2024-09-19T11:03:24.633 INFO:root:teuthology version: 1.2.2.dev2+g3752d38 2024-09-19T11:03:24.654 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T11:03:24.753 INFO:teuthology.run:Config: archive_path: /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417 branch: wip-yuval-test description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} email: null first_in_suite: false job_id: '7912417' kernel: kdb: 1 sha1: distro last_in_suite: false machine_type: smithi name: yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi no_nested_subset: false openstack: - volumes: count: 3 size: 10 os_type: centos os_version: 9.stream overrides: admin_socket: branch: wip-yuval-test ceph: conf: client: debug rgw: 20 setgroup: ceph setuser: ceph mgr: debug mgr: 20 debug ms: 1 mon: debug mon: 20 debug ms: 1 debug paxos: 20 osd: bdev async discard: true bdev enable discard: true bluestore allocator: bitmap bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug ms: 1 debug osd: 20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore flavor: default fs: xfs log-ignorelist: - \(MDS_ALL_DOWN\) - \(MDS_UP_LESS_THAN_MAX\) - \(PG_AVAILABILITY\) - \(PG_DEGRADED\) - \(POOL_APP_NOT_ENABLED\) - not have an application enabled sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 ceph-deploy: bluestore: true conf: client: log file: /var/log/ceph/ceph-$name.$pid.log mon: {} osd: bdev async discard: true bdev enable discard: true bluestore block size: 96636764160 bluestore fsck on mount: true debug bluefs: 1/20 debug bluestore: 1/20 debug rocksdb: 4/10 mon osd backfillfull_ratio: 0.85 mon osd full ratio: 0.9 mon osd nearfull ratio: 0.8 osd failsafe full ratio: 0.95 osd objectstore: bluestore fs: xfs install: ceph: flavor: default sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 rgw: ec-data-pool: true erasure_code_profile: crush-failure-domain: osd k: 3 m: 1 name: testprofile frontend: beast s3tests: slow_backend: true thrashosds: bdev_inject_crash: 2 bdev_inject_crash_probability: 0.5 workunit: branch: wip-yuval-test sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 owner: scheduled_yuvalif@teuthology priority: 100 repo: https://github.com/ceph/ceph-ci.git roles: - - mon.a - osd.0 - - mgr.x - client.0 - osd.1 - osd.2 - osd.3 seed: 4251 sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 sleep_before_teardown: 0 subset: 1/3 suite: rgw suite_branch: wip-yuval-test suite_path: /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa suite_relpath: qa suite_repo: https://git.ceph.com/ceph-ci.git suite_sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 targets: smithi037.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDFjJMVbHRGV3jhx5H3ivF+riokeC2WLVeBXRul9sYACBdXEiOrx1biLhgmXKnLP6XO3rGecAMlwO9hN+JExj5A= smithi102.front.sepia.ceph.com: ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiDAY5Qy2MNHA4XQniSHGqL+Gz0ohPpsnAM6bdjuUQ6wteVk6HMzqVHuWuN5s7uK6KDtzvpZ7k8OULiKRtOFDM= tasks: - install: null - ceph: conf: client: debug ms: 1 rgw gc obj min wait: 15 osd: debug ms: 1 debug objclass: 20 - rgw: client.0: null - radosgw-admin: null - radosgw-admin-rest: null teuthology: fragments_dropped: [] meta: {} postmerge: [] teuthology_branch: main teuthology_sha1: 3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a timestamp: 2024-09-19_08:49:34 tube: smithi user: yuvalif verbose: false worker_log: /home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856 2024-09-19T11:03:24.754 INFO:teuthology.run:suite_path is set to /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa; will attempt to use it 2024-09-19T11:03:24.754 INFO:teuthology.run:Found tasks at /home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa/tasks 2024-09-19T11:03:24.755 INFO:teuthology.run_tasks:Running task internal.check_packages... 2024-09-19T11:03:24.756 INFO:teuthology.task.internal:Checking packages... 2024-09-19T11:03:24.778 INFO:teuthology.task.internal:Checking packages for os_type 'centos', flavor 'default' and ceph hash '08af21e0d16078b88ddf808fe9ba2ab84dbe6754' 2024-09-19T11:03:24.778 WARNING:teuthology.packaging:More than one of ref, tag, branch, or sha1 supplied; using branch 2024-09-19T11:03:24.778 INFO:teuthology.packaging:ref: None 2024-09-19T11:03:24.778 INFO:teuthology.packaging:tag: None 2024-09-19T11:03:24.778 INFO:teuthology.packaging:branch: wip-yuval-test 2024-09-19T11:03:24.778 INFO:teuthology.packaging:sha1: 08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:03:24.778 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&ref=wip-yuval-test 2024-09-19T11:03:24.925 INFO:teuthology.task.internal:Found packages for ceph version 19.3.0-5012.g08af21e0 2024-09-19T11:03:24.927 INFO:teuthology.run_tasks:Running task internal.buildpackages_prep... 2024-09-19T11:03:24.935 INFO:teuthology.task.internal:no buildpackages task found 2024-09-19T11:03:24.935 INFO:teuthology.run_tasks:Running task internal.save_config... 2024-09-19T11:03:24.943 INFO:teuthology.task.internal:Saving configuration 2024-09-19T11:03:24.955 INFO:teuthology.run_tasks:Running task internal.check_lock... 2024-09-19T11:03:24.964 INFO:teuthology.task.internal.check_lock:Checking locks... 2024-09-19T11:03:24.992 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi037.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 10:58:18.361132', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDFjJMVbHRGV3jhx5H3ivF+riokeC2WLVeBXRul9sYACBdXEiOrx1biLhgmXKnLP6XO3rGecAMlwO9hN+JExj5A='} 2024-09-19T11:03:25.021 DEBUG:teuthology.task.internal.check_lock:machine status is {'name': 'smithi102.front.sepia.ceph.com', 'description': '/home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417', 'up': True, 'machine_type': 'smithi', 'is_vm': False, 'vm_host': None, 'os_type': 'centos', 'os_version': '9.stream', 'arch': 'x86_64', 'locked': True, 'locked_since': '2024-09-19 10:58:18.359540', 'locked_by': 'scheduled_yuvalif@teuthology', 'mac_address': None, 'ssh_pub_key': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiDAY5Qy2MNHA4XQniSHGqL+Gz0ohPpsnAM6bdjuUQ6wteVk6HMzqVHuWuN5s7uK6KDtzvpZ7k8OULiKRtOFDM='} 2024-09-19T11:03:25.022 INFO:teuthology.run_tasks:Running task internal.add_remotes... 2024-09-19T11:03:25.045 INFO:teuthology.task.internal:roles: ubuntu@smithi037.front.sepia.ceph.com - ['mon.a', 'osd.0'] 2024-09-19T11:03:25.045 INFO:teuthology.task.internal:roles: ubuntu@smithi102.front.sepia.ceph.com - ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3'] 2024-09-19T11:03:25.045 INFO:teuthology.run_tasks:Running task console_log... 2024-09-19T11:03:25.130 DEBUG:teuthology.exit:Installing handler: Handler(exiter=, func=.kill_console_loggers at 0x7fdc26033ac0>, signals=[15]) 2024-09-19T11:03:25.130 INFO:teuthology.run_tasks:Running task internal.connect... 2024-09-19T11:03:25.141 INFO:teuthology.task.internal:Opening connections... 2024-09-19T11:03:25.141 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T11:03:25.143 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:03:25.231 DEBUG:teuthology.task.internal:connecting to ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:03:25.232 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:03:25.316 INFO:teuthology.run_tasks:Running task internal.push_inventory... 2024-09-19T11:03:25.326 DEBUG:teuthology.orchestra.run.smithi037:> uname -m 2024-09-19T11:03:25.344 INFO:teuthology.orchestra.run.smithi037.stdout:x86_64 2024-09-19T11:03:25.345 DEBUG:teuthology.orchestra.run.smithi037:> cat /etc/os-release 2024-09-19T11:03:25.403 INFO:teuthology.orchestra.run.smithi037.stdout:NAME="CentOS Stream" 2024-09-19T11:03:25.403 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION="9" 2024-09-19T11:03:25.403 INFO:teuthology.orchestra.run.smithi037.stdout:ID="centos" 2024-09-19T11:03:25.403 INFO:teuthology.orchestra.run.smithi037.stdout:ID_LIKE="rhel fedora" 2024-09-19T11:03:25.403 INFO:teuthology.orchestra.run.smithi037.stdout:VERSION_ID="9" 2024-09-19T11:03:25.403 INFO:teuthology.orchestra.run.smithi037.stdout:PLATFORM_ID="platform:el9" 2024-09-19T11:03:25.403 INFO:teuthology.orchestra.run.smithi037.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T11:03:25.404 INFO:teuthology.orchestra.run.smithi037.stdout:ANSI_COLOR="0;31" 2024-09-19T11:03:25.404 INFO:teuthology.orchestra.run.smithi037.stdout:LOGO="fedora-logo-icon" 2024-09-19T11:03:25.404 INFO:teuthology.orchestra.run.smithi037.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T11:03:25.404 INFO:teuthology.orchestra.run.smithi037.stdout:HOME_URL="https://centos.org/" 2024-09-19T11:03:25.404 INFO:teuthology.orchestra.run.smithi037.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T11:03:25.404 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T11:03:25.404 INFO:teuthology.orchestra.run.smithi037.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T11:03:25.405 INFO:teuthology.lock.ops:Updating smithi037.front.sepia.ceph.com on lock server 2024-09-19T11:03:25.436 DEBUG:teuthology.orchestra.run.smithi102:> uname -m 2024-09-19T11:03:25.455 INFO:teuthology.orchestra.run.smithi102.stdout:x86_64 2024-09-19T11:03:25.456 DEBUG:teuthology.orchestra.run.smithi102:> cat /etc/os-release 2024-09-19T11:03:25.514 INFO:teuthology.orchestra.run.smithi102.stdout:NAME="CentOS Stream" 2024-09-19T11:03:25.514 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION="9" 2024-09-19T11:03:25.514 INFO:teuthology.orchestra.run.smithi102.stdout:ID="centos" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:ID_LIKE="rhel fedora" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:VERSION_ID="9" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:PLATFORM_ID="platform:el9" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:PRETTY_NAME="CentOS Stream 9" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:ANSI_COLOR="0;31" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:LOGO="fedora-logo-icon" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:CPE_NAME="cpe:/o:centos:centos:9" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:HOME_URL="https://centos.org/" 2024-09-19T11:03:25.515 INFO:teuthology.orchestra.run.smithi102.stdout:BUG_REPORT_URL="https://issues.redhat.com/" 2024-09-19T11:03:25.516 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT="Red Hat Enterprise Linux 9" 2024-09-19T11:03:25.516 INFO:teuthology.orchestra.run.smithi102.stdout:REDHAT_SUPPORT_PRODUCT_VERSION="CentOS Stream" 2024-09-19T11:03:25.516 INFO:teuthology.lock.ops:Updating smithi102.front.sepia.ceph.com on lock server 2024-09-19T11:03:25.543 INFO:teuthology.run_tasks:Running task internal.serialize_remote_roles... 2024-09-19T11:03:25.570 INFO:teuthology.run_tasks:Running task internal.check_conflict... 2024-09-19T11:03:25.575 INFO:teuthology.task.internal:Checking for old test directory... 2024-09-19T11:03:25.575 DEBUG:teuthology.orchestra.run.smithi037:> test '!' -e /home/ubuntu/cephtest 2024-09-19T11:03:25.579 DEBUG:teuthology.orchestra.run.smithi102:> test '!' -e /home/ubuntu/cephtest 2024-09-19T11:03:25.595 INFO:teuthology.run_tasks:Running task internal.check_ceph_data... 2024-09-19T11:03:25.636 INFO:teuthology.task.internal:Checking for non-empty /var/lib/ceph... 2024-09-19T11:03:25.636 DEBUG:teuthology.orchestra.run.smithi037:> test -z $(ls -A /var/lib/ceph) 2024-09-19T11:03:25.639 DEBUG:teuthology.orchestra.run.smithi102:> test -z $(ls -A /var/lib/ceph) 2024-09-19T11:03:25.737 INFO:teuthology.run_tasks:Running task internal.vm_setup... 2024-09-19T11:03:25.824 INFO:teuthology.run_tasks:Running task kernel... 2024-09-19T11:03:25.841 INFO:teuthology.task.kernel:normalize config orig: {'kdb': 1, 'sha1': 'distro'} 2024-09-19T11:03:25.841 INFO:teuthology.task.kernel:config {'mon.a': {'kdb': 1, 'sha1': 'distro'}, 'mgr.x': {'kdb': 1, 'sha1': 'distro'}}, timeout 300 2024-09-19T11:03:25.842 DEBUG:teuthology.orchestra.run.smithi037:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T11:03:25.842 DEBUG:teuthology.orchestra.run.smithi102:> test -f /run/.containerenv -o -f /.dockerenv 2024-09-19T11:03:25.859 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:03:25.859 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-19T11:03:25.860 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:03:25.860 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-19T11:03:25.916 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-503.el9.x86_64 2024-09-19T11:03:25.917 INFO:teuthology.task.kernel:Running kernel on smithi102: 5.14.0-503.el9.x86_64 2024-09-19T11:03:25.917 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum install -y kernel 2024-09-19T11:03:25.918 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-503.el9.x86_64 2024-09-19T11:03:25.918 INFO:teuthology.task.kernel:Running kernel on smithi037: 5.14.0-503.el9.x86_64 2024-09-19T11:03:25.919 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum install -y kernel 2024-09-19T11:03:28.230 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 14 MB/s | 8.3 MB 00:00 2024-09-19T11:03:29.404 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 4.7 MB/s | 8.3 MB 00:01 2024-09-19T11:03:30.523 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 16 MB/s | 20 MB 00:01 2024-09-19T11:03:31.422 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 22 MB/s | 20 MB 00:00 2024-09-19T11:03:36.090 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-19T11:03:37.039 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 3.8 MB/s | 6.5 MB 00:01 2024-09-19T11:03:37.549 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 73 kB/s | 19 kB 00:00 2024-09-19T11:03:38.436 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 30 MB/s | 23 MB 00:00 2024-09-19T11:03:38.748 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 42 kB/s | 19 kB 00:00 2024-09-19T11:03:39.844 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 23 MB/s | 23 MB 00:00 2024-09-19T11:03:43.834 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 44 kB/s | 1.7 kB 00:00 2024-09-19T11:03:45.417 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T11:03:45.724 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T11:03:45.724 INFO:teuthology.orchestra.run.smithi102.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T11:03:45.821 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:03:45.828 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:03:45.829 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-19T11:03:45.829 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:03:45.829 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 79 M 2024-09-19T11:03:45.829 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 126 M 2024-09-19T11:03:45.829 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:03:46.027 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 392 kB/s | 36 kB 00:00 2024-09-19T11:03:46.419 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 32 MB/s | 16 MB 00:00 2024-09-19T11:03:46.886 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 36 MB/s | 35 MB 00:00 2024-09-19T11:03:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): kernel-modules-core-5.14.0-508.el9.x86_6 26 MB/s | 29 MB 00:01 2024-09-19T11:03:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:03:47.145 INFO:teuthology.orchestra.run.smithi102.stdout:Total 60 MB/s | 79 MB 00:01 2024-09-19T11:03:47.407 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-239.el9.x86_64 is already installed. 2024-09-19T11:03:47.407 INFO:teuthology.orchestra.run.smithi037.stdout:Package kernel-5.14.0-503.el9.x86_64 is already installed. 2024-09-19T11:03:47.502 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:03:47.514 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout: kernel x86_64 5.14.0-508.el9 baseos 36 k 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core x86_64 5.14.0-508.el9 baseos 16 M 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules x86_64 5.14.0-508.el9 baseos 35 M 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core x86_64 5.14.0-508.el9 baseos 29 M 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-09-19T11:03:47.515 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:03:47.516 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 79 M 2024-09-19T11:03:47.516 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 126 M 2024-09-19T11:03:47.516 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:03:47.819 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:03:47.835 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): kernel-5.14.0-508.el9.x86_64.rpm 350 kB/s | 36 kB 00:00 2024-09-19T11:03:48.127 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): kernel-core-5.14.0-508.el9.x86_64.rpm 40 MB/s | 16 MB 00:00 2024-09-19T11:03:48.165 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:03:48.165 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:03:48.427 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): kernel-modules-core-5.14.0-508.el9.x86_6 48 MB/s | 29 MB 00:00 2024-09-19T11:03:48.961 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): kernel-modules-5.14.0-508.el9.x86_64.rpm 28 MB/s | 35 MB 00:01 2024-09-19T11:03:48.965 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:03:48.965 INFO:teuthology.orchestra.run.smithi037.stdout:Total 55 MB/s | 79 MB 00:01 2024-09-19T11:03:49.113 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:03:49.113 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:03:49.669 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:03:50.070 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:03:50.071 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:03:51.044 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:03:51.044 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:03:51.554 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:03:52.197 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T11:03:52.288 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T11:03:53.595 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:03:54.321 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-core-5.14.0-508.el9.x86_64 1/4 2024-09-19T11:03:54.403 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T11:03:55.058 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T11:03:55.183 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T11:03:57.164 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T11:03:57.306 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T11:04:00.031 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T11:04:00.067 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:02.430 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T11:04:02.474 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:04.899 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:07.625 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:42.898 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:42.938 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T11:04:43.285 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T11:04:43.286 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T11:04:44.169 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:44.169 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:04:44.169 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:04:44.169 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T11:04:44.170 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T11:04:44.170 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T11:04:44.170 INFO:teuthology.orchestra.run.smithi102.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T11:04:44.170 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:04:44.170 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:04:44.510 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T11:04:44.625 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T11:04:44.626 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T11:04:44.626 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T11:04:44.626 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T11:04:44.626 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T11:04:44.626 INFO:teuthology.task.kernel:Installing distro kernel on mgr.x... 2024-09-19T11:04:44.626 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi102.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T11:04:44.627 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T11:04:44.685 INFO:teuthology.orchestra.run.smithi102.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T11:04:44.686 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T11:04:44.687 DEBUG:teuthology.orchestra.run.smithi102:> sudo rpm -qi grub2-tools 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Name : grub2-tools 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Epoch : 1 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Version : 2.06 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Release : 82.el9 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Architecture: x86_64 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Group : Unspecified 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Size : 8274670 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:License : GPLv3+ 2024-09-19T11:04:44.720 INFO:teuthology.orchestra.run.smithi102.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:Packager : builder@centos.org 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:Vendor : CentOS 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:Summary : Support tools for GRUB. 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:Description : 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout:hardware devices. 2024-09-19T11:04:44.721 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:04:44.722 INFO:teuthology.orchestra.run.smithi102.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T11:04:44.722 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T11:04:44.722 INFO:teuthology.task.kernel:Updating grub on smithi102 to boot 5.14.0-508.el9.x86_64 2024-09-19T11:04:44.723 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T11:04:45.401 INFO:teuthology.orchestra.run.smithi102.stderr:Generating grub configuration file ... 2024-09-19T11:04:46.688 INFO:teuthology.orchestra.run.smithi102.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T11:04:46.723 INFO:teuthology.orchestra.run.smithi102.stderr:done 2024-09-19T11:04:46.725 DEBUG:teuthology.orchestra.run.smithi102:> mktemp 2024-09-19T11:04:46.741 INFO:teuthology.orchestra.run.smithi102.stdout:/tmp/tmp.ggoRy3hBTL 2024-09-19T11:04:46.741 DEBUG:teuthology.orchestra.run.smithi102:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.ggoRy3hBTL 2024-09-19T11:04:46.808 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0666 /tmp/tmp.ggoRy3hBTL 2024-09-19T11:04:46.821 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:46.862 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-modules-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:46.946 DEBUG:teuthology.orchestra.remote:smithi102:/tmp/tmp.ggoRy3hBTL is 6KB 2024-09-19T11:04:46.995 DEBUG:teuthology.orchestra.run.smithi102:> rm -fr /tmp/tmp.ggoRy3hBTL 2024-09-19T11:04:47.010 DEBUG:teuthology.orchestra.run.smithi102:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T11:04:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T11:04:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T11:04:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T11:04:47.075 INFO:teuthology.orchestra.run.smithi102.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T11:04:47.076 DEBUG:teuthology.orchestra.run.smithi102:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T11:04:47.179 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: kernel-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:47.179 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-5.14.0-508.el9.x86_64 1/4 2024-09-19T11:04:47.179 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-core-5.14.0-508.el9.x86_64 2/4 2024-09-19T11:04:47.179 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-5.14.0-508.el9.x86_64 3/4 2024-09-19T11:04:47.219 DEBUG:teuthology.orchestra.run.smithi102:> sudo shutdown -r now 2024-09-19T11:04:48.054 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : kernel-modules-core-5.14.0-508.el9.x86_64 4/4 2024-09-19T11:04:48.054 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:04:48.054 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:04:48.055 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-5.14.0-508.el9.x86_64 2024-09-19T11:04:48.055 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-core-5.14.0-508.el9.x86_64 2024-09-19T11:04:48.055 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-5.14.0-508.el9.x86_64 2024-09-19T11:04:48.055 INFO:teuthology.orchestra.run.smithi037.stdout: kernel-modules-core-5.14.0-508.el9.x86_64 2024-09-19T11:04:48.055 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:04:48.055 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:04:48.412 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T11:04:48.508 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T11:04:48.508 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T11:04:48.508 INFO:teuthology.task.kernel:Not newest distro kernel. Current: 5.14.0-503.el9.x86_64 Expected: 5.14.0-508.el9.x86_64 2024-09-19T11:04:48.508 INFO:teuthology.task.kernel:Skipping firmware on distro kernel 2024-09-19T11:04:48.509 DEBUG:teuthology.task.kernel:src is distro, skipping download 2024-09-19T11:04:48.509 INFO:teuthology.task.kernel:Installing distro kernel on mon.a... 2024-09-19T11:04:48.509 DEBUG:teuthology.task.kernel:install_kernel(remote=ubuntu@smithi037.front.sepia.ceph.com, path=None, version=distro) 2024-09-19T11:04:48.509 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q kernel | sort -rV | head -n 1 2024-09-19T11:04:48.569 INFO:teuthology.orchestra.run.smithi037.stdout:kernel-5.14.0-508.el9.x86_64 2024-09-19T11:04:48.569 DEBUG:teuthology.task.kernel:get_latest_image_version_rpm: 5.14.0-508.el9.x86_64 2024-09-19T11:04:48.569 DEBUG:teuthology.orchestra.run.smithi037:> sudo rpm -qi grub2-tools 2024-09-19T11:04:48.600 INFO:teuthology.orchestra.run.smithi037.stdout:Name : grub2-tools 2024-09-19T11:04:48.600 INFO:teuthology.orchestra.run.smithi037.stdout:Epoch : 1 2024-09-19T11:04:48.600 INFO:teuthology.orchestra.run.smithi037.stdout:Version : 2.06 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Release : 82.el9 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Architecture: x86_64 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Install Date: Wed 28 Aug 2024 09:06:27 PM UTC 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Group : Unspecified 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Size : 8274670 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:License : GPLv3+ 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Signature : RSA/SHA256, Mon 01 Jul 2024 07:46:42 AM UTC, Key ID 05b555b38483c65d 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Source RPM : grub2-2.06-82.el9.src.rpm 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Build Date : Fri 28 Jun 2024 09:24:44 AM UTC 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Build Host : x86-05.stream.rdu2.redhat.com 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Packager : builder@centos.org 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Vendor : CentOS 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:URL : http://www.gnu.org/software/grub/ 2024-09-19T11:04:48.601 INFO:teuthology.orchestra.run.smithi037.stdout:Summary : Support tools for GRUB. 2024-09-19T11:04:48.602 INFO:teuthology.orchestra.run.smithi037.stdout:Description : 2024-09-19T11:04:48.602 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:04:48.602 INFO:teuthology.orchestra.run.smithi037.stdout:The GRand Unified Bootloader (GRUB) is a highly configurable and 2024-09-19T11:04:48.602 INFO:teuthology.orchestra.run.smithi037.stdout:customizable bootloader with modular architecture. It supports a rich 2024-09-19T11:04:48.602 INFO:teuthology.orchestra.run.smithi037.stdout:variety of kernel formats, file systems, computer architectures and 2024-09-19T11:04:48.602 INFO:teuthology.orchestra.run.smithi037.stdout:hardware devices. 2024-09-19T11:04:48.602 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:04:48.602 INFO:teuthology.orchestra.run.smithi037.stdout:This subpackage provides tools for support of all platforms. 2024-09-19T11:04:48.603 INFO:teuthology.task.kernel:Updating Grub Version: grub2 2024-09-19T11:04:48.603 INFO:teuthology.task.kernel:Updating grub on smithi037 to boot 5.14.0-508.el9.x86_64 2024-09-19T11:04:48.603 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-mkconfig -o /boot/grub2/grub.cfg 2024-09-19T11:04:49.258 INFO:teuthology.orchestra.run.smithi037.stderr:Generating grub configuration file ... 2024-09-19T11:04:50.585 INFO:teuthology.orchestra.run.smithi037.stderr:Adding boot menu entry for UEFI Firmware Settings ... 2024-09-19T11:04:50.614 INFO:teuthology.orchestra.run.smithi037.stderr:done 2024-09-19T11:04:50.616 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-19T11:04:50.631 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.gMh1WnFnnF 2024-09-19T11:04:50.632 DEBUG:teuthology.orchestra.run.smithi037:> sudo cp /boot/grub2/grub.cfg /tmp/tmp.gMh1WnFnnF 2024-09-19T11:04:50.698 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.gMh1WnFnnF 2024-09-19T11:04:50.832 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.gMh1WnFnnF is 6KB 2024-09-19T11:04:50.879 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.gMh1WnFnnF 2024-09-19T11:04:50.894 DEBUG:teuthology.orchestra.run.smithi037:> sudo /bin/ls /boot/loader/entries || true 2024-09-19T11:04:50.956 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-0-rescue.conf 2024-09-19T11:04:50.956 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-239.el9.x86_64.conf 2024-09-19T11:04:50.956 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-503.el9.x86_64.conf 2024-09-19T11:04:50.956 INFO:teuthology.orchestra.run.smithi037.stdout:fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64.conf 2024-09-19T11:04:50.957 DEBUG:teuthology.orchestra.run.smithi037:> sudo grub2-set-default fbf6b6fa6cf04654a0e563f30ecbf43a-5.14.0-508.el9.x86_64 2024-09-19T11:04:51.117 DEBUG:teuthology.orchestra.run.smithi037:> sudo shutdown -r now 2024-09-19T11:05:17.248 INFO:teuthology.task.kernel:Checking client mgr.x for new kernel version... 2024-09-19T11:05:17.249 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T11:05:17.250 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:05:21.124 INFO:teuthology.task.kernel:Checking client mon.a for new kernel version... 2024-09-19T11:05:21.125 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T11:05:21.125 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:05:35.805 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-19T11:05:39.645 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-19T11:05:44.810 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T11:05:44.811 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:05:47.901 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.102 2024-09-19T11:05:48.647 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T11:05:48.648 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:05:59.908 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T11:05:59.909 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:06:07.041 DEBUG:teuthology.orchestra.remote:[Errno None] Unable to connect to port 22 on 172.21.15.37 2024-09-19T11:06:19.053 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T11:06:19.054 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:06:20.337 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-19T11:06:20.931 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T11:06:20.932 INFO:teuthology.task.kernel:Checking kernel version of mon.a, want "5.14.0-508.el9.x86_64"... 2024-09-19T11:06:20.932 DEBUG:teuthology.orchestra.run.smithi037:> uname -r 2024-09-19T11:06:20.947 INFO:teuthology.orchestra.run.smithi037.stdout:5.14.0-508.el9.x86_64 2024-09-19T11:06:20.948 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T11:06:20.948 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T11:06:20.948 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T11:06:21.948 INFO:teuthology.task.kernel:Enabling kdb on mon.a... 2024-09-19T11:06:21.949 DEBUG:teuthology.orchestra.run.smithi037:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T11:06:22.039 INFO:teuthology.orchestra.run.smithi037.stdout:ttyS1 2024-09-19T11:06:22.060 DEBUG:teuthology.parallel:result is None 2024-09-19T11:06:31.829 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-19T11:06:32.181 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T11:06:32.181 INFO:teuthology.task.kernel:Checking kernel version of mgr.x, want "5.14.0-508.el9.x86_64"... 2024-09-19T11:06:32.182 DEBUG:teuthology.orchestra.run.smithi102:> uname -r 2024-09-19T11:06:32.202 INFO:teuthology.orchestra.run.smithi102.stdout:5.14.0-508.el9.x86_64 2024-09-19T11:06:32.202 DEBUG:teuthology.task.kernel:current kernel version is 5.14.0-508.el9.x86_64 vs 5.14.0-508.el9.x86_64 2024-09-19T11:06:32.202 DEBUG:teuthology.task.kernel:utsrelease strings match, do not need to install 2024-09-19T11:06:32.202 DEBUG:teuthology.task.kernel:Distro of this test job: centos 2024-09-19T11:06:33.203 INFO:teuthology.task.kernel:Enabling kdb on mgr.x... 2024-09-19T11:06:33.203 DEBUG:teuthology.orchestra.run.smithi102:> echo ttyS1 | sudo tee /sys/module/kgdboc/parameters/kgdboc 2024-09-19T11:06:33.316 INFO:teuthology.orchestra.run.smithi102.stdout:ttyS1 2024-09-19T11:06:33.340 DEBUG:teuthology.parallel:result is None 2024-09-19T11:06:33.341 INFO:teuthology.run_tasks:Running task internal.base... 2024-09-19T11:06:33.348 INFO:teuthology.task.internal:Creating test directory... 2024-09-19T11:06:33.349 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T11:06:33.353 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest 2024-09-19T11:06:33.402 INFO:teuthology.run_tasks:Running task internal.archive_upload... 2024-09-19T11:06:33.408 INFO:teuthology.run_tasks:Running task internal.archive... 2024-09-19T11:06:33.415 INFO:teuthology.task.internal:Creating archive directory... 2024-09-19T11:06:33.416 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T11:06:33.418 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive 2024-09-19T11:06:33.491 INFO:teuthology.run_tasks:Running task internal.coredump... 2024-09-19T11:06:33.499 INFO:teuthology.task.internal:Enabling coredump saving... 2024-09-19T11:06:33.499 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T11:06:33.502 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/archive/coredump && sudo sysctl -w kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core && echo kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core | sudo tee -a /etc/sysctl.conf 2024-09-19T11:06:33.534 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T11:06:33.546 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T11:06:33.634 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = /home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T11:06:33.664 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern=/home/ubuntu/cephtest/archive/coredump/%t.%p.core 2024-09-19T11:06:33.668 INFO:teuthology.run_tasks:Running task internal.sudo... 2024-09-19T11:06:33.674 INFO:teuthology.task.internal:Configuring sudo... 2024-09-19T11:06:33.675 DEBUG:teuthology.orchestra.run.smithi037:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T11:06:33.677 DEBUG:teuthology.orchestra.run.smithi102:> sudo sed -i.orig.teuthology -e 's/^\([^#]*\) \(requiretty\)/\1 !\2/g' -e 's/^\([^#]*\) !\(visiblepw\)/\1 \2/g' /etc/sudoers 2024-09-19T11:06:33.727 INFO:teuthology.run_tasks:Running task internal.syslog... 2024-09-19T11:06:33.736 INFO:teuthology.task.internal.syslog:Starting syslog monitoring... 2024-09-19T11:06:33.736 DEBUG:teuthology.orchestra.run.smithi037:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T11:06:33.747 DEBUG:teuthology.orchestra.run.smithi102:> mkdir -p -m0755 -- /home/ubuntu/cephtest/archive/syslog 2024-09-19T11:06:33.775 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T11:06:33.858 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T11:06:33.894 DEBUG:teuthology.orchestra.run.smithi037:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T11:06:33.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T11:06:34.021 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:06:34.021 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T11:06:34.088 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T11:06:34.178 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/kern.log 2024-09-19T11:06:34.242 DEBUG:teuthology.orchestra.run.smithi102:> install -m 666 /dev/null /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T11:06:34.293 DEBUG:teuthology.orchestra.run.smithi102:> sudo chcon system_u:object_r:var_log_t:s0 /home/ubuntu/cephtest/archive/syslog/misc.log 2024-09-19T11:06:34.323 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:06:34.323 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/rsyslog.d/80-cephtest.conf 2024-09-19T11:06:34.384 DEBUG:teuthology.orchestra.run.smithi037:> sudo service rsyslog restart 2024-09-19T11:06:34.387 DEBUG:teuthology.orchestra.run.smithi102:> sudo service rsyslog restart 2024-09-19T11:06:34.437 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T11:06:34.467 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T11:06:34.973 INFO:teuthology.run_tasks:Running task internal.timer... 2024-09-19T11:06:34.980 INFO:teuthology.task.internal:Starting timer... 2024-09-19T11:06:34.980 INFO:teuthology.run_tasks:Running task pcp... 2024-09-19T11:06:34.993 INFO:teuthology.run_tasks:Running task selinux... 2024-09-19T11:06:35.002 DEBUG:teuthology.orchestra.run.smithi037:> sudo service auditd rotate 2024-09-19T11:06:35.068 INFO:teuthology.orchestra.run.smithi037.stdout:Rotating logs: 2024-09-19T11:06:35.071 DEBUG:teuthology.orchestra.run.smithi102:> sudo service auditd rotate 2024-09-19T11:06:35.259 INFO:teuthology.orchestra.run.smithi102.stdout:Rotating logs: 2024-09-19T11:06:35.261 DEBUG:teuthology.task.selinux:Getting current SELinux state 2024-09-19T11:06:35.261 DEBUG:teuthology.orchestra.run.smithi037:> /usr/sbin/getenforce 2024-09-19T11:06:35.316 INFO:teuthology.orchestra.run.smithi037.stdout:Permissive 2024-09-19T11:06:35.316 DEBUG:teuthology.orchestra.run.smithi102:> /usr/sbin/getenforce 2024-09-19T11:06:35.351 INFO:teuthology.orchestra.run.smithi102.stdout:Permissive 2024-09-19T11:06:35.351 DEBUG:teuthology.task.selinux:Existing SELinux modes: {'ubuntu@smithi037.front.sepia.ceph.com': 'permissive', 'ubuntu@smithi102.front.sepia.ceph.com': 'permissive'} 2024-09-19T11:06:35.351 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-19T11:06:35.379 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:06:35.380 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-19T11:06:35.413 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:06:35.414 INFO:teuthology.task.selinux:Putting SELinux into permissive mode 2024-09-19T11:06:35.414 DEBUG:teuthology.orchestra.run.smithi037:> sudo /usr/sbin/setenforce permissive 2024-09-19T11:06:35.452 DEBUG:teuthology.orchestra.run.smithi102:> sudo /usr/sbin/setenforce permissive 2024-09-19T11:06:35.492 INFO:teuthology.run_tasks:Running task ansible.cephlab... 2024-09-19T11:06:35.502 DEBUG:teuthology.repo_utils:Resetting repo at /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main to origin/main 2024-09-19T11:06:35.514 INFO:teuthology.task.ansible:Playbook: [{'import_playbook': 'ansible_managed.yml'}, {'import_playbook': 'teuthology.yml'}, {'hosts': 'testnodes', 'tasks': [{'set_fact': {'ran_from_cephlab_playbook': True}}]}, {'import_playbook': 'testnodes.yml'}, {'import_playbook': 'container-host.yml'}, {'import_playbook': 'cobbler.yml'}, {'import_playbook': 'paddles.yml'}, {'import_playbook': 'pulpito.yml'}, {'hosts': 'testnodes', 'become': True, 'tasks': [{'name': 'Touch /ceph-qa-ready', 'file': {'path': '/ceph-qa-ready', 'state': 'touch'}, 'when': 'ran_from_cephlab_playbook|bool'}]}] 2024-09-19T11:06:35.515 DEBUG:teuthology.task.ansible:Running ansible-playbook -v --extra-vars '{"ansible_ssh_user": "ubuntu"}' -i /etc/ansible/hosts --limit smithi037.front.sepia.ceph.com,smithi102.front.sepia.ceph.com /home/teuthworker/src/git.ceph.com_ceph-cm-ansible_main/cephlab.yml 2024-09-19T11:10:24.165 DEBUG:teuthology.task.ansible:Reconnecting to [Remote(name='ubuntu@smithi037.front.sepia.ceph.com'), Remote(name='ubuntu@smithi102.front.sepia.ceph.com')] 2024-09-19T11:10:24.167 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T11:10:24.168 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi037.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:10:24.263 DEBUG:teuthology.orchestra.run.smithi037:> true 2024-09-19T11:10:24.341 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi037.front.sepia.ceph.com' 2024-09-19T11:10:24.342 INFO:teuthology.orchestra.remote:Trying to reconnect to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T11:10:24.342 DEBUG:teuthology.orchestra.connection:{'hostname': 'smithi102.front.sepia.ceph.com', 'username': 'ubuntu', 'timeout': 60} 2024-09-19T11:10:24.436 DEBUG:teuthology.orchestra.run.smithi102:> true 2024-09-19T11:10:24.516 INFO:teuthology.orchestra.remote:Successfully reconnected to host 'ubuntu@smithi102.front.sepia.ceph.com' 2024-09-19T11:10:24.516 INFO:teuthology.run_tasks:Running task clock... 2024-09-19T11:10:24.528 INFO:teuthology.task.clock:Syncing clocks and checking initial clock skew... 2024-09-19T11:10:24.528 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T11:10:24.529 DEBUG:teuthology.orchestra.run.smithi037:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T11:10:24.532 INFO:teuthology.orchestra.run:Running command with timeout 360 2024-09-19T11:10:24.532 DEBUG:teuthology.orchestra.run.smithi102:> sudo systemctl stop ntp.service || sudo systemctl stop ntpd.service || sudo systemctl stop chronyd.service ; sudo ntpd -gq || sudo chronyc makestep ; sudo systemctl start ntp.service || sudo systemctl start ntpd.service || sudo systemctl start chronyd.service ; PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T11:10:24.562 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T11:10:24.577 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T11:10:24.585 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntp.service: Unit ntp.service not loaded. 2024-09-19T11:10:24.599 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to stop ntpd.service: Unit ntpd.service not loaded. 2024-09-19T11:10:24.603 INFO:teuthology.orchestra.run.smithi037.stderr:sudo: ntpd: command not found 2024-09-19T11:10:24.615 INFO:teuthology.orchestra.run.smithi037.stdout:506 Cannot talk to daemon 2024-09-19T11:10:24.622 INFO:teuthology.orchestra.run.smithi102.stderr:sudo: ntpd: command not found 2024-09-19T11:10:24.630 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T11:10:24.633 INFO:teuthology.orchestra.run.smithi102.stdout:506 Cannot talk to daemon 2024-09-19T11:10:24.645 INFO:teuthology.orchestra.run.smithi037.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T11:10:24.647 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntp.service: Unit ntp.service not found. 2024-09-19T11:10:24.661 INFO:teuthology.orchestra.run.smithi102.stderr:Failed to start ntpd.service: Unit ntpd.service not found. 2024-09-19T11:10:24.699 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-19T11:10:24.703 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T11:10:24.703 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-19T11:10:24.703 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:10:24.703 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:10:24.704 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:10:24.704 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:10:24.719 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-19T11:10:24.723 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T11:10:24.723 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-19T11:10:24.723 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv01.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:10:24.723 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv02.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:10:24.723 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv03.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:10:24.723 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 6 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:10:24.724 INFO:teuthology.run_tasks:Running task install... 2024-09-19T11:10:24.734 DEBUG:teuthology.task.install:project ceph 2024-09-19T11:10:24.735 DEBUG:teuthology.task.install:INSTALL overrides: {'ceph': {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}} 2024-09-19T11:10:24.735 DEBUG:teuthology.task.install:config {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'} 2024-09-19T11:10:24.735 INFO:teuthology.task.install:Using flavor: default 2024-09-19T11:10:24.740 DEBUG:teuthology.task.install:Package list is: {'deb': ['ceph', 'cephadm', 'ceph-mds', 'ceph-mgr', 'ceph-common', 'ceph-fuse', 'ceph-test', 'ceph-volume', 'radosgw', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'libcephfs2', 'libcephfs-dev', 'librados2', 'librbd1', 'rbd-fuse'], 'rpm': ['ceph-radosgw', 'ceph-test', 'ceph', 'ceph-base', 'cephadm', 'ceph-immutable-object-cache', 'ceph-mgr', 'ceph-mgr-dashboard', 'ceph-mgr-diskprediction-local', 'ceph-mgr-rook', 'ceph-mgr-cephadm', 'ceph-fuse', 'ceph-volume', 'librados-devel', 'libcephfs2', 'libcephfs-devel', 'librados2', 'librbd1', 'python3-rados', 'python3-rgw', 'python3-cephfs', 'python3-rbd', 'rbd-fuse', 'rbd-mirror', 'rbd-nbd']} 2024-09-19T11:10:24.741 INFO:teuthology.task.install:extra packages: [] 2024-09-19T11:10:24.741 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'tag': None, 'wait_for_package': False} 2024-09-19T11:10:24.742 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:10:24.744 DEBUG:teuthology.task.install.rpm:_update_package_list_and_install: config is {'branch': None, 'cleanup': None, 'debuginfo': None, 'downgrade_packages': [], 'exclude_packages': [], 'extra_packages': [], 'extra_system_packages': [], 'extras': None, 'enable_coprs': [], 'flavor': 'default', 'install_ceph_packages': True, 'packages': {}, 'project': 'ceph', 'repos_only': False, 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'tag': None, 'wait_for_package': False} 2024-09-19T11:10:24.744 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:10:24.899 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/ 2024-09-19T11:10:24.899 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5012.g08af21e0 2024-09-19T11:10:24.917 INFO:teuthology.task.install.rpm:Pulling from https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/ 2024-09-19T11:10:24.917 INFO:teuthology.task.install.rpm:Package version is 19.3.0-5012.g08af21e0 2024-09-19T11:10:25.023 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T11:10:25.023 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:10:25.023 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T11:10:25.035 INFO:teuthology.packaging:Writing yum repo: [ceph] name=ceph packages for $basearch baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/$basearch enabled=1 gpgcheck=0 type=rpm-md [ceph-noarch] name=ceph noarch packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/noarch enabled=1 gpgcheck=0 type=rpm-md [ceph-source] name=ceph source packages baseurl=https://1.chacra.ceph.com/r/ceph/wip-yuval-test/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/centos/9/flavors/default/SRPMS enabled=1 gpgcheck=0 type=rpm-md 2024-09-19T11:10:25.035 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:10:25.035 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/yum.repos.d/ceph.repo 2024-09-19T11:10:25.049 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-19T11:10:25.049 DEBUG:teuthology.orchestra.run.smithi102:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T11:10:25.063 INFO:teuthology.task.install.rpm:Installing packages: ceph-radosgw, ceph-test, ceph, ceph-base, cephadm, ceph-immutable-object-cache, ceph-mgr, ceph-mgr-dashboard, ceph-mgr-diskprediction-local, ceph-mgr-rook, ceph-mgr-cephadm, ceph-fuse, ceph-volume, librados-devel, libcephfs2, libcephfs-devel, librados2, librbd1, python3-rados, python3-rgw, python3-cephfs, python3-rbd, rbd-fuse, rbd-mirror, rbd-nbd on remote rpm x86_64 2024-09-19T11:10:25.063 DEBUG:teuthology.orchestra.run.smithi037:> if test -f /etc/yum.repos.d/ceph.repo ; then sudo sed -i -e ':a;N;$!ba;s/enabled=1\ngpg/enabled=1\npriority=1\ngpg/g' -e 's;ref/[a-zA-Z0-9_-]*/;sha1/08af21e0d16078b88ddf808fe9ba2ab84dbe6754/;g' /etc/yum.repos.d/ceph.repo ; fi 2024-09-19T11:10:25.114 DEBUG:teuthology.orchestra.run.smithi102:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T11:10:25.130 DEBUG:teuthology.orchestra.run.smithi037:> sudo touch -a /etc/yum/pluginconf.d/priorities.conf ; test -e /etc/yum/pluginconf.d/priorities.conf.orig || sudo cp -af /etc/yum/pluginconf.d/priorities.conf /etc/yum/pluginconf.d/priorities.conf.orig 2024-09-19T11:10:25.189 DEBUG:teuthology.orchestra.run.smithi102:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T11:10:25.208 DEBUG:teuthology.orchestra.run.smithi037:> grep check_obsoletes /etc/yum/pluginconf.d/priorities.conf && sudo sed -i 's/check_obsoletes.*0/check_obsoletes = 1/g' /etc/yum/pluginconf.d/priorities.conf || echo 'check_obsoletes = 1' | sudo tee -a /etc/yum/pluginconf.d/priorities.conf 2024-09-19T11:10:25.254 INFO:teuthology.orchestra.run.smithi102.stdout:check_obsoletes = 1 2024-09-19T11:10:25.256 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum clean all 2024-09-19T11:10:25.273 INFO:teuthology.orchestra.run.smithi037.stdout:check_obsoletes = 1 2024-09-19T11:10:25.275 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum clean all 2024-09-19T11:10:25.494 INFO:teuthology.orchestra.run.smithi102.stdout:45 files removed 2024-09-19T11:10:25.511 INFO:teuthology.orchestra.run.smithi037.stdout:45 files removed 2024-09-19T11:10:25.521 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-radosgw 2024-09-19T11:10:25.538 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-radosgw 2024-09-19T11:10:26.073 INFO:teuthology.orchestra.run.smithi102.stdout:ceph packages for x86_64 314 kB/s | 84 kB 00:00 2024-09-19T11:10:26.100 INFO:teuthology.orchestra.run.smithi037.stdout:ceph packages for x86_64 321 kB/s | 84 kB 00:00 2024-09-19T11:10:26.365 INFO:teuthology.orchestra.run.smithi102.stdout:ceph noarch packages 97 kB/s | 24 kB 00:00 2024-09-19T11:10:26.376 INFO:teuthology.orchestra.run.smithi037.stdout:ceph noarch packages 105 kB/s | 24 kB 00:00 2024-09-19T11:10:26.641 INFO:teuthology.orchestra.run.smithi102.stdout:ceph source packages 8.1 kB/s | 1.9 kB 00:00 2024-09-19T11:10:26.643 INFO:teuthology.orchestra.run.smithi037.stdout:ceph source packages 8.5 kB/s | 1.9 kB 00:00 2024-09-19T11:10:27.476 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - BaseOS 10 MB/s | 8.3 MB 00:00 2024-09-19T11:10:28.244 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - BaseOS 5.3 MB/s | 8.3 MB 00:01 2024-09-19T11:10:29.284 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - AppStream 27 MB/s | 20 MB 00:00 2024-09-19T11:10:30.036 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - AppStream 29 MB/s | 20 MB 00:00 2024-09-19T11:10:34.643 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - CRB 4.1 MB/s | 6.5 MB 00:01 2024-09-19T11:10:34.954 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - CRB 6.5 MB/s | 6.5 MB 00:01 2024-09-19T11:10:36.446 INFO:teuthology.orchestra.run.smithi037.stdout:CentOS Stream 9 - Extras packages 86 kB/s | 19 kB 00:00 2024-09-19T11:10:36.577 INFO:teuthology.orchestra.run.smithi102.stdout:CentOS Stream 9 - Extras packages 31 kB/s | 19 kB 00:00 2024-09-19T11:10:37.531 INFO:teuthology.orchestra.run.smithi102.stdout:Extra Packages for Enterprise Linux 27 MB/s | 23 MB 00:00 2024-09-19T11:10:37.592 INFO:teuthology.orchestra.run.smithi037.stdout:Extra Packages for Enterprise Linux 22 MB/s | 23 MB 00:01 2024-09-19T11:10:42.937 INFO:teuthology.orchestra.run.smithi102.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T11:10:43.215 INFO:teuthology.orchestra.run.smithi037.stdout:lab-extras 29 kB/s | 1.7 kB 00:00 2024-09-19T11:10:45.162 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:10:45.173 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:10:45.173 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:10:45.173 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:10:45.173 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:10:45.173 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 11 M 2024-09-19T11:10:45.173 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrading: 2024-09-19T11:10:45.173 INFO:teuthology.orchestra.run.smithi102.stdout: librados2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.5 M 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.2 M 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 5.5 M 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 22 M 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 25 k 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 755 k 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T11:10:45.174 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 509 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 5.5 M 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 45 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 148 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 161 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 321 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 307 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 99 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T11:10:45.175 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout:Installing weak dependencies: 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout:Install 31 Packages 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout:Upgrade 2 Packages 2024-09-19T11:10:45.176 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:10:45.177 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 62 M 2024-09-19T11:10:45.177 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:10:45.536 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:10:45.539 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 11 M 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrading: 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: librados2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.5 M 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.2 M 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options x86_64 1.75.0-8.el9 appstream 107 k 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 5.5 M 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 22 M 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 25 k 2024-09-19T11:10:45.540 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs x86_64 2.9.1-3.el9 epel 308 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow x86_64 9.0.0-11.el9 epel 4.4 M 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc noarch 9.0.0-11.el9 epel 26 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 755 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd x86_64 1.20.2-2.el9 appstream 171 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: liboath x86_64 2.6.7-2.el9 epel 49 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj x86_64 1.12.1-1.el9 appstream 160 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq x86_64 0.11.0-7.el9 appstream 45 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 509 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka x86_64 1.6.1-102.el9 appstream 662 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2 x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 5.5 M 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind x86_64 1.6.2-1.el9 epel 67 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust x86_64 2.12.0-6.el9 appstream 292 k 2024-09-19T11:10:45.541 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs x86_64 9.0.0-11.el9 epel 839 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 45 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 148 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 161 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable noarch 0.7.2-27.el9 appstream 42 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 321 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 307 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 99 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib x86_64 24.02.0-1.el9 appstream 221 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs x86_64 1.2.0-1.el9 appstream 47 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: re2 x86_64 1:20211101-20.el9 epel 191 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: thrift x86_64 0.15.0-2.el9 epel 1.6 M 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout:Installing weak dependencies: 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service x86_64 24.02.0-1.el9 appstream 36 k 2024-09-19T11:10:45.542 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:10:45.543 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:10:45.543 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:10:45.543 INFO:teuthology.orchestra.run.smithi037.stdout:Install 31 Packages 2024-09-19T11:10:45.543 INFO:teuthology.orchestra.run.smithi037.stdout:Upgrade 2 Packages 2024-09-19T11:10:45.543 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:10:45.543 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 62 M 2024-09-19T11:10:45.543 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:10:46.114 INFO:teuthology.orchestra.run.smithi102.stdout:(1/33): ceph-base-19.3.0-5012.g08af21e0.el9.x86 12 MB/s | 5.5 MB 00:00 2024-09-19T11:10:46.180 INFO:teuthology.orchestra.run.smithi102.stdout:(2/33): ceph-selinux-19.3.0-5012.g08af21e0.el9. 378 kB/s | 25 kB 00:00 2024-09-19T11:10:46.272 INFO:teuthology.orchestra.run.smithi102.stdout:(3/33): libcephfs2-19.3.0-5012.g08af21e0.el9.x8 8.0 MB/s | 755 kB 00:00 2024-09-19T11:10:46.356 INFO:teuthology.orchestra.run.smithi102.stdout:(4/33): libradosstriper1-19.3.0-5012.g08af21e0. 6.0 MB/s | 509 kB 00:00 2024-09-19T11:10:46.681 INFO:teuthology.orchestra.run.smithi102.stdout:(5/33): ceph-radosgw-19.3.0-5012.g08af21e0.el9. 11 MB/s | 11 MB 00:01 2024-09-19T11:10:46.782 INFO:teuthology.orchestra.run.smithi102.stdout:(6/33): librgw2-19.3.0-5012.g08af21e0.el9.x86_6 13 MB/s | 5.5 MB 00:00 2024-09-19T11:10:46.807 INFO:teuthology.orchestra.run.smithi102.stdout:(7/33): python3-ceph-argparse-19.3.0-5012.g08af 361 kB/s | 45 kB 00:00 2024-09-19T11:10:46.840 INFO:teuthology.orchestra.run.smithi102.stdout:(8/33): python3-ceph-common-19.3.0-5012.g08af21 2.5 MB/s | 148 kB 00:00 2024-09-19T11:10:46.865 INFO:teuthology.orchestra.run.smithi102.stdout:(9/33): python3-cephfs-19.3.0-5012.g08af21e0.el 2.7 MB/s | 161 kB 00:00 2024-09-19T11:10:46.899 INFO:teuthology.orchestra.run.smithi102.stdout:(10/33): python3-rados-19.3.0-5012.g08af21e0.el 5.3 MB/s | 321 kB 00:00 2024-09-19T11:10:46.933 INFO:teuthology.orchestra.run.smithi102.stdout:(11/33): python3-rbd-19.3.0-5012.g08af21e0.el9. 4.5 MB/s | 307 kB 00:00 2024-09-19T11:10:46.958 INFO:teuthology.orchestra.run.smithi102.stdout:(12/33): python3-rgw-19.3.0-5012.g08af21e0.el9. 1.7 MB/s | 99 kB 00:00 2024-09-19T11:10:47.108 INFO:teuthology.orchestra.run.smithi037.stdout:(1/33): ceph-base-19.3.0-5012.g08af21e0.el9.x86 4.1 MB/s | 5.5 MB 00:01 2024-09-19T11:10:47.158 INFO:teuthology.orchestra.run.smithi037.stdout:(2/33): ceph-selinux-19.3.0-5012.g08af21e0.el9. 505 kB/s | 25 kB 00:00 2024-09-19T11:10:47.175 INFO:teuthology.orchestra.run.smithi102.stdout:(13/33): ceph-common-19.3.0-5012.g08af21e0.el9. 14 MB/s | 22 MB 00:01 2024-09-19T11:10:47.217 INFO:teuthology.orchestra.run.smithi102.stdout:(14/33): boost-program-options-1.75.0-8.el9.x86 376 kB/s | 107 kB 00:00 2024-09-19T11:10:47.259 INFO:teuthology.orchestra.run.smithi102.stdout:(15/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 1.1 MB/s | 45 kB 00:00 2024-09-19T11:10:47.284 INFO:teuthology.orchestra.run.smithi102.stdout:(16/33): libnbd-1.20.2-2.el9.x86_64.rpm 524 kB/s | 171 kB 00:00 2024-09-19T11:10:47.299 INFO:teuthology.orchestra.run.smithi037.stdout:(3/33): libcephfs2-19.3.0-5012.g08af21e0.el9.x8 5.2 MB/s | 755 kB 00:00 2024-09-19T11:10:47.318 INFO:teuthology.orchestra.run.smithi102.stdout:(17/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.1 MB/s | 160 kB 00:00 2024-09-19T11:10:47.377 INFO:teuthology.orchestra.run.smithi102.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 3.1 MB/s | 292 kB 00:00 2024-09-19T11:10:47.400 INFO:teuthology.orchestra.run.smithi037.stdout:(4/33): libradosstriper1-19.3.0-5012.g08af21e0. 5.0 MB/s | 509 kB 00:00 2024-09-19T11:10:47.402 INFO:teuthology.orchestra.run.smithi102.stdout:(19/33): librdkafka-1.6.1-102.el9.x86_64.rpm 4.5 MB/s | 662 kB 00:00 2024-09-19T11:10:47.427 INFO:teuthology.orchestra.run.smithi102.stdout:(20/33): python3-prettytable-0.7.2-27.el9.noarc 387 kB/s | 42 kB 00:00 2024-09-19T11:10:47.452 INFO:teuthology.orchestra.run.smithi102.stdout:(21/33): qatlib-24.02.0-1.el9.x86_64.rpm 2.9 MB/s | 221 kB 00:00 2024-09-19T11:10:47.478 INFO:teuthology.orchestra.run.smithi102.stdout:(22/33): qatlib-service-24.02.0-1.el9.x86_64.rp 714 kB/s | 36 kB 00:00 2024-09-19T11:10:47.503 INFO:teuthology.orchestra.run.smithi102.stdout:(23/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 630 kB/s | 47 kB 00:00 2024-09-19T11:10:47.554 INFO:teuthology.orchestra.run.smithi102.stdout:(24/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 520 kB/s | 26 kB 00:00 2024-09-19T11:10:47.579 INFO:teuthology.orchestra.run.smithi102.stdout:(25/33): liboath-2.6.7-2.el9.x86_64.rpm 2.1 MB/s | 49 kB 00:00 2024-09-19T11:10:47.629 INFO:teuthology.orchestra.run.smithi102.stdout:(26/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T11:10:47.654 INFO:teuthology.orchestra.run.smithi102.stdout:(27/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 1.5 MB/s | 308 kB 00:00 2024-09-19T11:10:47.688 INFO:teuthology.orchestra.run.smithi102.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 5.6 MB/s | 191 kB 00:00 2024-09-19T11:10:47.721 INFO:teuthology.orchestra.run.smithi102.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 8.9 MB/s | 839 kB 00:00 2024-09-19T11:10:47.750 INFO:teuthology.orchestra.run.smithi037.stdout:(5/33): ceph-common-19.3.0-5012.g08af21e0.el9.x 11 MB/s | 22 MB 00:01 2024-09-19T11:10:47.800 INFO:teuthology.orchestra.run.smithi037.stdout:(6/33): python3-ceph-argparse-19.3.0-5012.g08af 906 kB/s | 45 kB 00:00 2024-09-19T11:10:47.822 INFO:teuthology.orchestra.run.smithi102.stdout:(30/33): thrift-0.15.0-2.el9.x86_64.rpm 12 MB/s | 1.6 MB 00:00 2024-09-19T11:10:47.851 INFO:teuthology.orchestra.run.smithi037.stdout:(7/33): python3-ceph-common-19.3.0-5012.g08af21 2.9 MB/s | 148 kB 00:00 2024-09-19T11:10:47.897 INFO:teuthology.orchestra.run.smithi102.stdout:(31/33): libarrow-9.0.0-11.el9.x86_64.rpm 11 MB/s | 4.4 MB 00:00 2024-09-19T11:10:47.909 INFO:teuthology.orchestra.run.smithi037.stdout:(8/33): python3-cephfs-19.3.0-5012.g08af21e0.el 2.7 MB/s | 161 kB 00:00 2024-09-19T11:10:47.959 INFO:teuthology.orchestra.run.smithi037.stdout:(9/33): python3-rados-19.3.0-5012.g08af21e0.el9 6.3 MB/s | 321 kB 00:00 2024-09-19T11:10:47.964 INFO:teuthology.orchestra.run.smithi102.stdout:(32/33): librados2-19.3.0-5012.g08af21e0.el9.x8 14 MB/s | 3.5 MB 00:00 2024-09-19T11:10:48.018 INFO:teuthology.orchestra.run.smithi037.stdout:(10/33): python3-rbd-19.3.0-5012.g08af21e0.el9. 5.2 MB/s | 307 kB 00:00 2024-09-19T11:10:48.068 INFO:teuthology.orchestra.run.smithi037.stdout:(11/33): python3-rgw-19.3.0-5012.g08af21e0.el9. 1.9 MB/s | 99 kB 00:00 2024-09-19T11:10:48.089 INFO:teuthology.orchestra.run.smithi102.stdout:(33/33): librbd1-19.3.0-5012.g08af21e0.el9.x86_ 12 MB/s | 3.2 MB 00:00 2024-09-19T11:10:48.094 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:10:48.094 INFO:teuthology.orchestra.run.smithi102.stdout:Total 21 MB/s | 62 MB 00:02 2024-09-19T11:10:48.201 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:10:48.237 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:10:48.237 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:10:48.252 INFO:teuthology.orchestra.run.smithi037.stdout:(12/33): ceph-radosgw-19.3.0-5012.g08af21e0.el9 4.4 MB/s | 11 MB 00:02 2024-09-19T11:10:48.277 INFO:teuthology.orchestra.run.smithi037.stdout:(13/33): boost-program-options-1.75.0-8.el9.x86 513 kB/s | 107 kB 00:00 2024-09-19T11:10:48.361 INFO:teuthology.orchestra.run.smithi037.stdout:(14/33): libpmemobj-1.12.1-1.el9.x86_64.rpm 1.9 MB/s | 160 kB 00:00 2024-09-19T11:10:48.436 INFO:teuthology.orchestra.run.smithi037.stdout:(15/33): librgw2-19.3.0-5012.g08af21e0.el9.x86_ 5.3 MB/s | 5.5 MB 00:01 2024-09-19T11:10:48.462 INFO:teuthology.orchestra.run.smithi037.stdout:(16/33): librabbitmq-0.11.0-7.el9.x86_64.rpm 451 kB/s | 45 kB 00:00 2024-09-19T11:10:48.487 INFO:teuthology.orchestra.run.smithi037.stdout:(17/33): libnbd-1.20.2-2.el9.x86_64.rpm 729 kB/s | 171 kB 00:00 2024-09-19T11:10:48.520 INFO:teuthology.orchestra.run.smithi037.stdout:(18/33): lttng-ust-2.12.0-6.el9.x86_64.rpm 4.9 MB/s | 292 kB 00:00 2024-09-19T11:10:48.546 INFO:teuthology.orchestra.run.smithi037.stdout:(19/33): python3-prettytable-0.7.2-27.el9.noarc 720 kB/s | 42 kB 00:00 2024-09-19T11:10:48.571 INFO:teuthology.orchestra.run.smithi037.stdout:(20/33): qatlib-24.02.0-1.el9.x86_64.rpm 4.3 MB/s | 221 kB 00:00 2024-09-19T11:10:48.596 INFO:teuthology.orchestra.run.smithi037.stdout:(21/33): qatlib-service-24.02.0-1.el9.x86_64.rp 717 kB/s | 36 kB 00:00 2024-09-19T11:10:48.621 INFO:teuthology.orchestra.run.smithi037.stdout:(22/33): qatzip-libs-1.2.0-1.el9.x86_64.rpm 946 kB/s | 47 kB 00:00 2024-09-19T11:10:48.680 INFO:teuthology.orchestra.run.smithi037.stdout:(23/33): librdkafka-1.6.1-102.el9.x86_64.rpm 2.7 MB/s | 662 kB 00:00 2024-09-19T11:10:48.730 INFO:teuthology.orchestra.run.smithi037.stdout:(24/33): gperftools-libs-2.9.1-3.el9.x86_64.rpm 2.2 MB/s | 308 kB 00:00 2024-09-19T11:10:48.756 INFO:teuthology.orchestra.run.smithi037.stdout:(25/33): libarrow-doc-9.0.0-11.el9.noarch.rpm 355 kB/s | 26 kB 00:00 2024-09-19T11:10:48.781 INFO:teuthology.orchestra.run.smithi037.stdout:(26/33): liboath-2.6.7-2.el9.x86_64.rpm 969 kB/s | 49 kB 00:00 2024-09-19T11:10:48.806 INFO:teuthology.orchestra.run.smithi037.stdout:(27/33): libunwind-1.6.2-1.el9.x86_64.rpm 1.3 MB/s | 67 kB 00:00 2024-09-19T11:10:48.848 INFO:teuthology.orchestra.run.smithi037.stdout:(28/33): re2-20211101-20.el9.x86_64.rpm 4.5 MB/s | 191 kB 00:00 2024-09-19T11:10:48.898 INFO:teuthology.orchestra.run.smithi037.stdout:(29/33): parquet-libs-9.0.0-11.el9.x86_64.rpm 7.0 MB/s | 839 kB 00:00 2024-09-19T11:10:48.931 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:10:48.931 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:10:48.974 INFO:teuthology.orchestra.run.smithi037.stdout:(30/33): libarrow-9.0.0-11.el9.x86_64.rpm 13 MB/s | 4.4 MB 00:00 2024-09-19T11:10:49.024 INFO:teuthology.orchestra.run.smithi037.stdout:(31/33): thrift-0.15.0-2.el9.x86_64.rpm 9.0 MB/s | 1.6 MB 00:00 2024-09-19T11:10:49.225 INFO:teuthology.orchestra.run.smithi037.stdout:(32/33): librbd1-19.3.0-5012.g08af21e0.el9.x86_ 13 MB/s | 3.2 MB 00:00 2024-09-19T11:10:49.441 INFO:teuthology.orchestra.run.smithi037.stdout:(33/33): librados2-19.3.0-5012.g08af21e0.el9.x8 6.4 MB/s | 3.5 MB 00:00 2024-09-19T11:10:49.447 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:10:49.447 INFO:teuthology.orchestra.run.smithi037.stdout:Total 16 MB/s | 62 MB 00:03 2024-09-19T11:10:49.570 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:10:49.611 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:10:49.611 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:10:50.320 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:10:50.320 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:10:50.545 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:10:50.619 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-19T11:10:50.652 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-19T11:10:50.686 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-19T11:10:50.709 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-19T11:10:50.732 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-19T11:10:50.886 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-19T11:10:50.939 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-19T11:10:51.320 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-19T11:10:51.388 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 7/35 2024-09-19T11:10:51.464 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 7/35 2024-09-19T11:10:51.578 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 8/35 2024-09-19T11:10:51.615 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 9/35 2024-09-19T11:10:51.678 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 9/35 2024-09-19T11:10:51.723 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-19T11:10:51.767 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el9. 11/35 2024-09-19T11:10:51.837 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 12/35 2024-09-19T11:10:51.867 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_6 13/35 2024-09-19T11:10:51.931 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_6 13/35 2024-09-19T11:10:51.966 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-19T11:10:52.037 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:10:52.076 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-19T11:10:52.108 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-19T11:10:52.123 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lttng-ust-2.12.0-6.el9.x86_64 1/35 2024-09-19T11:10:52.155 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librdkafka-1.6.1-102.el9.x86_64 2/35 2024-09-19T11:10:52.164 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-19T11:10:52.188 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librabbitmq-0.11.0-7.el9.x86_64 3/35 2024-09-19T11:10:52.198 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-19T11:10:52.219 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-19T11:10:52.227 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-19T11:10:52.242 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-service-24.02.0-1.el9.x86_64 4/35 2024-09-19T11:10:52.260 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-19T11:10:52.298 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-19T11:10:52.432 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-19T11:10:52.493 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatlib-24.02.0-1.el9.x86_64 5/35 2024-09-19T11:10:52.625 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-19T11:10:52.674 INFO:teuthology.orchestra.run.smithi102.stdout: Upgrading : librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 23/35 2024-09-19T11:10:52.765 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 23/35 2024-09-19T11:10:52.796 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 24/35 2024-09-19T11:10:52.840 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-19T11:10:52.852 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : thrift-0.15.0-2.el9.x86_64 6/35 2024-09-19T11:10:52.964 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 7/35 2024-09-19T11:10:53.058 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 7/35 2024-09-19T11:10:53.148 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 8/35 2024-09-19T11:10:53.174 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 9/35 2024-09-19T11:10:53.240 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 9/35 2024-09-19T11:10:53.275 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : liboath-2.6.7-2.el9.x86_64 10/35 2024-09-19T11:10:53.321 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el9. 11/35 2024-09-19T11:10:53.333 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-19T11:10:53.369 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 27/35 2024-09-19T11:10:53.390 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 12/35 2024-09-19T11:10:53.427 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_6 13/35 2024-09-19T11:10:53.438 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 27/35 2024-09-19T11:10:53.491 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_6 13/35 2024-09-19T11:10:53.513 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 28/35 2024-09-19T11:10:53.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : qatzip-libs-1.2.0-1.el9.x86_64 14/35 2024-09-19T11:10:53.554 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ceph-common-2:19.3.0-5012.g08af21e0.el9.x8 29/35 2024-09-19T11:10:53.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : re2-1:20211101-20.el9.x86_64 15/35 2024-09-19T11:10:53.693 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-9.0.0-11.el9.x86_64 16/35 2024-09-19T11:10:53.744 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libunwind-1.6.2-1.el9.x86_64 17/35 2024-09-19T11:10:53.774 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : gperftools-libs-2.9.1-3.el9.x86_64 18/35 2024-09-19T11:10:53.804 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libarrow-doc-9.0.0-11.el9.noarch 19/35 2024-09-19T11:10:53.836 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-19T11:10:53.874 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libpmemobj-1.12.1-1.el9.x86_64 21/35 2024-09-19T11:10:54.210 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libnbd-1.20.2-2.el9.x86_64 22/35 2024-09-19T11:10:54.250 INFO:teuthology.orchestra.run.smithi037.stdout: Upgrading : librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 23/35 2024-09-19T11:10:54.335 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 23/35 2024-09-19T11:10:54.364 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 24/35 2024-09-19T11:10:54.400 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : boost-program-options-1.75.0-8.el9.x86_64 25/35 2024-09-19T11:10:54.927 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : parquet-libs-9.0.0-11.el9.x86_64 26/35 2024-09-19T11:10:54.961 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 27/35 2024-09-19T11:10:55.034 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 27/35 2024-09-19T11:10:55.118 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 28/35 2024-09-19T11:10:55.155 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ceph-common-2:19.3.0-5012.g08af21e0.el9.x8 29/35 2024-09-19T11:10:55.913 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 30/35 2024-09-19T11:10:55.942 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 30/35 2024-09-19T11:10:56.516 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 30/35 2024-09-19T11:10:56.556 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 31/35 2024-09-19T11:10:56.646 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 31/35 2024-09-19T11:10:56.646 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T11:10:56.647 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T11:10:56.647 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:10:56.682 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 32/35 2024-09-19T11:10:57.649 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 30/35 2024-09-19T11:10:57.685 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 30/35 2024-09-19T11:10:58.279 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 30/35 2024-09-19T11:10:58.346 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 31/35 2024-09-19T11:10:58.443 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 31/35 2024-09-19T11:10:58.443 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph.target → /usr/lib/systemd/system/ceph.target. 2024-09-19T11:10:58.443 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-crash.service → /usr/lib/systemd/system/ceph-crash.service. 2024-09-19T11:10:58.443 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:10:58.472 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 32/35 2024-09-19T11:11:06.678 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 32/35 2024-09-19T11:11:06.678 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /sys 2024-09-19T11:11:06.678 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /proc 2024-09-19T11:11:06.679 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /mnt 2024-09-19T11:11:06.679 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /var/tmp 2024-09-19T11:11:06.679 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /home 2024-09-19T11:11:06.679 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /root 2024-09-19T11:11:06.679 INFO:teuthology.orchestra.run.smithi102.stdout:skipping the directory /tmp 2024-09-19T11:11:06.679 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:07.708 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 33/35 2024-09-19T11:11:07.734 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 33/35 2024-09-19T11:11:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T11:11:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T11:11:07.734 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T11:11:07.735 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:07.737 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-19T11:11:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-19T11:11:07.819 INFO:teuthology.orchestra.run.smithi102.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-19T11:11:09.020 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-19T11:11:09.020 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 1/35 2024-09-19T11:11:09.020 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2/35 2024-09-19T11:11:09.020 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 3/35 2024-09-19T11:11:09.020 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 4/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 5/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_6 6/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 7/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el9. 8/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ceph-common-2:19.3.0-5012.g08af21e0.el9.x8 9/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 10/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 11/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 12/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 13/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-19T11:11:09.021 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-19T11:11:09.022 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-19T11:11:09.023 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-19T11:11:09.023 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 32/35 2024-09-19T11:11:09.023 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-19T11:11:09.023 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 34/35 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 32/35 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /sys 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /proc 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /mnt 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /var/tmp 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /home 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /root 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout:skipping the directory /tmp 2024-09-19T11:11:09.140 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:09.941 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-19T11:11:09.941 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout:Upgraded: 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T11:11:09.942 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.943 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:09.944 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:11:10.161 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 33/35 2024-09-19T11:11:10.188 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 33/35 2024-09-19T11:11:10.188 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:10.188 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-radosgw@*.service" escaped as "ceph-radosgw@\x2a.service". 2024-09-19T11:11:10.188 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T11:11:10.188 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-radosgw.target → /usr/lib/systemd/system/ceph-radosgw.target. 2024-09-19T11:11:10.189 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:10.190 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-19T11:11:10.280 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librbd1-2:16.2.4-5.el9.x86_64 34/35 2024-09-19T11:11:10.280 INFO:teuthology.orchestra.run.smithi037.stdout: Cleanup : librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-19T11:11:10.311 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-test 2024-09-19T11:11:10.896 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:28 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:11:11.033 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 46 M 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 161 k 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:11:11.034 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:11.035 INFO:teuthology.orchestra.run.smithi102.stdout:Install 4 Packages 2024-09-19T11:11:11.035 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:11.035 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 46 M 2024-09-19T11:11:11.035 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 201 M 2024-09-19T11:11:11.035 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:11:11.291 INFO:teuthology.orchestra.run.smithi102.stdout:(1/4): socat-1.7.4.1-6.el9.x86_64.rpm 1.5 MB/s | 304 kB 00:00 2024-09-19T11:11:11.316 INFO:teuthology.orchestra.run.smithi102.stdout:(2/4): libcephsqlite-19.3.0-5012.g08af21e0.el9. 714 kB/s | 161 kB 00:00 2024-09-19T11:11:11.333 INFO:teuthology.orchestra.run.smithi102.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 1.5 MB/s | 64 kB 00:00 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados2-2:16.2.4-5.el9.x86_64 35/35 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 1/35 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2/35 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 3/35 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 4/35 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 5/35 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_6 6/35 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 7/35 2024-09-19T11:11:11.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el9. 8/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ceph-common-2:19.3.0-5012.g08af21e0.el9.x8 9/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 10/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 11/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 12/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 13/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : boost-program-options-1.75.0-8.el9.x86_64 14/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libnbd-1.20.2-2.el9.x86_64 15/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libpmemobj-1.12.1-1.el9.x86_64 16/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librabbitmq-0.11.0-7.el9.x86_64 17/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librdkafka-1.6.1-102.el9.x86_64 18/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lttng-ust-2.12.0-6.el9.x86_64 19/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-prettytable-0.7.2-27.el9.noarch 20/35 2024-09-19T11:11:11.533 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-24.02.0-1.el9.x86_64 21/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatlib-service-24.02.0-1.el9.x86_64 22/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : qatzip-libs-1.2.0-1.el9.x86_64 23/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : gperftools-libs-2.9.1-3.el9.x86_64 24/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-9.0.0-11.el9.x86_64 25/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libarrow-doc-9.0.0-11.el9.noarch 26/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : liboath-2.6.7-2.el9.x86_64 27/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libunwind-1.6.2-1.el9.x86_64 28/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : parquet-libs-9.0.0-11.el9.x86_64 29/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : re2-1:20211101-20.el9.x86_64 30/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : thrift-0.15.0-2.el9.x86_64 31/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 32/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados2-2:16.2.4-5.el9.x86_64 33/35 2024-09-19T11:11:11.534 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 34/35 2024-09-19T11:11:12.517 INFO:teuthology.orchestra.run.smithi102.stdout:(4/4): ceph-test-19.3.0-5012.g08af21e0.el9.x86_ 32 MB/s | 46 MB 00:01 2024-09-19T11:11:12.518 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:12.519 INFO:teuthology.orchestra.run.smithi102.stdout:Total 31 MB/s | 46 MB 00:01 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librbd1-2:16.2.4-5.el9.x86_64 35/35 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout:Upgraded: 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: boost-program-options-1.75.0-8.el9.x86_64 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-radosgw-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-selinux-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.545 INFO:teuthology.orchestra.run.smithi037.stdout: gperftools-libs-2.9.1-3.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-9.0.0-11.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: libarrow-doc-9.0.0-11.el9.noarch 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: libnbd-1.20.2-2.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: liboath-2.6.7-2.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: libpmemobj-1.12.1-1.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: librabbitmq-0.11.0-7.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: libradosstriper1-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: librdkafka-1.6.1-102.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: librgw2-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: libunwind-1.6.2-1.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: lttng-ust-2.12.0-6.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: parquet-libs-9.0.0-11.el9.x86_64 2024-09-19T11:11:12.546 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-argparse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ceph-common-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: python3-prettytable-0.7.2-27.el9.noarch 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-24.02.0-1.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: qatlib-service-24.02.0-1.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: qatzip-libs-1.2.0-1.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: re2-1:20211101-20.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: thrift-0.15.0-2.el9.x86_64 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:12.547 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:11:12.548 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:11:12.565 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:11:12.565 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:11:12.896 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-test 2024-09-19T11:11:12.916 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:11:12.916 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:11:13.439 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:11:13.500 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:30 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:11:13.509 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-19T11:11:13.549 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-19T11:11:13.576 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 3/4 2024-09-19T11:11:13.638 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:11:13.638 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 46 M 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 161 k 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout: socat x86_64 1.7.4.1-6.el9 appstream 304 k 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet x86_64 1.6.1-20.el9 appstream 64 k 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:11:13.639 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:13.640 INFO:teuthology.orchestra.run.smithi037.stdout:Install 4 Packages 2024-09-19T11:11:13.640 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:13.640 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 46 M 2024-09-19T11:11:13.640 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 201 M 2024-09-19T11:11:13.640 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:11:14.045 INFO:teuthology.orchestra.run.smithi037.stdout:(1/4): libcephsqlite-19.3.0-5012.g08af21e0.el9. 731 kB/s | 161 kB 00:00 2024-09-19T11:11:14.620 INFO:teuthology.orchestra.run.smithi037.stdout:(2/4): socat-1.7.4.1-6.el9.x86_64.rpm 382 kB/s | 304 kB 00:00 2024-09-19T11:11:14.737 INFO:teuthology.orchestra.run.smithi037.stdout:(3/4): xmlstarlet-1.6.1-20.el9.x86_64.rpm 93 kB/s | 64 kB 00:00 2024-09-19T11:11:15.312 INFO:teuthology.orchestra.run.smithi037.stdout:(4/4): ceph-test-19.3.0-5012.g08af21e0.el9.x86_ 31 MB/s | 46 MB 00:01 2024-09-19T11:11:15.315 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:15.315 INFO:teuthology.orchestra.run.smithi037.stdout:Total 27 MB/s | 46 MB 00:01 2024-09-19T11:11:15.343 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:11:15.366 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:11:15.366 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:11:15.737 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:11:15.738 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:11:16.286 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:11:16.356 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : xmlstarlet-1.6.1-20.el9.x86_64 1/4 2024-09-19T11:11:16.404 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : socat-1.7.4.1-6.el9.x86_64 2/4 2024-09-19T11:11:16.431 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 3/4 2024-09-19T11:11:17.965 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 3/4 2024-09-19T11:11:18.042 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 4/4 2024-09-19T11:11:20.348 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 4/4 2024-09-19T11:11:20.348 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 1/4 2024-09-19T11:11:20.348 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 2/4 2024-09-19T11:11:20.348 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-19T11:11:20.640 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-19T11:11:20.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:20.641 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:11:20.641 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:20.641 INFO:teuthology.orchestra.run.smithi102.stdout: libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:20.641 INFO:teuthology.orchestra.run.smithi102.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T11:11:20.641 INFO:teuthology.orchestra.run.smithi102.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T11:11:20.641 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:20.641 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:11:20.938 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph 2024-09-19T11:11:21.161 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 3/4 2024-09-19T11:11:21.240 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 4/4 2024-09-19T11:11:21.526 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:39 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:11:21.677 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:11:21.679 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:11:21.679 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:21.679 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:11:21.679 INFO:teuthology.orchestra.run.smithi102.stdout: ceph x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 6.6 k 2024-09-19T11:11:21.679 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 2.4 M 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 1.5 M 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 292 k 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 4.8 M 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 17 M 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T11:11:21.680 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T11:11:21.681 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:21.682 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:11:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:Install 37 Packages 2024-09-19T11:11:21.683 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 31 M 2024-09-19T11:11:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 109 M 2024-09-19T11:11:21.683 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:11:22.231 INFO:teuthology.orchestra.run.smithi102.stdout:(1/37): ceph-19.3.0-5012.g08af21e0.el9.x86_64.r 48 kB/s | 6.6 kB 00:00 2024-09-19T11:11:22.380 INFO:teuthology.orchestra.run.smithi102.stdout:(2/37): ceph-mgr-19.3.0-5012.g08af21e0.el9.x86_ 5.3 MB/s | 1.5 MB 00:00 2024-09-19T11:11:22.447 INFO:teuthology.orchestra.run.smithi102.stdout:(3/37): ceph-mds-19.3.0-5012.g08af21e0.el9.x86_ 6.7 MB/s | 2.4 MB 00:00 2024-09-19T11:11:22.514 INFO:teuthology.orchestra.run.smithi102.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5012.g08af 4.3 MB/s | 292 kB 00:00 2024-09-19T11:11:22.715 INFO:teuthology.orchestra.run.smithi102.stdout:(5/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.2 MB/s | 253 kB 00:00 2024-09-19T11:11:22.781 INFO:teuthology.orchestra.run.smithi102.stdout:(6/37): ceph-mon-19.3.0-5012.g08af21e0.el9.x86_ 8.7 MB/s | 4.8 MB 00:00 2024-09-19T11:11:22.990 INFO:teuthology.orchestra.run.smithi102.stdout:(7/37): ceph-osd-19.3.0-5012.g08af21e0.el9.x86_ 28 MB/s | 17 MB 00:00 2024-09-19T11:11:23.024 INFO:teuthology.orchestra.run.smithi102.stdout:(8/37): python3-cryptography-36.0.1-4.el9.x86_6 4.0 MB/s | 1.2 MB 00:00 2024-09-19T11:11:23.049 INFO:teuthology.orchestra.run.smithi102.stdout:(9/37): python3-ply-3.11-14.el9.noarch.rpm 398 kB/s | 106 kB 00:00 2024-09-19T11:11:23.075 INFO:teuthology.orchestra.run.smithi102.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 2.4 MB/s | 125 kB 00:00 2024-09-19T11:11:23.167 INFO:teuthology.orchestra.run.smithi102.stdout:(11/37): python3-pycparser-2.20-6.el9.noarch.rp 769 kB/s | 135 kB 00:00 2024-09-19T11:11:23.192 INFO:teuthology.orchestra.run.smithi102.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.5 MB/s | 215 kB 00:00 2024-09-19T11:11:23.225 INFO:teuthology.orchestra.run.smithi102.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 1.2 MB/s | 188 kB 00:00 2024-09-19T11:11:23.267 INFO:teuthology.orchestra.run.smithi102.stdout:(14/37): python3-packaging-20.9-5.el9.noarch.rp 1.8 MB/s | 77 kB 00:00 2024-09-19T11:11:23.293 INFO:teuthology.orchestra.run.smithi102.stdout:(15/37): python3-markupsafe-1.1.1-12.el9.x86_64 345 kB/s | 35 kB 00:00 2024-09-19T11:11:23.318 INFO:teuthology.orchestra.run.smithi102.stdout:(16/37): python3-pytz-2021.1-5.el9.noarch.rpm 1.0 MB/s | 51 kB 00:00 2024-09-19T11:11:23.343 INFO:teuthology.orchestra.run.smithi102.stdout:(17/37): python3-mako-1.1.4-6.el9.noarch.rpm 976 kB/s | 172 kB 00:00 2024-09-19T11:11:23.369 INFO:teuthology.orchestra.run.smithi102.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 550 kB/s | 42 kB 00:00 2024-09-19T11:11:23.436 INFO:teuthology.orchestra.run.smithi102.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.6 MB/s | 151 kB 00:00 2024-09-19T11:11:23.461 INFO:teuthology.orchestra.run.smithi102.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 473 kB/s | 43 kB 00:00 2024-09-19T11:11:23.486 INFO:teuthology.orchestra.run.smithi102.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.4 MB/s | 172 kB 00:00 2024-09-19T11:11:23.512 INFO:teuthology.orchestra.run.smithi102.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-19T11:11:23.537 INFO:teuthology.orchestra.run.smithi102.stdout:(23/37): python3-jaraco-classes-3.2.1-5.el9.noa 709 kB/s | 18 kB 00:00 2024-09-19T11:11:23.562 INFO:teuthology.orchestra.run.smithi102.stdout:(24/37): python3-cherrypy-18.6.1-2.el9.noarch.r 3.5 MB/s | 358 kB 00:00 2024-09-19T11:11:23.579 INFO:teuthology.orchestra.run.smithi102.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 554 kB/s | 23 kB 00:00 2024-09-19T11:11:23.596 INFO:teuthology.orchestra.run.smithi102.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 581 kB/s | 19 kB 00:00 2024-09-19T11:11:23.630 INFO:teuthology.orchestra.run.smithi102.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 391 kB/s | 20 kB 00:00 2024-09-19T11:11:23.655 INFO:teuthology.orchestra.run.smithi102.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 900 kB/s | 46 kB 00:00 2024-09-19T11:11:23.680 INFO:teuthology.orchestra.run.smithi102.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.5 MB/s | 79 kB 00:00 2024-09-19T11:11:23.714 INFO:teuthology.orchestra.run.smithi102.stdout:(30/37): python3-portend-3.1.0-2.el9.noarch.rpm 506 kB/s | 16 kB 00:00 2024-09-19T11:11:23.739 INFO:teuthology.orchestra.run.smithi102.stdout:(31/37): python3-pecan-1.4.2-3.el9.noarch.rpm 3.2 MB/s | 272 kB 00:00 2024-09-19T11:11:23.751 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 4/4 2024-09-19T11:11:23.751 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 1/4 2024-09-19T11:11:23.752 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 2/4 2024-09-19T11:11:23.752 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : socat-1.7.4.1-6.el9.x86_64 3/4 2024-09-19T11:11:23.764 INFO:teuthology.orchestra.run.smithi102.stdout:(32/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 1.7 MB/s | 90 kB 00:00 2024-09-19T11:11:23.789 INFO:teuthology.orchestra.run.smithi102.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 1.4 MB/s | 36 kB 00:00 2024-09-19T11:11:23.823 INFO:teuthology.orchestra.run.smithi102.stdout:(34/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.9 MB/s | 230 kB 00:00 2024-09-19T11:11:23.849 INFO:teuthology.orchestra.run.smithi102.stdout:(35/37): python3-zc-lockfile-2.0-10.el9.noarch. 799 kB/s | 20 kB 00:00 2024-09-19T11:11:23.874 INFO:teuthology.orchestra.run.smithi102.stdout:(36/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 5.0 MB/s | 427 kB 00:00 2024-09-19T11:11:23.932 INFO:teuthology.orchestra.run.smithi102.stdout:(37/37): lua-devel-5.4.4-4.el9.x86_64.rpm 36 kB/s | 22 kB 00:00 2024-09-19T11:11:23.937 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:23.937 INFO:teuthology.orchestra.run.smithi102.stdout:Total 14 MB/s | 31 MB 00:02 2024-09-19T11:11:24.045 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : xmlstarlet-1.6.1-20.el9.x86_64 4/4 2024-09-19T11:11:24.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:24.045 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:11:24.045 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-test-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:24.045 INFO:teuthology.orchestra.run.smithi037.stdout: libcephsqlite-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:24.045 INFO:teuthology.orchestra.run.smithi037.stdout: socat-1.7.4.1-6.el9.x86_64 2024-09-19T11:11:24.045 INFO:teuthology.orchestra.run.smithi037.stdout: xmlstarlet-1.6.1-20.el9.x86_64 2024-09-19T11:11:24.045 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:24.046 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:11:24.088 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:11:24.128 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:11:24.128 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:11:24.354 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph 2024-09-19T11:11:24.620 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:11:24.620 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:11:24.969 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:41 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:11:25.110 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:11:25.112 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:25.112 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:11:25.112 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: ceph x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 6.6 k 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 2.4 M 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 1.5 M 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 292 k 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 4.8 M 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 17 M 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: lua x86_64 5.4.4-4.el9 appstream 188 k 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel x86_64 5.4.4-4.el9 crb 22 k 2024-09-19T11:11:25.113 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks noarch 3.9.2-5.el9 epel 151 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt x86_64 3.2.2-1.el9 epel 43 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi x86_64 1.14.5-5.el9 baseos 253 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot noarch 8.6.0-4.el9 epel 172 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy noarch 18.6.1-2.el9 epel 358 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography x86_64 36.0.1-4.el9 baseos 1.2 M 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco noarch 8.2.1-3.el9 epel 11 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes noarch 3.2.1-5.el9 epel 18 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: noarch 3.0.0-8.el9 epel 23 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools noarch 3.5.0-2.el9 epel 19 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text noarch 3.2.0-6.el9 epel 20 k 2024-09-19T11:11:25.114 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils noarch 0.3.5-21.el9 epel 46 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako noarch 1.1.4-6.el9 appstream 172 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe x86_64 1.1.1-12.el9 appstream 35 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools noarch 8.12.0-2.el9 epel 79 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging noarch 20.9-5.el9 appstream 77 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan noarch 1.4.2-3.el9 epel 272 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply noarch 3.11-14.el9 baseos 106 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend noarch 3.1.0-2.el9 epel 16 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL noarch 21.0.0-1.el9 epel 90 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser noarch 2.20-6.el9 baseos 135 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz noarch 2021.1-5.el9 appstream 51 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests noarch 2.25.1-8.el9 baseos 125 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora noarch 5.0.0-2.el9 epel 36 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml noarch 0.10.2-6.el9 appstream 42 k 2024-09-19T11:11:25.115 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3 noarch 1.26.5-6.el9 baseos 215 k 2024-09-19T11:11:25.116 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob noarch 1.8.8-2.el9 epel 230 k 2024-09-19T11:11:25.116 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug noarch 2.0.3-3.el9.1 epel 427 k 2024-09-19T11:11:25.116 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile noarch 2.0-10.el9 epel 20 k 2024-09-19T11:11:25.116 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:25.116 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:11:25.116 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:25.116 INFO:teuthology.orchestra.run.smithi037.stdout:Install 37 Packages 2024-09-19T11:11:25.116 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:25.117 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 31 M 2024-09-19T11:11:25.117 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 109 M 2024-09-19T11:11:25.117 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:11:25.983 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:11:26.052 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-19T11:11:26.093 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-19T11:11:26.116 INFO:teuthology.orchestra.run.smithi037.stdout:(1/37): ceph-19.3.0-5012.g08af21e0.el9.x86_64.r 52 kB/s | 6.6 kB 00:00 2024-09-19T11:11:26.129 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-19T11:11:26.202 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-19T11:11:26.245 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-19T11:11:26.278 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-19T11:11:26.333 INFO:teuthology.orchestra.run.smithi037.stdout:(2/37): ceph-mds-19.3.0-5012.g08af21e0.el9.x86_ 7.0 MB/s | 2.4 MB 00:00 2024-09-19T11:11:26.373 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-19T11:11:26.375 INFO:teuthology.orchestra.run.smithi037.stdout:(3/37): ceph-mgr-19.3.0-5012.g08af21e0.el9.x86_ 4.0 MB/s | 1.5 MB 00:00 2024-09-19T11:11:26.459 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-19T11:11:26.467 INFO:teuthology.orchestra.run.smithi037.stdout:(4/37): ceph-mgr-modules-core-19.3.0-5012.g08af 3.1 MB/s | 292 kB 00:00 2024-09-19T11:11:26.507 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-19T11:11:26.542 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-19T11:11:26.551 INFO:teuthology.orchestra.run.smithi037.stdout:(5/37): ceph-mon-19.3.0-5012.g08af21e0.el9.x86_ 11 MB/s | 4.8 MB 00:00 2024-09-19T11:11:26.572 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-19T11:11:26.607 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-19T11:11:26.634 INFO:teuthology.orchestra.run.smithi037.stdout:(6/37): python3-cffi-1.14.5-5.el9.x86_64.rpm 1.5 MB/s | 253 kB 00:00 2024-09-19T11:11:26.640 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-19T11:11:26.676 INFO:teuthology.orchestra.run.smithi037.stdout:(7/37): python3-ply-3.11-14.el9.noarch.rpm 2.5 MB/s | 106 kB 00:00 2024-09-19T11:11:26.681 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-19T11:11:26.718 INFO:teuthology.orchestra.run.smithi037.stdout:(8/37): python3-pycparser-2.20-6.el9.noarch.rpm 3.2 MB/s | 135 kB 00:00 2024-09-19T11:11:26.724 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-19T11:11:26.759 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-19T11:11:26.824 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-19T11:11:26.861 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-19T11:11:26.894 INFO:teuthology.orchestra.run.smithi037.stdout:(9/37): ceph-osd-19.3.0-5012.g08af21e0.el9.x86_ 31 MB/s | 17 MB 00:00 2024-09-19T11:11:26.919 INFO:teuthology.orchestra.run.smithi037.stdout:(10/37): python3-requests-2.25.1-8.el9.noarch.r 624 kB/s | 125 kB 00:00 2024-09-19T11:11:26.938 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-19T11:11:26.961 INFO:teuthology.orchestra.run.smithi037.stdout:(11/37): python3-cryptography-36.0.1-4.el9.x86_ 3.0 MB/s | 1.2 MB 00:00 2024-09-19T11:11:27.036 INFO:teuthology.orchestra.run.smithi037.stdout:(12/37): python3-urllib3-1.26.5-6.el9.noarch.rp 1.5 MB/s | 215 kB 00:00 2024-09-19T11:11:27.087 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-19T11:11:27.120 INFO:teuthology.orchestra.run.smithi037.stdout:(13/37): lua-5.4.4-4.el9.x86_64.rpm 939 kB/s | 188 kB 00:00 2024-09-19T11:11:27.145 INFO:teuthology.orchestra.run.smithi037.stdout:(14/37): python3-markupsafe-1.1.1-12.el9.x86_64 320 kB/s | 35 kB 00:00 2024-09-19T11:11:27.172 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-19T11:11:27.178 INFO:teuthology.orchestra.run.smithi037.stdout:(15/37): python3-mako-1.1.4-6.el9.noarch.rpm 793 kB/s | 172 kB 00:00 2024-09-19T11:11:27.204 INFO:teuthology.orchestra.run.smithi037.stdout:(16/37): python3-packaging-20.9-5.el9.noarch.rp 922 kB/s | 77 kB 00:00 2024-09-19T11:11:27.226 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-19T11:11:27.229 INFO:teuthology.orchestra.run.smithi037.stdout:(17/37): python3-pytz-2021.1-5.el9.noarch.rpm 608 kB/s | 51 kB 00:00 2024-09-19T11:11:27.254 INFO:teuthology.orchestra.run.smithi037.stdout:(18/37): python3-toml-0.10.2-6.el9.noarch.rpm 552 kB/s | 42 kB 00:00 2024-09-19T11:11:27.264 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-19T11:11:27.313 INFO:teuthology.orchestra.run.smithi037.stdout:(19/37): luarocks-3.9.2-5.el9.noarch.rpm 1.8 MB/s | 151 kB 00:00 2024-09-19T11:11:27.321 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-19T11:11:27.338 INFO:teuthology.orchestra.run.smithi037.stdout:(20/37): python3-bcrypt-3.2.2-1.el9.x86_64.rpm 520 kB/s | 43 kB 00:00 2024-09-19T11:11:27.363 INFO:teuthology.orchestra.run.smithi037.stdout:(21/37): python3-cheroot-8.6.0-4.el9.noarch.rpm 3.3 MB/s | 172 kB 00:00 2024-09-19T11:11:27.377 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-19T11:11:27.389 INFO:teuthology.orchestra.run.smithi037.stdout:(22/37): python3-jaraco-8.2.1-3.el9.noarch.rpm 429 kB/s | 11 kB 00:00 2024-09-19T11:11:27.414 INFO:teuthology.orchestra.run.smithi037.stdout:(23/37): python3-cherrypy-18.6.1-2.el9.noarch.r 4.6 MB/s | 358 kB 00:00 2024-09-19T11:11:27.431 INFO:teuthology.orchestra.run.smithi037.stdout:(24/37): python3-jaraco-classes-3.2.1-5.el9.noa 421 kB/s | 18 kB 00:00 2024-09-19T11:11:27.448 INFO:teuthology.orchestra.run.smithi037.stdout:(25/37): python3-jaraco-collections-3.0.0-8.el9 693 kB/s | 23 kB 00:00 2024-09-19T11:11:27.465 INFO:teuthology.orchestra.run.smithi037.stdout:(26/37): python3-jaraco-functools-3.5.0-2.el9.n 575 kB/s | 19 kB 00:00 2024-09-19T11:11:27.482 INFO:teuthology.orchestra.run.smithi037.stdout:(27/37): python3-jaraco-text-3.2.0-6.el9.noarch 583 kB/s | 20 kB 00:00 2024-09-19T11:11:27.499 INFO:teuthology.orchestra.run.smithi037.stdout:(28/37): python3-logutils-0.3.5-21.el9.noarch.r 1.4 MB/s | 46 kB 00:00 2024-09-19T11:11:27.524 INFO:teuthology.orchestra.run.smithi037.stdout:(29/37): python3-more-itertools-8.12.0-2.el9.no 1.8 MB/s | 79 kB 00:00 2024-09-19T11:11:27.549 INFO:teuthology.orchestra.run.smithi037.stdout:(30/37): lua-devel-5.4.4-4.el9.x86_64.rpm 64 kB/s | 22 kB 00:00 2024-09-19T11:11:27.574 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-19T11:11:27.583 INFO:teuthology.orchestra.run.smithi037.stdout:(31/37): python3-portend-3.1.0-2.el9.noarch.rpm 281 kB/s | 16 kB 00:00 2024-09-19T11:11:27.617 INFO:teuthology.orchestra.run.smithi037.stdout:(32/37): python3-pecan-1.4.2-3.el9.noarch.rpm 2.3 MB/s | 272 kB 00:00 2024-09-19T11:11:27.626 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-19T11:11:27.642 INFO:teuthology.orchestra.run.smithi037.stdout:(33/37): python3-tempora-5.0.0-2.el9.noarch.rpm 632 kB/s | 36 kB 00:00 2024-09-19T11:11:27.667 INFO:teuthology.orchestra.run.smithi037.stdout:(34/37): python3-pyOpenSSL-21.0.0-1.el9.noarch. 767 kB/s | 90 kB 00:00 2024-09-19T11:11:27.692 INFO:teuthology.orchestra.run.smithi037.stdout:(35/37): python3-webob-1.8.8-2.el9.noarch.rpm 3.0 MB/s | 230 kB 00:00 2024-09-19T11:11:27.705 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-19T11:11:27.717 INFO:teuthology.orchestra.run.smithi037.stdout:(36/37): python3-zc-lockfile-2.0-10.el9.noarch. 398 kB/s | 20 kB 00:00 2024-09-19T11:11:27.751 INFO:teuthology.orchestra.run.smithi037.stdout:(37/37): python3-werkzeug-2.0.3-3.el9.1.noarch. 3.8 MB/s | 427 kB 00:00 2024-09-19T11:11:27.755 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:27.755 INFO:teuthology.orchestra.run.smithi037.stdout:Total 12 MB/s | 31 MB 00:02 2024-09-19T11:11:27.794 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-19T11:11:27.838 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-19T11:11:27.910 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:11:27.954 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:11:27.955 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:11:27.980 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-19T11:11:28.157 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el9. 32/37 2024-09-19T11:11:28.186 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 33/37 2024-09-19T11:11:28.212 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 33/37 2024-09-19T11:11:28.212 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:28.212 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T11:11:28.213 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T11:11:28.213 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T11:11:28.213 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:28.452 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:11:28.453 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:11:29.670 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 34/37 2024-09-19T11:11:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 34/37 2024-09-19T11:11:29.698 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:29.698 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T11:11:29.698 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T11:11:29.698 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T11:11:29.698 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:29.993 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:11:30.071 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-more-itertools-8.12.0-2.el9.noarch 1/37 2024-09-19T11:11:30.104 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-8.2.1-3.el9.noarch 2/37 2024-09-19T11:11:30.131 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-5.4.4-4.el9.x86_64 3/37 2024-09-19T11:11:30.137 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 35/37 2024-09-19T11:11:30.161 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 35/37 2024-09-19T11:11:30.161 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:30.162 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T11:11:30.162 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T11:11:30.162 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T11:11:30.162 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:30.208 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : lua-devel-5.4.4-4.el9.x86_64 4/37 2024-09-19T11:11:30.256 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : luarocks-3.9.2-5.el9.noarch 5/37 2024-09-19T11:11:30.296 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-classes-3.2.1-5.el9.noarch 6/37 2024-09-19T11:11:30.388 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 36/37 2024-09-19T11:11:30.392 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-zc-lockfile-2.0-10.el9.noarch 7/37 2024-09-19T11:11:30.412 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 36/37 2024-09-19T11:11:30.412 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:30.412 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T11:11:30.412 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T11:11:30.412 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T11:11:30.412 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:30.470 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-werkzeug-2.0.3-3.el9.1.noarch 8/37 2024-09-19T11:11:30.477 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 37/37 2024-09-19T11:11:30.516 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-webob-1.8.8-2.el9.noarch 9/37 2024-09-19T11:11:30.551 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-logutils-0.3.5-21.el9.noarch 10/37 2024-09-19T11:11:30.581 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-toml-0.10.2-6.el9.noarch 11/37 2024-09-19T11:11:30.615 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-functools-3.5.0-2.el9.noarch 12/37 2024-09-19T11:11:30.657 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-text-3.2.0-6.el9.noarch 13/37 2024-09-19T11:11:30.698 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jaraco-collections-3.0.0-8.el9.noarch 14/37 2024-09-19T11:11:30.762 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pytz-2021.1-5.el9.noarch 15/37 2024-09-19T11:11:30.800 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-tempora-5.0.0-2.el9.noarch 16/37 2024-09-19T11:11:30.850 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-portend-3.1.0-2.el9.noarch 17/37 2024-09-19T11:11:30.892 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-packaging-20.9-5.el9.noarch 18/37 2024-09-19T11:11:30.974 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-markupsafe-1.1.1-12.el9.x86_64 19/37 2024-09-19T11:11:31.244 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-mako-1.1.4-6.el9.noarch 20/37 2024-09-19T11:11:31.333 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pecan-1.4.2-3.el9.noarch 21/37 2024-09-19T11:11:31.393 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-urllib3-1.26.5-6.el9.noarch 22/37 2024-09-19T11:11:31.430 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-2.25.1-8.el9.noarch 23/37 2024-09-19T11:11:31.489 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-ply-3.11-14.el9.noarch 24/37 2024-09-19T11:11:31.553 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pycparser-2.20-6.el9.noarch 25/37 2024-09-19T11:11:31.750 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cffi-1.14.5-5.el9.x86_64 26/37 2024-09-19T11:11:31.810 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cryptography-36.0.1-4.el9.x86_64 27/37 2024-09-19T11:11:31.892 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyOpenSSL-21.0.0-1.el9.noarch 28/37 2024-09-19T11:11:31.988 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cheroot-8.6.0-4.el9.noarch 29/37 2024-09-19T11:11:32.035 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cherrypy-18.6.1-2.el9.noarch 30/37 2024-09-19T11:11:32.178 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-bcrypt-3.2.2-1.el9.x86_64 31/37 2024-09-19T11:11:32.297 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 37/37 2024-09-19T11:11:32.297 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 1/37 2024-09-19T11:11:32.297 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 2/37 2024-09-19T11:11:32.297 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 3/37 2024-09-19T11:11:32.297 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 4/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 5/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el9. 6/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-19T11:11:32.298 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-19T11:11:32.299 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-19T11:11:32.300 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-19T11:11:32.300 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-19T11:11:32.301 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-19T11:11:32.301 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-19T11:11:32.301 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-19T11:11:32.301 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-19T11:11:32.301 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-19T11:11:32.301 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-19T11:11:32.301 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-19T11:11:32.357 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el9. 32/37 2024-09-19T11:11:32.395 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 33/37 2024-09-19T11:11:32.423 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 33/37 2024-09-19T11:11:32.423 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:32.423 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mgr@*.service" escaped as "ceph-mgr@\x2a.service". 2024-09-19T11:11:32.423 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T11:11:32.423 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mgr.target → /usr/lib/systemd/system/ceph-mgr.target. 2024-09-19T11:11:32.423 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:33.358 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-19T11:11:33.358 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:33.358 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:11:33.358 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:33.358 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:33.358 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:33.358 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T11:11:33.359 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T11:11:33.360 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:33.361 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:11:33.761 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-base 2024-09-19T11:11:33.979 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 34/37 2024-09-19T11:11:34.008 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 34/37 2024-09-19T11:11:34.008 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:34.008 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-osd@*.service" escaped as "ceph-osd@\x2a.service". 2024-09-19T11:11:34.008 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T11:11:34.008 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-osd.target → /usr/lib/systemd/system/ceph-osd.target. 2024-09-19T11:11:34.008 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:34.346 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:52 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:11:34.435 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:11:34.477 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:11:34.478 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:11:34.478 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:11:34.480 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 35/37 2024-09-19T11:11:34.505 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 35/37 2024-09-19T11:11:34.505 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:34.505 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mon@*.service" escaped as "ceph-mon@\x2a.service". 2024-09-19T11:11:34.505 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T11:11:34.505 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mon.target → /usr/lib/systemd/system/ceph-mon.target. 2024-09-19T11:11:34.505 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:34.552 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install cephadm 2024-09-19T11:11:34.768 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 36/37 2024-09-19T11:11:34.797 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 36/37 2024-09-19T11:11:34.797 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:34.797 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-mds@*.service" escaped as "ceph-mds@\x2a.service". 2024-09-19T11:11:34.797 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T11:11:34.797 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-mds.target → /usr/lib/systemd/system/ceph-mds.target. 2024-09-19T11:11:34.797 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:34.863 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 37/37 2024-09-19T11:11:35.131 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:53 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:11:35.262 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:11:35.263 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:35.263 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:11:35.263 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:35.263 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 784 k 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 784 k 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 791 k 2024-09-19T11:11:35.264 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:11:35.550 INFO:teuthology.orchestra.run.smithi102.stdout:cephadm-19.3.0-5012.g08af21e0.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-19T11:11:35.551 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:35.551 INFO:teuthology.orchestra.run.smithi102.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-19T11:11:35.551 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:11:35.556 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:11:35.556 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:11:35.562 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:11:35.562 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:11:35.631 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:11:36.112 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:11:36.204 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:11:36.588 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 37/37 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 1/37 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 2/37 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 3/37 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 4/37 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 5/37 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el9. 6/37 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cffi-1.14.5-5.el9.x86_64 7/37 2024-09-19T11:11:36.681 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cryptography-36.0.1-4.el9.x86_64 8/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-ply-3.11-14.el9.noarch 9/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pycparser-2.20-6.el9.noarch 10/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-2.25.1-8.el9.noarch 11/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-urllib3-1.26.5-6.el9.noarch 12/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-5.4.4-4.el9.x86_64 13/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-mako-1.1.4-6.el9.noarch 14/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-markupsafe-1.1.1-12.el9.x86_64 15/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-packaging-20.9-5.el9.noarch 16/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pytz-2021.1-5.el9.noarch 17/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-toml-0.10.2-6.el9.noarch 18/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : lua-devel-5.4.4-4.el9.x86_64 19/37 2024-09-19T11:11:36.682 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : luarocks-3.9.2-5.el9.noarch 20/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-bcrypt-3.2.2-1.el9.x86_64 21/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cheroot-8.6.0-4.el9.noarch 22/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cherrypy-18.6.1-2.el9.noarch 23/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-8.2.1-3.el9.noarch 24/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-classes-3.2.1-5.el9.noarch 25/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-collections-3.0.0-8.el9.noarch 26/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-functools-3.5.0-2.el9.noarch 27/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jaraco-text-3.2.0-6.el9.noarch 28/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-logutils-0.3.5-21.el9.noarch 29/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-more-itertools-8.12.0-2.el9.noarch 30/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pecan-1.4.2-3.el9.noarch 31/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-portend-3.1.0-2.el9.noarch 32/37 2024-09-19T11:11:36.683 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyOpenSSL-21.0.0-1.el9.noarch 33/37 2024-09-19T11:11:36.684 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-tempora-5.0.0-2.el9.noarch 34/37 2024-09-19T11:11:36.684 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-webob-1.8.8-2.el9.noarch 35/37 2024-09-19T11:11:36.684 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-werkzeug-2.0.3-3.el9.1.noarch 36/37 2024-09-19T11:11:36.847 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:11:36.848 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:36.848 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:11:36.848 INFO:teuthology.orchestra.run.smithi102.stdout: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:36.848 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:36.848 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:11:37.071 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-immutable-object-cache 2024-09-19T11:11:37.675 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:55 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-zc-lockfile-2.0-10.el9.noarch 37/37 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mds-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-modules-core-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mon-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:37.725 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-osd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: lua-5.4.4-4.el9.x86_64 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: lua-devel-5.4.4-4.el9.x86_64 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: luarocks-3.9.2-5.el9.noarch 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-bcrypt-3.2.2-1.el9.x86_64 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cffi-1.14.5-5.el9.x86_64 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cheroot-8.6.0-4.el9.noarch 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cherrypy-18.6.1-2.el9.noarch 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cryptography-36.0.1-4.el9.x86_64 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-8.2.1-3.el9.noarch 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-classes-3.2.1-5.el9.noarch 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-collections-3.0.0-8.el9.noarch 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-functools-3.5.0-2.el9.noarch 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jaraco-text-3.2.0-6.el9.noarch 2024-09-19T11:11:37.726 INFO:teuthology.orchestra.run.smithi037.stdout: python3-logutils-0.3.5-21.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-mako-1.1.4-6.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-markupsafe-1.1.1-12.el9.x86_64 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-more-itertools-8.12.0-2.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-packaging-20.9-5.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pecan-1.4.2-3.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-ply-3.11-14.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-portend-3.1.0-2.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyOpenSSL-21.0.0-1.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pycparser-2.20-6.el9.noarch 2024-09-19T11:11:37.727 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pytz-2021.1-5.el9.noarch 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-2.25.1-8.el9.noarch 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: python3-tempora-5.0.0-2.el9.noarch 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: python3-toml-0.10.2-6.el9.noarch 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: python3-urllib3-1.26.5-6.el9.noarch 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: python3-webob-1.8.8-2.el9.noarch 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: python3-werkzeug-2.0.3-3.el9.1.noarch 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: python3-zc-lockfile-2.0-10.el9.noarch 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:37.728 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:11:37.812 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 145 k 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:37.813 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T11:11:37.814 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:37.814 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 145 k 2024-09-19T11:11:37.814 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 432 k 2024-09-19T11:11:37.814 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:11:38.024 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-immutable-object-cache-19.3.0-5012.g08af21 691 kB/s | 145 kB 00:00 2024-09-19T11:11:38.024 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:38.024 INFO:teuthology.orchestra.run.smithi102.stdout:Total 687 kB/s | 145 kB 00:00 2024-09-19T11:11:38.025 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:11:38.032 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:11:38.032 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:11:38.088 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:11:38.089 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:11:38.145 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-base 2024-09-19T11:11:38.234 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:11:38.299 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0. 1/1 2024-09-19T11:11:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0. 1/1 2024-09-19T11:11:38.324 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:38.324 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T11:11:38.324 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:38.757 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:55 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:11:38.849 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-base-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:11:38.894 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:11:38.895 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:11:38.895 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:11:38.964 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install cephadm 2024-09-19T11:11:39.256 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0. 1/1 2024-09-19T11:11:39.256 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:39.256 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:11:39.256 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:39.256 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:39.256 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:11:39.484 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr 2024-09-19T11:11:39.569 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:56 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:11:39.706 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:11:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:39.707 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:11:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:11:39.707 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 784 k 2024-09-19T11:11:39.707 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:39.707 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:11:39.708 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:39.708 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-19T11:11:39.708 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:39.708 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 784 k 2024-09-19T11:11:39.708 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 791 k 2024-09-19T11:11:39.708 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:11:39.996 INFO:teuthology.orchestra.run.smithi037.stdout:cephadm-19.3.0-5012.g08af21e0.el9.noarch.rpm 2.7 MB/s | 784 kB 00:00 2024-09-19T11:11:39.996 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:39.996 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.7 MB/s | 784 kB 00:00 2024-09-19T11:11:39.997 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:11:40.002 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:11:40.002 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:11:40.009 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:11:40.009 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:11:40.068 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:58 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:11:40.087 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:11:40.160 INFO:teuthology.orchestra.run.smithi102.stdout:Package ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:11:40.202 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:11:40.203 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:11:40.203 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:11:40.275 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-dashboard 2024-09-19T11:11:40.562 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:11:40.660 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:11:40.849 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:00:58 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:11:40.982 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 14 M 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 34 k 2024-09-19T11:11:40.983 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 16 k 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-09-19T11:11:40.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:40.985 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 19 M 2024-09-19T11:11:40.985 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 159 M 2024-09-19T11:11:40.985 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:11:41.053 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:11:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:11:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:41.307 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:11:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:41.307 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:41.307 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:11:41.377 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): ceph-grafana-dashboards-19.3.0-5012.g08 150 kB/s | 34 kB 00:00 2024-09-19T11:11:41.403 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): ceph-prometheus-alerts-19.3.0-5012.g08a 65 kB/s | 16 kB 00:00 2024-09-19T11:11:41.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-immutable-object-cache 2024-09-19T11:11:41.886 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): ceph-mgr-dashboard-19.3.0-5012.g08af21e 19 MB/s | 14 MB 00:00 2024-09-19T11:11:42.045 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): protobuf-compiler-3.14.0-13.el9.x86_64. 5.3 MB/s | 863 kB 00:00 2024-09-19T11:11:42.070 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): python3-protobuf-3.14.0-13.el9.noarch.r 404 kB/s | 269 kB 00:00 2024-09-19T11:11:42.129 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 6.4 MB/s | 548 kB 00:00 2024-09-19T11:11:42.131 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:00:59 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:11:42.154 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): grpc-data-1.46.7-10.el9.noarch.rpm 232 kB/s | 19 kB 00:00 2024-09-19T11:11:42.187 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): python3-grpcio-tools-1.46.7-10.el9.x86_ 4.2 MB/s | 144 kB 00:00 2024-09-19T11:11:42.213 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): python3-repoze-lru-0.7-16.el9.noarch.rp 1.2 MB/s | 31 kB 00:00 2024-09-19T11:11:42.247 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): python3-routes-2.5.1-5.el9.noarch.rpm 5.5 MB/s | 188 kB 00:00 2024-09-19T11:11:42.270 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 145 k 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-19T11:11:42.271 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:42.272 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 145 k 2024-09-19T11:11:42.272 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 432 k 2024-09-19T11:11:42.272 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:11:42.289 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): python3-grpcio-1.46.7-10.el9.x86_64.rp 13 MB/s | 2.0 MB 00:00 2024-09-19T11:11:42.477 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-immutable-object-cache-19.3.0-5012.g08af21 709 kB/s | 145 kB 00:00 2024-09-19T11:11:42.477 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:42.477 INFO:teuthology.orchestra.run.smithi037.stdout:Total 704 kB/s | 145 kB 00:00 2024-09-19T11:11:42.478 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:11:42.486 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:11:42.486 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:11:42.489 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): protobuf-3.14.0-13.el9.x86_64.rpm 930 kB/s | 1.0 MB 00:01 2024-09-19T11:11:42.493 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:42.493 INFO:teuthology.orchestra.run.smithi102.stdout:Total 13 MB/s | 19 MB 00:01 2024-09-19T11:11:42.542 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:11:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:11:42.546 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:11:42.561 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:11:42.561 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:11:42.700 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:11:42.794 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0. 1/1 2024-09-19T11:11:42.820 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0. 1/1 2024-09-19T11:11:42.820 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:11:42.820 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-immutable-object-cache@*.service" escaped as "ceph-immutable-object-cache@\x2a.service". 2024-09-19T11:11:42.821 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:42.833 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:11:42.833 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:11:43.426 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:11:43.514 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-19T11:11:43.550 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-19T11:11:43.596 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-19T11:11:43.635 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-19T11:11:43.740 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-19T11:11:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0. 1/1 2024-09-19T11:11:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:43.778 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:11:43.778 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-immutable-object-cache-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:11:43.779 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:43.779 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:11:43.878 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-19T11:11:43.973 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-19T11:11:44.007 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr 2024-09-19T11:11:44.023 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-19T11:11:44.051 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-19T11:11:44.084 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.el9 10/12 2024-09-19T11:11:44.616 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:01 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:11:44.707 INFO:teuthology.orchestra.run.smithi037.stdout:Package ceph-mgr-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:11:44.752 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:11:44.753 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:11:44.753 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:11:44.818 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-dashboard 2024-09-19T11:11:45.423 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:02 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:11:45.561 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:11:45.562 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:45.562 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:11:45.562 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:45.562 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:11:45.562 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 14 M 2024-09-19T11:11:45.562 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:11:45.562 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp x86_64 20211102.0-3.el9 epel 548 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 34 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 16 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data noarch 1.46.7-10.el9 epel 19 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf x86_64 3.14.0-13.el9 appstream 1.0 M 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler x86_64 3.14.0-13.el9 crb 863 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio x86_64 1.46.7-10.el9 epel 2.0 M 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools x86_64 1.46.7-10.el9 epel 144 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf noarch 3.14.0-13.el9 appstream 269 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru noarch 0.7-16.el9 epel 31 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes noarch 2.5.1-5.el9 epel 188 k 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:11:45.563 INFO:teuthology.orchestra.run.smithi037.stdout:Install 12 Packages 2024-09-19T11:11:45.564 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:45.564 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 19 M 2024-09-19T11:11:45.564 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 159 M 2024-09-19T11:11:45.564 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:11:45.972 INFO:teuthology.orchestra.run.smithi037.stdout:(1/12): ceph-grafana-dashboards-19.3.0-5012.g08 113 kB/s | 34 kB 00:00 2024-09-19T11:11:45.997 INFO:teuthology.orchestra.run.smithi037.stdout:(2/12): ceph-prometheus-alerts-19.3.0-5012.g08a 50 kB/s | 16 kB 00:00 2024-09-19T11:11:46.864 INFO:teuthology.orchestra.run.smithi037.stdout:(3/12): ceph-mgr-dashboard-19.3.0-5012.g08af21e 12 MB/s | 14 MB 00:01 2024-09-19T11:11:46.889 INFO:teuthology.orchestra.run.smithi037.stdout:(4/12): python3-protobuf-3.14.0-13.el9.noarch.r 302 kB/s | 269 kB 00:00 2024-09-19T11:11:46.948 INFO:teuthology.orchestra.run.smithi037.stdout:(5/12): abseil-cpp-20211102.0-3.el9.x86_64.rpm 9.2 MB/s | 548 kB 00:00 2024-09-19T11:11:46.973 INFO:teuthology.orchestra.run.smithi037.stdout:(6/12): grpc-data-1.46.7-10.el9.noarch.rpm 782 kB/s | 19 kB 00:00 2024-09-19T11:11:47.015 INFO:teuthology.orchestra.run.smithi037.stdout:(7/12): protobuf-3.14.0-13.el9.x86_64.rpm 991 kB/s | 1.0 MB 00:01 2024-09-19T11:11:47.074 INFO:teuthology.orchestra.run.smithi037.stdout:(8/12): protobuf-compiler-3.14.0-13.el9.x86_64. 4.0 MB/s | 863 kB 00:00 2024-09-19T11:11:47.132 INFO:teuthology.orchestra.run.smithi037.stdout:(9/12): python3-grpcio-1.46.7-10.el9.x86_64.rpm 13 MB/s | 2.0 MB 00:00 2024-09-19T11:11:47.157 INFO:teuthology.orchestra.run.smithi037.stdout:(10/12): python3-grpcio-tools-1.46.7-10.el9.x86 1.0 MB/s | 144 kB 00:00 2024-09-19T11:11:47.183 INFO:teuthology.orchestra.run.smithi037.stdout:(11/12): python3-repoze-lru-0.7-16.el9.noarch.r 288 kB/s | 31 kB 00:00 2024-09-19T11:11:47.208 INFO:teuthology.orchestra.run.smithi037.stdout:(12/12): python3-routes-2.5.1-5.el9.noarch.rpm 2.5 MB/s | 188 kB 00:00 2024-09-19T11:11:47.213 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:47.213 INFO:teuthology.orchestra.run.smithi037.stdout:Total 12 MB/s | 19 MB 00:01 2024-09-19T11:11:47.266 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:11:47.283 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0.el 11/12 2024-09-19T11:11:47.287 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:11:47.287 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:11:47.339 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noa 12/12 2024-09-19T11:11:47.573 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:11:47.573 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:11:48.181 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:11:48.268 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-3.14.0-13.el9.x86_64 1/12 2024-09-19T11:11:48.311 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : protobuf-compiler-3.14.0-13.el9.x86_64 2/12 2024-09-19T11:11:48.359 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-repoze-lru-0.7-16.el9.noarch 3/12 2024-09-19T11:11:48.396 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-routes-2.5.1-5.el9.noarch 4/12 2024-09-19T11:11:48.507 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : grpc-data-1.46.7-10.el9.noarch 5/12 2024-09-19T11:11:48.645 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : abseil-cpp-20211102.0-3.el9.x86_64 6/12 2024-09-19T11:11:48.744 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-1.46.7-10.el9.x86_64 7/12 2024-09-19T11:11:48.793 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-protobuf-3.14.0-13.el9.noarch 8/12 2024-09-19T11:11:48.821 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-grpcio-tools-1.46.7-10.el9.x86_64 9/12 2024-09-19T11:11:48.853 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.el9 10/12 2024-09-19T11:11:49.441 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noa 12/12 2024-09-19T11:11:49.441 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0.el 1/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noa 2/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.el9 3/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-19T11:11:49.442 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-19T11:11:49.768 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-19T11:11:49.768 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:49.768 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:11:49.768 INFO:teuthology.orchestra.run.smithi102.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T11:11:49.768 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:49.768 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:49.768 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:49.768 INFO:teuthology.orchestra.run.smithi102.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:49.769 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:11:50.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-19T11:11:50.612 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:08 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:11:50.745 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:11:50.746 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-09-19T11:11:50.746 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 7.4 M 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T11:11:50.747 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout:======================================================================================= 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout:Install 12 Packages 2024-09-19T11:11:50.748 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:11:50.749 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 38 M 2024-09-19T11:11:50.749 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 212 M 2024-09-19T11:11:50.749 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:11:51.396 INFO:teuthology.orchestra.run.smithi102.stdout:(1/12): libquadmath-11.5.0-2.el9.x86_64.rpm 335 kB/s | 191 kB 00:00 2024-09-19T11:11:51.488 INFO:teuthology.orchestra.run.smithi102.stdout:(2/12): ceph-mgr-diskprediction-local-19.3.0-50 11 MB/s | 7.4 MB 00:00 2024-09-19T11:11:51.580 INFO:teuthology.orchestra.run.smithi102.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 178 kB/s | 33 kB 00:00 2024-09-19T11:11:51.630 INFO:teuthology.orchestra.run.smithi102.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 365 kB/s | 18 kB 00:00 2024-09-19T11:11:51.680 INFO:teuthology.orchestra.run.smithi102.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 768 kB/s | 38 kB 00:00 2024-09-19T11:11:51.706 INFO:teuthology.orchestra.run.smithi102.stdout:(6/12): libgfortran-11.5.0-2.el9.x86_64.rpm 910 kB/s | 801 kB 00:00 2024-09-19T11:11:51.906 INFO:teuthology.orchestra.run.smithi102.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 1.2 MB/s | 245 kB 00:00 2024-09-19T11:11:51.957 INFO:teuthology.orchestra.run.smithi102.stdout:(8/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 6.4 MB/s | 3.0 MB 00:00 2024-09-19T11:11:52.015 INFO:teuthology.orchestra.run.smithi102.stdout:(9/12): python3-numpy-f2py-1.20.1-5.el9.x86_64. 4.2 MB/s | 250 kB 00:00 2024-09-19T11:11:52.190 INFO:teuthology.orchestra.run.smithi102.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 9.7 MB/s | 4.9 MB 00:00 2024-09-19T11:11:52.248 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0.el 11/12 2024-09-19T11:11:52.315 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noa 12/12 2024-09-19T11:11:52.399 INFO:teuthology.orchestra.run.smithi102.stdout:(11/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 10 MB/s | 5.1 MB 00:00 2024-09-19T11:11:52.907 INFO:teuthology.orchestra.run.smithi102.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 18 MB/s | 16 MB 00:00 2024-09-19T11:11:52.908 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:52.908 INFO:teuthology.orchestra.run.smithi102.stdout:Total 18 MB/s | 38 MB 00:02 2024-09-19T11:11:53.258 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:11:53.282 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:11:53.283 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:11:53.714 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:11:53.714 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:11:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noa 12/12 2024-09-19T11:11:54.202 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0.el 1/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noa 2/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.el9 3/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-3.14.0-13.el9.x86_64 4/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-protobuf-3.14.0-13.el9.noarch 5/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : protobuf-compiler-3.14.0-13.el9.x86_64 6/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : abseil-cpp-20211102.0-3.el9.x86_64 7/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : grpc-data-1.46.7-10.el9.noarch 8/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-1.46.7-10.el9.x86_64 9/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-grpcio-tools-1.46.7-10.el9.x86_64 10/12 2024-09-19T11:11:54.203 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-repoze-lru-0.7-16.el9.noarch 11/12 2024-09-19T11:11:54.479 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:11:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-routes-2.5.1-5.el9.noarch 12/12 2024-09-19T11:11:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:54.532 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:11:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: abseil-cpp-20211102.0-3.el9.x86_64 2024-09-19T11:11:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-grafana-dashboards-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:54.532 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-dashboard-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-prometheus-alerts-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: grpc-data-1.46.7-10.el9.noarch 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-3.14.0-13.el9.x86_64 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: protobuf-compiler-3.14.0-13.el9.x86_64 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-1.46.7-10.el9.x86_64 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: python3-grpcio-tools-1.46.7-10.el9.x86_64 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: python3-protobuf-3.14.0-13.el9.noarch 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: python3-repoze-lru-0.7-16.el9.noarch 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: python3-routes-2.5.1-5.el9.noarch 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:54.533 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:11:54.562 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-19T11:11:54.615 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-19T11:11:54.711 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-19T11:11:54.739 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-19T11:11:54.810 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-diskprediction-local 2024-09-19T11:11:54.914 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-19T11:11:54.938 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-19T11:11:55.015 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-19T11:11:55.429 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:12 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:11:55.570 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:11:55.571 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-19T11:11:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:11:55.571 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-19T11:11:55.571 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:11:55.571 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 7.4 M 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas x86_64 3.0.4-8.el9 appstream 33 k 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib x86_64 3.0.4-8.el9 appstream 3.0 M 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp x86_64 3.0.4-8.el9 appstream 18 k 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran x86_64 11.5.0-2.el9 baseos 801 k 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath x86_64 11.5.0-2.el9 baseos 191 k 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: openblas x86_64 0.3.26-2.el9 appstream 38 k 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp x86_64 0.3.26-2.el9 appstream 4.9 M 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel x86_64 3.9.19-8.el9 appstream 245 k 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy x86_64 1:1.20.1-5.el9 appstream 5.1 M 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py x86_64 1:1.20.1-5.el9 appstream 250 k 2024-09-19T11:11:55.572 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy x86_64 1.6.2-8.el9 appstream 16 M 2024-09-19T11:11:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:55.573 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:11:55.573 INFO:teuthology.orchestra.run.smithi037.stdout:======================================================================================= 2024-09-19T11:11:55.573 INFO:teuthology.orchestra.run.smithi037.stdout:Install 12 Packages 2024-09-19T11:11:55.573 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:11:55.574 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 38 M 2024-09-19T11:11:55.574 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 212 M 2024-09-19T11:11:55.574 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:11:55.663 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-19T11:11:55.776 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-19T11:11:56.248 INFO:teuthology.orchestra.run.smithi037.stdout:(1/12): ceph-mgr-diskprediction-local-19.3.0-50 14 MB/s | 7.4 MB 00:00 2024-09-19T11:11:56.290 INFO:teuthology.orchestra.run.smithi037.stdout:(2/12): libquadmath-11.5.0-2.el9.x86_64.rpm 339 kB/s | 191 kB 00:00 2024-09-19T11:11:56.357 INFO:teuthology.orchestra.run.smithi037.stdout:(3/12): flexiblas-3.0.4-8.el9.x86_64.rpm 302 kB/s | 33 kB 00:00 2024-09-19T11:11:56.399 INFO:teuthology.orchestra.run.smithi037.stdout:(4/12): flexiblas-openblas-openmp-3.0.4-8.el9.x 436 kB/s | 18 kB 00:00 2024-09-19T11:11:56.449 INFO:teuthology.orchestra.run.smithi037.stdout:(5/12): openblas-0.3.26-2.el9.x86_64.rpm 772 kB/s | 38 kB 00:00 2024-09-19T11:11:56.516 INFO:teuthology.orchestra.run.smithi037.stdout:(6/12): flexiblas-netlib-3.0.4-8.el9.x86_64.rpm 13 MB/s | 3.0 MB 00:00 2024-09-19T11:11:56.567 INFO:teuthology.orchestra.run.smithi037.stdout:(7/12): python3-devel-3.9.19-8.el9.x86_64.rpm 4.8 MB/s | 245 kB 00:00 2024-09-19T11:11:56.600 INFO:teuthology.orchestra.run.smithi037.stdout:(8/12): libgfortran-11.5.0-2.el9.x86_64.rpm 917 kB/s | 801 kB 00:00 2024-09-19T11:11:56.709 INFO:teuthology.orchestra.run.smithi037.stdout:(9/12): python3-numpy-1.20.1-5.el9.x86_64.rpm 36 MB/s | 5.1 MB 00:00 2024-09-19T11:11:56.801 INFO:teuthology.orchestra.run.smithi037.stdout:(10/12): openblas-openmp-0.3.26-2.el9.x86_64.rp 14 MB/s | 4.9 MB 00:00 2024-09-19T11:11:56.860 INFO:teuthology.orchestra.run.smithi037.stdout:(11/12): python3-numpy-f2py-1.20.1-5.el9.x86_64 967 kB/s | 250 kB 00:00 2024-09-19T11:11:57.009 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T11:11:57.068 INFO:teuthology.orchestra.run.smithi037.stdout:(12/12): python3-scipy-1.6.2-8.el9.x86_64.rpm 45 MB/s | 16 MB 00:00 2024-09-19T11:11:57.068 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:11:57.069 INFO:teuthology.orchestra.run.smithi037.stdout:Total 26 MB/s | 38 MB 00:01 2024-09-19T11:11:57.436 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:11:57.463 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:11:57.463 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:11:57.925 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:11:57.925 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:11:58.052 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-19T11:11:58.080 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af2 12/12 2024-09-19T11:11:58.717 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:11:58.799 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-3.0.4-8.el9.x86_64 1/12 2024-09-19T11:11:58.862 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libquadmath-11.5.0-2.el9.x86_64 2/12 2024-09-19T11:11:58.965 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libgfortran-11.5.0-2.el9.x86_64 3/12 2024-09-19T11:11:59.010 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-devel-3.9.19-8.el9.x86_64 4/12 2024-09-19T11:11:59.199 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-0.3.26-2.el9.x86_64 5/12 2024-09-19T11:11:59.241 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : openblas-openmp-0.3.26-2.el9.x86_64 6/12 2024-09-19T11:11:59.320 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 7/12 2024-09-19T11:12:00.018 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : flexiblas-netlib-3.0.4-8.el9.x86_64 8/12 2024-09-19T11:12:00.144 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-1:1.20.1-5.el9.x86_64 9/12 2024-09-19T11:12:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af2 12/12 2024-09-19T11:12:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af2 1/12 2024-09-19T11:12:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-19T11:12:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-19T11:12:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-19T11:12:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-19T11:12:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-19T11:12:00.639 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-19T11:12:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-19T11:12:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-19T11:12:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T11:12:00.640 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-19T11:12:01.027 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-19T11:12:01.027 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:01.027 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:01.027 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:12:01.027 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T11:12:01.027 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:01.028 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:01.464 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-rook 2024-09-19T11:12:01.502 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T11:12:02.063 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:20 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:02.197 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 49 k 2024-09-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T11:12:02.198 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:02.199 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi102.stdout:Install 13 Packages 2024-09-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 2.2 M 2024-09-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 26 M 2024-09-19T11:12:02.200 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:02.605 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-scipy-1.6.2-8.el9.x86_64 11/12 2024-09-19T11:12:02.640 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af2 12/12 2024-09-19T11:12:02.715 INFO:teuthology.orchestra.run.smithi102.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 267 kB/s | 26 kB 00:00 2024-09-19T11:12:02.798 INFO:teuthology.orchestra.run.smithi102.stdout:(2/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.6 MB/s | 222 kB 00:00 2024-09-19T11:12:02.824 INFO:teuthology.orchestra.run.smithi102.stdout:(3/13): ceph-mgr-rook-19.3.0-5012.g08af21e0.el9 240 kB/s | 49 kB 00:00 2024-09-19T11:12:02.857 INFO:teuthology.orchestra.run.smithi102.stdout:(4/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 2.6 MB/s | 159 kB 00:00 2024-09-19T11:12:02.924 INFO:teuthology.orchestra.run.smithi102.stdout:(5/13): python3-requests-oauthlib-1.3.0-12.el9. 803 kB/s | 54 kB 00:00 2024-09-19T11:12:02.966 INFO:teuthology.orchestra.run.smithi102.stdout:(6/13): python3-cachetools-4.2.4-1.el9.noarch.r 770 kB/s | 32 kB 00:00 2024-09-19T11:12:02.991 INFO:teuthology.orchestra.run.smithi102.stdout:(7/13): python3-certifi-2023.05.07-4.el9.noarch 566 kB/s | 14 kB 00:00 2024-09-19T11:12:03.016 INFO:teuthology.orchestra.run.smithi102.stdout:(8/13): python3-google-auth-2.34.0-1.el9.noarch 8.6 MB/s | 220 kB 00:00 2024-09-19T11:12:03.067 INFO:teuthology.orchestra.run.smithi102.stdout:(9/13): python3-kubernetes-26.1.0-2.el9.noarch. 20 MB/s | 1.0 MB 00:00 2024-09-19T11:12:03.092 INFO:teuthology.orchestra.run.smithi102.stdout:(10/13): python3-rsa-4.9-2.el9.noarch.rpm 2.3 MB/s | 59 kB 00:00 2024-09-19T11:12:03.117 INFO:teuthology.orchestra.run.smithi102.stdout:(11/13): python3-websocket-client-1.2.3-2.el9.n 3.5 MB/s | 90 kB 00:00 2024-09-19T11:12:05.166 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af2 12/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af2 1/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libgfortran-11.5.0-2.el9.x86_64 2/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libquadmath-11.5.0-2.el9.x86_64 3/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-3.0.4-8.el9.x86_64 4/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-netlib-3.0.4-8.el9.x86_64 5/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 6/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-0.3.26-2.el9.x86_64 7/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : openblas-openmp-0.3.26-2.el9.x86_64 8/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-devel-3.9.19-8.el9.x86_64 9/12 2024-09-19T11:12:05.167 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-1:1.20.1-5.el9.x86_64 10/12 2024-09-19T11:12:05.168 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-numpy-f2py-1:1.20.1-5.el9.x86_64 11/12 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-scipy-1.6.2-8.el9.x86_64 12/12 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-diskprediction-local-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-3.0.4-8.el9.x86_64 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-netlib-3.0.4-8.el9.x86_64 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: flexiblas-openblas-openmp-3.0.4-8.el9.x86_64 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: libgfortran-11.5.0-2.el9.x86_64 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: libquadmath-11.5.0-2.el9.x86_64 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-0.3.26-2.el9.x86_64 2024-09-19T11:12:05.637 INFO:teuthology.orchestra.run.smithi037.stdout: openblas-openmp-0.3.26-2.el9.x86_64 2024-09-19T11:12:05.638 INFO:teuthology.orchestra.run.smithi037.stdout: python3-devel-3.9.19-8.el9.x86_64 2024-09-19T11:12:05.638 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-1:1.20.1-5.el9.x86_64 2024-09-19T11:12:05.638 INFO:teuthology.orchestra.run.smithi037.stdout: python3-numpy-f2py-1:1.20.1-5.el9.x86_64 2024-09-19T11:12:05.638 INFO:teuthology.orchestra.run.smithi037.stdout: python3-scipy-1.6.2-8.el9.x86_64 2024-09-19T11:12:05.638 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:05.638 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:05.851 INFO:teuthology.orchestra.run.smithi102.stdout:(12/13): python3-jsonpointer-2.0-4.el9.noarch.r 5.9 kB/s | 19 kB 00:03 2024-09-19T11:12:06.036 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-rook 2024-09-19T11:12:06.661 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:23 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:06.800 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:06.801 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:06.801 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:12:06.801 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:06.801 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:06.801 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 49 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools noarch 4.2.4-1.el9 epel 32 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi noarch 2023.05.07-4.el9 epel 14 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth noarch 1:2.34.0-1.el9 epel 220 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch noarch 1.21-16.el9 appstream 26 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer noarch 2.0-4.el9 appstream 19 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes noarch 1:26.1.0-2.el9 epel 1.0 M 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib noarch 3.1.1-5.el9 appstream 222 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1 noarch 0.4.8-6.el9 appstream 159 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules noarch 0.4.8-6.el9 appstream 279 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib noarch 1.3.0-12.el9 appstream 54 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa noarch 4.9-2.el9 epel 59 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client noarch 1.2.3-2.el9 epel 90 k 2024-09-19T11:12:06.802 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:06.803 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:06.803 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:06.803 INFO:teuthology.orchestra.run.smithi037.stdout:Install 13 Packages 2024-09-19T11:12:06.803 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:06.803 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 2.2 M 2024-09-19T11:12:06.803 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 26 M 2024-09-19T11:12:06.803 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:07.134 INFO:teuthology.orchestra.run.smithi102.stdout:(13/13): python3-pyasn1-modules-0.4.8-6.el9.noa 65 kB/s | 279 kB 00:04 2024-09-19T11:12:07.135 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:07.136 INFO:teuthology.orchestra.run.smithi102.stdout:Total 459 kB/s | 2.2 MB 00:04 2024-09-19T11:12:07.203 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:07.218 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:07.218 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:07.309 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:07.312 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:07.372 INFO:teuthology.orchestra.run.smithi037.stdout:(1/13): python3-jsonpatch-1.21-16.el9.noarch.rp 223 kB/s | 26 kB 00:00 2024-09-19T11:12:07.398 INFO:teuthology.orchestra.run.smithi037.stdout:(2/13): python3-jsonpointer-2.0-4.el9.noarch.rp 137 kB/s | 19 kB 00:00 2024-09-19T11:12:07.423 INFO:teuthology.orchestra.run.smithi037.stdout:(3/13): ceph-mgr-rook-19.3.0-5012.g08af21e0.el9 298 kB/s | 49 kB 00:00 2024-09-19T11:12:07.482 INFO:teuthology.orchestra.run.smithi037.stdout:(4/13): python3-oauthlib-3.1.1-5.el9.noarch.rpm 2.0 MB/s | 222 kB 00:00 2024-09-19T11:12:07.540 INFO:teuthology.orchestra.run.smithi037.stdout:(5/13): python3-pyasn1-0.4.8-6.el9.noarch.rpm 1.1 MB/s | 159 kB 00:00 2024-09-19T11:12:07.565 INFO:teuthology.orchestra.run.smithi037.stdout:(6/13): python3-requests-oauthlib-1.3.0-12.el9. 643 kB/s | 54 kB 00:00 2024-09-19T11:12:07.615 INFO:teuthology.orchestra.run.smithi037.stdout:(7/13): python3-cachetools-4.2.4-1.el9.noarch.r 428 kB/s | 32 kB 00:00 2024-09-19T11:12:07.649 INFO:teuthology.orchestra.run.smithi037.stdout:(8/13): python3-pyasn1-modules-0.4.8-6.el9.noar 1.2 MB/s | 279 kB 00:00 2024-09-19T11:12:07.674 INFO:teuthology.orchestra.run.smithi037.stdout:(9/13): python3-certifi-2023.05.07-4.el9.noarch 130 kB/s | 14 kB 00:00 2024-09-19T11:12:07.708 INFO:teuthology.orchestra.run.smithi037.stdout:(10/13): python3-google-auth-2.34.0-1.el9.noarc 2.3 MB/s | 220 kB 00:00 2024-09-19T11:12:07.733 INFO:teuthology.orchestra.run.smithi037.stdout:(11/13): python3-rsa-4.9-2.el9.noarch.rpm 1.0 MB/s | 59 kB 00:00 2024-09-19T11:12:07.758 INFO:teuthology.orchestra.run.smithi037.stdout:(12/13): python3-websocket-client-1.2.3-2.el9.n 1.8 MB/s | 90 kB 00:00 2024-09-19T11:12:07.792 INFO:teuthology.orchestra.run.smithi037.stdout:(13/13): python3-kubernetes-26.1.0-2.el9.noarch 7.2 MB/s | 1.0 MB 00:00 2024-09-19T11:12:07.796 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:07.796 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.2 MB/s | 2.2 MB 00:00 2024-09-19T11:12:07.817 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:07.864 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:07.881 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:07.884 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:07.981 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:07.982 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-19T11:12:07.982 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:08.044 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-19T11:12:08.108 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-19T11:12:08.145 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-19T11:12:08.187 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-19T11:12:08.289 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-19T11:12:08.398 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-19T11:12:08.455 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-19T11:12:08.520 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:08.714 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-0.4.8-6.el9.noarch 1/13 2024-09-19T11:12:08.771 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-pyasn1-modules-0.4.8-6.el9.noarch 2/13 2024-09-19T11:12:08.827 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-rsa-4.9-2.el9.noarch 3/13 2024-09-19T11:12:08.862 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-websocket-client-1.2.3-2.el9.noarch 4/13 2024-09-19T11:12:08.912 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-certifi-2023.05.07-4.el9.noarch 5/13 2024-09-19T11:12:09.027 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-cachetools-4.2.4-1.el9.noarch 6/13 2024-09-19T11:12:09.136 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-google-auth-1:2.34.0-1.el9.noarch 7/13 2024-09-19T11:12:09.171 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-19T11:12:09.190 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-oauthlib-3.1.1-5.el9.noarch 8/13 2024-09-19T11:12:09.218 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-19T11:12:09.261 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-19T11:12:09.317 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-19T11:12:09.339 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 13/13 2024-09-19T11:12:09.953 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-requests-oauthlib-1.3.0-12.el9.noarch 9/13 2024-09-19T11:12:10.010 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-kubernetes-1:26.1.0-2.el9.noarch 10/13 2024-09-19T11:12:10.044 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpointer-2.0-4.el9.noarch 11/13 2024-09-19T11:12:10.093 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jsonpatch-1.21-16.el9.noarch 12/13 2024-09-19T11:12:10.122 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 13/13 2024-09-19T11:12:10.148 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 13/13 2024-09-19T11:12:10.148 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 1/13 2024-09-19T11:12:10.148 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-19T11:12:10.149 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-19T11:12:10.492 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-19T11:12:10.492 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:10.492 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:10.492 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:12:10.492 INFO:teuthology.orchestra.run.smithi102.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T11:12:10.492 INFO:teuthology.orchestra.run.smithi102.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T11:12:10.492 INFO:teuthology.orchestra.run.smithi102.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:10.493 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:10.749 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-mgr-cephadm 2024-09-19T11:12:10.965 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 13/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 1/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpatch-1.21-16.el9.noarch 2/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jsonpointer-2.0-4.el9.noarch 3/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-oauthlib-3.1.1-5.el9.noarch 4/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-0.4.8-6.el9.noarch 5/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-pyasn1-modules-0.4.8-6.el9.noarch 6/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-requests-oauthlib-1.3.0-12.el9.noarch 7/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-cachetools-4.2.4-1.el9.noarch 8/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-certifi-2023.05.07-4.el9.noarch 9/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-google-auth-1:2.34.0-1.el9.noarch 10/13 2024-09-19T11:12:10.966 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-kubernetes-1:26.1.0-2.el9.noarch 11/13 2024-09-19T11:12:10.967 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-rsa-4.9-2.el9.noarch 12/13 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-websocket-client-1.2.3-2.el9.noarch 13/13 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-rook-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-cachetools-4.2.4-1.el9.noarch 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-certifi-2023.05.07-4.el9.noarch 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-google-auth-1:2.34.0-1.el9.noarch 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpatch-1.21-16.el9.noarch 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jsonpointer-2.0-4.el9.noarch 2024-09-19T11:12:11.305 INFO:teuthology.orchestra.run.smithi037.stdout: python3-kubernetes-1:26.1.0-2.el9.noarch 2024-09-19T11:12:11.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-oauthlib-3.1.1-5.el9.noarch 2024-09-19T11:12:11.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-0.4.8-6.el9.noarch 2024-09-19T11:12:11.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-pyasn1-modules-0.4.8-6.el9.noarch 2024-09-19T11:12:11.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-requests-oauthlib-1.3.0-12.el9.noarch 2024-09-19T11:12:11.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-rsa-4.9-2.el9.noarch 2024-09-19T11:12:11.306 INFO:teuthology.orchestra.run.smithi037.stdout: python3-websocket-client-1.2.3-2.el9.noarch 2024-09-19T11:12:11.306 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:11.306 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:11.328 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:29 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:11.461 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 154 k 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T11:12:11.462 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T11:12:11.463 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:11.463 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:11.463 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:11.463 INFO:teuthology.orchestra.run.smithi102.stdout:Install 6 Packages 2024-09-19T11:12:11.463 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:11.463 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 7.0 M 2024-09-19T11:12:11.463 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 33 M 2024-09-19T11:12:11.464 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:11.570 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-mgr-cephadm 2024-09-19T11:12:11.987 INFO:teuthology.orchestra.run.smithi102.stdout:(1/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.2 MB/s | 248 kB 00:00 2024-09-19T11:12:12.021 INFO:teuthology.orchestra.run.smithi102.stdout:(2/6): ceph-mgr-cephadm-19.3.0-5012.g08af21e0.e 637 kB/s | 154 kB 00:00 2024-09-19T11:12:12.071 INFO:teuthology.orchestra.run.smithi102.stdout:(3/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 6.4 MB/s | 548 kB 00:00 2024-09-19T11:12:12.096 INFO:teuthology.orchestra.run.smithi102.stdout:(4/6): python3-natsort-7.1.1-5.el9.noarch.rpm 765 kB/s | 58 kB 00:00 2024-09-19T11:12:12.121 INFO:teuthology.orchestra.run.smithi102.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-19T11:12:12.181 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:29 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:12.320 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:12.320 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 154 k 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh noarch 2.13.2-5.el9 epel 548 k 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel noarch 2.9.1-2.el9 appstream 6.0 M 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2 noarch 2.11.3-6.el9 appstream 248 k 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort noarch 7.1.1-5.el9 epel 58 k 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions noarch 4.12.2-2.el9 epel 74 k 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:12.321 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:12.322 INFO:teuthology.orchestra.run.smithi037.stdout:Install 6 Packages 2024-09-19T11:12:12.322 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:12.322 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 7.0 M 2024-09-19T11:12:12.322 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 33 M 2024-09-19T11:12:12.322 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:12.380 INFO:teuthology.orchestra.run.smithi102.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 9.9 MB/s | 6.0 MB 00:00 2024-09-19T11:12:12.382 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:12.383 INFO:teuthology.orchestra.run.smithi102.stdout:Total 7.6 MB/s | 7.0 MB 00:00 2024-09-19T11:12:12.454 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:12.465 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:12.465 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:12.565 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:12.566 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:12.844 INFO:teuthology.orchestra.run.smithi037.stdout:(1/6): ceph-mgr-cephadm-19.3.0-5012.g08af21e0.e 736 kB/s | 154 kB 00:00 2024-09-19T11:12:12.871 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:12.878 INFO:teuthology.orchestra.run.smithi037.stdout:(2/6): python3-jinja2-2.11.3-6.el9.noarch.rpm 1.0 MB/s | 248 kB 00:00 2024-09-19T11:12:12.928 INFO:teuthology.orchestra.run.smithi037.stdout:(3/6): python3-natsort-7.1.1-5.el9.noarch.rpm 1.1 MB/s | 58 kB 00:00 2024-09-19T11:12:12.954 INFO:teuthology.orchestra.run.smithi037.stdout:(4/6): python3-asyncssh-2.13.2-5.el9.noarch.rpm 4.9 MB/s | 548 kB 00:00 2024-09-19T11:12:12.979 INFO:teuthology.orchestra.run.smithi037.stdout:(5/6): python3-typing-extensions-4.12.2-2.el9.n 1.5 MB/s | 74 kB 00:00 2024-09-19T11:12:13.045 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-19T11:12:13.098 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-19T11:12:13.624 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-19T11:12:13.739 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-19T11:12:13.819 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-19T11:12:13.844 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 6/6 2024-09-19T11:12:14.634 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 6/6 2024-09-19T11:12:14.635 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/6 2024-09-19T11:12:14.635 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-19T11:12:14.635 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-19T11:12:14.635 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-19T11:12:14.635 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T11:12:14.916 INFO:teuthology.orchestra.run.smithi102.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T11:12:14.917 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:14.917 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:15.004 INFO:teuthology.orchestra.run.smithi037.stdout:(6/6): python3-babel-2.9.1-2.el9.noarch.rpm 2.5 MB/s | 6.0 MB 00:02 2024-09-19T11:12:15.006 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:15.007 INFO:teuthology.orchestra.run.smithi037.stdout:Total 2.6 MB/s | 7.0 MB 00:02 2024-09-19T11:12:15.083 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:15.096 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:15.096 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:15.176 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-fuse 2024-09-19T11:12:15.204 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:15.204 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:15.525 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:15.712 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-typing-extensions-4.12.2-2.el9.noarch 1/6 2024-09-19T11:12:15.752 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:33 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:15.782 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-asyncssh-2.13.2-5.el9.noarch 2/6 2024-09-19T11:12:15.885 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:15.885 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:15.885 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:12:15.885 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 900 k 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout:Installing dependencies: 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout:Install 2 Packages 2024-09-19T11:12:15.886 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:15.887 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 979 k 2024-09-19T11:12:15.887 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 2.9 M 2024-09-19T11:12:15.887 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:16.332 INFO:teuthology.orchestra.run.smithi102.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 411 kB/s | 80 kB 00:00 2024-09-19T11:12:16.332 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-natsort-7.1.1-5.el9.noarch 3/6 2024-09-19T11:12:16.415 INFO:teuthology.orchestra.run.smithi102.stdout:(2/2): ceph-fuse-19.3.0-5012.g08af21e0.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-19T11:12:16.416 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:16.416 INFO:teuthology.orchestra.run.smithi102.stdout:Total 1.8 MB/s | 979 kB 00:00 2024-09-19T11:12:16.420 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-babel-2.9.1-2.el9.noarch 4/6 2024-09-19T11:12:16.428 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:16.448 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:16.449 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:16.504 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : python3-jinja2-2.11.3-6.el9.noarch 5/6 2024-09-19T11:12:16.531 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:16.531 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:16.534 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 6/6 2024-09-19T11:12:16.714 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:16.859 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-19T11:12:16.931 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2/2 2024-09-19T11:12:17.338 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 6/6 2024-09-19T11:12:17.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 1/6 2024-09-19T11:12:17.338 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-babel-2.9.1-2.el9.noarch 2/6 2024-09-19T11:12:17.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-jinja2-2.11.3-6.el9.noarch 3/6 2024-09-19T11:12:17.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-asyncssh-2.13.2-5.el9.noarch 4/6 2024-09-19T11:12:17.339 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-natsort-7.1.1-5.el9.noarch 5/6 2024-09-19T11:12:17.624 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : python3-typing-extensions-4.12.2-2.el9.noarch 6/6 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-mgr-cephadm-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout: python3-asyncssh-2.13.2-5.el9.noarch 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout: python3-babel-2.9.1-2.el9.noarch 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout: python3-jinja2-2.11.3-6.el9.noarch 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout: python3-natsort-7.1.1-5.el9.noarch 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout: python3-typing-extensions-4.12.2-2.el9.noarch 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:17.625 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:17.632 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2/2 2024-09-19T11:12:17.633 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 1/2 2024-09-19T11:12:17.881 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-fuse 2024-09-19T11:12:17.908 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-19T11:12:17.908 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:17.908 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:17.908 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-19T11:12:17.908 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:17.908 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:18.203 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install ceph-volume 2024-09-19T11:12:18.485 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:35 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:18.624 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:18.624 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:18.624 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:12:18.624 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:18.624 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:18.624 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 900 k 2024-09-19T11:12:18.625 INFO:teuthology.orchestra.run.smithi037.stdout:Installing dependencies: 2024-09-19T11:12:18.625 INFO:teuthology.orchestra.run.smithi037.stdout: fuse x86_64 2.9.9-16.el9 baseos 80 k 2024-09-19T11:12:18.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:18.625 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:18.625 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:18.625 INFO:teuthology.orchestra.run.smithi037.stdout:Install 2 Packages 2024-09-19T11:12:18.625 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:18.626 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 979 k 2024-09-19T11:12:18.626 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 2.9 M 2024-09-19T11:12:18.626 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:18.797 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:36 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:18.931 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repository Size 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 285 k 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T11:12:18.932 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:18.933 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 285 k 2024-09-19T11:12:18.933 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 1.3 M 2024-09-19T11:12:18.933 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:18.989 INFO:teuthology.orchestra.run.smithi037.stdout:(1/2): fuse-2.9.9-16.el9.x86_64.rpm 770 kB/s | 80 kB 00:00 2024-09-19T11:12:19.163 INFO:teuthology.orchestra.run.smithi102.stdout:ceph-volume-19.3.0-5012.g08af21e0.el9.noarch.rp 1.2 MB/s | 285 kB 00:00 2024-09-19T11:12:19.163 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:(2/2): ceph-fuse-19.3.0-5012.g08af21e0.el9.x86_ 3.2 MB/s | 900 kB 00:00 2024-09-19T11:12:19.164 INFO:teuthology.orchestra.run.smithi102.stdout:Total 1.2 MB/s | 285 kB 00:00 2024-09-19T11:12:19.164 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:19.164 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:19.165 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.8 MB/s | 979 kB 00:00 2024-09-19T11:12:19.172 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:19.172 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:19.177 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:19.200 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:19.200 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:19.203 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:19.204 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:19.287 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:19.287 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:19.422 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:19.483 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:19.490 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:12:19.506 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:12:19.506 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:12:19.507 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T11:12:19.507 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:19.640 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : fuse-2.9.9-16.el9.x86_64 1/2 2024-09-19T11:12:19.708 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2/2 2024-09-19T11:12:20.428 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2/2 2024-09-19T11:12:20.428 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 1/2 2024-09-19T11:12:20.582 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:12:20.583 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:20.583 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:20.583 INFO:teuthology.orchestra.run.smithi102.stdout: ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:12:20.583 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:20.583 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:20.713 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : fuse-2.9.9-16.el9.x86_64 2/2 2024-09-19T11:12:20.713 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:20.713 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:20.713 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 fuse-2.9.9-16.el9.x86_64 2024-09-19T11:12:20.713 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:20.713 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:20.866 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados-devel 2024-09-19T11:12:20.987 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install ceph-volume 2024-09-19T11:12:21.460 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:39 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:21.594 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 127 k 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T11:12:21.595 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:21.596 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 127 k 2024-09-19T11:12:21.596 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 456 k 2024-09-19T11:12:21.596 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:21.606 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:38 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:21.746 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repository Size 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume noarch 2:19.3.0-5012.g08af21e0.el9 ceph-noarch 285 k 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 285 k 2024-09-19T11:12:21.747 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 1.3 M 2024-09-19T11:12:21.748 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:librados-devel-19.3.0-5012.g08af21e0.el9.x86_64 550 kB/s | 127 kB 00:00 2024-09-19T11:12:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:21.827 INFO:teuthology.orchestra.run.smithi102.stdout:Total 546 kB/s | 127 kB 00:00 2024-09-19T11:12:21.828 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:21.833 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:21.833 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:21.897 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:21.897 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:22.001 INFO:teuthology.orchestra.run.smithi037.stdout:ceph-volume-19.3.0-5012.g08af21e0.el9.noarch.rp 1.1 MB/s | 285 kB 00:00 2024-09-19T11:12:22.002 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:22.002 INFO:teuthology.orchestra.run.smithi037.stdout:Total 1.1 MB/s | 285 kB 00:00 2024-09-19T11:12:22.002 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:22.011 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:22.012 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:22.042 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:22.043 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:22.054 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:22.157 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:22.273 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:22.337 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:12:22.353 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:12:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:12:22.354 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-volume@*.service" escaped as "ceph-volume@\x2a.service". 2024-09-19T11:12:22.354 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:22.599 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:22.875 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:22.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:22.875 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:22.875 INFO:teuthology.orchestra.run.smithi102.stdout: librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:22.875 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:22.875 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:23.135 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs2 2024-09-19T11:12:23.455 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 1/1 2024-09-19T11:12:23.455 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:23.455 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:23.456 INFO:teuthology.orchestra.run.smithi037.stdout: ceph-volume-2:19.3.0-5012.g08af21e0.el9.noarch 2024-09-19T11:12:23.456 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:23.456 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:23.732 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:41 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:23.785 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados-devel 2024-09-19T11:12:23.822 INFO:teuthology.orchestra.run.smithi102.stdout:Package libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:23.867 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:12:23.868 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:23.936 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install libcephfs-devel 2024-09-19T11:12:24.405 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:41 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:24.515 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:42 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:24.545 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 127 k 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-19T11:12:24.546 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:24.547 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 127 k 2024-09-19T11:12:24.547 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 456 k 2024-09-19T11:12:24.547 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:24.647 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:24.647 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 32 k 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 32 k 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 142 k 2024-09-19T11:12:24.648 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:24.756 INFO:teuthology.orchestra.run.smithi037.stdout:librados-devel-19.3.0-5012.g08af21e0.el9.x86_64 605 kB/s | 127 kB 00:00 2024-09-19T11:12:24.757 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:24.757 INFO:teuthology.orchestra.run.smithi037.stdout:Total 600 kB/s | 127 kB 00:00 2024-09-19T11:12:24.758 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:24.764 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:24.764 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:24.798 INFO:teuthology.orchestra.run.smithi102.stdout:libcephfs-devel-19.3.0-5012.g08af21e0.el9.x86_6 212 kB/s | 32 kB 00:00 2024-09-19T11:12:24.798 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:24.799 INFO:teuthology.orchestra.run.smithi102.stdout:Total 210 kB/s | 32 kB 00:00 2024-09-19T11:12:24.799 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:24.802 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:24.802 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:24.812 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:24.813 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:24.834 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:24.834 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:24.901 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:25.003 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:25.027 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:25.157 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:25.377 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:25.606 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:25.606 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:25.606 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:25.606 INFO:teuthology.orchestra.run.smithi102.stdout: libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:25.606 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:25.606 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:25.662 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:25.795 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librados2 2024-09-19T11:12:25.922 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:25.922 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:25.923 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:25.923 INFO:teuthology.orchestra.run.smithi037.stdout: librados-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:25.923 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:25.923 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:26.158 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs2 2024-09-19T11:12:26.376 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:44 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:26.466 INFO:teuthology.orchestra.run.smithi102.stdout:Package librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:26.510 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:26.511 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:12:26.511 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:26.579 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install librbd1 2024-09-19T11:12:26.767 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:43 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:26.862 INFO:teuthology.orchestra.run.smithi037.stdout:Package libcephfs2-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:26.908 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:26.909 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:12:26.909 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:26.979 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install libcephfs-devel 2024-09-19T11:12:27.151 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:45 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:27.238 INFO:teuthology.orchestra.run.smithi102.stdout:Package librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:27.281 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:27.282 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:12:27.282 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:27.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rados 2024-09-19T11:12:27.581 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:44 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:27.725 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:27.725 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:27.725 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-09-19T11:12:27.725 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:27.725 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:27.725 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 32 k 2024-09-19T11:12:27.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:27.726 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:27.726 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:27.726 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-19T11:12:27.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:27.726 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 32 k 2024-09-19T11:12:27.726 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 142 k 2024-09-19T11:12:27.726 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:27.867 INFO:teuthology.orchestra.run.smithi037.stdout:libcephfs-devel-19.3.0-5012.g08af21e0.el9.x86_6 221 kB/s | 32 kB 00:00 2024-09-19T11:12:27.868 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:27.868 INFO:teuthology.orchestra.run.smithi037.stdout:Total 218 kB/s | 32 kB 00:00 2024-09-19T11:12:27.868 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:27.872 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:27.872 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:27.889 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:27.889 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:27.931 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:45 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:27.984 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:28.021 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:28.066 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:28.066 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:12:28.066 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:28.109 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:28.138 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rgw 2024-09-19T11:12:28.472 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:28.726 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:28.726 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:28.726 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:28.727 INFO:teuthology.orchestra.run.smithi037.stdout: libcephfs-devel-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:28.727 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:28.727 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:28.732 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:46 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:28.826 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:28.870 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:28.871 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:12:28.871 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:28.924 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librados2 2024-09-19T11:12:28.955 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-cephfs 2024-09-19T11:12:29.524 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:46 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:29.552 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:47 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:29.617 INFO:teuthology.orchestra.run.smithi037.stdout:Package librados2-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:29.642 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:29.663 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:29.664 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:12:29.664 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:29.686 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:29.687 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:12:29.687 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:29.740 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install librbd1 2024-09-19T11:12:29.765 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install python3-rbd 2024-09-19T11:12:30.340 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:48 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:30.342 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:47 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:30.430 INFO:teuthology.orchestra.run.smithi102.stdout:Package python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:30.434 INFO:teuthology.orchestra.run.smithi037.stdout:Package librbd1-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:30.473 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:30.474 INFO:teuthology.orchestra.run.smithi102.stdout:Nothing to do. 2024-09-19T11:12:30.474 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:30.481 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:30.482 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:12:30.482 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:30.539 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-fuse 2024-09-19T11:12:30.544 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rados 2024-09-19T11:12:31.116 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:49 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:31.149 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:48 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:31.242 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rados-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:31.248 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:31.249 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:31.249 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-19T11:12:31.249 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:31.249 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:31.249 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 85 k 2024-09-19T11:12:31.249 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:31.249 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:31.250 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:31.250 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T11:12:31.250 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:31.250 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 85 k 2024-09-19T11:12:31.250 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 231 k 2024-09-19T11:12:31.250 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:31.288 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:31.289 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:12:31.289 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:31.357 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rgw 2024-09-19T11:12:31.452 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-fuse-19.3.0-5012.g08af21e0.el9.x86_64.rpm 423 kB/s | 85 kB 00:00 2024-09-19T11:12:31.452 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:31.453 INFO:teuthology.orchestra.run.smithi102.stdout:Total 420 kB/s | 85 kB 00:00 2024-09-19T11:12:31.453 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:31.459 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:31.459 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:31.523 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:31.523 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:31.665 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:31.774 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:31.963 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:48 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:32.057 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rgw-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:32.104 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:32.105 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:12:32.105 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:32.181 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-cephfs 2024-09-19T11:12:32.231 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:32.471 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:32.471 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:32.471 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:32.471 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:32.471 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:32.471 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:32.729 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-mirror 2024-09-19T11:12:32.788 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:49 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:32.881 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-cephfs-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:32.926 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:32.928 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:12:32.928 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:32.995 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install python3-rbd 2024-09-19T11:12:33.320 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:51 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout: Package Arch Version Repo Size 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.2 M 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:33.460 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:33.461 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T11:12:33.461 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:33.461 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 3.2 M 2024-09-19T11:12:33.461 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 14 M 2024-09-19T11:12:33.461 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:33.601 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:50 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:33.695 INFO:teuthology.orchestra.run.smithi037.stdout:Package python3-rbd-2:19.3.0-5012.g08af21e0.el9.x86_64 is already installed. 2024-09-19T11:12:33.741 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:33.742 INFO:teuthology.orchestra.run.smithi037.stdout:Nothing to do. 2024-09-19T11:12:33.743 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:33.789 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-mirror-19.3.0-5012.g08af21e0.el9.x86_64.rpm 9.7 MB/s | 3.2 MB 00:00 2024-09-19T11:12:33.789 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:33.790 INFO:teuthology.orchestra.run.smithi102.stdout:Total 9.7 MB/s | 3.2 MB 00:00 2024-09-19T11:12:33.790 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:33.800 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:33.800 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:33.812 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-fuse 2024-09-19T11:12:33.881 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:33.882 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:34.332 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:34.398 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:34.414 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:51 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:34.423 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:34.423 INFO:teuthology.orchestra.run.smithi102.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:12:34.423 INFO:teuthology.orchestra.run.smithi102.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T11:12:34.424 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T11:12:34.424 INFO:teuthology.orchestra.run.smithi102.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T11:12:34.424 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:34.553 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:34.553 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 85 k 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-19T11:12:34.554 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:34.555 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 85 k 2024-09-19T11:12:34.555 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 231 k 2024-09-19T11:12:34.555 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:34.821 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-fuse-19.3.0-5012.g08af21e0.el9.x86_64.rpm 320 kB/s | 85 kB 00:00 2024-09-19T11:12:34.822 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:34.822 INFO:teuthology.orchestra.run.smithi037.stdout:Total 319 kB/s | 85 kB 00:00 2024-09-19T11:12:34.822 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:34.829 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:34.830 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:34.897 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:34.897 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:35.158 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:35.272 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:35.506 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:35.506 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:35.644 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:35.754 DEBUG:teuthology.orchestra.run.smithi102:> sudo yum -y install rbd-nbd 2024-09-19T11:12:35.950 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:35.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:35.950 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:35.950 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-fuse-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:35.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:35.950 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:36.215 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-mirror 2024-09-19T11:12:36.343 INFO:teuthology.orchestra.run.smithi102.stdout:Last metadata expiration check: 0:01:54 ago on Thu 19 Sep 2024 11:10:42 AM UTC. 2024-09-19T11:12:36.481 INFO:teuthology.orchestra.run.smithi102.stdout:Dependencies resolved. 2024-09-19T11:12:36.481 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: Package Architecture Version Repository Size 2024-09-19T11:12:36.481 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:36.481 INFO:teuthology.orchestra.run.smithi102.stdout:Installing: 2024-09-19T11:12:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 171 k 2024-09-19T11:12:36.481 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:36.482 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction Summary 2024-09-19T11:12:36.482 INFO:teuthology.orchestra.run.smithi102.stdout:================================================================================ 2024-09-19T11:12:36.482 INFO:teuthology.orchestra.run.smithi102.stdout:Install 1 Package 2024-09-19T11:12:36.482 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:36.482 INFO:teuthology.orchestra.run.smithi102.stdout:Total download size: 171 k 2024-09-19T11:12:36.482 INFO:teuthology.orchestra.run.smithi102.stdout:Installed size: 490 k 2024-09-19T11:12:36.482 INFO:teuthology.orchestra.run.smithi102.stdout:Downloading Packages: 2024-09-19T11:12:36.702 INFO:teuthology.orchestra.run.smithi102.stdout:rbd-nbd-19.3.0-5012.g08af21e0.el9.x86_64.rpm 779 kB/s | 171 kB 00:00 2024-09-19T11:12:36.702 INFO:teuthology.orchestra.run.smithi102.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:36.703 INFO:teuthology.orchestra.run.smithi102.stdout:Total 774 kB/s | 171 kB 00:00 2024-09-19T11:12:36.703 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction check 2024-09-19T11:12:36.710 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction check succeeded. 2024-09-19T11:12:36.710 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction test 2024-09-19T11:12:36.774 INFO:teuthology.orchestra.run.smithi102.stdout:Transaction test succeeded. 2024-09-19T11:12:36.774 INFO:teuthology.orchestra.run.smithi102.stdout:Running transaction 2024-09-19T11:12:36.823 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:53 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:36.931 INFO:teuthology.orchestra.run.smithi102.stdout: Preparing : 1/1 2024-09-19T11:12:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:36.963 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:36.963 INFO:teuthology.orchestra.run.smithi037.stdout: Package Arch Version Repo Size 2024-09-19T11:12:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 3.2 M 2024-09-19T11:12:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:36.964 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-19T11:12:36.964 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 3.2 M 2024-09-19T11:12:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 14 M 2024-09-19T11:12:36.965 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:37.041 INFO:teuthology.orchestra.run.smithi102.stdout: Installing : rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:37.315 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-mirror-19.3.0-5012.g08af21e0.el9.x86_64.rpm 9.1 MB/s | 3.2 MB 00:00 2024-09-19T11:12:37.316 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:37.316 INFO:teuthology.orchestra.run.smithi037.stdout:Total 9.1 MB/s | 3.2 MB 00:00 2024-09-19T11:12:37.317 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:37.327 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:37.327 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:37.415 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:37.415 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:37.474 INFO:teuthology.orchestra.run.smithi102.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:37.728 INFO:teuthology.orchestra.run.smithi102.stdout: Verifying : rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:37.729 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:37.729 INFO:teuthology.orchestra.run.smithi102.stdout:Installed: 2024-09-19T11:12:37.729 INFO:teuthology.orchestra.run.smithi102.stdout: rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:37.729 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:37.729 INFO:teuthology.orchestra.run.smithi102.stdout:Complete! 2024-09-19T11:12:37.896 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:37.958 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:37.963 DEBUG:teuthology.parallel:result is None 2024-09-19T11:12:37.985 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:37.985 INFO:teuthology.orchestra.run.smithi037.stdout:Glob pattern passed to enable, but globs are not supported for this. 2024-09-19T11:12:37.985 INFO:teuthology.orchestra.run.smithi037.stdout:Invalid unit name "ceph-rbd-mirror@*.service" escaped as "ceph-rbd-mirror@\x2a.service". 2024-09-19T11:12:37.985 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/multi-user.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T11:12:37.985 INFO:teuthology.orchestra.run.smithi037.stdout:Created symlink /etc/systemd/system/ceph.target.wants/ceph-rbd-mirror.target → /usr/lib/systemd/system/ceph-rbd-mirror.target. 2024-09-19T11:12:37.986 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:39.199 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:39.199 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:39.200 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:39.200 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-mirror-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:39.200 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:39.200 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:39.463 DEBUG:teuthology.orchestra.run.smithi037:> sudo yum -y install rbd-nbd 2024-09-19T11:12:40.071 INFO:teuthology.orchestra.run.smithi037.stdout:Last metadata expiration check: 0:01:57 ago on Thu 19 Sep 2024 11:10:43 AM UTC. 2024-09-19T11:12:40.209 INFO:teuthology.orchestra.run.smithi037.stdout:Dependencies resolved. 2024-09-19T11:12:40.210 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:40.210 INFO:teuthology.orchestra.run.smithi037.stdout: Package Architecture Version Repository Size 2024-09-19T11:12:40.210 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:40.210 INFO:teuthology.orchestra.run.smithi037.stdout:Installing: 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd x86_64 2:19.3.0-5012.g08af21e0.el9 ceph 171 k 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction Summary 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout:================================================================================ 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout:Install 1 Package 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout:Total download size: 171 k 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout:Installed size: 490 k 2024-09-19T11:12:40.211 INFO:teuthology.orchestra.run.smithi037.stdout:Downloading Packages: 2024-09-19T11:12:40.419 INFO:teuthology.orchestra.run.smithi037.stdout:rbd-nbd-19.3.0-5012.g08af21e0.el9.x86_64.rpm 823 kB/s | 171 kB 00:00 2024-09-19T11:12:40.419 INFO:teuthology.orchestra.run.smithi037.stdout:-------------------------------------------------------------------------------- 2024-09-19T11:12:40.419 INFO:teuthology.orchestra.run.smithi037.stdout:Total 818 kB/s | 171 kB 00:00 2024-09-19T11:12:40.420 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction check 2024-09-19T11:12:40.428 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction check succeeded. 2024-09-19T11:12:40.428 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction test 2024-09-19T11:12:40.496 INFO:teuthology.orchestra.run.smithi037.stdout:Transaction test succeeded. 2024-09-19T11:12:40.497 INFO:teuthology.orchestra.run.smithi037.stdout:Running transaction 2024-09-19T11:12:40.657 INFO:teuthology.orchestra.run.smithi037.stdout: Preparing : 1/1 2024-09-19T11:12:40.770 INFO:teuthology.orchestra.run.smithi037.stdout: Installing : rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:41.206 INFO:teuthology.orchestra.run.smithi037.stdout: Running scriptlet: rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: Verifying : rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 1/1 2024-09-19T11:12:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:41.465 INFO:teuthology.orchestra.run.smithi037.stdout:Installed: 2024-09-19T11:12:41.465 INFO:teuthology.orchestra.run.smithi037.stdout: rbd-nbd-2:19.3.0-5012.g08af21e0.el9.x86_64 2024-09-19T11:12:41.466 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:41.466 INFO:teuthology.orchestra.run.smithi037.stdout:Complete! 2024-09-19T11:12:41.691 DEBUG:teuthology.parallel:result is None 2024-09-19T11:12:41.692 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:12:41.846 DEBUG:teuthology.orchestra.run.smithi037:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T11:12:41.868 INFO:teuthology.orchestra.run.smithi037.stdout:19.3.0-5012.g08af21e0.el9 2024-09-19T11:12:41.868 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5012.g08af21e0.el9 2024-09-19T11:12:41.868 INFO:teuthology.task.install:The correct ceph version 19.3.0-5012.g08af21e0 is installed. 2024-09-19T11:12:41.870 DEBUG:teuthology.packaging:Querying https://shaman.ceph.com/api/search?status=ready&project=ceph&flavor=default&distros=centos%2F9%2Fx86_64&sha1=08af21e0d16078b88ddf808fe9ba2ab84dbe6754 2024-09-19T11:12:42.017 DEBUG:teuthology.orchestra.run.smithi102:> rpm -q ceph --qf '%{VERSION}-%{RELEASE}' 2024-09-19T11:12:42.041 INFO:teuthology.orchestra.run.smithi102.stdout:19.3.0-5012.g08af21e0.el9 2024-09-19T11:12:42.042 INFO:teuthology.packaging:The installed version of ceph is 19.3.0-5012.g08af21e0.el9 2024-09-19T11:12:42.042 INFO:teuthology.task.install:The correct ceph version 19.3.0-5012.g08af21e0 is installed. 2024-09-19T11:12:42.044 INFO:teuthology.task.install.util:Shipping valgrind.supp... 2024-09-19T11:12:42.044 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:42.044 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T11:12:42.071 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:12:42.071 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/home/ubuntu/cephtest/valgrind.supp 2024-09-19T11:12:42.109 INFO:teuthology.task.install.util:Shipping 'daemon-helper'... 2024-09-19T11:12:42.110 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:42.110 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T11:12:42.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T11:12:42.202 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:12:42.202 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/daemon-helper 2024-09-19T11:12:42.230 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/daemon-helper 2024-09-19T11:12:42.296 INFO:teuthology.task.install.util:Shipping 'adjust-ulimits'... 2024-09-19T11:12:42.297 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:42.297 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T11:12:42.322 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T11:12:42.388 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:12:42.388 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/adjust-ulimits 2024-09-19T11:12:42.415 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/adjust-ulimits 2024-09-19T11:12:42.480 INFO:teuthology.task.install.util:Shipping 'stdin-killer'... 2024-09-19T11:12:42.481 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:42.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T11:12:42.506 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T11:12:42.572 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:12:42.572 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/usr/bin/stdin-killer 2024-09-19T11:12:42.599 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod a=rx -- /usr/bin/stdin-killer 2024-09-19T11:12:42.664 INFO:teuthology.run_tasks:Running task ceph... 2024-09-19T11:12:42.742 INFO:tasks.ceph:Making ceph log dir writeable by non-root... 2024-09-19T11:12:42.743 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 777 /var/log/ceph 2024-09-19T11:12:42.745 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 777 /var/log/ceph 2024-09-19T11:12:42.771 INFO:tasks.ceph:Disabling ceph logrotate... 2024-09-19T11:12:42.771 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T11:12:42.811 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/logrotate.d/ceph 2024-09-19T11:12:42.837 INFO:tasks.ceph:Creating extra log directories... 2024-09-19T11:12:42.837 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T11:12:42.877 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/log/ceph/valgrind /var/log/ceph/profiling-logger 2024-09-19T11:12:42.910 INFO:tasks.ceph:Creating ceph cluster ceph... 2024-09-19T11:12:42.910 INFO:tasks.ceph:config {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'fs': 'xfs', 'mkfs_options': None, 'mount_options': None, 'skip_mgr_daemons': False, 'log_ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'cpu_profile': set(), 'cluster': 'ceph', 'mon_bind_msgr2': True, 'mon_bind_addrvec': True} 2024-09-19T11:12:42.911 INFO:tasks.ceph:ctx.config {'archive_path': '/home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417', 'branch': 'wip-yuval-test', 'description': 'rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}}', 'email': None, 'first_in_suite': False, 'job_id': '7912417', 'kernel': {'kdb': 1, 'sha1': 'distro'}, 'last_in_suite': False, 'machine_type': 'smithi', 'name': 'yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi', 'no_nested_subset': False, 'openstack': [{'volumes': {'count': 3, 'size': 10}}], 'os_type': 'centos', 'os_version': '9.stream', 'overrides': {'admin_socket': {'branch': 'wip-yuval-test'}, 'ceph': {'conf': {'client': {'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug ms': 1, 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}, 'ceph-deploy': {'bluestore': True, 'conf': {'client': {'log file': '/var/log/ceph/ceph-$name.$pid.log'}, 'mon': {}, 'osd': {'bdev async discard': True, 'bdev enable discard': True, 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}}, 'fs': 'xfs'}, 'install': {'ceph': {'flavor': 'default', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, 'rgw': {'ec-data-pool': True, 'erasure_code_profile': {'crush-failure-domain': 'osd', 'k': 3, 'm': 1, 'name': 'testprofile'}, 'frontend': 'beast'}, 's3tests': {'slow_backend': True}, 'thrashosds': {'bdev_inject_crash': 2, 'bdev_inject_crash_probability': 0.5}, 'workunit': {'branch': 'wip-yuval-test', 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754'}}, 'owner': 'scheduled_yuvalif@teuthology', 'priority': 100, 'repo': 'https://github.com/ceph/ceph-ci.git', 'roles': [['mon.a', 'osd.0'], ['mgr.x', 'client.0', 'osd.1', 'osd.2', 'osd.3']], 'seed': 4251, 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'sleep_before_teardown': 0, 'subset': '1/3', 'suite': 'rgw', 'suite_branch': 'wip-yuval-test', 'suite_path': '/home/teuthworker/src/git.ceph.com_ceph-c_08af21e0d16078b88ddf808fe9ba2ab84dbe6754/qa', 'suite_relpath': 'qa', 'suite_repo': 'https://git.ceph.com/ceph-ci.git', 'suite_sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'targets': {'smithi037.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBDFjJMVbHRGV3jhx5H3ivF+riokeC2WLVeBXRul9sYACBdXEiOrx1biLhgmXKnLP6XO3rGecAMlwO9hN+JExj5A=', 'smithi102.front.sepia.ceph.com': 'ecdsa-sha2-nistp256 AAAAE2VjZHNhLXNoYTItbmlzdHAyNTYAAAAIbmlzdHAyNTYAAABBBOiDAY5Qy2MNHA4XQniSHGqL+Gz0ohPpsnAM6bdjuUQ6wteVk6HMzqVHuWuN5s7uK6KDtzvpZ7k8OULiKRtOFDM='}, 'tasks': [{'internal.check_packages': None}, {'internal.buildpackages_prep': None}, {'internal.save_config': None}, {'internal.check_lock': None}, {'internal.add_remotes': None}, {'console_log': None}, {'internal.connect': None}, {'internal.push_inventory': None}, {'internal.serialize_remote_roles': None}, {'internal.check_conflict': None}, {'internal.check_ceph_data': None}, {'internal.vm_setup': None}, {'kernel': {'kdb': 1, 'sha1': 'distro'}}, {'internal.base': None}, {'internal.archive_upload': None}, {'internal.archive': None}, {'internal.coredump': None}, {'internal.sudo': None}, {'internal.syslog': None}, {'internal.timer': None}, {'pcp': None}, {'selinux': None}, {'ansible.cephlab': None}, {'clock': None}, {'install': None}, {'ceph': {'conf': {'client': {'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'osd': {'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug mgr': 20, 'debug ms': 1}, 'mon': {'debug mon': 20, 'debug ms': 1, 'debug paxos': 20}}, 'flavor': 'default', 'fs': 'xfs', 'log-ignorelist': ['\\(MDS_ALL_DOWN\\)', '\\(MDS_UP_LESS_THAN_MAX\\)', '\\(PG_AVAILABILITY\\)', '\\(PG_DEGRADED\\)', '\\(POOL_APP_NOT_ENABLED\\)', 'not have an application enabled'], 'sha1': '08af21e0d16078b88ddf808fe9ba2ab84dbe6754', 'cluster': 'ceph'}}, {'rgw': {'client.0': None}}, {'radosgw-admin': None}, {'radosgw-admin-rest': None}], 'teuthology': {'fragments_dropped': [], 'meta': {}, 'postmerge': []}, 'teuthology_branch': 'main', 'teuthology_sha1': '3752d3834a7b6cd13dc17dfaa6c2fd3658f3439a', 'timestamp': '2024-09-19_08:49:34', 'tube': 'smithi', 'user': 'yuvalif', 'verbose': False, 'worker_log': '/home/teuthworker/archive/worker_logs/dispatcher.smithi.3401856'} 2024-09-19T11:12:42.911 DEBUG:teuthology.orchestra.run.smithi037:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T11:12:42.943 DEBUG:teuthology.orchestra.run.smithi102:> install -d -m0755 -- /home/ubuntu/cephtest/ceph.data 2024-09-19T11:12:42.958 DEBUG:teuthology.orchestra.run.smithi037:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T11:12:42.999 DEBUG:teuthology.orchestra.run.smithi102:> sudo install -d -m0777 -- /var/run/ceph 2024-09-19T11:12:43.024 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:43.024 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T11:12:43.079 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T11:12:43.079 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_1 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 666 Links: 1 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 11:12:38.245446682 +0000 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 11:10:03.381290602 +0000 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 11:10:03.381290602 +0000 2024-09-19T11:12:43.136 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 11:10:03.381290602 +0000 2024-09-19T11:12:43.136 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T11:12:43.199 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-19T11:12:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-19T11:12:43.200 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000239694 s, 2.1 MB/s 2024-09-19T11:12:43.201 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T11:12:43.257 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_2 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 685 Links: 1 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 11:12:38.246446668 +0000 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 11:10:03.719286026 +0000 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 11:10:03.719286026 +0000 2024-09-19T11:12:43.314 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 11:10:03.719286026 +0000 2024-09-19T11:12:43.314 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T11:12:43.377 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-19T11:12:43.377 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-19T11:12:43.377 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.0002155 s, 2.4 MB/s 2024-09-19T11:12:43.379 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T11:12:43.436 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_3 2024-09-19T11:12:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T11:12:43.492 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:12:43.492 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 705 Links: 1 2024-09-19T11:12:43.492 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:12:43.492 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T11:12:43.493 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 11:12:38.246446668 +0000 2024-09-19T11:12:43.493 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 11:10:04.054281492 +0000 2024-09-19T11:12:43.493 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 11:10:04.054281492 +0000 2024-09-19T11:12:43.493 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 11:10:04.054281492 +0000 2024-09-19T11:12:43.493 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T11:12:43.556 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-19T11:12:43.556 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-19T11:12:43.556 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000201593 s, 2.5 MB/s 2024-09-19T11:12:43.557 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T11:12:43.614 DEBUG:teuthology.orchestra.run.smithi037:> stat /dev/vg_nvme/lv_4 2024-09-19T11:12:43.670 INFO:teuthology.orchestra.run.smithi037.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T11:12:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:12:43.671 INFO:teuthology.orchestra.run.smithi037.stdout:Device: 5h/5d Inode: 725 Links: 1 2024-09-19T11:12:43.671 INFO:teuthology.orchestra.run.smithi037.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:12:43.671 INFO:teuthology.orchestra.run.smithi037.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T11:12:43.671 INFO:teuthology.orchestra.run.smithi037.stdout:Access: 2024-09-19 11:12:38.246446668 +0000 2024-09-19T11:12:43.671 INFO:teuthology.orchestra.run.smithi037.stdout:Modify: 2024-09-19 11:10:04.400276808 +0000 2024-09-19T11:12:43.671 INFO:teuthology.orchestra.run.smithi037.stdout:Change: 2024-09-19 11:10:04.400276808 +0000 2024-09-19T11:12:43.671 INFO:teuthology.orchestra.run.smithi037.stdout: Birth: 2024-09-19 11:10:04.400276808 +0000 2024-09-19T11:12:43.671 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T11:12:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records in 2024-09-19T11:12:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:1+0 records out 2024-09-19T11:12:43.734 INFO:teuthology.orchestra.run.smithi037.stderr:512 bytes copied, 0.000184506 s, 2.8 MB/s 2024-09-19T11:12:43.736 DEBUG:teuthology.orchestra.run.smithi037:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T11:12:43.792 INFO:tasks.ceph:osd dev map: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-19T11:12:43.792 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:12:43.793 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/scratch_devs of=/dev/stdout 2024-09-19T11:12:43.811 DEBUG:teuthology.misc:devs=['/dev/vg_nvme/lv_1', '/dev/vg_nvme/lv_2', '/dev/vg_nvme/lv_3', '/dev/vg_nvme/lv_4'] 2024-09-19T11:12:43.811 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_1 2024-09-19T11:12:43.870 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_1 -> ../dm-0 2024-09-19T11:12:43.870 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:12:43.870 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 668 Links: 1 2024-09-19T11:12:43.870 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:12:43.870 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T11:12:43.871 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 11:12:34.667148799 +0000 2024-09-19T11:12:43.871 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 11:09:59.653943234 +0000 2024-09-19T11:12:43.871 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 11:09:59.653943234 +0000 2024-09-19T11:12:43.871 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 11:09:59.653943234 +0000 2024-09-19T11:12:43.871 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_1 of=/dev/null count=1 2024-09-19T11:12:43.939 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T11:12:43.939 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T11:12:43.939 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000234996 s, 2.2 MB/s 2024-09-19T11:12:43.940 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_1 2024-09-19T11:12:44.000 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_2 2024-09-19T11:12:44.057 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_2 -> ../dm-1 2024-09-19T11:12:44.057 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:12:44.057 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 684 Links: 1 2024-09-19T11:12:44.057 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:12:44.057 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T11:12:44.057 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 11:12:34.667148799 +0000 2024-09-19T11:12:44.058 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 11:09:59.982936371 +0000 2024-09-19T11:12:44.058 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 11:09:59.982936371 +0000 2024-09-19T11:12:44.058 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 11:09:59.982936371 +0000 2024-09-19T11:12:44.058 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_2 of=/dev/null count=1 2024-09-19T11:12:44.123 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T11:12:44.123 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T11:12:44.123 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000231353 s, 2.2 MB/s 2024-09-19T11:12:44.125 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_2 2024-09-19T11:12:44.182 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_3 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_3 -> ../dm-2 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 704 Links: 1 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 11:12:34.667148799 +0000 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 11:10:00.314929445 +0000 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 11:10:00.314929445 +0000 2024-09-19T11:12:44.238 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 11:10:00.314929445 +0000 2024-09-19T11:12:44.239 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_3 of=/dev/null count=1 2024-09-19T11:12:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T11:12:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T11:12:44.302 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000198051 s, 2.6 MB/s 2024-09-19T11:12:44.303 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_3 2024-09-19T11:12:44.361 DEBUG:teuthology.orchestra.run.smithi102:> stat /dev/vg_nvme/lv_4 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout: File: /dev/vg_nvme/lv_4 -> ../dm-3 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout: Size: 7 Blocks: 0 IO Block: 4096 symbolic link 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout:Device: 5h/5d Inode: 722 Links: 1 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout:Access: (0777/lrwxrwxrwx) Uid: ( 0/ root) Gid: ( 0/ root) 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout:Context: system_u:object_r:device_t:s0 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout:Access: 2024-09-19 11:12:34.668148778 +0000 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout:Modify: 2024-09-19 11:10:00.655922331 +0000 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout:Change: 2024-09-19 11:10:00.655922331 +0000 2024-09-19T11:12:44.418 INFO:teuthology.orchestra.run.smithi102.stdout: Birth: 2024-09-19 11:10:00.655922331 +0000 2024-09-19T11:12:44.419 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/dev/vg_nvme/lv_4 of=/dev/null count=1 2024-09-19T11:12:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records in 2024-09-19T11:12:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:1+0 records out 2024-09-19T11:12:44.482 INFO:teuthology.orchestra.run.smithi102.stderr:512 bytes copied, 0.000198592 s, 2.6 MB/s 2024-09-19T11:12:44.483 DEBUG:teuthology.orchestra.run.smithi102:> ! mount | grep -v devtmpfs | grep -q /dev/vg_nvme/lv_4 2024-09-19T11:12:44.540 INFO:tasks.ceph:osd dev map: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-19T11:12:44.540 INFO:tasks.ceph:remote_to_roles_to_devs: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-19T11:12:44.540 INFO:tasks.ceph:Generating config... 2024-09-19T11:12:44.542 INFO:tasks.ceph:[client] debug ms = 1 2024-09-19T11:12:44.542 INFO:tasks.ceph:[client] rgw gc obj min wait = 15 2024-09-19T11:12:44.542 INFO:tasks.ceph:[client] debug rgw = 20 2024-09-19T11:12:44.542 INFO:tasks.ceph:[client] setgroup = ceph 2024-09-19T11:12:44.542 INFO:tasks.ceph:[client] setuser = ceph 2024-09-19T11:12:44.542 INFO:tasks.ceph:[osd] debug ms = 1 2024-09-19T11:12:44.542 INFO:tasks.ceph:[osd] debug objclass = 20 2024-09-19T11:12:44.542 INFO:tasks.ceph:[osd] bdev async discard = True 2024-09-19T11:12:44.542 INFO:tasks.ceph:[osd] bdev enable discard = True 2024-09-19T11:12:44.542 INFO:tasks.ceph:[osd] bluestore allocator = bitmap 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] bluestore block size = 96636764160 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] bluestore fsck on mount = True 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] debug bluefs = 1/20 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] debug bluestore = 1/20 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] debug osd = 20 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] debug rocksdb = 4/10 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] mon osd backfillfull_ratio = 0.85 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] mon osd full ratio = 0.9 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] mon osd nearfull ratio = 0.8 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] osd failsafe full ratio = 0.95 2024-09-19T11:12:44.543 INFO:tasks.ceph:[osd] osd objectstore = bluestore 2024-09-19T11:12:44.544 INFO:tasks.ceph:[mgr] debug mgr = 20 2024-09-19T11:12:44.544 INFO:tasks.ceph:[mgr] debug ms = 1 2024-09-19T11:12:44.544 INFO:tasks.ceph:[mon] debug mon = 20 2024-09-19T11:12:44.544 INFO:tasks.ceph:[mon] debug ms = 1 2024-09-19T11:12:44.544 INFO:tasks.ceph:[mon] debug paxos = 20 2024-09-19T11:12:44.544 INFO:tasks.ceph:Setting up mon.a... 2024-09-19T11:12:44.545 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring /etc/ceph/ceph.keyring 2024-09-19T11:12:44.605 INFO:teuthology.orchestra.run.smithi037.stdout:creating /etc/ceph/ceph.keyring 2024-09-19T11:12:44.608 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=mon. /etc/ceph/ceph.keyring 2024-09-19T11:12:44.657 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T11:12:44.683 DEBUG:tasks.ceph:Ceph mon addresses: [('mon.a', '172.21.15.37')] 2024-09-19T11:12:44.684 DEBUG:tasks.ceph:writing out conf {'global': {'chdir': '', 'pid file': '/var/run/ceph/$cluster-$name.pid', 'auth supported': 'cephx', 'filestore xattr use omap': 'true', 'mon clock drift allowed': '1.000', 'osd crush chooseleaf type': '0', 'auth debug': 'true', 'ms die on old message': 'true', 'ms die on bug': 'true', 'mon max pg per osd': '10000', 'mon pg warn max object skew': '0', 'osd_pool_default_pg_autoscale_mode': 'off', 'osd pool default size': '2', 'mon osd allow primary affinity': 'true', 'mon osd allow pg remap': 'true', 'mon warn on legacy crush tunables': 'false', 'mon warn on crush straw calc version zero': 'false', 'mon warn on no sortbitwise': 'false', 'mon warn on osd down out interval zero': 'false', 'mon warn on too few osds': 'false', 'mon_warn_on_pool_pg_num_not_power_of_two': 'false', 'mon_warn_on_pool_no_redundancy': 'false', 'mon_allow_pool_size_one': 'true', 'osd pool default erasure code profile': 'plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd', 'osd default data pool replay window': '5', 'mon allow pool delete': 'true', 'mon cluster log file level': 'debug', 'debug asserts on shutdown': 'true', 'mon health detail to clog': 'false', 'mon host': '172.21.15.37'}, 'osd': {'osd journal size': '100', 'osd scrub load threshold': '5.0', 'osd scrub max interval': '600', 'osd mclock profile': 'high_recovery_ops', 'osd recover clone overlap': 'true', 'osd recovery max chunk': '1048576', 'osd debug shutdown': 'true', 'osd debug op order': 'true', 'osd debug verify stray on activate': 'true', 'osd debug trim objects': 'true', 'osd open classes on start': 'true', 'osd debug pg log writeout': 'true', 'osd deep scrub update digest min age': '30', 'osd map max advance': '10', 'journal zero on create': 'true', 'filestore ondisk finisher threads': '3', 'filestore apply finisher threads': '3', 'bdev debug aio': 'true', 'osd debug misdirected ops': 'true', 'debug ms': 1, 'debug objclass': 20, 'bdev async discard': True, 'bdev enable discard': True, 'bluestore allocator': 'bitmap', 'bluestore block size': 96636764160, 'bluestore fsck on mount': True, 'debug bluefs': '1/20', 'debug bluestore': '1/20', 'debug osd': 20, 'debug rocksdb': '4/10', 'mon osd backfillfull_ratio': 0.85, 'mon osd full ratio': 0.9, 'mon osd nearfull ratio': 0.8, 'osd failsafe full ratio': 0.95, 'osd objectstore': 'bluestore'}, 'mgr': {'debug ms': 1, 'debug mgr': 20, 'debug mon': '20', 'debug auth': '20', 'mon reweight min pgs per osd': '4', 'mon reweight min bytes per osd': '10', 'mgr/telemetry/nag': 'false'}, 'mon': {'debug ms': 1, 'debug mon': 20, 'debug paxos': 20, 'debug auth': '20', 'mon data avail warn': '5', 'mon mgr mkfs grace': '240', 'mon reweight min pgs per osd': '4', 'mon osd reporter subtree level': 'osd', 'mon osd prime pg temp': 'true', 'mon reweight min bytes per osd': '10', 'auth mon ticket ttl': '660', 'auth service ticket ttl': '240', 'mon_warn_on_insecure_global_id_reclaim': 'false', 'mon_warn_on_insecure_global_id_reclaim_allowed': 'false', 'mon_down_mkfs_grace': '2m', 'mon_warn_on_filestore_osds': 'false'}, 'client': {'rgw cache enabled': 'true', 'rgw enable ops log': 'true', 'rgw enable usage log': 'true', 'log file': '/var/log/ceph/$cluster-$name.$pid.log', 'admin socket': '/var/run/ceph/$cluster-$name.$pid.asok', 'debug ms': 1, 'rgw gc obj min wait': 15, 'debug rgw': 20, 'setgroup': 'ceph', 'setuser': 'ceph'}, 'mon.a': {}} 2024-09-19T11:12:44.685 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:44.685 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T11:12:44.740 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage monmaptool -c /home/ubuntu/cephtest/ceph.tmp.conf --create --clobber --enable-all-features --add a 172.21.15.37 --print /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:12:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:12:44.823 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:12:44.823 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: monmap file /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:12:44.824 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: generated fsid ea40044b-acee-4485-a78a-0f4c700e12ca 2024-09-19T11:12:44.824 INFO:teuthology.orchestra.run.smithi037.stdout:setting min_mon_release = quincy 2024-09-19T11:12:44.824 INFO:teuthology.orchestra.run.smithi037.stdout:epoch 0 2024-09-19T11:12:44.824 INFO:teuthology.orchestra.run.smithi037.stdout:fsid ea40044b-acee-4485-a78a-0f4c700e12ca 2024-09-19T11:12:44.824 INFO:teuthology.orchestra.run.smithi037.stdout:last_changed 2024-09-19T11:12:44.823537+0000 2024-09-19T11:12:44.824 INFO:teuthology.orchestra.run.smithi037.stdout:created 2024-09-19T11:12:44.823537+0000 2024-09-19T11:12:44.825 INFO:teuthology.orchestra.run.smithi037.stdout:min_mon_release 17 (quincy) 2024-09-19T11:12:44.825 INFO:teuthology.orchestra.run.smithi037.stdout:election_strategy: 1 2024-09-19T11:12:44.825 INFO:teuthology.orchestra.run.smithi037.stdout:0: [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] mon.a 2024-09-19T11:12:44.825 INFO:teuthology.orchestra.run.smithi037.stdout:monmaptool: writing epoch 0 to /home/ubuntu/cephtest/ceph.monmap (1 monitors) 2024-09-19T11:12:44.826 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.tmp.conf 2024-09-19T11:12:44.882 INFO:tasks.ceph:Writing /etc/ceph/ceph.conf for FSID ea40044b-acee-4485-a78a-0f4c700e12ca... 2024-09-19T11:12:44.883 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T11:12:44.925 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /etc/ceph && sudo chmod 0755 /etc/ceph && sudo tee /etc/ceph/ceph.conf && sudo chmod 0644 /etc/ceph/ceph.conf > /dev/null 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout:[global] 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: chdir = "" 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: auth supported = cephx 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: filestore xattr use omap = true 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: mon clock drift allowed = 1.000 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: osd crush chooseleaf type = 0 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: auth debug = true 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on old message = true 2024-09-19T11:12:44.967 INFO:teuthology.orchestra.run.smithi037.stdout: ms die on bug = true 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: mon pg warn max object skew = 0 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default size = 2 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow primary affinity = true 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd allow pg remap = true 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on legacy crush tunables = false 2024-09-19T11:12:44.968 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on crush straw calc version zero = false 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on no sortbitwise = false 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on osd down out interval zero = false 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: mon warn on too few osds = false 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: mon_allow_pool_size_one = true 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: osd default data pool replay window = 5 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: mon allow pool delete = true 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.969 INFO:teuthology.orchestra.run.smithi037.stdout: mon cluster log file level = debug 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: debug asserts on shutdown = true 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: mon health detail to clog = false 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: mon host = 172.21.15.37 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: fsid = ea40044b-acee-4485-a78a-0f4c700e12ca 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout:[osd] 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: osd journal size = 100 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub load threshold = 5.0 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: osd scrub max interval = 600 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: osd mclock profile = high_recovery_ops 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: osd recover clone overlap = true 2024-09-19T11:12:44.970 INFO:teuthology.orchestra.run.smithi037.stdout: osd recovery max chunk = 1048576 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug shutdown = true 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug op order = true 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug verify stray on activate = true 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug trim objects = true 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: osd open classes on start = true 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug pg log writeout = true 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: osd deep scrub update digest min age = 30 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: osd map max advance = 10 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.971 INFO:teuthology.orchestra.run.smithi037.stdout: journal zero on create = true 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: filestore ondisk finisher threads = 3 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: filestore apply finisher threads = 3 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: bdev debug aio = true 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: osd debug misdirected ops = true 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: debug objclass = 20 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: bdev async discard = True 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: bdev enable discard = True 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore allocator = bitmap 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore block size = 96636764160 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: bluestore fsck on mount = True 2024-09-19T11:12:44.972 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluefs = 1/20 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: debug bluestore = 1/20 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: debug osd = 20 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: debug rocksdb = 4/10 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd full ratio = 0.9 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd nearfull ratio = 0.8 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: osd failsafe full ratio = 0.95 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: osd objectstore = bluestore 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr] 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: debug mgr = 20 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-09-19T11:12:44.973 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: mgr/telemetry/nag = false 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout:[mon] 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: debug mon = 20 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: debug paxos = 20 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: debug auth = 20 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: mon data avail warn = 5 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: mon mgr mkfs grace = 240 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min pgs per osd = 4 2024-09-19T11:12:44.974 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd reporter subtree level = osd 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: mon osd prime pg temp = true 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: mon reweight min bytes per osd = 10 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: # 1m isn't quite enough 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: mon_down_mkfs_grace = 2m 2024-09-19T11:12:44.975 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: mon_warn_on_filestore_osds = false 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout:[client] 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: rgw cache enabled = true 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable ops log = true 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: rgw enable usage log = true 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: debug ms = 1 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: rgw gc obj min wait = 15 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: debug rgw = 20 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: setgroup = ceph 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout: setuser = ceph 2024-09-19T11:12:44.976 INFO:teuthology.orchestra.run.smithi037.stdout:[mon.a] 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout:[global] 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: chdir = "" 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: pid file = /var/run/ceph/$cluster-$name.pid 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: auth supported = cephx 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: filestore xattr use omap = true 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: mon clock drift allowed = 1.000 2024-09-19T11:12:44.977 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: osd crush chooseleaf type = 0 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: auth debug = true 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on old message = true 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: ms die on bug = true 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: mon max pg per osd = 10000 # >= luminous 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: mon pg warn max object skew = 0 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: # disable pg_autoscaler by default for new pools 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: osd_pool_default_pg_autoscale_mode = off 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default size = 2 2024-09-19T11:12:44.978 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow primary affinity = true 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd allow pg remap = true 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on legacy crush tunables = false 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on crush straw calc version zero = false 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on no sortbitwise = false 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on osd down out interval zero = false 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon warn on too few osds = false 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_pg_num_not_power_of_two = false 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_pool_no_redundancy = false 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: mon_allow_pool_size_one = true 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: osd pool default erasure code profile = plugin=jerasure technique=reed_sol_van k=2 m=1 crush-failure-domain=osd 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: osd default data pool replay window = 5 2024-09-19T11:12:44.979 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: mon allow pool delete = true 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: mon cluster log file level = debug 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: debug asserts on shutdown = true 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: mon health detail to clog = false 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: mon host = 172.21.15.37 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: fsid = ea40044b-acee-4485-a78a-0f4c700e12ca 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout:[osd] 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: osd journal size = 100 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub load threshold = 5.0 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: osd scrub max interval = 600 2024-09-19T11:12:44.980 INFO:teuthology.orchestra.run.smithi102.stdout: osd mclock profile = high_recovery_ops 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd recover clone overlap = true 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd recovery max chunk = 1048576 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug shutdown = true 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug op order = true 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug verify stray on activate = true 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug trim objects = true 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd open classes on start = true 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug pg log writeout = true 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: osd deep scrub update digest min age = 30 2024-09-19T11:12:44.981 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: osd map max advance = 10 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: journal zero on create = true 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: filestore ondisk finisher threads = 3 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: filestore apply finisher threads = 3 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: bdev debug aio = true 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: osd debug misdirected ops = true 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: debug objclass = 20 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: bdev async discard = True 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: bdev enable discard = True 2024-09-19T11:12:44.982 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore allocator = bitmap 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore block size = 96636764160 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: bluestore fsck on mount = True 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluefs = 1/20 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: debug bluestore = 1/20 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: debug osd = 20 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: debug rocksdb = 4/10 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd backfillfull_ratio = 0.85 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd full ratio = 0.9 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd nearfull ratio = 0.8 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: osd failsafe full ratio = 0.95 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: osd objectstore = bluestore 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout:[mgr] 2024-09-19T11:12:44.983 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: debug mgr = 20 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mgr/telemetry/nag = false 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout:[mon] 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: debug mon = 20 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: debug paxos = 20 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: debug auth = 20 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon data avail warn = 5 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon mgr mkfs grace = 240 2024-09-19T11:12:44.984 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min pgs per osd = 4 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd reporter subtree level = osd 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: mon osd prime pg temp = true 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: mon reweight min bytes per osd = 10 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: # rotate auth tickets quickly to exercise renewal paths 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: auth mon ticket ttl = 660 # 11m 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: auth service ticket ttl = 240 # 4m 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: # don't complain about insecure global_id in the test suite 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim = false 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_insecure_global_id_reclaim_allowed = false 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: # 1m isn't quite enough 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: mon_down_mkfs_grace = 2m 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.985 INFO:teuthology.orchestra.run.smithi102.stdout: mon_warn_on_filestore_osds = false 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout:[client] 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: rgw cache enabled = true 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable ops log = true 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: rgw enable usage log = true 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: log file = /var/log/ceph/$cluster-$name.$pid.log 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: admin socket = /var/run/ceph/$cluster-$name.$pid.asok 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: debug ms = 1 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: rgw gc obj min wait = 15 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: debug rgw = 20 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: setgroup = ceph 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout: setuser = ceph 2024-09-19T11:12:44.986 INFO:teuthology.orchestra.run.smithi102.stdout:[mon.a] 2024-09-19T11:12:44.987 INFO:tasks.ceph:Creating admin key on mon.a... 2024-09-19T11:12:44.988 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --gen-key --name=client.admin --cap mon 'allow *' --cap osd 'allow *' --cap mds 'allow *' --cap mgr 'allow *' /etc/ceph/ceph.keyring 2024-09-19T11:12:45.084 INFO:tasks.ceph:Copying monmap to all nodes... 2024-09-19T11:12:45.084 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:45.084 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/etc/ceph/ceph.keyring of=/dev/stdout 2024-09-19T11:12:45.100 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:45.100 DEBUG:teuthology.orchestra.run.smithi037:> dd if=/home/ubuntu/cephtest/ceph.monmap of=/dev/stdout 2024-09-19T11:12:45.155 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T11:12:45.155 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:45.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T11:12:45.156 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T11:12:45.232 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:12:45.232 DEBUG:teuthology.orchestra.run.smithi037:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:12:45.288 INFO:tasks.ceph:Sending monmap to node ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:12:45.288 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:12:45.288 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd of=/etc/ceph/ceph.keyring 2024-09-19T11:12:45.288 DEBUG:teuthology.orchestra.run.smithi102:> sudo chmod 0644 /etc/ceph/ceph.keyring 2024-09-19T11:12:45.324 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:12:45.325 DEBUG:teuthology.orchestra.run.smithi102:> dd of=/home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:12:45.380 INFO:tasks.ceph:Setting up mon nodes... 2024-09-19T11:12:45.381 INFO:tasks.ceph:Setting up mgr nodes... 2024-09-19T11:12:45.381 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/mgr/ceph-x && sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=mgr.x /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T11:12:45.490 INFO:teuthology.orchestra.run.smithi102.stdout:creating /var/lib/ceph/mgr/ceph-x/keyring 2024-09-19T11:12:45.493 INFO:tasks.ceph:Setting up mds nodes... 2024-09-19T11:12:45.493 INFO:tasks.ceph_client:Setting up client nodes... 2024-09-19T11:12:45.494 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool --create-keyring --gen-key --name=client.0 /etc/ceph/ceph.client.0.keyring && sudo chmod 0644 /etc/ceph/ceph.client.0.keyring 2024-09-19T11:12:45.534 INFO:teuthology.orchestra.run.smithi102.stdout:creating /etc/ceph/ceph.client.0.keyring 2024-09-19T11:12:45.547 INFO:tasks.ceph:Running mkfs on osd nodes... 2024-09-19T11:12:45.547 INFO:tasks.ceph:ctx.disk_config.remote_to_roles_to_dev: {Remote(name='ubuntu@smithi037.front.sepia.ceph.com'): {'osd.0': '/dev/vg_nvme/lv_1'}, Remote(name='ubuntu@smithi102.front.sepia.ceph.com'): {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'}} 2024-09-19T11:12:45.547 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/osd/ceph-0 2024-09-19T11:12:45.573 INFO:tasks.ceph:roles_to_devs: {'osd.0': '/dev/vg_nvme/lv_1'} 2024-09-19T11:12:45.573 INFO:tasks.ceph:role: osd.0 2024-09-19T11:12:45.574 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T11:12:45.574 DEBUG:teuthology.orchestra.run.smithi037:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T11:12:45.648 INFO:teuthology.orchestra.run.smithi037.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:12:45.648 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:12:45.648 INFO:teuthology.orchestra.run.smithi037.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:12:45.648 INFO:teuthology.orchestra.run.smithi037.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T11:12:45.648 INFO:teuthology.orchestra.run.smithi037.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:12:45.648 INFO:teuthology.orchestra.run.smithi037.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:12:45.648 INFO:teuthology.orchestra.run.smithi037.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:12:45.648 INFO:teuthology.orchestra.run.smithi037.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T11:12:45.649 INFO:teuthology.orchestra.run.smithi037.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:12:45.649 INFO:teuthology.orchestra.run.smithi037.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:12:46.151 INFO:teuthology.orchestra.run.smithi037.stdout:Discarding blocks...Done. 2024-09-19T11:12:46.153 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi037.front.sepia.ceph.com -o noatime 2024-09-19T11:12:46.153 DEBUG:teuthology.orchestra.run.smithi037:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-0 2024-09-19T11:12:46.289 DEBUG:teuthology.orchestra.run.smithi037:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-0 2024-09-19T11:12:46.324 DEBUG:teuthology.orchestra.run.smithi037:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 0 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:12:46.428 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:12:46.427+0000 7f8a4ae87640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-0/keyring: can't open /var/lib/ceph/osd/ceph-0/keyring: (2) No such file or directory 2024-09-19T11:12:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:12:46.428+0000 7f8a4ae87640 -1 created new key in keyring /var/lib/ceph/osd/ceph-0/keyring 2024-09-19T11:12:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:12:46.428+0000 7f8a4ae87640 -1 bdev(0x5593a4e7d800 /var/lib/ceph/osd/ceph-0/block) open stat got: (1) Operation not permitted 2024-09-19T11:12:46.429 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:12:46.428+0000 7f8a4ae87640 -1 bluestore(/var/lib/ceph/osd/ceph-0) _read_fsid unparsable uuid 2024-09-19T11:12:49.364 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-0 2024-09-19T11:12:49.396 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-1 2024-09-19T11:12:49.425 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-19T11:12:49.426 INFO:tasks.ceph:role: osd.1 2024-09-19T11:12:49.426 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:12:49.426 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_1 2024-09-19T11:12:49.501 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_1 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:12:49.501 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:12:49.501 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:12:49.501 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T11:12:49.501 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:12:49.502 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:12:49.502 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:12:49.502 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T11:12:49.502 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:12:49.502 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:12:50.021 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-19T11:12:50.024 INFO:tasks.ceph:mount /dev/vg_nvme/lv_1 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-19T11:12:50.024 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_1 /var/lib/ceph/osd/ceph-1 2024-09-19T11:12:50.157 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-1 2024-09-19T11:12:50.195 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-2 2024-09-19T11:12:50.264 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-19T11:12:50.264 INFO:tasks.ceph:role: osd.2 2024-09-19T11:12:50.264 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:12:50.264 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_2 2024-09-19T11:12:50.339 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_2 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:12:50.339 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:12:50.339 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:12:50.340 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T11:12:50.340 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:12:50.340 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:12:50.340 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:12:50.340 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T11:12:50.341 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:12:50.341 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:12:50.782 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-19T11:12:50.784 INFO:tasks.ceph:mount /dev/vg_nvme/lv_2 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-19T11:12:50.785 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_2 /var/lib/ceph/osd/ceph-2 2024-09-19T11:12:50.879 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-2 2024-09-19T11:12:50.907 DEBUG:teuthology.orchestra.run.smithi102:> sudo mkdir -p /var/lib/ceph/osd/ceph-3 2024-09-19T11:12:50.973 INFO:tasks.ceph:roles_to_devs: {'osd.1': '/dev/vg_nvme/lv_1', 'osd.2': '/dev/vg_nvme/lv_2', 'osd.3': '/dev/vg_nvme/lv_3'} 2024-09-19T11:12:50.973 INFO:tasks.ceph:role: osd.3 2024-09-19T11:12:50.973 INFO:tasks.ceph:['mkfs.xfs', '-f', '-i', 'size=2048'] on /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:12:50.974 DEBUG:teuthology.orchestra.run.smithi102:> yes | sudo mkfs.xfs -f -i size=2048 /dev/vg_nvme/lv_3 2024-09-19T11:12:51.045 INFO:teuthology.orchestra.run.smithi102.stdout:meta-data=/dev/vg_nvme/lv_3 isize=2048 agcount=4, agsize=5859072 blks 2024-09-19T11:12:51.045 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 attr=2, projid32bit=1 2024-09-19T11:12:51.045 INFO:teuthology.orchestra.run.smithi102.stdout: = crc=1 finobt=1, sparse=1, rmapbt=0 2024-09-19T11:12:51.046 INFO:teuthology.orchestra.run.smithi102.stdout: = reflink=1 bigtime=1 inobtcount=1 nrext64=0 2024-09-19T11:12:51.046 INFO:teuthology.orchestra.run.smithi102.stdout:data = bsize=4096 blocks=23436288, imaxpct=25 2024-09-19T11:12:51.046 INFO:teuthology.orchestra.run.smithi102.stdout: = sunit=0 swidth=0 blks 2024-09-19T11:12:51.046 INFO:teuthology.orchestra.run.smithi102.stdout:naming =version 2 bsize=4096 ascii-ci=0, ftype=1 2024-09-19T11:12:51.046 INFO:teuthology.orchestra.run.smithi102.stdout:log =internal log bsize=4096 blocks=16384, version=2 2024-09-19T11:12:51.046 INFO:teuthology.orchestra.run.smithi102.stdout: = sectsz=512 sunit=0 blks, lazy-count=1 2024-09-19T11:12:51.046 INFO:teuthology.orchestra.run.smithi102.stdout:realtime =none extsz=4096 blocks=0, rtextents=0 2024-09-19T11:12:51.522 INFO:teuthology.orchestra.run.smithi102.stdout:Discarding blocks...Done. 2024-09-19T11:12:51.525 INFO:tasks.ceph:mount /dev/vg_nvme/lv_3 on ubuntu@smithi102.front.sepia.ceph.com -o noatime 2024-09-19T11:12:51.525 DEBUG:teuthology.orchestra.run.smithi102:> sudo mount -t xfs -o noatime /dev/vg_nvme/lv_3 /var/lib/ceph/osd/ceph-3 2024-09-19T11:12:51.668 DEBUG:teuthology.orchestra.run.smithi102:> sudo /sbin/restorecon /var/lib/ceph/osd/ceph-3 2024-09-19T11:12:51.697 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 1 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:12:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:51.835+0000 7f40fd13e640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-1/keyring: can't open /var/lib/ceph/osd/ceph-1/keyring: (2) No such file or directory 2024-09-19T11:12:51.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:51.840+0000 7f40fd13e640 -1 created new key in keyring /var/lib/ceph/osd/ceph-1/keyring 2024-09-19T11:12:51.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:51.840+0000 7f40fd13e640 -1 bdev(0x55fea2889800 /var/lib/ceph/osd/ceph-1/block) open stat got: (1) Operation not permitted 2024-09-19T11:12:51.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:51.840+0000 7f40fd13e640 -1 bluestore(/var/lib/ceph/osd/ceph-1) _read_fsid unparsable uuid 2024-09-19T11:12:54.742 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-1 2024-09-19T11:12:54.772 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 2 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:12:54.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:54.862+0000 7fc13fc0c640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-2/keyring: can't open /var/lib/ceph/osd/ceph-2/keyring: (2) No such file or directory 2024-09-19T11:12:54.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:54.862+0000 7fc13fc0c640 -1 created new key in keyring /var/lib/ceph/osd/ceph-2/keyring 2024-09-19T11:12:54.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:54.862+0000 7fc13fc0c640 -1 bdev(0x55a1d6d0f800 /var/lib/ceph/osd/ceph-2/block) open stat got: (1) Operation not permitted 2024-09-19T11:12:54.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:54.862+0000 7fc13fc0c640 -1 bluestore(/var/lib/ceph/osd/ceph-2) _read_fsid unparsable uuid 2024-09-19T11:12:58.019 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-2 2024-09-19T11:12:58.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo MALLOC_CHECK_=3 adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-osd --no-mon-config --cluster ceph --mkfs --mkkey -i 3 --monmap /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:12:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:58.138+0000 7fda08a33640 -1 auth: error reading file: /var/lib/ceph/osd/ceph-3/keyring: can't open /var/lib/ceph/osd/ceph-3/keyring: (2) No such file or directory 2024-09-19T11:12:58.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:58.138+0000 7fda08a33640 -1 created new key in keyring /var/lib/ceph/osd/ceph-3/keyring 2024-09-19T11:12:58.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:58.138+0000 7fda08a33640 -1 bdev(0x55a988109800 /var/lib/ceph/osd/ceph-3/block) open stat got: (1) Operation not permitted 2024-09-19T11:12:58.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:12:58.139+0000 7fda08a33640 -1 bluestore(/var/lib/ceph/osd/ceph-3) _read_fsid unparsable uuid 2024-09-19T11:13:01.049 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown -R ceph:ceph /var/lib/ceph/osd/ceph-3 2024-09-19T11:13:01.076 INFO:tasks.ceph:Reading keys from all nodes... 2024-09-19T11:13:01.076 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:13:01.076 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/keyring of=/dev/stdout 2024-09-19T11:13:01.108 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:13:01.108 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/mgr/ceph-x/keyring of=/dev/stdout 2024-09-19T11:13:01.142 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:13:01.142 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/keyring of=/dev/stdout 2024-09-19T11:13:01.207 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:13:01.207 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/keyring of=/dev/stdout 2024-09-19T11:13:01.273 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:13:01.273 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/keyring of=/dev/stdout 2024-09-19T11:13:01.339 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:13:01.339 DEBUG:teuthology.orchestra.run.smithi102:> dd if=/etc/ceph/ceph.client.0.keyring of=/dev/stdout 2024-09-19T11:13:01.394 INFO:tasks.ceph:Adding keys to all mons... 2024-09-19T11:13:01.394 DEBUG:teuthology.orchestra.run.smithi037:> sudo tee -a /etc/ceph/ceph.keyring 2024-09-19T11:13:01.424 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.0] 2024-09-19T11:13:01.424 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAuB+xmkIuFGRAAlHfpAonfrNh6E2Risjr1ZA== 2024-09-19T11:13:01.424 INFO:teuthology.orchestra.run.smithi037.stdout:[mgr.x] 2024-09-19T11:13:01.424 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAtB+xmXjM4HRAAoc2KpAz/N7/NnzNjYZYOuw== 2024-09-19T11:13:01.424 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.1] 2024-09-19T11:13:01.424 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAzB+xmoXrcMRAAnp0tPcsUKotORukvGar96g== 2024-09-19T11:13:01.424 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.2] 2024-09-19T11:13:01.425 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA2B+xmfzVuMxAAYrcgInGazFvx1C/SqA65cQ== 2024-09-19T11:13:01.425 INFO:teuthology.orchestra.run.smithi037.stdout:[osd.3] 2024-09-19T11:13:01.425 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQA6B+xmAstOCBAAjQTq5CQEI5vhQKnANn66uw== 2024-09-19T11:13:01.425 INFO:teuthology.orchestra.run.smithi037.stdout:[client.0] 2024-09-19T11:13:01.425 INFO:teuthology.orchestra.run.smithi037.stdout: key = AQAtB+xm8SfaHxAAbSl8mIPuatrcDDyO7kpR3g== 2024-09-19T11:13:01.426 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.0 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:13:01.528 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=mgr.x --cap mon 'allow profile mgr' --cap osd 'allow *' --cap mds 'allow *' 2024-09-19T11:13:01.584 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.1 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:13:01.638 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.2 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:13:01.692 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=osd.3 --cap mon 'allow profile osd' --cap mgr 'allow profile osd' --cap osd 'allow *' 2024-09-19T11:13:01.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-authtool /etc/ceph/ceph.keyring --name=client.0 --cap mon 'allow rw' --cap mgr 'allow r' --cap osd 'allow rwx' --cap mds allow 2024-09-19T11:13:01.800 INFO:tasks.ceph:Running mkfs on mon nodes... 2024-09-19T11:13:01.800 DEBUG:teuthology.orchestra.run.smithi037:> sudo mkdir -p /var/lib/ceph/mon/ceph-a 2024-09-19T11:13:01.825 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph-mon --cluster ceph --mkfs -i a --monmap /home/ubuntu/cephtest/ceph.monmap --keyring /etc/ceph/ceph.keyring 2024-09-19T11:13:01.926 DEBUG:teuthology.orchestra.run.smithi037:> sudo chown -R ceph:ceph /var/lib/ceph/mon/ceph-a 2024-09-19T11:13:01.951 DEBUG:teuthology.orchestra.run.smithi037:> rm -- /home/ubuntu/cephtest/ceph.monmap 2024-09-19T11:13:02.007 INFO:tasks.ceph:Starting mon daemons in cluster ceph... 2024-09-19T11:13:02.008 INFO:tasks.ceph.mon.a:Restarting daemon 2024-09-19T11:13:02.008 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mon -f --cluster ceph -i a 2024-09-19T11:13:02.050 INFO:tasks.ceph.mon.a:Started 2024-09-19T11:13:02.050 INFO:tasks.ceph:Starting mgr daemons in cluster ceph... 2024-09-19T11:13:02.051 INFO:tasks.ceph.mgr.x:Restarting daemon 2024-09-19T11:13:02.051 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-mgr -f --cluster ceph -i x 2024-09-19T11:13:02.053 INFO:tasks.ceph.mgr.x:Started 2024-09-19T11:13:02.053 DEBUG:tasks.ceph:set 0 configs 2024-09-19T11:13:02.053 INFO:tasks.ceph:Setting crush tunables to default 2024-09-19T11:13:02.054 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd crush tunables default 2024-09-19T11:13:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.153+0000 7fa058dd3640 1 Processor -- start 2024-09-19T11:13:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.153+0000 7fa058dd3640 1 -- start start 2024-09-19T11:13:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.153+0000 7fa058dd3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa054130010 0x7fa054134860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.153+0000 7fa058dd3640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa054130420 con 0x7fa05412f520 2024-09-19T11:13:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.153+0000 7fa058dd3640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa05406f6b0 con 0x7fa054130010 2024-09-19T11:13:02.155 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.153+0000 7fa05259c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa05412f520 0x7fa05412f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37304/0 (socket says 172.21.15.37:37304) 2024-09-19T11:13:02.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.154+0000 7fa05259c640 1 -- 172.21.15.37:0/3960416576 learned_addr learned my addr 172.21.15.37:0/3960416576 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:02.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.154+0000 7fa04bfff640 1 --2- 172.21.15.37:0/3960416576 >> v2:172.21.15.37:3300/0 conn(0x7fa054130010 0x7fa054134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:02.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.154+0000 7fa051d9b640 1 -- 172.21.15.37:0/3960416576 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3058453979 0 0) 0x7fa054130420 con 0x7fa05412f520 2024-09-19T11:13:02.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.154+0000 7fa051d9b640 1 -- 172.21.15.37:0/3960416576 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fa040003520 con 0x7fa05412f520 2024-09-19T11:13:02.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.154+0000 7fa04bfff640 1 -- 172.21.15.37:0/3960416576 >> v1:172.21.15.37:6789/0 conn(0x7fa05412f520 legacy=0x7fa05412f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.156 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.154+0000 7fa04bfff640 1 -- 172.21.15.37:0/3960416576 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05406fd20 con 0x7fa054130010 2024-09-19T11:13:02.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.155+0000 7fa04bfff640 1 --2- 172.21.15.37:0/3960416576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa054130010 0x7fa054134860 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009720 tx=0x7fa03c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d184723556d20da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:02.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa051d9b640 1 -- 172.21.15.37:0/3960416576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa03c037070 con 0x7fa054130010 2024-09-19T11:13:02.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa051d9b640 1 -- 172.21.15.37:0/3960416576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa03c02ad90 con 0x7fa054130010 2024-09-19T11:13:02.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa051d9b640 1 -- 172.21.15.37:0/3960416576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa03c032590 con 0x7fa054130010 2024-09-19T11:13:02.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa058dd3640 1 -- 172.21.15.37:0/3960416576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa054130010 msgr2=0x7fa054134860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.157 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa058dd3640 1 --2- 172.21.15.37:0/3960416576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa054130010 0x7fa054134860 secure :-1 s=READY pgs=2 cs=0 l=1 rev1=1 crypto rx=0x7fa03c009720 tx=0x7fa03c02a110 comp rx=0 tx=0).stop 2024-09-19T11:13:02.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa058dd3640 1 -- 172.21.15.37:0/3960416576 shutdown_connections 2024-09-19T11:13:02.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa058dd3640 1 --2- 172.21.15.37:0/3960416576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa054130010 0x7fa054134860 unknown :-1 s=CLOSED pgs=2 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:02.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa058dd3640 1 -- 172.21.15.37:0/3960416576 >> 172.21.15.37:0/3960416576 conn(0x7fa0540a2080 msgr2=0x7fa0540a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:02.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa058dd3640 1 -- 172.21.15.37:0/3960416576 shutdown_connections 2024-09-19T11:13:02.158 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.156+0000 7fa058dd3640 1 -- 172.21.15.37:0/3960416576 wait complete. 2024-09-19T11:13:02.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.157+0000 7fa058dd3640 1 Processor -- start 2024-09-19T11:13:02.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.157+0000 7fa058dd3640 1 -- start start 2024-09-19T11:13:02.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa058dd3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa05412f520 0x7fa054128050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:02.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa058dd3640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa054134f20 con 0x7fa05412f520 2024-09-19T11:13:02.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa05259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa05412f520 0x7fa054128050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:02.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa05259c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa05412f520 0x7fa054128050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42782/0 (socket says 172.21.15.37:42782) 2024-09-19T11:13:02.159 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa05259c640 1 -- 172.21.15.37:0/4010997871 learned_addr learned my addr 172.21.15.37:0/4010997871 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:02.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa05259c640 1 -- 172.21.15.37:0/4010997871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa05412a1f0 con 0x7fa05412f520 2024-09-19T11:13:02.160 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa05259c640 1 --2- 172.21.15.37:0/4010997871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa05412f520 0x7fa054128050 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c480 tx=0x7fa04400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:02.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa04affd640 1 -- 172.21.15.37:0/4010997871 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa044017070 con 0x7fa05412f520 2024-09-19T11:13:02.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.158+0000 7fa04affd640 1 -- 172.21.15.37:0/4010997871 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa044005cd0 con 0x7fa05412f520 2024-09-19T11:13:02.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.159+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa0541295f0 con 0x7fa05412f520 2024-09-19T11:13:02.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.159+0000 7fa04affd640 1 -- 172.21.15.37:0/4010997871 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa044007200 con 0x7fa05412f520 2024-09-19T11:13:02.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.159+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa054128590 con 0x7fa05412f520 2024-09-19T11:13:02.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.159+0000 7fa04affd640 1 -- 172.21.15.37:0/4010997871 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7fa04401a070 con 0x7fa05412f520 2024-09-19T11:13:02.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.159+0000 7fa04affd640 1 -- 172.21.15.37:0/4010997871 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(1..1 src has 1..1) ==== 725+0+0 (secure 0 0 0) 0x7fa044012400 con 0x7fa05412f520 2024-09-19T11:13:02.161 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.160+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa05412f900 con 0x7fa05412f520 2024-09-19T11:13:02.163 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.162+0000 7fa04affd640 1 -- 172.21.15.37:0/4010997871 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7fa04401c440 con 0x7fa05412f520 2024-09-19T11:13:02.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.227+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd crush tunables", "profile": "default"} v 0) -- 0x7fa05412cdb0 con 0x7fa05412f520 2024-09-19T11:13:02.229 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.228+0000 7fa04affd640 1 -- 172.21.15.37:0/4010997871 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd crush tunables", "profile": "default"}]=0 adjusted tunables profile to default v2) ==== 124+0+0 (secure 0 0 0) 0x7fa0440073a0 con 0x7fa05412f520 2024-09-19T11:13:02.229 INFO:teuthology.orchestra.run.smithi037.stderr:adjusted tunables profile to default 2024-09-19T11:13:02.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.229+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa05412f520 msgr2=0x7fa054128050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.229+0000 7fa058dd3640 1 --2- 172.21.15.37:0/4010997871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa05412f520 0x7fa054128050 secure :-1 s=READY pgs=3 cs=0 l=1 rev1=1 crypto rx=0x7fa04400c480 tx=0x7fa04400c940 comp rx=0 tx=0).stop 2024-09-19T11:13:02.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.229+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 shutdown_connections 2024-09-19T11:13:02.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.229+0000 7fa058dd3640 1 --2- 172.21.15.37:0/4010997871 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa05412f520 0x7fa054128050 unknown :-1 s=CLOSED pgs=3 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:02.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.229+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 >> 172.21.15.37:0/4010997871 conn(0x7fa0540a2080 msgr2=0x7fa054072bf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:02.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.229+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 shutdown_connections 2024-09-19T11:13:02.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:02.229+0000 7fa058dd3640 1 -- 172.21.15.37:0/4010997871 wait complete. 2024-09-19T11:13:02.240 INFO:tasks.ceph:check_enable_crimson: False 2024-09-19T11:13:02.240 INFO:tasks.ceph:Starting osd daemons in cluster ceph... 2024-09-19T11:13:02.240 DEBUG:teuthology.orchestra.run.smithi037:> set -ex 2024-09-19T11:13:02.240 DEBUG:teuthology.orchestra.run.smithi037:> sudo dd if=/var/lib/ceph/osd/ceph-0/fsid of=/dev/stdout 2024-09-19T11:13:02.267 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:13:02.267 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-1/fsid of=/dev/stdout 2024-09-19T11:13:02.292 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:13:02.292 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-2/fsid of=/dev/stdout 2024-09-19T11:13:02.357 DEBUG:teuthology.orchestra.run.smithi102:> set -ex 2024-09-19T11:13:02.357 DEBUG:teuthology.orchestra.run.smithi102:> sudo dd if=/var/lib/ceph/osd/ceph-3/fsid of=/dev/stdout 2024-09-19T11:13:02.421 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new e66bdbac-cb32-42b2-ba97-3f71c62b28d9 0 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.558+0000 7f46a9452640 1 Processor -- start 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.559+0000 7f46a9452640 1 -- start start 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.559+0000 7f46a9452640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46a4110010 0x7f46a41103f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.559+0000 7f46a9452640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f46a4110ab0 con 0x7f46a4114df0 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.559+0000 7f46a9452640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f46a41159b0 con 0x7f46a4110010 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.559+0000 7f46a2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46a4110010 0x7f46a41103f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.559+0000 7f46a2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f46a4110010 0x7f46a41103f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:55816/0 (socket says 172.21.15.102:55816) 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.559+0000 7f46a2ffd640 1 -- 172.21.15.102:0/3572124203 learned_addr learned my addr 172.21.15.102:0/3572124203 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.560+0000 7f46a2ffd640 1 -- 172.21.15.102:0/3572124203 >> v1:172.21.15.37:6789/0 conn(0x7f46a4114df0 legacy=0x7f46a41152a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.560+0000 7f46a2ffd640 1 -- 172.21.15.102:0/3572124203 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a4115b60 con 0x7f46a4110010 2024-09-19T11:13:02.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.560+0000 7f46a1ffb640 1 -- 172.21.15.102:0/3572124203 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1790582951 0 0) 0x7f46a4110ab0 con 0x7f46a4114df0 2024-09-19T11:13:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.560+0000 7f46a2ffd640 1 --2- 172.21.15.102:0/3572124203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41103f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46940097f0 tx=0x7f469402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=28b7ad6a42d60bb4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.560+0000 7f46a1ffb640 1 -- 172.21.15.102:0/3572124203 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4694037070 con 0x7f46a4110010 2024-09-19T11:13:02.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.560+0000 7f46a1ffb640 1 -- 172.21.15.102:0/3572124203 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4694032440 con 0x7f46a4110010 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.560+0000 7f46a1ffb640 1 -- 172.21.15.102:0/3572124203 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f469402ae60 con 0x7f46a4110010 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.561+0000 7f46a9452640 1 -- 172.21.15.102:0/3572124203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 msgr2=0x7f46a41103f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.561+0000 7f46a9452640 1 --2- 172.21.15.102:0/3572124203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41103f0 secure :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0x7f46940097f0 tx=0x7f469402a1e0 comp rx=0 tx=0).stop 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.561+0000 7f46a9452640 1 -- 172.21.15.102:0/3572124203 shutdown_connections 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.561+0000 7f46a9452640 1 --2- 172.21.15.102:0/3572124203 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41103f0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.561+0000 7f46a9452640 1 -- 172.21.15.102:0/3572124203 >> 172.21.15.102:0/3572124203 conn(0x7f46a40701f0 msgr2=0x7f46a4072610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.561+0000 7f46a9452640 1 -- 172.21.15.102:0/3572124203 shutdown_connections 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.561+0000 7f46a9452640 1 -- 172.21.15.102:0/3572124203 wait complete. 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.562+0000 7f46a9452640 1 Processor -- start 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.562+0000 7f46a9452640 1 -- start start 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.562+0000 7f46a9452640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41a76b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:02.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.562+0000 7f46a9452640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f46a4074510 con 0x7f46a4110010 2024-09-19T11:13:02.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.562+0000 7f46a2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41a76b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:02.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f46a2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41a76b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:55822/0 (socket says 172.21.15.102:55822) 2024-09-19T11:13:02.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f46a2ffd640 1 -- 172.21.15.102:0/2231781020 learned_addr learned my addr 172.21.15.102:0/2231781020 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f46a2ffd640 1 -- 172.21.15.102:0/2231781020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f46a41a7c80 con 0x7f46a4110010 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f46a2ffd640 1 --2- 172.21.15.102:0/2231781020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41a76b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4694035040 tx=0x7f46940046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f468b7fe640 1 -- 172.21.15.102:0/2231781020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4694041070 con 0x7f46a4110010 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f468b7fe640 1 -- 172.21.15.102:0/2231781020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f469403c7a0 con 0x7f46a4110010 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f46a41a7f70 con 0x7f46a4110010 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f468b7fe640 1 -- 172.21.15.102:0/2231781020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4694037040 con 0x7f46a4110010 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.563+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f46a41ad140 con 0x7f46a4110010 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.564+0000 7f468b7fe640 1 -- 172.21.15.102:0/2231781020 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f4694044070 con 0x7f46a4110010 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.564+0000 7f468b7fe640 1 -- 172.21.15.102:0/2231781020 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(2..2 src has 1..2) ==== 725+0+0 (secure 0 0 0) 0x7f4694046db0 con 0x7f46a4110010 2024-09-19T11:13:02.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.564+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f46a41a82b0 con 0x7f46a4110010 2024-09-19T11:13:02.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.567+0000 7f468b7fe640 1 -- 172.21.15.102:0/2231781020 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f4694046450 con 0x7f46a4110010 2024-09-19T11:13:02.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.637+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e66bdbac-cb32-42b2-ba97-3f71c62b28d9", "id": 0} v 0) -- 0x7f46a4110470 con 0x7f46a4110010 2024-09-19T11:13:02.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.639+0000 7f468b7fe640 1 -- 172.21.15.102:0/2231781020 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e66bdbac-cb32-42b2-ba97-3f71c62b28d9", "id": 0}]=0 v3) ==== 112+0+2 (secure 0 0 0) 0x7f469403caa0 con 0x7f46a4110010 2024-09-19T11:13:02.640 INFO:teuthology.orchestra.run.smithi102.stdout:0 2024-09-19T11:13:02.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.640+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 msgr2=0x7f46a41a76b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.640+0000 7f46a9452640 1 --2- 172.21.15.102:0/2231781020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41a76b0 secure :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0x7f4694035040 tx=0x7f46940046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:02.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.640+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 shutdown_connections 2024-09-19T11:13:02.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.640+0000 7f46a9452640 1 --2- 172.21.15.102:0/2231781020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f46a4110010 0x7f46a41a76b0 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:02.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.640+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 >> 172.21.15.102:0/2231781020 conn(0x7f46a40701f0 msgr2=0x7f46a4112f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:02.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.640+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 shutdown_connections 2024-09-19T11:13:02.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.640+0000 7f46a9452640 1 -- 172.21.15.102:0/2231781020 wait complete. 2024-09-19T11:13:02.651 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 409932a6-2604-46e6-9f50-587cd693a846 1 2024-09-19T11:13:02.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.747+0000 7f0757145640 1 Processor -- start 2024-09-19T11:13:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.747+0000 7f0757145640 1 -- start start 2024-09-19T11:13:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.747+0000 7f0757145640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f075011bad0 0x7f075011dec0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.747+0000 7f0757145640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f075011e490 con 0x7f0750116b50 2024-09-19T11:13:02.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.747+0000 7f0757145640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f075011f670 con 0x7f075011bad0 2024-09-19T11:13:02.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.748+0000 7f074ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f075011bad0 0x7f075011dec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:02.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.748+0000 7f0754ee1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0750116b50 0x7f0750116f30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:55872/0 (socket says 172.21.15.102:55872) 2024-09-19T11:13:02.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.748+0000 7f0754ee1640 1 -- 172.21.15.102:0/1294584144 learned_addr learned my addr 172.21.15.102:0/1294584144 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:02.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.748+0000 7f074f7fe640 1 -- 172.21.15.102:0/1294584144 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4288592502 0 0) 0x7f075011e490 con 0x7f0750116b50 2024-09-19T11:13:02.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.748+0000 7f074f7fe640 1 -- 172.21.15.102:0/1294584144 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0740003520 con 0x7f0750116b50 2024-09-19T11:13:02.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.748+0000 7f074ffff640 1 -- 172.21.15.102:0/1294584144 >> v1:172.21.15.37:6789/0 conn(0x7f0750116b50 legacy=0x7f0750116f30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.748+0000 7f074ffff640 1 -- 172.21.15.102:0/1294584144 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f075011f7f0 con 0x7f075011bad0 2024-09-19T11:13:02.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.749+0000 7f074ffff640 1 --2- 172.21.15.102:0/1294584144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f075011bad0 0x7f075011dec0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f073c009720 tx=0x7f073c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9674988fa7c82f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:02.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.749+0000 7f074f7fe640 1 -- 172.21.15.102:0/1294584144 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f073c037070 con 0x7f075011bad0 2024-09-19T11:13:02.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.749+0000 7f074f7fe640 1 -- 172.21.15.102:0/1294584144 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f073c02ad90 con 0x7f075011bad0 2024-09-19T11:13:02.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.749+0000 7f074f7fe640 1 -- 172.21.15.102:0/1294584144 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f073c032590 con 0x7f075011bad0 2024-09-19T11:13:02.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.750+0000 7f0757145640 1 -- 172.21.15.102:0/1294584144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f075011bad0 msgr2=0x7f075011dec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.750+0000 7f0757145640 1 --2- 172.21.15.102:0/1294584144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f075011bad0 0x7f075011dec0 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7f073c009720 tx=0x7f073c02a110 comp rx=0 tx=0).stop 2024-09-19T11:13:02.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.750+0000 7f0757145640 1 -- 172.21.15.102:0/1294584144 shutdown_connections 2024-09-19T11:13:02.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.750+0000 7f0757145640 1 --2- 172.21.15.102:0/1294584144 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f075011bad0 0x7f075011dec0 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.750+0000 7f0757145640 1 -- 172.21.15.102:0/1294584144 >> 172.21.15.102:0/1294584144 conn(0x7f075006f730 msgr2=0x7f075006fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.750+0000 7f0757145640 1 -- 172.21.15.102:0/1294584144 shutdown_connections 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.750+0000 7f0757145640 1 -- 172.21.15.102:0/1294584144 wait complete. 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.750+0000 7f0757145640 1 Processor -- start 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.751+0000 7f0757145640 1 -- start start 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.751+0000 7f0757145640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0750116b50 0x7f07501a76f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.751+0000 7f0757145640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f075011eb40 con 0x7f0750116b50 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.751+0000 7f0754ee1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0750116b50 0x7f07501a76f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.751+0000 7f0754ee1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0750116b50 0x7f07501a76f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:55846/0 (socket says 172.21.15.102:55846) 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.751+0000 7f0754ee1640 1 -- 172.21.15.102:0/1459533125 learned_addr learned my addr 172.21.15.102:0/1459533125 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f0754ee1640 1 -- 172.21.15.102:0/1459533125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f07501a7cc0 con 0x7f0750116b50 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f0754ee1640 1 --2- 172.21.15.102:0/1459533125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0750116b50 0x7f07501a76f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f074400c480 tx=0x7f074400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:02.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f074d7fa640 1 -- 172.21.15.102:0/1459533125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744017070 con 0x7f0750116b50 2024-09-19T11:13:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f074d7fa640 1 -- 172.21.15.102:0/1459533125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0744005cd0 con 0x7f0750116b50 2024-09-19T11:13:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f074d7fa640 1 -- 172.21.15.102:0/1459533125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0744007200 con 0x7f0750116b50 2024-09-19T11:13:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f07501a7fb0 con 0x7f0750116b50 2024-09-19T11:13:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f07501ad180 con 0x7f0750116b50 2024-09-19T11:13:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f074d7fa640 1 -- 172.21.15.102:0/1459533125 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f074401a070 con 0x7f0750116b50 2024-09-19T11:13:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.752+0000 7f074d7fa640 1 -- 172.21.15.102:0/1459533125 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(3..3 src has 1..3) ==== 840+0+0 (secure 0 0 0) 0x7f0744012400 con 0x7f0750116b50 2024-09-19T11:13:02.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.753+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f07501a82f0 con 0x7f0750116b50 2024-09-19T11:13:02.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.756+0000 7f074d7fa640 1 -- 172.21.15.102:0/1459533125 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f074401c440 con 0x7f0750116b50 2024-09-19T11:13:02.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.888+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "409932a6-2604-46e6-9f50-587cd693a846", "id": 1} v 0) -- 0x7f075011f120 con 0x7f0750116b50 2024-09-19T11:13:02.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.889+0000 7f074d7fa640 1 -- 172.21.15.102:0/1459533125 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "409932a6-2604-46e6-9f50-587cd693a846", "id": 1}]=0 v4) ==== 112+0+2 (secure 0 0 0) 0x7f07440073a0 con 0x7f0750116b50 2024-09-19T11:13:02.890 INFO:teuthology.orchestra.run.smithi102.stdout:1 2024-09-19T11:13:02.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.890+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0750116b50 msgr2=0x7f07501a76f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:02.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.890+0000 7f0757145640 1 --2- 172.21.15.102:0/1459533125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0750116b50 0x7f07501a76f0 secure :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0x7f074400c480 tx=0x7f074400c940 comp rx=0 tx=0).stop 2024-09-19T11:13:02.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.891+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 shutdown_connections 2024-09-19T11:13:02.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.891+0000 7f0757145640 1 --2- 172.21.15.102:0/1459533125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0750116b50 0x7f07501a76f0 unknown :-1 s=CLOSED pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:02.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.891+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 >> 172.21.15.102:0/1459533125 conn(0x7f075006f730 msgr2=0x7f075011beb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:02.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.891+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 shutdown_connections 2024-09-19T11:13:02.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.891+0000 7f0757145640 1 -- 172.21.15.102:0/1459533125 wait complete. 2024-09-19T11:13:02.902 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new 4fb4fb22-028c-4cc7-a259-ac630af33e99 2 2024-09-19T11:13:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.998+0000 7f268b8b1640 1 Processor -- start 2024-09-19T11:13:02.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.998+0000 7f268b8b1640 1 -- start start 2024-09-19T11:13:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.998+0000 7f268b8b1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2684116b50 0x7f2684116f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.998+0000 7f268b8b1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f2684117650 con 0x7f2684112dc0 2024-09-19T11:13:03.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.998+0000 7f268b8b1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2684113960 con 0x7f2684116b50 2024-09-19T11:13:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.999+0000 7f268964d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f2684116b50 0x7f2684116f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.999+0000 7f2688e4c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f2684112dc0 0x7f2684113250 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:55882/0 (socket says 172.21.15.102:55882) 2024-09-19T11:13:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.999+0000 7f2688e4c640 1 -- 172.21.15.102:0/346157897 learned_addr learned my addr 172.21.15.102:0/346157897 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:03.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.999+0000 7f2677fff640 1 -- 172.21.15.102:0/346157897 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1137157455 0 0) 0x7f2684117650 con 0x7f2684112dc0 2024-09-19T11:13:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.999+0000 7f2677fff640 1 -- 172.21.15.102:0/346157897 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f2670003520 con 0x7f2684112dc0 2024-09-19T11:13:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.999+0000 7f268964d640 1 -- 172.21.15.102:0/346157897 >> v1:172.21.15.37:6789/0 conn(0x7f2684112dc0 legacy=0x7f2684113250 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:02.999+0000 7f268964d640 1 -- 172.21.15.102:0/346157897 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2684113b10 con 0x7f2684116b50 2024-09-19T11:13:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.000+0000 7f268964d640 1 --2- 172.21.15.102:0/346157897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684116b50 0x7f2684116f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2680009720 tx=0x7f268002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=89b4810cac390be8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.000+0000 7f2677fff640 1 -- 172.21.15.102:0/346157897 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2680037070 con 0x7f2684116b50 2024-09-19T11:13:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.000+0000 7f2677fff640 1 -- 172.21.15.102:0/346157897 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268002ad90 con 0x7f2684116b50 2024-09-19T11:13:03.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.000+0000 7f2677fff640 1 -- 172.21.15.102:0/346157897 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2680032590 con 0x7f2684116b50 2024-09-19T11:13:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.001+0000 7f268b8b1640 1 -- 172.21.15.102:0/346157897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684116b50 msgr2=0x7f2684116f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.001+0000 7f268b8b1640 1 --2- 172.21.15.102:0/346157897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684116b50 0x7f2684116f30 secure :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0x7f2680009720 tx=0x7f268002a110 comp rx=0 tx=0).stop 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.001+0000 7f268b8b1640 1 -- 172.21.15.102:0/346157897 shutdown_connections 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.001+0000 7f268b8b1640 1 --2- 172.21.15.102:0/346157897 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684116b50 0x7f2684116f30 unknown :-1 s=CLOSED pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.001+0000 7f268b8b1640 1 -- 172.21.15.102:0/346157897 >> 172.21.15.102:0/346157897 conn(0x7f268406f730 msgr2=0x7f268406fb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.001+0000 7f268b8b1640 1 -- 172.21.15.102:0/346157897 shutdown_connections 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.001+0000 7f268b8b1640 1 -- 172.21.15.102:0/346157897 wait complete. 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.002+0000 7f268b8b1640 1 Processor -- start 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.002+0000 7f268b8b1640 1 -- start start 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.002+0000 7f268b8b1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684112dc0 0x7f26841a7700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.002+0000 7f268b8b1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f268411efa0 con 0x7f2684112dc0 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.002+0000 7f268964d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684112dc0 0x7f26841a7700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.002+0000 7f268964d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684112dc0 0x7f26841a7700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:55852/0 (socket says 172.21.15.102:55852) 2024-09-19T11:13:03.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.002+0000 7f268964d640 1 -- 172.21.15.102:0/4254984552 learned_addr learned my addr 172.21.15.102:0/4254984552 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.002+0000 7f268964d640 1 -- 172.21.15.102:0/4254984552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f26841a7cd0 con 0x7f2684112dc0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.003+0000 7f268964d640 1 --2- 172.21.15.102:0/4254984552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684112dc0 0x7f26841a7700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2680009720 tx=0x7f26800046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.003+0000 7f2675ffb640 1 -- 172.21.15.102:0/4254984552 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2680041070 con 0x7f2684112dc0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.003+0000 7f2675ffb640 1 -- 172.21.15.102:0/4254984552 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f268003c460 con 0x7f2684112dc0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.003+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f26841a7f60 con 0x7f2684112dc0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.003+0000 7f2675ffb640 1 -- 172.21.15.102:0/4254984552 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2680037040 con 0x7f2684112dc0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.003+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f26841acf30 con 0x7f2684112dc0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.003+0000 7f2675ffb640 1 -- 172.21.15.102:0/4254984552 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f2680044070 con 0x7f2684112dc0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.003+0000 7f2675ffb640 1 -- 172.21.15.102:0/4254984552 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(4..4 src has 1..4) ==== 955+0+0 (secure 0 0 0) 0x7f2680046a80 con 0x7f2684112dc0 2024-09-19T11:13:03.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.004+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f2684116b50 con 0x7f2684112dc0 2024-09-19T11:13:03.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.006+0000 7f2675ffb640 1 -- 172.21.15.102:0/4254984552 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f2680046d20 con 0x7f2684112dc0 2024-09-19T11:13:03.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.077+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "4fb4fb22-028c-4cc7-a259-ac630af33e99", "id": 2} v 0) -- 0x7f2684116d20 con 0x7f2684112dc0 2024-09-19T11:13:03.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.078+0000 7f2675ffb640 1 -- 172.21.15.102:0/4254984552 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "4fb4fb22-028c-4cc7-a259-ac630af33e99", "id": 2}]=0 v5) ==== 112+0+2 (secure 0 0 0) 0x7f2680046620 con 0x7f2684112dc0 2024-09-19T11:13:03.079 INFO:teuthology.orchestra.run.smithi102.stdout:2 2024-09-19T11:13:03.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.079+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684112dc0 msgr2=0x7f26841a7700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.079+0000 7f268b8b1640 1 --2- 172.21.15.102:0/4254984552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684112dc0 0x7f26841a7700 secure :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0x7f2680009720 tx=0x7f26800046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.079+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 shutdown_connections 2024-09-19T11:13:03.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.079+0000 7f268b8b1640 1 --2- 172.21.15.102:0/4254984552 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f2684112dc0 0x7f26841a7700 unknown :-1 s=CLOSED pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.079+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 >> 172.21.15.102:0/4254984552 conn(0x7f268406f730 msgr2=0x7f2684111db0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:03.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.079+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 shutdown_connections 2024-09-19T11:13:03.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.079+0000 7f268b8b1640 1 -- 172.21.15.102:0/4254984552 wait complete. 2024-09-19T11:13:03.090 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph --cluster ceph osd new e0242238-a3ce-4288-93eb-e2aafa589662 3 2024-09-19T11:13:03.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.186+0000 7f37af6bd640 1 Processor -- start 2024-09-19T11:13:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.186+0000 7f37af6bd640 1 -- start start 2024-09-19T11:13:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.187+0000 7f37af6bd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37a8074ec0 0x7f37a810fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.187+0000 7f37af6bd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f37a8110920 con 0x7f37a81102e0 2024-09-19T11:13:03.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.187+0000 7f37af6bd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f37a8110b10 con 0x7f37a8074ec0 2024-09-19T11:13:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.187+0000 7f37ad459640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f37a8074ec0 0x7f37a810fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.187+0000 7f37acc58640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f37a81102e0 0x7f37a811b120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:55896/0 (socket says 172.21.15.102:55896) 2024-09-19T11:13:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.187+0000 7f37acc58640 1 -- 172.21.15.102:0/676840737 learned_addr learned my addr 172.21.15.102:0/676840737 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.187+0000 7f37ad459640 1 -- 172.21.15.102:0/676840737 >> v1:172.21.15.37:6789/0 conn(0x7f37a81102e0 legacy=0x7f37a811b120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.187+0000 7f37ad459640 1 -- 172.21.15.102:0/676840737 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a811d850 con 0x7f37a8074ec0 2024-09-19T11:13:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.188+0000 7f37ad459640 1 --2- 172.21.15.102:0/676840737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a810fda0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009720 tx=0x7f37a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d9648c93cb03ce43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:03.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.188+0000 7f379bfff640 1 -- 172.21.15.102:0/676840737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a4037070 con 0x7f37a8074ec0 2024-09-19T11:13:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.188+0000 7f379bfff640 1 -- 172.21.15.102:0/676840737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a402ad90 con 0x7f37a8074ec0 2024-09-19T11:13:03.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.188+0000 7f379bfff640 1 -- 172.21.15.102:0/676840737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a4032590 con 0x7f37a8074ec0 2024-09-19T11:13:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 -- 172.21.15.102:0/676840737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 msgr2=0x7f37a810fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 --2- 172.21.15.102:0/676840737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a810fda0 secure :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009720 tx=0x7f37a402a110 comp rx=0 tx=0).stop 2024-09-19T11:13:03.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 -- 172.21.15.102:0/676840737 shutdown_connections 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 --2- 172.21.15.102:0/676840737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a810fda0 unknown :-1 s=CLOSED pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 -- 172.21.15.102:0/676840737 >> 172.21.15.102:0/676840737 conn(0x7f37a8070680 msgr2=0x7f37a8072aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 -- 172.21.15.102:0/676840737 shutdown_connections 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 -- 172.21.15.102:0/676840737 wait complete. 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 Processor -- start 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.189+0000 7f37af6bd640 1 -- start start 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.190+0000 7f37af6bd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a81a7ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.190+0000 7f37af6bd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f37a811ccf0 con 0x7f37a8074ec0 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.190+0000 7f37ad459640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a81a7ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.190+0000 7f37ad459640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a81a7ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:55870/0 (socket says 172.21.15.102:55870) 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.190+0000 7f37ad459640 1 -- 172.21.15.102:0/2774192863 learned_addr learned my addr 172.21.15.102:0/2774192863 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.190+0000 7f37ad459640 1 -- 172.21.15.102:0/2774192863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f37a81a8080 con 0x7f37a8074ec0 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.190+0000 7f37ad459640 1 --2- 172.21.15.102:0/2774192863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a81a7ab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009720 tx=0x7f37a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.191+0000 7f3799ffb640 1 -- 172.21.15.102:0/2774192863 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a4041070 con 0x7f37a8074ec0 2024-09-19T11:13:03.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.191+0000 7f3799ffb640 1 -- 172.21.15.102:0/2774192863 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f37a403c460 con 0x7f37a8074ec0 2024-09-19T11:13:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.191+0000 7f3799ffb640 1 -- 172.21.15.102:0/2774192863 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f37a4037040 con 0x7f37a8074ec0 2024-09-19T11:13:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.191+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f37a81a8310 con 0x7f37a8074ec0 2024-09-19T11:13:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.191+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f37a81ad2e0 con 0x7f37a8074ec0 2024-09-19T11:13:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.191+0000 7f3799ffb640 1 -- 172.21.15.102:0/2774192863 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f37a4044070 con 0x7f37a8074ec0 2024-09-19T11:13:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.191+0000 7f3799ffb640 1 -- 172.21.15.102:0/2774192863 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(5..5 src has 1..5) ==== 1070+0+0 (secure 0 0 0) 0x7f37a4046d90 con 0x7f37a8074ec0 2024-09-19T11:13:03.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.192+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f37a810fda0 con 0x7f37a8074ec0 2024-09-19T11:13:03.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.194+0000 7f3799ffb640 1 -- 172.21.15.102:0/2774192863 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f37a4046450 con 0x7f37a8074ec0 2024-09-19T11:13:03.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.264+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd new", "uuid": "e0242238-a3ce-4288-93eb-e2aafa589662", "id": 3} v 0) -- 0x7f37a81102e0 con 0x7f37a8074ec0 2024-09-19T11:13:03.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.265+0000 7f3799ffb640 1 -- 172.21.15.102:0/2774192863 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd new", "uuid": "e0242238-a3ce-4288-93eb-e2aafa589662", "id": 3}]=0 v6) ==== 112+0+2 (secure 0 0 0) 0x7f37a4046900 con 0x7f37a8074ec0 2024-09-19T11:13:03.267 INFO:teuthology.orchestra.run.smithi102.stdout:3 2024-09-19T11:13:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.266+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 msgr2=0x7f37a81a7ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.266+0000 7f37af6bd640 1 --2- 172.21.15.102:0/2774192863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a81a7ab0 secure :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0x7f37a4009720 tx=0x7f37a40046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.266+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 shutdown_connections 2024-09-19T11:13:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.266+0000 7f37af6bd640 1 --2- 172.21.15.102:0/2774192863 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f37a8074ec0 0x7f37a81a7ab0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.266+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 >> 172.21.15.102:0/2774192863 conn(0x7f37a8070680 msgr2=0x7f37a8111b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.266+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 shutdown_connections 2024-09-19T11:13:03.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:03.266+0000 7f37af6bd640 1 -- 172.21.15.102:0/2774192863 wait complete. 2024-09-19T11:13:03.278 INFO:tasks.ceph.osd.0:Restarting daemon 2024-09-19T11:13:03.278 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 0 2024-09-19T11:13:03.281 INFO:tasks.ceph.osd.0:Started 2024-09-19T11:13:03.281 INFO:tasks.ceph.osd.1:Restarting daemon 2024-09-19T11:13:03.281 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 1 2024-09-19T11:13:03.283 INFO:tasks.ceph.osd.1:Started 2024-09-19T11:13:03.283 INFO:tasks.ceph.osd.2:Restarting daemon 2024-09-19T11:13:03.283 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 2 2024-09-19T11:13:03.285 INFO:tasks.ceph.osd.2:Started 2024-09-19T11:13:03.285 INFO:tasks.ceph.osd.3:Restarting daemon 2024-09-19T11:13:03.286 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper kill ceph-osd -f --cluster ceph -i 3 2024-09-19T11:13:03.288 INFO:tasks.ceph.osd.3:Started 2024-09-19T11:13:03.288 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T11:13:03.401 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.399+0000 7ff820cef640 1 Processor -- start 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.399+0000 7ff820cef640 1 -- start start 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.400+0000 7ff820cef640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff81c12c0b0 0x7ff81c12c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.400+0000 7ff820cef640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff81c09a290 con 0x7ff81c12c9d0 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.400+0000 7ff820cef640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff81c071860 con 0x7ff81c12c0b0 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.400+0000 7ff81a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff81c12c0b0 0x7ff81c12c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.400+0000 7ff819d9b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff81c12c9d0 0x7ff81c097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37318/0 (socket says 172.21.15.37:37318) 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.400+0000 7ff819d9b640 1 -- 172.21.15.37:0/2239496435 learned_addr learned my addr 172.21.15.37:0/2239496435 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.400+0000 7ff81a59c640 1 -- 172.21.15.37:0/2239496435 >> v1:172.21.15.37:6789/0 conn(0x7ff81c12c9d0 legacy=0x7ff81c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.400+0000 7ff81959a640 1 -- 172.21.15.37:0/2239496435 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1713079264 0 0) 0x7ff81c09a290 con 0x7ff81c12c9d0 2024-09-19T11:13:03.402 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.401+0000 7ff81a59c640 1 -- 172.21.15.37:0/2239496435 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c099e20 con 0x7ff81c12c0b0 2024-09-19T11:13:03.403 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.401+0000 7ff81a59c640 1 --2- 172.21.15.37:0/2239496435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c12c490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009750 tx=0x7ff80c02a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=108e3a1e90dabaf3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.401+0000 7ff81959a640 1 -- 172.21.15.37:0/2239496435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c037070 con 0x7ff81c12c0b0 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.401+0000 7ff81959a640 1 -- 172.21.15.37:0/2239496435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c02ad80 con 0x7ff81c12c0b0 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.401+0000 7ff81959a640 1 -- 172.21.15.37:0/2239496435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c032590 con 0x7ff81c12c0b0 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.402+0000 7ff820cef640 1 -- 172.21.15.37:0/2239496435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 msgr2=0x7ff81c12c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.402+0000 7ff820cef640 1 --2- 172.21.15.37:0/2239496435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c12c490 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009750 tx=0x7ff80c02a140 comp rx=0 tx=0).stop 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.402+0000 7ff820cef640 1 -- 172.21.15.37:0/2239496435 shutdown_connections 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.402+0000 7ff820cef640 1 --2- 172.21.15.37:0/2239496435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c12c490 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.402+0000 7ff820cef640 1 -- 172.21.15.37:0/2239496435 >> 172.21.15.37:0/2239496435 conn(0x7ff81c09abc0 msgr2=0x7ff81c098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.402+0000 7ff820cef640 1 -- 172.21.15.37:0/2239496435 shutdown_connections 2024-09-19T11:13:03.404 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.402+0000 7ff820cef640 1 -- 172.21.15.37:0/2239496435 wait complete. 2024-09-19T11:13:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.403+0000 7ff820cef640 1 Processor -- start 2024-09-19T11:13:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.403+0000 7ff820cef640 1 -- start start 2024-09-19T11:13:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff820cef640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c122df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:03.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff820cef640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff81c12ce00 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff81a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c122df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff81a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c122df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:42814/0 (socket says 172.21.15.37:42814) 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff81a59c640 1 -- 172.21.15.37:0/2219566162 learned_addr learned my addr 172.21.15.37:0/2219566162 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff81a59c640 1 -- 172.21.15.37:0/2219566162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff81c074090 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff81a59c640 1 --2- 172.21.15.37:0/2219566162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c122df0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009750 tx=0x7ff80c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff80affd640 1 -- 172.21.15.37:0/2219566162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c041070 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff80affd640 1 -- 172.21.15.37:0/2219566162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff80c03c590 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff81c091260 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff80affd640 1 -- 172.21.15.37:0/2219566162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff80c037040 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.404+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff81c123510 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.405+0000 7ff80affd640 1 -- 172.21.15.37:0/2219566162 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7ff80c044070 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.405+0000 7ff80affd640 1 -- 172.21.15.37:0/2219566162 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7ff80c046cd0 con 0x7ff81c12c0b0 2024-09-19T11:13:03.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.405+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff81c1244d0 con 0x7ff81c12c0b0 2024-09-19T11:13:03.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.407+0000 7ff80affd640 1 -- 172.21.15.37:0/2219566162 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7ff80c02ad10 con 0x7ff81c12c0b0 2024-09-19T11:13:03.469 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.468+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff81c12c490 con 0x7ff81c12c0b0 2024-09-19T11:13:03.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.469+0000 7ff80affd640 1 -- 172.21.15.37:0/2219566162 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7ff80c0469d0 con 0x7ff81c12c0b0 2024-09-19T11:13:03.470 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:13:03.470 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":6,"fsid":"ea40044b-acee-4485-a78a-0f4c700e12ca","created":"2024-09-19T11:13:02.138535+0000","modified":"2024-09-19T11:13:03.266089+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T11:13:03.266089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e66bdbac-cb32-42b2-ba97-3f71c62b28d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"409932a6-2604-46e6-9f50-587cd693a846","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4fb4fb22-028c-4cc7-a259-ac630af33e99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e0242238-a3ce-4288-93eb-e2aafa589662","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:13:03.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.469+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 msgr2=0x7ff81c122df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.469+0000 7ff820cef640 1 --2- 172.21.15.37:0/2219566162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c122df0 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7ff80c009750 tx=0x7ff80c0046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.469+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 shutdown_connections 2024-09-19T11:13:03.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.469+0000 7ff820cef640 1 --2- 172.21.15.37:0/2219566162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff81c12c0b0 0x7ff81c122df0 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.469+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 >> 172.21.15.37:0/2219566162 conn(0x7ff81c09abc0 msgr2=0x7ff81c129260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:03.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.469+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 shutdown_connections 2024-09-19T11:13:03.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:03.469+0000 7ff820cef640 1 -- 172.21.15.37:0/2219566162 wait complete. 2024-09-19T11:13:03.481 INFO:tasks.ceph.ceph_manager.ceph:[] 2024-09-19T11:13:03.481 INFO:tasks.ceph:Waiting for OSDs to come up 2024-09-19T11:13:03.883 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T11:13:03.984 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.981+0000 7f1b7192b640 1 Processor -- start 2024-09-19T11:13:03.984 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b7192b640 1 -- start start 2024-09-19T11:13:03.984 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b7192b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b6c0712e0 0x7f1b6c1317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:03.984 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b7192b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1b6c06cc20 con 0x7f1b6c129370 2024-09-19T11:13:03.984 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b7192b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f1b6c074250 con 0x7f1b6c0712e0 2024-09-19T11:13:03.984 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b63fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f1b6c0712e0 0x7f1b6c1317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:03.985 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b6affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f1b6c129370 0x7f1b6c129750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37156/0 (socket says 172.21.15.37:37156) 2024-09-19T11:13:03.985 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b6affd640 1 -- 172.21.15.37:0/2755077258 learned_addr learned my addr 172.21.15.37:0/2755077258 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:03.985 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b63fff640 1 -- 172.21.15.37:0/2755077258 >> v1:172.21.15.37:6789/0 conn(0x7f1b6c129370 legacy=0x7f1b6c129750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.985 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b63fff640 1 -- 172.21.15.37:0/2755077258 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c06e640 con 0x7f1b6c0712e0 2024-09-19T11:13:03.985 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.982+0000 7f1b6a7fc640 1 -- 172.21.15.37:0/2755077258 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2070722158 0 0) 0x7f1b6c06cc20 con 0x7f1b6c129370 2024-09-19T11:13:03.988 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.983+0000 7f1b63fff640 1 --2- 172.21.15.37:0/2755077258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1317f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400b9c0 tx=0x7f1b5402c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58bf463088367d26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:03.988 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.983+0000 7f1b6a7fc640 1 -- 172.21.15.37:0/2755077258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b54031640 con 0x7f1b6c0712e0 2024-09-19T11:13:03.988 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.983+0000 7f1b6a7fc640 1 -- 172.21.15.37:0/2755077258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b540317e0 con 0x7f1b6c0712e0 2024-09-19T11:13:03.988 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.983+0000 7f1b6a7fc640 1 -- 172.21.15.37:0/2755077258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b54031ae0 con 0x7f1b6c0712e0 2024-09-19T11:13:03.988 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.984+0000 7f1b7192b640 1 -- 172.21.15.37:0/2755077258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 msgr2=0x7f1b6c1317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:03.988 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.984+0000 7f1b7192b640 1 --2- 172.21.15.37:0/2755077258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1317f0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f1b5400b9c0 tx=0x7f1b5402c7e0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.984+0000 7f1b7192b640 1 -- 172.21.15.37:0/2755077258 shutdown_connections 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.984+0000 7f1b7192b640 1 --2- 172.21.15.37:0/2755077258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1317f0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.984+0000 7f1b7192b640 1 -- 172.21.15.37:0/2755077258 >> 172.21.15.37:0/2755077258 conn(0x7f1b6c09b950 msgr2=0x7f1b6c09bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.984+0000 7f1b7192b640 1 -- 172.21.15.37:0/2755077258 shutdown_connections 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.984+0000 7f1b7192b640 1 -- 172.21.15.37:0/2755077258 wait complete. 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.985+0000 7f1b7192b640 1 Processor -- start 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.985+0000 7f1b7192b640 1 -- start start 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.985+0000 7f1b7192b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1c0340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.985+0000 7f1b7192b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f1b6c071a50 con 0x7f1b6c0712e0 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.985+0000 7f1b6affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1c0340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:03.989 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.985+0000 7f1b6affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1c0340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51410/0 (socket says 172.21.15.37:51410) 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.985+0000 7f1b6affd640 1 -- 172.21.15.37:0/1591960953 learned_addr learned my addr 172.21.15.37:0/1591960953 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b6affd640 1 -- 172.21.15.37:0/1591960953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1b6c091200 con 0x7f1b6c0712e0 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b6affd640 1 --2- 172.21.15.37:0/1591960953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1c0340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c3e0 tx=0x7f1b5c00c8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b68ff9640 1 -- 172.21.15.37:0/1591960953 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b5c017070 con 0x7f1b6c0712e0 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b68ff9640 1 -- 172.21.15.37:0/1591960953 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b5c005c10 con 0x7f1b6c0712e0 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1b6c126ca0 con 0x7f1b6c0712e0 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b68ff9640 1 -- 172.21.15.37:0/1591960953 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b5c0070d0 con 0x7f1b6c0712e0 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f1b6c090dc0 con 0x7f1b6c0712e0 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b68ff9640 1 -- 172.21.15.37:0/1591960953 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 1) ==== 807+0+0 (secure 0 0 0) 0x7f1b5c01a070 con 0x7f1b6c0712e0 2024-09-19T11:13:03.990 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.986+0000 7f1b68ff9640 1 -- 172.21.15.37:0/1591960953 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(6..6 src has 1..6) ==== 1185+0+0 (secure 0 0 0) 0x7f1b5c012910 con 0x7f1b6c0712e0 2024-09-19T11:13:03.991 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.987+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f1b6c0008d0 con 0x7f1b6c0712e0 2024-09-19T11:13:03.991 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:03.989+0000 7f1b68ff9640 1 -- 172.21.15.37:0/1591960953 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+75856 (secure 0 0 0) 0x7f1b5c021070 con 0x7f1b6c0712e0 2024-09-19T11:13:04.051 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.050+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f1b6c075760 con 0x7f1b6c0712e0 2024-09-19T11:13:04.051 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.050+0000 7f1b68ff9640 1 -- 172.21.15.37:0/1591960953 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v6) ==== 74+0+4153 (secure 0 0 0) 0x7f1b5c012d20 con 0x7f1b6c0712e0 2024-09-19T11:13:04.051 INFO:teuthology.misc.health.smithi037.stdout: 2024-09-19T11:13:04.052 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":6,"fsid":"ea40044b-acee-4485-a78a-0f4c700e12ca","created":"2024-09-19T11:13:02.138535+0000","modified":"2024-09-19T11:13:03.266089+0000","last_up_change":"0.000000","last_in_change":"2024-09-19T11:13:03.266089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":2,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e66bdbac-cb32-42b2-ba97-3f71c62b28d9","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":1,"uuid":"409932a6-2604-46e6-9f50-587cd693a846","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4fb4fb22-028c-4cc7-a259-ac630af33e99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e0242238-a3ce-4288-93eb-e2aafa589662","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:13:04.052 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.051+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 msgr2=0x7f1b6c1c0340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.051+0000 7f1b7192b640 1 --2- 172.21.15.37:0/1591960953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1c0340 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f1b5c00c3e0 tx=0x7f1b5c00c8a0 comp rx=0 tx=0).stop 2024-09-19T11:13:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.051+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 shutdown_connections 2024-09-19T11:13:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.051+0000 7f1b7192b640 1 --2- 172.21.15.37:0/1591960953 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f1b6c0712e0 0x7f1b6c1c0340 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.051+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 >> 172.21.15.37:0/1591960953 conn(0x7f1b6c09b950 msgr2=0x7f1b6c072750 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.051+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 shutdown_connections 2024-09-19T11:13:04.053 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:04.051+0000 7f1b7192b640 1 -- 172.21.15.37:0/1591960953 wait complete. 2024-09-19T11:13:04.061 DEBUG:teuthology.misc:0 of 4 OSDs are up 2024-09-19T11:13:04.204 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-09-19T11:13:04.202+0000 7f42f4adc640 -1 Falling back to public interface 2024-09-19T11:13:04.730 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-19T11:13:04.729+0000 7fa4967a6640 -1 Falling back to public interface 2024-09-19T11:13:04.739 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-19T11:13:04.738+0000 7f745a81f640 -1 Falling back to public interface 2024-09-19T11:13:04.743 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-19T11:13:04.742+0000 7f95bada8640 -1 Falling back to public interface 2024-09-19T11:13:07.510 INFO:tasks.ceph.mgr.x.smithi102.stderr:2024-09-19T11:13:07.509+0000 7fbc93a8e640 -1 mgr.server handle_report got status from non-daemon mon.a 2024-09-19T11:13:07.958 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-09-19T11:13:07.957+0000 7f42f4adc640 -1 osd.0 0 log_to_monitors true 2024-09-19T11:13:08.538 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-19T11:13:08.537+0000 7fa4967a6640 -1 osd.3 0 log_to_monitors true 2024-09-19T11:13:08.824 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-19T11:13:08.823+0000 7f745a81f640 -1 osd.2 0 log_to_monitors true 2024-09-19T11:13:09.028 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-19T11:13:09.027+0000 7f95bada8640 -1 osd.1 0 log_to_monitors true 2024-09-19T11:13:10.418 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-09-19T11:13:10.416+0000 7f42f0a6b640 -1 osd.0 0 waiting for initial osdmap 2024-09-19T11:13:10.429 INFO:tasks.ceph.osd.0.smithi037.stderr:2024-09-19T11:13:10.427+0000 7f42e888a640 -1 osd.0 8 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:13:10.464 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T11:13:10.560 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc15b90640 1 Processor -- start 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc15b90640 1 -- start start 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc15b90640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc10129370 0x7efc10129750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc15b90640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7efc1006cc20 con 0x7efc10129c90 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc15b90640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7efc10074250 con 0x7efc10129370 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc0f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7efc10129370 0x7efc10129750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc0effd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7efc10129c90 0x7efc1012c4b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37162/0 (socket says 172.21.15.37:37162) 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc0effd640 1 -- 172.21.15.37:0/3482759168 learned_addr learned my addr 172.21.15.37:0/3482759168 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc0f7fe640 1 -- 172.21.15.37:0/3482759168 >> v1:172.21.15.37:6789/0 conn(0x7efc10129c90 legacy=0x7efc1012c4b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:10.561 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.558+0000 7efc0f7fe640 1 -- 172.21.15.37:0/3482759168 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc1006e640 con 0x7efc10129370 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.559+0000 7efc0f7fe640 1 --2- 172.21.15.37:0/3482759168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc10129750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc0000b9c0 tx=0x7efc0002c7e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d689d066897e1dae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.559+0000 7efc0e7fc640 1 -- 172.21.15.37:0/3482759168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc00031640 con 0x7efc10129370 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.559+0000 7efc0e7fc640 1 -- 172.21.15.37:0/3482759168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc000317e0 con 0x7efc10129370 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.559+0000 7efc0e7fc640 1 -- 172.21.15.37:0/3482759168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc00031ae0 con 0x7efc10129370 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.560+0000 7efc15b90640 1 -- 172.21.15.37:0/3482759168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 msgr2=0x7efc10129750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.560+0000 7efc15b90640 1 --2- 172.21.15.37:0/3482759168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc10129750 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7efc0000b9c0 tx=0x7efc0002c7e0 comp rx=0 tx=0).stop 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.560+0000 7efc15b90640 1 -- 172.21.15.37:0/3482759168 shutdown_connections 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.560+0000 7efc15b90640 1 --2- 172.21.15.37:0/3482759168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc10129750 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.560+0000 7efc15b90640 1 -- 172.21.15.37:0/3482759168 >> 172.21.15.37:0/3482759168 conn(0x7efc1009b950 msgr2=0x7efc1009bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:10.563 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.560+0000 7efc15b90640 1 -- 172.21.15.37:0/3482759168 shutdown_connections 2024-09-19T11:13:10.564 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.560+0000 7efc15b90640 1 -- 172.21.15.37:0/3482759168 wait complete. 2024-09-19T11:13:10.564 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.561+0000 7efc15b90640 1 Processor -- start 2024-09-19T11:13:10.564 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.561+0000 7efc15b90640 1 -- start start 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.561+0000 7efc15b90640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc1008bfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.561+0000 7efc15b90640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7efc10071460 con 0x7efc10129370 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.561+0000 7efc0f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc1008bfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.561+0000 7efc0f7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc1008bfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:51446/0 (socket says 172.21.15.37:51446) 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.561+0000 7efc0f7fe640 1 -- 172.21.15.37:0/4193364073 learned_addr learned my addr 172.21.15.37:0/4193364073 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.562+0000 7efc0f7fe640 1 -- 172.21.15.37:0/4193364073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7efc10125f40 con 0x7efc10129370 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.562+0000 7efc0f7fe640 1 --2- 172.21.15.37:0/4193364073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc1008bfa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efc00000c00 tx=0x7efc000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.562+0000 7efbf7fff640 1 -- 172.21.15.37:0/4193364073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc00033be0 con 0x7efc10129370 2024-09-19T11:13:10.566 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.562+0000 7efbf7fff640 1 -- 172.21.15.37:0/4193364073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc00033da0 con 0x7efc10129370 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.562+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7efc1008d790 con 0x7efc10129370 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.562+0000 7efbf7fff640 1 -- 172.21.15.37:0/4193364073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc0003e590 con 0x7efc10129370 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.562+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7efc1008e270 con 0x7efc10129370 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.563+0000 7efbf7fff640 1 -- 172.21.15.37:0/4193364073 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (secure 0 0 0) 0x7efc0003b040 con 0x7efc10129370 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.563+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7efc10129750 con 0x7efc10129370 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.563+0000 7efbf7fff640 1 --2- 172.21.15.37:0/4193364073 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbfc03e680 0x7efbfc040b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.563+0000 7efbf7fff640 1 -- 172.21.15.37:0/4193364073 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(9..9 src has 1..9) ==== 1903+0+0 (secure 0 0 0) 0x7efc00075ef0 con 0x7efc10129370 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.563+0000 7efc0effd640 1 --2- 172.21.15.37:0/4193364073 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbfc03e680 0x7efbfc040b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:10.567 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.564+0000 7efc0effd640 1 --2- 172.21.15.37:0/4193364073 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbfc03e680 0x7efbfc040b40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc04007fd0 tx=0x7efc04007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:10.570 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.568+0000 7efbf7fff640 1 -- 172.21.15.37:0/4193364073 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7efc00042030 con 0x7efc10129370 2024-09-19T11:13:10.757 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.755+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7efc1008e720 con 0x7efc10129370 2024-09-19T11:13:10.757 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.755+0000 7efbf7fff640 1 -- 172.21.15.37:0/4193364073 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v9) ==== 74+0+4637 (secure 0 0 0) 0x7efc0004f3f0 con 0x7efc10129370 2024-09-19T11:13:10.758 INFO:teuthology.misc.health.smithi037.stdout: 2024-09-19T11:13:10.758 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":9,"fsid":"ea40044b-acee-4485-a78a-0f4c700e12ca","created":"2024-09-19T11:13:02.138535+0000","modified":"2024-09-19T11:13:10.509568+0000","last_up_change":"2024-09-19T11:13:10.509568+0000","last_in_change":"2024-09-19T11:13:03.266089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":0,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[],"osds":[{"osd":0,"uuid":"e66bdbac-cb32-42b2-ba97-3f71c62b28d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6801","nonce":394652614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6803","nonce":394652614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6807","nonce":394652614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6805","nonce":394652614}]},"public_addr":"172.21.15.37:6801/394652614","cluster_addr":"172.21.15.37:6803/394652614","heartbeat_back_addr":"172.21.15.37:6807/394652614","heartbeat_front_addr":"172.21.15.37:6805/394652614","state":["exists","up"]},{"osd":1,"uuid":"409932a6-2604-46e6-9f50-587cd693a846","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":2,"uuid":"4fb4fb22-028c-4cc7-a259-ac630af33e99","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]},{"osd":3,"uuid":"e0242238-a3ce-4288-93eb-e2aafa589662","up":0,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":0,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[]},"cluster_addrs":{"addrvec":[]},"heartbeat_back_addrs":{"addrvec":[]},"heartbeat_front_addrs":{"addrvec":[]},"public_addr":"(unrecognized address family 0)/0","cluster_addr":"(unrecognized address family 0)/0","heartbeat_back_addr":"(unrecognized address family 0)/0","heartbeat_front_addr":"(unrecognized address family 0)/0","state":["exists","new"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":0,"old_weight":0,"last_purged_snaps_scrub":"0.000000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:13:10.760 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbfc03e680 msgr2=0x7efbfc040b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:10.760 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 --2- 172.21.15.37:0/4193364073 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbfc03e680 0x7efbfc040b40 secure :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0x7efc04007fd0 tx=0x7efc04007aa0 comp rx=0 tx=0).stop 2024-09-19T11:13:10.760 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 msgr2=0x7efc1008bfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:10.760 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 --2- 172.21.15.37:0/4193364073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc1008bfa0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7efc00000c00 tx=0x7efc000046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:10.760 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 shutdown_connections 2024-09-19T11:13:10.761 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 --2- 172.21.15.37:0/4193364073 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbfc03e680 0x7efbfc040b40 unknown :-1 s=CLOSED pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:10.761 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 --2- 172.21.15.37:0/4193364073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7efc10129370 0x7efc1008bfa0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:10.761 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 >> 172.21.15.37:0/4193364073 conn(0x7efc1009b950 msgr2=0x7efc10127eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:10.761 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 shutdown_connections 2024-09-19T11:13:10.761 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:10.758+0000 7efc15b90640 1 -- 172.21.15.37:0/4193364073 wait complete. 2024-09-19T11:13:10.769 DEBUG:teuthology.misc:1 of 4 OSDs are up 2024-09-19T11:13:12.205 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-19T11:13:12.204+0000 7fa492735640 -1 osd.3 0 waiting for initial osdmap 2024-09-19T11:13:12.205 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-19T11:13:12.205+0000 7f74561ec640 -1 osd.2 0 waiting for initial osdmap 2024-09-19T11:13:12.211 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-19T11:13:12.210+0000 7f95b6d37640 -1 osd.1 0 waiting for initial osdmap 2024-09-19T11:13:12.222 INFO:tasks.ceph.osd.2.smithi102.stderr:2024-09-19T11:13:12.221+0000 7f744e00b640 -1 osd.2 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:13:12.222 INFO:tasks.ceph.osd.3.smithi102.stderr:2024-09-19T11:13:12.221+0000 7fa48a554640 -1 osd.3 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:13:12.226 INFO:tasks.ceph.osd.1.smithi102.stderr:2024-09-19T11:13:12.225+0000 7f95aeb56640 -1 osd.1 10 set_numa_affinity unable to identify public interface '' numa node: (2) No such file or directory 2024-09-19T11:13:17.174 DEBUG:teuthology.orchestra.run.smithi037:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage ceph --cluster ceph osd dump --format=json 2024-09-19T11:13:17.274 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.271+0000 7fa3af96b640 1 Processor -- start 2024-09-19T11:13:17.274 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.271+0000 7fa3af96b640 1 -- start start 2024-09-19T11:13:17.274 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.271+0000 7fa3af96b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3a80712e0 0x7fa3a81317f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:17.274 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.271+0000 7fa3af96b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa3a806cc20 con 0x7fa3a8129370 2024-09-19T11:13:17.274 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.271+0000 7fa3af96b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa3a8074250 con 0x7fa3a80712e0 2024-09-19T11:13:17.274 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.272+0000 7fa3acf06640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3a80712e0 0x7fa3a81317f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:17.274 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.272+0000 7fa3acf06640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa3a80712e0 0x7fa3a81317f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47454/0 (socket says 172.21.15.37:47454) 2024-09-19T11:13:17.275 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.272+0000 7fa3acf06640 1 -- 172.21.15.37:0/1266026531 learned_addr learned my addr 172.21.15.37:0/1266026531 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:17.275 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.272+0000 7fa3ad707640 1 --1- 172.21.15.37:0/1266026531 >> v1:172.21.15.37:6789/0 conn(0x7fa3a8129370 0x7fa3a8129750 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37738/0 (socket says 172.21.15.37:37738) 2024-09-19T11:13:17.275 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.272+0000 7fa3acf06640 1 -- 172.21.15.37:0/1266026531 >> v1:172.21.15.37:6789/0 conn(0x7fa3a8129370 legacy=0x7fa3a8129750 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:17.275 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.272+0000 7fa3acf06640 1 -- 172.21.15.37:0/1266026531 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a806e640 con 0x7fa3a80712e0 2024-09-19T11:13:17.276 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa3acf06640 1 --2- 172.21.15.37:0/1266026531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a81317f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3980097f0 tx=0x7fa39802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=68dd85382b35ddff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:17.276 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa39ffff640 1 -- 172.21.15.37:0/1266026531 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa398037070 con 0x7fa3a80712e0 2024-09-19T11:13:17.276 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa39ffff640 1 -- 172.21.15.37:0/1266026531 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa398032440 con 0x7fa3a80712e0 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa39ffff640 1 -- 172.21.15.37:0/1266026531 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa39802ae60 con 0x7fa3a80712e0 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa3af96b640 1 -- 172.21.15.37:0/1266026531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 msgr2=0x7fa3a81317f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa3af96b640 1 --2- 172.21.15.37:0/1266026531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a81317f0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fa3980097f0 tx=0x7fa39802a1e0 comp rx=0 tx=0).stop 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa3af96b640 1 -- 172.21.15.37:0/1266026531 shutdown_connections 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa3af96b640 1 --2- 172.21.15.37:0/1266026531 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a81317f0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa3af96b640 1 -- 172.21.15.37:0/1266026531 >> 172.21.15.37:0/1266026531 conn(0x7fa3a809b950 msgr2=0x7fa3a809bd60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa3af96b640 1 -- 172.21.15.37:0/1266026531 shutdown_connections 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.273+0000 7fa3af96b640 1 -- 172.21.15.37:0/1266026531 wait complete. 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.274+0000 7fa3af96b640 1 Processor -- start 2024-09-19T11:13:17.277 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.274+0000 7fa3af96b640 1 -- start start 2024-09-19T11:13:17.280 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa3af96b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a8130370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:17.280 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa3af96b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa3a806ec60 con 0x7fa3a80712e0 2024-09-19T11:13:17.280 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa3ad707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a8130370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:17.280 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa3ad707640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a8130370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47462/0 (socket says 172.21.15.37:47462) 2024-09-19T11:13:17.280 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa3ad707640 1 -- 172.21.15.37:0/756997831 learned_addr learned my addr 172.21.15.37:0/756997831 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:17.280 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa3ad707640 1 -- 172.21.15.37:0/756997831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa3a8126ca0 con 0x7fa3a80712e0 2024-09-19T11:13:17.280 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa3ad707640 1 --2- 172.21.15.37:0/756997831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a8130370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c450 tx=0x7fa3a400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa39dffb640 1 -- 172.21.15.37:0/756997831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a4007410 con 0x7fa3a80712e0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa39dffb640 1 -- 172.21.15.37:0/756997831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa3a40075b0 con 0x7fa3a80712e0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.275+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa3a8132ff0 con 0x7fa3a80712e0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.276+0000 7fa39dffb640 1 -- 172.21.15.37:0/756997831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa3a4004950 con 0x7fa3a80712e0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.276+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa3a81308b0 con 0x7fa3a80712e0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.277+0000 7fa39dffb640 1 -- 172.21.15.37:0/756997831 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (secure 0 0 0) 0x7fa3a4004af0 con 0x7fa3a80712e0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.277+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa3a8132c40 con 0x7fa3a80712e0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.277+0000 7fa39dffb640 1 --2- 172.21.15.37:0/756997831 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa38c03e680 0x7fa38c040b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.277+0000 7fa39dffb640 1 -- 172.21.15.37:0/756997831 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7fa3a4051f70 con 0x7fa3a80712e0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.277+0000 7fa3acf06640 1 --2- 172.21.15.37:0/756997831 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa38c03e680 0x7fa38c040b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:17.281 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.278+0000 7fa3acf06640 1 --2- 172.21.15.37:0/756997831 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa38c03e680 0x7fa38c040b40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa398034000 tx=0x7fa39802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:17.283 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.282+0000 7fa39dffb640 1 -- 172.21.15.37:0/756997831 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fa3a4019310 con 0x7fa3a80712e0 2024-09-19T11:13:17.470 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.468+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7fa3a8131be0 con 0x7fa3a80712e0 2024-09-19T11:13:17.471 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.469+0000 7fa39dffb640 1 -- 172.21.15.37:0/756997831 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v15) ==== 74+0+7990 (secure 0 0 0) 0x7fa3a4004de0 con 0x7fa3a80712e0 2024-09-19T11:13:17.471 INFO:teuthology.misc.health.smithi037.stdout: 2024-09-19T11:13:17.471 INFO:teuthology.misc.health.smithi037.stdout:{"epoch":15,"fsid":"ea40044b-acee-4485-a78a-0f4c700e12ca","created":"2024-09-19T11:13:02.138535+0000","modified":"2024-09-19T11:13:17.225344+0000","last_up_change":"2024-09-19T11:13:13.212621+0000","last_in_change":"2024-09-19T11:13:03.266089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":1,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T11:13:14.523581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e66bdbac-cb32-42b2-ba97-3f71c62b28d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6801","nonce":394652614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6803","nonce":394652614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6807","nonce":394652614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6805","nonce":394652614}]},"public_addr":"172.21.15.37:6801/394652614","cluster_addr":"172.21.15.37:6803/394652614","heartbeat_back_addr":"172.21.15.37:6807/394652614","heartbeat_front_addr":"172.21.15.37:6805/394652614","state":["exists","up"]},{"osd":1,"uuid":"409932a6-2604-46e6-9f50-587cd693a846","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6817","nonce":3609322588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6819","nonce":3609322588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6823","nonce":3609322588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6821","nonce":3609322588}]},"public_addr":"172.21.15.102:6817/3609322588","cluster_addr":"172.21.15.102:6819/3609322588","heartbeat_back_addr":"172.21.15.102:6823/3609322588","heartbeat_front_addr":"172.21.15.102:6821/3609322588","state":["exists","up"]},{"osd":2,"uuid":"4fb4fb22-028c-4cc7-a259-ac630af33e99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6809","nonce":525557096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6811","nonce":525557096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6815","nonce":525557096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6813","nonce":525557096}]},"public_addr":"172.21.15.102:6809/525557096","cluster_addr":"172.21.15.102:6811/525557096","heartbeat_back_addr":"172.21.15.102:6815/525557096","heartbeat_front_addr":"172.21.15.102:6813/525557096","state":["exists","up"]},{"osd":3,"uuid":"e0242238-a3ce-4288-93eb-e2aafa589662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":0,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6801","nonce":3957239017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6803","nonce":3957239017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6807","nonce":3957239017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6805","nonce":3957239017}]},"public_addr":"172.21.15.102:6801/3957239017","cluster_addr":"172.21.15.102:6803/3957239017","heartbeat_back_addr":"172.21.15.102:6807/3957239017","heartbeat_front_addr":"172.21.15.102:6805/3957239017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:08.941516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.998554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.777857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.565216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:13:17.474 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa38c03e680 msgr2=0x7fa38c040b40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:17.474 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 --2- 172.21.15.37:0/756997831 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa38c03e680 0x7fa38c040b40 secure :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0x7fa398034000 tx=0x7fa39802e000 comp rx=0 tx=0).stop 2024-09-19T11:13:17.474 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 msgr2=0x7fa3a8130370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:17.474 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 --2- 172.21.15.37:0/756997831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a8130370 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7fa3a400c450 tx=0x7fa3a400c910 comp rx=0 tx=0).stop 2024-09-19T11:13:17.474 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 shutdown_connections 2024-09-19T11:13:17.474 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 --2- 172.21.15.37:0/756997831 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa38c03e680 0x7fa38c040b40 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:17.474 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 --2- 172.21.15.37:0/756997831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa3a80712e0 0x7fa3a8130370 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:17.474 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 >> 172.21.15.37:0/756997831 conn(0x7fa3a809b950 msgr2=0x7fa3a8098450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:17.475 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 shutdown_connections 2024-09-19T11:13:17.475 INFO:teuthology.misc.health.smithi037.stderr:2024-09-19T11:13:17.472+0000 7fa3af96b640 1 -- 172.21.15.37:0/756997831 wait complete. 2024-09-19T11:13:17.483 DEBUG:teuthology.misc:4 of 4 OSDs are up 2024-09-19T11:13:17.483 INFO:tasks.ceph:Creating RBD pool 2024-09-19T11:13:17.483 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph osd pool create rbd 8 2024-09-19T11:13:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16e6733640 1 Processor -- start 2024-09-19T11:13:17.584 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16e6733640 1 -- start start 2024-09-19T11:13:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16e6733640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16e0130010 0x7f16e0134860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16e6733640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f16e0130420 con 0x7f16e012f520 2024-09-19T11:13:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16e6733640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f16e006f6b0 con 0x7f16e0130010 2024-09-19T11:13:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16df7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f16e0130010 0x7f16e0134860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16dffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f16e012f520 0x7f16e012f900 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37752/0 (socket says 172.21.15.37:37752) 2024-09-19T11:13:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16dffff640 1 -- 172.21.15.37:0/2329873265 learned_addr learned my addr 172.21.15.37:0/2329873265 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16df7fe640 1 -- 172.21.15.37:0/2329873265 >> v1:172.21.15.37:6789/0 conn(0x7f16e012f520 legacy=0x7f16e012f900 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:17.585 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.582+0000 7f16df7fe640 1 -- 172.21.15.37:0/2329873265 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e006fd20 con 0x7f16e0130010 2024-09-19T11:13:17.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.583+0000 7f16df7fe640 1 --2- 172.21.15.37:0/2329873265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e0130010 0x7f16e0134860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009720 tx=0x7f16d402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3915707078bccfdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:17.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.583+0000 7f16deffd640 1 -- 172.21.15.37:0/2329873265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d4037070 con 0x7f16e0130010 2024-09-19T11:13:17.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.583+0000 7f16deffd640 1 -- 172.21.15.37:0/2329873265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d402ad90 con 0x7f16e0130010 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.583+0000 7f16deffd640 1 -- 172.21.15.37:0/2329873265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d4032590 con 0x7f16e0130010 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.584+0000 7f16e6733640 1 -- 172.21.15.37:0/2329873265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e0130010 msgr2=0x7f16e0134860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.584+0000 7f16e6733640 1 --2- 172.21.15.37:0/2329873265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e0130010 0x7f16e0134860 secure :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009720 tx=0x7f16d402a110 comp rx=0 tx=0).stop 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.584+0000 7f16e6733640 1 -- 172.21.15.37:0/2329873265 shutdown_connections 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.584+0000 7f16e6733640 1 --2- 172.21.15.37:0/2329873265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e0130010 0x7f16e0134860 unknown :-1 s=CLOSED pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.584+0000 7f16e6733640 1 -- 172.21.15.37:0/2329873265 >> 172.21.15.37:0/2329873265 conn(0x7f16e00a2080 msgr2=0x7f16e00a2490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.584+0000 7f16e6733640 1 -- 172.21.15.37:0/2329873265 shutdown_connections 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.584+0000 7f16e6733640 1 -- 172.21.15.37:0/2329873265 wait complete. 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.585+0000 7f16e6733640 1 Processor -- start 2024-09-19T11:13:17.589 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.585+0000 7f16e6733640 1 -- start start 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.585+0000 7f16e6733640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e012f520 0x7f16e01281d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.585+0000 7f16e6733640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f16e0134f20 con 0x7f16e012f520 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.585+0000 7f16dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e012f520 0x7f16e01281d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.585+0000 7f16dffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e012f520 0x7f16e01281d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47490/0 (socket says 172.21.15.37:47490) 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.585+0000 7f16dffff640 1 -- 172.21.15.37:0/3880724297 learned_addr learned my addr 172.21.15.37:0/3880724297 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.586+0000 7f16dffff640 1 -- 172.21.15.37:0/3880724297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f16e012a7a0 con 0x7f16e012f520 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.586+0000 7f16dffff640 1 --2- 172.21.15.37:0/3880724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e012f520 0x7f16e01281d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f16d000c480 tx=0x7f16d000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.586+0000 7f16dcff9640 1 -- 172.21.15.37:0/3880724297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d0017070 con 0x7f16e012f520 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.586+0000 7f16dcff9640 1 -- 172.21.15.37:0/3880724297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16d0005c10 con 0x7f16e012f520 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.586+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f16e012a140 con 0x7f16e012f520 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.586+0000 7f16dcff9640 1 -- 172.21.15.37:0/3880724297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f16d0007070 con 0x7f16e012f520 2024-09-19T11:13:17.590 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.586+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f16e01288f0 con 0x7f16e012f520 2024-09-19T11:13:17.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.587+0000 7f16dcff9640 1 -- 172.21.15.37:0/3880724297 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (secure 0 0 0) 0x7f16d001a070 con 0x7f16e012f520 2024-09-19T11:13:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.587+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f16e012f900 con 0x7f16e012f520 2024-09-19T11:13:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.587+0000 7f16dcff9640 1 --2- 172.21.15.37:0/3880724297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f16cc03e6b0 0x7f16cc040b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.587+0000 7f16dcff9640 1 -- 172.21.15.37:0/3880724297 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(15..15 src has 1..15) ==== 3129+0+0 (secure 0 0 0) 0x7f16d0051ca0 con 0x7f16e012f520 2024-09-19T11:13:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.588+0000 7f16df7fe640 1 --2- 172.21.15.37:0/3880724297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f16cc03e6b0 0x7f16cc040b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:17.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.588+0000 7f16df7fe640 1 --2- 172.21.15.37:0/3880724297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f16cc03e6b0 0x7f16cc040b70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009720 tx=0x7f16d402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:17.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.593+0000 7f16dcff9640 1 -- 172.21.15.37:0/3880724297 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f16d001ac60 con 0x7f16e012f520 2024-09-19T11:13:17.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:17.777+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "rbd", "pg_num": 8} v 0) -- 0x7f16e012a370 con 0x7f16e012f520 2024-09-19T11:13:18.234 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.232+0000 7f16dcff9640 1 -- 172.21.15.37:0/3880724297 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "rbd", "pg_num": 8}]=0 pool 'rbd' created v16) ==== 109+0+0 (secure 0 0 0) 0x7f16d0019cd0 con 0x7f16e012f520 2024-09-19T11:13:18.234 INFO:teuthology.orchestra.run.smithi037.stderr:pool 'rbd' created 2024-09-19T11:13:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f16cc03e6b0 msgr2=0x7f16cc040b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 --2- 172.21.15.37:0/3880724297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f16cc03e6b0 0x7f16cc040b70 secure :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0x7f16d4009720 tx=0x7f16d402e000 comp rx=0 tx=0).stop 2024-09-19T11:13:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e012f520 msgr2=0x7f16e01281d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 --2- 172.21.15.37:0/3880724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e012f520 0x7f16e01281d0 secure :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0x7f16d000c480 tx=0x7f16d000c940 comp rx=0 tx=0).stop 2024-09-19T11:13:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 shutdown_connections 2024-09-19T11:13:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 --2- 172.21.15.37:0/3880724297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f16cc03e6b0 0x7f16cc040b70 unknown :-1 s=CLOSED pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 --2- 172.21.15.37:0/3880724297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f16e012f520 0x7f16e01281d0 unknown :-1 s=CLOSED pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:18.237 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 >> 172.21.15.37:0/3880724297 conn(0x7f16e00a2080 msgr2=0x7f16e012e450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 shutdown_connections 2024-09-19T11:13:18.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.234+0000 7f16e6733640 1 -- 172.21.15.37:0/3880724297 wait complete. 2024-09-19T11:13:18.249 DEBUG:teuthology.orchestra.run.smithi037:> rbd --cluster ceph pool init rbd 2024-09-19T11:13:18.309 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:18.309 INFO:teuthology.orchestra.run.smithi037.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:18.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.308+0000 7f336104f140 1 Processor -- start 2024-09-19T11:13:18.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.308+0000 7f336104f140 1 -- start start 2024-09-19T11:13:18.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.309+0000 7f336104f140 1 --2- >> v2:172.21.15.37:3300/0 conn(0x560ee5dd26f0 0x560ee5e65c60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:18.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.309+0000 7f336104f140 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x560ee5c52d90 con 0x560ee5db53c0 2024-09-19T11:13:18.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.309+0000 7f336104f140 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x560ee5ca2a80 con 0x560ee5dd26f0 2024-09-19T11:13:18.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.309+0000 7f335f33b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x560ee5dd26f0 0x560ee5e65c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:18.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.309+0000 7f335fb3c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x560ee5db53c0 0x560ee5db57a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37756/0 (socket says 172.21.15.37:37756) 2024-09-19T11:13:18.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.309+0000 7f335fb3c640 1 -- 172.21.15.37:0/3478687057 learned_addr learned my addr 172.21.15.37:0/3478687057 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:18.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.309+0000 7f335f33b640 1 -- 172.21.15.37:0/3478687057 >> v1:172.21.15.37:6789/0 conn(0x560ee5db53c0 legacy=0x560ee5db57a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:18.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.309+0000 7f335f33b640 1 -- 172.21.15.37:0/3478687057 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee5c6a410 con 0x560ee5dd26f0 2024-09-19T11:13:18.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f335f33b640 1 --2- 172.21.15.37:0/3478687057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5dd26f0 0x560ee5e65c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f335400a470 tx=0x7f3354045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c8b91de73fd33827 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:18.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f335eb3a640 1 -- 172.21.15.37:0/3478687057 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3354053570 con 0x560ee5dd26f0 2024-09-19T11:13:18.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f335eb3a640 1 -- 172.21.15.37:0/3478687057 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3354058070 con 0x560ee5dd26f0 2024-09-19T11:13:18.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f335eb3a640 1 -- 172.21.15.37:0/3478687057 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3354053880 con 0x560ee5dd26f0 2024-09-19T11:13:18.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f336104f140 1 -- 172.21.15.37:0/3478687057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5dd26f0 msgr2=0x560ee5e65c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:18.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f336104f140 1 --2- 172.21.15.37:0/3478687057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5dd26f0 0x560ee5e65c60 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x7f335400a470 tx=0x7f3354045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:18.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f336104f140 1 -- 172.21.15.37:0/3478687057 shutdown_connections 2024-09-19T11:13:18.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f336104f140 1 --2- 172.21.15.37:0/3478687057 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5dd26f0 0x560ee5e65c60 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:18.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f336104f140 1 -- 172.21.15.37:0/3478687057 >> 172.21.15.37:0/3478687057 conn(0x560ee5dcedd0 msgr2=0x560ee5dd1c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:18.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f336104f140 1 -- 172.21.15.37:0/3478687057 shutdown_connections 2024-09-19T11:13:18.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f336104f140 1 -- 172.21.15.37:0/3478687057 wait complete. 2024-09-19T11:13:18.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.312+0000 7f336104f140 1 Processor -- start 2024-09-19T11:13:18.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.313+0000 7f336104f140 1 -- start start 2024-09-19T11:13:18.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.313+0000 7f336104f140 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5db53c0 0x560ee5dc9410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:18.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.313+0000 7f336104f140 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560ee5ca6890 con 0x560ee5db53c0 2024-09-19T11:13:18.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.313+0000 7f335fb3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5db53c0 0x560ee5dc9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:18.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.313+0000 7f335fb3c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5db53c0 0x560ee5dc9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47508/0 (socket says 172.21.15.37:47508) 2024-09-19T11:13:18.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.313+0000 7f335fb3c640 1 -- 172.21.15.37:0/2547124102 learned_addr learned my addr 172.21.15.37:0/2547124102 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:18.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.313+0000 7f335fb3c640 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560ee5c21720 con 0x560ee5db53c0 2024-09-19T11:13:18.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.313+0000 7f335fb3c640 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5db53c0 0x560ee5dc9410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f335000bbd0 tx=0x7f3350009640 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:18.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3350012070 con 0x560ee5db53c0 2024-09-19T11:13:18.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3350009e40 con 0x560ee5db53c0 2024-09-19T11:13:18.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f335000e5a0 con 0x560ee5db53c0 2024-09-19T11:13:18.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560ee5dcaaf0 con 0x560ee5db53c0 2024-09-19T11:13:18.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560ee5e4d180 con 0x560ee5db53c0 2024-09-19T11:13:18.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 4) ==== 50975+0+0 (secure 0 0 0) 0x7f3350015070 con 0x560ee5db53c0 2024-09-19T11:13:18.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f334ffff640 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f334403cf70 0x7f334403f430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:18.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(16..16 src has 1..16) ==== 3471+0+0 (secure 0 0 0) 0x7f3350051950 con 0x560ee5db53c0 2024-09-19T11:13:18.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable","pool": "rbd","app": "rbd"} v 0) -- 0x560ee5dc9b60 con 0x560ee5db53c0 2024-09-19T11:13:18.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.315+0000 7f335f33b640 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f334403cf70 0x7f334403f430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:18.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:18.317+0000 7f335f33b640 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f334403cf70 0x7f334403f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f335400a470 tx=0x7f3354052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.233+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "osd pool application enable","pool": "rbd","app": "rbd"}]=0 enabled application 'rbd' on pool 'rbd' v17) ==== 141+0+0 (secure 0 0 0) 0x7f3350016dc0 con 0x560ee5db53c0 2024-09-19T11:13:19.235 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.234+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f3354058070 con 0x560ee5db53c0 2024-09-19T11:13:19.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.238+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_get_version_reply(handle=1 version=17) ==== 24+0+0 (secure 0 0 0) 0x7f3350045050 con 0x560ee5db53c0 2024-09-19T11:13:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.238+0000 7f335e339640 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=17}) -- 0x7f333c002ae0 con 0x560ee5db53c0 2024-09-19T11:13:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.238+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 8 ==== osd_map(17..17 src has 1..17) ==== 650+0+0 (secure 0 0 0) 0x7f335001fc70 con 0x560ee5db53c0 2024-09-19T11:13:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.238+0000 7f336104f140 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560ee5dd26f0 0x560ee5e71ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.238+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:1 2.3 2:c4c92e5a:::rbd_trash:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e17) -- 0x560ee5e76480 con 0x560ee5dd26f0 2024-09-19T11:13:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.239+0000 7f3360d9e640 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560ee5dd26f0 0x560ee5e71ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:19.240 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.239+0000 7f3360d9e640 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560ee5dd26f0 0x560ee5e71ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:19.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.245+0000 7f3360d9e640 1 -- 172.21.15.37:0/2547124102 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(1 rbd_trash [create] v17'1 uv1 ondisk = 0) ==== 153+0+0 (crc 0 0 0) 0x7f3358002040 con 0x560ee5dd26f0 2024-09-19T11:13:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.248+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:2 2.2 2:5cea7035:::rbd_info:head [call rbd.metadata_list in=33b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x560ee5ec8a50 con 0x560ee5dd26f0 2024-09-19T11:13:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.248+0000 7f3360d9e640 1 -- 172.21.15.37:0/2547124102 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(2 rbd_info [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3358002040 con 0x560ee5dd26f0 2024-09-19T11:13:19.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.248+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:3 2.2 2:5cea7035:::rbd_info:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e17) -- 0x560ee5ec7b60 con 0x560ee5dd26f0 2024-09-19T11:13:19.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.249+0000 7f3360d9e640 1 -- 172.21.15.37:0/2547124102 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(3 rbd_info [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f3358002040 con 0x560ee5dd26f0 2024-09-19T11:13:19.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.249+0000 7f335db38640 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- pool_op(create unmanaged snap pool 2 tid 4 name v0) -- 0x7f3340001f00 con 0x560ee5db53c0 2024-09-19T11:13:19.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:19.249+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 9 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3350015c30 con 0x560ee5db53c0 2024-09-19T11:13:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:20.243+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 10 ==== pool_op_reply(tid 4 (0) Success v18) ==== 55+0+0 (secure 0 0 0) 0x7f33500401f0 con 0x560ee5db53c0 2024-09-19T11:13:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:20.243+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=18}) -- 0x7f3344042d80 con 0x560ee5db53c0 2024-09-19T11:13:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:20.244+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 11 ==== osd_map(18..18 src has 1..18) ==== 626+0+0 (secure 0 0 0) 0x7f3350054380 con 0x560ee5db53c0 2024-09-19T11:13:20.245 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:20.244+0000 7f335e339640 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 2.2 2:5cea7035:::rbd_info:head [create,write 0~8 in=8b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e18) -- 0x7f333c005780 con 0x560ee5dd26f0 2024-09-19T11:13:20.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:20.247+0000 7f3360d9e640 1 -- 172.21.15.37:0/2547124102 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(5 rbd_info [create,write 0~8] v18'1 uv1 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f3358002040 con 0x560ee5dd26f0 2024-09-19T11:13:20.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:20.247+0000 7f335db38640 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- pool_op(delete unmanaged snap pool 2 tid 6 name v18) -- 0x7f3340003350 con 0x560ee5db53c0 2024-09-19T11:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.250+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 12 ==== pool_op_reply(tid 6 (0) Success v19) ==== 43+0+0 (secure 0 0 0) 0x7f335003c570 con 0x560ee5db53c0 2024-09-19T11:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.250+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=19}) -- 0x7f3344042d80 con 0x560ee5db53c0 2024-09-19T11:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.251+0000 7f334ffff640 1 -- 172.21.15.37:0/2547124102 <== mon.0 v2:172.21.15.37:3300/0 13 ==== osd_map(19..19 src has 1..19) ==== 654+0+0 (secure 0 0 0) 0x7f3350017b40 con 0x560ee5db53c0 2024-09-19T11:13:21.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.251+0000 7f335e339640 1 -- 172.21.15.37:0/2547124102 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:7 2.2 2:5cea7035:::rbd_info:head [write 0~19 in=19b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e19) -- 0x7f333c005b40 con 0x560ee5dd26f0 2024-09-19T11:13:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.254+0000 7f3360d9e640 1 -- 172.21.15.37:0/2547124102 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(7 rbd_info [write 0~19] v19'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3358002040 con 0x560ee5dd26f0 2024-09-19T11:13:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560ee5dd26f0 msgr2=0x560ee5e71ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560ee5dd26f0 0x560ee5e71ae0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f334403cf70 msgr2=0x7f334403f430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.256 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f334403cf70 0x7f334403f430 secure :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0x7f335400a470 tx=0x7f3354052000 comp rx=0 tx=0).stop 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5db53c0 msgr2=0x560ee5dc9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5db53c0 0x560ee5dc9410 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f335000bbd0 tx=0x7f3350009640 comp rx=0 tx=0).stop 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 shutdown_connections 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f334403cf70 0x7f334403f430 unknown :-1 s=CLOSED pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560ee5dd26f0 0x560ee5e71ae0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 --2- 172.21.15.37:0/2547124102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560ee5db53c0 0x560ee5dc9410 unknown :-1 s=CLOSED pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 >> 172.21.15.37:0/2547124102 conn(0x560ee5dcedd0 msgr2=0x560ee5e57aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 shutdown_connections 2024-09-19T11:13:21.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.255+0000 7f336104f140 1 -- 172.21.15.37:0/2547124102 wait complete. 2024-09-19T11:13:21.261 INFO:tasks.ceph:Starting mds daemons in cluster ceph... 2024-09-19T11:13:21.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph config log 1 --format=json 2024-09-19T11:13:21.262 INFO:tasks.daemonwatchdog.daemon_watchdog:watchdog starting 2024-09-19T11:13:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.373+0000 7fa87c55a640 1 Processor -- start 2024-09-19T11:13:21.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.373+0000 7fa87c55a640 1 -- start start 2024-09-19T11:13:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.374+0000 7fa87c55a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa87406e530 0x7fa87406e910 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.374+0000 7fa87c55a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fa8740708a0 con 0x7fa87406ee50 2024-09-19T11:13:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.374+0000 7fa87c55a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fa8740704d0 con 0x7fa87406e530 2024-09-19T11:13:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.374+0000 7fa87a2f6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fa87406e530 0x7fa87406e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.374+0000 7fa879af5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fa87406ee50 0x7fa87412f570 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37760/0 (socket says 172.21.15.37:37760) 2024-09-19T11:13:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.374+0000 7fa879af5640 1 -- 172.21.15.37:0/2651633289 learned_addr learned my addr 172.21.15.37:0/2651633289 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.374+0000 7fa87a2f6640 1 -- 172.21.15.37:0/2651633289 >> v1:172.21.15.37:6789/0 conn(0x7fa87406ee50 legacy=0x7fa87412f570 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.374+0000 7fa87a2f6640 1 -- 172.21.15.37:0/2651633289 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87406f260 con 0x7fa87406e530 2024-09-19T11:13:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.375+0000 7fa87a2f6640 1 --2- 172.21.15.37:0/2651633289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa87406e910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa870009720 tx=0x7fa87002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7a28536e725b6efd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.375+0000 7fa8792f4640 1 -- 172.21.15.37:0/2651633289 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa870037070 con 0x7fa87406e530 2024-09-19T11:13:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.375+0000 7fa8792f4640 1 -- 172.21.15.37:0/2651633289 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87002ad90 con 0x7fa87406e530 2024-09-19T11:13:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.375+0000 7fa8792f4640 1 -- 172.21.15.37:0/2651633289 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa870032590 con 0x7fa87406e530 2024-09-19T11:13:21.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.376+0000 7fa87c55a640 1 -- 172.21.15.37:0/2651633289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 msgr2=0x7fa87406e910 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.376+0000 7fa87c55a640 1 --2- 172.21.15.37:0/2651633289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa87406e910 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x7fa870009720 tx=0x7fa87002a110 comp rx=0 tx=0).stop 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.376+0000 7fa87c55a640 1 -- 172.21.15.37:0/2651633289 shutdown_connections 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.376+0000 7fa87c55a640 1 --2- 172.21.15.37:0/2651633289 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa87406e910 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.376+0000 7fa87c55a640 1 -- 172.21.15.37:0/2651633289 >> 172.21.15.37:0/2651633289 conn(0x7fa8740a22c0 msgr2=0x7fa8740a26d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.376+0000 7fa87c55a640 1 -- 172.21.15.37:0/2651633289 shutdown_connections 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.376+0000 7fa87c55a640 1 -- 172.21.15.37:0/2651633289 wait complete. 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.377+0000 7fa87c55a640 1 Processor -- start 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.377+0000 7fa87c55a640 1 -- start start 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.377+0000 7fa87c55a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa8740903f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:21.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.377+0000 7fa87c55a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fa874130010 con 0x7fa87406e530 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.377+0000 7fa87a2f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa8740903f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.377+0000 7fa87a2f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa8740903f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47522/0 (socket says 172.21.15.37:47522) 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.377+0000 7fa87a2f6640 1 -- 172.21.15.37:0/358007028 learned_addr learned my addr 172.21.15.37:0/358007028 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.378+0000 7fa87a2f6640 1 -- 172.21.15.37:0/358007028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fa87409c330 con 0x7fa87406e530 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.378+0000 7fa87a2f6640 1 --2- 172.21.15.37:0/358007028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa8740903f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa870009720 tx=0x7fa8700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.378+0000 7fa86affd640 1 -- 172.21.15.37:0/358007028 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa870041020 con 0x7fa87406e530 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.378+0000 7fa86affd640 1 -- 172.21.15.37:0/358007028 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa87003d550 con 0x7fa87406e530 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.378+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fa874073850 con 0x7fa87406e530 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.378+0000 7fa86affd640 1 -- 172.21.15.37:0/358007028 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa870037040 con 0x7fa87406e530 2024-09-19T11:13:21.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.378+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fa874092810 con 0x7fa87406e530 2024-09-19T11:13:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.379+0000 7fa86affd640 1 -- 172.21.15.37:0/358007028 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa870044020 con 0x7fa87406e530 2024-09-19T11:13:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.379+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fa874092b50 con 0x7fa87406e530 2024-09-19T11:13:21.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.379+0000 7fa86affd640 1 --2- 172.21.15.37:0/358007028 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa85803e790 0x7fa858040c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.379+0000 7fa86affd640 1 -- 172.21.15.37:0/358007028 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fa870073540 con 0x7fa87406e530 2024-09-19T11:13:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.380+0000 7fa879af5640 1 --2- 172.21.15.37:0/358007028 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa85803e790 0x7fa858040c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:21.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.380+0000 7fa879af5640 1 --2- 172.21.15.37:0/358007028 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa85803e790 0x7fa858040c50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa864007fd0 tx=0x7fa864007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:21.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.384+0000 7fa86affd640 1 -- 172.21.15.37:0/358007028 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fa874092b50 con 0x7fa87406e530 2024-09-19T11:13:21.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.571+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "config log", "num": 1, "format": "json"} v 0) -- 0x7fa8740916e0 con 0x7fa87406e530 2024-09-19T11:13:21.573 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.572+0000 7fa86affd640 1 -- 172.21.15.37:0/358007028 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "config log", "num": 1, "format": "json"}]=0 v5) ==== 86+0+159 (secure 0 0 0) 0x7fa87004b030 con 0x7fa87406e530 2024-09-19T11:13:21.573 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:13:21.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa85803e790 msgr2=0x7fa858040c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 --2- 172.21.15.37:0/358007028 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa85803e790 0x7fa858040c50 secure :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0x7fa864007fd0 tx=0x7fa864007aa0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 msgr2=0x7fa8740903f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.575 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 --2- 172.21.15.37:0/358007028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa8740903f0 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x7fa870009720 tx=0x7fa8700046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 shutdown_connections 2024-09-19T11:13:21.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 --2- 172.21.15.37:0/358007028 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa85803e790 0x7fa858040c50 unknown :-1 s=CLOSED pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 --2- 172.21.15.37:0/358007028 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fa87406e530 0x7fa8740903f0 unknown :-1 s=CLOSED pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 >> 172.21.15.37:0/358007028 conn(0x7fa8740a22c0 msgr2=0x7fa87409d9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:21.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 shutdown_connections 2024-09-19T11:13:21.576 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.574+0000 7fa87c55a640 1 -- 172.21.15.37:0/358007028 wait complete. 2024-09-19T11:13:21.586 INFO:teuthology.orchestra.run.smithi037.stdout:[{"version":5,"timestamp":"2024-09-19T11:13:12.212044+0000","name":"","changes":[{"name":"osd.1/osd_mclock_max_capacity_iops_ssd","new_value":"5974.195728"}]}] 2024-09-19T11:13:21.586 INFO:tasks.ceph_manager:config epoch is 5 2024-09-19T11:13:21.586 INFO:tasks.ceph:Waiting until ceph daemons up and pgs clean... 2024-09-19T11:13:21.586 INFO:tasks.ceph.ceph_manager.ceph:waiting for mgr available 2024-09-19T11:13:21.586 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph mgr dump --format=json 2024-09-19T11:13:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.686+0000 7f6e7c432640 1 Processor -- start 2024-09-19T11:13:21.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.686+0000 7f6e7c432640 1 -- start start 2024-09-19T11:13:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.686+0000 7f6e7c432640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e7412c0b0 0x7f6e7412c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.686+0000 7f6e7c432640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e74099e20 con 0x7f6e7412c9d0 2024-09-19T11:13:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.686+0000 7f6e7c432640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6e740715a0 con 0x7f6e7412c0b0 2024-09-19T11:13:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.686+0000 7f6e7a1ce640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e7412c0b0 0x7f6e7412c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:21.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.686+0000 7f6e799cd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6e7412c9d0 0x7f6e74097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37774/0 (socket says 172.21.15.37:37774) 2024-09-19T11:13:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.687+0000 7f6e799cd640 1 -- 172.21.15.37:0/109534620 learned_addr learned my addr 172.21.15.37:0/109534620 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.687+0000 7f6e7a1ce640 1 -- 172.21.15.37:0/109534620 >> v1:172.21.15.37:6789/0 conn(0x7f6e7412c9d0 legacy=0x7f6e74097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.687+0000 7f6e791cc640 1 -- 172.21.15.37:0/109534620 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1184377794 0 0) 0x7f6e74099e20 con 0x7f6e7412c9d0 2024-09-19T11:13:21.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.687+0000 7f6e7a1ce640 1 -- 172.21.15.37:0/109534620 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e740705b0 con 0x7f6e7412c0b0 2024-09-19T11:13:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e7a1ce640 1 --2- 172.21.15.37:0/109534620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e7412c490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009750 tx=0x7f6e7002a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99f24845fb071fb0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:21.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e791cc640 1 -- 172.21.15.37:0/109534620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e70037070 con 0x7f6e7412c0b0 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e791cc640 1 -- 172.21.15.37:0/109534620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e7002ad80 con 0x7f6e7412c0b0 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e791cc640 1 -- 172.21.15.37:0/109534620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e70032590 con 0x7f6e7412c0b0 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e7c432640 1 -- 172.21.15.37:0/109534620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 msgr2=0x7f6e7412c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e7c432640 1 --2- 172.21.15.37:0/109534620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e7412c490 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x7f6e70009750 tx=0x7f6e7002a140 comp rx=0 tx=0).stop 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e7c432640 1 -- 172.21.15.37:0/109534620 shutdown_connections 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e7c432640 1 --2- 172.21.15.37:0/109534620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e7412c490 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e7c432640 1 -- 172.21.15.37:0/109534620 >> 172.21.15.37:0/109534620 conn(0x7f6e7409abc0 msgr2=0x7f6e74098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e7c432640 1 -- 172.21.15.37:0/109534620 shutdown_connections 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.688+0000 7f6e7c432640 1 -- 172.21.15.37:0/109534620 wait complete. 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.689+0000 7f6e7c432640 1 Processor -- start 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.689+0000 7f6e7c432640 1 -- start start 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.689+0000 7f6e7c432640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e74128490 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:21.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.689+0000 7f6e7c432640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e7412ce60 con 0x7f6e7412c0b0 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e7a1ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e74128490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e7a1ce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e74128490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47542/0 (socket says 172.21.15.37:47542) 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e7a1ce640 1 -- 172.21.15.37:0/222235799 learned_addr learned my addr 172.21.15.37:0/222235799 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e7a1ce640 1 -- 172.21.15.37:0/222235799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e7408c3d0 con 0x7f6e7412c0b0 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e7a1ce640 1 --2- 172.21.15.37:0/222235799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e74128490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6e70035040 tx=0x7f6e700046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e6affd640 1 -- 172.21.15.37:0/222235799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e70037040 con 0x7f6e7412c0b0 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e6affd640 1 -- 172.21.15.37:0/222235799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e70004030 con 0x7f6e7412c0b0 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e6affd640 1 -- 172.21.15.37:0/222235799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e70004310 con 0x7f6e7412c0b0 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e7406e220 con 0x7f6e7412c0b0 2024-09-19T11:13:21.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.690+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e7406ebf0 con 0x7f6e7412c0b0 2024-09-19T11:13:21.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.691+0000 7f6e6affd640 1 -- 172.21.15.37:0/222235799 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6e7003a040 con 0x7f6e7412c0b0 2024-09-19T11:13:21.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.691+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e74097df0 con 0x7f6e7412c0b0 2024-09-19T11:13:21.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.692+0000 7f6e6affd640 1 --2- 172.21.15.37:0/222235799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6e5803e710 0x7f6e58040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:21.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.692+0000 7f6e6affd640 1 -- 172.21.15.37:0/222235799 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f6e70073600 con 0x7f6e7412c0b0 2024-09-19T11:13:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.692+0000 7f6e799cd640 1 --2- 172.21.15.37:0/222235799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6e5803e710 0x7f6e58040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:21.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.692+0000 7f6e799cd640 1 --2- 172.21.15.37:0/222235799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6e5803e710 0x7f6e58040bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6e64000c00 tx=0x7f6e640078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:21.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.696+0000 7f6e6affd640 1 -- 172.21.15.37:0/222235799 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f6e70042020 con 0x7f6e7412c0b0 2024-09-19T11:13:21.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.931+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "mgr dump", "format": "json"} v 0) -- 0x7f6e7408c180 con 0x7f6e7412c0b0 2024-09-19T11:13:21.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.932+0000 7f6e6affd640 1 -- 172.21.15.37:0/222235799 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "mgr dump", "format": "json"}]=0 v5) ==== 74+0+98095 (secure 0 0 0) 0x7f6e7408c180 con 0x7f6e7412c0b0 2024-09-19T11:13:21.936 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:13:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6e5803e710 msgr2=0x7f6e58040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 --2- 172.21.15.37:0/222235799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6e5803e710 0x7f6e58040bd0 secure :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0x7f6e64000c00 tx=0x7f6e640078d0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 msgr2=0x7f6e74128490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 --2- 172.21.15.37:0/222235799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e74128490 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x7f6e70035040 tx=0x7f6e700046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 shutdown_connections 2024-09-19T11:13:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 --2- 172.21.15.37:0/222235799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6e5803e710 0x7f6e58040bd0 unknown :-1 s=CLOSED pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 --2- 172.21.15.37:0/222235799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e7412c0b0 0x7f6e74128490 unknown :-1 s=CLOSED pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 >> 172.21.15.37:0/222235799 conn(0x7f6e7409abc0 msgr2=0x7f6e7409c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 shutdown_connections 2024-09-19T11:13:21.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:21.935+0000 7f6e7c432640 1 -- 172.21.15.37:0/222235799 wait complete. 2024-09-19T11:13:21.946 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":5,"flags":0,"active_gid":4102,"active_name":"x","active_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6824","nonce":3738146565},{"type":"v1","addr":"172.21.15.102:6825","nonce":3738146565}]},"active_addr":"172.21.15.102:6825/3738146565","active_change":"2024-09-19T11:13:06.502360+0000","active_mgr_features":4540719139924082687,"available":true,"standbys":[],"modules":["iostat","nfs","restful"],"available_modules":[{"name":"alerts","can_run":true,"error_string":"","module_options":{"interval":{"name":"interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"How frequently to reexamine health status","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"smtp_destination":{"name":"smtp_destination","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Email address to send alerts to, use commas to separate multiple","long_desc":"","tags":[],"see_also":[]},"smtp_from_name":{"name":"smtp_from_name","type":"str","level":"advanced","flags":1,"default_value":"Ceph","min":"","max":"","enum_allowed":[],"desc":"Email From: name","long_desc":"","tags":[],"see_also":[]},"smtp_host":{"name":"smtp_host","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_password":{"name":"smtp_password","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Password to authenticate with","long_desc":"","tags":[],"see_also":[]},"smtp_port":{"name":"smtp_port","type":"int","level":"advanced","flags":1,"default_value":"465","min":"","max":"","enum_allowed":[],"desc":"SMTP port","long_desc":"","tags":[],"see_also":[]},"smtp_sender":{"name":"smtp_sender","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"SMTP envelope sender","long_desc":"","tags":[],"see_also":[]},"smtp_ssl":{"name":"smtp_ssl","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Use SSL to connect to SMTP server","long_desc":"","tags":[],"see_also":[]},"smtp_user":{"name":"smtp_user","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"User to authenticate as","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"balancer","can_run":true,"error_string":"","module_options":{"active":{"name":"active","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically balance PGs across cluster","long_desc":"","tags":[],"see_also":[]},"begin_time":{"name":"begin_time","type":"str","level":"advanced","flags":1,"default_value":"0000","min":"","max":"","enum_allowed":[],"desc":"beginning time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"begin_weekday":{"name":"begin_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to this day of the week or later","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"crush_compat_max_iterations":{"name":"crush_compat_max_iterations","type":"uint","level":"advanced","flags":1,"default_value":"25","min":"1","max":"250","enum_allowed":[],"desc":"maximum number of iterations to attempt optimization","long_desc":"","tags":[],"see_also":[]},"crush_compat_metrics":{"name":"crush_compat_metrics","type":"str","level":"advanced","flags":1,"default_value":"pgs,objects,bytes","min":"","max":"","enum_allowed":[],"desc":"metrics with which to calculate OSD utilization","long_desc":"Value is a list of one or more of \"pgs\", \"objects\", or \"bytes\", and indicates which metrics to use to balance utilization.","tags":[],"see_also":[]},"crush_compat_step":{"name":"crush_compat_step","type":"float","level":"advanced","flags":1,"default_value":"0.5","min":"0.001","max":"0.999","enum_allowed":[],"desc":"aggressiveness of optimization","long_desc":".99 is very aggressive, .01 is less aggressive","tags":[],"see_also":[]},"end_time":{"name":"end_time","type":"str","level":"advanced","flags":1,"default_value":"2359","min":"","max":"","enum_allowed":[],"desc":"ending time of day to automatically balance","long_desc":"This is a time of day in the format HHMM.","tags":[],"see_also":[]},"end_weekday":{"name":"end_weekday","type":"uint","level":"advanced","flags":1,"default_value":"0","min":"0","max":"6","enum_allowed":[],"desc":"Restrict automatic balancing to days of the week earlier than this","long_desc":"0 = Sunday, 1 = Monday, etc.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_score":{"name":"min_score","type":"float","level":"advanced","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"minimum score, below which no optimization is attempted","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":1,"default_value":"upmap","min":"","max":"","enum_allowed":["crush-compat","none","read","upmap","upmap-read"],"desc":"Balancer mode","long_desc":"","tags":[],"see_also":[]},"pool_ids":{"name":"pool_ids","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"pools which the automatic balancing will be limited to","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and attempt optimization","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"upmap_max_deviation":{"name":"upmap_max_deviation","type":"int","level":"advanced","flags":1,"default_value":"5","min":"1","max":"","enum_allowed":[],"desc":"deviation below which no optimization is attempted","long_desc":"If the number of PGs are within this count then no optimization is attempted","tags":[],"see_also":[]},"upmap_max_optimizations":{"name":"upmap_max_optimizations","type":"uint","level":"advanced","flags":1,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"maximum upmap optimizations to make per attempt","long_desc":"","tags":[],"see_also":[]}}},{"name":"cephadm","can_run":true,"error_string":"","module_options":{"agent_down_multiplier":{"name":"agent_down_multiplier","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"","max":"","enum_allowed":[],"desc":"Multiplied by agent refresh rate to calculate how long agent must not report before being marked down","long_desc":"","tags":[],"see_also":[]},"agent_refresh_rate":{"name":"agent_refresh_rate","type":"secs","level":"advanced","flags":0,"default_value":"20","min":"","max":"","enum_allowed":[],"desc":"How often agent on each host will try to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"agent_starting_port":{"name":"agent_starting_port","type":"int","level":"advanced","flags":0,"default_value":"4721","min":"","max":"","enum_allowed":[],"desc":"First port agent will try to bind to (will also try up to next 1000 subsequent ports if blocked)","long_desc":"","tags":[],"see_also":[]},"allow_ptrace":{"name":"allow_ptrace","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow SYS_PTRACE capability on ceph containers","long_desc":"The SYS_PTRACE capability is needed to attach to a process with gdb or strace. Enabling this options can allow debugging daemons that encounter problems at runtime.","tags":[],"see_also":[]},"autotune_interval":{"name":"autotune_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to autotune daemon memory","long_desc":"","tags":[],"see_also":[]},"autotune_memory_target_ratio":{"name":"autotune_memory_target_ratio","type":"float","level":"advanced","flags":0,"default_value":"0.7","min":"","max":"","enum_allowed":[],"desc":"ratio of total system memory to divide amongst autotuned daemons","long_desc":"","tags":[],"see_also":[]},"cephadm_log_destination":{"name":"cephadm_log_destination","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":["file","file,syslog","syslog"],"desc":"Destination for cephadm command's persistent logging","long_desc":"","tags":[],"see_also":[]},"cgroups_split":{"name":"cgroups_split","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Pass --cgroups=split when cephadm creates containers (currently podman only)","long_desc":"","tags":[],"see_also":[]},"config_checks_enabled":{"name":"config_checks_enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable or disable the cephadm configuration analysis","long_desc":"","tags":[],"see_also":[]},"config_dashboard":{"name":"config_dashboard","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"manage configs like API endpoints in Dashboard.","long_desc":"","tags":[],"see_also":[]},"container_image_alertmanager":{"name":"container_image_alertmanager","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/alertmanager:v0.27.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_base":{"name":"container_image_base","type":"str","level":"advanced","flags":1,"default_value":"quay.io/ceph/ceph","min":"","max":"","enum_allowed":[],"desc":"Container image name, without the tag","long_desc":"","tags":[],"see_also":[]},"container_image_elasticsearch":{"name":"container_image_elasticsearch","type":"str","level":"advanced","flags":0,"default_value":"quay.io/omrizeneva/elasticsearch:6.8.23","min":"","max":"","enum_allowed":[],"desc":"elasticsearch container image","long_desc":"","tags":[],"see_also":[]},"container_image_grafana":{"name":"container_image_grafana","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/grafana:10.4.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_haproxy":{"name":"container_image_haproxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/haproxy:2.3","min":"","max":"","enum_allowed":[],"desc":"HAproxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_agent":{"name":"container_image_jaeger_agent","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-agent:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger agent container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_collector":{"name":"container_image_jaeger_collector","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-collector:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger collector container image","long_desc":"","tags":[],"see_also":[]},"container_image_jaeger_query":{"name":"container_image_jaeger_query","type":"str","level":"advanced","flags":0,"default_value":"quay.io/jaegertracing/jaeger-query:1.29","min":"","max":"","enum_allowed":[],"desc":"Jaeger query container image","long_desc":"","tags":[],"see_also":[]},"container_image_keepalived":{"name":"container_image_keepalived","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/keepalived:2.2.4","min":"","max":"","enum_allowed":[],"desc":"Keepalived container image","long_desc":"","tags":[],"see_also":[]},"container_image_loki":{"name":"container_image_loki","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/loki:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Loki container image","long_desc":"","tags":[],"see_also":[]},"container_image_nginx":{"name":"container_image_nginx","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nginx:sclorg-nginx-126","min":"","max":"","enum_allowed":[],"desc":"Nginx container image","long_desc":"","tags":[],"see_also":[]},"container_image_node_exporter":{"name":"container_image_node_exporter","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/node-exporter:v1.7.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_nvmeof":{"name":"container_image_nvmeof","type":"str","level":"advanced","flags":0,"default_value":"quay.io/ceph/nvmeof:1.2.17","min":"","max":"","enum_allowed":[],"desc":"Nvme-of container image","long_desc":"","tags":[],"see_also":[]},"container_image_oauth2_proxy":{"name":"container_image_oauth2_proxy","type":"str","level":"advanced","flags":0,"default_value":"quay.io/oauth2-proxy/oauth2-proxy:v7.6.0","min":"","max":"","enum_allowed":[],"desc":"oauth2-proxy container image","long_desc":"","tags":[],"see_also":[]},"container_image_prometheus":{"name":"container_image_prometheus","type":"str","level":"advanced","flags":0,"default_value":"quay.io/prometheus/prometheus:v2.51.0","min":"","max":"","enum_allowed":[],"desc":"Prometheus container image","long_desc":"","tags":[],"see_also":[]},"container_image_promtail":{"name":"container_image_promtail","type":"str","level":"advanced","flags":0,"default_value":"docker.io/grafana/promtail:3.0.0","min":"","max":"","enum_allowed":[],"desc":"Promtail container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba":{"name":"container_image_samba","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-server:devbuilds-centos-amd64","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB container image","long_desc":"","tags":[],"see_also":[]},"container_image_samba_metrics":{"name":"container_image_samba_metrics","type":"str","level":"advanced","flags":0,"default_value":"quay.io/samba.org/samba-metrics:latest","min":"","max":"","enum_allowed":[],"desc":"Samba/SMB metrics exporter container image","long_desc":"","tags":[],"see_also":[]},"container_image_snmp_gateway":{"name":"container_image_snmp_gateway","type":"str","level":"advanced","flags":0,"default_value":"docker.io/maxwo/snmp-notifier:v1.2.1","min":"","max":"","enum_allowed":[],"desc":"SNMP Gateway container image","long_desc":"","tags":[],"see_also":[]},"container_init":{"name":"container_init","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Run podman/docker with `--init`","long_desc":"","tags":[],"see_also":[]},"daemon_cache_timeout":{"name":"daemon_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"seconds to cache service (daemon) inventory","long_desc":"","tags":[],"see_also":[]},"default_cephadm_command_timeout":{"name":"default_cephadm_command_timeout","type":"int","level":"advanced","flags":0,"default_value":"900","min":"","max":"","enum_allowed":[],"desc":"Default timeout applied to cephadm commands run directly on the host (in seconds)","long_desc":"","tags":[],"see_also":[]},"default_registry":{"name":"default_registry","type":"str","level":"advanced","flags":0,"default_value":"docker.io","min":"","max":"","enum_allowed":[],"desc":"Search-registry to which we should normalize unqualified image names. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"device_cache_timeout":{"name":"device_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"1800","min":"","max":"","enum_allowed":[],"desc":"seconds to cache device inventory","long_desc":"","tags":[],"see_also":[]},"device_enhanced_scan":{"name":"device_enhanced_scan","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use libstoragemgmt during device scans","long_desc":"","tags":[],"see_also":[]},"facts_cache_timeout":{"name":"facts_cache_timeout","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"seconds to cache host facts data","long_desc":"","tags":[],"see_also":[]},"grafana_dashboards_path":{"name":"grafana_dashboards_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/grafana/dashboards/ceph-dashboard/","min":"","max":"","enum_allowed":[],"desc":"location of dashboards to include in grafana deployments","long_desc":"","tags":[],"see_also":[]},"host_check_interval":{"name":"host_check_interval","type":"secs","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to perform a host check","long_desc":"","tags":[],"see_also":[]},"hw_monitoring":{"name":"hw_monitoring","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Deploy hw monitoring daemon on every host.","long_desc":"","tags":[],"see_also":[]},"inventory_list_all":{"name":"inventory_list_all","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Whether ceph-volume inventory should report more devices (mostly mappers (LVs / mpaths), partitions...)","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_refresh_metadata":{"name":"log_refresh_metadata","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Log all refresh metadata. Includes daemon, device, and host info collected regularly. Only has effect if logging at debug level","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"log to the \"cephadm\" cluster log channel\"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf":{"name":"manage_etc_ceph_ceph_conf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Manage and own /etc/ceph/ceph.conf on the hosts.","long_desc":"","tags":[],"see_also":[]},"manage_etc_ceph_ceph_conf_hosts":{"name":"manage_etc_ceph_ceph_conf_hosts","type":"str","level":"advanced","flags":0,"default_value":"*","min":"","max":"","enum_allowed":[],"desc":"PlacementSpec describing on which hosts to manage /etc/ceph/ceph.conf","long_desc":"","tags":[],"see_also":[]},"max_count_per_host":{"name":"max_count_per_host","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of daemons per service per host","long_desc":"","tags":[],"see_also":[]},"max_osd_draining_count":{"name":"max_osd_draining_count","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"max number of osds that will be drained simultaneously when osds are removed","long_desc":"","tags":[],"see_also":[]},"migration_current":{"name":"migration_current","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"internal - do not modify","long_desc":"","tags":[],"see_also":[]},"mode":{"name":"mode","type":"str","level":"advanced","flags":0,"default_value":"root","min":"","max":"","enum_allowed":["cephadm-package","root"],"desc":"mode for remote execution of cephadm","long_desc":"","tags":[],"see_also":[]},"oob_default_addr":{"name":"oob_default_addr","type":"str","level":"advanced","flags":0,"default_value":"169.254.1.1","min":"","max":"","enum_allowed":[],"desc":"Default address for RedFish API (oob management).","long_desc":"","tags":[],"see_also":[]},"prometheus_alerts_path":{"name":"prometheus_alerts_path","type":"str","level":"advanced","flags":0,"default_value":"/etc/prometheus/ceph/ceph_default_alerts.yml","min":"","max":"","enum_allowed":[],"desc":"location of alerts to include in prometheus deployments","long_desc":"","tags":[],"see_also":[]},"registry_insecure":{"name":"registry_insecure","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Registry is to be considered insecure (no TLS available). Only for development purposes.","long_desc":"","tags":[],"see_also":[]},"registry_password":{"name":"registry_password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository password. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"registry_url":{"name":"registry_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Registry url for login purposes. This is not the default registry","long_desc":"","tags":[],"see_also":[]},"registry_username":{"name":"registry_username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"Custom repository username. Only used for logging into a registry.","long_desc":"","tags":[],"see_also":[]},"secure_monitoring_stack":{"name":"secure_monitoring_stack","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable TLS security for all the monitoring stack daemons","long_desc":"","tags":[],"see_also":[]},"service_discovery_port":{"name":"service_discovery_port","type":"int","level":"advanced","flags":0,"default_value":"8765","min":"","max":"","enum_allowed":[],"desc":"cephadm service discovery port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssh_config_file":{"name":"ssh_config_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"customized SSH config file to connect to managed hosts","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_count_max":{"name":"ssh_keepalive_count_max","type":"int","level":"advanced","flags":0,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"How many times ssh connections can fail liveness checks before the host is marked offline","long_desc":"","tags":[],"see_also":[]},"ssh_keepalive_interval":{"name":"ssh_keepalive_interval","type":"int","level":"advanced","flags":0,"default_value":"7","min":"","max":"","enum_allowed":[],"desc":"How often ssh connections are checked for liveness","long_desc":"","tags":[],"see_also":[]},"use_agent":{"name":"use_agent","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Use cephadm agent on each host to gather and send metadata","long_desc":"","tags":[],"see_also":[]},"use_repo_digest":{"name":"use_repo_digest","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Automatically convert image tags to image digest. Make sure all daemons use the same image","long_desc":"","tags":[],"see_also":[]},"warn_on_failed_host_check":{"name":"warn_on_failed_host_check","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if the host check fails","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_daemons":{"name":"warn_on_stray_daemons","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected that are not managed by cephadm","long_desc":"","tags":[],"see_also":[]},"warn_on_stray_hosts":{"name":"warn_on_stray_hosts","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"raise a health warning if daemons are detected on a host that is not managed by cephadm","long_desc":"","tags":[],"see_also":[]}}},{"name":"crash","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"retain_interval":{"name":"retain_interval","type":"secs","level":"advanced","flags":1,"default_value":"31536000","min":"","max":"","enum_allowed":[],"desc":"how long to retain crashes before pruning them","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_recent_interval":{"name":"warn_recent_interval","type":"secs","level":"advanced","flags":1,"default_value":"1209600","min":"","max":"","enum_allowed":[],"desc":"time interval in which to warn about recent crashes","long_desc":"","tags":[],"see_also":[]}}},{"name":"dashboard","can_run":true,"error_string":"","module_options":{"ACCOUNT_LOCKOUT_ATTEMPTS":{"name":"ACCOUNT_LOCKOUT_ATTEMPTS","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_HOST":{"name":"ALERTMANAGER_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ALERTMANAGER_API_SSL_VERIFY":{"name":"ALERTMANAGER_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_ENABLED":{"name":"AUDIT_API_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"AUDIT_API_LOG_PAYLOAD":{"name":"AUDIT_API_LOG_PAYLOAD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ENABLE_BROWSABLE_API":{"name":"ENABLE_BROWSABLE_API","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_CEPHFS":{"name":"FEATURE_TOGGLE_CEPHFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_DASHBOARD":{"name":"FEATURE_TOGGLE_DASHBOARD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_ISCSI":{"name":"FEATURE_TOGGLE_ISCSI","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_MIRRORING":{"name":"FEATURE_TOGGLE_MIRRORING","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_NFS":{"name":"FEATURE_TOGGLE_NFS","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RBD":{"name":"FEATURE_TOGGLE_RBD","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"FEATURE_TOGGLE_RGW":{"name":"FEATURE_TOGGLE_RGW","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE":{"name":"GANESHA_CLUSTERS_RADOS_POOL_NAMESPACE","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_PASSWORD":{"name":"GRAFANA_API_PASSWORD","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_SSL_VERIFY":{"name":"GRAFANA_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_URL":{"name":"GRAFANA_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_API_USERNAME":{"name":"GRAFANA_API_USERNAME","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_FRONTEND_API_URL":{"name":"GRAFANA_FRONTEND_API_URL","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"GRAFANA_UPDATE_DASHBOARDS":{"name":"GRAFANA_UPDATE_DASHBOARDS","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISCSI_API_SSL_VERIFICATION":{"name":"ISCSI_API_SSL_VERIFICATION","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ISSUE_TRACKER_API_KEY":{"name":"ISSUE_TRACKER_API_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MANAGED_BY_CLUSTERS":{"name":"MANAGED_BY_CLUSTERS","type":"str","level":"advanced","flags":0,"default_value":"[]","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"MULTICLUSTER_CONFIG":{"name":"MULTICLUSTER_CONFIG","type":"str","level":"advanced","flags":0,"default_value":"{}","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_HOST":{"name":"PROMETHEUS_API_HOST","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PROMETHEUS_API_SSL_VERIFY":{"name":"PROMETHEUS_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_COMPLEXITY_ENABLED":{"name":"PWD_POLICY_CHECK_COMPLEXITY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED":{"name":"PWD_POLICY_CHECK_EXCLUSION_LIST_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_LENGTH_ENABLED":{"name":"PWD_POLICY_CHECK_LENGTH_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_OLDPWD_ENABLED":{"name":"PWD_POLICY_CHECK_OLDPWD_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_REPETITIVE_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED":{"name":"PWD_POLICY_CHECK_SEQUENTIAL_CHARS_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_CHECK_USERNAME_ENABLED":{"name":"PWD_POLICY_CHECK_USERNAME_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_ENABLED":{"name":"PWD_POLICY_ENABLED","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_EXCLUSION_LIST":{"name":"PWD_POLICY_EXCLUSION_LIST","type":"str","level":"advanced","flags":0,"default_value":"osd,host,dashboard,pool,block,nfs,ceph,monitors,gateway,logs,crush,maps","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_COMPLEXITY":{"name":"PWD_POLICY_MIN_COMPLEXITY","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"PWD_POLICY_MIN_LENGTH":{"name":"PWD_POLICY_MIN_LENGTH","type":"int","level":"advanced","flags":0,"default_value":"8","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"REST_REQUESTS_TIMEOUT":{"name":"REST_REQUESTS_TIMEOUT","type":"int","level":"advanced","flags":0,"default_value":"45","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ACCESS_KEY":{"name":"RGW_API_ACCESS_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_ADMIN_RESOURCE":{"name":"RGW_API_ADMIN_RESOURCE","type":"str","level":"advanced","flags":0,"default_value":"admin","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SECRET_KEY":{"name":"RGW_API_SECRET_KEY","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"RGW_API_SSL_VERIFY":{"name":"RGW_API_SSL_VERIFY","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"UNSAFE_TLS_v1_2":{"name":"UNSAFE_TLS_v1_2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_SPAN":{"name":"USER_PWD_EXPIRATION_SPAN","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_1":{"name":"USER_PWD_EXPIRATION_WARNING_1","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"USER_PWD_EXPIRATION_WARNING_2":{"name":"USER_PWD_EXPIRATION_WARNING_2","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"cross_origin_url":{"name":"cross_origin_url","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"crt_file":{"name":"crt_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"debug":{"name":"debug","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Enable/disable debug options","long_desc":"","tags":[],"see_also":[]},"jwt_token_ttl":{"name":"jwt_token_ttl","type":"int","level":"advanced","flags":0,"default_value":"28800","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"motd":{"name":"motd","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"The message of the day","long_desc":"","tags":[],"see_also":[]},"redirect_resolve_ip_addr":{"name":"redirect_resolve_ip_addr","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":0,"default_value":"8080","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl_server_port":{"name":"ssl_server_port","type":"int","level":"advanced","flags":0,"default_value":"8443","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sso_oauth2":{"name":"sso_oauth2","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":0,"default_value":"redirect","min":"","max":"","enum_allowed":["error","redirect"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":0,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url_prefix":{"name":"url_prefix","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"devicehealth","can_run":true,"error_string":"","module_options":{"enable_monitoring":{"name":"enable_monitoring","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"monitor device health metrics","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mark_out_threshold":{"name":"mark_out_threshold","type":"secs","level":"advanced","flags":1,"default_value":"2419200","min":"","max":"","enum_allowed":[],"desc":"automatically mark OSD if it may fail before this long","long_desc":"","tags":[],"see_also":[]},"pool_name":{"name":"pool_name","type":"str","level":"advanced","flags":1,"default_value":"device_health_metrics","min":"","max":"","enum_allowed":[],"desc":"name of pool in which to store device health metrics","long_desc":"","tags":[],"see_also":[]},"retention_period":{"name":"retention_period","type":"secs","level":"advanced","flags":1,"default_value":"15552000","min":"","max":"","enum_allowed":[],"desc":"how long to retain device health metrics","long_desc":"","tags":[],"see_also":[]},"scrape_frequency":{"name":"scrape_frequency","type":"secs","level":"advanced","flags":1,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"how frequently to scrape device health metrics","long_desc":"","tags":[],"see_also":[]},"self_heal":{"name":"self_heal","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"preemptively heal cluster around devices that may fail","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"how frequently to wake up and check device health","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"warn_threshold":{"name":"warn_threshold","type":"secs","level":"advanced","flags":1,"default_value":"7257600","min":"","max":"","enum_allowed":[],"desc":"raise health warning if OSD may fail before this long","long_desc":"","tags":[],"see_also":[]}}},{"name":"diskprediction_local","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predict_interval":{"name":"predict_interval","type":"str","level":"advanced","flags":0,"default_value":"86400","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"predictor_model":{"name":"predictor_model","type":"str","level":"advanced","flags":0,"default_value":"prophetstor","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"str","level":"advanced","flags":0,"default_value":"600","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"influx","can_run":false,"error_string":"influxdb python module not found","module_options":{"batch_size":{"name":"batch_size","type":"int","level":"advanced","flags":0,"default_value":"5000","min":"","max":"","enum_allowed":[],"desc":"How big batches of data points should be when sending to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"database":{"name":"database","type":"str","level":"advanced","flags":0,"default_value":"ceph","min":"","max":"","enum_allowed":[],"desc":"InfluxDB database name. You will need to create this database and grant write privileges to the configured username or the username must have admin privileges to create it.","long_desc":"","tags":[],"see_also":[]},"hostname":{"name":"hostname","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server hostname","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"30","min":"5","max":"","enum_allowed":[],"desc":"Time between reports to InfluxDB. Default 30 seconds.","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"password":{"name":"password","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"password of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"port":{"name":"port","type":"int","level":"advanced","flags":0,"default_value":"8086","min":"","max":"","enum_allowed":[],"desc":"InfluxDB server port","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"ssl":{"name":"ssl","type":"str","level":"advanced","flags":0,"default_value":"false","min":"","max":"","enum_allowed":[],"desc":"Use https connection for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]},"threads":{"name":"threads","type":"int","level":"advanced","flags":0,"default_value":"5","min":"1","max":"32","enum_allowed":[],"desc":"How many worker threads should be spawned for sending data to InfluxDB.","long_desc":"","tags":[],"see_also":[]},"username":{"name":"username","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"username of InfluxDB server user","long_desc":"","tags":[],"see_also":[]},"verify_ssl":{"name":"verify_ssl","type":"str","level":"advanced","flags":0,"default_value":"true","min":"","max":"","enum_allowed":[],"desc":"Verify https cert for InfluxDB server. Use \"true\" or \"false\".","long_desc":"","tags":[],"see_also":[]}}},{"name":"insights","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"iostat","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"localpool","can_run":true,"error_string":"","module_options":{"failure_domain":{"name":"failure_domain","type":"str","level":"advanced","flags":1,"default_value":"host","min":"","max":"","enum_allowed":[],"desc":"failure domain for any created local pool","long_desc":"what failure domain we should separate data replicas across.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"min_size":{"name":"min_size","type":"int","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"default min_size for any created local pool","long_desc":"value to set min_size to (unchanged from Ceph's default if this option is not set)","tags":[],"see_also":[]},"num_rep":{"name":"num_rep","type":"int","level":"advanced","flags":1,"default_value":"3","min":"","max":"","enum_allowed":[],"desc":"default replica count for any created local pool","long_desc":"","tags":[],"see_also":[]},"pg_num":{"name":"pg_num","type":"int","level":"advanced","flags":1,"default_value":"128","min":"","max":"","enum_allowed":[],"desc":"default pg_num for any created local pool","long_desc":"","tags":[],"see_also":[]},"prefix":{"name":"prefix","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"name prefix for any created local pool","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"subtree":{"name":"subtree","type":"str","level":"advanced","flags":1,"default_value":"rack","min":"","max":"","enum_allowed":[],"desc":"CRUSH level for which to create a local pool","long_desc":"which CRUSH subtree type the module should create a pool for.","tags":[],"see_also":[]}}},{"name":"mds_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"mirroring","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"nfs","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"orchestrator","can_run":true,"error_string":"","module_options":{"fail_fs":{"name":"fail_fs","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Fail filesystem for rapid multi-rank mds upgrade","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"orchestrator":{"name":"orchestrator","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["cephadm","rook","test_orchestrator"],"desc":"Orchestrator backend","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_perf_query","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"osd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"pg_autoscaler","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"threshold":{"name":"threshold","type":"float","level":"advanced","flags":0,"default_value":"3.0","min":"1.0","max":"","enum_allowed":[],"desc":"scaling threshold","long_desc":"The factor by which the `NEW PG_NUM` must vary from the current`PG_NUM` before being accepted. Cannot be less than 1.0","tags":[],"see_also":[]}}},{"name":"progress","can_run":true,"error_string":"","module_options":{"allow_pg_recovery_event":{"name":"allow_pg_recovery_event","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow the module to show pg recovery progress","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_completed_events":{"name":"max_completed_events","type":"int","level":"advanced","flags":1,"default_value":"50","min":"","max":"","enum_allowed":[],"desc":"number of past completed events to remember","long_desc":"","tags":[],"see_also":[]},"sleep_interval":{"name":"sleep_interval","type":"secs","level":"advanced","flags":1,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"how long the module is going to sleep","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"prometheus","can_run":true,"error_string":"","module_options":{"cache":{"name":"cache","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"exclude_perf_counters":{"name":"exclude_perf_counters","type":"bool","level":"advanced","flags":1,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Do not include perf-counters in the metrics output","long_desc":"Gathering perf-counters from a single Prometheus exporter can degrade ceph-mgr performance, especially in large clusters. Instead, Ceph-exporter daemons are now used by default for perf-counter gathering. This should only be disabled when no ceph-exporters are deployed.","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools":{"name":"rbd_stats_pools","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rbd_stats_pools_refresh_interval":{"name":"rbd_stats_pools_refresh_interval","type":"int","level":"advanced","flags":0,"default_value":"300","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"scrape_interval":{"name":"scrape_interval","type":"float","level":"advanced","flags":0,"default_value":"15.0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"::","min":"","max":"","enum_allowed":[],"desc":"the IPv4 or IPv6 address on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"int","level":"advanced","flags":1,"default_value":"9283","min":"","max":"","enum_allowed":[],"desc":"the port on which the module listens for HTTP requests","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"stale_cache_strategy":{"name":"stale_cache_strategy","type":"str","level":"advanced","flags":0,"default_value":"log","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_behaviour":{"name":"standby_behaviour","type":"str","level":"advanced","flags":1,"default_value":"default","min":"","max":"","enum_allowed":["default","error"],"desc":"","long_desc":"","tags":[],"see_also":[]},"standby_error_status_code":{"name":"standby_error_status_code","type":"int","level":"advanced","flags":1,"default_value":"500","min":"400","max":"599","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rbd_support","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_snap_create":{"name":"max_concurrent_snap_create","type":"int","level":"advanced","flags":0,"default_value":"10","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"mirror_snapshot_schedule":{"name":"mirror_snapshot_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"trash_purge_schedule":{"name":"trash_purge_schedule","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"restful","can_run":true,"error_string":"","module_options":{"enable_auth":{"name":"enable_auth","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"key_file":{"name":"key_file","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_requests":{"name":"max_requests","type":"int","level":"advanced","flags":0,"default_value":"500","min":"","max":"","enum_allowed":[],"desc":"Maximum number of requests to keep in memory. When new request comes in, the oldest request will be removed if the number of requests exceeds the max request number.if un-finished request is removed, error message will be logged in the ceph-mgr log.","long_desc":"","tags":[],"see_also":[]},"server_addr":{"name":"server_addr","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"server_port":{"name":"server_port","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rgw","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"secondary_zone_period_retry_limit":{"name":"secondary_zone_period_retry_limit","type":"int","level":"advanced","flags":0,"default_value":"5","min":"","max":"","enum_allowed":[],"desc":"RGW module period update retry limit for secondary site","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"rook","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"storage_class":{"name":"storage_class","type":"str","level":"advanced","flags":0,"default_value":"local","min":"","max":"","enum_allowed":[],"desc":"storage class name for LSO-discovered PVs","long_desc":"","tags":[],"see_also":[]}}},{"name":"selftest","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption1":{"name":"roption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"roption2":{"name":"roption2","type":"str","level":"advanced","flags":0,"default_value":"xyz","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption1":{"name":"rwoption1","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption2":{"name":"rwoption2","type":"int","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption3":{"name":"rwoption3","type":"float","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption4":{"name":"rwoption4","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption5":{"name":"rwoption5","type":"bool","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption6":{"name":"rwoption6","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"rwoption7":{"name":"rwoption7","type":"int","level":"advanced","flags":0,"default_value":"","min":"1","max":"42","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testkey":{"name":"testkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testlkey":{"name":"testlkey","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"testnewline":{"name":"testnewline","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"smb","can_run":true,"error_string":"","module_options":{"internal_store_backend":{"name":"internal_store_backend","type":"str","level":"dev","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"set internal store backend. for develoment and testing only","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"update_orchestration":{"name":"update_orchestration","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"automatically update orchestration when smb resources are changed","long_desc":"","tags":[],"see_also":[]}}},{"name":"snap_schedule","can_run":true,"error_string":"","module_options":{"allow_m_granularity":{"name":"allow_m_granularity","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"allow minute scheduled snapshots","long_desc":"","tags":[],"see_also":[]},"dump_on_update":{"name":"dump_on_update","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"dump database to debug log on update","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"stats","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"status","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telegraf","can_run":true,"error_string":"","module_options":{"address":{"name":"address","type":"str","level":"advanced","flags":0,"default_value":"unixgram:///tmp/telegraf.sock","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"15","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"telemetry","can_run":true,"error_string":"","module_options":{"channel_basic":{"name":"channel_basic","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share basic cluster information (size, version)","long_desc":"","tags":[],"see_also":[]},"channel_crash":{"name":"channel_crash","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share metadata about Ceph daemon crashes (version, stack straces, etc)","long_desc":"","tags":[],"see_also":[]},"channel_device":{"name":"channel_device","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Share device health metrics (e.g., SMART data, minus potentially identifying info like serial numbers)","long_desc":"","tags":[],"see_also":[]},"channel_ident":{"name":"channel_ident","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share a user-provided description and/or contact email for the cluster","long_desc":"","tags":[],"see_also":[]},"channel_perf":{"name":"channel_perf","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Share various performance metrics of a cluster","long_desc":"","tags":[],"see_also":[]},"contact":{"name":"contact","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"description":{"name":"description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"device_url":{"name":"device_url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/device","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"enabled":{"name":"enabled","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"int","level":"advanced","flags":0,"default_value":"24","min":"8","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"last_opt_revision":{"name":"last_opt_revision","type":"int","level":"advanced","flags":0,"default_value":"1","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard":{"name":"leaderboard","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"leaderboard_description":{"name":"leaderboard_description","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"organization":{"name":"organization","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"proxy":{"name":"proxy","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"url":{"name":"url","type":"str","level":"advanced","flags":0,"default_value":"https://telemetry.ceph.com/report","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"test_orchestrator","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"volumes","can_run":true,"error_string":"","module_options":{"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"max_concurrent_clones":{"name":"max_concurrent_clones","type":"int","level":"advanced","flags":0,"default_value":"4","min":"","max":"","enum_allowed":[],"desc":"Number of asynchronous cloner threads","long_desc":"","tags":[],"see_also":[]},"periodic_async_work":{"name":"periodic_async_work","type":"bool","level":"advanced","flags":0,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"Periodically check for async work","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_delay":{"name":"snapshot_clone_delay","type":"int","level":"advanced","flags":0,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"Delay clone begin operation by snapshot_clone_delay seconds","long_desc":"","tags":[],"see_also":[]},"snapshot_clone_no_wait":{"name":"snapshot_clone_no_wait","type":"bool","level":"advanced","flags":0,"default_value":"True","min":"","max":"","enum_allowed":[],"desc":"Reject subvolume clone request when cloner threads are busy","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}},{"name":"zabbix","can_run":true,"error_string":"","module_options":{"discovery_interval":{"name":"discovery_interval","type":"uint","level":"advanced","flags":0,"default_value":"100","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"identifier":{"name":"identifier","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"interval":{"name":"interval","type":"secs","level":"advanced","flags":0,"default_value":"60","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_level":{"name":"log_level","type":"str","level":"advanced","flags":1,"default_value":"","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster":{"name":"log_to_cluster","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_cluster_level":{"name":"log_to_cluster_level","type":"str","level":"advanced","flags":1,"default_value":"info","min":"","max":"","enum_allowed":["","critical","debug","error","info","warning"],"desc":"","long_desc":"","tags":[],"see_also":[]},"log_to_file":{"name":"log_to_file","type":"bool","level":"advanced","flags":1,"default_value":"False","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"sqlite3_killpoint":{"name":"sqlite3_killpoint","type":"int","level":"dev","flags":1,"default_value":"0","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_host":{"name":"zabbix_host","type":"str","level":"advanced","flags":0,"default_value":"","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_port":{"name":"zabbix_port","type":"int","level":"advanced","flags":0,"default_value":"10051","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]},"zabbix_sender":{"name":"zabbix_sender","type":"str","level":"advanced","flags":0,"default_value":"/usr/bin/zabbix_sender","min":"","max":"","enum_allowed":[],"desc":"","long_desc":"","tags":[],"see_also":[]}}}],"services":{},"always_on_modules":{"octopus":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"pacific":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"quincy":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"reef":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"],"squid":["balancer","crash","devicehealth","orchestrator","pg_autoscaler","progress","rbd_support","status","telemetry","volumes"]},"last_failure_osd_epoch":0,"active_clients":[{"name":"devicehealth","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":2899104583}]},{"name":"libcephsqlite","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":1522460738}]},{"name":"rbd_support","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":4232745186}]},{"name":"volumes","addrvec":[{"type":"v2","addr":"172.21.15.102:0","nonce":3948604610}]}]} 2024-09-19T11:13:21.949 INFO:tasks.ceph.ceph_manager.ceph:mgr available! 2024-09-19T11:13:21.949 INFO:tasks.ceph.ceph_manager.ceph:waiting for all up 2024-09-19T11:13:21.949 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T11:13:22.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.049+0000 7f338aab0640 1 Processor -- start 2024-09-19T11:13:22.050 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.049+0000 7f338aab0640 1 -- start start 2024-09-19T11:13:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.049+0000 7f338aab0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f338406eaa0 0x7f33841326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.049+0000 7f338aab0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3384071660 con 0x7f338406dfb0 2024-09-19T11:13:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.049+0000 7f338aab0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3384072550 con 0x7f338406eaa0 2024-09-19T11:13:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.049+0000 7f3383fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f338406eaa0 0x7f33841326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.049+0000 7f338884c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f338406dfb0 0x7f338406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37788/0 (socket says 172.21.15.37:37788) 2024-09-19T11:13:22.051 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.049+0000 7f338884c640 1 -- 172.21.15.37:0/2683847535 learned_addr learned my addr 172.21.15.37:0/2683847535 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.050+0000 7f3383fff640 1 -- 172.21.15.37:0/2683847535 >> v1:172.21.15.37:6789/0 conn(0x7f338406dfb0 legacy=0x7f338406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.052 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.050+0000 7f3383fff640 1 -- 172.21.15.37:0/2683847535 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3384099e20 con 0x7f338406eaa0 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.050+0000 7f3383fff640 1 --2- 172.21.15.37:0/2683847535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406eaa0 0x7f33841326d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3370009720 tx=0x7f337002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ba7f6d0b1da53451 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.050+0000 7f33837fe640 1 -- 172.21.15.37:0/2683847535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3370037070 con 0x7f338406eaa0 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f33837fe640 1 -- 172.21.15.37:0/2683847535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f337002ae20 con 0x7f338406eaa0 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f33837fe640 1 -- 172.21.15.37:0/2683847535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3370032590 con 0x7f338406eaa0 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f338aab0640 1 -- 172.21.15.37:0/2683847535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406eaa0 msgr2=0x7f33841326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f338aab0640 1 --2- 172.21.15.37:0/2683847535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406eaa0 0x7f33841326d0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x7f3370009720 tx=0x7f337002a1a0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f338aab0640 1 -- 172.21.15.37:0/2683847535 shutdown_connections 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f338aab0640 1 --2- 172.21.15.37:0/2683847535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406eaa0 0x7f33841326d0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f338aab0640 1 -- 172.21.15.37:0/2683847535 >> 172.21.15.37:0/2683847535 conn(0x7f338409abc0 msgr2=0x7f3384098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f338aab0640 1 -- 172.21.15.37:0/2683847535 shutdown_connections 2024-09-19T11:13:22.053 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.051+0000 7f338aab0640 1 -- 172.21.15.37:0/2683847535 wait complete. 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.052+0000 7f338aab0640 1 Processor -- start 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.052+0000 7f338aab0640 1 -- start start 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338aab0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406dfb0 0x7f33841299e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338aab0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f33840712d0 con 0x7f338406dfb0 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338884c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406dfb0 0x7f33841299e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338884c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406dfb0 0x7f33841299e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47560/0 (socket says 172.21.15.37:47560) 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338884c640 1 -- 172.21.15.37:0/1873440656 learned_addr learned my addr 172.21.15.37:0/1873440656 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338884c640 1 -- 172.21.15.37:0/1873440656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3384128380 con 0x7f338406dfb0 2024-09-19T11:13:22.055 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338884c640 1 --2- 172.21.15.37:0/1873440656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406dfb0 0x7f33841299e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f337800c480 tx=0x7f337800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f33817fa640 1 -- 172.21.15.37:0/1873440656 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3378017070 con 0x7f338406dfb0 2024-09-19T11:13:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f33817fa640 1 -- 172.21.15.37:0/1873440656 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3378005c10 con 0x7f338406dfb0 2024-09-19T11:13:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3384129460 con 0x7f338406dfb0 2024-09-19T11:13:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f33817fa640 1 -- 172.21.15.37:0/1873440656 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3378007070 con 0x7f338406dfb0 2024-09-19T11:13:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.053+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3384129f20 con 0x7f338406dfb0 2024-09-19T11:13:22.056 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.054+0000 7f33817fa640 1 -- 172.21.15.37:0/1873440656 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f337801a070 con 0x7f338406dfb0 2024-09-19T11:13:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.054+0000 7f33817fa640 1 --2- 172.21.15.37:0/1873440656 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f336803e710 0x7f3368040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.054+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f33841271d0 con 0x7f338406dfb0 2024-09-19T11:13:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.054+0000 7f33817fa640 1 -- 172.21.15.37:0/1873440656 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f3378051f80 con 0x7f338406dfb0 2024-09-19T11:13:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.055+0000 7f3383fff640 1 --2- 172.21.15.37:0/1873440656 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f336803e710 0x7f3368040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.057 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.055+0000 7f3383fff640 1 --2- 172.21.15.37:0/1873440656 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f336803e710 0x7f3368040bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3370034000 tx=0x7f337002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.060 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.059+0000 7f33817fa640 1 -- 172.21.15.37:0/1873440656 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f337801ac60 con 0x7f338406dfb0 2024-09-19T11:13:22.248 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.247+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f3384127780 con 0x7f338406dfb0 2024-09-19T11:13:22.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.248+0000 7f33817fa640 1 -- 172.21.15.37:0/1873440656 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+9890 (secure 0 0 0) 0x7f3378019cd0 con 0x7f338406dfb0 2024-09-19T11:13:22.249 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:13:22.249 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"ea40044b-acee-4485-a78a-0f4c700e12ca","created":"2024-09-19T11:13:02.138535+0000","modified":"2024-09-19T11:13:21.248276+0000","last_up_change":"2024-09-19T11:13:13.212621+0000","last_in_change":"2024-09-19T11:13:03.266089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T11:13:14.523581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T11:13:17.782082+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e66bdbac-cb32-42b2-ba97-3f71c62b28d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6801","nonce":394652614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6803","nonce":394652614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6807","nonce":394652614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6805","nonce":394652614}]},"public_addr":"172.21.15.37:6801/394652614","cluster_addr":"172.21.15.37:6803/394652614","heartbeat_back_addr":"172.21.15.37:6807/394652614","heartbeat_front_addr":"172.21.15.37:6805/394652614","state":["exists","up"]},{"osd":1,"uuid":"409932a6-2604-46e6-9f50-587cd693a846","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6817","nonce":3609322588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6819","nonce":3609322588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6823","nonce":3609322588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6821","nonce":3609322588}]},"public_addr":"172.21.15.102:6817/3609322588","cluster_addr":"172.21.15.102:6819/3609322588","heartbeat_back_addr":"172.21.15.102:6823/3609322588","heartbeat_front_addr":"172.21.15.102:6821/3609322588","state":["exists","up"]},{"osd":2,"uuid":"4fb4fb22-028c-4cc7-a259-ac630af33e99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6809","nonce":525557096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6811","nonce":525557096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6815","nonce":525557096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6813","nonce":525557096}]},"public_addr":"172.21.15.102:6809/525557096","cluster_addr":"172.21.15.102:6811/525557096","heartbeat_back_addr":"172.21.15.102:6815/525557096","heartbeat_front_addr":"172.21.15.102:6813/525557096","state":["exists","up"]},{"osd":3,"uuid":"e0242238-a3ce-4288-93eb-e2aafa589662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6801","nonce":3957239017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6803","nonce":3957239017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6807","nonce":3957239017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6805","nonce":3957239017}]},"public_addr":"172.21.15.102:6801/3957239017","cluster_addr":"172.21.15.102:6803/3957239017","heartbeat_back_addr":"172.21.15.102:6807/3957239017","heartbeat_front_addr":"172.21.15.102:6805/3957239017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:08.941516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.998554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.777857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.565216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:13:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f336803e710 msgr2=0x7f3368040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 --2- 172.21.15.37:0/1873440656 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f336803e710 0x7f3368040bd0 secure :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0x7f3370034000 tx=0x7f337002e000 comp rx=0 tx=0).stop 2024-09-19T11:13:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406dfb0 msgr2=0x7f33841299e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 --2- 172.21.15.37:0/1873440656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406dfb0 0x7f33841299e0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f337800c480 tx=0x7f337800c940 comp rx=0 tx=0).stop 2024-09-19T11:13:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 shutdown_connections 2024-09-19T11:13:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 --2- 172.21.15.37:0/1873440656 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f336803e710 0x7f3368040bd0 unknown :-1 s=CLOSED pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 --2- 172.21.15.37:0/1873440656 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f338406dfb0 0x7f33841299e0 unknown :-1 s=CLOSED pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 >> 172.21.15.37:0/1873440656 conn(0x7f338409abc0 msgr2=0x7f338412e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 shutdown_connections 2024-09-19T11:13:22.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.250+0000 7f338aab0640 1 -- 172.21.15.37:0/1873440656 wait complete. 2024-09-19T11:13:22.262 INFO:tasks.ceph.ceph_manager.ceph:all up! 2024-09-19T11:13:22.262 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.362+0000 7f9dac69b640 1 Processor -- start 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.362+0000 7f9dac69b640 1 -- start start 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.362+0000 7f9dac69b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9da412cba0 0x7f9da41315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.362+0000 7f9dac69b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9da409a290 con 0x7f9da412c0b0 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.362+0000 7f9dac69b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9da4071860 con 0x7f9da412cba0 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.363+0000 7f9da9c36640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9da412cba0 0x7f9da41315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.363+0000 7f9daa437640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9da412c0b0 0x7f9da412c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37804/0 (socket says 172.21.15.37:37804) 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.363+0000 7f9daa437640 1 -- 172.21.15.37:0/1844178704 learned_addr learned my addr 172.21.15.37:0/1844178704 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:22.364 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.363+0000 7f9da9c36640 1 -- 172.21.15.37:0/1844178704 >> v1:172.21.15.37:6789/0 conn(0x7f9da412c0b0 legacy=0x7f9da412c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.365 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.363+0000 7f9da9c36640 1 -- 172.21.15.37:0/1844178704 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da4099e20 con 0x7f9da412cba0 2024-09-19T11:13:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.363+0000 7f9da9c36640 1 --2- 172.21.15.37:0/1844178704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412cba0 0x7f9da41315e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009750 tx=0x7f9d9402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=271e7d0768cba618 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9da9435640 1 -- 172.21.15.37:0/1844178704 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d94037070 con 0x7f9da412cba0 2024-09-19T11:13:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9da9435640 1 -- 172.21.15.37:0/1844178704 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9d9402ad80 con 0x7f9da412cba0 2024-09-19T11:13:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9da9435640 1 -- 172.21.15.37:0/1844178704 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9d94032590 con 0x7f9da412cba0 2024-09-19T11:13:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9dac69b640 1 -- 172.21.15.37:0/1844178704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412cba0 msgr2=0x7f9da41315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9dac69b640 1 --2- 172.21.15.37:0/1844178704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412cba0 0x7f9da41315e0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x7f9d94009750 tx=0x7f9d9402a140 comp rx=0 tx=0).stop 2024-09-19T11:13:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9dac69b640 1 -- 172.21.15.37:0/1844178704 shutdown_connections 2024-09-19T11:13:22.366 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9dac69b640 1 --2- 172.21.15.37:0/1844178704 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412cba0 0x7f9da41315e0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9dac69b640 1 -- 172.21.15.37:0/1844178704 >> 172.21.15.37:0/1844178704 conn(0x7f9da409abc0 msgr2=0x7f9da4098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9dac69b640 1 -- 172.21.15.37:0/1844178704 shutdown_connections 2024-09-19T11:13:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.364+0000 7f9dac69b640 1 -- 172.21.15.37:0/1844178704 wait complete. 2024-09-19T11:13:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.365+0000 7f9dac69b640 1 Processor -- start 2024-09-19T11:13:22.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.365+0000 7f9dac69b640 1 -- start start 2024-09-19T11:13:22.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.365+0000 7f9dac69b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412c0b0 0x7f9da4097b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.365+0000 7f9dac69b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9da4070c40 con 0x7f9da412c0b0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9daa437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412c0b0 0x7f9da4097b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9daa437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412c0b0 0x7f9da4097b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47584/0 (socket says 172.21.15.37:47584) 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9daa437640 1 -- 172.21.15.37:0/1045951204 learned_addr learned my addr 172.21.15.37:0/1045951204 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9daa437640 1 -- 172.21.15.37:0/1045951204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9da41297f0 con 0x7f9da412c0b0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9daa437640 1 --2- 172.21.15.37:0/1045951204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412c0b0 0x7f9da4097b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9da000c480 tx=0x7f9da000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9d9affd640 1 -- 172.21.15.37:0/1045951204 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da0017070 con 0x7f9da412c0b0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9d9affd640 1 -- 172.21.15.37:0/1045951204 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9da0005c10 con 0x7f9da412c0b0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9d9affd640 1 -- 172.21.15.37:0/1045951204 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9da0007070 con 0x7f9da412c0b0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9da4126ee0 con 0x7f9da412c0b0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.366+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9da4127210 con 0x7f9da412c0b0 2024-09-19T11:13:22.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.367+0000 7f9d9affd640 1 -- 172.21.15.37:0/1045951204 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9da001a070 con 0x7f9da412c0b0 2024-09-19T11:13:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.367+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9da412c490 con 0x7f9da412c0b0 2024-09-19T11:13:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.367+0000 7f9d9affd640 1 --2- 172.21.15.37:0/1045951204 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9d8803e760 0x7f9d88040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.367+0000 7f9d9affd640 1 -- 172.21.15.37:0/1045951204 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f9da0052020 con 0x7f9da412c0b0 2024-09-19T11:13:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.368+0000 7f9da9c36640 1 --2- 172.21.15.37:0/1045951204 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9d8803e760 0x7f9d88040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.368+0000 7f9da9c36640 1 --2- 172.21.15.37:0/1045951204 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9d8803e760 0x7f9d88040c20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9d94034000 tx=0x7f9d9402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.372+0000 7f9d9affd640 1 -- 172.21.15.37:0/1045951204 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f9da001ac60 con 0x7f9da412c0b0 2024-09-19T11:13:22.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.558+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7f9da4050ee0 con 0x7f9da412c0b0 2024-09-19T11:13:22.559 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.558+0000 7f9d9affd640 1 -- 172.21.15.37:0/1045951204 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v19) ==== 74+0+9890 (secure 0 0 0) 0x7f9da0050e30 con 0x7f9da412c0b0 2024-09-19T11:13:22.560 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:13:22.560 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":19,"fsid":"ea40044b-acee-4485-a78a-0f4c700e12ca","created":"2024-09-19T11:13:02.138535+0000","modified":"2024-09-19T11:13:21.248276+0000","last_up_change":"2024-09-19T11:13:13.212621+0000","last_in_change":"2024-09-19T11:13:03.266089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":5,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":2,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"jewel","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T11:13:14.523581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T11:13:17.782082+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e66bdbac-cb32-42b2-ba97-3f71c62b28d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6801","nonce":394652614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6803","nonce":394652614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6807","nonce":394652614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6805","nonce":394652614}]},"public_addr":"172.21.15.37:6801/394652614","cluster_addr":"172.21.15.37:6803/394652614","heartbeat_back_addr":"172.21.15.37:6807/394652614","heartbeat_front_addr":"172.21.15.37:6805/394652614","state":["exists","up"]},{"osd":1,"uuid":"409932a6-2604-46e6-9f50-587cd693a846","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":13,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6817","nonce":3609322588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6819","nonce":3609322588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6823","nonce":3609322588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6821","nonce":3609322588}]},"public_addr":"172.21.15.102:6817/3609322588","cluster_addr":"172.21.15.102:6819/3609322588","heartbeat_back_addr":"172.21.15.102:6823/3609322588","heartbeat_front_addr":"172.21.15.102:6821/3609322588","state":["exists","up"]},{"osd":2,"uuid":"4fb4fb22-028c-4cc7-a259-ac630af33e99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6809","nonce":525557096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6811","nonce":525557096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6815","nonce":525557096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6813","nonce":525557096}]},"public_addr":"172.21.15.102:6809/525557096","cluster_addr":"172.21.15.102:6811/525557096","heartbeat_back_addr":"172.21.15.102:6815/525557096","heartbeat_front_addr":"172.21.15.102:6813/525557096","state":["exists","up"]},{"osd":3,"uuid":"e0242238-a3ce-4288-93eb-e2aafa589662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":16,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6801","nonce":3957239017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6803","nonce":3957239017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6807","nonce":3957239017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6805","nonce":3957239017}]},"public_addr":"172.21.15.102:6801/3957239017","cluster_addr":"172.21.15.102:6803/3957239017","heartbeat_back_addr":"172.21.15.102:6807/3957239017","heartbeat_front_addr":"172.21.15.102:6805/3957239017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:08.941516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.998554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.777857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.565216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_removed_snaps":[{"pool":2,"snaps":[{"begin":2,"length":1}]}],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:13:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9d8803e760 msgr2=0x7f9d88040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 --2- 172.21.15.37:0/1045951204 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9d8803e760 0x7f9d88040c20 secure :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0x7f9d94034000 tx=0x7f9d9402e000 comp rx=0 tx=0).stop 2024-09-19T11:13:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412c0b0 msgr2=0x7f9da4097b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.562 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 --2- 172.21.15.37:0/1045951204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412c0b0 0x7f9da4097b50 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7f9da000c480 tx=0x7f9da000c940 comp rx=0 tx=0).stop 2024-09-19T11:13:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 shutdown_connections 2024-09-19T11:13:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 --2- 172.21.15.37:0/1045951204 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9d8803e760 0x7f9d88040c20 unknown :-1 s=CLOSED pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 --2- 172.21.15.37:0/1045951204 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9da412c0b0 0x7f9da4097b50 unknown :-1 s=CLOSED pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 >> 172.21.15.37:0/1045951204 conn(0x7f9da409abc0 msgr2=0x7f9da4071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 shutdown_connections 2024-09-19T11:13:22.563 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.561+0000 7f9dac69b640 1 -- 172.21.15.37:0/1045951204 wait complete. 2024-09-19T11:13:22.573 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 flush_pg_stats 2024-09-19T11:13:22.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 flush_pg_stats 2024-09-19T11:13:22.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 flush_pg_stats 2024-09-19T11:13:22.574 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 flush_pg_stats 2024-09-19T11:13:22.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.680+0000 7f8bbbf64640 1 Processor -- start 2024-09-19T11:13:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.680+0000 7fb332fa1640 1 Processor -- start 2024-09-19T11:13:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.680+0000 7f7996add640 1 Processor -- start 2024-09-19T11:13:22.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.680+0000 7f0636452640 1 Processor -- start 2024-09-19T11:13:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.680+0000 7f8bbbf64640 1 -- start start 2024-09-19T11:13:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.680+0000 7f7996add640 1 -- start start 2024-09-19T11:13:22.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.680+0000 7fb332fa1640 1 -- start start 2024-09-19T11:13:22.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.680+0000 7f0636452640 1 -- start start 2024-09-19T11:13:22.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f7996add640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f799012c0b0 0x7f799012c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f7996add640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7990099e20 con 0x7f799012c9d0 2024-09-19T11:13:22.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f7996add640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f79900715a0 con 0x7f799012c0b0 2024-09-19T11:13:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7fb332fa1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fb32c12bf50 0x7fb32c12c330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7fb332fa1640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fb32c0703d0 con 0x7fb32c12c870 2024-09-19T11:13:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7fb332fa1640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fb32c09cee0 con 0x7fb32c12bf50 2024-09-19T11:13:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7fb33179e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fb32c12c870 0x7fb32c097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37820/0 (socket says 172.21.15.37:37820) 2024-09-19T11:13:22.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7fb33179e640 1 -- 172.21.15.37:0/192432575 learned_addr learned my addr 172.21.15.37:0/192432575 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f8bbbf64640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8bb412cba0 0x7f8bb41315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f8bb9d00640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8bb412c0b0 0x7f8bb412c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37836/0 (socket says 172.21.15.37:37836) 2024-09-19T11:13:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f8bb9d00640 1 -- 172.21.15.37:0/3546512981 learned_addr learned my addr 172.21.15.37:0/3546512981 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f8bbbf64640 1 -- 172.21.15.37:0/3546512981 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8bb4099e20 con 0x7f8bb412c0b0 2024-09-19T11:13:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f8bb94ff640 1 --2- 172.21.15.37:0/3546512981 >> v2:172.21.15.37:3300/0 conn(0x7f8bb412cba0 0x7f8bb41315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f8bbbf64640 1 -- 172.21.15.37:0/3546512981 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8bb40715a0 con 0x7f8bb412cba0 2024-09-19T11:13:22.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f798ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f799012c9d0 0x7f7990097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37816/0 (socket says 172.21.15.37:37816) 2024-09-19T11:13:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f798ffff640 1 -- 172.21.15.37:0/931788138 learned_addr learned my addr 172.21.15.37:0/931788138 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f7994879640 1 --2- 172.21.15.37:0/931788138 >> v2:172.21.15.37:3300/0 conn(0x7f799012c0b0 0x7f799012c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f0636452640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f063009b4a0 0x7f063009b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f0636452640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f06300706a0 con 0x7f063009bdc0 2024-09-19T11:13:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f0636452640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f063009f400 con 0x7f063009b4a0 2024-09-19T11:13:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f062f7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f063009bdc0 0x7f063006efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37842/0 (socket says 172.21.15.37:37842) 2024-09-19T11:13:22.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f062f7fe640 1 -- 172.21.15.37:0/676339621 learned_addr learned my addr 172.21.15.37:0/676339621 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f798f7fe640 1 -- 172.21.15.37:0/931788138 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3788915865 0 0) 0x7f7990099e20 con 0x7f799012c9d0 2024-09-19T11:13:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7f798f7fe640 1 -- 172.21.15.37:0/931788138 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7980003520 con 0x7f799012c9d0 2024-09-19T11:13:22.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2687704607 0 0) 0x7fb32c0703d0 con 0x7fb32c12c870 2024-09-19T11:13:22.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fb318003520 con 0x7fb32c12c870 2024-09-19T11:13:22.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.681+0000 7fb331f9f640 1 --2- 172.21.15.37:0/192432575 >> v2:172.21.15.37:3300/0 conn(0x7fb32c12bf50 0x7fb32c12c330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f8bb94ff640 1 -- 172.21.15.37:0/3546512981 >> v1:172.21.15.37:6789/0 conn(0x7f8bb412c0b0 legacy=0x7f8bb412c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f8bb94ff640 1 -- 172.21.15.37:0/3546512981 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb40705b0 con 0x7f8bb412cba0 2024-09-19T11:13:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062ffff640 1 --2- 172.21.15.37:0/676339621 >> v2:172.21.15.37:3300/0 conn(0x7f063009b4a0 0x7f063009b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 259644153 0 0) 0x7fb318003520 con 0x7fb32c12c870 2024-09-19T11:13:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 >> v2:172.21.15.37:3300/0 conn(0x7fb32c12bf50 msgr2=0x7fb32c12c330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T11:13:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb330f9d640 1 --2- 172.21.15.37:0/192432575 >> v2:172.21.15.37:3300/0 conn(0x7fb32c12bf50 0x7fb32c12c330 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c0712c0 con 0x7fb32c12c870 2024-09-19T11:13:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 4068826855 0 0) 0x7fb31c001620 con 0x7fb32c12c870 2024-09-19T11:13:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 >> v1:172.21.15.37:6789/0 conn(0x7fb32c12c870 legacy=0x7fb32c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb330f9d640 1 --2- 172.21.15.37:0/192432575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb318003e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.691 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c09cee0 con 0x7fb318003a50 2024-09-19T11:13:22.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 886437529 0 0) 0x7f06300706a0 con 0x7f063009bdc0 2024-09-19T11:13:22.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0618003520 con 0x7f063009bdc0 2024-09-19T11:13:22.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f7994879640 1 -- 172.21.15.37:0/931788138 >> v1:172.21.15.37:6789/0 conn(0x7f799012c9d0 legacy=0x7f7990097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f7994879640 1 -- 172.21.15.37:0/931788138 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f79900705b0 con 0x7f799012c0b0 2024-09-19T11:13:22.692 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f798f7fe640 1 -- 172.21.15.37:0/931788138 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 3060567837 0 0) 0x7f7980003520 con 0x7f799012c9d0 2024-09-19T11:13:22.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 1627090420 0 0) 0x7f0618003520 con 0x7f063009bdc0 2024-09-19T11:13:22.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 >> v2:172.21.15.37:3300/0 conn(0x7f063009b4a0 msgr2=0x7f063009b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T11:13:22.693 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 --2- 172.21.15.37:0/676339621 >> v2:172.21.15.37:3300/0 conn(0x7f063009b4a0 0x7f063009b880 unknown :-1 s=AUTH_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7fb331f9f640 1 --2- 172.21.15.37:0/192432575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb318003e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 --> v1:172.21.15.37:6789/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063009f950 con 0x7f063009bdc0 2024-09-19T11:13:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 <== mon.0 v1:172.21.15.37:6789/0 3 ==== mon_map magic: 0 ==== 205+0+0 (unknown 4068826855 0 0) 0x7f0624001620 con 0x7f063009bdc0 2024-09-19T11:13:22.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 >> v1:172.21.15.37:6789/0 conn(0x7f063009bdc0 legacy=0x7f063006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f8bb94ff640 1 --2- 172.21.15.37:0/3546512981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412cba0 0x7f8bb41315e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009750 tx=0x7f8ba402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec6684afcb8bedda server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.682+0000 7f062effd640 1 --2- 172.21.15.37:0/676339621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f0618003ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f063009f400 con 0x7f0618003aa0 2024-09-19T11:13:22.695 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7fb331f9f640 1 -- 172.21.15.37:0/192432575 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb318003520 con 0x7fb318003a50 2024-09-19T11:13:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f8bb8cfe640 1 -- 172.21.15.37:0/3546512981 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba4037070 con 0x7f8bb412cba0 2024-09-19T11:13:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f062ffff640 1 --2- 172.21.15.37:0/676339621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f0618003ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f8bb8cfe640 1 -- 172.21.15.37:0/3546512981 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ba402ad80 con 0x7f8bb412cba0 2024-09-19T11:13:22.696 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f8bb8cfe640 1 -- 172.21.15.37:0/3546512981 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ba4032590 con 0x7f8bb412cba0 2024-09-19T11:13:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f7994879640 1 --2- 172.21.15.37:0/931788138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f799012c490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f798400b9f0 tx=0x7f798402c7a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=801df986df5c4356 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f062ffff640 1 -- 172.21.15.37:0/676339621 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0618003520 con 0x7f0618003aa0 2024-09-19T11:13:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f798f7fe640 1 -- 172.21.15.37:0/931788138 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f797c001620 con 0x7f799012c0b0 2024-09-19T11:13:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f798f7fe640 1 -- 172.21.15.37:0/931788138 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7984031510 con 0x7f799012c0b0 2024-09-19T11:13:22.697 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7f798f7fe640 1 -- 172.21.15.37:0/931788138 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7984031810 con 0x7f799012c0b0 2024-09-19T11:13:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.683+0000 7fb331f9f640 1 --2- 172.21.15.37:0/192432575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb318003e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb328009a40 tx=0x7fb318005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=43e802175a23abe6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb328036070 con 0x7fb318003a50 2024-09-19T11:13:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb328031530 con 0x7fb318003a50 2024-09-19T11:13:22.698 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7fb330f9d640 1 -- 172.21.15.37:0/192432575 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb328009690 con 0x7fb318003a50 2024-09-19T11:13:22.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f8bbbf64640 1 -- 172.21.15.37:0/3546512981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412cba0 msgr2=0x7f8bb41315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f8bbbf64640 1 --2- 172.21.15.37:0/3546512981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412cba0 0x7f8bb41315e0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009750 tx=0x7f8ba402a140 comp rx=0 tx=0).stop 2024-09-19T11:13:22.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f8bbbf64640 1 -- 172.21.15.37:0/3546512981 shutdown_connections 2024-09-19T11:13:22.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f8bbbf64640 1 --2- 172.21.15.37:0/3546512981 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412cba0 0x7f8bb41315e0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.699 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f8bbbf64640 1 -- 172.21.15.37:0/3546512981 >> 172.21.15.37:0/3546512981 conn(0x7f8bb409abc0 msgr2=0x7f8bb4098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f7996add640 1 -- 172.21.15.37:0/931788138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 msgr2=0x7f799012c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f7996add640 1 --2- 172.21.15.37:0/931788138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f799012c490 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f798400b9f0 tx=0x7f798402c7a0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f7996add640 1 -- 172.21.15.37:0/931788138 shutdown_connections 2024-09-19T11:13:22.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f7996add640 1 --2- 172.21.15.37:0/931788138 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f799012c490 unknown :-1 s=CLOSED pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f7996add640 1 -- 172.21.15.37:0/931788138 >> 172.21.15.37:0/931788138 conn(0x7f799009abc0 msgr2=0x7f7990098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f8bbbf64640 1 -- 172.21.15.37:0/3546512981 shutdown_connections 2024-09-19T11:13:22.700 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f8bbbf64640 1 -- 172.21.15.37:0/3546512981 wait complete. 2024-09-19T11:13:22.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f7996add640 1 -- 172.21.15.37:0/931788138 shutdown_connections 2024-09-19T11:13:22.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f7996add640 1 -- 172.21.15.37:0/931788138 wait complete. 2024-09-19T11:13:22.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7f062ffff640 1 --2- 172.21.15.37:0/676339621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f0618003ea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f062000b9b0 tx=0x7f0618005830 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4e98bd3560fa692f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.701 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7fb332fa1640 1 -- 172.21.15.37:0/192432575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 msgr2=0x7fb318003e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.684+0000 7fb332fa1640 1 --2- 172.21.15.37:0/192432575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb318003e50 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7fb328009a40 tx=0x7fb318005830 comp rx=0 tx=0).stop 2024-09-19T11:13:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7fb332fa1640 1 -- 172.21.15.37:0/192432575 shutdown_connections 2024-09-19T11:13:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7fb332fa1640 1 --2- 172.21.15.37:0/192432575 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb318003e50 unknown :-1 s=CLOSED pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7fb332fa1640 1 --2- 172.21.15.37:0/192432575 >> v2:172.21.15.37:3300/0 conn(0x7fb32c12bf50 0x7fb32c12c330 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7fb332fa1640 1 -- 172.21.15.37:0/192432575 >> 172.21.15.37:0/192432575 conn(0x7fb32c09a860 msgr2=0x7fb32c09ac70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0620038070 con 0x7f0618003aa0 2024-09-19T11:13:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0620033540 con 0x7f0618003aa0 2024-09-19T11:13:22.702 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f062effd640 1 -- 172.21.15.37:0/676339621 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f062000b600 con 0x7f0618003aa0 2024-09-19T11:13:22.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7fb332fa1640 1 -- 172.21.15.37:0/192432575 shutdown_connections 2024-09-19T11:13:22.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7fb332fa1640 1 -- 172.21.15.37:0/192432575 wait complete. 2024-09-19T11:13:22.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f7996add640 1 Processor -- start 2024-09-19T11:13:22.703 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f7996add640 1 -- start start 2024-09-19T11:13:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f0636452640 1 -- 172.21.15.37:0/676339621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 msgr2=0x7f0618003ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f0636452640 1 --2- 172.21.15.37:0/676339621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f0618003ea0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f062000b9b0 tx=0x7f0618005830 comp rx=0 tx=0).stop 2024-09-19T11:13:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f0636452640 1 -- 172.21.15.37:0/676339621 shutdown_connections 2024-09-19T11:13:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f0636452640 1 --2- 172.21.15.37:0/676339621 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f0618003ea0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f0636452640 1 --2- 172.21.15.37:0/676339621 >> v2:172.21.15.37:3300/0 conn(0x7f063009b4a0 0x7f063009b880 unknown :-1 s=CLOSED pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.685+0000 7f0636452640 1 -- 172.21.15.37:0/676339621 >> 172.21.15.37:0/676339621 conn(0x7f06300a25b0 msgr2=0x7f063009ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.704 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f0636452640 1 -- 172.21.15.37:0/676339621 shutdown_connections 2024-09-19T11:13:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f0636452640 1 -- 172.21.15.37:0/676339621 wait complete. 2024-09-19T11:13:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f8bbbf64640 1 Processor -- start 2024-09-19T11:13:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f7996add640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f79901bfb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f7996add640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f799012ce60 con 0x7f799012c0b0 2024-09-19T11:13:22.705 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f8bbbf64640 1 -- start start 2024-09-19T11:13:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f7994879640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f79901bfb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f7994879640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f79901bfb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47662/0 (socket says 172.21.15.37:47662) 2024-09-19T11:13:22.706 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f7994879640 1 -- 172.21.15.37:0/3645070361 learned_addr learned my addr 172.21.15.37:0/3645070361 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7fb332fa1640 1 Processor -- start 2024-09-19T11:13:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7fb332fa1640 1 -- start start 2024-09-19T11:13:22.707 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f7994879640 1 -- 172.21.15.37:0/3645070361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7990129600 con 0x7f799012c0b0 2024-09-19T11:13:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f8bbbf64640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412c0b0 0x7f8bb41bc9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.686+0000 7f8bbbf64640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8bb406dfb0 con 0x7f8bb412c0b0 2024-09-19T11:13:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8bb9d00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412c0b0 0x7f8bb41bc9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8bb9d00640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412c0b0 0x7f8bb41bc9a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47668/0 (socket says 172.21.15.37:47668) 2024-09-19T11:13:22.708 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8bb9d00640 1 -- 172.21.15.37:0/1310198864 learned_addr learned my addr 172.21.15.37:0/1310198864 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7fb332fa1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb32c127080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.709 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f0636452640 1 Processor -- start 2024-09-19T11:13:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7fb332fa1640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fb32c0709d0 con 0x7fb318003a50 2024-09-19T11:13:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7fb331f9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb32c127080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7fb331f9f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb32c127080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47676/0 (socket says 172.21.15.37:47676) 2024-09-19T11:13:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7fb331f9f640 1 -- 172.21.15.37:0/1958760082 learned_addr learned my addr 172.21.15.37:0/1958760082 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8bb9d00640 1 -- 172.21.15.37:0/1310198864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8bb4127ee0 con 0x7f8bb412c0b0 2024-09-19T11:13:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7fb331f9f640 1 -- 172.21.15.37:0/1958760082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fb32c132c60 con 0x7fb318003a50 2024-09-19T11:13:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f0636452640 1 -- start start 2024-09-19T11:13:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8bb9d00640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412c0b0 0x7f8bb41bc9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000c480 tx=0x7f8bb000c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f7994879640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f79901bfb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f798400bb10 tx=0x7f79840046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb0017070 con 0x7f8bb412c0b0 2024-09-19T11:13:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7fb331f9f640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb32c127080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb328034040 tx=0x7fb328004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7984042070 con 0x7f799012c0b0 2024-09-19T11:13:22.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bb0005c10 con 0x7f8bb412c0b0 2024-09-19T11:13:22.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb328040070 con 0x7fb318003a50 2024-09-19T11:13:22.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7990128ea0 con 0x7f799012c0b0 2024-09-19T11:13:22.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8bb4128bb0 con 0x7f8bb412c0b0 2024-09-19T11:13:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8bb41bd0c0 con 0x7f8bb412c0b0 2024-09-19T11:13:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.687+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bb0007070 con 0x7f8bb412c0b0 2024-09-19T11:13:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fb32c128620 con 0x7fb318003a50 2024-09-19T11:13:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f799008c650 con 0x7f799012c0b0 2024-09-19T11:13:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7984031510 con 0x7f799012c0b0 2024-09-19T11:13:22.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f79840339e0 con 0x7f799012c0b0 2024-09-19T11:13:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7f0636452640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f06300720c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7f0636452640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f063006f6d0 con 0x7f0618003aa0 2024-09-19T11:13:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.688+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fb32c132680 con 0x7fb318003a50 2024-09-19T11:13:22.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f7970000f80 con 0x7f799012c0b0 2024-09-19T11:13:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb328031530 con 0x7fb318003a50 2024-09-19T11:13:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb328049060 con 0x7fb318003a50 2024-09-19T11:13:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7f062ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f06300720c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7f062ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f06300720c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47690/0 (socket says 172.21.15.37:47690) 2024-09-19T11:13:22.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8bb412c490 con 0x7f8bb412c0b0 2024-09-19T11:13:22.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7f062ffff640 1 -- 172.21.15.37:0/893573257 learned_addr learned my addr 172.21.15.37:0/893573257 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fb314000f80 con 0x7fb318003a50 2024-09-19T11:13:22.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.689+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f798403b040 con 0x7f799012c0b0 2024-09-19T11:13:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f062ffff640 1 -- 172.21.15.37:0/893573257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f063009a800 con 0x7f0618003aa0 2024-09-19T11:13:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f798d7fa640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f797403e6c0 0x7f7974040b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f7984076940 con 0x7f799012c0b0 2024-09-19T11:13:22.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8bb001a070 con 0x7f8bb412c0b0 2024-09-19T11:13:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f062ffff640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f06300720c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f062000bad0 tx=0x7f0620004730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f798d7fa640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f7974043e40 0x7f79740462c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f7974046990 con 0x7f7974043e40 2024-09-19T11:13:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f7984076e00 con 0x7f799012c0b0 2024-09-19T11:13:22.719 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f798ffff640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f797403e6c0 0x7f7974040b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb328039070 con 0x7fb318003a50 2024-09-19T11:13:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f8baa7fc640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b9803e6f0 0x7f8b98040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0620040070 con 0x7f0618003aa0 2024-09-19T11:13:22.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f799507a640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f7974043e40 0x7f79740462c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0620031690 con 0x7f0618003aa0 2024-09-19T11:13:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f8bb0052820 con 0x7f8bb412c0b0 2024-09-19T11:13:22.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0620040070 con 0x7f0618003aa0 2024-09-19T11:13:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.690+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0630073910 con 0x7f0618003aa0 2024-09-19T11:13:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7f8baa7fc640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8b98043e70 0x7f8b980462f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7fb3227fc640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb31003e710 0x7fb310040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.722 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fb32800f040 con 0x7fb318003a50 2024-09-19T11:13:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8bb001eec0 con 0x7f8b98043e70 2024-09-19T11:13:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f8bb0052ce0 con 0x7f8bb412c0b0 2024-09-19T11:13:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7f8bb94ff640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b9803e6f0 0x7f8b98040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f063009b110 con 0x7f0618003aa0 2024-09-19T11:13:22.723 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7f799507a640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f7974043e40 0x7f79740462c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7fb3227fc640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7fb310043e90 0x7fb310046310 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7f8bba501640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8b98043e70 0x7f8b980462f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7fb33179e640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb31003e710 0x7fb310040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fb3100469e0 con 0x7fb310043e90 2024-09-19T11:13:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7fb328073bb0 con 0x7fb318003a50 2024-09-19T11:13:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7fb3327a0640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7fb310043e90 0x7fb310046310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.691+0000 7f798ffff640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f797403e6c0 0x7f7974040b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f797c0017d0 tx=0x7f797c001060 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.725 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f7974046990 con 0x7f7974043e40 2024-09-19T11:13:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7fb33179e640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb31003e710 0x7fb310040bd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0078d0 tx=0x7fb31c001980 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7fb3327a0640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7fb310043e90 0x7fb310046310 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7f8bb94ff640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b9803e6f0 0x7f8b98040bb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009750 tx=0x7f8ba402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7f8bba501640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8b98043e70 0x7f8b980462f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f063012a030 con 0x7f0618003aa0 2024-09-19T11:13:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0620043070 con 0x7f0618003aa0 2024-09-19T11:13:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7f062cff9640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f061c03e8d0 0x7f061c040d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f0620030070 con 0x7f0618003aa0 2024-09-19T11:13:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.692+0000 7f062cff9640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7f061c044050 0x7f061c0464d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.727 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.693+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f062004ae80 con 0x7f061c044050 2024-09-19T11:13:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.693+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fb3100469e0 con 0x7fb310043e90 2024-09-19T11:13:22.728 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.693+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8bb001eec0 con 0x7f8b98043e70 2024-09-19T11:13:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.693+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=19) ==== 24+0+0 (secure 0 0 0) 0x7f06200755d0 con 0x7f0618003aa0 2024-09-19T11:13:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.693+0000 7f062f7fe640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f061c03e8d0 0x7f061c040d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.693+0000 7f06349ef640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7f061c044050 0x7f061c0464d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.693+0000 7f062f7fe640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f061c03e8d0 0x7f061c040d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f06240078d0 tx=0x7f0624001550 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.693+0000 7f06349ef640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7f061c044050 0x7f061c0464d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.694+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f062004ae80 con 0x7f061c044050 2024-09-19T11:13:22.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.705+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f7970002c70 con 0x7f7974043e40 2024-09-19T11:13:22.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f798d7fa640 1 -- 172.21.15.37:0/3645070361 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f7970002c70 con 0x7f7974043e40 2024-09-19T11:13:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f7974043e40 msgr2=0x7f79740462c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f7974043e40 0x7f79740462c0 crc :-1 s=READY pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f797403e6c0 msgr2=0x7f7974040b80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f797403e6c0 0x7f7974040b80 secure :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0x7f797c0017d0 tx=0x7f797c001060 comp rx=0 tx=0).stop 2024-09-19T11:13:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 msgr2=0x7f79901bfb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f79901bfb50 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f798400bb10 tx=0x7f79840046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 shutdown_connections 2024-09-19T11:13:22.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f7974043e40 0x7f79740462c0 unknown :-1 s=CLOSED pgs=5 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f797403e6c0 0x7f7974040b80 unknown :-1 s=CLOSED pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 --2- 172.21.15.37:0/3645070361 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f799012c0b0 0x7f79901bfb50 unknown :-1 s=CLOSED pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.706+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 >> 172.21.15.37:0/3645070361 conn(0x7f799009abc0 msgr2=0x7f7990072a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 shutdown_connections 2024-09-19T11:13:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f7996add640 1 -- 172.21.15.37:0/3645070361 wait complete. 2024-09-19T11:13:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f8bb4074090 con 0x7f8b98043e70 2024-09-19T11:13:22.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7fb314002c70 con 0x7fb310043e90 2024-09-19T11:13:22.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8baa7fc640 1 -- 172.21.15.37:0/1310198864 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f8bb4074090 con 0x7f8b98043e70 2024-09-19T11:13:22.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8b98043e70 msgr2=0x7f8b980462f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.733 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8bbbf64640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8b98043e70 0x7f8b980462f0 crc :-1 s=READY pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7fb3227fc640 1 -- 172.21.15.37:0/1958760082 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7fb314002c70 con 0x7fb310043e90 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b9803e6f0 msgr2=0x7f8b98040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8bbbf64640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b9803e6f0 0x7f8b98040bb0 secure :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0x7f8ba4009750 tx=0x7f8ba402e000 comp rx=0 tx=0).stop 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412c0b0 msgr2=0x7f8bb41bc9a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8bbbf64640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412c0b0 0x7f8bb41bc9a0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f8bb000c480 tx=0x7f8bb000c940 comp rx=0 tx=0).stop 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.707+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 shutdown_connections 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7f8bbbf64640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8b98043e70 0x7f8b980462f0 unknown :-1 s=CLOSED pgs=7 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7f8bbbf64640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b9803e6f0 0x7f8b98040bb0 unknown :-1 s=CLOSED pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7f8bbbf64640 1 --2- 172.21.15.37:0/1310198864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8bb412c0b0 0x7f8bb41bc9a0 unknown :-1 s=CLOSED pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 >> 172.21.15.37:0/1310198864 conn(0x7f8bb409abc0 msgr2=0x7f8bb409bb80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 shutdown_connections 2024-09-19T11:13:22.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7f8bbbf64640 1 -- 172.21.15.37:0/1310198864 wait complete. 2024-09-19T11:13:22.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7fb310043e90 msgr2=0x7fb310046310 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7fb310043e90 0x7fb310046310 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb31003e710 msgr2=0x7fb310040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb31003e710 0x7fb310040bd0 secure :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0x7fb31c0078d0 tx=0x7fb31c001980 comp rx=0 tx=0).stop 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 msgr2=0x7fb32c127080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb32c127080 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7fb328034040 tx=0x7fb328004730 comp rx=0 tx=0).stop 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 shutdown_connections 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7fb310043e90 0x7fb310046310 unknown :-1 s=CLOSED pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb31003e710 0x7fb310040bd0 unknown :-1 s=CLOSED pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 --2- 172.21.15.37:0/1958760082 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fb318003a50 0x7fb32c127080 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 >> 172.21.15.37:0/1958760082 conn(0x7fb32c09a860 msgr2=0x7fb32c071890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 shutdown_connections 2024-09-19T11:13:22.737 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7fb332fa1640 1 -- 172.21.15.37:0/1958760082 wait complete. 2024-09-19T11:13:22.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.708+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- command(tid 2: {"prefix": "flush_pg_stats"}) -- 0x7f063006fbb0 con 0x7f061c044050 2024-09-19T11:13:22.738 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f062cff9640 1 -- 172.21.15.37:0/893573257 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+11 (crc 0 0 0) 0x7f063006fbb0 con 0x7f061c044050 2024-09-19T11:13:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7f061c044050 msgr2=0x7f061c0464d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7f061c044050 0x7f061c0464d0 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f061c03e8d0 msgr2=0x7f061c040d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f061c03e8d0 0x7f061c040d90 secure :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0x7f06240078d0 tx=0x7f0624001550 comp rx=0 tx=0).stop 2024-09-19T11:13:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 msgr2=0x7f06300720c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f06300720c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f062000bad0 tx=0x7f0620004730 comp rx=0 tx=0).stop 2024-09-19T11:13:22.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 shutdown_connections 2024-09-19T11:13:22.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f061c03e8d0 0x7f061c040d90 unknown :-1 s=CLOSED pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7f061c044050 0x7f061c0464d0 unknown :-1 s=CLOSED pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 --2- 172.21.15.37:0/893573257 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0618003aa0 0x7f06300720c0 unknown :-1 s=CLOSED pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.709+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 >> 172.21.15.37:0/893573257 conn(0x7f06300a25b0 msgr2=0x7f063012a280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.710+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 shutdown_connections 2024-09-19T11:13:22.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.710+0000 7f0636452640 1 -- 172.21.15.37:0/893573257 wait complete. 2024-09-19T11:13:22.741 INFO:teuthology.orchestra.run.smithi037.stdout:38654705669 2024-09-19T11:13:22.741 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T11:13:22.742 INFO:teuthology.orchestra.run.smithi037.stdout:47244640262 2024-09-19T11:13:22.742 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T11:13:22.743 INFO:teuthology.orchestra.run.smithi037.stdout:47244640262 2024-09-19T11:13:22.744 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T11:13:22.744 INFO:teuthology.orchestra.run.smithi037.stdout:47244640261 2024-09-19T11:13:22.745 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T11:13:22.889 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7ff008047640 1 Processor -- start 2024-09-19T11:13:22.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f7ea82b6640 1 Processor -- start 2024-09-19T11:13:22.890 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f7ea82b6640 1 -- start start 2024-09-19T11:13:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f6e13033640 1 Processor -- start 2024-09-19T11:13:22.891 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f6e13033640 1 -- start start 2024-09-19T11:13:22.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7ff008047640 1 -- start start 2024-09-19T11:13:22.892 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f6e13033640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e0c12c0b0 0x7f6e0c12c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7ff008047640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff00012f910 0x7ff00012fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.893 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7ff008047640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff00012f4e0 con 0x7ff000130230 2024-09-19T11:13:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7ff008047640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff00009f3f0 con 0x7ff00012f910 2024-09-19T11:13:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f6e13033640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6e0c09a290 con 0x7f6e0c12c9d0 2024-09-19T11:13:22.894 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f6e13033640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6e0c071860 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f7ea82b6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f7ea012c0b0 0x7f7ea012c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea82b6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f7ea009a290 con 0x7f7ea012c9d0 2024-09-19T11:13:22.895 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea82b6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f7ea0071860 con 0x7f7ea012c0b0 2024-09-19T11:13:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea5851640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f7ea012c9d0 0x7f7ea0097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37886/0 (socket says 172.21.15.37:37886) 2024-09-19T11:13:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea5851640 1 -- 172.21.15.37:0/708187490 learned_addr learned my addr 172.21.15.37:0/708187490 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:22.896 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea6052640 1 --2- 172.21.15.37:0/708187490 >> v2:172.21.15.37:3300/0 conn(0x7f7ea012c0b0 0x7f7ea012c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.888+0000 7f6e10dcf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e0c12c0b0 0x7f6e0c12c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f6e10dcf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6e0c12c0b0 0x7f6e0c12c490 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47692/0 (socket says 172.21.15.37:47692) 2024-09-19T11:13:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f6e10dcf640 1 -- 172.21.15.37:0/2320142123 learned_addr learned my addr 172.21.15.37:0/2320142123 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f6e10dcf640 1 -- 172.21.15.37:0/2320142123 >> v1:172.21.15.37:6789/0 conn(0x7f6e0c12c9d0 legacy=0x7f6e0c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=0).mark_down 2024-09-19T11:13:22.897 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f6e10dcf640 1 -- 172.21.15.37:0/2320142123 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c099e20 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7ff005de3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff00012f910 0x7ff00012fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7ff005de3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff00012f910 0x7ff00012fcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47704/0 (socket says 172.21.15.37:47704) 2024-09-19T11:13:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7ff0055e2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff000130230 0x7ff00006efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37872/0 (socket says 172.21.15.37:37872) 2024-09-19T11:13:22.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7ff005de3640 1 -- 172.21.15.37:0/2135801197 learned_addr learned my addr 172.21.15.37:0/2135801197 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7ff9e9a01640 1 Processor -- start 2024-09-19T11:13:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea5050640 1 -- 172.21.15.37:0/708187490 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1038280426 0 0) 0x7f7ea009a290 con 0x7f7ea012c9d0 2024-09-19T11:13:22.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea5050640 1 -- 172.21.15.37:0/708187490 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7e8c003520 con 0x7f7ea012c9d0 2024-09-19T11:13:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7ff005de3640 1 -- 172.21.15.37:0/2135801197 >> v1:172.21.15.37:6789/0 conn(0x7ff000130230 legacy=0x7ff00006efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.900 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7ff005de3640 1 -- 172.21.15.37:0/2135801197 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff000070760 con 0x7ff00012f910 2024-09-19T11:13:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7ff9e9a01640 1 -- start start 2024-09-19T11:13:22.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea5050640 1 -- 172.21.15.37:0/708187490 <== mon.0 v1:172.21.15.37:6789/0 2 ==== auth_reply(proto 2 0 (0) Success) ==== 214+0+0 (unknown 991295483 0 0) 0x7f7e8c003520 con 0x7f7ea012c9d0 2024-09-19T11:13:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea6052640 1 -- 172.21.15.37:0/708187490 >> v1:172.21.15.37:6789/0 conn(0x7f7ea012c9d0 legacy=0x7f7ea0097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.889+0000 7f7ea6052640 1 -- 172.21.15.37:0/708187490 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea0099e20 con 0x7f7ea012c0b0 2024-09-19T11:13:22.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e9a01640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff9e406e700 0x7ff9e4134b70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e9a01640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff9e4070220 con 0x7ff9e4098bd0 2024-09-19T11:13:22.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e9a01640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff9e4070530 con 0x7ff9e406e700 2024-09-19T11:13:22.903 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7f6e10dcf640 1 --2- 172.21.15.37:0/2320142123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c12c490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009820 tx=0x7f6e0002a180 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a5eb4d4f5e990dc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e2ffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff9e4098bd0 0x7ff9e406dff0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:37894/0 (socket says 172.21.15.37:37894) 2024-09-19T11:13:22.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e2ffd640 1 -- 172.21.15.37:0/3153945126 learned_addr learned my addr 172.21.15.37:0/3153945126 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:22.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff005de3640 1 --2- 172.21.15.37:0/2135801197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff00012fcf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feffc0097f0 tx=0x7feffc02a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9b9b96cc9926e96b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7f6e0b7fe640 1 -- 172.21.15.37:0/2320142123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e00037070 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e27fc640 1 --2- 172.21.15.37:0/3153945126 >> v2:172.21.15.37:3300/0 conn(0x7ff9e406e700 0x7ff9e4134b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7f6e0b7fe640 1 -- 172.21.15.37:0/2320142123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0002adc0 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7f6e0b7fe640 1 -- 172.21.15.37:0/2320142123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e00032590 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.907 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e1ffb640 1 -- 172.21.15.37:0/3153945126 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 961847862 0 0) 0x7ff9dc001490 con 0x7ff9e4098bd0 2024-09-19T11:13:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e1ffb640 1 -- 172.21.15.37:0/3153945126 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff9d0003520 con 0x7ff9e4098bd0 2024-09-19T11:13:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e27fc640 1 -- 172.21.15.37:0/3153945126 >> v1:172.21.15.37:6789/0 conn(0x7ff9e4098bd0 legacy=0x7ff9e406dff0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.908 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff9e27fc640 1 -- 172.21.15.37:0/3153945126 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e406faf0 con 0x7ff9e406e700 2024-09-19T11:13:22.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff004de1640 1 -- 172.21.15.37:0/2135801197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc037070 con 0x7ff00012f910 2024-09-19T11:13:22.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff004de1640 1 -- 172.21.15.37:0/2135801197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc032440 con 0x7ff00012f910 2024-09-19T11:13:22.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7ff004de1640 1 -- 172.21.15.37:0/2135801197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc032740 con 0x7ff00012f910 2024-09-19T11:13:22.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.890+0000 7f7ea6052640 1 --2- 172.21.15.37:0/708187490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea012c490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009750 tx=0x7f7e9c02a0d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b14a7edc5e7602b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f7ea5050640 1 -- 172.21.15.37:0/708187490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e9c037070 con 0x7f7ea012c0b0 2024-09-19T11:13:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f7ea5050640 1 -- 172.21.15.37:0/708187490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c02ab60 con 0x7f7ea012c0b0 2024-09-19T11:13:22.911 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f7ea5050640 1 -- 172.21.15.37:0/708187490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e90001620 con 0x7f7ea012c0b0 2024-09-19T11:13:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f6e13033640 1 -- 172.21.15.37:0/2320142123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 msgr2=0x7f6e0c12c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f6e13033640 1 --2- 172.21.15.37:0/2320142123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c12c490 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f6e00009820 tx=0x7f6e0002a180 comp rx=0 tx=0).stop 2024-09-19T11:13:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f6e13033640 1 -- 172.21.15.37:0/2320142123 shutdown_connections 2024-09-19T11:13:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f6e13033640 1 --2- 172.21.15.37:0/2320142123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c12c490 unknown :-1 s=CLOSED pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f6e13033640 1 -- 172.21.15.37:0/2320142123 >> 172.21.15.37:0/2320142123 conn(0x7f6e0c09abc0 msgr2=0x7f6e0c098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7ff9e27fc640 1 --2- 172.21.15.37:0/3153945126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e4134b70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009720 tx=0x7ff9cc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1eb998cedad87a01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f6e13033640 1 -- 172.21.15.37:0/2320142123 shutdown_connections 2024-09-19T11:13:22.914 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7f6e13033640 1 -- 172.21.15.37:0/2320142123 wait complete. 2024-09-19T11:13:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7ff9e1ffb640 1 -- 172.21.15.37:0/3153945126 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc037070 con 0x7ff9e406e700 2024-09-19T11:13:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7ff9e1ffb640 1 -- 172.21.15.37:0/3153945126 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9cc02ae20 con 0x7ff9e406e700 2024-09-19T11:13:22.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.891+0000 7ff9e1ffb640 1 -- 172.21.15.37:0/3153945126 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9cc032590 con 0x7ff9e406e700 2024-09-19T11:13:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff008047640 1 -- 172.21.15.37:0/2135801197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 msgr2=0x7ff00012fcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff008047640 1 --2- 172.21.15.37:0/2135801197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff00012fcf0 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7feffc0097f0 tx=0x7feffc02a270 comp rx=0 tx=0).stop 2024-09-19T11:13:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff008047640 1 -- 172.21.15.37:0/2135801197 shutdown_connections 2024-09-19T11:13:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff008047640 1 --2- 172.21.15.37:0/2135801197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff00012fcf0 unknown :-1 s=CLOSED pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff008047640 1 -- 172.21.15.37:0/2135801197 >> 172.21.15.37:0/2135801197 conn(0x7ff0000a2540 msgr2=0x7ff00009ea10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f7ea82b6640 1 -- 172.21.15.37:0/708187490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 msgr2=0x7f7ea012c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f7ea82b6640 1 --2- 172.21.15.37:0/708187490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea012c490 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c009750 tx=0x7f7e9c02a0d0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff008047640 1 -- 172.21.15.37:0/2135801197 shutdown_connections 2024-09-19T11:13:22.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff008047640 1 -- 172.21.15.37:0/2135801197 wait complete. 2024-09-19T11:13:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f7ea82b6640 1 -- 172.21.15.37:0/708187490 shutdown_connections 2024-09-19T11:13:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f7ea82b6640 1 --2- 172.21.15.37:0/708187490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea012c490 unknown :-1 s=CLOSED pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f7ea82b6640 1 -- 172.21.15.37:0/708187490 >> 172.21.15.37:0/708187490 conn(0x7f7ea009abc0 msgr2=0x7f7ea0098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f7ea82b6640 1 -- 172.21.15.37:0/708187490 shutdown_connections 2024-09-19T11:13:22.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f7ea82b6640 1 -- 172.21.15.37:0/708187490 wait complete. 2024-09-19T11:13:22.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff9e9a01640 1 -- 172.21.15.37:0/3153945126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 msgr2=0x7ff9e4134b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:22.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff9e9a01640 1 --2- 172.21.15.37:0/3153945126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e4134b70 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc009720 tx=0x7ff9cc02a1a0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f6e13033640 1 Processor -- start 2024-09-19T11:13:22.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7f6e13033640 1 -- start start 2024-09-19T11:13:22.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff9e9a01640 1 -- 172.21.15.37:0/3153945126 shutdown_connections 2024-09-19T11:13:22.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff9e9a01640 1 --2- 172.21.15.37:0/3153945126 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e4134b70 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:22.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff9e9a01640 1 -- 172.21.15.37:0/3153945126 >> 172.21.15.37:0/3153945126 conn(0x7ff9e409c8c0 msgr2=0x7ff9e409ccd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:22.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff9e9a01640 1 -- 172.21.15.37:0/3153945126 shutdown_connections 2024-09-19T11:13:22.923 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.892+0000 7ff9e9a01640 1 -- 172.21.15.37:0/3153945126 wait complete. 2024-09-19T11:13:22.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7f7ea82b6640 1 Processor -- start 2024-09-19T11:13:22.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7f6e13033640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c124ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.924 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7f6e13033640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6e0c12ce00 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7ff008047640 1 Processor -- start 2024-09-19T11:13:22.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7f7ea82b6640 1 -- start start 2024-09-19T11:13:22.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7f6e10dcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c124ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7f6e10dcf640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c124ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47728/0 (socket says 172.21.15.37:47728) 2024-09-19T11:13:22.926 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7f6e10dcf640 1 -- 172.21.15.37:0/4029694594 learned_addr learned my addr 172.21.15.37:0/4029694594 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7ff008047640 1 -- start start 2024-09-19T11:13:22.927 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.893+0000 7f6e10dcf640 1 -- 172.21.15.37:0/4029694594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6e0c126fb0 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f7ea82b6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea008ca10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.928 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff008047640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff000090660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f7ea82b6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f7ea012ce00 con 0x7f7ea012c0b0 2024-09-19T11:13:22.929 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f7ea6052640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea008ca10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f7ea6052640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea008ca10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47730/0 (socket says 172.21.15.37:47730) 2024-09-19T11:13:22.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f6e10dcf640 1 --2- 172.21.15.37:0/4029694594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c124ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e00035040 tx=0x7f6e000046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f7ea6052640 1 -- 172.21.15.37:0/1622410952 learned_addr learned my addr 172.21.15.37:0/1622410952 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff9e9a01640 1 Processor -- start 2024-09-19T11:13:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff008047640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff00006f850 con 0x7ff00012f910 2024-09-19T11:13:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff005de3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff000090660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.932 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff005de3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff000090660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47738/0 (socket says 172.21.15.37:47738) 2024-09-19T11:13:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff005de3640 1 -- 172.21.15.37:0/2726537163 learned_addr learned my addr 172.21.15.37:0/2726537163 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.933 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f7ea6052640 1 -- 172.21.15.37:0/1622410952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f7ea0097fb0 con 0x7f7ea012c0b0 2024-09-19T11:13:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f6e097fa640 1 -- 172.21.15.37:0/4029694594 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e00041070 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.934 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f6e097fa640 1 -- 172.21.15.37:0/4029694594 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6e0003c590 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff9e9a01640 1 -- start start 2024-09-19T11:13:22.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff005de3640 1 -- 172.21.15.37:0/2726537163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff000092ad0 con 0x7ff00012f910 2024-09-19T11:13:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6e0c127fb0 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f6e097fa640 1 -- 172.21.15.37:0/4029694594 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6e00037040 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6e0c1250e0 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7f7ea6052640 1 --2- 172.21.15.37:0/1622410952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea008ca10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c035040 tx=0x7f7e9c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.894+0000 7ff005de3640 1 --2- 172.21.15.37:0/2726537163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff000090660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feffc0097f0 tx=0x7feffc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7ff9e9a01640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e408bfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7ff9e9a01640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff9e41350b0 con 0x7ff9e406e700 2024-09-19T11:13:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7ff9e2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e408bfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7ff9e2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e408bfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:47754/0 (socket says 172.21.15.37:47754) 2024-09-19T11:13:22.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7ff9e2ffd640 1 -- 172.21.15.37:0/57981027 learned_addr learned my addr 172.21.15.37:0/57981027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7f7e96ffd640 1 -- 172.21.15.37:0/1622410952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e9c041070 con 0x7f7ea012c0b0 2024-09-19T11:13:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f7ea008e140 con 0x7f7ea012c0b0 2024-09-19T11:13:22.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7f7e96ffd640 1 -- 172.21.15.37:0/1622410952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7e9c03c590 con 0x7f7ea012c0b0 2024-09-19T11:13:22.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7ff9e2ffd640 1 -- 172.21.15.37:0/57981027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff9e408e5e0 con 0x7ff9e406e700 2024-09-19T11:13:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f7ea008f450 con 0x7f7ea012c0b0 2024-09-19T11:13:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7f7e96ffd640 1 -- 172.21.15.37:0/1622410952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7e9c037040 con 0x7f7ea012c0b0 2024-09-19T11:13:22.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6e0c1262d0 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7ff9e2ffd640 1 --2- 172.21.15.37:0/57981027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e408bfe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00cbc0 tx=0x7ff9dc00a430 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.942 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7f6e097fa640 1 -- 172.21.15.37:0/4029694594 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6e00044070 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7feff67fc640 1 -- 172.21.15.37:0/2726537163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc041070 con 0x7ff00012f910 2024-09-19T11:13:22.943 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.895+0000 7feff67fc640 1 -- 172.21.15.37:0/2726537163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feffc03c7c0 con 0x7ff00012f910 2024-09-19T11:13:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7f6e097fa640 1 --2- 172.21.15.37:0/4029694594 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6df003e710 0x7f6df0040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7feff67fc640 1 -- 172.21.15.37:0/2726537163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feffc037040 con 0x7ff00012f910 2024-09-19T11:13:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7f6e097fa640 1 -- 172.21.15.37:0/4029694594 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f6e00073590 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7ff9dbfff640 1 -- 172.21.15.37:0/57981027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc00ab70 con 0x7ff9e406e700 2024-09-19T11:13:22.945 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff9e408d700 con 0x7ff9e406e700 2024-09-19T11:13:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7f6e0bfff640 1 --2- 172.21.15.37:0/4029694594 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6df003e710 0x7f6df0040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.946 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff9e4134640 con 0x7ff9e406e700 2024-09-19T11:13:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0000935b0 con 0x7ff00012f910 2024-09-19T11:13:22.947 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff000090d80 con 0x7ff00012f910 2024-09-19T11:13:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.896+0000 7f7e96ffd640 1 -- 172.21.15.37:0/1622410952 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7e9c044070 con 0x7f7ea012c0b0 2024-09-19T11:13:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.897+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f7ea008edf0 con 0x7f7ea012c0b0 2024-09-19T11:13:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.897+0000 7f7e96ffd640 1 --2- 172.21.15.37:0/1622410952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7e8403e760 0x7f7e84040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.948 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.897+0000 7f7e96ffd640 1 -- 172.21.15.37:0/1622410952 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f7e9c0735b0 con 0x7f7ea012c0b0 2024-09-19T11:13:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.897+0000 7f7ea5851640 1 --2- 172.21.15.37:0/1622410952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7e8403e760 0x7f7e84040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.949 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.897+0000 7f6e0bfff640 1 --2- 172.21.15.37:0/4029694594 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6df003e710 0x7f6df0040bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6df8003cf0 tx=0x7f6df8007a50 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.897+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff9e406dff0 con 0x7ff9e406e700 2024-09-19T11:13:22.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.897+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff00006fd90 con 0x7ff00012f910 2024-09-19T11:13:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.898+0000 7f7ea5851640 1 --2- 172.21.15.37:0/1622410952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7e8403e760 0x7f7e84040c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e90005880 tx=0x7f7e900019a0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.901+0000 7ff9dbfff640 1 -- 172.21.15.37:0/57981027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff9dc00ad10 con 0x7ff9e406e700 2024-09-19T11:13:22.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.901+0000 7ff9dbfff640 1 -- 172.21.15.37:0/57981027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff9dc012400 con 0x7ff9e406e700 2024-09-19T11:13:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.901+0000 7f6e097fa640 1 -- 172.21.15.37:0/4029694594 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f6e0c1262d0 con 0x7f6e0c12c0b0 2024-09-19T11:13:22.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.906+0000 7f7e96ffd640 1 -- 172.21.15.37:0/1622410952 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f7ea008edf0 con 0x7f7ea012c0b0 2024-09-19T11:13:22.953 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.906+0000 7feff67fc640 1 -- 172.21.15.37:0/2726537163 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feffc044070 con 0x7ff00012f910 2024-09-19T11:13:22.956 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.906+0000 7ff9dbfff640 1 -- 172.21.15.37:0/57981027 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff9dc0125a0 con 0x7ff9e406e700 2024-09-19T11:13:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.906+0000 7feff67fc640 1 --2- 172.21.15.37:0/2726537163 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fefe403e7e0 0x7fefe4040ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.907+0000 7feff67fc640 1 -- 172.21.15.37:0/2726537163 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7feffc073c80 con 0x7ff00012f910 2024-09-19T11:13:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.907+0000 7ff9dbfff640 1 --2- 172.21.15.37:0/57981027 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff9c403e790 0x7ff9c4040c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:22.957 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.907+0000 7ff9dbfff640 1 -- 172.21.15.37:0/57981027 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7ff9dc053e40 con 0x7ff9e406e700 2024-09-19T11:13:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.907+0000 7ff9e27fc640 1 --2- 172.21.15.37:0/57981027 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff9c403e790 0x7ff9c4040c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.907+0000 7ff0055e2640 1 --2- 172.21.15.37:0/2726537163 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fefe403e7e0 0x7fefe4040ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.908+0000 7ff0055e2640 1 --2- 172.21.15.37:0/2726537163 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fefe403e7e0 0x7fefe4040ca0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff000075e80 tx=0x7feff0007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.958 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.908+0000 7ff9e27fc640 1 --2- 172.21.15.37:0/57981027 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff9c403e790 0x7ff9c4040c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc034000 tx=0x7ff9cc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.910+0000 7feff67fc640 1 -- 172.21.15.37:0/2726537163 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7feffc03ad70 con 0x7ff00012f910 2024-09-19T11:13:22.959 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:22.915+0000 7ff9dbfff640 1 -- 172.21.15.37:0/57981027 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7ff9e4070220 con 0x7ff9e406e700 2024-09-19T11:13:23.119 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.118+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f7ea012c490 con 0x7f7ea012c0b0 2024-09-19T11:13:23.120 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.118+0000 7f7e96ffd640 1 -- 172.21.15.37:0/1622410952 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f7e9c0723c0 con 0x7f7ea012c0b0 2024-09-19T11:13:23.120 INFO:teuthology.orchestra.run.smithi037.stdout:47244640261 2024-09-19T11:13:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7e8403e760 msgr2=0x7f7e84040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 --2- 172.21.15.37:0/1622410952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7e8403e760 0x7f7e84040c20 secure :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0x7f7e90005880 tx=0x7f7e900019a0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 msgr2=0x7f7ea008ca10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 --2- 172.21.15.37:0/1622410952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea008ca10 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7e9c035040 tx=0x7f7e9c0046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.123 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 shutdown_connections 2024-09-19T11:13:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 --2- 172.21.15.37:0/1622410952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7e8403e760 0x7f7e84040c20 unknown :-1 s=CLOSED pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 --2- 172.21.15.37:0/1622410952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f7ea012c0b0 0x7f7ea008ca10 unknown :-1 s=CLOSED pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 >> 172.21.15.37:0/1622410952 conn(0x7f7ea009abc0 msgr2=0x7f7ea01290d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 shutdown_connections 2024-09-19T11:13:23.124 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.122+0000 7f7ea82b6640 1 -- 172.21.15.37:0/1622410952 wait complete. 2024-09-19T11:13:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.125+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7ff000093a60 con 0x7ff00012f910 2024-09-19T11:13:23.126 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.125+0000 7feff67fc640 1 -- 172.21.15.37:0/2726537163 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7feffc071b60 con 0x7ff00012f910 2024-09-19T11:13:23.127 INFO:teuthology.orchestra.run.smithi037.stdout:38654705667 2024-09-19T11:13:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fefe403e7e0 msgr2=0x7fefe4040ca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 --2- 172.21.15.37:0/2726537163 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fefe403e7e0 0x7fefe4040ca0 secure :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0x7ff000075e80 tx=0x7feff0007a40 comp rx=0 tx=0).stop 2024-09-19T11:13:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 msgr2=0x7ff000090660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:23.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 --2- 172.21.15.37:0/2726537163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff000090660 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7feffc0097f0 tx=0x7feffc0046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 shutdown_connections 2024-09-19T11:13:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 --2- 172.21.15.37:0/2726537163 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fefe403e7e0 0x7fefe4040ca0 unknown :-1 s=CLOSED pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 --2- 172.21.15.37:0/2726537163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff00012f910 0x7ff000090660 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 >> 172.21.15.37:0/2726537163 conn(0x7ff0000a2540 msgr2=0x7ff00009d660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 shutdown_connections 2024-09-19T11:13:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7ff008047640 1 -- 172.21.15.37:0/2726537163 wait complete. 2024-09-19T11:13:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.128+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f6e0c12c490 con 0x7f6e0c12c0b0 2024-09-19T11:13:23.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.129+0000 7f6e097fa640 1 -- 172.21.15.37:0/4029694594 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6e0002ad50 con 0x7f6e0c12c0b0 2024-09-19T11:13:23.131 INFO:teuthology.orchestra.run.smithi037.stdout:47244640261 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6df003e710 msgr2=0x7f6df0040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 --2- 172.21.15.37:0/4029694594 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6df003e710 0x7f6df0040bd0 secure :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0x7f6df8003cf0 tx=0x7f6df8007a50 comp rx=0 tx=0).stop 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 msgr2=0x7f6e0c124ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 --2- 172.21.15.37:0/4029694594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c124ba0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x7f6e00035040 tx=0x7f6e000046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 shutdown_connections 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 --2- 172.21.15.37:0/4029694594 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6df003e710 0x7f6df0040bd0 unknown :-1 s=CLOSED pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 --2- 172.21.15.37:0/4029694594 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6e0c12c0b0 0x7f6e0c124ba0 unknown :-1 s=CLOSED pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 >> 172.21.15.37:0/4029694594 conn(0x7f6e0c09abc0 msgr2=0x7f6e0c09c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.132+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 shutdown_connections 2024-09-19T11:13:23.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.133+0000 7f6e13033640 1 -- 172.21.15.37:0/4029694594 wait complete. 2024-09-19T11:13:23.137 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-09-19T11:13:23.141 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705667 for osd.0 2024-09-19T11:13:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.142+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff9e406c7e0 con 0x7ff9e406e700 2024-09-19T11:13:23.143 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.142+0000 7ff9dbfff640 1 -- 172.21.15.37:0/57981027 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff9dc024c70 con 0x7ff9e406e700 2024-09-19T11:13:23.143 INFO:teuthology.orchestra.run.smithi037.stdout:47244640260 2024-09-19T11:13:23.146 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.1 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff9c403e790 msgr2=0x7ff9c4040c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 --2- 172.21.15.37:0/57981027 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff9c403e790 0x7ff9c4040c50 secure :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0x7ff9cc034000 tx=0x7ff9cc02e000 comp rx=0 tx=0).stop 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 msgr2=0x7ff9e408bfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 --2- 172.21.15.37:0/57981027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e408bfe0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7ff9dc00cbc0 tx=0x7ff9dc00a430 comp rx=0 tx=0).stop 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 shutdown_connections 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 --2- 172.21.15.37:0/57981027 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff9c403e790 0x7ff9c4040c50 unknown :-1 s=CLOSED pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 --2- 172.21.15.37:0/57981027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff9e406e700 0x7ff9e408bfe0 unknown :-1 s=CLOSED pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 >> 172.21.15.37:0/57981027 conn(0x7ff9e409c8c0 msgr2=0x7ff9e40997b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 shutdown_connections 2024-09-19T11:13:23.147 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:23.145+0000 7ff9e9a01640 1 -- 172.21.15.37:0/57981027 wait complete. 2024-09-19T11:13:23.157 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2024-09-19T11:13:24.138 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T11:13:24.142 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T11:13:24.147 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T11:13:24.157 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T11:13:24.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.256+0000 7f6f50ec6640 1 Processor -- start 2024-09-19T11:13:24.257 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.256+0000 7f6f50ec6640 1 -- start start 2024-09-19T11:13:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.256+0000 7f6f50ec6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f4c06fab0 0x7f6f4c134820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.256+0000 7f6f50ec6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6f4c070330 con 0x7f6f4c06efc0 2024-09-19T11:13:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.256+0000 7f6f50ec6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6f4c09f310 con 0x7f6f4c06fab0 2024-09-19T11:13:24.258 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.257+0000 7f6f49d9b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6f4c06fab0 0x7f6f4c134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.257+0000 7f6f4a59c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f6f4c06efc0 0x7f6f4c06f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53358/0 (socket says 172.21.15.37:53358) 2024-09-19T11:13:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.257+0000 7f6f4a59c640 1 -- 172.21.15.37:0/3989604973 learned_addr learned my addr 172.21.15.37:0/3989604973 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.257+0000 7f6f49d9b640 1 -- 172.21.15.37:0/3989604973 >> v1:172.21.15.37:6789/0 conn(0x7f6f4c06efc0 legacy=0x7f6f4c06f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.257+0000 7f6f4959a640 1 -- 172.21.15.37:0/3989604973 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1173314821 0 0) 0x7f6f4c070330 con 0x7f6f4c06efc0 2024-09-19T11:13:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.257+0000 7f6f49d9b640 1 -- 172.21.15.37:0/3989604973 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c070640 con 0x7f6f4c06fab0 2024-09-19T11:13:24.259 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.258+0000 7f6f49d9b640 1 --2- 172.21.15.37:0/3989604973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06fab0 0x7f6f4c134820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009720 tx=0x7f6f4002a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c1a4864aaa4a4827 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.258+0000 7f6f4959a640 1 -- 172.21.15.37:0/3989604973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f40037070 con 0x7f6f4c06fab0 2024-09-19T11:13:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.258+0000 7f6f4959a640 1 -- 172.21.15.37:0/3989604973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f4002ad90 con 0x7f6f4c06fab0 2024-09-19T11:13:24.260 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.258+0000 7f6f4959a640 1 -- 172.21.15.37:0/3989604973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f40032590 con 0x7f6f4c06fab0 2024-09-19T11:13:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.259+0000 7f6f50ec6640 1 -- 172.21.15.37:0/3989604973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06fab0 msgr2=0x7f6f4c134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.259+0000 7f6f50ec6640 1 --2- 172.21.15.37:0/3989604973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06fab0 0x7f6f4c134820 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x7f6f40009720 tx=0x7f6f4002a110 comp rx=0 tx=0).stop 2024-09-19T11:13:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.259+0000 7f6f50ec6640 1 -- 172.21.15.37:0/3989604973 shutdown_connections 2024-09-19T11:13:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.259+0000 7f6f50ec6640 1 --2- 172.21.15.37:0/3989604973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06fab0 0x7f6f4c134820 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.259+0000 7f6f50ec6640 1 -- 172.21.15.37:0/3989604973 >> 172.21.15.37:0/3989604973 conn(0x7f6f4c0a2460 msgr2=0x7f6f4c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.259+0000 7f6f50ec6640 1 -- 172.21.15.37:0/3989604973 shutdown_connections 2024-09-19T11:13:24.261 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.259+0000 7f6f50ec6640 1 -- 172.21.15.37:0/3989604973 wait complete. 2024-09-19T11:13:24.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.261+0000 7f6f50ec6640 1 Processor -- start 2024-09-19T11:13:24.262 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.261+0000 7f6f50ec6640 1 -- start start 2024-09-19T11:13:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.262+0000 7f6f50ec6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06efc0 0x7f6f4c1279d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.262+0000 7f6f50ec6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6f4c134ee0 con 0x7f6f4c06efc0 2024-09-19T11:13:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.262+0000 7f6f4a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06efc0 0x7f6f4c1279d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.262+0000 7f6f4a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06efc0 0x7f6f4c1279d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60330/0 (socket says 172.21.15.37:60330) 2024-09-19T11:13:24.263 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.262+0000 7f6f4a59c640 1 -- 172.21.15.37:0/2168377079 learned_addr learned my addr 172.21.15.37:0/2168377079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:24.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.262+0000 7f6f4a59c640 1 -- 172.21.15.37:0/2168377079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6f4c129960 con 0x7f6f4c06efc0 2024-09-19T11:13:24.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.262+0000 7f6f4a59c640 1 --2- 172.21.15.37:0/2168377079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06efc0 0x7f6f4c1279d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c3d0 tx=0x7f6f3c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.263+0000 7f6f3affd640 1 -- 172.21.15.37:0/2168377079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f3c0074d0 con 0x7f6f4c06efc0 2024-09-19T11:13:24.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.263+0000 7f6f3affd640 1 -- 172.21.15.37:0/2168377079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6f3c0047e0 con 0x7f6f4c06efc0 2024-09-19T11:13:24.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.263+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6f4c127f10 con 0x7f6f4c06efc0 2024-09-19T11:13:24.264 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.263+0000 7f6f3affd640 1 -- 172.21.15.37:0/2168377079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6f3c007670 con 0x7f6f4c06efc0 2024-09-19T11:13:24.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.263+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6f4c1283e0 con 0x7f6f4c06efc0 2024-09-19T11:13:24.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.264+0000 7f6f3affd640 1 -- 172.21.15.37:0/2168377079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6f3c011070 con 0x7f6f4c06efc0 2024-09-19T11:13:24.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.264+0000 7f6f3affd640 1 --2- 172.21.15.37:0/2168377079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6f2c03e790 0x7f6f2c040c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.265 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.264+0000 7f6f3affd640 1 -- 172.21.15.37:0/2168377079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f6f3c052a00 con 0x7f6f4c06efc0 2024-09-19T11:13:24.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.264+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6f4c06f3a0 con 0x7f6f4c06efc0 2024-09-19T11:13:24.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.264+0000 7f6f49d9b640 1 --2- 172.21.15.37:0/2168377079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6f2c03e790 0x7f6f2c040c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.266 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.265+0000 7f6f49d9b640 1 --2- 172.21.15.37:0/2168377079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6f2c03e790 0x7f6f2c040c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6f40034000 tx=0x7f6f4002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.274 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.273+0000 7f6f3affd640 1 -- 172.21.15.37:0/2168377079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f6f3c012dd0 con 0x7f6f4c06efc0 2024-09-19T11:13:24.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.295+0000 7ff09bfbb640 1 Processor -- start 2024-09-19T11:13:24.297 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.296+0000 7ff09bfbb640 1 -- start start 2024-09-19T11:13:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.296+0000 7ff09bfbb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff09412cba0 0x7ff0941315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.296+0000 7ff09bfbb640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff09409a290 con 0x7ff09412c0b0 2024-09-19T11:13:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.296+0000 7ff09bfbb640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff094071860 con 0x7ff09412cba0 2024-09-19T11:13:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.296+0000 7ff099556640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff09412cba0 0x7ff0941315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.296+0000 7ff099d57640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff09412c0b0 0x7ff09412c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53372/0 (socket says 172.21.15.37:53372) 2024-09-19T11:13:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.296+0000 7ff099556640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff09412cba0 0x7ff0941315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60342/0 (socket says 172.21.15.37:60342) 2024-09-19T11:13:24.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.296+0000 7ff099d57640 1 -- 172.21.15.37:0/3837812786 learned_addr learned my addr 172.21.15.37:0/3837812786 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.297+0000 7ff099556640 1 -- 172.21.15.37:0/3837812786 >> v1:172.21.15.37:6789/0 conn(0x7ff09412c0b0 legacy=0x7ff09412c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.297+0000 7ff099556640 1 -- 172.21.15.37:0/3837812786 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff094099e20 con 0x7ff09412cba0 2024-09-19T11:13:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.298+0000 7ff099556640 1 --2- 172.21.15.37:0/3837812786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412cba0 0x7ff0941315e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff08400b9f0 tx=0x7ff08402c810 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5b533c45fe19df1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.298+0000 7ff098d55640 1 -- 172.21.15.37:0/3837812786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff08403a070 con 0x7ff09412cba0 2024-09-19T11:13:24.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.298+0000 7ff098d55640 1 -- 172.21.15.37:0/3837812786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff084031070 con 0x7ff09412cba0 2024-09-19T11:13:24.300 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.298+0000 7ff098d55640 1 -- 172.21.15.37:0/3837812786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff084032620 con 0x7ff09412cba0 2024-09-19T11:13:24.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3837812786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412cba0 msgr2=0x7ff0941315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7ff09bfbb640 1 --2- 172.21.15.37:0/3837812786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412cba0 0x7ff0941315e0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x7ff08400b9f0 tx=0x7ff08402c810 comp rx=0 tx=0).stop 2024-09-19T11:13:24.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3837812786 shutdown_connections 2024-09-19T11:13:24.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7ff09bfbb640 1 --2- 172.21.15.37:0/3837812786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412cba0 0x7ff0941315e0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3837812786 >> 172.21.15.37:0/3837812786 conn(0x7ff09409abc0 msgr2=0x7ff094098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:24.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3837812786 shutdown_connections 2024-09-19T11:13:24.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3837812786 wait complete. 2024-09-19T11:13:24.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7f3cba58a640 1 Processor -- start 2024-09-19T11:13:24.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.299+0000 7f3cba58a640 1 -- start start 2024-09-19T11:13:24.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cba58a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cb406fab0 0x7f3cb4134820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7ff09bfbb640 1 Processor -- start 2024-09-19T11:13:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cba58a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3cb4070330 con 0x7f3cb406efc0 2024-09-19T11:13:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cba58a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3cb409f310 con 0x7f3cb406fab0 2024-09-19T11:13:24.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7ff09bfbb640 1 -- start start 2024-09-19T11:13:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cb37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cb406fab0 0x7f3cb4134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cb37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3cb406fab0 0x7f3cb4134820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60356/0 (socket says 172.21.15.37:60356) 2024-09-19T11:13:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cb3fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3cb406efc0 0x7f3cb406f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53374/0 (socket says 172.21.15.37:53374) 2024-09-19T11:13:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cb37fe640 1 -- 172.21.15.37:0/1300507027 learned_addr learned my addr 172.21.15.37:0/1300507027 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cb37fe640 1 -- 172.21.15.37:0/1300507027 >> v1:172.21.15.37:6789/0 conn(0x7f3cb406efc0 legacy=0x7f3cb406f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.304 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7f3cb37fe640 1 -- 172.21.15.37:0/1300507027 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb4070640 con 0x7f3cb406fab0 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7ff09bfbb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412c0b0 0x7ff094122b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.300+0000 7ff09bfbb640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff094070c40 con 0x7ff09412c0b0 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff099d57640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412c0b0 0x7ff094122b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff099d57640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412c0b0 0x7ff094122b50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60364/0 (socket says 172.21.15.37:60364) 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff099d57640 1 -- 172.21.15.37:0/3007574157 learned_addr learned my addr 172.21.15.37:0/3007574157 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff099d57640 1 -- 172.21.15.37:0/3007574157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff094123df0 con 0x7ff09412c0b0 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff099d57640 1 --2- 172.21.15.37:0/3007574157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412c0b0 0x7ff094122b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff09000c450 tx=0x7ff09000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff08a7fc640 1 -- 172.21.15.37:0/3007574157 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff090017070 con 0x7ff09412c0b0 2024-09-19T11:13:24.306 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff08a7fc640 1 -- 172.21.15.37:0/3007574157 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff090005c10 con 0x7ff09412c0b0 2024-09-19T11:13:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff08a7fc640 1 -- 172.21.15.37:0/3007574157 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0900070d0 con 0x7ff09412c0b0 2024-09-19T11:13:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff0940974f0 con 0x7ff09412c0b0 2024-09-19T11:13:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff094123090 con 0x7ff09412c0b0 2024-09-19T11:13:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.301+0000 7f3cb37fe640 1 --2- 172.21.15.37:0/1300507027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406fab0 0x7f3cb4134820 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80097f0 tx=0x7f3ca802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b584badf6465f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.302+0000 7f3cb2ffd640 1 -- 172.21.15.37:0/1300507027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ca8037070 con 0x7f3cb406fab0 2024-09-19T11:13:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.302+0000 7f3cb2ffd640 1 -- 172.21.15.37:0/1300507027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca8032440 con 0x7f3cb406fab0 2024-09-19T11:13:24.307 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.302+0000 7f3cb2ffd640 1 -- 172.21.15.37:0/1300507027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ca802ae60 con 0x7f3cb406fab0 2024-09-19T11:13:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7f3cba58a640 1 -- 172.21.15.37:0/1300507027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406fab0 msgr2=0x7f3cb4134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff09412c490 con 0x7ff09412c0b0 2024-09-19T11:13:24.308 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7f3cba58a640 1 --2- 172.21.15.37:0/1300507027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406fab0 0x7f3cb4134820 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x7f3ca80097f0 tx=0x7f3ca802a1e0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7f3cba58a640 1 -- 172.21.15.37:0/1300507027 shutdown_connections 2024-09-19T11:13:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7f3cba58a640 1 --2- 172.21.15.37:0/1300507027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406fab0 0x7f3cb4134820 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7f3cba58a640 1 -- 172.21.15.37:0/1300507027 >> 172.21.15.37:0/1300507027 conn(0x7f3cb40a2460 msgr2=0x7f3cb409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7ff08a7fc640 1 -- 172.21.15.37:0/3007574157 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff09001a070 con 0x7ff09412c0b0 2024-09-19T11:13:24.309 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7f3cba58a640 1 -- 172.21.15.37:0/1300507027 shutdown_connections 2024-09-19T11:13:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7f3cba58a640 1 -- 172.21.15.37:0/1300507027 wait complete. 2024-09-19T11:13:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7ff08a7fc640 1 --2- 172.21.15.37:0/3007574157 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff07803e6f0 0x7ff078040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.303+0000 7ff08a7fc640 1 -- 172.21.15.37:0/3007574157 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7ff090052110 con 0x7ff09412c0b0 2024-09-19T11:13:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.304+0000 7ff099556640 1 --2- 172.21.15.37:0/3007574157 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff07803e6f0 0x7ff078040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.310 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.304+0000 7ff099556640 1 --2- 172.21.15.37:0/3007574157 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff07803e6f0 0x7ff078040bb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff084037000 tx=0x7ff084008040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.304+0000 7f3cba58a640 1 Processor -- start 2024-09-19T11:13:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.305+0000 7f3cba58a640 1 -- start start 2024-09-19T11:13:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.305+0000 7f3cba58a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406efc0 0x7f3cb412be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.311 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.305+0000 7f3cba58a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3cb4134ee0 con 0x7f3cb406efc0 2024-09-19T11:13:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.305+0000 7f3cb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406efc0 0x7f3cb412be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.305+0000 7f3cb3fff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406efc0 0x7f3cb412be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60366/0 (socket says 172.21.15.37:60366) 2024-09-19T11:13:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.305+0000 7f3cb3fff640 1 -- 172.21.15.37:0/2856949097 learned_addr learned my addr 172.21.15.37:0/2856949097 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.306+0000 7f3cb3fff640 1 -- 172.21.15.37:0/2856949097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3cb41291a0 con 0x7f3cb406efc0 2024-09-19T11:13:24.312 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.306+0000 7f3cb3fff640 1 --2- 172.21.15.37:0/2856949097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406efc0 0x7f3cb412be30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c450 tx=0x7f3ca400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.309+0000 7fdfbeaf6640 1 Processor -- start 2024-09-19T11:13:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.309+0000 7fdfbeaf6640 1 -- start start 2024-09-19T11:13:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.310+0000 7fdfbeaf6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdfb806fab0 0x7fdfb8134820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.310+0000 7fdfbeaf6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fdfb8070330 con 0x7fdfb806efc0 2024-09-19T11:13:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.310+0000 7fdfbeaf6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fdfb809f310 con 0x7fdfb806fab0 2024-09-19T11:13:24.313 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.310+0000 7fdfaffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fdfb806fab0 0x7fdfb8134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.310+0000 7fdfbc892640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fdfb806efc0 0x7fdfb806f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53380/0 (socket says 172.21.15.37:53380) 2024-09-19T11:13:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.310+0000 7fdfbc892640 1 -- 172.21.15.37:0/319258709 learned_addr learned my addr 172.21.15.37:0/319258709 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.310+0000 7fdfaffff640 1 -- 172.21.15.37:0/319258709 >> v1:172.21.15.37:6789/0 conn(0x7fdfb806efc0 legacy=0x7fdfb806f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.311+0000 7fdfaffff640 1 -- 172.21.15.37:0/319258709 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb8070640 con 0x7fdfb806fab0 2024-09-19T11:13:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.311+0000 7fdfaffff640 1 --2- 172.21.15.37:0/319258709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806fab0 0x7fdfb8134820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009720 tx=0x7fdfa802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ae78227de86c6df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.314 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.311+0000 7ff08a7fc640 1 -- 172.21.15.37:0/3007574157 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7ff09001ad70 con 0x7ff09412c0b0 2024-09-19T11:13:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.311+0000 7f3cb0ff9640 1 -- 172.21.15.37:0/2856949097 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ca4007410 con 0x7f3cb406efc0 2024-09-19T11:13:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.312+0000 7f3cb0ff9640 1 -- 172.21.15.37:0/2856949097 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3ca40075b0 con 0x7f3cb406efc0 2024-09-19T11:13:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.312+0000 7f3cb0ff9640 1 -- 172.21.15.37:0/2856949097 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3ca4004950 con 0x7f3cb406efc0 2024-09-19T11:13:24.315 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.312+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3cb412a390 con 0x7f3cb406efc0 2024-09-19T11:13:24.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.312+0000 7fdfaf7fe640 1 -- 172.21.15.37:0/319258709 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfa8037070 con 0x7fdfb806fab0 2024-09-19T11:13:24.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.312+0000 7fdfaf7fe640 1 -- 172.21.15.37:0/319258709 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfa802ad90 con 0x7fdfb806fab0 2024-09-19T11:13:24.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.312+0000 7fdfaf7fe640 1 -- 172.21.15.37:0/319258709 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfa8032590 con 0x7fdfb806fab0 2024-09-19T11:13:24.316 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.312+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3cb412b140 con 0x7f3cb406efc0 2024-09-19T11:13:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/319258709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806fab0 msgr2=0x7fdfb8134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7fdfbeaf6640 1 --2- 172.21.15.37:0/319258709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806fab0 0x7fdfb8134820 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8009720 tx=0x7fdfa802a110 comp rx=0 tx=0).stop 2024-09-19T11:13:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/319258709 shutdown_connections 2024-09-19T11:13:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7fdfbeaf6640 1 --2- 172.21.15.37:0/319258709 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806fab0 0x7fdfb8134820 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.317 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/319258709 >> 172.21.15.37:0/319258709 conn(0x7fdfb80a2460 msgr2=0x7fdfb809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3cb406f3a0 con 0x7f3cb406efc0 2024-09-19T11:13:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/319258709 shutdown_connections 2024-09-19T11:13:24.318 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/319258709 wait complete. 2024-09-19T11:13:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.313+0000 7f3cb0ff9640 1 -- 172.21.15.37:0/2856949097 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3ca4004af0 con 0x7f3cb406efc0 2024-09-19T11:13:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.314+0000 7f3cb0ff9640 1 --2- 172.21.15.37:0/2856949097 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ca003e760 0x7f3ca0040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.314+0000 7f3cb0ff9640 1 -- 172.21.15.37:0/2856949097 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f3ca4052230 con 0x7f3cb406efc0 2024-09-19T11:13:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.314+0000 7fdfbeaf6640 1 Processor -- start 2024-09-19T11:13:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.314+0000 7fdfbeaf6640 1 -- start start 2024-09-19T11:13:24.319 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.314+0000 7f3cb37fe640 1 --2- 172.21.15.37:0/2856949097 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ca003e760 0x7f3ca0040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.315+0000 7fdfbeaf6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806efc0 0x7fdfb812bb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.320 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.315+0000 7f3cb37fe640 1 --2- 172.21.15.37:0/2856949097 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ca003e760 0x7f3ca0040c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8034000 tx=0x7f3ca802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.315+0000 7fdfbeaf6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fdfb8134ee0 con 0x7fdfb806efc0 2024-09-19T11:13:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.315+0000 7fdfbc892640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806efc0 0x7fdfb812bb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.315+0000 7fdfbc892640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806efc0 0x7fdfb812bb50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60386/0 (socket says 172.21.15.37:60386) 2024-09-19T11:13:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.315+0000 7fdfbc892640 1 -- 172.21.15.37:0/2456470955 learned_addr learned my addr 172.21.15.37:0/2456470955 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.315+0000 7fdfbc892640 1 -- 172.21.15.37:0/2456470955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fdfb81298f0 con 0x7fdfb806efc0 2024-09-19T11:13:24.321 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.315+0000 7fdfbc892640 1 --2- 172.21.15.37:0/2456470955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806efc0 0x7fdfb812bb50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400c480 tx=0x7fdfb400c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.323 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.322+0000 7fdfad7fa640 1 -- 172.21.15.37:0/2456470955 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb4017070 con 0x7fdfb806efc0 2024-09-19T11:13:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.322+0000 7fdfad7fa640 1 -- 172.21.15.37:0/2456470955 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdfb4005c10 con 0x7fdfb806efc0 2024-09-19T11:13:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.322+0000 7fdfad7fa640 1 -- 172.21.15.37:0/2456470955 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdfb4007070 con 0x7fdfb806efc0 2024-09-19T11:13:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.322+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fdfb812b5d0 con 0x7fdfb806efc0 2024-09-19T11:13:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.322+0000 7f3cb0ff9640 1 -- 172.21.15.37:0/2856949097 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f3ca4019310 con 0x7f3cb406efc0 2024-09-19T11:13:24.324 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.323+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fdfb812c090 con 0x7fdfb806efc0 2024-09-19T11:13:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.324+0000 7fdfad7fa640 1 -- 172.21.15.37:0/2456470955 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdfb401a070 con 0x7fdfb806efc0 2024-09-19T11:13:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.324+0000 7fdfad7fa640 1 --2- 172.21.15.37:0/2456470955 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdfa403e760 0x7fdfa4040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.324+0000 7fdfad7fa640 1 -- 172.21.15.37:0/2456470955 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fdfb4051fe0 con 0x7fdfb806efc0 2024-09-19T11:13:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.324+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fdfb806f3a0 con 0x7fdfb806efc0 2024-09-19T11:13:24.325 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.324+0000 7fdfaffff640 1 --2- 172.21.15.37:0/2456470955 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdfa403e760 0x7fdfa4040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:24.326 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.325+0000 7fdfaffff640 1 --2- 172.21.15.37:0/2456470955 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdfa403e760 0x7fdfa4040c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8034000 tx=0x7fdfa802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:24.334 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.333+0000 7fdfad7fa640 1 -- 172.21.15.37:0/2456470955 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fdfb401ac60 con 0x7fdfb806efc0 2024-09-19T11:13:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.489+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7f6f4c12a690 con 0x7f6f4c06efc0 2024-09-19T11:13:24.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.489+0000 7f6f3affd640 1 -- 172.21.15.37:0/2168377079 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f6f3c010d40 con 0x7f6f4c06efc0 2024-09-19T11:13:24.491 INFO:teuthology.orchestra.run.smithi037.stdout:47244640261 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6f2c03e790 msgr2=0x7f6f2c040c50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 --2- 172.21.15.37:0/2168377079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6f2c03e790 0x7f6f2c040c50 secure :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0x7f6f40034000 tx=0x7f6f4002e000 comp rx=0 tx=0).stop 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06efc0 msgr2=0x7f6f4c1279d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 --2- 172.21.15.37:0/2168377079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06efc0 0x7f6f4c1279d0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f6f3c00c3d0 tx=0x7f6f3c00c890 comp rx=0 tx=0).stop 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 shutdown_connections 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 --2- 172.21.15.37:0/2168377079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6f2c03e790 0x7f6f2c040c50 unknown :-1 s=CLOSED pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 --2- 172.21.15.37:0/2168377079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6f4c06efc0 0x7f6f4c1279d0 unknown :-1 s=CLOSED pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 >> 172.21.15.37:0/2168377079 conn(0x7f6f4c0a2460 msgr2=0x7f6f4c09dbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 shutdown_connections 2024-09-19T11:13:24.494 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.492+0000 7f6f50ec6640 1 -- 172.21.15.37:0/2168377079 wait complete. 2024-09-19T11:13:24.509 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.2 2024-09-19T11:13:24.509 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.509+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7ff094074090 con 0x7ff09412c0b0 2024-09-19T11:13:24.510 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.509+0000 7ff08a7fc640 1 -- 172.21.15.37:0/3007574157 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff09001b8d0 con 0x7ff09412c0b0 2024-09-19T11:13:24.510 INFO:teuthology.orchestra.run.smithi037.stdout:47244640261 2024-09-19T11:13:24.511 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f3cb4129790 con 0x7f3cb406efc0 2024-09-19T11:13:24.512 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7f3cb0ff9640 1 -- 172.21.15.37:0/2856949097 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f3ca4004de0 con 0x7f3cb406efc0 2024-09-19T11:13:24.512 INFO:teuthology.orchestra.run.smithi037.stdout:38654705668 2024-09-19T11:13:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff07803e6f0 msgr2=0x7ff078040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 --2- 172.21.15.37:0/3007574157 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff07803e6f0 0x7ff078040bb0 secure :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0x7ff084037000 tx=0x7ff084008040 comp rx=0 tx=0).stop 2024-09-19T11:13:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412c0b0 msgr2=0x7ff094122b50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 --2- 172.21.15.37:0/3007574157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412c0b0 0x7ff094122b50 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7ff09000c450 tx=0x7ff09000c910 comp rx=0 tx=0).stop 2024-09-19T11:13:24.513 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 shutdown_connections 2024-09-19T11:13:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 --2- 172.21.15.37:0/3007574157 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff07803e6f0 0x7ff078040bb0 unknown :-1 s=CLOSED pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 --2- 172.21.15.37:0/3007574157 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff09412c0b0 0x7ff094122b50 unknown :-1 s=CLOSED pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 >> 172.21.15.37:0/3007574157 conn(0x7ff09409abc0 msgr2=0x7ff09409c1b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 shutdown_connections 2024-09-19T11:13:24.514 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.511+0000 7ff09bfbb640 1 -- 172.21.15.37:0/3007574157 wait complete. 2024-09-19T11:13:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ca003e760 msgr2=0x7f3ca0040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 --2- 172.21.15.37:0/2856949097 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ca003e760 0x7f3ca0040c20 secure :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0x7f3ca8034000 tx=0x7f3ca802e000 comp rx=0 tx=0).stop 2024-09-19T11:13:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406efc0 msgr2=0x7f3cb412be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 --2- 172.21.15.37:0/2856949097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406efc0 0x7f3cb412be30 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f3ca400c450 tx=0x7f3ca400c910 comp rx=0 tx=0).stop 2024-09-19T11:13:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 shutdown_connections 2024-09-19T11:13:24.515 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 --2- 172.21.15.37:0/2856949097 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ca003e760 0x7f3ca0040c20 unknown :-1 s=CLOSED pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 --2- 172.21.15.37:0/2856949097 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3cb406efc0 0x7f3cb412be30 unknown :-1 s=CLOSED pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 >> 172.21.15.37:0/2856949097 conn(0x7f3cb40a2460 msgr2=0x7f3cb409d030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 shutdown_connections 2024-09-19T11:13:24.516 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.514+0000 7f3cba58a640 1 -- 172.21.15.37:0/2856949097 wait complete. 2024-09-19T11:13:24.524 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640261 for osd.1 2024-09-19T11:13:24.526 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705668 for osd.0 2024-09-19T11:13:24.541 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.541+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7fdfb812a4f0 con 0x7fdfb806efc0 2024-09-19T11:13:24.542 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.541+0000 7fdfad7fa640 1 -- 172.21.15.37:0/2456470955 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fdfb4050eb0 con 0x7fdfb806efc0 2024-09-19T11:13:24.542 INFO:teuthology.orchestra.run.smithi037.stdout:47244640260 2024-09-19T11:13:24.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdfa403e760 msgr2=0x7fdfa4040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.544 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 --2- 172.21.15.37:0/2456470955 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdfa403e760 0x7fdfa4040c20 secure :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0x7fdfa8034000 tx=0x7fdfa802e000 comp rx=0 tx=0).stop 2024-09-19T11:13:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806efc0 msgr2=0x7fdfb812bb50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 --2- 172.21.15.37:0/2456470955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806efc0 0x7fdfb812bb50 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7fdfb400c480 tx=0x7fdfb400c940 comp rx=0 tx=0).stop 2024-09-19T11:13:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 shutdown_connections 2024-09-19T11:13:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 --2- 172.21.15.37:0/2456470955 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdfa403e760 0x7fdfa4040c20 unknown :-1 s=CLOSED pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 --2- 172.21.15.37:0/2456470955 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fdfb806efc0 0x7fdfb812bb50 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 >> 172.21.15.37:0/2456470955 conn(0x7fdfb80a2460 msgr2=0x7fdfb812f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 shutdown_connections 2024-09-19T11:13:24.545 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:24.543+0000 7fdfbeaf6640 1 -- 172.21.15.37:0/2456470955 wait complete. 2024-09-19T11:13:24.555 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640260 for osd.3 2024-09-19T11:13:25.510 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.2 2024-09-19T11:13:25.524 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.1 2024-09-19T11:13:25.527 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.0 2024-09-19T11:13:25.555 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd last-stat-seq osd.3 2024-09-19T11:13:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.630+0000 7fede907f640 1 Processor -- start 2024-09-19T11:13:25.631 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.630+0000 7fede907f640 1 -- start start 2024-09-19T11:13:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede907f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fede406fab0 0x7fede4134820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede907f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fede4070330 con 0x7fede406efc0 2024-09-19T11:13:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede907f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fede409f310 con 0x7fede406fab0 2024-09-19T11:13:25.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede2d9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fede406efc0 0x7fede406f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53390/0 (socket says 172.21.15.37:53390) 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede259c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fede406fab0 0x7fede4134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede2d9d640 1 -- 172.21.15.37:0/2124117990 learned_addr learned my addr 172.21.15.37:0/2124117990 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede259c640 1 -- 172.21.15.37:0/2124117990 >> v1:172.21.15.37:6789/0 conn(0x7fede406efc0 legacy=0x7fede406f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede259c640 1 -- 172.21.15.37:0/2124117990 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede4070640 con 0x7fede406fab0 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.631+0000 7fede1d9b640 1 -- 172.21.15.37:0/2124117990 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2944243449 0 0) 0x7fede4070330 con 0x7fede406efc0 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.632+0000 7fede259c640 1 --2- 172.21.15.37:0/2124117990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406fab0 0x7fede4134820 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009720 tx=0x7fedd802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d491ecca1e6906c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.632+0000 7fede1d9b640 1 -- 172.21.15.37:0/2124117990 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd8037070 con 0x7fede406fab0 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.632+0000 7fede1d9b640 1 -- 172.21.15.37:0/2124117990 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd802ad90 con 0x7fede406fab0 2024-09-19T11:13:25.634 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.632+0000 7fede1d9b640 1 -- 172.21.15.37:0/2124117990 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd8032590 con 0x7fede406fab0 2024-09-19T11:13:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.633+0000 7fede907f640 1 -- 172.21.15.37:0/2124117990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406fab0 msgr2=0x7fede4134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.633+0000 7fede907f640 1 --2- 172.21.15.37:0/2124117990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406fab0 0x7fede4134820 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fedd8009720 tx=0x7fedd802a110 comp rx=0 tx=0).stop 2024-09-19T11:13:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.633+0000 7fede907f640 1 -- 172.21.15.37:0/2124117990 shutdown_connections 2024-09-19T11:13:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.633+0000 7fede907f640 1 --2- 172.21.15.37:0/2124117990 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406fab0 0x7fede4134820 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.635 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.633+0000 7fede907f640 1 -- 172.21.15.37:0/2124117990 >> 172.21.15.37:0/2124117990 conn(0x7fede40a2460 msgr2=0x7fede409e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.633+0000 7fede907f640 1 -- 172.21.15.37:0/2124117990 shutdown_connections 2024-09-19T11:13:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.633+0000 7fede907f640 1 -- 172.21.15.37:0/2124117990 wait complete. 2024-09-19T11:13:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.635+0000 7fede907f640 1 Processor -- start 2024-09-19T11:13:25.636 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.635+0000 7fede907f640 1 -- start start 2024-09-19T11:13:25.637 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.636+0000 7fede907f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406efc0 0x7fede41279c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.636+0000 7fede907f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fede4134ee0 con 0x7fede406efc0 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.636+0000 7fede2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406efc0 0x7fede41279c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.636+0000 7fede2d9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406efc0 0x7fede41279c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60404/0 (socket says 172.21.15.37:60404) 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.636+0000 7fede2d9d640 1 -- 172.21.15.37:0/653958954 learned_addr learned my addr 172.21.15.37:0/653958954 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.636+0000 7fede2d9d640 1 -- 172.21.15.37:0/653958954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fede4129220 con 0x7fede406efc0 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.636+0000 7fede2d9d640 1 --2- 172.21.15.37:0/653958954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406efc0 0x7fede41279c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c3d0 tx=0x7fedd400c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.637+0000 7fedcb7fe640 1 -- 172.21.15.37:0/653958954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd40074d0 con 0x7fede406efc0 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.637+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fede412ccf0 con 0x7fede406efc0 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.637+0000 7fedcb7fe640 1 -- 172.21.15.37:0/653958954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fedd40047e0 con 0x7fede406efc0 2024-09-19T11:13:25.638 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.637+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fede4127f00 con 0x7fede406efc0 2024-09-19T11:13:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.638+0000 7fedcb7fe640 1 -- 172.21.15.37:0/653958954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fedd40074d0 con 0x7fede406efc0 2024-09-19T11:13:25.639 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.638+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fede406f3a0 con 0x7fede406efc0 2024-09-19T11:13:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.639+0000 7fedcb7fe640 1 -- 172.21.15.37:0/653958954 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fedd4011070 con 0x7fede406efc0 2024-09-19T11:13:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.639+0000 7fedcb7fe640 1 --2- 172.21.15.37:0/653958954 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003e8a0 0x7fedd0040d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.639+0000 7fedcb7fe640 1 -- 172.21.15.37:0/653958954 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fedd4052d10 con 0x7fede406efc0 2024-09-19T11:13:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.640+0000 7fede259c640 1 --2- 172.21.15.37:0/653958954 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003e8a0 0x7fedd0040d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.641 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.640+0000 7fede259c640 1 --2- 172.21.15.37:0/653958954 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003e8a0 0x7fedd0040d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fedd8034000 tx=0x7fedd802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.644 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.643+0000 7fedcb7fe640 1 -- 172.21.15.37:0/653958954 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fedd40133c0 con 0x7fede406efc0 2024-09-19T11:13:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.669+0000 7f9e02c6a640 1 Processor -- start 2024-09-19T11:13:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.669+0000 7f9e02c6a640 1 -- start start 2024-09-19T11:13:25.671 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9e02c6a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc09bf90 0x7f9dfc134a10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9e02c6a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f9dfc0706a0 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9e02c6a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f9dfc09f400 con 0x7f9dfc09bf90 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9dfbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc09bf90 0x7f9dfc134a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9dfbfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f9dfc09bf90 0x7f9dfc134a10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60416/0 (socket says 172.21.15.37:60416) 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9dfbfff640 1 -- 172.21.15.37:0/3320986775 learned_addr learned my addr 172.21.15.37:0/3320986775 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9e00a06640 1 --1- 172.21.15.37:0/3320986775 >> v1:172.21.15.37:6789/0 conn(0x7f9dfc09b4a0 0x7f9dfc09b880 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53406/0 (socket says 172.21.15.37:53406) 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9dfbfff640 1 -- 172.21.15.37:0/3320986775 >> v1:172.21.15.37:6789/0 conn(0x7f9dfc09b4a0 legacy=0x7f9dfc09b880 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9dfbfff640 1 -- 172.21.15.37:0/3320986775 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc09f950 con 0x7f9dfc09bf90 2024-09-19T11:13:25.672 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.670+0000 7f9dfb7fe640 1 -- 172.21.15.37:0/3320986775 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3610421110 0 0) 0x7f9dfc0706a0 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.671+0000 7f9dfbfff640 1 --2- 172.21.15.37:0/3320986775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09bf90 0x7f9dfc134a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9de80097f0 tx=0x7f9de802a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=73f748b58fb1a429 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.671+0000 7f9dfb7fe640 1 -- 172.21.15.37:0/3320986775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de8037070 con 0x7f9dfc09bf90 2024-09-19T11:13:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.671+0000 7f9dfb7fe640 1 -- 172.21.15.37:0/3320986775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9de8032440 con 0x7f9dfc09bf90 2024-09-19T11:13:25.673 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.671+0000 7f9dfb7fe640 1 -- 172.21.15.37:0/3320986775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9de8032740 con 0x7f9dfc09bf90 2024-09-19T11:13:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.672+0000 7f9e02c6a640 1 -- 172.21.15.37:0/3320986775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09bf90 msgr2=0x7f9dfc134a10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.672+0000 7f9e02c6a640 1 --2- 172.21.15.37:0/3320986775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09bf90 0x7f9dfc134a10 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7f9de80097f0 tx=0x7f9de802a270 comp rx=0 tx=0).stop 2024-09-19T11:13:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.672+0000 7f9e02c6a640 1 -- 172.21.15.37:0/3320986775 shutdown_connections 2024-09-19T11:13:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.672+0000 7f9e02c6a640 1 --2- 172.21.15.37:0/3320986775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09bf90 0x7f9dfc134a10 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.672+0000 7f9e02c6a640 1 -- 172.21.15.37:0/3320986775 >> 172.21.15.37:0/3320986775 conn(0x7f9dfc0a25b0 msgr2=0x7f9dfc09ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.672+0000 7f9e02c6a640 1 -- 172.21.15.37:0/3320986775 shutdown_connections 2024-09-19T11:13:25.674 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.672+0000 7f9e02c6a640 1 -- 172.21.15.37:0/3320986775 wait complete. 2024-09-19T11:13:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.673+0000 7f9e02c6a640 1 Processor -- start 2024-09-19T11:13:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.673+0000 7f9e02c6a640 1 -- start start 2024-09-19T11:13:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.674+0000 7f9e02c6a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09b4a0 0x7f9dfc1c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.674+0000 7f9e02c6a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f9dfc1350d0 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.674+0000 7f9e00a06640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09b4a0 0x7f9dfc1c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.674+0000 7f9e00a06640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09b4a0 0x7f9dfc1c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60422/0 (socket says 172.21.15.37:60422) 2024-09-19T11:13:25.675 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.674+0000 7f9e00a06640 1 -- 172.21.15.37:0/4015211475 learned_addr learned my addr 172.21.15.37:0/4015211475 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:25.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.675+0000 7f9e00a06640 1 -- 172.21.15.37:0/4015211475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f9dfc073850 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.676 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.675+0000 7f9e00a06640 1 --2- 172.21.15.37:0/4015211475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09b4a0 0x7f9dfc1c43f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c3d0 tx=0x7f9df000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.675+0000 7f9df97fa640 1 -- 172.21.15.37:0/4015211475 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df00074d0 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.675+0000 7f9df97fa640 1 -- 172.21.15.37:0/4015211475 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9df00047e0 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.675+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f9dfc131040 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.675+0000 7f9df97fa640 1 -- 172.21.15.37:0/4015211475 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9df0007670 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.676+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f9dfc1c4b10 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.677+0000 7f9df97fa640 1 -- 172.21.15.37:0/4015211475 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9df0011070 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.677+0000 7f9df97fa640 1 --2- 172.21.15.37:0/4015211475 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9de003e760 0x7f9de0040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.677+0000 7f9df97fa640 1 -- 172.21.15.37:0/4015211475 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f9df00528c0 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.677+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f9dfc073170 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.678 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.677+0000 7f9dfbfff640 1 --2- 172.21.15.37:0/4015211475 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9de003e760 0x7f9de0040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.679 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.678+0000 7f9dfbfff640 1 --2- 172.21.15.37:0/4015211475 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9de003e760 0x7f9de0040c20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9de8034000 tx=0x7f9de802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.680+0000 7f8b30a33640 1 Processor -- start 2024-09-19T11:13:25.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.680+0000 7f8b30a33640 1 -- start start 2024-09-19T11:13:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.681+0000 7f8b30a33640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b2c06efc0 0x7f8b2c06f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.681+0000 7f8b30a33640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8b2c070330 con 0x7f8b2c06f8e0 2024-09-19T11:13:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.681+0000 7f8b30a33640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8b2c09f310 con 0x7f8b2c06efc0 2024-09-19T11:13:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.681+0000 7f8b2a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b2c06efc0 0x7f8b2c06f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.681+0000 7f8b2a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8b2c06efc0 0x7f8b2c06f3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60426/0 (socket says 172.21.15.37:60426) 2024-09-19T11:13:25.682 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.681+0000 7f8b2a59c640 1 -- 172.21.15.37:0/3907246783 learned_addr learned my addr 172.21.15.37:0/3907246783 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.681+0000 7f8b2a59c640 1 -- 172.21.15.37:0/3907246783 >> v1:172.21.15.37:6789/0 conn(0x7f8b2c06f8e0 legacy=0x7f8b2c09b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.681+0000 7f8b2a59c640 1 -- 172.21.15.37:0/3907246783 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c070640 con 0x7f8b2c06efc0 2024-09-19T11:13:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.682+0000 7f8b2a59c640 1 --2- 172.21.15.37:0/3907246783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c06f3a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0097f0 tx=0x7f8b1c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3f1eb81cf7565f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.682+0000 7f8b2959a640 1 -- 172.21.15.37:0/3907246783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c037070 con 0x7f8b2c06efc0 2024-09-19T11:13:25.683 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.682+0000 7f9df97fa640 1 -- 172.21.15.37:0/4015211475 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f9df0012dd0 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.682+0000 7f8b2959a640 1 -- 172.21.15.37:0/3907246783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1c032440 con 0x7f8b2c06efc0 2024-09-19T11:13:25.684 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.682+0000 7f8b2959a640 1 -- 172.21.15.37:0/3907246783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c037070 con 0x7f8b2c06efc0 2024-09-19T11:13:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.683+0000 7f8b30a33640 1 -- 172.21.15.37:0/3907246783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 msgr2=0x7f8b2c06f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.683+0000 7f8b30a33640 1 --2- 172.21.15.37:0/3907246783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c06f3a0 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0097f0 tx=0x7f8b1c02a1e0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.683+0000 7f8b30a33640 1 -- 172.21.15.37:0/3907246783 shutdown_connections 2024-09-19T11:13:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.683+0000 7f8b30a33640 1 --2- 172.21.15.37:0/3907246783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c06f3a0 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.684+0000 7f8b30a33640 1 -- 172.21.15.37:0/3907246783 >> 172.21.15.37:0/3907246783 conn(0x7f8b2c0a2460 msgr2=0x7f8b2c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.684+0000 7f8b30a33640 1 -- 172.21.15.37:0/3907246783 shutdown_connections 2024-09-19T11:13:25.685 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.684+0000 7f8b30a33640 1 -- 172.21.15.37:0/3907246783 wait complete. 2024-09-19T11:13:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.685+0000 7f8b30a33640 1 Processor -- start 2024-09-19T11:13:25.686 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.685+0000 7f8b30a33640 1 -- start start 2024-09-19T11:13:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.686+0000 7f8b30a33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c12b9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.686+0000 7f8b30a33640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8b2c09f870 con 0x7f8b2c06efc0 2024-09-19T11:13:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.686+0000 7f8b2a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c12b9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.686+0000 7f8b2a59c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c12b9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60428/0 (socket says 172.21.15.37:60428) 2024-09-19T11:13:25.687 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.686+0000 7f8b2a59c640 1 -- 172.21.15.37:0/2260362983 learned_addr learned my addr 172.21.15.37:0/2260362983 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.686+0000 7f8b2a59c640 1 -- 172.21.15.37:0/2260362983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8b2c090760 con 0x7f8b2c06efc0 2024-09-19T11:13:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.686+0000 7f8b2a59c640 1 --2- 172.21.15.37:0/2260362983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c12b9b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0097f0 tx=0x7f8b1c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.687+0000 7f8b1affd640 1 -- 172.21.15.37:0/2260362983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c037040 con 0x7f8b2c06efc0 2024-09-19T11:13:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.687+0000 7f8b1affd640 1 -- 172.21.15.37:0/2260362983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8b1c042070 con 0x7f8b2c06efc0 2024-09-19T11:13:25.688 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.687+0000 7f8b1affd640 1 -- 172.21.15.37:0/2260362983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8b1c032740 con 0x7f8b2c06efc0 2024-09-19T11:13:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.687+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8b2c091630 con 0x7f8b2c06efc0 2024-09-19T11:13:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.687+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8b2c12c0d0 con 0x7f8b2c06efc0 2024-09-19T11:13:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.688+0000 7f8b1affd640 1 -- 172.21.15.37:0/2260362983 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8b1c0328e0 con 0x7f8b2c06efc0 2024-09-19T11:13:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.688+0000 7f8b1affd640 1 --2- 172.21.15.37:0/2260362983 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b0c03e710 0x7f8b0c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.689 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.688+0000 7f8b1affd640 1 -- 172.21.15.37:0/2260362983 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f8b1c0738d0 con 0x7f8b2c06efc0 2024-09-19T11:13:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.689+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8b2c0911e0 con 0x7f8b2c06efc0 2024-09-19T11:13:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.689+0000 7f8b29d9b640 1 --2- 172.21.15.37:0/2260362983 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b0c03e710 0x7f8b0c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.690 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.689+0000 7f8b29d9b640 1 --2- 172.21.15.37:0/2260362983 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b0c03e710 0x7f8b0c040bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b200015a0 tx=0x7f8b20007a30 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.694 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.693+0000 7f8b1affd640 1 -- 172.21.15.37:0/2260362983 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f8b1c03c3b0 con 0x7f8b2c06efc0 2024-09-19T11:13:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.709+0000 7ff4a4695640 1 Processor -- start 2024-09-19T11:13:25.710 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.709+0000 7ff4a4695640 1 -- start start 2024-09-19T11:13:25.711 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.710+0000 7ff4a4695640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff49c1326a0 0x7ff49c134a90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.710+0000 7ff4a2431640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff49c12c320 0x7ff49c12c700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53416/0 (socket says 172.21.15.37:53416) 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.710+0000 7ff4a1c30640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff49c1326a0 0x7ff49c134a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.710+0000 7ff4a1c30640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff49c1326a0 0x7ff49c134a90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60438/0 (socket says 172.21.15.37:60438) 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.710+0000 7ff4a2431640 1 -- 172.21.15.37:0/762014023 learned_addr learned my addr 172.21.15.37:0/762014023 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.710+0000 7ff4a4695640 1 -- 172.21.15.37:0/762014023 --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff49c12c0a0 con 0x7ff49c12c320 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.710+0000 7ff4a4695640 1 -- 172.21.15.37:0/762014023 --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff49c098f30 con 0x7ff49c1326a0 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.711+0000 7ff4a1c30640 1 -- 172.21.15.37:0/762014023 >> v1:172.21.15.37:6789/0 conn(0x7ff49c12c320 legacy=0x7ff49c12c700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.711+0000 7ff4a1c30640 1 -- 172.21.15.37:0/762014023 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c073aa0 con 0x7ff49c1326a0 2024-09-19T11:13:25.712 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.711+0000 7ff4a142f640 1 -- 172.21.15.37:0/762014023 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1352897624 0 0) 0x7ff49c12c0a0 con 0x7ff49c12c320 2024-09-19T11:13:25.713 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.711+0000 7ff4a1c30640 1 --2- 172.21.15.37:0/762014023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c1326a0 0x7ff49c134a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009980 tx=0x7ff48c02a420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e6dc09f154b4f19a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a142f640 1 -- 172.21.15.37:0/762014023 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff48c036070 con 0x7ff49c1326a0 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a142f640 1 -- 172.21.15.37:0/762014023 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff48c031530 con 0x7ff49c1326a0 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a142f640 1 -- 172.21.15.37:0/762014023 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff48c031830 con 0x7ff49c1326a0 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a4695640 1 -- 172.21.15.37:0/762014023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c1326a0 msgr2=0x7ff49c134a90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a4695640 1 --2- 172.21.15.37:0/762014023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c1326a0 0x7ff49c134a90 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7ff48c009980 tx=0x7ff48c02a420 comp rx=0 tx=0).stop 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a4695640 1 -- 172.21.15.37:0/762014023 shutdown_connections 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a4695640 1 --2- 172.21.15.37:0/762014023 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c1326a0 0x7ff49c134a90 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a4695640 1 -- 172.21.15.37:0/762014023 >> 172.21.15.37:0/762014023 conn(0x7ff49c09edf0 msgr2=0x7ff49c09f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.712+0000 7ff4a4695640 1 -- 172.21.15.37:0/762014023 shutdown_connections 2024-09-19T11:13:25.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.713+0000 7ff4a4695640 1 -- 172.21.15.37:0/762014023 wait complete. 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.713+0000 7ff4a4695640 1 Processor -- start 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.713+0000 7ff4a4695640 1 -- start start 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.714+0000 7ff4a4695640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c12c320 0x7ff49c124930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.714+0000 7ff4a4695640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff49c1351e0 con 0x7ff49c12c320 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.714+0000 7ff4a2431640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c12c320 0x7ff49c124930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.714+0000 7ff4a2431640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c12c320 0x7ff49c124930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60452/0 (socket says 172.21.15.37:60452) 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.714+0000 7ff4a2431640 1 -- 172.21.15.37:0/1798536252 learned_addr learned my addr 172.21.15.37:0/1798536252 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.714+0000 7ff4a2431640 1 -- 172.21.15.37:0/1798536252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff49c126020 con 0x7ff49c12c320 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.714+0000 7ff4a2431640 1 --2- 172.21.15.37:0/1798536252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c12c320 0x7ff49c124930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c3d0 tx=0x7ff49800c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.715+0000 7ff492ffd640 1 -- 172.21.15.37:0/1798536252 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff4980074d0 con 0x7ff49c12c320 2024-09-19T11:13:25.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.715+0000 7ff492ffd640 1 -- 172.21.15.37:0/1798536252 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff4980047e0 con 0x7ff49c12c320 2024-09-19T11:13:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.715+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff49c127150 con 0x7ff49c12c320 2024-09-19T11:13:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.715+0000 7ff492ffd640 1 -- 172.21.15.37:0/1798536252 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff498007670 con 0x7ff49c12c320 2024-09-19T11:13:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.715+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff49c125050 con 0x7ff49c12c320 2024-09-19T11:13:25.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.716+0000 7ff492ffd640 1 -- 172.21.15.37:0/1798536252 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff498011070 con 0x7ff49c12c320 2024-09-19T11:13:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.716+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff49c12c700 con 0x7ff49c12c320 2024-09-19T11:13:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.716+0000 7ff492ffd640 1 --2- 172.21.15.37:0/1798536252 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff48003e760 0x7ff480040c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.716+0000 7ff492ffd640 1 -- 172.21.15.37:0/1798536252 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7ff498052a00 con 0x7ff49c12c320 2024-09-19T11:13:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.717+0000 7ff4a1c30640 1 --2- 172.21.15.37:0/1798536252 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff48003e760 0x7ff480040c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:25.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.717+0000 7ff4a1c30640 1 --2- 172.21.15.37:0/1798536252 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff48003e760 0x7ff480040c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff48c033000 tx=0x7ff48c008030 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:25.726 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.725+0000 7ff492ffd640 1 -- 172.21.15.37:0/1798536252 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7ff498012dd0 con 0x7ff49c12c320 2024-09-19T11:13:25.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.880+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 1} v 0) -- 0x7f9dfc09b880 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.882 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.881+0000 7f9df97fa640 1 -- 172.21.15.37:0/4015211475 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 1}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f9df0010d70 con 0x7f9dfc09b4a0 2024-09-19T11:13:25.882 INFO:teuthology.orchestra.run.smithi037.stdout:47244640263 2024-09-19T11:13:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9de003e760 msgr2=0x7f9de0040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 --2- 172.21.15.37:0/4015211475 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9de003e760 0x7f9de0040c20 secure :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0x7f9de8034000 tx=0x7f9de802e000 comp rx=0 tx=0).stop 2024-09-19T11:13:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09b4a0 msgr2=0x7f9dfc1c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 --2- 172.21.15.37:0/4015211475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09b4a0 0x7f9dfc1c43f0 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7f9df000c3d0 tx=0x7f9df000c890 comp rx=0 tx=0).stop 2024-09-19T11:13:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 shutdown_connections 2024-09-19T11:13:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 --2- 172.21.15.37:0/4015211475 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f9de003e760 0x7f9de0040c20 unknown :-1 s=CLOSED pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 --2- 172.21.15.37:0/4015211475 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9dfc09b4a0 0x7f9dfc1c43f0 unknown :-1 s=CLOSED pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.885 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 >> 172.21.15.37:0/4015211475 conn(0x7f9dfc0a25b0 msgr2=0x7f9dfc06ebc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 shutdown_connections 2024-09-19T11:13:25.886 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.883+0000 7f9e02c6a640 1 -- 172.21.15.37:0/4015211475 wait complete. 2024-09-19T11:13:25.895 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640263 for osd.1 2024-09-19T11:13:25.896 DEBUG:teuthology.parallel:result is None 2024-09-19T11:13:25.909 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.908+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 2} v 0) -- 0x7fede4129e20 con 0x7fede406efc0 2024-09-19T11:13:25.910 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.909+0000 7fedcb7fe640 1 -- 172.21.15.37:0/653958954 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 2}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7fedd4050cb0 con 0x7fede406efc0 2024-09-19T11:13:25.910 INFO:teuthology.orchestra.run.smithi037.stdout:47244640263 2024-09-19T11:13:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003e8a0 msgr2=0x7fedd0040d60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.912 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 --2- 172.21.15.37:0/653958954 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003e8a0 0x7fedd0040d60 secure :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0x7fedd8034000 tx=0x7fedd802e000 comp rx=0 tx=0).stop 2024-09-19T11:13:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406efc0 msgr2=0x7fede41279c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 --2- 172.21.15.37:0/653958954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406efc0 0x7fede41279c0 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x7fedd400c3d0 tx=0x7fedd400c890 comp rx=0 tx=0).stop 2024-09-19T11:13:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 shutdown_connections 2024-09-19T11:13:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 --2- 172.21.15.37:0/653958954 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003e8a0 0x7fedd0040d60 unknown :-1 s=CLOSED pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 --2- 172.21.15.37:0/653958954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fede406efc0 0x7fede41279c0 unknown :-1 s=CLOSED pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 >> 172.21.15.37:0/653958954 conn(0x7fede40a2460 msgr2=0x7fede4072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 shutdown_connections 2024-09-19T11:13:25.913 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.911+0000 7fede907f640 1 -- 172.21.15.37:0/653958954 wait complete. 2024-09-19T11:13:25.915 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.914+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 3} v 0) -- 0x7ff49c0990c0 con 0x7ff49c12c320 2024-09-19T11:13:25.916 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.915+0000 7ff492ffd640 1 -- 172.21.15.37:0/1798536252 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 3}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7ff498051810 con 0x7ff49c12c320 2024-09-19T11:13:25.916 INFO:teuthology.orchestra.run.smithi037.stdout:47244640262 2024-09-19T11:13:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.918+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff48003e760 msgr2=0x7ff480040c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.918+0000 7ff4a4695640 1 --2- 172.21.15.37:0/1798536252 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff48003e760 0x7ff480040c20 secure :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0x7ff48c033000 tx=0x7ff48c008030 comp rx=0 tx=0).stop 2024-09-19T11:13:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.918+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c12c320 msgr2=0x7ff49c124930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.918+0000 7ff4a4695640 1 --2- 172.21.15.37:0/1798536252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c12c320 0x7ff49c124930 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7ff49800c3d0 tx=0x7ff49800c890 comp rx=0 tx=0).stop 2024-09-19T11:13:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.919+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 shutdown_connections 2024-09-19T11:13:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.919+0000 7ff4a4695640 1 --2- 172.21.15.37:0/1798536252 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff48003e760 0x7ff480040c20 unknown :-1 s=CLOSED pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.919+0000 7ff4a4695640 1 --2- 172.21.15.37:0/1798536252 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff49c12c320 0x7ff49c124930 unknown :-1 s=CLOSED pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.919+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 >> 172.21.15.37:0/1798536252 conn(0x7ff49c09edf0 msgr2=0x7ff49c09a260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.919+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 shutdown_connections 2024-09-19T11:13:25.921 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.919+0000 7ff4a4695640 1 -- 172.21.15.37:0/1798536252 wait complete. 2024-09-19T11:13:25.926 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640262 got 47244640263 for osd.2 2024-09-19T11:13:25.927 DEBUG:teuthology.parallel:result is None 2024-09-19T11:13:25.931 INFO:tasks.ceph.ceph_manager.ceph:need seq 47244640261 got 47244640262 for osd.3 2024-09-19T11:13:25.932 DEBUG:teuthology.parallel:result is None 2024-09-19T11:13:25.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.940+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd last-stat-seq", "id": 0} v 0) -- 0x7f8b2c06f3a0 con 0x7f8b2c06efc0 2024-09-19T11:13:25.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.940+0000 7f8b1affd640 1 -- 172.21.15.37:0/2260362983 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd last-stat-seq", "id": 0}]=0 v0) ==== 74+0+12 (secure 0 0 0) 0x7f8b1c047980 con 0x7f8b2c06efc0 2024-09-19T11:13:25.941 INFO:teuthology.orchestra.run.smithi037.stdout:38654705669 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b0c03e710 msgr2=0x7f8b0c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 --2- 172.21.15.37:0/2260362983 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b0c03e710 0x7f8b0c040bd0 secure :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0x7f8b200015a0 tx=0x7f8b20007a30 comp rx=0 tx=0).stop 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 msgr2=0x7f8b2c12b9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 --2- 172.21.15.37:0/2260362983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c12b9b0 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f8b1c0097f0 tx=0x7f8b1c0046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 shutdown_connections 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 --2- 172.21.15.37:0/2260362983 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8b0c03e710 0x7f8b0c040bd0 unknown :-1 s=CLOSED pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 --2- 172.21.15.37:0/2260362983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8b2c06efc0 0x7f8b2c12b9b0 unknown :-1 s=CLOSED pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 >> 172.21.15.37:0/2260362983 conn(0x7f8b2c0a2460 msgr2=0x7f8b2c12f170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 shutdown_connections 2024-09-19T11:13:25.944 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:25.942+0000 7f8b30a33640 1 -- 172.21.15.37:0/2260362983 wait complete. 2024-09-19T11:13:25.954 INFO:tasks.ceph.ceph_manager.ceph:need seq 38654705669 got 38654705669 for osd.0 2024-09-19T11:13:25.954 DEBUG:teuthology.parallel:result is None 2024-09-19T11:13:25.955 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T11:13:25.955 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:13:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f92017c9640 1 Processor -- start 2024-09-19T11:13:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f92017c9640 1 -- start start 2024-09-19T11:13:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f92017c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91fc12cba0 0x7f91fc1315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f92017c9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f91fc099e20 con 0x7f91fc12c0b0 2024-09-19T11:13:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f92017c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f91fc0715a0 con 0x7f91fc12cba0 2024-09-19T11:13:26.097 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f91f27fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91fc12cba0 0x7f91fc1315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f91faffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f91fc12c0b0 0x7f91fc12c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53432/0 (socket says 172.21.15.37:53432) 2024-09-19T11:13:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f91f27fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f91fc12cba0 0x7f91fc1315e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60464/0 (socket says 172.21.15.37:60464) 2024-09-19T11:13:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.095+0000 7f91faffd640 1 -- 172.21.15.37:0/78395577 learned_addr learned my addr 172.21.15.37:0/78395577 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.096+0000 7f91f27fc640 1 -- 172.21.15.37:0/78395577 >> v1:172.21.15.37:6789/0 conn(0x7f91fc12c0b0 legacy=0x7f91fc12c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.098 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.096+0000 7f91f27fc640 1 -- 172.21.15.37:0/78395577 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc0705b0 con 0x7f91fc12cba0 2024-09-19T11:13:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.096+0000 7f91f27fc640 1 --2- 172.21.15.37:0/78395577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12cba0 0x7f91fc1315e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009750 tx=0x7f91e402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c22a55d4ca2be494 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.096+0000 7f91fa7fc640 1 -- 172.21.15.37:0/78395577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e4037070 con 0x7f91fc12cba0 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f91fa7fc640 1 -- 172.21.15.37:0/78395577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91e402ad80 con 0x7f91fc12cba0 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f91fa7fc640 1 -- 172.21.15.37:0/78395577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91e4032590 con 0x7f91fc12cba0 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f92017c9640 1 -- 172.21.15.37:0/78395577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12cba0 msgr2=0x7f91fc1315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f92017c9640 1 --2- 172.21.15.37:0/78395577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12cba0 0x7f91fc1315e0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009750 tx=0x7f91e402a140 comp rx=0 tx=0).stop 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f92017c9640 1 -- 172.21.15.37:0/78395577 shutdown_connections 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f92017c9640 1 --2- 172.21.15.37:0/78395577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12cba0 0x7f91fc1315e0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f92017c9640 1 -- 172.21.15.37:0/78395577 >> 172.21.15.37:0/78395577 conn(0x7f91fc09abc0 msgr2=0x7f91fc098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f92017c9640 1 -- 172.21.15.37:0/78395577 shutdown_connections 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.097+0000 7f92017c9640 1 -- 172.21.15.37:0/78395577 wait complete. 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.098+0000 7f92017c9640 1 Processor -- start 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.098+0000 7f92017c9640 1 -- start start 2024-09-19T11:13:26.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f92017c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12c0b0 0x7f91fc126170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f92017c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f91fc131b20 con 0x7f91fc12c0b0 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f91faffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12c0b0 0x7f91fc126170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f91faffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12c0b0 0x7f91fc126170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60468/0 (socket says 172.21.15.37:60468) 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f91faffd640 1 -- 172.21.15.37:0/2271283737 learned_addr learned my addr 172.21.15.37:0/2271283737 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f91faffd640 1 -- 172.21.15.37:0/2271283737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f91fc129580 con 0x7f91fc12c0b0 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f91faffd640 1 --2- 172.21.15.37:0/2271283737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12c0b0 0x7f91fc126170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c480 tx=0x7f91ec00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f91f3fff640 1 -- 172.21.15.37:0/2271283737 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec017070 con 0x7f91fc12c0b0 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f91f3fff640 1 -- 172.21.15.37:0/2271283737 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f91ec005c10 con 0x7f91fc12c0b0 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f91fc129140 con 0x7f91fc12c0b0 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f91f3fff640 1 -- 172.21.15.37:0/2271283737 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f91ec007070 con 0x7f91fc12c0b0 2024-09-19T11:13:26.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.099+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f91fc128bb0 con 0x7f91fc12c0b0 2024-09-19T11:13:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.100+0000 7f91f3fff640 1 -- 172.21.15.37:0/2271283737 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f91ec01a070 con 0x7f91fc12c0b0 2024-09-19T11:13:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.100+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f91fc12c490 con 0x7f91fc12c0b0 2024-09-19T11:13:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.100+0000 7f91f3fff640 1 --2- 172.21.15.37:0/2271283737 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f91dc03e710 0x7f91dc040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.100+0000 7f91f3fff640 1 -- 172.21.15.37:0/2271283737 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f91ec051f60 con 0x7f91fc12c0b0 2024-09-19T11:13:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.101+0000 7f91f27fc640 1 --2- 172.21.15.37:0/2271283737 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f91dc03e710 0x7f91dc040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.104 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.101+0000 7f91f27fc640 1 --2- 172.21.15.37:0/2271283737 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f91dc03e710 0x7f91dc040bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009750 tx=0x7f91e402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.105+0000 7f91f3fff640 1 -- 172.21.15.37:0/2271283737 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f91ec01ac60 con 0x7f91fc12c0b0 2024-09-19T11:13:26.289 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.288+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f91fc131900 con 0x7f91dc03e710 2024-09-19T11:13:26.290 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.289+0000 7f91f3fff640 1 -- 172.21.15.37:0/2271283737 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32215 (secure 0 0 0) 0x7f91fc131900 con 0x7f91dc03e710 2024-09-19T11:13:26.291 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:13:26.291 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:13:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.291+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f91dc03e710 msgr2=0x7f91dc040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.291+0000 7f92017c9640 1 --2- 172.21.15.37:0/2271283737 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f91dc03e710 0x7f91dc040bd0 secure :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0x7f91e4009750 tx=0x7f91e402e000 comp rx=0 tx=0).stop 2024-09-19T11:13:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.291+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12c0b0 msgr2=0x7f91fc126170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.291+0000 7f92017c9640 1 --2- 172.21.15.37:0/2271283737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12c0b0 0x7f91fc126170 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f91ec00c480 tx=0x7f91ec00c940 comp rx=0 tx=0).stop 2024-09-19T11:13:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.291+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 shutdown_connections 2024-09-19T11:13:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.291+0000 7f92017c9640 1 --2- 172.21.15.37:0/2271283737 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f91dc03e710 0x7f91dc040bd0 unknown :-1 s=CLOSED pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.291+0000 7f92017c9640 1 --2- 172.21.15.37:0/2271283737 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f91fc12c0b0 0x7f91fc126170 unknown :-1 s=CLOSED pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.293 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.291+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 >> 172.21.15.37:0/2271283737 conn(0x7f91fc09abc0 msgr2=0x7f91fc09c7e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.292+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 shutdown_connections 2024-09-19T11:13:26.294 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.292+0000 7f92017c9640 1 -- 172.21.15.37:0/2271283737 wait complete. 2024-09-19T11:13:26.303 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":23,"stamp":"2024-09-19T11:13:24.509388+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109932,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377428,"statfs":{"total":386547056640,"available":386434486272,"internally_reserved":0,"allocated":1851392,"data_stored":1391362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"5.271658"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254103+0000","last_change":"2024-09-19T11:13:21.254352+0000","last_active":"2024-09-19T11:13:21.254103+0000","last_peered":"2024-09-19T11:13:21.254103+0000","last_clean":"2024-09-19T11:13:21.254103+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:13:21.254103+0000","last_undegraded":"2024-09-19T11:13:21.254103+0000","last_fullsized":"2024-09-19T11:13:21.254103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:50.082399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.259143+0000","last_change":"2024-09-19T11:13:21.259371+0000","last_active":"2024-09-19T11:13:21.259143+0000","last_peered":"2024-09-19T11:13:21.259143+0000","last_clean":"2024-09-19T11:13:21.259143+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:13:21.259143+0000","last_undegraded":"2024-09-19T11:13:21.259143+0000","last_fullsized":"2024-09-19T11:13:21.259143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:58.914941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254717+0000","last_change":"2024-09-19T11:13:21.254921+0000","last_active":"2024-09-19T11:13:21.254717+0000","last_peered":"2024-09-19T11:13:21.254717+0000","last_clean":"2024-09-19T11:13:21.254717+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:13:21.254717+0000","last_undegraded":"2024-09-19T11:13:21.254717+0000","last_fullsized":"2024-09-19T11:13:21.254717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:50.538143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.259092+0000","last_change":"2024-09-19T11:13:21.259380+0000","last_active":"2024-09-19T11:13:21.259092+0000","last_peered":"2024-09-19T11:13:21.259092+0000","last_clean":"2024-09-19T11:13:21.259092+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:13:21.259092+0000","last_undegraded":"2024-09-19T11:13:21.259092+0000","last_fullsized":"2024-09-19T11:13:21.259092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:46.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254900+0000","last_change":"2024-09-19T11:13:21.254900+0000","last_active":"2024-09-19T11:13:21.254900+0000","last_peered":"2024-09-19T11:13:21.254900+0000","last_clean":"2024-09-19T11:13:21.254900+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:13:21.254900+0000","last_undegraded":"2024-09-19T11:13:21.254900+0000","last_fullsized":"2024-09-19T11:13:21.254900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:06.693190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.252481+0000","last_change":"2024-09-19T11:13:21.252701+0000","last_active":"2024-09-19T11:13:21.252481+0000","last_peered":"2024-09-19T11:13:21.252481+0000","last_clean":"2024-09-19T11:13:21.252481+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:13:21.252481+0000","last_undegraded":"2024-09-19T11:13:21.252481+0000","last_fullsized":"2024-09-19T11:13:21.252481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:32.819428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254062+0000","last_change":"2024-09-19T11:13:21.254355+0000","last_active":"2024-09-19T11:13:21.254062+0000","last_peered":"2024-09-19T11:13:21.254062+0000","last_clean":"2024-09-19T11:13:21.254062+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:13:21.254062+0000","last_undegraded":"2024-09-19T11:13:21.254062+0000","last_fullsized":"2024-09-19T11:13:21.254062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:49.014710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254417+0000","last_change":"2024-09-19T11:13:21.254644+0000","last_active":"2024-09-19T11:13:21.254417+0000","last_peered":"2024-09-19T11:13:21.254417+0000","last_clean":"2024-09-19T11:13:21.254417+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:13:21.254417+0000","last_undegraded":"2024-09-19T11:13:21.254417+0000","last_fullsized":"2024-09-19T11:13:21.254417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:09.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'72","reported_seq":110,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.628542+0000","last_change":"2024-09-19T11:13:16.796669+0000","last_active":"2024-09-19T11:13:21.628542+0000","last_peered":"2024-09-19T11:13:21.628542+0000","last_clean":"2024-09-19T11:13:21.628542+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:13:21.628542+0000","last_undegraded":"2024-09-19T11:13:21.628542+0000","last_fullsized":"2024-09-19T11:13:21.628542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_clean_scrub_stamp":"2024-09-19T11:13:15.217500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:15.868833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705669,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":1,"apply_latency_ms":1,"commit_latency_ns":1000000,"apply_latency_ns":1000000},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:13:26.304 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:13:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.404+0000 7fad603ec640 1 Processor -- start 2024-09-19T11:13:26.405 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.404+0000 7fad603ec640 1 -- start start 2024-09-19T11:13:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.404+0000 7fad603ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad5806dfb0 0x7fad5806e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.404+0000 7fad603ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fad58071660 con 0x7fad5806e8d0 2024-09-19T11:13:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.404+0000 7fad603ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fad58072550 con 0x7fad5806dfb0 2024-09-19T11:13:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.404+0000 7fad5e188640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad5806dfb0 0x7fad5806e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.405+0000 7fad5e188640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fad5806dfb0 0x7fad5806e390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60480/0 (socket says 172.21.15.37:60480) 2024-09-19T11:13:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.405+0000 7fad5e188640 1 -- 172.21.15.37:0/3967022733 learned_addr learned my addr 172.21.15.37:0/3967022733 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:26.406 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.405+0000 7fad5d987640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fad5806e8d0 0x7fad58097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53436/0 (socket says 172.21.15.37:53436) 2024-09-19T11:13:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.405+0000 7fad5e188640 1 -- 172.21.15.37:0/3967022733 >> v1:172.21.15.37:6789/0 conn(0x7fad5806e8d0 legacy=0x7fad58097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.405+0000 7fad5e188640 1 -- 172.21.15.37:0/3967022733 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad58099e20 con 0x7fad5806dfb0 2024-09-19T11:13:26.407 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.405+0000 7fad5d186640 1 -- 172.21.15.37:0/3967022733 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 712227625 0 0) 0x7fad58071660 con 0x7fad5806e8d0 2024-09-19T11:13:26.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.405+0000 7fad5e188640 1 --2- 172.21.15.37:0/3967022733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad5806e390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad540097f0 tx=0x7fad5402a270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac3d56002cbf99dd server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad5d186640 1 -- 172.21.15.37:0/3967022733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad54037070 con 0x7fad5806dfb0 2024-09-19T11:13:26.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad5d186640 1 -- 172.21.15.37:0/3967022733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad54032440 con 0x7fad5806dfb0 2024-09-19T11:13:26.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad5d186640 1 -- 172.21.15.37:0/3967022733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad54032740 con 0x7fad5806dfb0 2024-09-19T11:13:26.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad603ec640 1 -- 172.21.15.37:0/3967022733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 msgr2=0x7fad5806e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad603ec640 1 --2- 172.21.15.37:0/3967022733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad5806e390 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x7fad540097f0 tx=0x7fad5402a270 comp rx=0 tx=0).stop 2024-09-19T11:13:26.408 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad603ec640 1 -- 172.21.15.37:0/3967022733 shutdown_connections 2024-09-19T11:13:26.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad603ec640 1 --2- 172.21.15.37:0/3967022733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad5806e390 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad603ec640 1 -- 172.21.15.37:0/3967022733 >> 172.21.15.37:0/3967022733 conn(0x7fad5809abc0 msgr2=0x7fad58098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:26.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad603ec640 1 -- 172.21.15.37:0/3967022733 shutdown_connections 2024-09-19T11:13:26.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.406+0000 7fad603ec640 1 -- 172.21.15.37:0/3967022733 wait complete. 2024-09-19T11:13:26.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.407+0000 7fad603ec640 1 Processor -- start 2024-09-19T11:13:26.409 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.407+0000 7fad603ec640 1 -- start start 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.407+0000 7fad603ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad58129250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad603ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fad5806ece0 con 0x7fad5806dfb0 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad5e188640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad58129250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad5e188640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad58129250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60494/0 (socket says 172.21.15.37:60494) 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad5e188640 1 -- 172.21.15.37:0/25399854 learned_addr learned my addr 172.21.15.37:0/25399854 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad5e188640 1 -- 172.21.15.37:0/25399854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fad5806fb80 con 0x7fad5806dfb0 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad5e188640 1 --2- 172.21.15.37:0/25399854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad58129250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fad5402a2b0 tx=0x7fad540046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad4effd640 1 -- 172.21.15.37:0/25399854 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad54037040 con 0x7fad5806dfb0 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad4effd640 1 -- 172.21.15.37:0/25399854 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fad54004160 con 0x7fad5806dfb0 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fad58070820 con 0x7fad5806dfb0 2024-09-19T11:13:26.411 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad4effd640 1 -- 172.21.15.37:0/25399854 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fad54004440 con 0x7fad5806dfb0 2024-09-19T11:13:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.408+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fad58129970 con 0x7fad5806dfb0 2024-09-19T11:13:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.409+0000 7fad4effd640 1 -- 172.21.15.37:0/25399854 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fad5403a070 con 0x7fad5806dfb0 2024-09-19T11:13:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.409+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fad5806e390 con 0x7fad5806dfb0 2024-09-19T11:13:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.409+0000 7fad4effd640 1 --2- 172.21.15.37:0/25399854 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fad3c03e710 0x7fad3c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.409+0000 7fad4effd640 1 -- 172.21.15.37:0/25399854 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7fad54073620 con 0x7fad5806dfb0 2024-09-19T11:13:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.410+0000 7fad5d987640 1 --2- 172.21.15.37:0/25399854 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fad3c03e710 0x7fad3c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.412 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.410+0000 7fad5d987640 1 --2- 172.21.15.37:0/25399854 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fad3c03e710 0x7fad3c040bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad48000c00 tx=0x7fad480078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.415 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.414+0000 7fad4effd640 1 -- 172.21.15.37:0/25399854 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fad54041020 con 0x7fad5806dfb0 2024-09-19T11:13:26.599 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.598+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fad58074110 con 0x7fad3c03e710 2024-09-19T11:13:26.601 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.599+0000 7fad4effd640 1 -- 172.21.15.37:0/25399854 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+32191 (secure 0 0 0) 0x7fad480070d0 con 0x7fad3c03e710 2024-09-19T11:13:26.601 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:13:26.602 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:13:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fad3c03e710 msgr2=0x7fad3c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 --2- 172.21.15.37:0/25399854 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fad3c03e710 0x7fad3c040bd0 secure :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0x7fad48000c00 tx=0x7fad480078f0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 msgr2=0x7fad58129250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 --2- 172.21.15.37:0/25399854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad58129250 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7fad5402a2b0 tx=0x7fad540046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.603 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 shutdown_connections 2024-09-19T11:13:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 --2- 172.21.15.37:0/25399854 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fad3c03e710 0x7fad3c040bd0 unknown :-1 s=CLOSED pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 --2- 172.21.15.37:0/25399854 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fad5806dfb0 0x7fad58129250 unknown :-1 s=CLOSED pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 >> 172.21.15.37:0/25399854 conn(0x7fad5809abc0 msgr2=0x7fad5812d680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 shutdown_connections 2024-09-19T11:13:26.604 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.602+0000 7fad603ec640 1 -- 172.21.15.37:0/25399854 wait complete. 2024-09-19T11:13:26.613 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":24,"stamp":"2024-09-19T11:13:26.509854+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":590387,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":103,"num_write_kb":1630,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":75,"ondisk_log_size":75,"up":18,"acting":18,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":18,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":109932,"kb_used_data":1808,"kb_used_omap":6,"kb_used_meta":108025,"kb_avail":377377428,"statfs":{"total":386547056640,"available":386434486272,"internally_reserved":0,"allocated":1851392,"data_stored":1391362,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":110618390},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"7.272124"},"pg_stats":[{"pgid":"2.7","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254103+0000","last_change":"2024-09-19T11:13:21.254352+0000","last_active":"2024-09-19T11:13:21.254103+0000","last_peered":"2024-09-19T11:13:21.254103+0000","last_clean":"2024-09-19T11:13:21.254103+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:13:21.254103+0000","last_undegraded":"2024-09-19T11:13:21.254103+0000","last_fullsized":"2024-09-19T11:13:21.254103+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:50.082399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.6","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.259143+0000","last_change":"2024-09-19T11:13:21.259371+0000","last_active":"2024-09-19T11:13:21.259143+0000","last_peered":"2024-09-19T11:13:21.259143+0000","last_clean":"2024-09-19T11:13:21.259143+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:13:21.259143+0000","last_undegraded":"2024-09-19T11:13:21.259143+0000","last_fullsized":"2024-09-19T11:13:21.259143+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:58.914941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.5","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254717+0000","last_change":"2024-09-19T11:13:21.254921+0000","last_active":"2024-09-19T11:13:21.254717+0000","last_peered":"2024-09-19T11:13:21.254717+0000","last_clean":"2024-09-19T11:13:21.254717+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:13:21.254717+0000","last_undegraded":"2024-09-19T11:13:21.254717+0000","last_fullsized":"2024-09-19T11:13:21.254717+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:50.538143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.4","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.259092+0000","last_change":"2024-09-19T11:13:21.259380+0000","last_active":"2024-09-19T11:13:21.259092+0000","last_peered":"2024-09-19T11:13:21.259092+0000","last_clean":"2024-09-19T11:13:21.259092+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:13:21.259092+0000","last_undegraded":"2024-09-19T11:13:21.259092+0000","last_fullsized":"2024-09-19T11:13:21.259092+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:46.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.2","version":"19'2","reported_seq":22,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254900+0000","last_change":"2024-09-19T11:13:21.254900+0000","last_active":"2024-09-19T11:13:21.254900+0000","last_peered":"2024-09-19T11:13:21.254900+0000","last_clean":"2024-09-19T11:13:21.254900+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:13:21.254900+0000","last_undegraded":"2024-09-19T11:13:21.254900+0000","last_fullsized":"2024-09-19T11:13:21.254900+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:06.693190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.1","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.252481+0000","last_change":"2024-09-19T11:13:21.252701+0000","last_active":"2024-09-19T11:13:21.252481+0000","last_peered":"2024-09-19T11:13:21.252481+0000","last_clean":"2024-09-19T11:13:21.252481+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:13:21.252481+0000","last_undegraded":"2024-09-19T11:13:21.252481+0000","last_fullsized":"2024-09-19T11:13:21.252481+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:32.819428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.0","version":"0'0","reported_seq":20,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254062+0000","last_change":"2024-09-19T11:13:21.254355+0000","last_active":"2024-09-19T11:13:21.254062+0000","last_peered":"2024-09-19T11:13:21.254062+0000","last_clean":"2024-09-19T11:13:21.254062+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:13:21.254062+0000","last_undegraded":"2024-09-19T11:13:21.254062+0000","last_fullsized":"2024-09-19T11:13:21.254062+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:49.014710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"2.3","version":"17'1","reported_seq":21,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.254417+0000","last_change":"2024-09-19T11:13:21.254644+0000","last_active":"2024-09-19T11:13:21.254417+0000","last_peered":"2024-09-19T11:13:21.254417+0000","last_clean":"2024-09-19T11:13:21.254417+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:13:21.254417+0000","last_undegraded":"2024-09-19T11:13:21.254417+0000","last_fullsized":"2024-09-19T11:13:21.254417+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:09.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[{"start":"2","length":"1"}]},{"pgid":"1.0","version":"14'72","reported_seq":110,"reported_epoch":19,"state":"active+clean","last_fresh":"2024-09-19T11:13:21.628542+0000","last_change":"2024-09-19T11:13:16.796669+0000","last_active":"2024-09-19T11:13:21.628542+0000","last_peered":"2024-09-19T11:13:21.628542+0000","last_clean":"2024-09-19T11:13:21.628542+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:13:21.628542+0000","last_undegraded":"2024-09-19T11:13:21.628542+0000","last_fullsized":"2024-09-19T11:13:21.628542+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_clean_scrub_stamp":"2024-09-19T11:13:15.217500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:15.868833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640262,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27192,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344648,"statfs":{"total":96636764160,"available":96608919552,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":27654599},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640263,"num_pgs":4,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27768,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344072,"statfs":{"total":96636764160,"available":96608329728,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640263,"num_pgs":2,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27772,"kb_used_data":740,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344068,"statfs":{"total":96636764160,"available":96608325632,"internally_reserved":0,"allocated":757760,"data_stored":643015,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705670,"num_pgs":6,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27200,"kb_used_data":164,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344640,"statfs":{"total":96636764160,"available":96608911360,"internally_reserved":0,"allocated":167936,"data_stored":52666,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:13:26.614 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T11:13:26.614 INFO:tasks.ceph:Waiting until ceph cluster ceph is healthy... 2024-09-19T11:13:26.614 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy 2024-09-19T11:13:26.614 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph health --format=json 2024-09-19T11:13:26.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.713+0000 7f64281ec640 1 Processor -- start 2024-09-19T11:13:26.714 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.713+0000 7f64281ec640 1 -- start start 2024-09-19T11:13:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.713+0000 7f64281ec640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f642006eaa0 0x7f64201326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.713+0000 7f64281ec640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6420071660 con 0x7f642006dfb0 2024-09-19T11:13:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.713+0000 7f64281ec640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6420072550 con 0x7f642006eaa0 2024-09-19T11:13:26.715 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.714+0000 7f6425787640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f642006eaa0 0x7f64201326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.714+0000 7f6425f88640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f642006dfb0 0x7f642006e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:53450/0 (socket says 172.21.15.37:53450) 2024-09-19T11:13:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.714+0000 7f6425f88640 1 -- 172.21.15.37:0/1121176056 learned_addr learned my addr 172.21.15.37:0/1121176056 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:13:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.714+0000 7f6425787640 1 -- 172.21.15.37:0/1121176056 >> v1:172.21.15.37:6789/0 conn(0x7f642006dfb0 legacy=0x7f642006e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.714+0000 7f6424f86640 1 -- 172.21.15.37:0/1121176056 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3806798958 0 0) 0x7f6420071660 con 0x7f642006dfb0 2024-09-19T11:13:26.716 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.714+0000 7f6425787640 1 -- 172.21.15.37:0/1121176056 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6420099e20 con 0x7f642006eaa0 2024-09-19T11:13:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f6425787640 1 --2- 172.21.15.37:0/1121176056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006eaa0 0x7f64201326d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6410009720 tx=0x7f641002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2fe3ff14836fedd9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f6424f86640 1 -- 172.21.15.37:0/1121176056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6410037070 con 0x7f642006eaa0 2024-09-19T11:13:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f6424f86640 1 -- 172.21.15.37:0/1121176056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641002ae20 con 0x7f642006eaa0 2024-09-19T11:13:26.717 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f6424f86640 1 -- 172.21.15.37:0/1121176056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6410032590 con 0x7f642006eaa0 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f64281ec640 1 -- 172.21.15.37:0/1121176056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006eaa0 msgr2=0x7f64201326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f64281ec640 1 --2- 172.21.15.37:0/1121176056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006eaa0 0x7f64201326d0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7f6410009720 tx=0x7f641002a1a0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f64281ec640 1 -- 172.21.15.37:0/1121176056 shutdown_connections 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f64281ec640 1 --2- 172.21.15.37:0/1121176056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006eaa0 0x7f64201326d0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f64281ec640 1 -- 172.21.15.37:0/1121176056 >> 172.21.15.37:0/1121176056 conn(0x7f642009abc0 msgr2=0x7f6420098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f64281ec640 1 -- 172.21.15.37:0/1121176056 shutdown_connections 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.715+0000 7f64281ec640 1 -- 172.21.15.37:0/1121176056 wait complete. 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.716+0000 7f64281ec640 1 Processor -- start 2024-09-19T11:13:26.718 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.716+0000 7f64281ec640 1 -- start start 2024-09-19T11:13:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f64281ec640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006dfb0 0x7f64201c4000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f64281ec640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f64200712d0 con 0x7f642006dfb0 2024-09-19T11:13:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f6425f88640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006dfb0 0x7f64201c4000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f6425f88640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006dfb0 0x7f64201c4000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:60506/0 (socket says 172.21.15.37:60506) 2024-09-19T11:13:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f6425f88640 1 -- 172.21.15.37:0/3264230926 learned_addr learned my addr 172.21.15.37:0/3264230926 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:13:26.720 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f6425f88640 1 -- 172.21.15.37:0/3264230926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f642012a2e0 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f6425f88640 1 --2- 172.21.15.37:0/3264230926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006dfb0 0x7f64201c4000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c3d0 tx=0x7f641c00c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f64167fc640 1 -- 172.21.15.37:0/3264230926 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641c0074d0 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f64167fc640 1 -- 172.21.15.37:0/3264230926 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f641c0047e0 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f64167fc640 1 -- 172.21.15.37:0/3264230926 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f641c007670 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6420074110 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.717+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f642008c4a0 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.718+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f642009c1b0 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.718+0000 7f64167fc640 1 -- 172.21.15.37:0/3264230926 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f641c011070 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.719+0000 7f64167fc640 1 --2- 172.21.15.37:0/3264230926 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f640403e710 0x7f6404040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.719+0000 7f64167fc640 1 -- 172.21.15.37:0/3264230926 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7f641c052940 con 0x7f642006dfb0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.719+0000 7f6425787640 1 --2- 172.21.15.37:0/3264230926 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f640403e710 0x7f6404040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:26.721 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.719+0000 7f6425787640 1 --2- 172.21.15.37:0/3264230926 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f640403e710 0x7f6404040bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6410034000 tx=0x7f641002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:26.724 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.723+0000 7f64167fc640 1 -- 172.21.15.37:0/3264230926 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f642009c1b0 con 0x7f642006dfb0 2024-09-19T11:13:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.951+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "health", "format": "json"} v 0) -- 0x7f642006e390 con 0x7f642006dfb0 2024-09-19T11:13:26.952 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.951+0000 7f64167fc640 1 -- 172.21.15.37:0/3264230926 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "health", "format": "json"}]=0 v0) ==== 72+0+46 (secure 0 0 0) 0x7f641c012dd0 con 0x7f642006dfb0 2024-09-19T11:13:26.952 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:13:26.953 INFO:teuthology.orchestra.run.smithi037.stdout:{"status":"HEALTH_OK","checks":{},"mutes":[]} 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f640403e710 msgr2=0x7f6404040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 --2- 172.21.15.37:0/3264230926 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f640403e710 0x7f6404040bd0 secure :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0x7f6410034000 tx=0x7f641002e000 comp rx=0 tx=0).stop 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006dfb0 msgr2=0x7f64201c4000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 --2- 172.21.15.37:0/3264230926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006dfb0 0x7f64201c4000 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7f641c00c3d0 tx=0x7f641c00c890 comp rx=0 tx=0).stop 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 shutdown_connections 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 --2- 172.21.15.37:0/3264230926 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f640403e710 0x7f6404040bd0 unknown :-1 s=CLOSED pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 --2- 172.21.15.37:0/3264230926 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f642006dfb0 0x7f64201c4000 unknown :-1 s=CLOSED pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 >> 172.21.15.37:0/3264230926 conn(0x7f642009abc0 msgr2=0x7f642012e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 shutdown_connections 2024-09-19T11:13:26.955 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:13:26.953+0000 7f64281ec640 1 -- 172.21.15.37:0/3264230926 wait complete. 2024-09-19T11:13:26.965 INFO:tasks.ceph.ceph_manager.ceph:wait_until_healthy done 2024-09-19T11:13:26.965 INFO:teuthology.run_tasks:Running task rgw... 2024-09-19T11:13:26.981 DEBUG:tasks.rgw:config is {'client.0': None} 2024-09-19T11:13:26.981 DEBUG:tasks.rgw:client list is dict_keys(['client.0']) 2024-09-19T11:13:26.981 INFO:tasks.rgw:Creating data pools 2024-09-19T11:13:26.982 DEBUG:tasks.rgw:Obtaining remote for client client.0 2024-09-19T11:13:26.982 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd erasure-code-profile set client.0 crush-failure-domain=osd k=3 m=1 name=testprofile --cluster ceph 2024-09-19T11:13:27.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.093+0000 7ff5bf590640 1 Processor -- start 2024-09-19T11:13:27.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bf590640 1 -- start start 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bf590640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5b8113850 0x7ff5b8113c30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bf590640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff5b81142f0 con 0x7ff5b80741e0 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bf590640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff5b8074da0 con 0x7ff5b8113850 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bd32c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5b8113850 0x7ff5b8113c30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bcb2b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff5b80741e0 0x7ff5b8074690 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:42254/0 (socket says 172.21.15.102:42254) 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bd32c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff5b8113850 0x7ff5b8113c30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:48550/0 (socket says 172.21.15.102:48550) 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bcb2b640 1 -- 172.21.15.102:0/2941164661 learned_addr learned my addr 172.21.15.102:0/2941164661 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bd32c640 1 -- 172.21.15.102:0/2941164661 >> v1:172.21.15.37:6789/0 conn(0x7ff5b80741e0 legacy=0x7ff5b8074690 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:27.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.094+0000 7ff5bd32c640 1 -- 172.21.15.102:0/2941164661 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b8074f50 con 0x7ff5b8113850 2024-09-19T11:13:27.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.095+0000 7ff5bd32c640 1 --2- 172.21.15.102:0/2941164661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8113850 0x7ff5b8113c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009720 tx=0x7ff5a802a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=792458469daf9e08 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:27.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.095+0000 7ff5b7fff640 1 -- 172.21.15.102:0/2941164661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a8037070 con 0x7ff5b8113850 2024-09-19T11:13:27.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.095+0000 7ff5b7fff640 1 -- 172.21.15.102:0/2941164661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a802ad90 con 0x7ff5b8113850 2024-09-19T11:13:27.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.095+0000 7ff5b7fff640 1 -- 172.21.15.102:0/2941164661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a8032590 con 0x7ff5b8113850 2024-09-19T11:13:27.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.096+0000 7ff5bf590640 1 -- 172.21.15.102:0/2941164661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8113850 msgr2=0x7ff5b8113c30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:27.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.096+0000 7ff5bf590640 1 --2- 172.21.15.102:0/2941164661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8113850 0x7ff5b8113c30 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7ff5a8009720 tx=0x7ff5a802a110 comp rx=0 tx=0).stop 2024-09-19T11:13:27.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.096+0000 7ff5bf590640 1 -- 172.21.15.102:0/2941164661 shutdown_connections 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.096+0000 7ff5bf590640 1 --2- 172.21.15.102:0/2941164661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b8113850 0x7ff5b8113c30 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.096+0000 7ff5bf590640 1 -- 172.21.15.102:0/2941164661 >> 172.21.15.102:0/2941164661 conn(0x7ff5b8070280 msgr2=0x7ff5b80726a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.096+0000 7ff5bf590640 1 -- 172.21.15.102:0/2941164661 shutdown_connections 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.096+0000 7ff5bf590640 1 -- 172.21.15.102:0/2941164661 wait complete. 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.097+0000 7ff5bf590640 1 Processor -- start 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.097+0000 7ff5bf590640 1 -- start start 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.097+0000 7ff5bf590640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b80741e0 0x7ff5b8070780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.097+0000 7ff5bf590640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff5b811bcd0 con 0x7ff5b80741e0 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.097+0000 7ff5bd32c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b80741e0 0x7ff5b8070780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.097+0000 7ff5bd32c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b80741e0 0x7ff5b8070780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:48554/0 (socket says 172.21.15.102:48554) 2024-09-19T11:13:27.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.097+0000 7ff5bd32c640 1 -- 172.21.15.102:0/2703055063 learned_addr learned my addr 172.21.15.102:0/2703055063 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:27.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.097+0000 7ff5bd32c640 1 -- 172.21.15.102:0/2703055063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff5b8072680 con 0x7ff5b80741e0 2024-09-19T11:13:27.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.098+0000 7ff5bd32c640 1 --2- 172.21.15.102:0/2703055063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b80741e0 0x7ff5b8070780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5a802a150 tx=0x7ff5a80046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:27.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.098+0000 7ff5b5ffb640 1 -- 172.21.15.102:0/2703055063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a8041070 con 0x7ff5b80741e0 2024-09-19T11:13:27.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.098+0000 7ff5b5ffb640 1 -- 172.21.15.102:0/2703055063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5a8032e30 con 0x7ff5b80741e0 2024-09-19T11:13:27.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.098+0000 7ff5b5ffb640 1 -- 172.21.15.102:0/2703055063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5a8037040 con 0x7ff5b80741e0 2024-09-19T11:13:27.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.098+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff5b8070d20 con 0x7ff5b80741e0 2024-09-19T11:13:27.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.098+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff5b80712c0 con 0x7ff5b80741e0 2024-09-19T11:13:27.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.099+0000 7ff5b5ffb640 1 -- 172.21.15.102:0/2703055063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff5a8044070 con 0x7ff5b80741e0 2024-09-19T11:13:27.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.099+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff5b8071540 con 0x7ff5b80741e0 2024-09-19T11:13:27.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.099+0000 7ff5b5ffb640 1 --2- 172.21.15.102:0/2703055063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff5a403e6f0 0x7ff5a4040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:27.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.099+0000 7ff5b5ffb640 1 -- 172.21.15.102:0/2703055063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(19..19 src has 1..19) ==== 3538+0+0 (secure 0 0 0) 0x7ff5a8073740 con 0x7ff5b80741e0 2024-09-19T11:13:27.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.099+0000 7ff5bcb2b640 1 --2- 172.21.15.102:0/2703055063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff5a403e6f0 0x7ff5a4040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:27.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.100+0000 7ff5bcb2b640 1 --2- 172.21.15.102:0/2703055063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff5a403e6f0 0x7ff5a4040bb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007fd0 tx=0x7ff5ac007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:27.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.104+0000 7ff5b5ffb640 1 -- 172.21.15.102:0/2703055063 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7ff5a803cdf0 con 0x7ff5b80741e0 2024-09-19T11:13:27.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:27.290+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]} v 0) -- 0x7ff5b8113850 con 0x7ff5b80741e0 2024-09-19T11:13:28.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.170+0000 7ff5b5ffb640 1 -- 172.21.15.102:0/2703055063 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd erasure-code-profile set", "name": "client.0", "profile": ["crush-failure-domain=osd", "k=3", "m=1", "name=testprofile"]}]=0 v21) ==== 171+0+0 (secure 0 0 0) 0x7ff5a804ed60 con 0x7ff5b80741e0 2024-09-19T11:13:28.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff5a403e6f0 msgr2=0x7ff5a4040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:28.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 --2- 172.21.15.102:0/2703055063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff5a403e6f0 0x7ff5a4040bb0 secure :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0x7ff5ac007fd0 tx=0x7ff5ac007aa0 comp rx=0 tx=0).stop 2024-09-19T11:13:28.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b80741e0 msgr2=0x7ff5b8070780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:28.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 --2- 172.21.15.102:0/2703055063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b80741e0 0x7ff5b8070780 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7ff5a802a150 tx=0x7ff5a80046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:28.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 shutdown_connections 2024-09-19T11:13:28.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 --2- 172.21.15.102:0/2703055063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff5a403e6f0 0x7ff5a4040bb0 unknown :-1 s=CLOSED pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:28.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 --2- 172.21.15.102:0/2703055063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff5b80741e0 0x7ff5b8070780 unknown :-1 s=CLOSED pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:28.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 >> 172.21.15.102:0/2703055063 conn(0x7ff5b8070280 msgr2=0x7ff5b810fea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:28.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 shutdown_connections 2024-09-19T11:13:28.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.173+0000 7ff5bf590640 1 -- 172.21.15.102:0/2703055063 wait complete. 2024-09-19T11:13:28.186 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool create default.rgw.buckets.data 64 64 erasure client.0 --cluster ceph 2024-09-19T11:13:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.291+0000 7f6a229a0640 1 Processor -- start 2024-09-19T11:13:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a229a0640 1 -- start start 2024-09-19T11:13:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a229a0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a1c113030 0x7f6a1c113410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a229a0640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6a1c113b30 con 0x7f6a1c1189e0 2024-09-19T11:13:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a229a0640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6a1c119560 con 0x7f6a1c113030 2024-09-19T11:13:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a1bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a1c113030 0x7f6a1c113410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a1bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f6a1c113030 0x7f6a1c113410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:48558/0 (socket says 172.21.15.102:48558) 2024-09-19T11:13:28.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a1bfff640 1 -- 172.21.15.102:0/945062412 learned_addr learned my addr 172.21.15.102:0/945062412 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a13fff640 1 --1- 172.21.15.102:0/945062412 >> v1:172.21.15.37:6789/0 conn(0x7f6a1c1189e0 0x7f6a1c118e50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:42262/0 (socket says 172.21.15.102:42262) 2024-09-19T11:13:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a1bfff640 1 -- 172.21.15.102:0/945062412 >> v1:172.21.15.37:6789/0 conn(0x7f6a1c1189e0 legacy=0x7f6a1c118e50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:28.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.292+0000 7f6a1bfff640 1 -- 172.21.15.102:0/945062412 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c119710 con 0x7f6a1c113030 2024-09-19T11:13:28.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.293+0000 7f6a1bfff640 1 --2- 172.21.15.102:0/945062412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c113410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0097f0 tx=0x7f6a0c02a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a6e453b794d9d1ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.293+0000 7f6a1b7fe640 1 -- 172.21.15.102:0/945062412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c037070 con 0x7f6a1c113030 2024-09-19T11:13:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.293+0000 7f6a1b7fe640 1 -- 172.21.15.102:0/945062412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c032440 con 0x7f6a1c113030 2024-09-19T11:13:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.293+0000 7f6a1b7fe640 1 -- 172.21.15.102:0/945062412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c02ae60 con 0x7f6a1c113030 2024-09-19T11:13:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.294+0000 7f6a229a0640 1 -- 172.21.15.102:0/945062412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 msgr2=0x7f6a1c113410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.294+0000 7f6a229a0640 1 --2- 172.21.15.102:0/945062412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c113410 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c0097f0 tx=0x7f6a0c02a1e0 comp rx=0 tx=0).stop 2024-09-19T11:13:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.294+0000 7f6a229a0640 1 -- 172.21.15.102:0/945062412 shutdown_connections 2024-09-19T11:13:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.294+0000 7f6a229a0640 1 --2- 172.21.15.102:0/945062412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c113410 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:28.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.294+0000 7f6a229a0640 1 -- 172.21.15.102:0/945062412 >> 172.21.15.102:0/945062412 conn(0x7f6a1c06f760 msgr2=0x7f6a1c06fb70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.294+0000 7f6a229a0640 1 -- 172.21.15.102:0/945062412 shutdown_connections 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.294+0000 7f6a229a0640 1 -- 172.21.15.102:0/945062412 wait complete. 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.295+0000 7f6a229a0640 1 Processor -- start 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.295+0000 7f6a229a0640 1 -- start start 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.295+0000 7f6a229a0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c1a78d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.295+0000 7f6a229a0640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f6a1c11ef70 con 0x7f6a1c113030 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.295+0000 7f6a1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c1a78d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.295+0000 7f6a1bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c1a78d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:48574/0 (socket says 172.21.15.102:48574) 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.295+0000 7f6a1bfff640 1 -- 172.21.15.102:0/1198446016 learned_addr learned my addr 172.21.15.102:0/1198446016 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.296+0000 7f6a1bfff640 1 -- 172.21.15.102:0/1198446016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f6a1c1a7ea0 con 0x7f6a1c113030 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.296+0000 7f6a1bfff640 1 --2- 172.21.15.102:0/1198446016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c1a78d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c035040 tx=0x7f6a0c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.296+0000 7f6a197fa640 1 -- 172.21.15.102:0/1198446016 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c041070 con 0x7f6a1c113030 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.296+0000 7f6a197fa640 1 -- 172.21.15.102:0/1198446016 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6a0c03c7a0 con 0x7f6a1c113030 2024-09-19T11:13:28.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.296+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f6a1c1a8130 con 0x7f6a1c113030 2024-09-19T11:13:28.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.296+0000 7f6a197fa640 1 -- 172.21.15.102:0/1198446016 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6a0c037040 con 0x7f6a1c113030 2024-09-19T11:13:28.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.296+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f6a1c1ad100 con 0x7f6a1c113030 2024-09-19T11:13:28.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.297+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f6a1c113410 con 0x7f6a1c113030 2024-09-19T11:13:28.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.297+0000 7f6a197fa640 1 -- 172.21.15.102:0/1198446016 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6a0c044070 con 0x7f6a1c113030 2024-09-19T11:13:28.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.297+0000 7f6a197fa640 1 --2- 172.21.15.102:0/1198446016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f69fc03e740 0x7f69fc040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:28.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.297+0000 7f6a197fa640 1 -- 172.21.15.102:0/1198446016 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(21..21 src has 1..21) ==== 3797+0+0 (secure 0 0 0) 0x7f6a0c073a30 con 0x7f6a1c113030 2024-09-19T11:13:28.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.297+0000 7f6a13fff640 1 --2- 172.21.15.102:0/1198446016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f69fc03e740 0x7f69fc040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:28.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.298+0000 7f6a13fff640 1 --2- 172.21.15.102:0/1198446016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f69fc03e740 0x7f69fc040c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a04001630 tx=0x7f6a04007a20 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:28.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.302+0000 7f6a197fa640 1 -- 172.21.15.102:0/1198446016 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f6a0c03d3f0 con 0x7f6a1c113030 2024-09-19T11:13:28.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:28.479+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"} v 0) -- 0x7f6a1c1189e0 con 0x7f6a1c113030 2024-09-19T11:13:30.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.317+0000 7f6a197fa640 1 -- 172.21.15.102:0/1198446016 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.data", "pg_num": 64, "pgp_num": 64, "pool_type": "erasure", "erasure_code_profile": "client.0"}]=0 pool 'default.rgw.buckets.data' created v23) ==== 227+0+0 (secure 0 0 0) 0x7f6a0c03ac80 con 0x7f6a1c113030 2024-09-19T11:13:30.318 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'default.rgw.buckets.data' created 2024-09-19T11:13:30.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.320+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f69fc03e740 msgr2=0x7f69fc040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:30.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.320+0000 7f6a229a0640 1 --2- 172.21.15.102:0/1198446016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f69fc03e740 0x7f69fc040c00 secure :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0x7f6a04001630 tx=0x7f6a04007a20 comp rx=0 tx=0).stop 2024-09-19T11:13:30.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.321+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 msgr2=0x7f6a1c1a78d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:30.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.321+0000 7f6a229a0640 1 --2- 172.21.15.102:0/1198446016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c1a78d0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7f6a0c035040 tx=0x7f6a0c0046c0 comp rx=0 tx=0).stop 2024-09-19T11:13:30.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.321+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 shutdown_connections 2024-09-19T11:13:30.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.321+0000 7f6a229a0640 1 --2- 172.21.15.102:0/1198446016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f69fc03e740 0x7f69fc040c00 unknown :-1 s=CLOSED pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:30.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.321+0000 7f6a229a0640 1 --2- 172.21.15.102:0/1198446016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f6a1c113030 0x7f6a1c1a78d0 unknown :-1 s=CLOSED pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:30.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.321+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 >> 172.21.15.102:0/1198446016 conn(0x7f6a1c06f760 msgr2=0x7f6a1c111e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:30.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.321+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 shutdown_connections 2024-09-19T11:13:30.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.321+0000 7f6a229a0640 1 -- 172.21.15.102:0/1198446016 wait complete. 2024-09-19T11:13:30.344 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool application enable default.rgw.buckets.data rgw --cluster ceph 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.446+0000 7f699c33a640 1 Processor -- start 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.446+0000 7f699c33a640 1 -- start start 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.446+0000 7f699c33a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69940749e0 0x7f699411c130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.446+0000 7f699c33a640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f6994074e70 con 0x7f6994110900 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.446+0000 7f699c33a640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f6994075040 con 0x7f69940749e0 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.446+0000 7f69998d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69940749e0 0x7f699411c130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.446+0000 7f69998d5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f69940749e0 0x7f699411c130 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38544/0 (socket says 172.21.15.102:38544) 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.446+0000 7f69998d5640 1 -- 172.21.15.102:0/1602139118 learned_addr learned my addr 172.21.15.102:0/1602139118 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:30.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.447+0000 7f69998d5640 1 -- 172.21.15.102:0/1602139118 >> v1:172.21.15.37:6789/0 conn(0x7f6994110900 legacy=0x7f69940742d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:30.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.447+0000 7f69998d5640 1 -- 172.21.15.102:0/1602139118 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f699411d680 con 0x7f69940749e0 2024-09-19T11:13:30.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.447+0000 7f69998d5640 1 --2- 172.21.15.102:0/1602139118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f699411c130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69880097f0 tx=0x7f698802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4bfb11bcf0a82c2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:30.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f69990d4640 1 -- 172.21.15.102:0/1602139118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6988037070 con 0x7f69940749e0 2024-09-19T11:13:30.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f69990d4640 1 -- 172.21.15.102:0/1602139118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6988032440 con 0x7f69940749e0 2024-09-19T11:13:30.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f69990d4640 1 -- 172.21.15.102:0/1602139118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f698802ae60 con 0x7f69940749e0 2024-09-19T11:13:30.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f699c33a640 1 -- 172.21.15.102:0/1602139118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 msgr2=0x7f699411c130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:30.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f699c33a640 1 --2- 172.21.15.102:0/1602139118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f699411c130 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x7f69880097f0 tx=0x7f698802a1e0 comp rx=0 tx=0).stop 2024-09-19T11:13:30.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f699c33a640 1 -- 172.21.15.102:0/1602139118 shutdown_connections 2024-09-19T11:13:30.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f699c33a640 1 --2- 172.21.15.102:0/1602139118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f699411c130 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:30.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f699c33a640 1 -- 172.21.15.102:0/1602139118 >> 172.21.15.102:0/1602139118 conn(0x7f69940702f0 msgr2=0x7f6994072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:30.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f699c33a640 1 -- 172.21.15.102:0/1602139118 shutdown_connections 2024-09-19T11:13:30.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.448+0000 7f699c33a640 1 -- 172.21.15.102:0/1602139118 wait complete. 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.449+0000 7f699c33a640 1 Processor -- start 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.449+0000 7f699c33a640 1 -- start start 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.449+0000 7f699c33a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f69941a5660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.449+0000 7f699c33a640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f699411cb20 con 0x7f69940749e0 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.449+0000 7f699a0d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f69941a5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.449+0000 7f699a0d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f69941a5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38546/0 (socket says 172.21.15.102:38546) 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.449+0000 7f699a0d6640 1 -- 172.21.15.102:0/1888028643 learned_addr learned my addr 172.21.15.102:0/1888028643 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.450+0000 7f699a0d6640 1 -- 172.21.15.102:0/1888028643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f69941a5c30 con 0x7f69940749e0 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.450+0000 7f699a0d6640 1 --2- 172.21.15.102:0/1888028643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f69941a5660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f699000c3d0 tx=0x7f699000c890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.450+0000 7f6986ffd640 1 -- 172.21.15.102:0/1888028643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6990017070 con 0x7f69940749e0 2024-09-19T11:13:30.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.450+0000 7f6986ffd640 1 -- 172.21.15.102:0/1888028643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6990005240 con 0x7f69940749e0 2024-09-19T11:13:30.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.450+0000 7f6986ffd640 1 -- 172.21.15.102:0/1888028643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69900035f0 con 0x7f69940749e0 2024-09-19T11:13:30.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.450+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f69941a5f20 con 0x7f69940749e0 2024-09-19T11:13:30.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.450+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f69941ab0f0 con 0x7f69940749e0 2024-09-19T11:13:30.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.451+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f69941a6260 con 0x7f69940749e0 2024-09-19T11:13:30.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.451+0000 7f6986ffd640 1 -- 172.21.15.102:0/1888028643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f699001a070 con 0x7f69940749e0 2024-09-19T11:13:30.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.452+0000 7f6986ffd640 1 --2- 172.21.15.102:0/1888028643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f697803e6f0 0x7f6978040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:30.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.452+0000 7f6986ffd640 1 -- 172.21.15.102:0/1888028643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(23..23 src has 1..23) ==== 4272+0+0 (secure 0 0 0) 0x7f6990052390 con 0x7f69940749e0 2024-09-19T11:13:30.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.452+0000 7f69998d5640 1 --2- 172.21.15.102:0/1888028643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f697803e6f0 0x7f6978040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:30.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.452+0000 7f69998d5640 1 --2- 172.21.15.102:0/1888028643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f697803e6f0 0x7f6978040bb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6988034000 tx=0x7f698802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:30.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.457+0000 7f6986ffd640 1 -- 172.21.15.102:0/1888028643 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f6990003790 con 0x7f69940749e0 2024-09-19T11:13:30.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:30.635+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"} v 0) -- 0x7f699411d130 con 0x7f69940749e0 2024-09-19T11:13:31.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.322+0000 7f6986ffd640 1 -- 172.21.15.102:0/1888028643 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.data", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.data' v24) ==== 185+0+0 (secure 0 0 0) 0x7f69900520d0 con 0x7f69940749e0 2024-09-19T11:13:31.324 INFO:teuthology.orchestra.run.smithi102.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.data' 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.324+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f697803e6f0 msgr2=0x7f6978040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.324+0000 7f699c33a640 1 --2- 172.21.15.102:0/1888028643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f697803e6f0 0x7f6978040bb0 secure :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0x7f6988034000 tx=0x7f698802e000 comp rx=0 tx=0).stop 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.324+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 msgr2=0x7f69941a5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.324+0000 7f699c33a640 1 --2- 172.21.15.102:0/1888028643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f69941a5660 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x7f699000c3d0 tx=0x7f699000c890 comp rx=0 tx=0).stop 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.325+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 shutdown_connections 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.325+0000 7f699c33a640 1 --2- 172.21.15.102:0/1888028643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f697803e6f0 0x7f6978040bb0 unknown :-1 s=CLOSED pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.325+0000 7f699c33a640 1 --2- 172.21.15.102:0/1888028643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f69940749e0 0x7f69941a5660 unknown :-1 s=CLOSED pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.325+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 >> 172.21.15.102:0/1888028643 conn(0x7f69940702f0 msgr2=0x7f6994116090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:31.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.325+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 shutdown_connections 2024-09-19T11:13:31.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.325+0000 7f699c33a640 1 -- 172.21.15.102:0/1888028643 wait complete. 2024-09-19T11:13:31.348 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool create default.rgw.buckets.index 64 64 --cluster ceph 2024-09-19T11:13:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.465+0000 7fef7c518640 1 Processor -- start 2024-09-19T11:13:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.465+0000 7fef7c518640 1 -- start start 2024-09-19T11:13:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.466+0000 7fef7c518640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef74118740 0x7fef7411ab30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:31.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.466+0000 7fef7c518640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fef7411b100 con 0x7fef741137c0 2024-09-19T11:13:31.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.466+0000 7fef7c518640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fef7411c2e0 con 0x7fef74118740 2024-09-19T11:13:31.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.466+0000 7fef79ab3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef74118740 0x7fef7411ab30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:31.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.466+0000 7fef79ab3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fef74118740 0x7fef7411ab30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38552/0 (socket says 172.21.15.102:38552) 2024-09-19T11:13:31.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.466+0000 7fef7a2b4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fef741137c0 0x7fef74113ba0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:38880/0 (socket says 172.21.15.102:38880) 2024-09-19T11:13:31.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.466+0000 7fef79ab3640 1 -- 172.21.15.102:0/468030517 learned_addr learned my addr 172.21.15.102:0/468030517 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.466+0000 7fef79ab3640 1 -- 172.21.15.102:0/468030517 >> v1:172.21.15.37:6789/0 conn(0x7fef741137c0 legacy=0x7fef74113ba0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.467+0000 7fef79ab3640 1 -- 172.21.15.102:0/468030517 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef7411c460 con 0x7fef74118740 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.467+0000 7fef79ab3640 1 --2- 172.21.15.102:0/468030517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74118740 0x7fef7411ab30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef640097f0 tx=0x7fef6402a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9e9e34aecede092 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.467+0000 7fef792b2640 1 -- 172.21.15.102:0/468030517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef64037070 con 0x7fef74118740 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.467+0000 7fef792b2640 1 -- 172.21.15.102:0/468030517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef64032440 con 0x7fef74118740 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.467+0000 7fef792b2640 1 -- 172.21.15.102:0/468030517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef6402ae60 con 0x7fef74118740 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.468+0000 7fef7c518640 1 -- 172.21.15.102:0/468030517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74118740 msgr2=0x7fef7411ab30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.468+0000 7fef7c518640 1 --2- 172.21.15.102:0/468030517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74118740 0x7fef7411ab30 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7fef640097f0 tx=0x7fef6402a1e0 comp rx=0 tx=0).stop 2024-09-19T11:13:31.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.468+0000 7fef7c518640 1 -- 172.21.15.102:0/468030517 shutdown_connections 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.468+0000 7fef7c518640 1 --2- 172.21.15.102:0/468030517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef74118740 0x7fef7411ab30 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.468+0000 7fef7c518640 1 -- 172.21.15.102:0/468030517 >> 172.21.15.102:0/468030517 conn(0x7fef740702f0 msgr2=0x7fef74072710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.468+0000 7fef7c518640 1 -- 172.21.15.102:0/468030517 shutdown_connections 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.468+0000 7fef7c518640 1 -- 172.21.15.102:0/468030517 wait complete. 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.469+0000 7fef7c518640 1 Processor -- start 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.469+0000 7fef7c518640 1 -- start start 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.469+0000 7fef7c518640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef741137c0 0x7fef741a56d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.469+0000 7fef7c518640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fef7411b7b0 con 0x7fef741137c0 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.469+0000 7fef7a2b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef741137c0 0x7fef741a56d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.469+0000 7fef7a2b4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef741137c0 0x7fef741a56d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38562/0 (socket says 172.21.15.102:38562) 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.469+0000 7fef7a2b4640 1 -- 172.21.15.102:0/35258395 learned_addr learned my addr 172.21.15.102:0/35258395 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:31.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.469+0000 7fef7a2b4640 1 -- 172.21.15.102:0/35258395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fef741a5ca0 con 0x7fef741137c0 2024-09-19T11:13:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.470+0000 7fef7a2b4640 1 --2- 172.21.15.102:0/35258395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef741137c0 0x7fef741a56d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef7000c450 tx=0x7fef7000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.470+0000 7fef6affd640 1 -- 172.21.15.102:0/35258395 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef70007410 con 0x7fef741137c0 2024-09-19T11:13:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.470+0000 7fef6affd640 1 -- 172.21.15.102:0/35258395 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef700075b0 con 0x7fef741137c0 2024-09-19T11:13:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.470+0000 7fef6affd640 1 -- 172.21.15.102:0/35258395 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef70004910 con 0x7fef741137c0 2024-09-19T11:13:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.470+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fef741a5f90 con 0x7fef741137c0 2024-09-19T11:13:31.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.470+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fef741ab0e0 con 0x7fef741137c0 2024-09-19T11:13:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.471+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fef741a62d0 con 0x7fef741137c0 2024-09-19T11:13:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.471+0000 7fef6affd640 1 -- 172.21.15.102:0/35258395 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fef7001a020 con 0x7fef741137c0 2024-09-19T11:13:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.471+0000 7fef6affd640 1 --2- 172.21.15.102:0/35258395 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803e6f0 0x7fef58040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.471+0000 7fef6affd640 1 -- 172.21.15.102:0/35258395 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(24..24 src has 1..24) ==== 4283+0+0 (secure 0 0 0) 0x7fef70052900 con 0x7fef741137c0 2024-09-19T11:13:31.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.471+0000 7fef79ab3640 1 --2- 172.21.15.102:0/35258395 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803e6f0 0x7fef58040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:31.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.471+0000 7fef79ab3640 1 --2- 172.21.15.102:0/35258395 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803e6f0 0x7fef58040bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef64034000 tx=0x7fef6402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:31.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.476+0000 7fef6affd640 1 -- 172.21.15.102:0/35258395 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fef700113a0 con 0x7fef741137c0 2024-09-19T11:13:31.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:31.652+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64} v 0) -- 0x7fef7411be10 con 0x7fef741137c0 2024-09-19T11:13:32.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.327+0000 7fef6affd640 1 -- 172.21.15.102:0/35258395 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool create", "pool": "default.rgw.buckets.index", "pg_num": 64, "pgp_num": 64}]=0 pool 'default.rgw.buckets.index' created v25) ==== 169+0+0 (secure 0 0 0) 0x7fef70004b70 con 0x7fef741137c0 2024-09-19T11:13:32.345 INFO:teuthology.orchestra.run.smithi102.stderr:pool 'default.rgw.buckets.index' created 2024-09-19T11:13:32.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803e6f0 msgr2=0x7fef58040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:32.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 --2- 172.21.15.102:0/35258395 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803e6f0 0x7fef58040bb0 secure :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0x7fef64034000 tx=0x7fef6402e000 comp rx=0 tx=0).stop 2024-09-19T11:13:32.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef741137c0 msgr2=0x7fef741a56d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:32.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 --2- 172.21.15.102:0/35258395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef741137c0 0x7fef741a56d0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7fef7000c450 tx=0x7fef7000c910 comp rx=0 tx=0).stop 2024-09-19T11:13:32.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 shutdown_connections 2024-09-19T11:13:32.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 --2- 172.21.15.102:0/35258395 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803e6f0 0x7fef58040bb0 unknown :-1 s=CLOSED pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:32.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 --2- 172.21.15.102:0/35258395 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fef741137c0 0x7fef741a56d0 unknown :-1 s=CLOSED pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:32.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 >> 172.21.15.102:0/35258395 conn(0x7fef740702f0 msgr2=0x7fef7410ff40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:32.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.329+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 shutdown_connections 2024-09-19T11:13:32.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.330+0000 7fef7c518640 1 -- 172.21.15.102:0/35258395 wait complete. 2024-09-19T11:13:32.352 DEBUG:teuthology.orchestra.run.smithi102:> sudo ceph osd pool application enable default.rgw.buckets.index rgw --cluster ceph 2024-09-19T11:13:32.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.452+0000 7f96169c9640 1 Processor -- start 2024-09-19T11:13:32.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.452+0000 7f96169c9640 1 -- start start 2024-09-19T11:13:32.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.453+0000 7f96169c9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f961011ba40 0x7f961011de70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:32.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.453+0000 7f96169c9640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f961011e520 con 0x7f9610118d90 2024-09-19T11:13:32.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.453+0000 7f96169c9640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f961011f720 con 0x7f961011ba40 2024-09-19T11:13:32.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.453+0000 7f960f7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f961011ba40 0x7f961011de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:32.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.453+0000 7f960ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f9610118d90 0x7f9610119170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:38896/0 (socket says 172.21.15.102:38896) 2024-09-19T11:13:32.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.453+0000 7f960ffff640 1 -- 172.21.15.102:0/247879515 learned_addr learned my addr 172.21.15.102:0/247879515 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:32.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.453+0000 7f960f7fe640 1 -- 172.21.15.102:0/247879515 >> v1:172.21.15.37:6789/0 conn(0x7f9610118d90 legacy=0x7f9610119170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:32.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.453+0000 7f960f7fe640 1 -- 172.21.15.102:0/247879515 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f961011f8d0 con 0x7f961011ba40 2024-09-19T11:13:32.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.454+0000 7f960f7fe640 1 --2- 172.21.15.102:0/247879515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f961011ba40 0x7f961011de70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9604009720 tx=0x7f960402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97a7548a76a3b6a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:32.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.454+0000 7f960effd640 1 -- 172.21.15.102:0/247879515 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9604037070 con 0x7f961011ba40 2024-09-19T11:13:32.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.454+0000 7f960effd640 1 -- 172.21.15.102:0/247879515 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f960402ad90 con 0x7f961011ba40 2024-09-19T11:13:32.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.454+0000 7f960effd640 1 -- 172.21.15.102:0/247879515 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9604032590 con 0x7f961011ba40 2024-09-19T11:13:32.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.455+0000 7f96169c9640 1 -- 172.21.15.102:0/247879515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f961011ba40 msgr2=0x7f961011de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:32.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.455+0000 7f96169c9640 1 --2- 172.21.15.102:0/247879515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f961011ba40 0x7f961011de70 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f9604009720 tx=0x7f960402a110 comp rx=0 tx=0).stop 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.455+0000 7f96169c9640 1 -- 172.21.15.102:0/247879515 shutdown_connections 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.455+0000 7f96169c9640 1 --2- 172.21.15.102:0/247879515 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f961011ba40 0x7f961011de70 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.455+0000 7f96169c9640 1 -- 172.21.15.102:0/247879515 >> 172.21.15.102:0/247879515 conn(0x7f961006f7c0 msgr2=0x7f961006fbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.455+0000 7f96169c9640 1 -- 172.21.15.102:0/247879515 shutdown_connections 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.455+0000 7f96169c9640 1 -- 172.21.15.102:0/247879515 wait complete. 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.455+0000 7f96169c9640 1 Processor -- start 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.456+0000 7f96169c9640 1 -- start start 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.456+0000 7f96169c9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9610118d90 0x7f96101a7990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.456+0000 7f96169c9640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f961011ebd0 con 0x7f9610118d90 2024-09-19T11:13:32.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.456+0000 7f960ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9610118d90 0x7f96101a7990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:32.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.456+0000 7f960ffff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9610118d90 0x7f96101a7990 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38582/0 (socket says 172.21.15.102:38582) 2024-09-19T11:13:32.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.456+0000 7f960ffff640 1 -- 172.21.15.102:0/1900203325 learned_addr learned my addr 172.21.15.102:0/1900203325 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:32.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.456+0000 7f960ffff640 1 -- 172.21.15.102:0/1900203325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f96101a7f60 con 0x7f9610118d90 2024-09-19T11:13:32.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.457+0000 7f960ffff640 1 --2- 172.21.15.102:0/1900203325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9610118d90 0x7f96101a7990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f960000c450 tx=0x7f960000c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:32.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.457+0000 7f960cff9640 1 -- 172.21.15.102:0/1900203325 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9600017070 con 0x7f9610118d90 2024-09-19T11:13:32.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.457+0000 7f960cff9640 1 -- 172.21.15.102:0/1900203325 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9600005c10 con 0x7f9610118d90 2024-09-19T11:13:32.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.457+0000 7f960cff9640 1 -- 172.21.15.102:0/1900203325 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f96000070d0 con 0x7f9610118d90 2024-09-19T11:13:32.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.457+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f96101a8250 con 0x7f9610118d90 2024-09-19T11:13:32.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.457+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f96101ad420 con 0x7f9610118d90 2024-09-19T11:13:32.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.458+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f96101a8590 con 0x7f9610118d90 2024-09-19T11:13:32.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.458+0000 7f960cff9640 1 -- 172.21.15.102:0/1900203325 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f960001a070 con 0x7f9610118d90 2024-09-19T11:13:32.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.458+0000 7f960cff9640 1 --2- 172.21.15.102:0/1900203325 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f95fc03e6f0 0x7f95fc040bb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:32.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.458+0000 7f960cff9640 1 -- 172.21.15.102:0/1900203325 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(25..25 src has 1..25) ==== 4647+0+0 (secure 0 0 0) 0x7f96000525c0 con 0x7f9610118d90 2024-09-19T11:13:32.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.458+0000 7f960f7fe640 1 --2- 172.21.15.102:0/1900203325 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f95fc03e6f0 0x7f95fc040bb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:32.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.459+0000 7f960f7fe640 1 --2- 172.21.15.102:0/1900203325 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f95fc03e6f0 0x7f95fc040bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9604034000 tx=0x7f960402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:32.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.464+0000 7f960cff9640 1 -- 172.21.15.102:0/1900203325 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f960001ad80 con 0x7f9610118d90 2024-09-19T11:13:32.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:32.643+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"} v 0) -- 0x7f961011f230 con 0x7f9610118d90 2024-09-19T11:13:33.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.330+0000 7f960cff9640 1 -- 172.21.15.102:0/1900203325 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd pool application enable", "pool": "default.rgw.buckets.index", "app": "rgw"}]=0 enabled application 'rgw' on pool 'default.rgw.buckets.index' v26) ==== 187+0+0 (secure 0 0 0) 0x7f960001b8d0 con 0x7f9610118d90 2024-09-19T11:13:33.332 INFO:teuthology.orchestra.run.smithi102.stderr:enabled application 'rgw' on pool 'default.rgw.buckets.index' 2024-09-19T11:13:33.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.334+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f95fc03e6f0 msgr2=0x7f95fc040bb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:33.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.334+0000 7f96169c9640 1 --2- 172.21.15.102:0/1900203325 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f95fc03e6f0 0x7f95fc040bb0 secure :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0x7f9604034000 tx=0x7f960402e000 comp rx=0 tx=0).stop 2024-09-19T11:13:33.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.334+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9610118d90 msgr2=0x7f96101a7990 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:33.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.334+0000 7f96169c9640 1 --2- 172.21.15.102:0/1900203325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9610118d90 0x7f96101a7990 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x7f960000c450 tx=0x7f960000c910 comp rx=0 tx=0).stop 2024-09-19T11:13:33.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.338+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 shutdown_connections 2024-09-19T11:13:33.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.338+0000 7f96169c9640 1 --2- 172.21.15.102:0/1900203325 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f95fc03e6f0 0x7f95fc040bb0 unknown :-1 s=CLOSED pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:33.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.338+0000 7f96169c9640 1 --2- 172.21.15.102:0/1900203325 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f9610118d90 0x7f96101a7990 unknown :-1 s=CLOSED pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:33.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.338+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 >> 172.21.15.102:0/1900203325 conn(0x7f961006f7c0 msgr2=0x7f961011be20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:33.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.348+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 shutdown_connections 2024-09-19T11:13:33.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:33.349+0000 7f96169c9640 1 -- 172.21.15.102:0/1900203325 wait complete. 2024-09-19T11:13:33.369 DEBUG:tasks.rgw:Pools created 2024-09-19T11:13:33.369 INFO:tasks.rgw:Starting rgw... 2024-09-19T11:13:33.370 INFO:tasks.rgw:rgw client.0 config is {} 2024-09-19T11:13:33.370 INFO:tasks.rgw:Using beast as radosgw frontend 2024-09-19T11:13:33.370 DEBUG:teuthology.orchestra.run.smithi102:> sudo echo -n http://smithi102.front.sepia.ceph.com:80 | sudo tee /home/ubuntu/cephtest/url_file 2024-09-19T11:13:33.398 INFO:teuthology.orchestra.run.smithi102.stdout:http://smithi102.front.sepia.ceph.com:80 2024-09-19T11:13:33.398 DEBUG:teuthology.orchestra.run.smithi102:> sudo chown ceph /home/ubuntu/cephtest/url_file 2024-09-19T11:13:33.465 INFO:tasks.rgw.client.0:Restarting daemon 2024-09-19T11:13:33.465 DEBUG:teuthology.orchestra.run.smithi102:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage daemon-helper term radosgw --rgw-frontends 'beast port=80' -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground | sudo tee /var/log/ceph/rgw.ceph.client.0.stdout 2>&1 2024-09-19T11:13:33.507 INFO:tasks.rgw.client.0:Started 2024-09-19T11:13:33.508 INFO:tasks.rgw:Polling client.0 until it starts accepting connections on http://smithi102.front.sepia.ceph.com:80/ 2024-09-19T11:13:33.508 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-19T11:13:33.545 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T11:13:33.546 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T11:13:33.546 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-19T11:13:33.546 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T11:13:33.546 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 80: Connection refused 2024-09-19T11:13:34.547 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-19T11:13:34.571 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T11:13:34.571 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-19T11:13:34.571 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T11:13:34.572 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T11:13:34.572 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 80: Connection refused 2024-09-19T11:13:36.573 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-19T11:13:36.598 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T11:13:36.598 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T11:13:36.598 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-19T11:13:36.598 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T11:13:36.598 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 80: Connection refused 2024-09-19T11:13:40.599 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-19T11:13:40.623 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T11:13:40.623 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-19T11:13:40.623 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 2024-09-19T11:13:40.624 INFO:teuthology.orchestra.run.smithi102.stderr:curl: (7) Failed to connect to smithi102.front.sepia.ceph.com port 80: Connection refused 2024-09-19T11:13:40.624 DEBUG:teuthology.orchestra.run:got remote process result: 7 2024-09-19T11:13:48.626 DEBUG:teuthology.orchestra.run.smithi102:> curl http://smithi102.front.sepia.ceph.com:80/ 2024-09-19T11:13:48.649 INFO:teuthology.orchestra.run.smithi102.stderr: % Total % Received % Xferd Average Speed Time Time Time Current 2024-09-19T11:13:48.649 INFO:teuthology.orchestra.run.smithi102.stderr: Dload Upload Total Spent Left Speed 2024-09-19T11:13:48.650 INFO:teuthology.orchestra.run.smithi102.stderr: 0 0 0 0 0 0 0 0 --:--:-- --:--:-- --:--:-- 0 100 187 0 187 0 0 93500 0 --:--:-- --:--:-- --:--:-- 93500 2024-09-19T11:13:48.651 INFO:teuthology.orchestra.run.smithi102.stdout:anonymous 2024-09-19T11:13:48.651 INFO:teuthology.run_tasks:Running task radosgw-admin... 2024-09-19T11:13:50.600 DEBUG:tasks.radosgw_admin:config is: {'client.0': None} 2024-09-19T11:13:50.600 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-19T11:13:50.600 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-19T11:13:50.600 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-19T11:13:50.650 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:50.651 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:50.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.650+0000 7f3b25d32800 1 Processor -- start 2024-09-19T11:13:50.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.650+0000 7f3b25d32800 1 -- start start 2024-09-19T11:13:50.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.651+0000 7f3b25d32800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a0d1ca4ac0 0x55a0d1ca6f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.651+0000 7f3b25d32800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a0d1ca75d0 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.651+0000 7f3b25d32800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55a0d1b2b7d0 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.651+0000 7f3b219bc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55a0d1ca0fb0 0x55a0d1ca33a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52146/0 (socket says 172.21.15.102:52146) 2024-09-19T11:13:50.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.651+0000 7f3b191bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a0d1ca4ac0 0x55a0d1ca6f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.651+0000 7f3b219bc640 1 -- 172.21.15.102:0/3448415020 learned_addr learned my addr 172.21.15.102:0/3448415020 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:50.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.651+0000 7f3b191bb640 1 -- 172.21.15.102:0/3448415020 >> v1:172.21.15.37:6789/0 conn(0x55a0d1ca0fb0 legacy=0x55a0d1ca33a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.651+0000 7f3b191bb640 1 -- 172.21.15.102:0/3448415020 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d1ca8800 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.654+0000 7f3b191bb640 1 --2- 172.21.15.102:0/3448415020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca4ac0 0x55a0d1ca6f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00a470 tx=0x7f3b0c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4904bca88814e70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.654+0000 7f3b211bb640 1 -- 172.21.15.102:0/3448415020 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0c053570 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.654+0000 7f3b211bb640 1 -- 172.21.15.102:0/3448415020 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b0c058070 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.654+0000 7f3b211bb640 1 -- 172.21.15.102:0/3448415020 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b0c053880 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.654+0000 7f3b25d32800 1 -- 172.21.15.102:0/3448415020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca4ac0 msgr2=0x55a0d1ca6f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.654+0000 7f3b25d32800 1 --2- 172.21.15.102:0/3448415020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca4ac0 0x55a0d1ca6f50 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c00a470 tx=0x7f3b0c045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:50.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.655+0000 7f3b25d32800 1 -- 172.21.15.102:0/3448415020 shutdown_connections 2024-09-19T11:13:50.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.655+0000 7f3b25d32800 1 --2- 172.21.15.102:0/3448415020 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca4ac0 0x55a0d1ca6f50 unknown :-1 s=CLOSED pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.655+0000 7f3b25d32800 1 -- 172.21.15.102:0/3448415020 >> 172.21.15.102:0/3448415020 conn(0x55a0d1c9aa50 msgr2=0x55a0d1c9ceb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.655+0000 7f3b25d32800 1 -- 172.21.15.102:0/3448415020 shutdown_connections 2024-09-19T11:13:50.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.655+0000 7f3b25d32800 1 -- 172.21.15.102:0/3448415020 wait complete. 2024-09-19T11:13:50.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.672+0000 7f3b25d32800 1 Processor -- start 2024-09-19T11:13:50.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.673+0000 7f3b25d32800 1 -- start start 2024-09-19T11:13:50.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.673+0000 7f3b25d32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1ca0740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.673+0000 7f3b25d32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a0d1b38dd0 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.673+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1ca0740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.673+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1ca0740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:41934/0 (socket says 172.21.15.102:41934) 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.673+0000 7f3b219bc640 1 -- 172.21.15.102:0/3350925503 learned_addr learned my addr 172.21.15.102:0/3350925503 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.674+0000 7f3b219bc640 1 -- 172.21.15.102:0/3350925503 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d1ca0d30 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.674+0000 7f3b219bc640 1 --2- 172.21.15.102:0/3350925503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1ca0740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b14001e40 tx=0x7f3b14001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c882ba66db2fb34a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.674+0000 7f3a0fe07640 1 -- 172.21.15.102:0/3350925503 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14012020 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.674+0000 7f3a0fe07640 1 -- 172.21.15.102:0/3350925503 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1400e5a0 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.674+0000 7f3a0fe07640 1 -- 172.21.15.102:0/3350925503 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b1400e8a0 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 -- 172.21.15.102:0/3350925503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 msgr2=0x55a0d1ca0740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 --2- 172.21.15.102:0/3350925503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1ca0740 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f3b14001e40 tx=0x7f3b14001e70 comp rx=0 tx=0).stop 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 -- 172.21.15.102:0/3350925503 shutdown_connections 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 --2- 172.21.15.102:0/3350925503 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1ca0740 unknown :-1 s=CLOSED pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 -- 172.21.15.102:0/3350925503 >> 172.21.15.102:0/3350925503 conn(0x55a0d1c9aa50 msgr2=0x55a0d1d8bca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 -- 172.21.15.102:0/3350925503 shutdown_connections 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 -- 172.21.15.102:0/3350925503 wait complete. 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 Processor -- start 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 -- start start 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1d9a060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.675+0000 7f3b25d32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a0d1ca7aa0 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1d9a060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1d9a060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:41948/0 (socket says 172.21.15.102:41948) 2024-09-19T11:13:50.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3b219bc640 1 -- 172.21.15.102:0/73465934 learned_addr learned my addr 172.21.15.102:0/73465934 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3b219bc640 1 -- 172.21.15.102:0/73465934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d1d9a5c0 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3b219bc640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1d9a060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c010 tx=0x7f3b14000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3a0e604640 1 -- 172.21.15.102:0/73465934 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14012030 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3a0e604640 1 -- 172.21.15.102:0/73465934 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b140014a0 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0d1d9a850 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3a0e604640 1 -- 172.21.15.102:0/73465934 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b1401a7a0 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.676+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d1d9b250 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.677+0000 7f3a0e604640 1 -- 172.21.15.102:0/73465934 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3b14015020 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.678+0000 7f3a0e604640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3a0803d000 0x7f3a0803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.678+0000 7f3a0e604640 1 -- 172.21.15.102:0/73465934 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3b14020030 con 0x55a0d1ca0fb0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.678+0000 7f3b191bb640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3a0803d000 0x7f3a0803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.678+0000 7f3b25d32800 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1ca4ac0 0x55a0d1da16b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.678+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1d9be00 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.678+0000 7f3b221bd640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1ca4ac0 0x55a0d1da16b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.678+0000 7f3b191bb640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3a0803d000 0x7f3a0803f4c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c057000 tx=0x7f3b0c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.678+0000 7f3b221bd640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1ca4ac0 0x55a0d1da16b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.679+0000 7f3b221bd640 1 -- 172.21.15.102:0/73465934 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.679+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1d9b6e0 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.679+0000 7f3b221bd640 1 -- 172.21.15.102:0/73465934 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.679+0000 7f3b25d32800 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1da3b20 0x55a0d1da5f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.679+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1da65e0 con 0x55a0d1da3b20 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.679+0000 7f3b219bc640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1da3b20 0x55a0d1da5f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.680+0000 7f3b219bc640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1da3b20 0x55a0d1da5f10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.680+0000 7f3b219bc640 1 -- 172.21.15.102:0/73465934 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3b140187b0 con 0x55a0d1da3b20 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.680+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1da29c0 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.680+0000 7f3b221bd640 1 -- 172.21.15.102:0/73465934 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1ca4ac0 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.680+0000 7f3b25d32800 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1da7a20 0x55a0d1da9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.680+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1daa550 con 0x55a0d1da7a20 2024-09-19T11:13:50.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.681+0000 7f3b191bb640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1da7a20 0x55a0d1da9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.681+0000 7f3b191bb640 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1da7a20 0x55a0d1da9e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.681+0000 7f3b191bb640 1 -- 172.21.15.102:0/73465934 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1da7a20 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.682+0000 7f3b25d32800 1 Processor -- start 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.682+0000 7f3b25d32800 1 -- start start 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.682+0000 7f3b25d32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1db82b0 0x55a0d1db86d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.682+0000 7f3b25d32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a0d1b974a0 con 0x55a0d1db82b0 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.682+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1db82b0 0x55a0d1db86d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.682+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1db82b0 0x55a0d1db86d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:41952/0 (socket says 172.21.15.102:41952) 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.682+0000 7f3b219bc640 1 -- 172.21.15.102:0/374469232 learned_addr learned my addr 172.21.15.102:0/374469232 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.682+0000 7f3b219bc640 1 -- 172.21.15.102:0/374469232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d1db8d10 con 0x55a0d1db82b0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.683+0000 7f3b219bc640 1 --2- 172.21.15.102:0/374469232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1db82b0 0x55a0d1db86d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b14052a60 tx=0x7f3b14051510 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.683+0000 7f3a077fe640 1 -- 172.21.15.102:0/374469232 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14017e40 con 0x55a0d1db82b0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.683+0000 7f3a077fe640 1 -- 172.21.15.102:0/374469232 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b14048070 con 0x55a0d1db82b0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.683+0000 7f3b25d32800 1 -- 172.21.15.102:0/374469232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0d1db9540 con 0x55a0d1db82b0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.683+0000 7f3a077fe640 1 -- 172.21.15.102:0/374469232 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b1400d3d0 con 0x55a0d1db82b0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.683+0000 7f3b25d32800 1 -- 172.21.15.102:0/374469232 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d1db9540 con 0x55a0d1db82b0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.684+0000 7f3a077fe640 1 -- 172.21.15.102:0/374469232 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3b1404b370 con 0x55a0d1db82b0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.684+0000 7f3a077fe640 1 --2- 172.21.15.102:0/374469232 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39fc03d000 0x7f39fc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.684+0000 7f3a077fe640 1 -- 172.21.15.102:0/374469232 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3b1403ca10 con 0x55a0d1db82b0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.684+0000 7f3b191bb640 1 --2- 172.21.15.102:0/374469232 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39fc03d000 0x7f39fc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.684+0000 7f3b25d32800 1 Processor -- start 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.684+0000 7f3b25d32800 1 -- start start 2024-09-19T11:13:50.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.684+0000 7f3b191bb640 1 --2- 172.21.15.102:0/374469232 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39fc03d000 0x7f39fc03f4c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55a0d1da1cc0 tx=0x7f3b0c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3b25d32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dc4d40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3b25d32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a0d1c9f190 con 0x55a0d1dc4940 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dc4d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dc4d40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:41964/0 (socket says 172.21.15.102:41964) 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3b219bc640 1 -- 172.21.15.102:0/2022674745 learned_addr learned my addr 172.21.15.102:0/2022674745 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3b219bc640 1 -- 172.21.15.102:0/2022674745 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d1dc5330 con 0x55a0d1dc4940 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3b219bc640 1 --2- 172.21.15.102:0/2022674745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dc4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b1403eef0 tx=0x7f3b14026f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62511cf5ed45ac8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3a057fa640 1 -- 172.21.15.102:0/2022674745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14058030 con 0x55a0d1dc4940 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3a057fa640 1 -- 172.21.15.102:0/2022674745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1404b660 con 0x55a0d1dc4940 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.685+0000 7f3a057fa640 1 -- 172.21.15.102:0/2022674745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14018430 con 0x55a0d1dc4940 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 -- 172.21.15.102:0/2022674745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 msgr2=0x55a0d1dc4d40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2022674745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dc4d40 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7f3b1403eef0 tx=0x7f3b14026f70 comp rx=0 tx=0).stop 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 -- 172.21.15.102:0/2022674745 shutdown_connections 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2022674745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dc4d40 unknown :-1 s=CLOSED pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 -- 172.21.15.102:0/2022674745 >> 172.21.15.102:0/2022674745 conn(0x55a0d1dc0d40 msgr2=0x55a0d1dbef80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 -- 172.21.15.102:0/2022674745 shutdown_connections 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 -- 172.21.15.102:0/2022674745 wait complete. 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 Processor -- start 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.686+0000 7f3b25d32800 1 -- start start 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f3b25d32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dcbe40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f3b25d32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a0d1dc57a0 con 0x55a0d1dc4940 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dcbe40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f3b219bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dcbe40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:41968/0 (socket says 172.21.15.102:41968) 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 learned_addr learned my addr 172.21.15.102:0/2415201219 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a0d1dcc3a0 con 0x55a0d1dc4940 2024-09-19T11:13:50.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f3b219bc640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dcbe40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b1403cc80 tx=0x7f3b14023f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f39f37fe640 1 -- 172.21.15.102:0/2415201219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b1406f070 con 0x55a0d1dc4940 2024-09-19T11:13:50.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.687+0000 7f39f37fe640 1 -- 172.21.15.102:0/2415201219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3b1404b860 con 0x55a0d1dc4940 2024-09-19T11:13:50.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.688+0000 7f39f37fe640 1 -- 172.21.15.102:0/2415201219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3b14058040 con 0x55a0d1dc4940 2024-09-19T11:13:50.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.688+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a0d1dcc3a0 con 0x55a0d1dc4940 2024-09-19T11:13:50.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.688+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a0d1dcc3a0 con 0x55a0d1dc4940 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.689+0000 7f39f37fe640 1 -- 172.21.15.102:0/2415201219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3b14072070 con 0x55a0d1dc4940 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.689+0000 7f39f37fe640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39ec03cf60 0x7f39ec03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.689+0000 7f39f37fe640 1 -- 172.21.15.102:0/2415201219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3b14067070 con 0x55a0d1dc4940 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.689+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.689+0000 7f3b191bb640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39ec03cf60 0x7f39ec03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.689+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1dd7250 0x55a0d1dd96e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.689+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1dd9e30 con 0x55a0d1dd7250 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.689+0000 7f3b221bd640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1dd7250 0x55a0d1dd96e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b191bb640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39ec03cf60 0x7f39ec03f420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c053570 tx=0x7f3b0c053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b221bd640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1dd7250 0x55a0d1dd96e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b25d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b25d32800 20 realm 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1dda240 con 0x55a0d1dd7250 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b25d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b25d32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.690+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddab10 con 0x55a0d1dd7250 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b25d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b25d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1ddb9a0 0x55a0d1dddd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1dde4d0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.691+0000 7f3b219bc640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1ddb9a0 0x55a0d1dddd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.692+0000 7f3b219bc640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1ddb9a0 0x55a0d1dddd90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.692+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.692+0000 7f3b25d32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.692+0000 7f3b25d32800 20 searching for the correct realm 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.692+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1de0570 0x55a0d1de2a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.692+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de3100 con 0x55a0d1de0570 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.692+0000 7f3b191bb640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1de0570 0x55a0d1de2a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.692+0000 7f3b191bb640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1de0570 0x55a0d1de2a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.693+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.693+0000 7f3b191bb640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3b0c05f040 0x7f3b0c05f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.693+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de3100 con 0x7f3b0c05f040 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.693+0000 7f3b221bd640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3b0c05f040 0x7f3b0c05f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.693+0000 7f3b221bd640 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3b0c05f040 0x7f3b0c05f930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.694+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.694+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.694+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.694+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.694+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.694+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.694+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.694+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.695+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.695+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.695+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.695+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x7f3b0c05f040 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.695+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.695+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.696+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.696+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.696+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.696+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.696+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.696+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.697+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.697+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x7f3b0c05f040 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.697+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.697+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.697+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.697+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.698+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.698+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.698+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.698+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.698+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.698+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.699+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.699+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.699+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.699+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.699+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.699+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.699+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.700+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.700+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.700+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x7f3b0c05f040 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.700+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.700+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.700+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.700+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.701+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.701+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.701+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.701+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.701+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.701+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x7f3b0c05f040 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.702+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.702+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.702+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.702+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.702+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.702+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x7f3b0c05f040 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:50.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddee70 con 0x55a0d1dd7250 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.703+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddee70 con 0x55a0d1dd7250 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:50.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddee70 con 0x55a0d1de0570 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 20 zone default found 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 4 Realm: () 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 20 zonegroup default 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddf710 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.704+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de4f70 con 0x55a0d1de0570 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b25d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b25d32800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de5310 con 0x55a0d1de0570 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b25d32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b25d32800 20 started sync module instance, tier type = 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b25d32800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.705+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de4410 con 0x7f3b0c05f040 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.706+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.706+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94149204134192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de4410 con 0x7f3b0c05f040 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.706+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de5d70 con 0x55a0d1dd7250 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.707+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94149204134192] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.708+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.708+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94149204138064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de4410 con 0x55a0d1dd7250 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.708+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de67e0 con 0x55a0d1de0570 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.709+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.709+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94149204138064] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.709+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94149204140752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7080 con 0x55a0d1de0570 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.709+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de3f60 con 0x7f3b0c05f040 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.710+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94149204140752] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.710+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.710+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94149204143056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7b20 con 0x7f3b0c05f040 2024-09-19T11:13:50.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.710+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de8410 con 0x55a0d1dd7250 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.712+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.712+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94149204146976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7f40 con 0x55a0d1dd7250 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.712+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de93c0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.713+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94149204143056] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.714+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.714+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94149204145776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.714+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1dea170 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.714+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94149204146976] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.715+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94149204145776] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.716+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.716+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94149204150272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1dea170 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.716+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1deaa10 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'3 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94149204150272] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94149204157792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1deae30 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b25d32800 20 add_watcher() i=0 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b25d32800 20 add_watcher() i=1 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b25d32800 20 add_watcher() i=2 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b25d32800 20 add_watcher() i=3 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b25d32800 20 add_watcher() i=4 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b25d32800 20 add_watcher() i=5 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.717+0000 7f3b25d32800 20 add_watcher() i=6 2024-09-19T11:13:50.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.718+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94149204157792] v35'4 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.718+0000 7f3b25d32800 20 add_watcher() i=7 2024-09-19T11:13:50.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.718+0000 7f3b25d32800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:50.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.718+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1deae30 con 0x55a0d1dd7250 2024-09-19T11:13:50.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.719+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.719+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94149204158848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1deb700 con 0x55a0d1dd7250 2024-09-19T11:13:50.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94149204158848] v35'24 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f39d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:50.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f3b25d32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:50.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f3b25d32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:50.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f3b25d32800 5 note: GC not initialized 2024-09-19T11:13:50.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f39d27fc640 20 reqs_thread_entry: start 2024-09-19T11:13:50.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f3b25d32800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:50.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f3b25d32800 20 Filter name: none 2024-09-19T11:13:50.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.724+0000 7f3943fff640 20 reqs_thread_entry: start 2024-09-19T11:13:50.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.725+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1e206d0 con 0x55a0d1de0570 2024-09-19T11:13:50.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.725+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(62 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.725+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7080 con 0x55a0d1de0570 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.725+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(63 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.725+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7080 con 0x55a0d1dd7250 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.725+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(64 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.725+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.726+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.726+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x7f3b0c05f040 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.726+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.726+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.726+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(67 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.726+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.726+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.726+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.727+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(69 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.727+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x7f3b0c05f040 2024-09-19T11:13:50.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.727+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.727+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.727+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(71 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.727+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1dd7250 2024-09-19T11:13:50.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.727+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(72 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.727+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.728+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(73 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.728+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.728+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(74 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.728+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1de0570 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.728+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(75 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.729+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.729+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(76 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.729+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.729+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(77 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.729+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.729+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(78 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.729+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1de0570 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.730+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(79 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.730+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x7f3b0c05f040 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.730+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(80 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.730+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1dd7250 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.730+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(81 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.730+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1dd7250 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.730+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(82 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.730+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1de0570 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.731+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(83 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.731+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x7f3b0c05f040 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.731+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(84 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.731+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.731+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(85 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.731+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1dd7250 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.731+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(86 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.731+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.732+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(87 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.732+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1de0570 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.732+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(88 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.732+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x7f3b0c05f040 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.732+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(89 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.732+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.733+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(90 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.733+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1dd7250 2024-09-19T11:13:50.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.733+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(91 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.733+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x55a0d1de0570 2024-09-19T11:13:50.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.733+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(92 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.733+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de97b0 con 0x7f3b0c05f040 2024-09-19T11:13:50.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.733+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(93 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.734+0000 7f39d37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:50.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.734+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94149204158848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7080 con 0x55a0d1dd7250 2024-09-19T11:13:50.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.735+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94149204158848] v35'25 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.735+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94149204134192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x7f3b0c05f040 2024-09-19T11:13:50.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.738+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94149204134192] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.738+0000 7f3b25d32800 20 remove_watcher() i=0 2024-09-19T11:13:50.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.738+0000 7f3b25d32800 2 removed watcher, disabling cache 2024-09-19T11:13:50.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.738+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94149204138064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7080 con 0x55a0d1dd7250 2024-09-19T11:13:50.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.739+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94149204138064] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.739+0000 7f3b25d32800 20 remove_watcher() i=1 2024-09-19T11:13:50.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.739+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94149204140752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1ddaeb0 con 0x55a0d1de0570 2024-09-19T11:13:50.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.741+0000 7f3b191bb640 1 -- 172.21.15.102:0/2415201219 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94149204140752] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b0c051070 con 0x55a0d1de0570 2024-09-19T11:13:50.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.741+0000 7f3b25d32800 20 remove_watcher() i=2 2024-09-19T11:13:50.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.741+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94149204143056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7080 con 0x7f3b0c05f040 2024-09-19T11:13:50.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.742+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94149204143056] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x7f3b0c05f040 2024-09-19T11:13:50.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.742+0000 7f3b25d32800 20 remove_watcher() i=3 2024-09-19T11:13:50.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.742+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94149204146976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7080 con 0x55a0d1dd7250 2024-09-19T11:13:50.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.743+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94149204146976] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b1c00a4d0 con 0x55a0d1dd7250 2024-09-19T11:13:50.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.743+0000 7f3b25d32800 20 remove_watcher() i=4 2024-09-19T11:13:50.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.743+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94149204145776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7080 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.745+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94149204145776] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.745+0000 7f3b25d32800 20 remove_watcher() i=5 2024-09-19T11:13:50.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.745+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94149204150272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de7b20 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.746+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94149204150272] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.746+0000 7f3b25d32800 20 remove_watcher() i=6 2024-09-19T11:13:50.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.746+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94149204157792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a0d1de8800 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.747+0000 7f3b219bc640 1 -- 172.21.15.102:0/2415201219 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94149204157792] v35'5 uv3 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3b14071030 con 0x55a0d1ddb9a0 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.747+0000 7f3b25d32800 20 remove_watcher() i=7 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.747+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1ddb9a0 msgr2=0x55a0d1dddd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.747+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1ddb9a0 0x55a0d1dddd90 crc :-1 s=READY pgs=9 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1dd7250 msgr2=0x55a0d1dd96e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1dd7250 0x55a0d1dd96e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3b0c05f040 msgr2=0x7f3b0c05f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3b0c05f040 0x7f3b0c05f930 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1de0570 msgr2=0x55a0d1de2a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1de0570 0x55a0d1de2a30 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39ec03cf60 msgr2=0x7f39ec03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39ec03cf60 0x7f39ec03f420 secure :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c053570 tx=0x7f3b0c053000 comp rx=0 tx=0).stop 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 msgr2=0x55a0d1dcbe40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b221bd640 1 -- 172.21.15.102:0/2415201219 reap_dead start 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dcbe40 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x7f3b1403cc80 tx=0x7f3b14023f50 comp rx=0 tx=0).stop 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 shutdown_connections 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/2415201219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1dc4940 0x55a0d1dcbe40 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 >> 172.21.15.102:0/2415201219 conn(0x55a0d1dc0d40 msgr2=0x55a0d1dbef50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 shutdown_connections 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/2415201219 wait complete. 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/374469232 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39fc03d000 msgr2=0x7f39fc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/374469232 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39fc03d000 0x7f39fc03f4c0 secure :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0x55a0d1da1cc0 tx=0x7f3b0c005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:50.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/374469232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1db82b0 msgr2=0x55a0d1db86d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/374469232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1db82b0 0x55a0d1db86d0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f3b14052a60 tx=0x7f3b14051510 comp rx=0 tx=0).stop 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/374469232 shutdown_connections 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/374469232 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f39fc03d000 0x7f39fc03f4c0 unknown :-1 s=CLOSED pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 --2- 172.21.15.102:0/374469232 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1db82b0 0x55a0d1db86d0 unknown :-1 s=CLOSED pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/374469232 >> 172.21.15.102:0/374469232 conn(0x55a0d1dac660 msgr2=0x55a0d1daca40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/374469232 shutdown_connections 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.748+0000 7f3b25d32800 1 -- 172.21.15.102:0/374469232 wait complete. 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1da3b20 msgr2=0x55a0d1da5f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a0d1da3b20 0x55a0d1da5f10 crc :-1 s=READY pgs=8 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1ca4ac0 msgr2=0x55a0d1da16b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a0d1ca4ac0 0x55a0d1da16b0 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1da7a20 msgr2=0x55a0d1da9e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a0d1da7a20 0x55a0d1da9e10 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3a0803d000 msgr2=0x7f3a0803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3a0803d000 0x7f3a0803f4c0 secure :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0x7f3b0c057000 tx=0x7f3b0c052000 comp rx=0 tx=0).stop 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 msgr2=0x55a0d1d9a060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 --2- 172.21.15.102:0/73465934 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a0d1ca0fb0 0x55a0d1d9a060 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x7f3b1400c010 tx=0x7f3b14000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b221bd640 1 -- 172.21.15.102:0/73465934 reap_dead start 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 shutdown_connections 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 >> 172.21.15.102:0/73465934 conn(0x55a0d1c9aa50 msgr2=0x55a0d1d8b7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 shutdown_connections 2024-09-19T11:13:50.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.749+0000 7f3b25d32800 1 -- 172.21.15.102:0/73465934 wait complete. 2024-09-19T11:13:50.832 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-19T11:13:50.833 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T11:13:50.833 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud'] 2024-09-19T11:13:50.833 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud'] 2024-09-19T11:13:50.833 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud 2024-09-19T11:13:50.879 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:50.879 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:50.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.879+0000 7f4cd7e2f800 1 Processor -- start 2024-09-19T11:13:50.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.879+0000 7f4cd7e2f800 1 -- start start 2024-09-19T11:13:50.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.879+0000 7f4cd7e2f800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x565512580aa0 0x565512582f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.879+0000 7f4cd7e2f800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5655125835e0 con 0x56551257cf30 2024-09-19T11:13:50.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.879+0000 7f4cd7e2f800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5655124077d0 con 0x565512580aa0 2024-09-19T11:13:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.879+0000 7f4cd511f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x565512580aa0 0x565512582f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.879+0000 7f4cd5920640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x56551257cf30 0x56551257f320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52152/0 (socket says 172.21.15.102:52152) 2024-09-19T11:13:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.879+0000 7f4cd5920640 1 -- 172.21.15.102:0/127902710 learned_addr learned my addr 172.21.15.102:0/127902710 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.880+0000 7f4cd491e640 1 -- 172.21.15.102:0/127902710 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2846482939 0 0) 0x5655125835e0 con 0x56551257cf30 2024-09-19T11:13:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.880+0000 7f4cd491e640 1 -- 172.21.15.102:0/127902710 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f4cc0001e10 con 0x56551257cf30 2024-09-19T11:13:50.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.880+0000 7f4cd511f640 1 -- 172.21.15.102:0/127902710 >> v1:172.21.15.37:6789/0 conn(0x56551257cf30 legacy=0x56551257f320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.880+0000 7f4cd511f640 1 -- 172.21.15.102:0/127902710 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x565512584810 con 0x565512580aa0 2024-09-19T11:13:50.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.881+0000 7f4cd511f640 1 --2- 172.21.15.102:0/127902710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565512580aa0 0x565512582f60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a470 tx=0x7f4ccc045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3c42b0658bb88f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd491e640 1 -- 172.21.15.102:0/127902710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc059070 con 0x565512580aa0 2024-09-19T11:13:50.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd491e640 1 -- 172.21.15.102:0/127902710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4ccc054570 con 0x565512580aa0 2024-09-19T11:13:50.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd491e640 1 -- 172.21.15.102:0/127902710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4ccc054850 con 0x565512580aa0 2024-09-19T11:13:50.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/127902710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565512580aa0 msgr2=0x565512582f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/127902710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565512580aa0 0x565512582f60 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7f4ccc00a470 tx=0x7f4ccc045920 comp rx=0 tx=0).stop 2024-09-19T11:13:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/127902710 shutdown_connections 2024-09-19T11:13:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/127902710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565512580aa0 0x565512582f60 unknown :-1 s=CLOSED pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/127902710 >> 172.21.15.102:0/127902710 conn(0x565512576a90 msgr2=0x565512578ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/127902710 shutdown_connections 2024-09-19T11:13:50.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.882+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/127902710 wait complete. 2024-09-19T11:13:50.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.896+0000 7f4cd7e2f800 1 Processor -- start 2024-09-19T11:13:50.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.896+0000 7f4cd7e2f800 1 -- start start 2024-09-19T11:13:50.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.896+0000 7f4cd7e2f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551266c150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.896+0000 7f4cd7e2f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565512414dd0 con 0x56551257cf30 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.897+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551266c150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.897+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551266c150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:41980/0 (socket says 172.21.15.102:41980) 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.897+0000 7f4cd5920640 1 -- 172.21.15.102:0/2431707258 learned_addr learned my addr 172.21.15.102:0/2431707258 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.897+0000 7f4cd5920640 1 -- 172.21.15.102:0/2431707258 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56551266c740 con 0x56551257cf30 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.897+0000 7f4cd5920640 1 --2- 172.21.15.102:0/2431707258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551266c150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8001e30 tx=0x7f4cc800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=727f060898cfd5a5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.897+0000 7f4bc3e07640 1 -- 172.21.15.102:0/2431707258 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8012020 con 0x56551257cf30 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.897+0000 7f4bc3e07640 1 -- 172.21.15.102:0/2431707258 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc800e470 con 0x56551257cf30 2024-09-19T11:13:50.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.897+0000 7f4bc3e07640 1 -- 172.21.15.102:0/2431707258 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc800e790 con 0x56551257cf30 2024-09-19T11:13:50.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/2431707258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 msgr2=0x56551266c150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/2431707258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551266c150 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x7f4cc8001e30 tx=0x7f4cc800b780 comp rx=0 tx=0).stop 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/2431707258 shutdown_connections 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/2431707258 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551266c150 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/2431707258 >> 172.21.15.102:0/2431707258 conn(0x565512576a90 msgr2=0x565512667ad0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/2431707258 shutdown_connections 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/2431707258 wait complete. 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 Processor -- start 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.898+0000 7f4cd7e2f800 1 -- start start 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4cd7e2f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551257c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4cd7e2f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565512583ab0 con 0x56551257cf30 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551257c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551257c650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:41990/0 (socket says 172.21.15.102:41990) 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4cd5920640 1 -- 172.21.15.102:0/3551680582 learned_addr learned my addr 172.21.15.102:0/3551680582 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4cd5920640 1 -- 172.21.15.102:0/3551680582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56551257cbb0 con 0x56551257cf30 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4cd5920640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551257c650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x56551266d0e0 tx=0x7f4cc80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4bc2604640 1 -- 172.21.15.102:0/3551680582 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8012030 con 0x56551257cf30 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4bc2604640 1 -- 172.21.15.102:0/3551680582 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc801a7a0 con 0x56551257cf30 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56551257af60 con 0x56551257cf30 2024-09-19T11:13:50.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.899+0000 7f4bc2604640 1 -- 172.21.15.102:0/3551680582 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc801aaa0 con 0x56551257cf30 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.900+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56551257b520 con 0x56551257cf30 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.900+0000 7f4bc2604640 1 -- 172.21.15.102:0/3551680582 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4cc8015020 con 0x56551257cf30 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.901+0000 7f4bc2604640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bbc03cfb0 0x7f4bbc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.901+0000 7f4bc2604640 1 -- 172.21.15.102:0/3551680582 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4cc8020070 con 0x56551257cf30 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.901+0000 7f4cd511f640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bbc03cfb0 0x7f4bbc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.901+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x565512580aa0 0x56551267d180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.901+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56551267d6c0 con 0x565512580aa0 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.901+0000 7f4cd6121640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x565512580aa0 0x56551267d180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.901+0000 7f4cd511f640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bbc03cfb0 0x7f4bbc03f470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5655124ef790 tx=0x7f4ccc050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.901+0000 7f4cd6121640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x565512580aa0 0x56551267d180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.902+0000 7f4cd6121640 1 -- 172.21.15.102:0/3551680582 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x565512580aa0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.902+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56551257ba50 con 0x565512580aa0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.902+0000 7f4cd6121640 1 -- 172.21.15.102:0/3551680582 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cd000a4d0 con 0x565512580aa0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.902+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56551267f9f0 0x565512681de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.902+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126824b0 con 0x56551267f9f0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.902+0000 7f4cd5920640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56551267f9f0 0x565512681de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.903+0000 7f4cd5920640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56551267f9f0 0x565512681de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.903+0000 7f4cd5920640 1 -- 172.21.15.102:0/3551680582 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4cc8018950 con 0x56551267f9f0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.903+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56551267e890 con 0x565512580aa0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.903+0000 7f4cd6121640 1 -- 172.21.15.102:0/3551680582 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cd000a4d0 con 0x565512580aa0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.903+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126838f0 0x565512685ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.903+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x565512686420 con 0x5655126838f0 2024-09-19T11:13:50.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.903+0000 7f4cd511f640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126838f0 0x565512685ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.904+0000 7f4cd511f640 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126838f0 0x565512685ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.904+0000 7f4cd511f640 1 -- 172.21.15.102:0/3551680582 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4ccc05c040 con 0x5655126838f0 2024-09-19T11:13:50.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.904+0000 7f4cd7e2f800 1 Processor -- start 2024-09-19T11:13:50.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.904+0000 7f4cd7e2f800 1 -- start start 2024-09-19T11:13:50.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.904+0000 7f4cd7e2f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126941a0 0x5655126945c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.904+0000 7f4cd7e2f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5655124734a0 con 0x5655126941a0 2024-09-19T11:13:50.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126941a0 0x5655126945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126941a0 0x5655126945c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42000/0 (socket says 172.21.15.102:42000) 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4cd5920640 1 -- 172.21.15.102:0/347620269 learned_addr learned my addr 172.21.15.102:0/347620269 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4cd5920640 1 -- 172.21.15.102:0/347620269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565512694c00 con 0x5655126941a0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4cd5920640 1 --2- 172.21.15.102:0/347620269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126941a0 0x5655126945c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4cc802c560 tx=0x7f4cc8043da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4bbb7fe640 1 -- 172.21.15.102:0/347620269 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc80513b0 con 0x5655126941a0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4bbb7fe640 1 -- 172.21.15.102:0/347620269 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc8048070 con 0x5655126941a0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/347620269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565512695430 con 0x5655126941a0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4bbb7fe640 1 -- 172.21.15.102:0/347620269 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc80516e0 con 0x5655126941a0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.905+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/347620269 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655126959d0 con 0x5655126941a0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.906+0000 7f4bbb7fe640 1 -- 172.21.15.102:0/347620269 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4cc804a020 con 0x5655126941a0 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.906+0000 7f4bbb7fe640 1 --2- 172.21.15.102:0/347620269 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bb003cfb0 0x7f4bb003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.906+0000 7f4bbb7fe640 1 -- 172.21.15.102:0/347620269 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4cc803ca60 con 0x5655126941a0 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.906+0000 7f4cd511f640 1 --2- 172.21.15.102:0/347620269 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bb003cfb0 0x7f4bb003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd7e2f800 1 Processor -- start 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd7e2f800 1 -- start start 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd511f640 1 --2- 172.21.15.102:0/347620269 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bb003cfb0 0x7f4bb003f470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x56551267db70 tx=0x7f4ccc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd7e2f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a0e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd7e2f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56551266cb70 con 0x5655126a0ab0 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a0e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a0e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42008/0 (socket says 172.21.15.102:42008) 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd5920640 1 -- 172.21.15.102:0/1123489399 learned_addr learned my addr 172.21.15.102:0/1123489399 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd5920640 1 -- 172.21.15.102:0/1123489399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655126a1480 con 0x5655126a0ab0 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.907+0000 7f4cd5920640 1 --2- 172.21.15.102:0/1123489399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a0e90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4cc802d910 tx=0x7f4cc802d4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fae816bb4abc5834 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4bb97fa640 1 -- 172.21.15.102:0/1123489399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc800d3d0 con 0x5655126a0ab0 2024-09-19T11:13:50.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4bb97fa640 1 -- 172.21.15.102:0/1123489399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc804ba10 con 0x5655126a0ab0 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4bb97fa640 1 -- 172.21.15.102:0/1123489399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8024bb0 con 0x5655126a0ab0 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/1123489399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 msgr2=0x5655126a0e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/1123489399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a0e90 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7f4cc802d910 tx=0x7f4cc802d4b0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/1123489399 shutdown_connections 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/1123489399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a0e90 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/1123489399 >> 172.21.15.102:0/1123489399 conn(0x56551269ceb0 msgr2=0x56551269b0f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/1123489399 shutdown_connections 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/1123489399 wait complete. 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.908+0000 7f4cd7e2f800 1 Processor -- start 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd7e2f800 1 -- start start 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd7e2f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a7ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd7e2f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5655126a1910 con 0x5655126a0ab0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a7ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd5920640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a7ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42024/0 (socket says 172.21.15.102:42024) 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 learned_addr learned my addr 172.21.15.102:0/53390721 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5655126a8440 con 0x5655126a0ab0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd5920640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a7ee0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4cc802dd90 tx=0x7f4cc80518e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4ba77fe640 1 -- 172.21.15.102:0/53390721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc806c020 con 0x5655126a0ab0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4ba77fe640 1 -- 172.21.15.102:0/53390721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4cc8024620 con 0x5655126a0ab0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5655126a8440 con 0x5655126a0ab0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.909+0000 7f4ba77fe640 1 -- 172.21.15.102:0/53390721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4cc8024900 con 0x5655126a0ab0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.910+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5655126a8440 con 0x5655126a0ab0 2024-09-19T11:13:50.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.910+0000 7f4ba77fe640 1 -- 172.21.15.102:0/53390721 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4cc806f020 con 0x5655126a0ab0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4ba77fe640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ba003cfb0 0x7f4ba003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4ba77fe640 1 -- 172.21.15.102:0/53390721 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4cc8063050 con 0x5655126a0ab0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4cd511f640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ba003cfb0 0x7f4ba003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5655126b34d0 0x5655126b5990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126b60e0 con 0x5655126b34d0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4cd6121640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5655126b34d0 0x5655126b5990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4cd511f640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ba003cfb0 0x7f4ba003f470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x565512686820 tx=0x7f4ccc062040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.911+0000 7f4cd6121640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5655126b34d0 0x5655126b5990 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 realm 2024-09-19T11:13:50.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126b64f0 con 0x5655126b34d0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126b6dc0 con 0x5655126b34d0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.912+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5655126b7ec0 0x5655126ba2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126ba870 con 0x5655126b7ec0 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd5920640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5655126b7ec0 0x5655126ba2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd5920640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5655126b7ec0 0x5655126ba2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd7e2f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd7e2f800 20 searching for the correct realm 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126bc820 0x5655126bece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.913+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126bf3b0 con 0x5655126bc820 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.914+0000 7f4cd511f640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126bc820 0x5655126bece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.914+0000 7f4cd511f640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126bc820 0x5655126bece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.914+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.914+0000 7f4cd511f640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4ccc085040 0x7f4ccc077430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.914+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126bf3b0 con 0x7f4ccc085040 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.914+0000 7f4cd6121640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4ccc085040 0x7f4ccc077430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.914+0000 7f4cd6121640 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4ccc085040 0x7f4ccc077430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.915+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.915+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.915+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.915+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.915+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.915+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.915+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.915+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.916+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.916+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.916+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.916+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x7f4ccc085040 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.916+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.916+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126bc820 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.916+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.916+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.917+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.917+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.917+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.917+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.917+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.917+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x7f4ccc085040 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.917+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.917+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126bc820 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.918+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.918+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126bc820 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.918+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.918+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.918+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.918+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126bc820 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126bc820 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.919+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.920+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126bc820 2024-09-19T11:13:50.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.920+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.920+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x7f4ccc085040 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.920+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.920+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.920+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.920+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.921+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.921+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126bc820 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.921+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.921+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.921+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.921+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x7f4ccc085040 2024-09-19T11:13:50.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.921+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.921+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126bc820 2024-09-19T11:13:50.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b7ec0 2024-09-19T11:13:50.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x5655126b34d0 2024-09-19T11:13:50.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5655126b7160 con 0x7f4ccc085040 2024-09-19T11:13:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd7e2f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd7e2f800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd7e2f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd7e2f800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd7e2f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.922+0000 7f4cd7e2f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126bb130 con 0x5655126b34d0 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126bb130 con 0x5655126b34d0 2024-09-19T11:13:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126bb130 con 0x5655126bc820 2024-09-19T11:13:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 zone default found 2024-09-19T11:13:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 4 Realm: () 2024-09-19T11:13:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 zonegroup default 2024-09-19T11:13:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.923+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126bba20 con 0x5655126b7ec0 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126c1320 con 0x5655126bc820 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126c1750 con 0x5655126bc820 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 20 started sync module instance, tier type = 2024-09-19T11:13:50.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.924+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c06c0 con 0x7f4ccc085040 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.925+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.925+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94923381279680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c06c0 con 0x7f4ccc085040 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.925+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c2280 con 0x5655126b34d0 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.928+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.928+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94923381284176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c2770 con 0x5655126b34d0 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.928+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c3290 con 0x5655126bc820 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.928+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94923381279680] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.931+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94923381284176] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.931+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.931+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94923381285440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c0210 con 0x5655126bc820 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.931+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c3b70 con 0x7f4ccc085040 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.933+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94923381285440] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.934+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.934+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94923381288288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c3f60 con 0x7f4ccc085040 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.934+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c4920 con 0x5655126b34d0 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.936+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.936+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94923381294192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c4890 con 0x5655126b34d0 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.936+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c5860 con 0x5655126b7ec0 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.936+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94923381288288] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.937+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.937+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94923381298064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c5c80 con 0x5655126b7ec0 2024-09-19T11:13:50.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.937+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c6640 con 0x5655126b7ec0 2024-09-19T11:13:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.937+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94923381294192] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.939+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94923381298064] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.939+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.939+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94923381301648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c6a60 con 0x5655126b7ec0 2024-09-19T11:13:50.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.939+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c72b0 con 0x5655126b7ec0 2024-09-19T11:13:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94923381301648] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'6 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94923381303776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c72b0 con 0x5655126b7ec0 2024-09-19T11:13:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd7e2f800 20 add_watcher() i=0 2024-09-19T11:13:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd7e2f800 20 add_watcher() i=1 2024-09-19T11:13:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd7e2f800 20 add_watcher() i=2 2024-09-19T11:13:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd7e2f800 20 add_watcher() i=3 2024-09-19T11:13:50.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd7e2f800 20 add_watcher() i=4 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd7e2f800 20 add_watcher() i=5 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.942+0000 7f4cd7e2f800 20 add_watcher() i=6 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.943+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94923381303776] v35'7 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.943+0000 7f4cd7e2f800 20 add_watcher() i=7 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.943+0000 7f4cd7e2f800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.943+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126ca6e0 con 0x5655126b34d0 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.944+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.944+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94923381305296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c7c30 con 0x5655126b34d0 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.946+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94923381305296] v35'26 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.946+0000 7f4b877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.946+0000 7f4cd7e2f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:50.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.946+0000 7f4cd7e2f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.946+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d2f60 con 0x5655126b34d0 2024-09-19T11:13:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.947+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.947+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d3610 con 0x5655126b7ec0 2024-09-19T11:13:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.949+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'10 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.949+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d3610 con 0x5655126bc820 2024-09-19T11:13:50.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.951+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.951+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d3c20 con 0x5655126b34d0 2024-09-19T11:13:50.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.954+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.954+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d40d0 con 0x7f4ccc085040 2024-09-19T11:13:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.956+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.956+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d0e30 con 0x5655126bc820 2024-09-19T11:13:50.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.958+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.958+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d0e30 con 0x5655126b34d0 2024-09-19T11:13:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.960+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.960+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d4e50 con 0x5655126b7ec0 2024-09-19T11:13:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.962+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'13 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.962+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d4e50 con 0x7f4ccc085040 2024-09-19T11:13:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.963+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.963+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d4e50 con 0x5655126bc820 2024-09-19T11:13:50.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.965+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.965+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5300 con 0x7f4ccc085040 2024-09-19T11:13:50.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.968+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.968+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d52b0 con 0x5655126b7ec0 2024-09-19T11:13:50.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.969+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.969+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d50e0 con 0x7f4ccc085040 2024-09-19T11:13:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.971+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.971+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d50e0 con 0x5655126b7ec0 2024-09-19T11:13:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.974+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'19 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.974+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d50e0 con 0x5655126b34d0 2024-09-19T11:13:50.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.976+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.976+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d50e0 con 0x5655126bc820 2024-09-19T11:13:50.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.979+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.979+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5210 con 0x7f4ccc085040 2024-09-19T11:13:50.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.981+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'22 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.981+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d51d0 con 0x5655126bc820 2024-09-19T11:13:50.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.984+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.984+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d52e0 con 0x5655126b34d0 2024-09-19T11:13:50.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.985+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.985+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d52e0 con 0x5655126b34d0 2024-09-19T11:13:50.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.987+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'29 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:50.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.987+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d52a0 con 0x5655126bc820 2024-09-19T11:13:50.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.989+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.989+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d52e0 con 0x7f4ccc085040 2024-09-19T11:13:50.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.990+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:50.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.990+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5320 con 0x5655126bc820 2024-09-19T11:13:50.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.992+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.992+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5350 con 0x5655126bc820 2024-09-19T11:13:50.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.993+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.993+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5390 con 0x5655126bc820 2024-09-19T11:13:50.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.993+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'6 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.993+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5390 con 0x5655126bc820 2024-09-19T11:13:50.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.994+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'14 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.994+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d53d0 con 0x5655126b7ec0 2024-09-19T11:13:50.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.996+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'12 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.996+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5410 con 0x5655126bc820 2024-09-19T11:13:50.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.997+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'10 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:50.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.997+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5410 con 0x5655126b7ec0 2024-09-19T11:13:50.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.998+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'14 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:50.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.998+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5410 con 0x5655126bc820 2024-09-19T11:13:51.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.999+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'16 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:51.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:50.999+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5410 con 0x5655126b7ec0 2024-09-19T11:13:51.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.000+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'20 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:51.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.000+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126d5450 con 0x7f4ccc085040 2024-09-19T11:13:51.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.001+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:51.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.001+0000 7f4b867fc640 20 reqs_thread_entry: start 2024-09-19T11:13:51.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd7e2f800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:51.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd7e2f800 20 Filter name: none 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4af7fff640 20 reqs_thread_entry: start 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd7e2f800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd7e2f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5655126fff00 con 0x7f4ccc085040 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(94 bud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd7e2f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd7e2f800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x0 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.002+0000 7f4cd7e2f800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-19T11:13:51.004 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, user does not exist 2024-09-19T11:13:51.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.003+0000 7f4b877fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.003+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94923381305296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126cf810 con 0x5655126b34d0 2024-09-19T11:13:51.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.004+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94923381305296] v35'30 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:51.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.004+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94923381279680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c6fa0 con 0x7f4ccc085040 2024-09-19T11:13:51.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.005+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94923381279680] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:51.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.005+0000 7f4cd7e2f800 20 remove_watcher() i=0 2024-09-19T11:13:51.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.005+0000 7f4cd7e2f800 2 removed watcher, disabling cache 2024-09-19T11:13:51.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.005+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94923381284176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c0bc0 con 0x5655126b34d0 2024-09-19T11:13:51.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.006+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94923381284176] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:51.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.006+0000 7f4cd7e2f800 20 remove_watcher() i=1 2024-09-19T11:13:51.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.006+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94923381285440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c0bc0 con 0x5655126bc820 2024-09-19T11:13:51.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.007+0000 7f4cd511f640 1 -- 172.21.15.102:0/53390721 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94923381285440] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4ccc072030 con 0x5655126bc820 2024-09-19T11:13:51.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.007+0000 7f4cd7e2f800 20 remove_watcher() i=2 2024-09-19T11:13:51.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.007+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94923381288288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c0bc0 con 0x7f4ccc085040 2024-09-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.008+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94923381288288] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x7f4ccc085040 2024-09-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.008+0000 7f4cd7e2f800 20 remove_watcher() i=3 2024-09-19T11:13:51.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.008+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94923381294192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c2d60 con 0x5655126b34d0 2024-09-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.009+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94923381294192] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cd000a4d0 con 0x5655126b34d0 2024-09-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.009+0000 7f4cd7e2f800 20 remove_watcher() i=4 2024-09-19T11:13:51.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.009+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94923381298064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c4470 con 0x5655126b7ec0 2024-09-19T11:13:51.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.010+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94923381298064] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:51.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.010+0000 7f4cd7e2f800 20 remove_watcher() i=5 2024-09-19T11:13:51.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.010+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94923381301648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c5390 con 0x5655126b7ec0 2024-09-19T11:13:51.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.011+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94923381301648] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:51.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.011+0000 7f4cd7e2f800 20 remove_watcher() i=6 2024-09-19T11:13:51.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.011+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94923381303776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5655126c4470 con 0x5655126b7ec0 2024-09-19T11:13:51.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd5920640 1 -- 172.21.15.102:0/53390721 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94923381303776] v35'8 uv6 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4cc8018950 con 0x5655126b7ec0 2024-09-19T11:13:51.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 20 remove_watcher() i=7 2024-09-19T11:13:51.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5655126b7ec0 msgr2=0x5655126ba2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5655126b7ec0 0x5655126ba2b0 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5655126b34d0 msgr2=0x5655126b5990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5655126b34d0 0x5655126b5990 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4ccc085040 msgr2=0x7f4ccc077430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4ccc085040 0x7f4ccc077430 crc :-1 s=READY pgs=11 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126bc820 msgr2=0x5655126bece0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126bc820 0x5655126bece0 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ba003cfb0 msgr2=0x7f4ba003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ba003cfb0 0x7f4ba003f470 secure :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0x565512686820 tx=0x7f4ccc062040 comp rx=0 tx=0).stop 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 msgr2=0x5655126a7ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/53390721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126a0ab0 0x5655126a7ee0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7f4cc802dd90 tx=0x7f4cc80518e0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 reap_dead start 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd6121640 1 -- 172.21.15.102:0/53390721 reap_dead start 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 shutdown_connections 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 >> 172.21.15.102:0/53390721 conn(0x56551269ceb0 msgr2=0x56551269b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 shutdown_connections 2024-09-19T11:13:51.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.012+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/53390721 wait complete. 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/347620269 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bb003cfb0 msgr2=0x7f4bb003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/347620269 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bb003cfb0 0x7f4bb003f470 secure :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0x56551267db70 tx=0x7f4ccc005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/347620269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126941a0 msgr2=0x5655126945c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/347620269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126941a0 0x5655126945c0 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7f4cc802c560 tx=0x7f4cc8043da0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/347620269 shutdown_connections 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/347620269 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bb003cfb0 0x7f4bb003f470 unknown :-1 s=CLOSED pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/347620269 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5655126941a0 0x5655126945c0 unknown :-1 s=CLOSED pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/347620269 >> 172.21.15.102:0/347620269 conn(0x565512688550 msgr2=0x565512688930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/347620269 shutdown_connections 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/347620269 wait complete. 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56551267f9f0 msgr2=0x565512681de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56551267f9f0 0x565512681de0 crc :-1 s=READY pgs=10 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x565512580aa0 msgr2=0x56551267d180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x565512580aa0 0x56551267d180 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126838f0 msgr2=0x565512685ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5655126838f0 0x565512685ce0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bbc03cfb0 msgr2=0x7f4bbc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4bbc03cfb0 0x7f4bbc03f470 secure :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0x5655124ef790 tx=0x7f4ccc050000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 msgr2=0x56551257c650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 --2- 172.21.15.102:0/3551680582 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56551257cf30 0x56551257c650 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x56551266d0e0 tx=0x7f4cc80040e0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd6121640 1 -- 172.21.15.102:0/3551680582 reap_dead start 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 shutdown_connections 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 >> 172.21.15.102:0/3551680582 conn(0x565512576a90 msgr2=0x56551266d640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 shutdown_connections 2024-09-19T11:13:51.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.013+0000 7f4cd7e2f800 1 -- 172.21.15.102:0/3551680582 wait complete. 2024-09-19T11:13:51.022 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-19T11:13:51.023 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bar'] 2024-09-19T11:13:51.023 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bar'] 2024-09-19T11:13:51.023 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bar 2024-09-19T11:13:51.067 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:51.067 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:51.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6fb2e800 1 Processor -- start 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6fb2e800 1 -- start start 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6fb2e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5579adb42aa0 0x5579adb48640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6fb2e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5579adb41d40 con 0x5579adb41690 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6fb2e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5579ad9cd7d0 con 0x5579adb42aa0 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6b0dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5579adb42aa0 0x5579adb48640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6b0dc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5579adb42aa0 0x5579adb48640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42030/0 (socket says 172.21.15.102:42030) 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6b8dd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5579adb41690 0x5579adb42390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52160/0 (socket says 172.21.15.102:52160) 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.067+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/1041249707 learned_addr learned my addr 172.21.15.102:0/1041249707 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.068+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/1041249707 >> v1:172.21.15.37:6789/0 conn(0x5579adb41690 legacy=0x5579adb42390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.068+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/1041249707 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579adb42f50 con 0x5579adb42aa0 2024-09-19T11:13:51.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/1041249707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb42aa0 0x5579adb48640 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400a6b0 tx=0x7f5a54047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5e05d6e62aa9792c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6a8db640 1 -- 172.21.15.102:0/1041249707 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a5400a200 con 0x5579adb42aa0 2024-09-19T11:13:51.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6a8db640 1 -- 172.21.15.102:0/1041249707 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a5400a3a0 con 0x5579adb42aa0 2024-09-19T11:13:51.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6a8db640 1 -- 172.21.15.102:0/1041249707 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a54008700 con 0x5579adb42aa0 2024-09-19T11:13:51.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1041249707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb42aa0 msgr2=0x5579adb48640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/1041249707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb42aa0 0x5579adb48640 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x7f5a5400a6b0 tx=0x7f5a54047e30 comp rx=0 tx=0).stop 2024-09-19T11:13:51.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1041249707 shutdown_connections 2024-09-19T11:13:51.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/1041249707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb42aa0 0x5579adb48640 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1041249707 >> 172.21.15.102:0/1041249707 conn(0x5579adb3ca60 msgr2=0x5579adb3eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1041249707 shutdown_connections 2024-09-19T11:13:51.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.070+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1041249707 wait complete. 2024-09-19T11:13:51.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.083+0000 7f5a6fb2e800 1 Processor -- start 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.084+0000 7f5a6fb2e800 1 -- start start 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.084+0000 7f5a6fb2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc344c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.084+0000 7f5a6fb2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5579ad9dadd0 con 0x5579adb41690 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.084+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc344c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.084+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc344c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42046/0 (socket says 172.21.15.102:42046) 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.084+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/3934207874 learned_addr learned my addr 172.21.15.102:0/3934207874 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.084+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/3934207874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579adc34ab0 con 0x5579adb41690 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.084+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/3934207874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc344c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a640016e0 tx=0x7f5a64001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5641daf4a2168c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5959e0b640 1 -- 172.21.15.102:0/3934207874 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a64013420 con 0x5579adb41690 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5959e0b640 1 -- 172.21.15.102:0/3934207874 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a640135e0 con 0x5579adb41690 2024-09-19T11:13:51.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5959e0b640 1 -- 172.21.15.102:0/3934207874 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a64013900 con 0x5579adb41690 2024-09-19T11:13:51.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/3934207874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 msgr2=0x5579adc344c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/3934207874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc344c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x7f5a640016e0 tx=0x7f5a64001ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/3934207874 shutdown_connections 2024-09-19T11:13:51.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/3934207874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc344c0 unknown :-1 s=CLOSED pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/3934207874 >> 172.21.15.102:0/3934207874 conn(0x5579adb3ca60 msgr2=0x5579adc2ba30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/3934207874 shutdown_connections 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.085+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/3934207874 wait complete. 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.086+0000 7f5a6fb2e800 1 Processor -- start 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.086+0000 7f5a6fb2e800 1 -- start start 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.086+0000 7f5a6fb2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc3bfc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.086+0000 7f5a6fb2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5579adab50f0 con 0x5579adb41690 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.086+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc3bfc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.086+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc3bfc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42062/0 (socket says 172.21.15.102:42062) 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.086+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/373760153 learned_addr learned my addr 172.21.15.102:0/373760153 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.086+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/373760153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579adc3c520 con 0x5579adb41690 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.087+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc3bfc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a64000f80 tx=0x7f5a64001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.087+0000 7f5953fff640 1 -- 172.21.15.102:0/373760153 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a64022020 con 0x5579adb41690 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.087+0000 7f5953fff640 1 -- 172.21.15.102:0/373760153 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64019040 con 0x5579adb41690 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.087+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579adc3c7b0 con 0x5579adb41690 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.087+0000 7f5953fff640 1 -- 172.21.15.102:0/373760153 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a64004a40 con 0x5579adb41690 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.087+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579adc3d1b0 con 0x5579adb41690 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5953fff640 1 -- 172.21.15.102:0/373760153 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5a64025020 con 0x5579adb41690 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5953fff640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f595403cfb0 0x7f595403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5953fff640 1 -- 172.21.15.102:0/373760153 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5a64054480 con 0x5579adb41690 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f595403cfb0 0x7f595403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adb42aa0 0x5579adc43610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc43b50 con 0x5579adb42aa0 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5a6c0de640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adb42aa0 0x5579adc43610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f595403cfb0 0x7f595403f470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a54058000 tx=0x7f5a54053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.088+0000 7f5a6c0de640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adb42aa0 0x5579adc43610 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.089+0000 7f5a6c0de640 1 -- 172.21.15.102:0/373760153 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c0083e0 con 0x5579adb42aa0 2024-09-19T11:13:51.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.089+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc43ef0 con 0x5579adb42aa0 2024-09-19T11:13:51.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.089+0000 7f5a6c0de640 1 -- 172.21.15.102:0/373760153 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a5c0083e0 con 0x5579adb42aa0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.089+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc459f0 0x5579adc47e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.089+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc48620 con 0x5579adc459f0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.089+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc459f0 0x5579adc47e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.090+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc459f0 0x5579adc47e90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.090+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/373760153 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5a6400f030 con 0x5579adc459f0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.090+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc44740 con 0x5579adb42aa0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.091+0000 7f5a6c0de640 1 -- 172.21.15.102:0/373760153 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a5c0083e0 con 0x5579adb42aa0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.091+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc49a80 0x5579adc4be70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.091+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc4c5e0 con 0x5579adc49a80 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.091+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc49a80 0x5579adc4be70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.091+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc49a80 0x5579adc4be70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.091+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/373760153 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5a5404f780 con 0x5579adc49a80 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6fb2e800 1 Processor -- start 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6fb2e800 1 -- start start 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6fb2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc5a360 0x5579adc5a780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6fb2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5579ada394a0 con 0x5579adc5a360 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc5a360 0x5579adc5a780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc5a360 0x5579adc5a780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42076/0 (socket says 172.21.15.102:42076) 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/2261736883 learned_addr learned my addr 172.21.15.102:0/2261736883 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/2261736883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579adc5adc0 con 0x5579adc5a360 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.092+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/2261736883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc5a360 0x5579adc5a780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a640528d0 tx=0x7f5a64004f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.093+0000 7f59517fa640 1 -- 172.21.15.102:0/2261736883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6404b450 con 0x5579adc5a360 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.093+0000 7f59517fa640 1 -- 172.21.15.102:0/2261736883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64048020 con 0x5579adc5a360 2024-09-19T11:13:51.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.093+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/2261736883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579adc5b5f0 con 0x5579adc5a360 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.093+0000 7f59517fa640 1 -- 172.21.15.102:0/2261736883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a640541c0 con 0x5579adc5a360 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.093+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/2261736883 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579adc5b5f0 con 0x5579adc5a360 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.093+0000 7f59517fa640 1 -- 172.21.15.102:0/2261736883 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5a64010070 con 0x5579adc5a360 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f59517fa640 1 --2- 172.21.15.102:0/2261736883 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f594403cfb0 0x7f594403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f59517fa640 1 -- 172.21.15.102:0/2261736883 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5a64049030 con 0x5579adc5a360 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/2261736883 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f594403cfb0 0x7f594403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6fb2e800 1 Processor -- start 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6fb2e800 1 -- start start 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/2261736883 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f594403cfb0 0x7f594403f470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x5579adc44ae0 tx=0x7f5a54005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6fb2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc66e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6fb2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5579adc34ee0 con 0x5579adc66aa0 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc66e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc66e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42088/0 (socket says 172.21.15.102:42088) 2024-09-19T11:13:51.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.094+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/1906850860 learned_addr learned my addr 172.21.15.102:0/1906850860 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/1906850860 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579adc67470 con 0x5579adc66aa0 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/1906850860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc66e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a6403f010 tx=0x7f5a64052a70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2401d81a5a1e6dbf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f594affd640 1 -- 172.21.15.102:0/1906850860 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6403ed80 con 0x5579adc66aa0 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f594affd640 1 -- 172.21.15.102:0/1906850860 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a6401b270 con 0x5579adc66aa0 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f594affd640 1 -- 172.21.15.102:0/1906850860 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a640113d0 con 0x5579adc66aa0 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1906850860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 msgr2=0x5579adc66e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/1906850860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc66e80 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f5a6403f010 tx=0x7f5a64052a70 comp rx=0 tx=0).stop 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1906850860 shutdown_connections 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/1906850860 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc66e80 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1906850860 >> 172.21.15.102:0/1906850860 conn(0x5579adc62ea0 msgr2=0x5579adc610e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1906850860 shutdown_connections 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.095+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/1906850860 wait complete. 2024-09-19T11:13:51.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.096+0000 7f5a6fb2e800 1 Processor -- start 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.096+0000 7f5a6fb2e800 1 -- start start 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.096+0000 7f5a6fb2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc6dee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.096+0000 7f5a6fb2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5579adc67900 con 0x5579adc66aa0 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.096+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc6dee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.096+0000 7f5a6b8dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc6dee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42104/0 (socket says 172.21.15.102:42104) 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.096+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 learned_addr learned my addr 172.21.15.102:0/389468130 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.096+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5579adc6e440 con 0x5579adc66aa0 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.097+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc6dee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a6401b980 tx=0x7f5a64046f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.097+0000 7f59497fa640 1 -- 172.21.15.102:0/389468130 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a6406f070 con 0x5579adc66aa0 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.097+0000 7f59497fa640 1 -- 172.21.15.102:0/389468130 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5a64026a10 con 0x5579adc66aa0 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.097+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5579adc6e440 con 0x5579adc66aa0 2024-09-19T11:13:51.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.097+0000 7f59497fa640 1 -- 172.21.15.102:0/389468130 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5a64058050 con 0x5579adc66aa0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.097+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5579adc6e440 con 0x5579adc66aa0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.098+0000 7f59497fa640 1 -- 172.21.15.102:0/389468130 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5a64072070 con 0x5579adc66aa0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.098+0000 7f59497fa640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f593403cfb0 0x7f593403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.098+0000 7f59497fa640 1 -- 172.21.15.102:0/389468130 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5a6405b020 con 0x5579adc66aa0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.098+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f593403cfb0 0x7f593403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.098+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f593403cfb0 0x7f593403f470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5579adc4c9e0 tx=0x7f5a5400a000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.098+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.098+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adc79470 0x5579adc7b930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.098+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7c080 con 0x5579adc79470 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6c0de640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adc79470 0x5579adc7b930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6c0de640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adc79470 0x5579adc7b930 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c0083e0 con 0x5579adc79470 2024-09-19T11:13:51.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 20 realm 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7c490 con 0x5579adc79470 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c0083e0 con 0x5579adc79470 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c0083e0 con 0x5579adc79470 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.099+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.100+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7d100 con 0x5579adc79470 2024-09-19T11:13:51.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.100+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5a5c0083e0 con 0x5579adc79470 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.100+0000 7f5a6fb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.100+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.100+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc7dac0 0x5579adc7feb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.100+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc80500 con 0x5579adc7dac0 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.100+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc7dac0 0x5579adc7feb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.100+0000 7f5a6b8dd640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc7dac0 0x5579adc7feb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.101+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.101+0000 7f5a6fb2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.101+0000 7f5a6fb2e800 20 searching for the correct realm 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.101+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc82490 0x5579adc84950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.101+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc84fd0 con 0x5579adc82490 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.101+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc82490 0x5579adc84950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.101+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc82490 0x5579adc84950 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.102+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.102+0000 7f5a6b0dc640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5a54084040 0x7f5a54084420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.102+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc84fd0 con 0x7f5a54084040 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.102+0000 7f5a6c0de640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5a54084040 0x7f5a54084420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.102+0000 7f5a6c0de640 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5a54084040 0x7f5a54084420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.102+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c0083e0 con 0x7f5a54084040 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.102+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.103+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.103+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.103+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c0083e0 con 0x5579adc79470 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.103+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.103+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.103+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.103+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.103+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.104+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.104+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x7f5a54084040 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.104+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x7f5a54084040 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.104+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc82490 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.104+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.104+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.104+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.104+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.105+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.105+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.105+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.105+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x7f5a54084040 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.105+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5a5c026040 con 0x7f5a54084040 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.105+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc82490 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.105+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.105+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc82490 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.106+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.106+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.106+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.106+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc82490 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.106+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.106+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc82490 2024-09-19T11:13:51.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.106+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.106+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.107+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.107+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.107+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.107+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.107+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.107+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc82490 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.107+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.108+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x7f5a54084040 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.108+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x7f5a54084040 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.108+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.108+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.108+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.108+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.108+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc82490 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.109+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.109+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.109+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.109+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x7f5a54084040 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.109+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x7f5a54084040 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.109+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc82490 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.109+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.109+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc7dac0 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x5579adc79470 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5579adc7cd60 con 0x7f5a54084040 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5a5c026040 con 0x7f5a54084040 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:51.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc808a0 con 0x5579adc79470 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.110+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc808a0 con 0x5579adc79470 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5a5c026040 con 0x5579adc79470 2024-09-19T11:13:51.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc808a0 con 0x5579adc82490 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 20 zone default found 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 4 Realm: () 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 20 zonegroup default 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc81190 con 0x5579adc7dac0 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.111+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc86f40 con 0x5579adc82490 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc873d0 con 0x5579adc82490 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6fb2e800 20 started sync module instance, tier type = 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6fb2e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.112+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc862e0 con 0x7f5a54084040 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.113+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c026040 con 0x7f5a54084040 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.113+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93981094996016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc862e0 con 0x7f5a54084040 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.113+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc87eb0 con 0x5579adc79470 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.114+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93981094996016] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.114+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.114+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93981095000480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc862e0 con 0x5579adc79470 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.114+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc88950 con 0x5579adc82490 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.115+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93981095000480] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.115+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.115+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93981094993456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc86250 con 0x5579adc82490 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.115+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc89810 con 0x7f5a54084040 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.116+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93981094993456] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.116+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.116+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93981095007072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc89c30 con 0x7f5a54084040 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.116+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8a5f0 con 0x5579adc79470 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.117+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.117+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93981095010624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8a560 con 0x5579adc79470 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.117+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8b570 con 0x5579adc7dac0 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.118+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93981095007072] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.119+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.119+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93981095014528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8b990 con 0x5579adc7dac0 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.119+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8c390 con 0x5579adc7dac0 2024-09-19T11:13:51.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.119+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93981095010624] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.120+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.120+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93981095012832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8c780 con 0x5579adc7dac0 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.120+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8d140 con 0x5579adc7dac0 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.120+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93981095014528] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'9 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93981095008128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8d140 con 0x5579adc7dac0 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6fb2e800 20 add_watcher() i=0 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6fb2e800 20 add_watcher() i=1 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6fb2e800 20 add_watcher() i=2 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6fb2e800 20 add_watcher() i=3 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6fb2e800 20 add_watcher() i=4 2024-09-19T11:13:51.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6fb2e800 20 add_watcher() i=5 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93981095012832] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.121+0000 7f5a6fb2e800 20 add_watcher() i=6 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.122+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93981095008128] v35'10 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.122+0000 7f5a6fb2e800 20 add_watcher() i=7 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.122+0000 7f5a6fb2e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.122+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8bea0 con 0x5579adc79470 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.122+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.122+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93981095018144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8d5b0 con 0x5579adc79470 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.123+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93981095018144] v35'31 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.123+0000 7f5921fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.123+0000 7f5a6fb2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.123+0000 7f5a6fb2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:51.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.123+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc989c0 con 0x5579adc79470 2024-09-19T11:13:51.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.124+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.124+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc989c0 con 0x5579adc7dac0 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.125+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'11 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.125+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc989c0 con 0x5579adc82490 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.127+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.127+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc993e0 con 0x5579adc79470 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.128+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.128+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc99950 con 0x7f5a54084040 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.129+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.129+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc99d30 con 0x5579adc82490 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.130+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.130+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a2a0 con 0x5579adc79470 2024-09-19T11:13:51.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.131+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.131+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a2a0 con 0x5579adc7dac0 2024-09-19T11:13:51.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.132+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'15 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.133+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a330 con 0x7f5a54084040 2024-09-19T11:13:51.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.133+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.134+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a330 con 0x5579adc82490 2024-09-19T11:13:51.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.136+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.136+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a3c0 con 0x7f5a54084040 2024-09-19T11:13:51.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.139+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.139+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a3c0 con 0x5579adc7dac0 2024-09-19T11:13:51.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.140+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.140+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a590 con 0x7f5a54084040 2024-09-19T11:13:51.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.141+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.141+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a590 con 0x5579adc7dac0 2024-09-19T11:13:51.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.143+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'21 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.143+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a590 con 0x5579adc79470 2024-09-19T11:13:51.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.144+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'33 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.144+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a590 con 0x5579adc82490 2024-09-19T11:13:51.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.145+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.145+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a590 con 0x7f5a54084040 2024-09-19T11:13:51.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.146+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'25 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.146+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a590 con 0x5579adc82490 2024-09-19T11:13:51.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.147+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.147+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9aa00 con 0x5579adc79470 2024-09-19T11:13:51.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.148+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.148+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9e0 con 0x5579adc79470 2024-09-19T11:13:51.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.149+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'34 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.149+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x5579adc82490 2024-09-19T11:13:51.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.151+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.151+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x7f5a54084040 2024-09-19T11:13:51.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.152+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'21 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.152+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x5579adc82490 2024-09-19T11:13:51.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.153+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.153+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x5579adc82490 2024-09-19T11:13:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.154+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.154+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x5579adc82490 2024-09-19T11:13:51.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.157+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'7 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.157+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x5579adc82490 2024-09-19T11:13:51.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.158+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'16 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.158+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x5579adc7dac0 2024-09-19T11:13:51.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.159+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'13 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.159+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x5579adc82490 2024-09-19T11:13:51.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.160+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'11 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.160+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc99100 con 0x5579adc7dac0 2024-09-19T11:13:51.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.163+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'16 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.163+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc99100 con 0x5579adc82490 2024-09-19T11:13:51.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.164+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'19 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.164+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc99100 con 0x5579adc7dac0 2024-09-19T11:13:51.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.165+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'22 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.166+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc9a9c0 con 0x7f5a54084040 2024-09-19T11:13:51.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f5920fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f5a6fb2e800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f5a6fb2e800 20 Filter name: none 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f589a7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f5a6fb2e800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f5a6fb2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:94 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5579adcc54a0 con 0x5579adc7dac0 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.167+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(94 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.168+0000 7f5a6fb2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.168+0000 7f5a6fb2e800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.168+0000 7f5a6fb2e800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-19T11:13:51.169 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, user does not exist 2024-09-19T11:13:51.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.168+0000 7f5921fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.168+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93981095018144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc96ae0 con 0x5579adc79470 2024-09-19T11:13:51.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.169+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 93981095018144] v35'35 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.169+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93981094996016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8bea0 con 0x7f5a54084040 2024-09-19T11:13:51.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.170+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 93981094996016] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.170+0000 7f5a6fb2e800 20 remove_watcher() i=0 2024-09-19T11:13:51.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.170+0000 7f5a6fb2e800 2 removed watcher, disabling cache 2024-09-19T11:13:51.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.170+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93981095000480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc86830 con 0x5579adc79470 2024-09-19T11:13:51.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.171+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 93981095000480] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.171+0000 7f5a6fb2e800 20 remove_watcher() i=1 2024-09-19T11:13:51.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.171+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93981094993456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc879a0 con 0x5579adc82490 2024-09-19T11:13:51.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.173+0000 7f5a6b0dc640 1 -- 172.21.15.102:0/389468130 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 93981094993456] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a54073070 con 0x5579adc82490 2024-09-19T11:13:51.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.173+0000 7f5a6fb2e800 20 remove_watcher() i=2 2024-09-19T11:13:51.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.173+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93981095007072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc879a0 con 0x7f5a54084040 2024-09-19T11:13:51.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.174+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 93981095007072] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x7f5a54084040 2024-09-19T11:13:51.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.174+0000 7f5a6fb2e800 20 remove_watcher() i=3 2024-09-19T11:13:51.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.174+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93981095010624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc89360 con 0x5579adc79470 2024-09-19T11:13:51.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.175+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 93981095010624] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a5c036040 con 0x5579adc79470 2024-09-19T11:13:51.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.175+0000 7f5a6fb2e800 20 remove_watcher() i=4 2024-09-19T11:13:51.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.175+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93981095014528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc879a0 con 0x5579adc7dac0 2024-09-19T11:13:51.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.176+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 93981095014528] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.176+0000 7f5a6fb2e800 20 remove_watcher() i=5 2024-09-19T11:13:51.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.176+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93981095012832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc8a140 con 0x5579adc7dac0 2024-09-19T11:13:51.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.179+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 93981095012832] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.179+0000 7f5a6fb2e800 20 remove_watcher() i=6 2024-09-19T11:13:51.180 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.179+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93981095008128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5579adc89360 con 0x5579adc7dac0 2024-09-19T11:13:51.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6b8dd640 1 -- 172.21.15.102:0/389468130 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 93981095008128] v35'11 uv9 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5a64071030 con 0x5579adc7dac0 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 20 remove_watcher() i=7 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc7dac0 msgr2=0x5579adc7feb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc7dac0 0x5579adc7feb0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adc79470 msgr2=0x5579adc7b930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adc79470 0x5579adc7b930 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5a54084040 msgr2=0x7f5a54084420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5a54084040 0x7f5a54084420 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc82490 msgr2=0x5579adc84950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc82490 0x5579adc84950 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f593403cfb0 msgr2=0x7f593403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f593403cfb0 0x7f593403f470 secure :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0x5579adc4c9e0 tx=0x7f5a5400a000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 msgr2=0x5579adc6dee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6c0de640 1 -- 172.21.15.102:0/389468130 reap_dead start 2024-09-19T11:13:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc6dee0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f5a6401b980 tx=0x7f5a64046f50 comp rx=0 tx=0).stop 2024-09-19T11:13:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 shutdown_connections 2024-09-19T11:13:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/389468130 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc66aa0 0x5579adc6dee0 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.180+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 >> 172.21.15.102:0/389468130 conn(0x5579adc62ea0 msgr2=0x5579adc610b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 shutdown_connections 2024-09-19T11:13:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/389468130 wait complete. 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/2261736883 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f594403cfb0 msgr2=0x7f594403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/2261736883 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f594403cfb0 0x7f594403f470 secure :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0x5579adc44ae0 tx=0x7f5a54005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/2261736883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc5a360 msgr2=0x5579adc5a780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/2261736883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc5a360 0x5579adc5a780 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x7f5a640528d0 tx=0x7f5a64004f90 comp rx=0 tx=0).stop 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/2261736883 shutdown_connections 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/2261736883 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f594403cfb0 0x7f594403f470 unknown :-1 s=CLOSED pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/2261736883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adc5a360 0x5579adc5a780 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/2261736883 >> 172.21.15.102:0/2261736883 conn(0x5579adc4e710 msgr2=0x5579adc4eaf0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/2261736883 shutdown_connections 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/2261736883 wait complete. 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc459f0 msgr2=0x5579adc47e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5579adc459f0 0x5579adc47e90 crc :-1 s=READY pgs=12 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adb42aa0 msgr2=0x5579adc43610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5579adb42aa0 0x5579adc43610 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc49a80 msgr2=0x5579adc4be70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5579adc49a80 0x5579adc4be70 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f595403cfb0 msgr2=0x7f595403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f595403cfb0 0x7f595403f470 secure :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0x7f5a54058000 tx=0x7f5a54053000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 msgr2=0x5579adc3bfc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 --2- 172.21.15.102:0/373760153 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5579adb41690 0x5579adc3bfc0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f5a64000f80 tx=0x7f5a64001250 comp rx=0 tx=0).stop 2024-09-19T11:13:51.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6c0de640 1 -- 172.21.15.102:0/373760153 reap_dead start 2024-09-19T11:13:51.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 shutdown_connections 2024-09-19T11:13:51.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.181+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 >> 172.21.15.102:0/373760153 conn(0x5579adb3ca60 msgr2=0x5579adc359b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.182+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 shutdown_connections 2024-09-19T11:13:51.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.182+0000 7f5a6fb2e800 1 -- 172.21.15.102:0/373760153 wait complete. 2024-09-19T11:13:51.191 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-19T11:13:51.191 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-19T11:13:51.191 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-19T11:13:51.192 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-19T11:13:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a8416800 1 Processor -- start 2024-09-19T11:13:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a8416800 1 -- start start 2024-09-19T11:13:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a8416800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55fc5321cda0 0x55fc5321d1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a8416800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fc532257f0 con 0x55fc53221bc0 2024-09-19T11:13:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a8416800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55fc530a77d0 con 0x55fc5321cda0 2024-09-19T11:13:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a3be7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55fc5321cda0 0x55fc5321d1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a3be7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55fc5321cda0 0x55fc5321d1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42112/0 (socket says 172.21.15.102:42112) 2024-09-19T11:13:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a3be7640 1 -- 172.21.15.102:0/2762566141 learned_addr learned my addr 172.21.15.102:0/2762566141 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a3be7640 1 -- 172.21.15.102:0/2762566141 >> v1:172.21.15.37:6789/0 conn(0x55fc53221bc0 legacy=0x55fc53223fb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.236+0000 7f54a3be7640 1 -- 172.21.15.102:0/2762566141 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc53226a20 con 0x55fc5321cda0 2024-09-19T11:13:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.238+0000 7f54a3be7640 1 --2- 172.21.15.102:0/2762566141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5321d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f549400a520 tx=0x7f5494045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c4593a876ac159ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.238+0000 7f54a33e6640 1 -- 172.21.15.102:0/2762566141 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5494055070 con 0x55fc5321cda0 2024-09-19T11:13:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.238+0000 7f54a33e6640 1 -- 172.21.15.102:0/2762566141 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54940515b0 con 0x55fc5321cda0 2024-09-19T11:13:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.238+0000 7f54a33e6640 1 -- 172.21.15.102:0/2762566141 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54940518d0 con 0x55fc5321cda0 2024-09-19T11:13:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.239+0000 7f54a8416800 1 -- 172.21.15.102:0/2762566141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 msgr2=0x55fc5321d1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.239+0000 7f54a8416800 1 --2- 172.21.15.102:0/2762566141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5321d1a0 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x7f549400a520 tx=0x7f5494045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.239+0000 7f54a8416800 1 -- 172.21.15.102:0/2762566141 shutdown_connections 2024-09-19T11:13:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.239+0000 7f54a8416800 1 --2- 172.21.15.102:0/2762566141 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5321d1a0 unknown :-1 s=CLOSED pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.239+0000 7f54a8416800 1 -- 172.21.15.102:0/2762566141 >> 172.21.15.102:0/2762566141 conn(0x55fc532161c0 msgr2=0x55fc53218640 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.239+0000 7f54a8416800 1 -- 172.21.15.102:0/2762566141 shutdown_connections 2024-09-19T11:13:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.239+0000 7f54a8416800 1 -- 172.21.15.102:0/2762566141 wait complete. 2024-09-19T11:13:51.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.253+0000 7f54a8416800 1 Processor -- start 2024-09-19T11:13:51.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.253+0000 7f54a8416800 1 -- start start 2024-09-19T11:13:51.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.253+0000 7f54a8416800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5330e530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.253+0000 7f54a8416800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc530b4dd0 con 0x55fc5321cda0 2024-09-19T11:13:51.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.253+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5330e530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.253+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5330e530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42126/0 (socket says 172.21.15.102:42126) 2024-09-19T11:13:51.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.253+0000 7f54a3be7640 1 -- 172.21.15.102:0/1693459712 learned_addr learned my addr 172.21.15.102:0/1693459712 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.254+0000 7f54a3be7640 1 -- 172.21.15.102:0/1693459712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc5330eb20 con 0x55fc5321cda0 2024-09-19T11:13:51.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.254+0000 7f54a3be7640 1 --2- 172.21.15.102:0/1693459712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5330e530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5494025da0 tx=0x7f5494051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3bd6fdf6d01b8f14 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.254+0000 7f5391e0b640 1 -- 172.21.15.102:0/1693459712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5494051950 con 0x55fc5321cda0 2024-09-19T11:13:51.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.254+0000 7f5391e0b640 1 -- 172.21.15.102:0/1693459712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5494051af0 con 0x55fc5321cda0 2024-09-19T11:13:51.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.254+0000 7f5391e0b640 1 -- 172.21.15.102:0/1693459712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5494051dd0 con 0x55fc5321cda0 2024-09-19T11:13:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 -- 172.21.15.102:0/1693459712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 msgr2=0x55fc5330e530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 --2- 172.21.15.102:0/1693459712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5330e530 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5494025da0 tx=0x7f5494051000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 -- 172.21.15.102:0/1693459712 shutdown_connections 2024-09-19T11:13:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 --2- 172.21.15.102:0/1693459712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc5321cda0 0x55fc5330e530 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 -- 172.21.15.102:0/1693459712 >> 172.21.15.102:0/1693459712 conn(0x55fc532161c0 msgr2=0x55fc53309eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 -- 172.21.15.102:0/1693459712 shutdown_connections 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 -- 172.21.15.102:0/1693459712 wait complete. 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 Processor -- start 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 -- start start 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53221bc0 0x55fc53316170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a8416800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc53225cc0 con 0x55fc53221bc0 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53221bc0 0x55fc53316170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53221bc0 0x55fc53316170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42136/0 (socket says 172.21.15.102:42136) 2024-09-19T11:13:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.255+0000 7f54a3be7640 1 -- 172.21.15.102:0/3766718438 learned_addr learned my addr 172.21.15.102:0/3766718438 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.256+0000 7f54a3be7640 1 -- 172.21.15.102:0/3766718438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc533166d0 con 0x55fc53221bc0 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.256+0000 7f54a3be7640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53221bc0 0x55fc53316170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5494067040 tx=0x7f5494002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.256+0000 7f538bfff640 1 -- 172.21.15.102:0/3766718438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5494073020 con 0x55fc53221bc0 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.256+0000 7f538bfff640 1 -- 172.21.15.102:0/3766718438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5494051e50 con 0x55fc53221bc0 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.256+0000 7f538bfff640 1 -- 172.21.15.102:0/3766718438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f549406f580 con 0x55fc53221bc0 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.256+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc53316960 con 0x55fc53221bc0 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.256+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc53317570 con 0x55fc53221bc0 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.257+0000 7f538bfff640 1 -- 172.21.15.102:0/3766718438 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5494076020 con 0x55fc53221bc0 2024-09-19T11:13:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.257+0000 7f538bfff640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f538c03d000 0x7f538c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.257+0000 7f538bfff640 1 -- 172.21.15.102:0/3766718438 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f549406b040 con 0x55fc53221bc0 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.257+0000 7f549b3e6640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f538c03d000 0x7f538c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.257+0000 7f54a8416800 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc5331b7b0 0x55fc5331dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.257+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5331e0e0 con 0x55fc5331b7b0 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.258+0000 7f54a43e8640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc5331b7b0 0x55fc5331dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.258+0000 7f549b3e6640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f538c03d000 0x7f538c03f4c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f548c001e50 tx=0x7f548c0013d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.258+0000 7f54a43e8640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc5331b7b0 0x55fc5331dba0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.258+0000 7f54a43e8640 1 -- 172.21.15.102:0/3766718438 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc5331b7b0 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.258+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5331e480 con 0x55fc5331b7b0 2024-09-19T11:13:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.258+0000 7f54a43e8640 1 -- 172.21.15.102:0/3766718438 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc5331b7b0 2024-09-19T11:13:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.258+0000 7f54a8416800 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc5331ff80 0x55fc53322400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.258+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc53322b90 con 0x55fc5331ff80 2024-09-19T11:13:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.259+0000 7f54a3be7640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc5331ff80 0x55fc53322400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.259+0000 7f54a3be7640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc5331ff80 0x55fc53322400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.260+0000 7f54a3be7640 1 -- 172.21.15.102:0/3766718438 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5494057030 con 0x55fc5331ff80 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.260+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5331ecd0 con 0x55fc5331b7b0 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.260+0000 7f54a43e8640 1 -- 172.21.15.102:0/3766718438 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc5331b7b0 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.260+0000 7f54a8416800 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc53323ff0 0x55fc533263e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.260+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc53326b20 con 0x55fc53323ff0 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.260+0000 7f549b3e6640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc53323ff0 0x55fc533263e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.260+0000 7f549b3e6640 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc53323ff0 0x55fc533263e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.261+0000 7f549b3e6640 1 -- 172.21.15.102:0/3766718438 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f548c010600 con 0x55fc53323ff0 2024-09-19T11:13:51.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.261+0000 7f54a8416800 1 Processor -- start 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.261+0000 7f54a8416800 1 -- start start 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.261+0000 7f54a8416800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53334860 0x55fc53334c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.261+0000 7f54a8416800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc531134a0 con 0x55fc53334860 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.261+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53334860 0x55fc53334c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.261+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53334860 0x55fc53334c80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42144/0 (socket says 172.21.15.102:42144) 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.261+0000 7f54a3be7640 1 -- 172.21.15.102:0/3069463572 learned_addr learned my addr 172.21.15.102:0/3069463572 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.262+0000 7f54a3be7640 1 -- 172.21.15.102:0/3069463572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc533352c0 con 0x55fc53334860 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.262+0000 7f54a3be7640 1 --2- 172.21.15.102:0/3069463572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53334860 0x55fc53334c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5494096b10 tx=0x7f5494098420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.262+0000 7f5389ffb640 1 -- 172.21.15.102:0/3069463572 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f549405a450 con 0x55fc53334860 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.262+0000 7f5389ffb640 1 -- 172.21.15.102:0/3069463572 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f549408fd60 con 0x55fc53334860 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.262+0000 7f54a8416800 1 -- 172.21.15.102:0/3069463572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc53335af0 con 0x55fc53334860 2024-09-19T11:13:51.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.262+0000 7f5389ffb640 1 -- 172.21.15.102:0/3069463572 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f549408f1c0 con 0x55fc53334860 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.262+0000 7f54a8416800 1 -- 172.21.15.102:0/3069463572 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc53336090 con 0x55fc53334860 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f5389ffb640 1 -- 172.21.15.102:0/3069463572 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5494058070 con 0x55fc53334860 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f5389ffb640 1 --2- 172.21.15.102:0/3069463572 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f537c03d000 0x7f537c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f5389ffb640 1 -- 172.21.15.102:0/3069463572 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5494088070 con 0x55fc53334860 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f549b3e6640 1 --2- 172.21.15.102:0/3069463572 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f537c03d000 0x7f537c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f54a8416800 1 Processor -- start 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f549b3e6640 1 --2- 172.21.15.102:0/3069463572 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f537c03d000 0x7f537c03f4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55fc53326f20 tx=0x7f548c006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f54a8416800 1 -- start start 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f54a8416800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53341500 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.263+0000 7f54a8416800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc5330ee90 con 0x55fc53341120 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.264+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53341500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.264+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53341500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42158/0 (socket says 172.21.15.102:42158) 2024-09-19T11:13:51.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.264+0000 7f54a3be7640 1 -- 172.21.15.102:0/4290114660 learned_addr learned my addr 172.21.15.102:0/4290114660 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.264+0000 7f54a3be7640 1 -- 172.21.15.102:0/4290114660 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc53341af0 con 0x55fc53341120 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.264+0000 7f54a3be7640 1 --2- 172.21.15.102:0/4290114660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53341500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f549407c030 tx=0x7f549408bb50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=551d62c4240a368f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.264+0000 7f5382ffd640 1 -- 172.21.15.102:0/4290114660 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f549409d070 con 0x55fc53341120 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.264+0000 7f5382ffd640 1 -- 172.21.15.102:0/4290114660 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5494050ce0 con 0x55fc53341120 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.264+0000 7f5382ffd640 1 -- 172.21.15.102:0/4290114660 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f549406f760 con 0x55fc53341120 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 -- 172.21.15.102:0/4290114660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 msgr2=0x55fc53341500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 --2- 172.21.15.102:0/4290114660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53341500 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7f549407c030 tx=0x7f549408bb50 comp rx=0 tx=0).stop 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 -- 172.21.15.102:0/4290114660 shutdown_connections 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 --2- 172.21.15.102:0/4290114660 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53341500 unknown :-1 s=CLOSED pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 -- 172.21.15.102:0/4290114660 >> 172.21.15.102:0/4290114660 conn(0x55fc5333d520 msgr2=0x55fc5333b760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 -- 172.21.15.102:0/4290114660 shutdown_connections 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 -- 172.21.15.102:0/4290114660 wait complete. 2024-09-19T11:13:51.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 Processor -- start 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 -- start start 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53348530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a8416800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fc53341f80 con 0x55fc53341120 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53348530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a3be7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53348530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42170/0 (socket says 172.21.15.102:42170) 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.265+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 learned_addr learned my addr 172.21.15.102:0/1409005818 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.266+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fc53348a90 con 0x55fc53341120 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.266+0000 7f54a3be7640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53348530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5494001eb0 tx=0x7f5494053ec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.266+0000 7f53817fa640 1 -- 172.21.15.102:0/1409005818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54940bc070 con 0x55fc53341120 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.266+0000 7f53817fa640 1 -- 172.21.15.102:0/1409005818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54940b1070 con 0x55fc53341120 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.266+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fc53348a90 con 0x55fc53341120 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.266+0000 7f53817fa640 1 -- 172.21.15.102:0/1409005818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5494006380 con 0x55fc53341120 2024-09-19T11:13:51.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.266+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fc53348a90 con 0x55fc53341120 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.267+0000 7f53817fa640 1 -- 172.21.15.102:0/1409005818 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f54940bf070 con 0x55fc53341120 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.267+0000 7f53817fa640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f536c03cf30 0x7f536c03f3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.267+0000 7f53817fa640 1 -- 172.21.15.102:0/1409005818 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5494094040 con 0x55fc53341120 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.267+0000 7f549b3e6640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f536c03cf30 0x7f536c03f3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f549b3e6640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f536c03cf30 0x7f536c03f3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f548c00bf70 tx=0x7f548c011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc53353b20 0x55fc53355fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc53356730 con 0x55fc53353b20 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a43e8640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc53353b20 0x55fc53355fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a43e8640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc53353b20 0x55fc53355fe0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a8416800 20 realm 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.268+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc53356b40 con 0x55fc53353b20 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc53357410 con 0x55fc53353b20 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc533577b0 con 0x55fc53353b20 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc53358510 0x55fc5335a900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5335aec0 con 0x55fc53358510 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.269+0000 7f54a3be7640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc53358510 0x55fc5335a900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.270+0000 7f54a3be7640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc53358510 0x55fc5335a900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.270+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.270+0000 7f54a8416800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.270+0000 7f54a8416800 20 searching for the correct realm 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.270+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc5335ce70 0x55fc5335f330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.270+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc5335fa00 con 0x55fc5335ce70 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.270+0000 7f549b3e6640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc5335ce70 0x55fc5335f330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.270+0000 7f549b3e6640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc5335ce70 0x55fc5335f330 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.271+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548c036040 con 0x55fc5335ce70 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.271+0000 7f549b3e6640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f548c0393c0 0x7f548c0397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.271+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc5335fa00 con 0x7f548c0393c0 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.271+0000 7f54a43e8640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f548c0393c0 0x7f548c0397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.271+0000 7f54a43e8640 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f548c0393c0 0x7f548c0397e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.271+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.271+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc533577b0 con 0x55fc53358510 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.272+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.272+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc533577b0 con 0x55fc53353b20 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.272+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.272+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc533577b0 con 0x55fc53353b20 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.272+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.272+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55fc533577b0 con 0x55fc53358510 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.272+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.272+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53358510 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.273+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.273+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x7f548c0393c0 2024-09-19T11:13:51.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.273+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.273+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc5335ce70 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.273+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548c036040 con 0x55fc5335ce70 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.273+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53353b20 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.273+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.273+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53358510 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53353b20 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x7f548c0393c0 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc5335ce70 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548c036040 con 0x55fc5335ce70 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc5335ce70 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f548c036040 con 0x55fc5335ce70 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.274+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53358510 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.275+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.275+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc5335ce70 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.275+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548c036040 con 0x55fc5335ce70 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.275+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc5335ce70 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.275+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548c036040 con 0x55fc5335ce70 2024-09-19T11:13:51.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.275+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53353b20 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.275+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.275+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53353b20 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.276+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.276+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53358510 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.276+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.276+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc5335ce70 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.276+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548c036040 con 0x55fc5335ce70 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.276+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x7f548c0393c0 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.277+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.277+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53353b20 2024-09-19T11:13:51.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.277+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.277+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53358510 2024-09-19T11:13:51.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.277+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.277+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc5335ce70 2024-09-19T11:13:51.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.278+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548c036040 con 0x55fc5335ce70 2024-09-19T11:13:51.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.278+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53358510 2024-09-19T11:13:51.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.278+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.278+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x7f548c0393c0 2024-09-19T11:13:51.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.278+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.278+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc5335ce70 2024-09-19T11:13:51.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.278+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.278+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53358510 2024-09-19T11:13:51.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x55fc53353b20 2024-09-19T11:13:51.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7f54940ca040 con 0x7f548c0393c0 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5335b780 con 0x55fc53353b20 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.279+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5335b780 con 0x55fc53353b20 2024-09-19T11:13:51.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5335b780 con 0x55fc5335ce70 2024-09-19T11:13:51.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:51.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 20 zone default found 2024-09-19T11:13:51.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 4 Realm: () 2024-09-19T11:13:51.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:51.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:51.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:51.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 20 zonegroup default 2024-09-19T11:13:51.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5335c070 con 0x55fc53358510 2024-09-19T11:13:51.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.280+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc53361970 con 0x55fc5335ce70 2024-09-19T11:13:51.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f54a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc53361e20 con 0x55fc5335ce70 2024-09-19T11:13:51.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f54a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f54a8416800 20 started sync module instance, tier type = 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f54a8416800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.281+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53360d10 con 0x7f548c0393c0 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.282+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.282+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94542216172048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53360d10 con 0x7f548c0393c0 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.282+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53362970 con 0x55fc53353b20 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.284+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.284+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94542216176704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53362930 con 0x55fc53353b20 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.284+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53363950 con 0x55fc5335ce70 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.285+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94542216172048] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.287+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.287+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94542216180832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53363d40 con 0x55fc5335ce70 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.287+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94542216176704] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.287+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53364770 con 0x7f548c0393c0 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.288+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.288+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94542216184448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53364c20 con 0x7f548c0393c0 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.288+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533655e0 con 0x55fc53353b20 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.288+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94542216180832] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.291+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.291+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94542216169568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533655e0 con 0x55fc53353b20 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.291+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53365ff0 con 0x55fc53358510 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.291+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94542216184448] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.294+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94542216169568] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.294+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.294+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94542216185712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533655e0 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.294+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53366890 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.296+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94542216185712] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.296+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.297+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94542216192992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53366cb0 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.297+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53367580 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'12 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94542216192992] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94542216195248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53367780 con 0x55fc53358510 2024-09-19T11:13:51.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a8416800 20 add_watcher() i=0 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a8416800 20 add_watcher() i=1 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a8416800 20 add_watcher() i=2 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a8416800 20 add_watcher() i=3 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a8416800 20 add_watcher() i=4 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a8416800 20 add_watcher() i=5 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.298+0000 7f54a8416800 20 add_watcher() i=6 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.299+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94542216195248] v35'13 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.299+0000 7f54a8416800 20 add_watcher() i=7 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.299+0000 7f54a8416800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.299+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc5336abc0 con 0x55fc53353b20 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.299+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.299+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94542216197856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53367fb0 con 0x55fc53353b20 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.301+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94542216197856] v35'36 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.301+0000 7f5359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.301+0000 7f54a8416800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.301+0000 7f54a8416800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.302+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53373350 con 0x55fc53353b20 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.303+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.303+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53373350 con 0x55fc53358510 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.304+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'12 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.304+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53373350 con 0x55fc5335ce70 2024-09-19T11:13:51.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.307+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.307+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53373e10 con 0x55fc53353b20 2024-09-19T11:13:51.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.309+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'37 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.309+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53374380 con 0x7f548c0393c0 2024-09-19T11:13:51.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.312+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.312+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53374830 con 0x55fc5335ce70 2024-09-19T11:13:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.313+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.313+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53371ac0 con 0x55fc53353b20 2024-09-19T11:13:51.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.316+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.316+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375390 con 0x55fc53358510 2024-09-19T11:13:51.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.317+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'17 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.317+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375390 con 0x7f548c0393c0 2024-09-19T11:13:51.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.318+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.318+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375390 con 0x55fc5335ce70 2024-09-19T11:13:51.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.320+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.320+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375840 con 0x7f548c0393c0 2024-09-19T11:13:51.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.323+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.323+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375840 con 0x55fc53358510 2024-09-19T11:13:51.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.324+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.324+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375840 con 0x7f548c0393c0 2024-09-19T11:13:51.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.326+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.326+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375840 con 0x55fc53358510 2024-09-19T11:13:51.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.329+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'23 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.329+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375840 con 0x55fc53353b20 2024-09-19T11:13:51.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.330+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'38 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.330+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375840 con 0x55fc5335ce70 2024-09-19T11:13:51.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.331+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'20 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.331+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375840 con 0x7f548c0393c0 2024-09-19T11:13:51.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.332+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'28 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.332+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375840 con 0x55fc5335ce70 2024-09-19T11:13:51.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.333+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.333+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533758d0 con 0x55fc53353b20 2024-09-19T11:13:51.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.334+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.334+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533758d0 con 0x55fc53353b20 2024-09-19T11:13:51.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.335+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'39 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.335+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533758d0 con 0x55fc5335ce70 2024-09-19T11:13:51.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.336+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'21 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.336+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375960 con 0x7f548c0393c0 2024-09-19T11:13:51.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.337+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'22 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.337+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375960 con 0x55fc5335ce70 2024-09-19T11:13:51.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.338+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.338+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375960 con 0x55fc5335ce70 2024-09-19T11:13:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.339+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.339+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375a00 con 0x55fc5335ce70 2024-09-19T11:13:51.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.340+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'8 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.340+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375a00 con 0x55fc5335ce70 2024-09-19T11:13:51.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.341+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'18 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.341+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375a00 con 0x55fc53358510 2024-09-19T11:13:51.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.342+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'14 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.342+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375a00 con 0x55fc5335ce70 2024-09-19T11:13:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.343+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'12 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.343+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375a30 con 0x55fc53358510 2024-09-19T11:13:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.344+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'18 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.344+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375a30 con 0x55fc5335ce70 2024-09-19T11:13:51.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.345+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'22 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.345+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375a00 con 0x55fc53358510 2024-09-19T11:13:51.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.346+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'24 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.346+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53375a20 con 0x7f548c0393c0 2024-09-19T11:13:51.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.347+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f5358fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:51.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a8416800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:51.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a8416800 20 Filter name: none 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f52d27fc640 20 reqs_thread_entry: start 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a8416800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a8416800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55fc533a0470 con 0x55fc53358510 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(94 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a8416800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a8416800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.348+0000 7f54a8416800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:51.350 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, user does not exist 2024-09-19T11:13:51.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.349+0000 7f5359fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.349+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94542216197856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533702f0 con 0x55fc53353b20 2024-09-19T11:13:51.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.350+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94542216197856] v35'40 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.350+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94542216172048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533702f0 con 0x7f548c0393c0 2024-09-19T11:13:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.351+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94542216172048] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.351+0000 7f54a8416800 20 remove_watcher() i=0 2024-09-19T11:13:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.351+0000 7f54a8416800 2 removed watcher, disabling cache 2024-09-19T11:13:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.351+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94542216176704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53361210 con 0x55fc53353b20 2024-09-19T11:13:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.352+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94542216176704] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.352+0000 7f54a8416800 20 remove_watcher() i=1 2024-09-19T11:13:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.352+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94542216180832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53361210 con 0x55fc5335ce70 2024-09-19T11:13:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.353+0000 7f549b3e6640 1 -- 172.21.15.102:0/1409005818 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94542216180832] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f548c048040 con 0x55fc5335ce70 2024-09-19T11:13:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.353+0000 7f54a8416800 20 remove_watcher() i=2 2024-09-19T11:13:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.353+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94542216184448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53361210 con 0x7f548c0393c0 2024-09-19T11:13:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.354+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94542216184448] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x7f548c0393c0 2024-09-19T11:13:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.354+0000 7f54a8416800 20 remove_watcher() i=3 2024-09-19T11:13:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.354+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94542216169568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53361210 con 0x55fc53353b20 2024-09-19T11:13:51.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.356+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94542216169568] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f549c00a4d0 con 0x55fc53353b20 2024-09-19T11:13:51.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.356+0000 7f54a8416800 20 remove_watcher() i=4 2024-09-19T11:13:51.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.356+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94542216185712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53360860 con 0x55fc53358510 2024-09-19T11:13:51.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.357+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94542216185712] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.357+0000 7f54a8416800 20 remove_watcher() i=5 2024-09-19T11:13:51.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.357+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94542216192992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc53364770 con 0x55fc53358510 2024-09-19T11:13:51.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.358+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94542216192992] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.358+0000 7f54a8416800 20 remove_watcher() i=6 2024-09-19T11:13:51.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.358+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94542216195248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55fc533663e0 con 0x55fc53358510 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a3be7640 1 -- 172.21.15.102:0/1409005818 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94542216195248] v35'14 uv12 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54940be030 con 0x55fc53358510 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 20 remove_watcher() i=7 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc53358510 msgr2=0x55fc5335a900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc53358510 0x55fc5335a900 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc53353b20 msgr2=0x55fc53355fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc53353b20 0x55fc53355fe0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f548c0393c0 msgr2=0x7f548c0397e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f548c0393c0 0x7f548c0397e0 crc :-1 s=READY pgs=13 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc5335ce70 msgr2=0x55fc5335f330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc5335ce70 0x55fc5335f330 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f536c03cf30 msgr2=0x7f536c03f3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f536c03cf30 0x7f536c03f3f0 secure :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0x7f548c00bf70 tx=0x7f548c011000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 msgr2=0x55fc53348530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a43e8640 1 -- 172.21.15.102:0/1409005818 reap_dead start 2024-09-19T11:13:51.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53348530 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7f5494001eb0 tx=0x7f5494053ec0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 shutdown_connections 2024-09-19T11:13:51.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/1409005818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53341120 0x55fc53348530 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 >> 172.21.15.102:0/1409005818 conn(0x55fc5333d520 msgr2=0x55fc5333b730 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 shutdown_connections 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/1409005818 wait complete. 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/3069463572 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f537c03d000 msgr2=0x7f537c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/3069463572 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f537c03d000 0x7f537c03f4c0 secure :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0x55fc53326f20 tx=0x7f548c006000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/3069463572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53334860 msgr2=0x55fc53334c80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/3069463572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53334860 0x55fc53334c80 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5494096b10 tx=0x7f5494098420 comp rx=0 tx=0).stop 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/3069463572 shutdown_connections 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/3069463572 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f537c03d000 0x7f537c03f4c0 unknown :-1 s=CLOSED pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 --2- 172.21.15.102:0/3069463572 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53334860 0x55fc53334c80 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.359+0000 7f54a8416800 1 -- 172.21.15.102:0/3069463572 >> 172.21.15.102:0/3069463572 conn(0x55fc53328c10 msgr2=0x55fc53328ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3069463572 shutdown_connections 2024-09-19T11:13:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3069463572 wait complete. 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc5331ff80 msgr2=0x55fc53322400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fc5331ff80 0x55fc53322400 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc5331b7b0 msgr2=0x55fc5331dba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fc5331b7b0 0x55fc5331dba0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc53323ff0 msgr2=0x55fc533263e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fc53323ff0 0x55fc533263e0 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f538c03d000 msgr2=0x7f538c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f538c03d000 0x7f538c03f4c0 secure :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0x7f548c001e50 tx=0x7f548c0013d0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53221bc0 msgr2=0x55fc53316170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 --2- 172.21.15.102:0/3766718438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fc53221bc0 0x55fc53316170 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5494067040 tx=0x7f5494002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a43e8640 1 -- 172.21.15.102:0/3766718438 reap_dead start 2024-09-19T11:13:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 shutdown_connections 2024-09-19T11:13:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 >> 172.21.15.102:0/3766718438 conn(0x55fc532161c0 msgr2=0x55fc5330f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 shutdown_connections 2024-09-19T11:13:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.360+0000 7f54a8416800 1 -- 172.21.15.102:0/3766718438 wait complete. 2024-09-19T11:13:51.369 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-19T11:13:51.370 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-19T11:13:51.370 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-19T11:13:51.370 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-19T11:13:51.415 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:51.415 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:51.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.414+0000 7fbe50f2a800 1 Processor -- start 2024-09-19T11:13:51.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.414+0000 7fbe50f2a800 1 -- start start 2024-09-19T11:13:51.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe50f2a800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56217b82c850 0x56217b835370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe50f2a800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56217b8358b0 con 0x56217b82ad30 2024-09-19T11:13:51.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe50f2a800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x56217b6b77d0 con 0x56217b82c850 2024-09-19T11:13:51.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe44416640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56217b82c850 0x56217b835370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe4cc17640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x56217b82ad30 0x56217b82b130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52188/0 (socket says 172.21.15.102:52188) 2024-09-19T11:13:51.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe44416640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56217b82c850 0x56217b835370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42172/0 (socket says 172.21.15.102:42172) 2024-09-19T11:13:51.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe4cc17640 1 -- 172.21.15.102:0/2091197436 learned_addr learned my addr 172.21.15.102:0/2091197436 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:51.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe44416640 1 -- 172.21.15.102:0/2091197436 >> v1:172.21.15.37:6789/0 conn(0x56217b82ad30 legacy=0x56217b82b130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.415+0000 7fbe44416640 1 -- 172.21.15.102:0/2091197436 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217b836a90 con 0x56217b82c850 2024-09-19T11:13:51.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.417+0000 7fbe44416640 1 --2- 172.21.15.102:0/2091197436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82c850 0x56217b835370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400a470 tx=0x7fbe34045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=710a755187105a41 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe47fff640 1 -- 172.21.15.102:0/2091197436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe34053570 con 0x56217b82c850 2024-09-19T11:13:51.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe47fff640 1 -- 172.21.15.102:0/2091197436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe34058070 con 0x56217b82c850 2024-09-19T11:13:51.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe47fff640 1 -- 172.21.15.102:0/2091197436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe34053880 con 0x56217b82c850 2024-09-19T11:13:51.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2091197436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82c850 msgr2=0x56217b835370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/2091197436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82c850 0x56217b835370 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7fbe3400a470 tx=0x7fbe34045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:51.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2091197436 shutdown_connections 2024-09-19T11:13:51.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/2091197436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82c850 0x56217b835370 unknown :-1 s=CLOSED pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2091197436 >> 172.21.15.102:0/2091197436 conn(0x56217b826a60 msgr2=0x56217b828ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2091197436 shutdown_connections 2024-09-19T11:13:51.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.418+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2091197436 wait complete. 2024-09-19T11:13:51.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.432+0000 7fbe50f2a800 1 Processor -- start 2024-09-19T11:13:51.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.432+0000 7fbe50f2a800 1 -- start start 2024-09-19T11:13:51.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.432+0000 7fbe50f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b91e520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.432+0000 7fbe50f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56217b6c4dd0 con 0x56217b82ad30 2024-09-19T11:13:51.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.432+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b91e520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.432+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b91e520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42188/0 (socket says 172.21.15.102:42188) 2024-09-19T11:13:51.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.432+0000 7fbe4cc17640 1 -- 172.21.15.102:0/2293786448 learned_addr learned my addr 172.21.15.102:0/2293786448 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.433+0000 7fbe4cc17640 1 -- 172.21.15.102:0/2293786448 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217b91eb10 con 0x56217b82ad30 2024-09-19T11:13:51.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.433+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/2293786448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b91e520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c001e40 tx=0x7fbe3c001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c30111896a4b851d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.433+0000 7fbd3ae0d640 1 -- 172.21.15.102:0/2293786448 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c012020 con 0x56217b82ad30 2024-09-19T11:13:51.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.433+0000 7fbd3ae0d640 1 -- 172.21.15.102:0/2293786448 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c00e5a0 con 0x56217b82ad30 2024-09-19T11:13:51.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.433+0000 7fbd3ae0d640 1 -- 172.21.15.102:0/2293786448 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c00e8a0 con 0x56217b82ad30 2024-09-19T11:13:51.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2293786448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 msgr2=0x56217b91e520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/2293786448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b91e520 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c001e40 tx=0x7fbe3c001e70 comp rx=0 tx=0).stop 2024-09-19T11:13:51.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2293786448 shutdown_connections 2024-09-19T11:13:51.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/2293786448 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b91e520 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2293786448 >> 172.21.15.102:0/2293786448 conn(0x56217b826a60 msgr2=0x56217b919ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2293786448 shutdown_connections 2024-09-19T11:13:51.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2293786448 wait complete. 2024-09-19T11:13:51.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 Processor -- start 2024-09-19T11:13:51.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 -- start start 2024-09-19T11:13:51.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b926070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe50f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56217b835d50 con 0x56217b82ad30 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b926070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b926070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42202/0 (socket says 172.21.15.102:42202) 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.434+0000 7fbe4cc17640 1 -- 172.21.15.102:0/1618259931 learned_addr learned my addr 172.21.15.102:0/1618259931 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.435+0000 7fbe4cc17640 1 -- 172.21.15.102:0/1618259931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217b9265d0 con 0x56217b82ad30 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.435+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b926070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c010 tx=0x7fbe3c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.435+0000 7fbd3960a640 1 -- 172.21.15.102:0/1618259931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c012030 con 0x56217b82ad30 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.435+0000 7fbd3960a640 1 -- 172.21.15.102:0/1618259931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c0014a0 con 0x56217b82ad30 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.435+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56217b926860 con 0x56217b82ad30 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.435+0000 7fbd3960a640 1 -- 172.21.15.102:0/1618259931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c01a7a0 con 0x56217b82ad30 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.435+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217b927260 con 0x56217b82ad30 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.436+0000 7fbd3960a640 1 -- 172.21.15.102:0/1618259931 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbe3c015020 con 0x56217b82ad30 2024-09-19T11:13:51.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.436+0000 7fbd3960a640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd3403cfb0 0x7fbd3403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.436+0000 7fbd3960a640 1 -- 172.21.15.102:0/1618259931 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fbe3c020030 con 0x56217b82ad30 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.436+0000 7fbe44416640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd3403cfb0 0x7fbd3403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.436+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b82c850 0x56217b92d6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.436+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b92dc00 con 0x56217b82c850 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.437+0000 7fbe4d418640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b82c850 0x56217b92d6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.437+0000 7fbe44416640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd3403cfb0 0x7fbd3403f470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe34057000 tx=0x7fbe34052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.437+0000 7fbe4d418640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b82c850 0x56217b92d6c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.437+0000 7fbe4d418640 1 -- 172.21.15.102:0/1618259931 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b82c850 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.437+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b92dfa0 con 0x56217b82c850 2024-09-19T11:13:51.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.437+0000 7fbe4d418640 1 -- 172.21.15.102:0/1618259931 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b82c850 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.437+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b92fa60 0x56217b931f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.437+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b932690 con 0x56217b92fa60 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.438+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b92fa60 0x56217b931f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.438+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b92fa60 0x56217b931f00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.438+0000 7fbe4cc17640 1 -- 172.21.15.102:0/1618259931 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbe3c01ab20 con 0x56217b92fa60 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.438+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b92e7f0 con 0x56217b82c850 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.439+0000 7fbe4d418640 1 -- 172.21.15.102:0/1618259931 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b82c850 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.439+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b933af0 0x56217b935ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.439+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b936620 con 0x56217b933af0 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.439+0000 7fbe44416640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b933af0 0x56217b935ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.439+0000 7fbe44416640 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b933af0 0x56217b935ee0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.439+0000 7fbe44416640 1 -- 172.21.15.102:0/1618259931 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbe34051070 con 0x56217b933af0 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.440+0000 7fbe50f2a800 1 Processor -- start 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.440+0000 7fbe50f2a800 1 -- start start 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.440+0000 7fbe50f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b944360 0x56217b944780 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.440+0000 7fbe50f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56217b7234a0 con 0x56217b944360 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.440+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b944360 0x56217b944780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.440+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b944360 0x56217b944780 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42204/0 (socket says 172.21.15.102:42204) 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.440+0000 7fbe4cc17640 1 -- 172.21.15.102:0/2104733113 learned_addr learned my addr 172.21.15.102:0/2104733113 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.441+0000 7fbe4cc17640 1 -- 172.21.15.102:0/2104733113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217b944dc0 con 0x56217b944360 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.441+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/2104733113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b944360 0x56217b944780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c052a60 tx=0x7fbe3c0423b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.441+0000 7fbd327fc640 1 -- 172.21.15.102:0/2104733113 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c04f030 con 0x56217b944360 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.441+0000 7fbd327fc640 1 -- 172.21.15.102:0/2104733113 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c0542d0 con 0x56217b944360 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.441+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2104733113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56217b9455f0 con 0x56217b944360 2024-09-19T11:13:51.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.441+0000 7fbd327fc640 1 -- 172.21.15.102:0/2104733113 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c0512c0 con 0x56217b944360 2024-09-19T11:13:51.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.441+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2104733113 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217b945b90 con 0x56217b944360 2024-09-19T11:13:51.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.442+0000 7fbd327fc640 1 -- 172.21.15.102:0/2104733113 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbe3c04b060 con 0x56217b944360 2024-09-19T11:13:51.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.442+0000 7fbd327fc640 1 --2- 172.21.15.102:0/2104733113 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd2403d000 0x7fbd2403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.442+0000 7fbd327fc640 1 -- 172.21.15.102:0/2104733113 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fbe3c050070 con 0x56217b944360 2024-09-19T11:13:51.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.442+0000 7fbe44416640 1 --2- 172.21.15.102:0/2104733113 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd2403d000 0x7fbd2403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.442+0000 7fbe50f2a800 1 Processor -- start 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.442+0000 7fbe50f2a800 1 -- start start 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.442+0000 7fbe44416640 1 --2- 172.21.15.102:0/2104733113 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd2403d000 0x7fbd2403f4c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x56217b928170 tx=0x7fbe34005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbe50f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b951020 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbe50f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56217b91ef40 con 0x56217b950c20 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b951020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b951020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42208/0 (socket says 172.21.15.102:42208) 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbe4cc17640 1 -- 172.21.15.102:0/3637156609 learned_addr learned my addr 172.21.15.102:0/3637156609 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbe4cc17640 1 -- 172.21.15.102:0/3637156609 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217b951610 con 0x56217b950c20 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/3637156609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b951020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c03a5d0 tx=0x7fbe3c04c1b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7012937c66d912b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbd23fff640 1 -- 172.21.15.102:0/3637156609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c058020 con 0x56217b950c20 2024-09-19T11:13:51.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbd23fff640 1 -- 172.21.15.102:0/3637156609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c042e50 con 0x56217b950c20 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.443+0000 7fbd23fff640 1 -- 172.21.15.102:0/3637156609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c042b50 con 0x56217b950c20 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 -- 172.21.15.102:0/3637156609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 msgr2=0x56217b951020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/3637156609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b951020 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c03a5d0 tx=0x7fbe3c04c1b0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 -- 172.21.15.102:0/3637156609 shutdown_connections 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/3637156609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b951020 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 -- 172.21.15.102:0/3637156609 >> 172.21.15.102:0/3637156609 conn(0x56217b94d020 msgr2=0x56217b94b260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 -- 172.21.15.102:0/3637156609 shutdown_connections 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 -- 172.21.15.102:0/3637156609 wait complete. 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 Processor -- start 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 -- start start 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b958090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe50f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56217b951a80 con 0x56217b950c20 2024-09-19T11:13:51.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.444+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b958090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbe4cc17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b958090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42212/0 (socket says 172.21.15.102:42212) 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 learned_addr learned my addr 172.21.15.102:0/192924894 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56217b9585f0 con 0x56217b950c20 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b958090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0394d0 tx=0x7fbe3c03a530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbd227fc640 1 -- 172.21.15.102:0/192924894 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c06c070 con 0x56217b950c20 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbd227fc640 1 -- 172.21.15.102:0/192924894 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbe3c042b40 con 0x56217b950c20 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56217b9585f0 con 0x56217b950c20 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbd227fc640 1 -- 172.21.15.102:0/192924894 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbe3c025070 con 0x56217b950c20 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.445+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56217b9585f0 con 0x56217b950c20 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.446+0000 7fbd227fc640 1 -- 172.21.15.102:0/192924894 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbe3c06f070 con 0x56217b950c20 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.446+0000 7fbd227fc640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd1803d000 0x7fbd1803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.446+0000 7fbd227fc640 1 -- 172.21.15.102:0/192924894 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fbe3c052e00 con 0x56217b950c20 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.446+0000 7fbe44416640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd1803d000 0x7fbd1803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe44416640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd1803d000 0x7fbd1803f4c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe34053570 tx=0x7fbe34053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b9635b0 0x56217b965a70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b9661c0 con 0x56217b9635b0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe4d418640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b9635b0 0x56217b965a70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe4d418640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b9635b0 0x56217b965a70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe50f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe50f2a800 20 realm 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.447+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b9665d0 con 0x56217b9635b0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b966ea0 con 0x56217b9635b0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b967fa0 0x56217b96a390 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b96a950 con 0x56217b967fa0 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.448+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b967fa0 0x56217b96a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.449+0000 7fbe4cc17640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b967fa0 0x56217b96a390 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.449+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.449+0000 7fbe50f2a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.449+0000 7fbe50f2a800 20 searching for the correct realm 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.449+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b96c900 0x56217b96edc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.449+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b96f490 con 0x56217b96c900 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.449+0000 7fbe44416640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b96c900 0x56217b96edc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.449+0000 7fbe44416640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b96c900 0x56217b96edc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe44416640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbe3405f040 0x7fbe3405f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b96f490 con 0x7fbe3405f040 2024-09-19T11:13:51.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe4d418640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbe3405f040 0x7fbe3405f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe4d418640 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbe3405f040 0x7fbe3405f930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.450+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.451+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.451+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.451+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.451+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.451+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.451+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.452+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.452+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x7fbe3405f040 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.452+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.452+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b96c900 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.452+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.452+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.452+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.452+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x7fbe3405f040 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b96c900 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b96c900 2024-09-19T11:13:51.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.453+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.454+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.454+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b96c900 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.454+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.454+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b96c900 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.454+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.454+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.455+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.455+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.455+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.455+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.455+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v28'1 uv1 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.455+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b96c900 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.455+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.455+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x7fbe3405f040 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.456+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.456+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.456+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.456+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.456+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.456+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b96c900 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.456+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.456+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.457+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.457+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x7fbe3405f040 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.457+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.457+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b96c900 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.457+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.457+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b967fa0 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x56217b9635b0 2024-09-19T11:13:51.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56217b967240 con 0x7fbe3405f040 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:51.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b96b210 con 0x56217b9635b0 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b96b210 con 0x56217b9635b0 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.458+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b96b210 con 0x56217b96c900 2024-09-19T11:13:51.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 20 zone default found 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 4 Realm: () 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 20 zonegroup default 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b96bad0 con 0x56217b967fa0 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b971400 con 0x56217b96c900 2024-09-19T11:13:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.459+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b971810 con 0x56217b96c900 2024-09-19T11:13:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.460+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.460+0000 7fbe50f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.460+0000 7fbe50f2a800 20 started sync module instance, tier type = 2024-09-19T11:13:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.460+0000 7fbe50f2a800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.460+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9707a0 con 0x7fbe3405f040 2024-09-19T11:13:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.461+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.461+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94701807406240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9707a0 con 0x7fbe3405f040 2024-09-19T11:13:51.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.461+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b972320 con 0x56217b9635b0 2024-09-19T11:13:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.462+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94701807406240] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.462+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.462+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94701807410704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9707a0 con 0x56217b9635b0 2024-09-19T11:13:51.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.462+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b972db0 con 0x56217b96c900 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.463+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94701807410704] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.463+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.463+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94701807403760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b970710 con 0x56217b96c900 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.463+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b973c70 con 0x7fbe3405f040 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.464+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.464+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94701807417824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b974510 con 0x7fbe3405f040 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.464+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b975000 con 0x56217b9635b0 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.464+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94701807403760] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.465+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.465+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94701807422160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b974fc0 con 0x56217b9635b0 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.465+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b975a10 con 0x56217b967fa0 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.466+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94701807417824] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.466+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.466+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94701807424864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b975e00 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.466+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9767c0 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.466+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94701807422160] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.467+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.467+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94701807415712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b977090 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.467+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9778e0 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94701807424864] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94701807415712] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'15 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94701807419488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9778e0 con 0x56217b967fa0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe50f2a800 20 add_watcher() i=0 2024-09-19T11:13:51.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe50f2a800 20 add_watcher() i=1 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe50f2a800 20 add_watcher() i=2 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe50f2a800 20 add_watcher() i=3 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe50f2a800 20 add_watcher() i=4 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe50f2a800 20 add_watcher() i=5 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.468+0000 7fbe50f2a800 20 add_watcher() i=6 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.470+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94701807419488] v35'16 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.470+0000 7fbe50f2a800 20 add_watcher() i=7 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.470+0000 7fbe50f2a800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.470+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b97ab10 con 0x56217b9635b0 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.470+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.470+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94701807445200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9778e0 con 0x56217b9635b0 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.471+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94701807445200] v35'41 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.471+0000 7fbd037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.471+0000 7fbe50f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.471+0000 7fbe50f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.471+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9833e0 con 0x56217b9635b0 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.473+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.473+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b983a10 con 0x56217b967fa0 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.474+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'13 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.474+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9839f0 con 0x56217b96c900 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.475+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.475+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b984040 con 0x56217b9635b0 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.476+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'42 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.476+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b984420 con 0x7fbe3405f040 2024-09-19T11:13:51.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.477+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'29 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.477+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b984990 con 0x56217b96c900 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.478+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.478+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b984d50 con 0x56217b9635b0 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.479+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.479+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9850e0 con 0x56217b967fa0 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.480+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'19 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.480+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985060 con 0x7fbe3405f040 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.481+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.481+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985160 con 0x56217b96c900 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.482+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.482+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9857c0 con 0x7fbe3405f040 2024-09-19T11:13:51.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.483+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.483+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9857c0 con 0x56217b967fa0 2024-09-19T11:13:51.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.484+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.484+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9857c0 con 0x7fbe3405f040 2024-09-19T11:13:51.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.485+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.485+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9857c0 con 0x56217b967fa0 2024-09-19T11:13:51.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.487+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'25 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.487+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9857c0 con 0x56217b9635b0 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.488+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.488+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9858a0 con 0x56217b96c900 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.489+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.489+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985c80 con 0x7fbe3405f040 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.490+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'31 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.490+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985c40 con 0x56217b96c900 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.491+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.491+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9859e0 con 0x56217b9635b0 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.492+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.492+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9859e0 con 0x56217b9635b0 2024-09-19T11:13:51.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.493+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'44 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.493+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9859e0 con 0x56217b96c900 2024-09-19T11:13:51.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.494+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'24 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.494+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a00 con 0x7fbe3405f040 2024-09-19T11:13:51.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.495+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'23 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.495+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a00 con 0x56217b96c900 2024-09-19T11:13:51.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.496+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.496+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a00 con 0x56217b96c900 2024-09-19T11:13:51.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.497+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.497+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a00 con 0x56217b96c900 2024-09-19T11:13:51.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.498+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'9 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.498+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a00 con 0x56217b96c900 2024-09-19T11:13:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.499+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'20 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.499+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a70 con 0x56217b967fa0 2024-09-19T11:13:51.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.501+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'15 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.501+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a70 con 0x56217b96c900 2024-09-19T11:13:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.502+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'13 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.502+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a70 con 0x56217b967fa0 2024-09-19T11:13:51.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.503+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'20 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.503+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a70 con 0x56217b96c900 2024-09-19T11:13:51.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.504+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'25 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.504+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a70 con 0x56217b967fa0 2024-09-19T11:13:51.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.505+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'26 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.505+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b985a70 con 0x7fbe3405f040 2024-09-19T11:13:51.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.506+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.506+0000 7fbd027e4640 20 reqs_thread_entry: start 2024-09-19T11:13:51.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe50f2a800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe50f2a800 20 Filter name: none 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbcfb7fe640 20 reqs_thread_entry: start 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe50f2a800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe50f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56217b9b06f0 con 0x56217b9635b0 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(94 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe50f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe50f2a800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-19T11:13:51.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.507+0000 7fbe50f2a800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:51.510 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, user does not exist 2024-09-19T11:13:51.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.508+0000 7fbd037e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.508+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:95 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94701807445200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b95c280 con 0x56217b9635b0 2024-09-19T11:13:51.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.509+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(95 data_loggenerations_metadata [watch unwatch cookie 94701807445200] v35'45 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.509+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:96 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94701807406240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b95c280 con 0x7fbe3405f040 2024-09-19T11:13:51.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.510+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(96 notify.0 [watch unwatch cookie 94701807406240] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.510+0000 7fbe50f2a800 20 remove_watcher() i=0 2024-09-19T11:13:51.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.510+0000 7fbe50f2a800 2 removed watcher, disabling cache 2024-09-19T11:13:51.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.510+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94701807410704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b95c280 con 0x56217b9635b0 2024-09-19T11:13:51.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.511+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(97 notify.1 [watch unwatch cookie 94701807410704] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.511+0000 7fbe50f2a800 20 remove_watcher() i=1 2024-09-19T11:13:51.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.511+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94701807403760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b971e10 con 0x56217b96c900 2024-09-19T11:13:51.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.512+0000 7fbe44416640 1 -- 172.21.15.102:0/192924894 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(98 notify.2 [watch unwatch cookie 94701807403760] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe34051070 con 0x56217b96c900 2024-09-19T11:13:51.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.512+0000 7fbe50f2a800 20 remove_watcher() i=2 2024-09-19T11:13:51.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.512+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:99 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94701807417824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b95c280 con 0x7fbe3405f040 2024-09-19T11:13:51.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.514+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(99 notify.3 [watch unwatch cookie 94701807417824] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x7fbe3405f040 2024-09-19T11:13:51.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.514+0000 7fbe50f2a800 20 remove_watcher() i=3 2024-09-19T11:13:51.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.514+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94701807422160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9702f0 con 0x56217b9635b0 2024-09-19T11:13:51.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.515+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(100 notify.4 [watch unwatch cookie 94701807422160] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe4800a4d0 con 0x56217b9635b0 2024-09-19T11:13:51.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.515+0000 7fbe50f2a800 20 remove_watcher() i=4 2024-09-19T11:13:51.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.515+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94701807424864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b971e10 con 0x56217b967fa0 2024-09-19T11:13:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.516+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(101 notify.5 [watch unwatch cookie 94701807424864] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.516+0000 7fbe50f2a800 20 remove_watcher() i=5 2024-09-19T11:13:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.516+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94701807415712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b9739e0 con 0x56217b967fa0 2024-09-19T11:13:51.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.519+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(102 notify.6 [watch unwatch cookie 94701807415712] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.519+0000 7fbe50f2a800 20 remove_watcher() i=6 2024-09-19T11:13:51.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.519+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94701807419488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56217b95c280 con 0x56217b967fa0 2024-09-19T11:13:51.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe4cc17640 1 -- 172.21.15.102:0/192924894 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(103 notify.7 [watch unwatch cookie 94701807419488] v35'17 uv15 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbe3c06e030 con 0x56217b967fa0 2024-09-19T11:13:51.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 20 remove_watcher() i=7 2024-09-19T11:13:51.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b967fa0 msgr2=0x56217b96a390 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b967fa0 0x56217b96a390 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b9635b0 msgr2=0x56217b965a70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b9635b0 0x56217b965a70 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbe3405f040 msgr2=0x7fbe3405f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbe3405f040 0x7fbe3405f930 crc :-1 s=READY pgs=14 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b96c900 msgr2=0x56217b96edc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b96c900 0x56217b96edc0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd1803d000 msgr2=0x7fbd1803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd1803d000 0x7fbd1803f4c0 secure :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0x7fbe34053570 tx=0x7fbe34053000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe4d418640 1 -- 172.21.15.102:0/192924894 reap_dead start 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 msgr2=0x56217b958090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b958090 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c0394d0 tx=0x7fbe3c03a530 comp rx=0 tx=0).stop 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 shutdown_connections 2024-09-19T11:13:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/192924894 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b950c20 0x56217b958090 unknown :-1 s=CLOSED pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 >> 172.21.15.102:0/192924894 conn(0x56217b94d020 msgr2=0x56217b94b230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 shutdown_connections 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.520+0000 7fbe50f2a800 1 -- 172.21.15.102:0/192924894 wait complete. 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2104733113 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd2403d000 msgr2=0x7fbd2403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/2104733113 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd2403d000 0x7fbd2403f4c0 secure :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0x56217b928170 tx=0x7fbe34005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2104733113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b944360 msgr2=0x56217b944780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/2104733113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b944360 0x56217b944780 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c052a60 tx=0x7fbe3c0423b0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2104733113 shutdown_connections 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/2104733113 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd2403d000 0x7fbd2403f4c0 unknown :-1 s=CLOSED pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/2104733113 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b944360 0x56217b944780 unknown :-1 s=CLOSED pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2104733113 >> 172.21.15.102:0/2104733113 conn(0x56217b938710 msgr2=0x56217b938af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2104733113 shutdown_connections 2024-09-19T11:13:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/2104733113 wait complete. 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b92fa60 msgr2=0x56217b931f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56217b92fa60 0x56217b931f00 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b82c850 msgr2=0x56217b92d6c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56217b82c850 0x56217b92d6c0 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b933af0 msgr2=0x56217b935ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56217b933af0 0x56217b935ee0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd3403cfb0 msgr2=0x7fbd3403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbd3403cfb0 0x7fbd3403f470 secure :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0x7fbe34057000 tx=0x7fbe34052000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 msgr2=0x56217b926070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 --2- 172.21.15.102:0/1618259931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56217b82ad30 0x56217b926070 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7fbe3c00c010 tx=0x7fbe3c000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe4d418640 1 -- 172.21.15.102:0/1618259931 reap_dead start 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 shutdown_connections 2024-09-19T11:13:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 >> 172.21.15.102:0/1618259931 conn(0x56217b826a60 msgr2=0x56217b91fa10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 shutdown_connections 2024-09-19T11:13:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.521+0000 7fbe50f2a800 1 -- 172.21.15.102:0/1618259931 wait complete. 2024-09-19T11:13:51.530 DEBUG:teuthology.orchestra.run:got remote process result: 2 2024-09-19T11:13:51.531 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-19T11:13:51.531 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-19T11:13:51.531 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-19T11:13:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.577+0000 7f562992a800 1 Processor -- start 2024-09-19T11:13:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.577+0000 7f562992a800 1 -- start start 2024-09-19T11:13:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.577+0000 7f562992a800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555b4a923be0 0x555b4a929780 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.577+0000 7f562992a800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555b4a922e80 con 0x555b4a9227d0 2024-09-19T11:13:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.577+0000 7f562992a800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x555b4a7ae7d0 con 0x555b4a923be0 2024-09-19T11:13:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.577+0000 7f5624d60640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555b4a923be0 0x555b4a929780 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.577+0000 7f5625561640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x555b4a9227d0 0x555b4a9234d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52194/0 (socket says 172.21.15.102:52194) 2024-09-19T11:13:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.577+0000 7f5625561640 1 -- 172.21.15.102:0/1909694348 learned_addr learned my addr 172.21.15.102:0/1909694348 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.578+0000 7f5624d60640 1 -- 172.21.15.102:0/1909694348 >> v1:172.21.15.37:6789/0 conn(0x555b4a9227d0 legacy=0x555b4a9234d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.578+0000 7f5624d60640 1 -- 172.21.15.102:0/1909694348 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4a924090 con 0x555b4a923be0 2024-09-19T11:13:51.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.579+0000 7f5624d60640 1 --2- 172.21.15.102:0/1909694348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a923be0 0x555b4a929780 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f561c00a470 tx=0x7f561c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f12071584d64d68e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f5617fff640 1 -- 172.21.15.102:0/1909694348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561c053570 con 0x555b4a923be0 2024-09-19T11:13:51.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f5617fff640 1 -- 172.21.15.102:0/1909694348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561c058070 con 0x555b4a923be0 2024-09-19T11:13:51.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f5617fff640 1 -- 172.21.15.102:0/1909694348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561c053880 con 0x555b4a923be0 2024-09-19T11:13:51.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f562992a800 1 -- 172.21.15.102:0/1909694348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a923be0 msgr2=0x555b4a929780 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f562992a800 1 --2- 172.21.15.102:0/1909694348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a923be0 0x555b4a929780 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x7f561c00a470 tx=0x7f561c045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:51.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f562992a800 1 -- 172.21.15.102:0/1909694348 shutdown_connections 2024-09-19T11:13:51.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f562992a800 1 --2- 172.21.15.102:0/1909694348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a923be0 0x555b4a929780 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f562992a800 1 -- 172.21.15.102:0/1909694348 >> 172.21.15.102:0/1909694348 conn(0x555b4a91dbc0 msgr2=0x555b4a920000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f562992a800 1 -- 172.21.15.102:0/1909694348 shutdown_connections 2024-09-19T11:13:51.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.580+0000 7f562992a800 1 -- 172.21.15.102:0/1909694348 wait complete. 2024-09-19T11:13:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.594+0000 7f562992a800 1 Processor -- start 2024-09-19T11:13:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.594+0000 7f562992a800 1 -- start start 2024-09-19T11:13:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.594+0000 7f562992a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa13410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.594+0000 7f562992a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555b4a7bbdd0 con 0x555b4a9227d0 2024-09-19T11:13:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.594+0000 7f5625561640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa13410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.594+0000 7f5625561640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa13410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42232/0 (socket says 172.21.15.102:42232) 2024-09-19T11:13:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.594+0000 7f5625561640 1 -- 172.21.15.102:0/3346897689 learned_addr learned my addr 172.21.15.102:0/3346897689 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.595+0000 7f5625561640 1 -- 172.21.15.102:0/3346897689 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4aa13a00 con 0x555b4a9227d0 2024-09-19T11:13:51.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.595+0000 7f5625561640 1 --2- 172.21.15.102:0/3346897689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa13410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5618001e40 tx=0x7f5618001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34e7115608aabe6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.595+0000 7f5513606640 1 -- 172.21.15.102:0/3346897689 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5618012020 con 0x555b4a9227d0 2024-09-19T11:13:51.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.595+0000 7f5513606640 1 -- 172.21.15.102:0/3346897689 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f561800e5a0 con 0x555b4a9227d0 2024-09-19T11:13:51.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.595+0000 7f5513606640 1 -- 172.21.15.102:0/3346897689 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561800e8a0 con 0x555b4a9227d0 2024-09-19T11:13:51.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 -- 172.21.15.102:0/3346897689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 msgr2=0x555b4aa13410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 --2- 172.21.15.102:0/3346897689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa13410 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7f5618001e40 tx=0x7f5618001e70 comp rx=0 tx=0).stop 2024-09-19T11:13:51.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 -- 172.21.15.102:0/3346897689 shutdown_connections 2024-09-19T11:13:51.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 --2- 172.21.15.102:0/3346897689 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa13410 unknown :-1 s=CLOSED pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 -- 172.21.15.102:0/3346897689 >> 172.21.15.102:0/3346897689 conn(0x555b4a91dbc0 msgr2=0x555b4aa117b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 -- 172.21.15.102:0/3346897689 shutdown_connections 2024-09-19T11:13:51.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 -- 172.21.15.102:0/3346897689 wait complete. 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 Processor -- start 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 -- start start 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa1af70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f562992a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555b4a929ed0 con 0x555b4a9227d0 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f5625561640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa1af70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.596+0000 7f5625561640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa1af70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42240/0 (socket says 172.21.15.102:42240) 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.597+0000 7f5625561640 1 -- 172.21.15.102:0/2971776244 learned_addr learned my addr 172.21.15.102:0/2971776244 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.597+0000 7f5625561640 1 -- 172.21.15.102:0/2971776244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4aa1b4d0 con 0x555b4a9227d0 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.597+0000 7f5625561640 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa1af70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f561800c010 tx=0x7f5618000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.597+0000 7f5511e03640 1 -- 172.21.15.102:0/2971776244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5618012030 con 0x555b4a9227d0 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.597+0000 7f5511e03640 1 -- 172.21.15.102:0/2971776244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f56180014a0 con 0x555b4a9227d0 2024-09-19T11:13:51.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.597+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4aa1b760 con 0x555b4a9227d0 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.597+0000 7f5511e03640 1 -- 172.21.15.102:0/2971776244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f561801a7a0 con 0x555b4a9227d0 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.597+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4aa1c160 con 0x555b4a9227d0 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f562992a800 1 Processor -- start 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f562992a800 1 -- start start 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f562992a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2a950 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f562992a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555b4a81a4a0 con 0x555b4aa28560 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f5511e03640 1 -- 172.21.15.102:0/2971776244 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5618015020 con 0x555b4a9227d0 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f5625d62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2a950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f5625d62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2a950 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42256/0 (socket says 172.21.15.102:42256) 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f5625d62640 1 -- 172.21.15.102:0/4281270368 learned_addr learned my addr 172.21.15.102:0/4281270368 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f5511e03640 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f550c03cfb0 0x7f550c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f5511e03640 1 -- 172.21.15.102:0/2971776244 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5618020030 con 0x555b4a9227d0 2024-09-19T11:13:51.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f5625561640 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f550c03cfb0 0x7f550c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.598+0000 7f5625d62640 1 -- 172.21.15.102:0/4281270368 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4aa2af20 con 0x555b4aa28560 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f5625d62640 1 --2- 172.21.15.102:0/4281270368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2a950 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f562000a3e0 tx=0x7f562000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=50ca3aba5683c2e1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f5625561640 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f550c03cfb0 0x7f550c03f470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56180012b0 tx=0x7f561802df10 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f550b7fe640 1 -- 172.21.15.102:0/4281270368 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5620015070 con 0x555b4aa28560 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f550b7fe640 1 -- 172.21.15.102:0/4281270368 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5620001670 con 0x555b4aa28560 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f550b7fe640 1 -- 172.21.15.102:0/4281270368 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5620001990 con 0x555b4aa28560 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f562992a800 1 -- 172.21.15.102:0/4281270368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 msgr2=0x555b4aa2a950 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f562992a800 1 --2- 172.21.15.102:0/4281270368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2a950 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x7f562000a3e0 tx=0x7f562000a8a0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f562992a800 1 -- 172.21.15.102:0/4281270368 shutdown_connections 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f562992a800 1 --2- 172.21.15.102:0/4281270368 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2a950 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f562992a800 1 -- 172.21.15.102:0/4281270368 >> 172.21.15.102:0/4281270368 conn(0x555b4a923be0 msgr2=0x555b4aa22e80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f562992a800 1 -- 172.21.15.102:0/4281270368 shutdown_connections 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.599+0000 7f562992a800 1 -- 172.21.15.102:0/4281270368 wait complete. 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f562992a800 1 Processor -- start 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f562992a800 1 -- start start 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f562992a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2f540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f562992a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555b4aa2b240 con 0x555b4aa28560 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f5625d62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2f540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f5625d62640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2f540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42270/0 (socket says 172.21.15.102:42270) 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f5625d62640 1 -- 172.21.15.102:0/3708711389 learned_addr learned my addr 172.21.15.102:0/3708711389 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f5625d62640 1 -- 172.21.15.102:0/3708711389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4aa2faa0 con 0x555b4aa28560 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.600+0000 7f5625d62640 1 --2- 172.21.15.102:0/3708711389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2f540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5620013040 tx=0x7f5620003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.601+0000 7f5509ffb640 1 -- 172.21.15.102:0/3708711389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5620020020 con 0x555b4aa28560 2024-09-19T11:13:51.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.601+0000 7f5509ffb640 1 -- 172.21.15.102:0/3708711389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5620010780 con 0x555b4aa28560 2024-09-19T11:13:51.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.601+0000 7f562992a800 1 -- 172.21.15.102:0/3708711389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4aa2fd30 con 0x555b4aa28560 2024-09-19T11:13:51.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.601+0000 7f5509ffb640 1 -- 172.21.15.102:0/3708711389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5620015040 con 0x555b4aa28560 2024-09-19T11:13:51.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.601+0000 7f562992a800 1 -- 172.21.15.102:0/3708711389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4aa306b0 con 0x555b4aa28560 2024-09-19T11:13:51.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.602+0000 7f5509ffb640 1 -- 172.21.15.102:0/3708711389 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5620023020 con 0x555b4aa28560 2024-09-19T11:13:51.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.602+0000 7f5509ffb640 1 --2- 172.21.15.102:0/3708711389 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54fc03cfb0 0x7f54fc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.602+0000 7f5509ffb640 1 -- 172.21.15.102:0/3708711389 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5620053de0 con 0x555b4aa28560 2024-09-19T11:13:51.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.602+0000 7f5624d60640 1 --2- 172.21.15.102:0/3708711389 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54fc03cfb0 0x7f54fc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.602+0000 7f562992a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:51.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.602+0000 7f562992a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.602+0000 7f5624d60640 1 --2- 172.21.15.102:0/3708711389 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54fc03cfb0 0x7f54fc03f470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f561c057000 tx=0x7f561c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.602+0000 7f562992a800 1 Processor -- start 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f562992a800 1 -- start start 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f562992a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa0ef40 0x555b4aa0d7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f562992a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555b4aa13e30 con 0x555b4aa0ef40 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f5625561640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa0ef40 0x555b4aa0d7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f5625561640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa0ef40 0x555b4aa0d7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42284/0 (socket says 172.21.15.102:42284) 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f5625561640 1 -- 172.21.15.102:0/3703329015 learned_addr learned my addr 172.21.15.102:0/3703329015 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f5625561640 1 -- 172.21.15.102:0/3703329015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555b4aa0f460 con 0x555b4aa0ef40 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f5625561640 1 --2- 172.21.15.102:0/3703329015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa0ef40 0x555b4aa0d7b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f561801a6a0 tx=0x7f5618024700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f54ea7e4640 1 -- 172.21.15.102:0/3703329015 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5618046020 con 0x555b4aa0ef40 2024-09-19T11:13:51.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.603+0000 7f54ea7e4640 1 -- 172.21.15.102:0/3703329015 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5618006e70 con 0x555b4aa0ef40 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.604+0000 7f562992a800 1 -- 172.21.15.102:0/3703329015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555b4aa0dcf0 con 0x555b4aa0ef40 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.604+0000 7f54ea7e4640 1 -- 172.21.15.102:0/3703329015 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5618018430 con 0x555b4aa0ef40 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.604+0000 7f562992a800 1 -- 172.21.15.102:0/3703329015 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555b4aa0e240 con 0x555b4aa0ef40 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.604+0000 7f54ea7e4640 1 -- 172.21.15.102:0/3703329015 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5618049020 con 0x555b4aa0ef40 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.604+0000 7f54ea7e4640 1 --2- 172.21.15.102:0/3703329015 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f545c03cfb0 0x7f545c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.604+0000 7f54ea7e4640 1 -- 172.21.15.102:0/3703329015 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f561803d030 con 0x555b4aa0ef40 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.605+0000 7f5624d60640 1 --2- 172.21.15.102:0/3703329015 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f545c03cfb0 0x7f545c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.605+0000 7f54e3fff640 20 reqs_thread_entry: start 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.605+0000 7f5624d60640 1 --2- 172.21.15.102:0/3703329015 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f545c03cfb0 0x7f545c03f470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x555b4a921f10 tx=0x7f561c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.605+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555b4aa58e80 0x555b4aa5b320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.605+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b4aa5b9f0 con 0x555b4aa58e80 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.605+0000 7f5625d62640 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555b4aa58e80 0x555b4aa5b320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.605+0000 7f5625d62640 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555b4aa58e80 0x555b4aa5b320 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.606+0000 7f5625d62640 1 -- 172.21.15.102:0/2971776244 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f562000e070 con 0x555b4aa58e80 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.606+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555b4aa5d7c0 0x555b4aa5fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.606+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:2 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555b4aa60280 con 0x555b4aa5d7c0 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.606+0000 7f5625561640 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555b4aa5d7c0 0x555b4aa5fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.606+0000 7f5625561640 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555b4aa5d7c0 0x555b4aa5fbb0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.606+0000 7f5625561640 1 -- 172.21.15.102:0/2971776244 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(2 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv1 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5618034070 con 0x555b4aa5d7c0 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.607+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555b4aa5ccc0 con 0x555b4aa5d7c0 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.608+0000 7f5625561640 1 -- 172.21.15.102:0/2971776244 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [stat,call,call,writefull 0~993] v35'2 uv2 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f5618034070 con 0x555b4aa5d7c0 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3708711389 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54fc03cfb0 msgr2=0x7f54fc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 --2- 172.21.15.102:0/3708711389 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54fc03cfb0 0x7f54fc03f470 secure :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0x7f561c057000 tx=0x7f561c052000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3708711389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 msgr2=0x555b4aa2f540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 --2- 172.21.15.102:0/3708711389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2f540 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5620013040 tx=0x7f5620003370 comp rx=0 tx=0).stop 2024-09-19T11:13:51.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3708711389 shutdown_connections 2024-09-19T11:13:51.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 --2- 172.21.15.102:0/3708711389 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54fc03cfb0 0x7f54fc03f470 unknown :-1 s=CLOSED pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 --2- 172.21.15.102:0/3708711389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa28560 0x555b4aa2f540 unknown :-1 s=CLOSED pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3708711389 >> 172.21.15.102:0/3708711389 conn(0x555b4a923be0 msgr2=0x555b4aa22e50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3708711389 shutdown_connections 2024-09-19T11:13:51.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3708711389 wait complete. 2024-09-19T11:13:51.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3703329015 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f545c03cfb0 msgr2=0x7f545c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 --2- 172.21.15.102:0/3703329015 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f545c03cfb0 0x7f545c03f470 secure :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0x555b4a921f10 tx=0x7f561c005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:51.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3703329015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa0ef40 msgr2=0x555b4aa0d7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 --2- 172.21.15.102:0/3703329015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa0ef40 0x555b4aa0d7b0 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7f561801a6a0 tx=0x7f5618024700 comp rx=0 tx=0).stop 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3703329015 shutdown_connections 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 --2- 172.21.15.102:0/3703329015 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f545c03cfb0 0x7f545c03f470 unknown :-1 s=CLOSED pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 --2- 172.21.15.102:0/3703329015 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4aa0ef40 0x555b4aa0d7b0 unknown :-1 s=CLOSED pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.609+0000 7f562992a800 1 -- 172.21.15.102:0/3703329015 >> 172.21.15.102:0/3703329015 conn(0x555b4aa3e8a0 msgr2=0x555b4aa3ec80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/3703329015 shutdown_connections 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/3703329015 wait complete. 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555b4aa5d7c0 msgr2=0x555b4aa5fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555b4aa5d7c0 0x555b4aa5fbb0 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555b4aa58e80 msgr2=0x555b4aa5b320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555b4aa58e80 0x555b4aa5b320 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f550c03cfb0 msgr2=0x7f550c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f550c03cfb0 0x7f550c03f470 secure :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0x7f56180012b0 tx=0x7f561802df10 comp rx=0 tx=0).stop 2024-09-19T11:13:51.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 msgr2=0x555b4aa1af70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa1af70 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f561800c010 tx=0x7f5618000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 shutdown_connections 2024-09-19T11:13:51.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555b4aa5d7c0 0x555b4aa5fbb0 unknown :-1 s=CLOSED pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555b4aa58e80 0x555b4aa5b320 unknown :-1 s=CLOSED pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f550c03cfb0 0x7f550c03f470 unknown :-1 s=CLOSED pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 --2- 172.21.15.102:0/2971776244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555b4a9227d0 0x555b4aa1af70 unknown :-1 s=CLOSED pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 >> 172.21.15.102:0/2971776244 conn(0x555b4a91dbc0 msgr2=0x555b4aa0c470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 shutdown_connections 2024-09-19T11:13:51.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.610+0000 7f562992a800 1 -- 172.21.15.102:0/2971776244 wait complete. 2024-09-19T11:13:51.624 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-19T11:13:51.624 DEBUG:tasks.util.rgw: json result: {'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-19T11:13:51.626 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-19T11:13:51.626 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-19T11:13:51.627 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-19T11:13:51.669 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:51.669 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.668+0000 7f6bb533a800 1 Processor -- start 2024-09-19T11:13:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb533a800 1 -- start start 2024-09-19T11:13:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb533a800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55f9a63c3fb0 0x55f9a63c63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb533a800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9a63ca5d0 con 0x55f9a63c68e0 2024-09-19T11:13:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb533a800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55f9a624e7d0 con 0x55f9a63c3fb0 2024-09-19T11:13:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb10bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55f9a63c3fb0 0x55f9a63c63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb08ba640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55f9a63c68e0 0x55f9a63c8d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52202/0 (socket says 172.21.15.102:52202) 2024-09-19T11:13:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb08ba640 1 -- 172.21.15.102:0/374410755 learned_addr learned my addr 172.21.15.102:0/374410755 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb10bb640 1 -- 172.21.15.102:0/374410755 >> v1:172.21.15.37:6789/0 conn(0x55f9a63c68e0 legacy=0x55f9a63c8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.669+0000 7f6bb10bb640 1 -- 172.21.15.102:0/374410755 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a63cb800 con 0x55f9a63c3fb0 2024-09-19T11:13:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.671+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/374410755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a63c63a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00a470 tx=0x7f6bac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=504ef04c1bc9b2f1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.671+0000 7f6ba3fff640 1 -- 172.21.15.102:0/374410755 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac053570 con 0x55f9a63c3fb0 2024-09-19T11:13:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.671+0000 7f6ba3fff640 1 -- 172.21.15.102:0/374410755 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac058070 con 0x55f9a63c3fb0 2024-09-19T11:13:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.671+0000 7f6ba3fff640 1 -- 172.21.15.102:0/374410755 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac053880 con 0x55f9a63c3fb0 2024-09-19T11:13:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.672+0000 7f6bb533a800 1 -- 172.21.15.102:0/374410755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 msgr2=0x55f9a63c63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.672+0000 7f6bb533a800 1 --2- 172.21.15.102:0/374410755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a63c63a0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x7f6bac00a470 tx=0x7f6bac045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.672+0000 7f6bb533a800 1 -- 172.21.15.102:0/374410755 shutdown_connections 2024-09-19T11:13:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.672+0000 7f6bb533a800 1 --2- 172.21.15.102:0/374410755 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a63c63a0 unknown :-1 s=CLOSED pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.672+0000 7f6bb533a800 1 -- 172.21.15.102:0/374410755 >> 172.21.15.102:0/374410755 conn(0x55f9a63bda50 msgr2=0x55f9a63bfeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.672+0000 7f6bb533a800 1 -- 172.21.15.102:0/374410755 shutdown_connections 2024-09-19T11:13:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.672+0000 7f6bb533a800 1 -- 172.21.15.102:0/374410755 wait complete. 2024-09-19T11:13:51.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.685+0000 7f6bb533a800 1 Processor -- start 2024-09-19T11:13:51.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.685+0000 7f6bb533a800 1 -- start start 2024-09-19T11:13:51.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.686+0000 7f6bb533a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a64b3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.686+0000 7f6bb533a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9a625bdd0 con 0x55f9a63c3fb0 2024-09-19T11:13:51.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.686+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a64b3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.686+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a64b3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42306/0 (socket says 172.21.15.102:42306) 2024-09-19T11:13:51.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.686+0000 7f6bb10bb640 1 -- 172.21.15.102:0/3455317146 learned_addr learned my addr 172.21.15.102:0/3455317146 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.686+0000 7f6bb10bb640 1 -- 172.21.15.102:0/3455317146 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a64b3910 con 0x55f9a63c3fb0 2024-09-19T11:13:51.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.686+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/3455317146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a64b3320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bac025c20 tx=0x7f6bac051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71b7ba74e38781b6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.686+0000 7f6a9f606640 1 -- 172.21.15.102:0/3455317146 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac05c580 con 0x55f9a63c3fb0 2024-09-19T11:13:51.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6a9f606640 1 -- 172.21.15.102:0/3455317146 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac063030 con 0x55f9a63c3fb0 2024-09-19T11:13:51.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6a9f606640 1 -- 172.21.15.102:0/3455317146 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac05c850 con 0x55f9a63c3fb0 2024-09-19T11:13:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6bb533a800 1 -- 172.21.15.102:0/3455317146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 msgr2=0x55f9a64b3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6bb533a800 1 --2- 172.21.15.102:0/3455317146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a64b3320 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f6bac025c20 tx=0x7f6bac051000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6bb533a800 1 -- 172.21.15.102:0/3455317146 shutdown_connections 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6bb533a800 1 --2- 172.21.15.102:0/3455317146 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a64b3320 unknown :-1 s=CLOSED pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6bb533a800 1 -- 172.21.15.102:0/3455317146 >> 172.21.15.102:0/3455317146 conn(0x55f9a63bda50 msgr2=0x55f9a64aeca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6bb533a800 1 -- 172.21.15.102:0/3455317146 shutdown_connections 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6bb533a800 1 -- 172.21.15.102:0/3455317146 wait complete. 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.687+0000 7f6bb533a800 1 Processor -- start 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.688+0000 7f6bb533a800 1 -- start start 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.688+0000 7f6bb533a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a63c36d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.688+0000 7f6bb533a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9a63caaa0 con 0x55f9a63c3fb0 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.688+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a63c36d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.688+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a63c36d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42322/0 (socket says 172.21.15.102:42322) 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.688+0000 7f6bb10bb640 1 -- 172.21.15.102:0/2314330518 learned_addr learned my addr 172.21.15.102:0/2314330518 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.688+0000 7f6bb10bb640 1 -- 172.21.15.102:0/2314330518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a63c3c30 con 0x55f9a63c3fb0 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.688+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a63c36d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bac045f50 tx=0x7f6bac002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.689+0000 7f6a9de03640 1 -- 172.21.15.102:0/2314330518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac054ad0 con 0x55f9a63c3fb0 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.689+0000 7f6a9de03640 1 -- 172.21.15.102:0/2314330518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac054c70 con 0x55f9a63c3fb0 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.689+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9a63c1fe0 con 0x55f9a63c3fb0 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.689+0000 7f6a9de03640 1 -- 172.21.15.102:0/2314330518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac068420 con 0x55f9a63c3fb0 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.689+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a63c25a0 con 0x55f9a63c3fb0 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.689+0000 7f6a9de03640 1 -- 172.21.15.102:0/2314330518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6bac0685c0 con 0x55f9a63c3fb0 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.690+0000 7f6a9de03640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a9803d000 0x7f6a9803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.690+0000 7f6a9de03640 1 -- 172.21.15.102:0/2314330518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f6bac070030 con 0x55f9a63c3fb0 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.690+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a9803d000 0x7f6a9803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.690+0000 7f6bb533a800 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a63c68e0 0x55f9a64c42c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.690+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64c4800 con 0x55f9a63c68e0 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.690+0000 7f6bb18bc640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a63c68e0 0x55f9a64c42c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.690+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a9803d000 0x7f6a9803f4c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8001d70 tx=0x7f6ba80012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.690+0000 7f6bb18bc640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a63c68e0 0x55f9a64c42c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.691+0000 7f6bb18bc640 1 -- 172.21.15.102:0/2314330518 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a63c68e0 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.691+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64c50a0 con 0x55f9a63c68e0 2024-09-19T11:13:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.691+0000 7f6bb18bc640 1 -- 172.21.15.102:0/2314330518 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a63c68e0 2024-09-19T11:13:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.691+0000 7f6bb533a800 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64c69b0 0x55f9a64c8e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.691+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64c95e0 con 0x55f9a64c69b0 2024-09-19T11:13:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.691+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64c69b0 0x55f9a64c8e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.691+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64c69b0 0x55f9a64c8e50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.692+0000 7f6bb10bb640 1 -- 172.21.15.102:0/2314330518 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64c69b0 2024-09-19T11:13:51.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.692+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64c58f0 con 0x55f9a63c68e0 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.692+0000 7f6bb18bc640 1 -- 172.21.15.102:0/2314330518 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a63c68e0 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.692+0000 7f6bb533a800 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a64caa40 0x55f9a64cce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.692+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64cd570 con 0x55f9a64caa40 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.692+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a64caa40 0x55f9a64cce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.692+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a64caa40 0x55f9a64cce30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.693+0000 7f6bb08ba640 1 -- 172.21.15.102:0/2314330518 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a64caa40 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.693+0000 7f6bb533a800 1 Processor -- start 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.693+0000 7f6bb533a800 1 -- start start 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.693+0000 7f6bb533a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64db2b0 0x55f9a64db6d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.693+0000 7f6bb533a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9a62ba4a0 con 0x55f9a64db2b0 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.693+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64db2b0 0x55f9a64db6d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.693+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64db2b0 0x55f9a64db6d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42332/0 (socket says 172.21.15.102:42332) 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.693+0000 7f6bb10bb640 1 -- 172.21.15.102:0/827013806 learned_addr learned my addr 172.21.15.102:0/827013806 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.694+0000 7f6bb10bb640 1 -- 172.21.15.102:0/827013806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a64dbd10 con 0x55f9a64db2b0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.694+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/827013806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64db2b0 0x55f9a64db6d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bac074fd0 tx=0x7f6bac0744e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.694+0000 7f6a96ffd640 1 -- 172.21.15.102:0/827013806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac096d00 con 0x55f9a64db2b0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.694+0000 7f6a96ffd640 1 -- 172.21.15.102:0/827013806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac068a90 con 0x55f9a64db2b0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.694+0000 7f6bb533a800 1 -- 172.21.15.102:0/827013806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9a64dc540 con 0x55f9a64db2b0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.694+0000 7f6a96ffd640 1 -- 172.21.15.102:0/827013806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac068d70 con 0x55f9a64db2b0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.694+0000 7f6bb533a800 1 -- 172.21.15.102:0/827013806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a64dc540 con 0x55f9a64db2b0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6a96ffd640 1 -- 172.21.15.102:0/827013806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6bac0980b0 con 0x55f9a64db2b0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6a96ffd640 1 --2- 172.21.15.102:0/827013806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a8803d000 0x7f6a8803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6a96ffd640 1 -- 172.21.15.102:0/827013806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f6bac06d0c0 con 0x55f9a64db2b0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/827013806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a8803d000 0x7f6a8803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6bb533a800 1 Processor -- start 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6bb533a800 1 -- start start 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/827013806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a8803d000 0x7f6a8803f4c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800bf40 tx=0x7f6ba800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6bb533a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64e7cc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.695+0000 7f6bb533a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9a64b3ce0 con 0x55f9a64e78e0 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.696+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64e7cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.696+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64e7cc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42342/0 (socket says 172.21.15.102:42342) 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.696+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1784902646 learned_addr learned my addr 172.21.15.102:0/1784902646 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.696+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1784902646 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a64e82b0 con 0x55f9a64e78e0 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.696+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/1784902646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64e7cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6bac067980 tx=0x7f6bac009870 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eda80762ae5d4fe2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.696+0000 7f6a94ff9640 1 -- 172.21.15.102:0/1784902646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac07dd20 con 0x55f9a64e78e0 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.696+0000 7f6a94ff9640 1 -- 172.21.15.102:0/1784902646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac08f5f0 con 0x55f9a64e78e0 2024-09-19T11:13:51.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.696+0000 7f6a94ff9640 1 -- 172.21.15.102:0/1784902646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac08f260 con 0x55f9a64e78e0 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 -- 172.21.15.102:0/1784902646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 msgr2=0x55f9a64e7cc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1784902646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64e7cc0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7f6bac067980 tx=0x7f6bac009870 comp rx=0 tx=0).stop 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 -- 172.21.15.102:0/1784902646 shutdown_connections 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1784902646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64e7cc0 unknown :-1 s=CLOSED pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 -- 172.21.15.102:0/1784902646 >> 172.21.15.102:0/1784902646 conn(0x55f9a64e3ce0 msgr2=0x55f9a64e1f20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 -- 172.21.15.102:0/1784902646 shutdown_connections 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 -- 172.21.15.102:0/1784902646 wait complete. 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 Processor -- start 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 -- start start 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64eeca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb533a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9a64e8740 con 0x55f9a64e78e0 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64eeca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb10bb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64eeca0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42358/0 (socket says 172.21.15.102:42358) 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.697+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 learned_addr learned my addr 172.21.15.102:0/1301243655 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.698+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9a64ef200 con 0x55f9a64e78e0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.698+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64eeca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6bac094fa0 tx=0x7f6bac098ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.698+0000 7f6a86ffd640 1 -- 172.21.15.102:0/1301243655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac0bd020 con 0x55f9a64e78e0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.698+0000 7f6a86ffd640 1 -- 172.21.15.102:0/1301243655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6bac0945a0 con 0x55f9a64e78e0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.698+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9a64ef200 con 0x55f9a64e78e0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.698+0000 7f6a86ffd640 1 -- 172.21.15.102:0/1301243655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6bac08f260 con 0x55f9a64e78e0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.698+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9a64ef6a0 con 0x55f9a64e78e0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.699+0000 7f6a86ffd640 1 -- 172.21.15.102:0/1301243655 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6bac0c0020 con 0x55f9a64e78e0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.699+0000 7f6a86ffd640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03d000 0x7f6a7c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.699+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.699+0000 7f6a86ffd640 1 -- 172.21.15.102:0/1301243655 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f6bac0b3050 con 0x55f9a64e78e0 2024-09-19T11:13:51.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.699+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03d000 0x7f6a7c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.699+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a64fa140 0x55f9a64fc5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.699+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fcd20 con 0x55f9a64fa140 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb18bc640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a64fa140 0x55f9a64fc5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03d000 0x7f6a7c03f4c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800c010 tx=0x7f6ba8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb18bc640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a64fa140 0x55f9a64fc5d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb533a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb533a800 20 realm 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fd130 con 0x55f9a64fa140 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb533a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb533a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.700+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fda00 con 0x55f9a64fa140 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb533a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb533a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64fe890 0x55f9a6500c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a65013c0 con 0x55f9a64fe890 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.701+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64fe890 0x55f9a6500c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.702+0000 7f6bb10bb640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64fe890 0x55f9a6500c80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.702+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.702+0000 7f6bb533a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.702+0000 7f6bb533a800 20 searching for the correct realm 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.702+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a6503460 0x55f9a6505920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.702+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6505ff0 con 0x55f9a6503460 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.702+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a6503460 0x55f9a6505920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.702+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a6503460 0x55f9a6505920 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.703+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.703+0000 7f6bb08ba640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6ba8037040 0x7f6ba8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.703+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6505ff0 con 0x7f6ba8037040 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.703+0000 7f6bb18bc640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6ba8037040 0x7f6ba8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.703+0000 7f6bb18bc640 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6ba8037040 0x7f6ba8036410 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.703+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.703+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.704+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.704+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.704+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.704+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.704+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.704+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.704+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.704+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.705+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.705+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x7f6ba8037040 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.705+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.705+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a6503460 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.705+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.705+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.705+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.705+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x7f6ba8037040 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a6503460 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a6503460 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.706+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a6503460 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a6503460 2024-09-19T11:13:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.707+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.708+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.708+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.708+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.708+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a6503460 2024-09-19T11:13:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.708+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.708+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x7f6ba8037040 2024-09-19T11:13:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.708+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.708+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.709+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.709+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.709+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.709+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a6503460 2024-09-19T11:13:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.709+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.709+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.709+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.709+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x7f6ba8037040 2024-09-19T11:13:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.710+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.710+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a6503460 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.710+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.710+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fe890 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.710+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.710+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x55f9a64fa140 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.710+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.710+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f9a64fdda0 con 0x7f6ba8037040 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:51.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6501d60 con 0x55f9a64fa140 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6501d60 con 0x55f9a64fa140 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6501d60 con 0x55f9a6503460 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:51.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 zone default found 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 4 Realm: () 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 zonegroup default 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.711+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6502600 con 0x55f9a64fe890 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6507e60 con 0x55f9a6503460 2024-09-19T11:13:51.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6508200 con 0x55f9a6503460 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 20 started sync module instance, tier type = 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.712+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6507300 con 0x7f6ba8037040 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.713+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.713+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94530725509152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6507300 con 0x7f6ba8037040 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.713+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6508ca0 con 0x55f9a64fa140 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.714+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94530725509152] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.714+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.714+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94530725513104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6507300 con 0x55f9a64fa140 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.714+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6509760 con 0x55f9a6503460 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.717+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.717+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94530725515824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650a000 con 0x55f9a6503460 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.717+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650ab00 con 0x7f6ba8037040 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.717+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94530725513104] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.720+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94530725515824] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.720+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.720+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94530725518160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6506e50 con 0x7f6ba8037040 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.720+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650b3a0 con 0x55f9a64fa140 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.721+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.721+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94530725523056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650b7a0 con 0x55f9a64fa140 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.721+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650c2b0 con 0x55f9a64fe890 2024-09-19T11:13:51.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.723+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94530725518160] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.726+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.726+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94530725526880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650c650 con 0x55f9a64fe890 2024-09-19T11:13:51.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.726+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650d050 con 0x55f9a64fe890 2024-09-19T11:13:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.729+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94530725523056] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.729+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94530725526880] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.730+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.730+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94530725524112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650d470 con 0x55f9a64fe890 2024-09-19T11:13:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.730+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650dcc0 con 0x55f9a64fe890 2024-09-19T11:13:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'18 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94530725533408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650e110 con 0x55f9a64fe890 2024-09-19T11:13:51.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb533a800 20 add_watcher() i=0 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb533a800 20 add_watcher() i=1 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb533a800 20 add_watcher() i=2 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb533a800 20 add_watcher() i=3 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb533a800 20 add_watcher() i=4 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb533a800 20 add_watcher() i=5 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94530725524112] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb533a800 20 add_watcher() i=6 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.731+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94530725533408] v35'19 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.732+0000 7f6bb533a800 20 add_watcher() i=7 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.732+0000 7f6bb533a800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.732+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650cb60 con 0x55f9a64fa140 2024-09-19T11:13:51.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.732+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.732+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94530725534624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a650cb60 con 0x55f9a64fa140 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94530725534624] v35'46 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6a67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6bb533a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6bb533a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6bb533a800 5 note: GC not initialized 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6a66fe5640 20 reqs_thread_entry: start 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6bb533a800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6bb533a800 20 Filter name: none 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6a64fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.734+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a65446c0 con 0x55f9a64fa140 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.735+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.735+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a65446c0 con 0x7f6ba8037040 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.735+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.735+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544680 con 0x55f9a64fa140 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.735+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.735+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544680 con 0x55f9a6503460 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.735+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.735+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b90 con 0x55f9a6503460 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b90 con 0x55f9a6503460 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b90 con 0x55f9a64fa140 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b90 con 0x55f9a64fa140 2024-09-19T11:13:51.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b00 con 0x55f9a6503460 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.736+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b00 con 0x55f9a6503460 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.737+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.737+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b00 con 0x55f9a64fe890 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.737+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(72 usage.10 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.737+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b00 con 0x55f9a64fa140 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.737+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.737+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b00 con 0x7f6ba8037040 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.737+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.737+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544b00 con 0x55f9a6503460 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.738+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.738+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.738+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.738+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.738+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.738+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a6503460 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.738+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.738+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.739+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(79 usage.17 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.739+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fa140 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.739+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.739+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a6503460 2024-09-19T11:13:51.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.739+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.739+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.739+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.739+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x7f6ba8037040 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fa140 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fa140 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a6503460 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.740+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fa140 2024-09-19T11:13:51.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fa140 2024-09-19T11:13:51.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a6503460 2024-09-19T11:13:51.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a6503460 2024-09-19T11:13:51.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a6503460 2024-09-19T11:13:51.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.741+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.742+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.742+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.743+0000 7f6a67fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.743+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94530725534624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fa140 2024-09-19T11:13:51.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.744+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94530725534624] v35'47 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.744+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94530725509152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x7f6ba8037040 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.747+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94530725509152] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.747+0000 7f6bb533a800 20 remove_watcher() i=0 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.747+0000 7f6bb533a800 2 removed watcher, disabling cache 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.747+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94530725513104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fa140 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.748+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94530725513104] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.748+0000 7f6bb533a800 20 remove_watcher() i=1 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.748+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94530725515824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a6503460 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.749+0000 7f6bb08ba640 1 -- 172.21.15.102:0/1301243655 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94530725515824] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba8009050 con 0x55f9a6503460 2024-09-19T11:13:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.749+0000 7f6bb533a800 20 remove_watcher() i=2 2024-09-19T11:13:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.749+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94530725518160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x7f6ba8037040 2024-09-19T11:13:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.750+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94530725518160] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x7f6ba8037040 2024-09-19T11:13:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.750+0000 7f6bb533a800 20 remove_watcher() i=3 2024-09-19T11:13:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.750+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94530725523056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fa140 2024-09-19T11:13:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.753+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94530725523056] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6ba400a4d0 con 0x55f9a64fa140 2024-09-19T11:13:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.753+0000 7f6bb533a800 20 remove_watcher() i=4 2024-09-19T11:13:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.753+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94530725526880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.754+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94530725526880] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.754+0000 7f6bb533a800 20 remove_watcher() i=5 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.754+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94530725524112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.755+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94530725524112] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.755+0000 7f6bb533a800 20 remove_watcher() i=6 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.755+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94530725533408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f9a6544ae0 con 0x55f9a64fe890 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb10bb640 1 -- 172.21.15.102:0/1301243655 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94530725533408] v35'20 uv18 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6bac051070 con 0x55f9a64fe890 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 20 remove_watcher() i=7 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64fe890 msgr2=0x55f9a6500c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64fe890 0x55f9a6500c80 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a64fa140 msgr2=0x55f9a64fc5d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a64fa140 0x55f9a64fc5d0 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6ba8037040 msgr2=0x7f6ba8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6ba8037040 0x7f6ba8036410 crc :-1 s=READY pgs=15 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a6503460 msgr2=0x55f9a6505920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a6503460 0x55f9a6505920 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03d000 msgr2=0x7f6a7c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03d000 0x7f6a7c03f4c0 secure :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800c010 tx=0x7f6ba8010000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 msgr2=0x55f9a64eeca0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb18bc640 1 -- 172.21.15.102:0/1301243655 reap_dead start 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64eeca0 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x7f6bac094fa0 tx=0x7f6bac098ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 shutdown_connections 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 --2- 172.21.15.102:0/1301243655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64e78e0 0x55f9a64eeca0 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 >> 172.21.15.102:0/1301243655 conn(0x55f9a64e3ce0 msgr2=0x55f9a64e1ef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 shutdown_connections 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.756+0000 7f6bb533a800 1 -- 172.21.15.102:0/1301243655 wait complete. 2024-09-19T11:13:51.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/827013806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a8803d000 msgr2=0x7f6a8803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/827013806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a8803d000 0x7f6a8803f4c0 secure :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0x7f6ba800bf40 tx=0x7f6ba800f000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/827013806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64db2b0 msgr2=0x55f9a64db6d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/827013806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64db2b0 0x55f9a64db6d0 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x7f6bac074fd0 tx=0x7f6bac0744e0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/827013806 shutdown_connections 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/827013806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a8803d000 0x7f6a8803f4c0 unknown :-1 s=CLOSED pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/827013806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a64db2b0 0x55f9a64db6d0 unknown :-1 s=CLOSED pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/827013806 >> 172.21.15.102:0/827013806 conn(0x55f9a64cf660 msgr2=0x55f9a64cfa40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/827013806 shutdown_connections 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/827013806 wait complete. 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64c69b0 msgr2=0x55f9a64c8e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9a64c69b0 0x55f9a64c8e50 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a63c68e0 msgr2=0x55f9a64c42c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9a63c68e0 0x55f9a64c42c0 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a64caa40 msgr2=0x55f9a64cce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9a64caa40 0x55f9a64cce30 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a9803d000 msgr2=0x7f6a9803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a9803d000 0x7f6a9803f4c0 secure :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0x7f6ba8001d70 tx=0x7f6ba80012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 msgr2=0x55f9a63c36d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 --2- 172.21.15.102:0/2314330518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9a63c3fb0 0x55f9a63c36d0 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f6bac045f50 tx=0x7f6bac002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb18bc640 1 -- 172.21.15.102:0/2314330518 reap_dead start 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 shutdown_connections 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 >> 172.21.15.102:0/2314330518 conn(0x55f9a63bda50 msgr2=0x55f9a64ad490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 shutdown_connections 2024-09-19T11:13:51.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.757+0000 7f6bb533a800 1 -- 172.21.15.102:0/2314330518 wait complete. 2024-09-19T11:13:51.767 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[],"summary":[]} 2024-09-19T11:13:51.767 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-19T11:13:51.767 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:13:51.768 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:13:51.768 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:13:51.851 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:51.852 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:51.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.851+0000 7f3fd3f0c800 1 Processor -- start 2024-09-19T11:13:51.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.851+0000 7f3fd3f0c800 1 -- start start 2024-09-19T11:13:51.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.851+0000 7f3fd3f0c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x562988e39890 0x562988e3a450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.851+0000 7f3fd3f0c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562988e39f40 con 0x562988e3a990 2024-09-19T11:13:51.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.851+0000 7f3fd3f0c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x562988cc47d0 con 0x562988e39890 2024-09-19T11:13:51.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.852+0000 7f3fd19f6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x562988e39890 0x562988e3a450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.852+0000 7f3fd11f5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x562988e3a990 0x562988e3f6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52210/0 (socket says 172.21.15.102:52210) 2024-09-19T11:13:51.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.852+0000 7f3fd19f6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x562988e39890 0x562988e3a450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42370/0 (socket says 172.21.15.102:42370) 2024-09-19T11:13:51.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.852+0000 7f3fd11f5640 1 -- 172.21.15.102:0/113679573 learned_addr learned my addr 172.21.15.102:0/113679573 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:51.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.852+0000 7f3fd19f6640 1 -- 172.21.15.102:0/113679573 >> v1:172.21.15.37:6789/0 conn(0x562988e3a990 legacy=0x562988e3f6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.852+0000 7f3fd19f6640 1 -- 172.21.15.102:0/113679573 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562988e3ae40 con 0x562988e39890 2024-09-19T11:13:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/113679573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988e3a450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400a470 tx=0x7f3fc4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c87b1189ed900e06 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd09f4640 1 -- 172.21.15.102:0/113679573 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc4053570 con 0x562988e39890 2024-09-19T11:13:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd09f4640 1 -- 172.21.15.102:0/113679573 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc4058070 con 0x562988e39890 2024-09-19T11:13:51.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd09f4640 1 -- 172.21.15.102:0/113679573 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc4053880 con 0x562988e39890 2024-09-19T11:13:51.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/113679573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 msgr2=0x562988e3a450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/113679573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988e3a450 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400a470 tx=0x7f3fc4045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:51.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/113679573 shutdown_connections 2024-09-19T11:13:51.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/113679573 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988e3a450 unknown :-1 s=CLOSED pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/113679573 >> 172.21.15.102:0/113679573 conn(0x562988e34c60 msgr2=0x562988e370c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.854+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/113679573 shutdown_connections 2024-09-19T11:13:51.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.855+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/113679573 wait complete. 2024-09-19T11:13:51.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.868+0000 7f3fd3f0c800 1 Processor -- start 2024-09-19T11:13:51.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.868+0000 7f3fd3f0c800 1 -- start start 2024-09-19T11:13:51.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.868+0000 7f3fd3f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988daf1a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.868+0000 7f3fd3f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562988cd1dd0 con 0x562988e39890 2024-09-19T11:13:51.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.868+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988daf1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.868+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988daf1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42378/0 (socket says 172.21.15.102:42378) 2024-09-19T11:13:51.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.868+0000 7f3fd19f6640 1 -- 172.21.15.102:0/2992666295 learned_addr learned my addr 172.21.15.102:0/2992666295 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.869+0000 7f3fd19f6640 1 -- 172.21.15.102:0/2992666295 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562988daf790 con 0x562988e39890 2024-09-19T11:13:51.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.869+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/2992666295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988daf1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4025c20 tx=0x7f3fc4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=265925fe3436a00e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.869+0000 7f3ebfe07640 1 -- 172.21.15.102:0/2992666295 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc405c580 con 0x562988e39890 2024-09-19T11:13:51.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.869+0000 7f3ebfe07640 1 -- 172.21.15.102:0/2992666295 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc4063030 con 0x562988e39890 2024-09-19T11:13:51.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.869+0000 7f3ebfe07640 1 -- 172.21.15.102:0/2992666295 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc405c850 con 0x562988e39890 2024-09-19T11:13:51.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/2992666295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 msgr2=0x562988daf1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/2992666295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988daf1a0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4025c20 tx=0x7f3fc4051000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/2992666295 shutdown_connections 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/2992666295 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988daf1a0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/2992666295 >> 172.21.15.102:0/2992666295 conn(0x562988e34c60 msgr2=0x562988f24c60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/2992666295 shutdown_connections 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/2992666295 wait complete. 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 Processor -- start 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.870+0000 7f3fd3f0c800 1 -- start start 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd3f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988f32eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd3f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562988e40e10 con 0x562988e39890 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988f32eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988f32eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42392/0 (socket says 172.21.15.102:42392) 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3745281958 learned_addr learned my addr 172.21.15.102:0/3745281958 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3745281958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562988f33410 con 0x562988e39890 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988f32eb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400a330 tx=0x7f3fc4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3ebe604640 1 -- 172.21.15.102:0/3745281958 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc406c030 con 0x562988e39890 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3ebe604640 1 -- 172.21.15.102:0/3745281958 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc405c580 con 0x562988e39890 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3ebe604640 1 -- 172.21.15.102:0/3745281958 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc405c860 con 0x562988e39890 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562988f336a0 con 0x562988e39890 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.871+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562988f342b0 con 0x562988e39890 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.872+0000 7f3ebe604640 1 -- 172.21.15.102:0/3745281958 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3fc4053440 con 0x562988e39890 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.872+0000 7f3ebe604640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eb803cfb0 0x7f3eb803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.872+0000 7f3ebe604640 1 -- 172.21.15.102:0/3745281958 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3fc4070020 con 0x562988e39890 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.872+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eb803cfb0 0x7f3eb803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.873+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988e3a990 0x562988f3a500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.873+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f3aa40 con 0x562988e3a990 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.873+0000 7f3fd21f7640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988e3a990 0x562988f3a500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.873+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eb803cfb0 0x7f3eb803f470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001d70 tx=0x7f3fc80012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.873+0000 7f3fd21f7640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988e3a990 0x562988f3a500 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.873+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3745281958 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988e3a990 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.873+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f3ade0 con 0x562988e3a990 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.874+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3745281958 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988e3a990 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.874+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f3c8e0 0x562988f3ed50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.874+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f3f4e0 con 0x562988f3c8e0 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.874+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f3c8e0 0x562988f3ed50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.874+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f3c8e0 0x562988f3ed50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.874+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3745281958 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f3c8e0 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.875+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f3b630 con 0x562988e3a990 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.875+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3745281958 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988e3a990 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.875+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f40940 0x562988f42d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.875+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f434a0 con 0x562988f40940 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.875+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f40940 0x562988f42d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.875+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f40940 0x562988f42d30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.875+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3745281958 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f40940 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.876+0000 7f3fd3f0c800 1 Processor -- start 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.876+0000 7f3fd3f0c800 1 -- start start 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.876+0000 7f3fd3f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f511e0 0x562988f51600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.876+0000 7f3fd3f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562988d304a0 con 0x562988f511e0 2024-09-19T11:13:51.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.876+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f511e0 0x562988f51600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.876+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f511e0 0x562988f51600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42400/0 (socket says 172.21.15.102:42400) 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.876+0000 7f3fd19f6640 1 -- 172.21.15.102:0/1221970154 learned_addr learned my addr 172.21.15.102:0/1221970154 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.876+0000 7f3fd19f6640 1 -- 172.21.15.102:0/1221970154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562988f51c40 con 0x562988f511e0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.877+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/1221970154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f511e0 0x562988f51600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3fc405d790 tx=0x7f3fc405ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.877+0000 7f3eb77fe640 1 -- 172.21.15.102:0/1221970154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc4079040 con 0x562988f511e0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.877+0000 7f3eb77fe640 1 -- 172.21.15.102:0/1221970154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc4084070 con 0x562988f511e0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.877+0000 7f3eb77fe640 1 -- 172.21.15.102:0/1221970154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc4009e60 con 0x562988f511e0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.877+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/1221970154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562988f52470 con 0x562988f511e0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.877+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/1221970154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562988f52a10 con 0x562988f511e0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.877+0000 7f3eb77fe640 1 -- 172.21.15.102:0/1221970154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3fc4092060 con 0x562988f511e0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3eb77fe640 1 --2- 172.21.15.102:0/1221970154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eac03d000 0x7f3eac03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3eb77fe640 1 -- 172.21.15.102:0/1221970154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3fc406d070 con 0x562988f511e0 2024-09-19T11:13:51.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/1221970154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eac03d000 0x7f3eac03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3fd3f0c800 1 Processor -- start 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/1221970154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eac03d000 0x7f3eac03f4c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800bf40 tx=0x7f3fc800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3fd3f0c800 1 -- start start 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3fd3f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f5dea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3fd3f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562988dadbb0 con 0x562988f5dac0 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.878+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f5dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f5dea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42412/0 (socket says 172.21.15.102:42412) 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3fd19f6640 1 -- 172.21.15.102:0/317522131 learned_addr learned my addr 172.21.15.102:0/317522131 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3fd19f6640 1 -- 172.21.15.102:0/317522131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562988f5e490 con 0x562988f5dac0 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/317522131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f5dea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4069f90 tx=0x7f3fc407f520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59f091af9a188fbb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3eb57fa640 1 -- 172.21.15.102:0/317522131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc409f040 con 0x562988f5dac0 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3eb57fa640 1 -- 172.21.15.102:0/317522131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc407f620 con 0x562988f5dac0 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3eb57fa640 1 -- 172.21.15.102:0/317522131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc405eb00 con 0x562988f5dac0 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/317522131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 msgr2=0x562988f5dea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.879+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/317522131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f5dea0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4069f90 tx=0x7f3fc407f520 comp rx=0 tx=0).stop 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/317522131 shutdown_connections 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/317522131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f5dea0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/317522131 >> 172.21.15.102:0/317522131 conn(0x562988f59ec0 msgr2=0x562988f58100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/317522131 shutdown_connections 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/317522131 wait complete. 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 Processor -- start 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 -- start start 2024-09-19T11:13:51.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f64ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd3f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562988f5e920 con 0x562988f5dac0 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f64ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd19f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f64ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42424/0 (socket says 172.21.15.102:42424) 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.880+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 learned_addr learned my addr 172.21.15.102:0/3311968096 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.881+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562988f65440 con 0x562988f5dac0 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.881+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f64ee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4096c80 tx=0x7f3fc40a0000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.881+0000 7f3ea37fe640 1 -- 172.21.15.102:0/3311968096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc407c800 con 0x562988f5dac0 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.881+0000 7f3ea37fe640 1 -- 172.21.15.102:0/3311968096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3fc40b4070 con 0x562988f5dac0 2024-09-19T11:13:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.881+0000 7f3ea37fe640 1 -- 172.21.15.102:0/3311968096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3fc407fab0 con 0x562988f5dac0 2024-09-19T11:13:51.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.881+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562988f65440 con 0x562988f5dac0 2024-09-19T11:13:51.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.881+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562988f65440 con 0x562988f5dac0 2024-09-19T11:13:51.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.882+0000 7f3ea37fe640 1 -- 172.21.15.102:0/3311968096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3fc407fc50 con 0x562988f5dac0 2024-09-19T11:13:51.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.882+0000 7f3ea37fe640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3e9c03d000 0x7f3e9c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.882+0000 7f3ea37fe640 1 -- 172.21.15.102:0/3311968096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3fc406b170 con 0x562988f5dac0 2024-09-19T11:13:51.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.882+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3e9c03d000 0x7f3e9c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988f703f0 0x562988f728b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f73000 con 0x562988f703f0 2024-09-19T11:13:51.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd21f7640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988f703f0 0x562988f728b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3e9c03d000 0x7f3e9c03f4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c010 tx=0x7f3fc8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd21f7640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988f703f0 0x562988f728b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 20 realm 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f73410 con 0x562988f703f0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.883+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f73ce0 con 0x562988f703f0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd3f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd3f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f74b70 0x562988f76f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f776a0 con 0x562988f74b70 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f74b70 0x562988f76f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.884+0000 7f3fd19f6640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f74b70 0x562988f76f60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd3f0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd3f0c800 20 searching for the correct realm 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f79740 0x562988f7bc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f7c2d0 con 0x562988f79740 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f79740 0x562988f7bc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f79740 0x562988f7bc00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.885+0000 7f3fd11f5640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3fc8037040 0x7f3fc8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.886+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f7c2d0 con 0x7f3fc8037040 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.886+0000 7f3fd21f7640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3fc8037040 0x7f3fc8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.886+0000 7f3fd21f7640 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3fc8037040 0x7f3fc8036410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.886+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.886+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.886+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.886+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.887+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.887+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.887+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.887+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.887+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.887+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.887+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.887+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x7f3fc8037040 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.888+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.888+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f79740 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.888+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.888+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.888+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.888+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.888+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.888+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.889+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.889+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x7f3fc8037040 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.889+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.889+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f79740 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.889+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.889+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f79740 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.889+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.889+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f79740 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f79740 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.890+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.891+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.891+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f79740 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.891+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.891+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x7f3fc8037040 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.891+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.891+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.891+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.891+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.892+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.892+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f79740 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.892+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.892+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.892+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.892+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x7f3fc8037040 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.892+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.892+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f79740 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f74b70 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x562988f703f0 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x562988f74080 con 0x7f3fc8037040 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd3f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd3f0c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd3f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd3f0c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd3f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd3f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.893+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f78040 con 0x562988f703f0 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f78040 con 0x562988f703f0 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f78040 con 0x562988f79740 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 zone default found 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 4 Realm: () 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 zonegroup default 2024-09-19T11:13:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f788e0 con 0x562988f74b70 2024-09-19T11:13:51.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.894+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f7e140 con 0x562988f79740 2024-09-19T11:13:51.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd3f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f7e4e0 con 0x562988f79740 2024-09-19T11:13:51.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd3f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd3f0c800 20 started sync module instance, tier type = 2024-09-19T11:13:51.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd3f0c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:51.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.895+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7d5e0 con 0x7f3fc8037040 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.898+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.898+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94736391592752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7d5e0 con 0x7f3fc8037040 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.898+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7ef90 con 0x562988f703f0 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.899+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94736391592752] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.900+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.900+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94736391596656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7d5e0 con 0x562988f703f0 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.900+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7fa30 con 0x562988f79740 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.902+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.902+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94736391599392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f802d0 con 0x562988f79740 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.902+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f80dc0 con 0x7f3fc8037040 2024-09-19T11:13:51.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.903+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94736391596656] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.905+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94736391599392] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.905+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.905+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94736391601696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7d130 con 0x7f3fc8037040 2024-09-19T11:13:51.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.905+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f81660 con 0x562988f703f0 2024-09-19T11:13:51.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.906+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.906+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94736391606624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f81580 con 0x562988f703f0 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.906+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f82560 con 0x562988f74b70 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.909+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94736391601696] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.909+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.909+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94736391604368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f82980 con 0x562988f74b70 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.909+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f83340 con 0x562988f74b70 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.911+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94736391606624] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.911+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.911+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94736391614096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f83760 con 0x562988f74b70 2024-09-19T11:13:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.911+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f84120 con 0x562988f74b70 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.912+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v35'21 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.912+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94736391617648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f84540 con 0x562988f74b70 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.912+0000 7f3fd3f0c800 20 add_watcher() i=0 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.912+0000 7f3fd3f0c800 20 add_watcher() i=1 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.912+0000 7f3fd3f0c800 20 add_watcher() i=2 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.912+0000 7f3fd3f0c800 20 add_watcher() i=3 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.912+0000 7f3fd3f0c800 20 add_watcher() i=4 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.913+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(59 notify.7 [watch watch cookie 94736391617648] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.914+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(55 notify.5 [watch watch cookie 94736391604368] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.914+0000 7f3fd3f0c800 20 add_watcher() i=5 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.914+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(57 notify.6 [watch watch cookie 94736391614096] v35'22 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.914+0000 7f3fd3f0c800 20 add_watcher() i=6 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.914+0000 7f3fd3f0c800 20 add_watcher() i=7 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.914+0000 7f3fd3f0c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.914+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988f84090 con 0x562988f703f0 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.915+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.915+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94736391610480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f84090 con 0x562988f703f0 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.916+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94736391610480] v35'48 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.916+0000 7f3e837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.916+0000 7f3fd3f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.916+0000 7f3fd3f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.916+0000 7f3fd3f0c800 5 note: GC not initialized 2024-09-19T11:13:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.916+0000 7f3e827fc640 20 reqs_thread_entry: start 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.917+0000 7f3fd3f0c800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.917+0000 7f3fd3f0c800 20 Filter name: none 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.917+0000 7f3df3fff640 20 reqs_thread_entry: start 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.917+0000 7f3fd3f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.917+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x562988fb9a40 con 0x562988f703f0 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.917+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.917+0000 7f3fd3f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:could not fetch user info: no user info saved 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.918+0000 7f3e837fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.918+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94736391610480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988fb9a00 con 0x562988f703f0 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.919+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94736391610480] v35'49 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.919+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94736391592752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988fb9a00 con 0x7f3fc8037040 2024-09-19T11:13:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.921+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94736391592752] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.922+0000 7f3fd3f0c800 20 remove_watcher() i=0 2024-09-19T11:13:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.922+0000 7f3fd3f0c800 2 removed watcher, disabling cache 2024-09-19T11:13:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.922+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94736391596656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988fb9a00 con 0x562988f703f0 2024-09-19T11:13:51.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.923+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94736391596656] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.923+0000 7f3fd3f0c800 20 remove_watcher() i=1 2024-09-19T11:13:51.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.923+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94736391599392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988fb9a00 con 0x562988f79740 2024-09-19T11:13:51.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.924+0000 7f3fd11f5640 1 -- 172.21.15.102:0/3311968096 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94736391599392] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc8009050 con 0x562988f79740 2024-09-19T11:13:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.924+0000 7f3fd3f0c800 20 remove_watcher() i=2 2024-09-19T11:13:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.924+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94736391601696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7ea70 con 0x7f3fc8037040 2024-09-19T11:13:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.925+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94736391601696] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x7f3fc8037040 2024-09-19T11:13:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.925+0000 7f3fd3f0c800 20 remove_watcher() i=3 2024-09-19T11:13:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.925+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94736391606624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7f520 con 0x562988f703f0 2024-09-19T11:13:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.927+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94736391606624] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fcc00a4d0 con 0x562988f703f0 2024-09-19T11:13:51.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.927+0000 7f3fd3f0c800 20 remove_watcher() i=4 2024-09-19T11:13:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.927+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94736391604368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7fe20 con 0x562988f74b70 2024-09-19T11:13:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.928+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94736391604368] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.928+0000 7f3fd3f0c800 20 remove_watcher() i=5 2024-09-19T11:13:51.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.928+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94736391614096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f7ea70 con 0x562988f74b70 2024-09-19T11:13:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.929+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94736391614096] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.929+0000 7f3fd3f0c800 20 remove_watcher() i=6 2024-09-19T11:13:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.929+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94736391617648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x562988f81160 con 0x562988f74b70 2024-09-19T11:13:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd19f6640 1 -- 172.21.15.102:0/3311968096 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94736391617648] v35'23 uv21 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3fc407b070 con 0x562988f74b70 2024-09-19T11:13:51.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 20 remove_watcher() i=7 2024-09-19T11:13:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f74b70 msgr2=0x562988f76f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f74b70 0x562988f76f60 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988f703f0 msgr2=0x562988f728b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988f703f0 0x562988f728b0 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3fc8037040 msgr2=0x7f3fc8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3fc8037040 0x7f3fc8036410 crc :-1 s=READY pgs=16 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f79740 msgr2=0x562988f7bc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f79740 0x562988f7bc00 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3e9c03d000 msgr2=0x7f3e9c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3e9c03d000 0x7f3e9c03f4c0 secure :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800c010 tx=0x7f3fc8010000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 msgr2=0x562988f64ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3311968096 reap_dead start 2024-09-19T11:13:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f64ee0 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7f3fc4096c80 tx=0x7f3fc40a0000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 shutdown_connections 2024-09-19T11:13:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3311968096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f5dac0 0x562988f64ee0 unknown :-1 s=CLOSED pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 >> 172.21.15.102:0/3311968096 conn(0x562988f59ec0 msgr2=0x562988f580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 shutdown_connections 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3311968096 wait complete. 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/1221970154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eac03d000 msgr2=0x7f3eac03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/1221970154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eac03d000 0x7f3eac03f4c0 secure :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0x7f3fc800bf40 tx=0x7f3fc800f000 comp rx=0 tx=0).stop 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/1221970154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f511e0 msgr2=0x562988f51600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/1221970154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f511e0 0x562988f51600 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7f3fc405d790 tx=0x7f3fc405ef70 comp rx=0 tx=0).stop 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/1221970154 shutdown_connections 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/1221970154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eac03d000 0x7f3eac03f4c0 unknown :-1 s=CLOSED pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/1221970154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988f511e0 0x562988f51600 unknown :-1 s=CLOSED pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/1221970154 >> 172.21.15.102:0/1221970154 conn(0x562988f45590 msgr2=0x562988f45970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/1221970154 shutdown_connections 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.930+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/1221970154 wait complete. 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f3c8e0 msgr2=0x562988f3ed50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562988f3c8e0 0x562988f3ed50 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988e3a990 msgr2=0x562988f3a500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562988e3a990 0x562988f3a500 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f40940 msgr2=0x562988f42d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562988f40940 0x562988f42d30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eb803cfb0 msgr2=0x7f3eb803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3eb803cfb0 0x7f3eb803f470 secure :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0x7f3fc8001d70 tx=0x7f3fc80012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 msgr2=0x562988f32eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 --2- 172.21.15.102:0/3745281958 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562988e39890 0x562988f32eb0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7f3fc400a330 tx=0x7f3fc4002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd21f7640 1 -- 172.21.15.102:0/3745281958 reap_dead start 2024-09-19T11:13:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 shutdown_connections 2024-09-19T11:13:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 >> 172.21.15.102:0/3745281958 conn(0x562988e34c60 msgr2=0x562988f247b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 shutdown_connections 2024-09-19T11:13:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:51.931+0000 7f3fd3f0c800 1 -- 172.21.15.102:0/3745281958 wait complete. 2024-09-19T11:13:51.945 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-19T11:13:51.945 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-19T11:13:51.945 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'foo', '--display-name', 'Foo', '--email', 'foo@foo.com', '--access-key', '9te6NH5mcdcq0Tc5i8i1', '--secret', 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', '--max-buckets', '4'] 2024-09-19T11:13:51.946 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid foo --display-name Foo --email foo@foo.com --access-key 9te6NH5mcdcq0Tc5i8i1 --secret Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu --max-buckets 4 2024-09-19T11:13:52.001 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:52.001 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:52.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.000+0000 7f7c96b2e800 1 Processor -- start 2024-09-19T11:13:52.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.000+0000 7f7c96b2e800 1 -- start start 2024-09-19T11:13:52.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c96b2e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x556847ca2f70 0x556847ca5360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c96b2e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556847ca9620 con 0x556847ca5900 2024-09-19T11:13:52.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c96b2e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x556847b2d7d0 con 0x556847ca2f70 2024-09-19T11:13:52.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c9276b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x556847ca2f70 0x556847ca5360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c91f6a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x556847ca5900 0x556847ca7dc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52224/0 (socket says 172.21.15.102:52224) 2024-09-19T11:13:52.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c9276b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x556847ca2f70 0x556847ca5360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42434/0 (socket says 172.21.15.102:42434) 2024-09-19T11:13:52.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c91f6a640 1 -- 172.21.15.102:0/41721347 learned_addr learned my addr 172.21.15.102:0/41721347 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:52.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c9276b640 1 -- 172.21.15.102:0/41721347 >> v1:172.21.15.37:6789/0 conn(0x556847ca5900 legacy=0x556847ca7dc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.001+0000 7f7c9276b640 1 -- 172.21.15.102:0/41721347 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556847caa850 con 0x556847ca2f70 2024-09-19T11:13:52.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.003+0000 7f7c9276b640 1 --2- 172.21.15.102:0/41721347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847ca5360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400a470 tx=0x7f7c84045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a7e660436bdd592 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.003+0000 7f7c91769640 1 -- 172.21.15.102:0/41721347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84053570 con 0x556847ca2f70 2024-09-19T11:13:52.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.003+0000 7f7c91769640 1 -- 172.21.15.102:0/41721347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c84058070 con 0x556847ca2f70 2024-09-19T11:13:52.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.003+0000 7f7c91769640 1 -- 172.21.15.102:0/41721347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84053880 con 0x556847ca2f70 2024-09-19T11:13:52.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.004+0000 7f7c96b2e800 1 -- 172.21.15.102:0/41721347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 msgr2=0x556847ca5360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.004+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/41721347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847ca5360 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x7f7c8400a470 tx=0x7f7c84045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:52.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.004+0000 7f7c96b2e800 1 -- 172.21.15.102:0/41721347 shutdown_connections 2024-09-19T11:13:52.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.004+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/41721347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847ca5360 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.004+0000 7f7c96b2e800 1 -- 172.21.15.102:0/41721347 >> 172.21.15.102:0/41721347 conn(0x556847c9cab0 msgr2=0x556847c9ef10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.004+0000 7f7c96b2e800 1 -- 172.21.15.102:0/41721347 shutdown_connections 2024-09-19T11:13:52.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.004+0000 7f7c96b2e800 1 -- 172.21.15.102:0/41721347 wait complete. 2024-09-19T11:13:52.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.017+0000 7f7c96b2e800 1 Processor -- start 2024-09-19T11:13:52.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.017+0000 7f7c96b2e800 1 -- start start 2024-09-19T11:13:52.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.018+0000 7f7c96b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847d92440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.018+0000 7f7c96b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556847b3add0 con 0x556847ca2f70 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.018+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847d92440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.018+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847d92440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42436/0 (socket says 172.21.15.102:42436) 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.018+0000 7f7c9276b640 1 -- 172.21.15.102:0/1525833925 learned_addr learned my addr 172.21.15.102:0/1525833925 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.018+0000 7f7c9276b640 1 -- 172.21.15.102:0/1525833925 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556847d92a30 con 0x556847ca2f70 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7c9276b640 1 --2- 172.21.15.102:0/1525833925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847d92440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c84025c20 tx=0x7f7c84051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fa06bea9b987edbe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7b80608640 1 -- 172.21.15.102:0/1525833925 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c8405c580 con 0x556847ca2f70 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7b80608640 1 -- 172.21.15.102:0/1525833925 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c84063030 con 0x556847ca2f70 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7b80608640 1 -- 172.21.15.102:0/1525833925 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c8405c850 con 0x556847ca2f70 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1525833925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 msgr2=0x556847d92440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1525833925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847d92440 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x7f7c84025c20 tx=0x7f7c84051000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1525833925 shutdown_connections 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1525833925 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847d92440 unknown :-1 s=CLOSED pgs=208 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1525833925 >> 172.21.15.102:0/1525833925 conn(0x556847c9cab0 msgr2=0x556847d8ddc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.019+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1525833925 shutdown_connections 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1525833925 wait complete. 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c96b2e800 1 Processor -- start 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c96b2e800 1 -- start start 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c96b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847ca2690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c96b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556847ca9af0 con 0x556847ca2f70 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847ca2690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847ca2690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42452/0 (socket says 172.21.15.102:42452) 2024-09-19T11:13:52.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c9276b640 1 -- 172.21.15.102:0/1536072004 learned_addr learned my addr 172.21.15.102:0/1536072004 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.020+0000 7f7c9276b640 1 -- 172.21.15.102:0/1536072004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556847ca2bf0 con 0x556847ca2f70 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.021+0000 7f7c9276b640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847ca2690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c84045f50 tx=0x7f7c84002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.021+0000 7f7b7ee05640 1 -- 172.21.15.102:0/1536072004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84054ad0 con 0x556847ca2f70 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.021+0000 7f7b7ee05640 1 -- 172.21.15.102:0/1536072004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c84054c70 con 0x556847ca2f70 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.021+0000 7f7b7ee05640 1 -- 172.21.15.102:0/1536072004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84068420 con 0x556847ca2f70 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.021+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556847ca0fa0 con 0x556847ca2f70 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.021+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556847ca1560 con 0x556847ca2f70 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7b7ee05640 1 -- 172.21.15.102:0/1536072004 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7c840685c0 con 0x556847ca2f70 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7b7ee05640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b7803d000 0x7f7b7803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7b7ee05640 1 -- 172.21.15.102:0/1536072004 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f7c84070030 con 0x556847ca2f70 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b7803d000 0x7f7b7803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847ca5900 0x556847da33a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847da38e0 con 0x556847ca5900 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7c92f6c640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847ca5900 0x556847da33a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b7803d000 0x7f7b7803f4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c88001d70 tx=0x7f7c880012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.022+0000 7f7c92f6c640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847ca5900 0x556847da33a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.023+0000 7f7c92f6c640 1 -- 172.21.15.102:0/1536072004 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847ca5900 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.023+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847da4180 con 0x556847ca5900 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.023+0000 7f7c92f6c640 1 -- 172.21.15.102:0/1536072004 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847ca5900 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.023+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847da5a90 0x556847da7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.023+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847da86c0 con 0x556847da5a90 2024-09-19T11:13:52.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.023+0000 7f7c9276b640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847da5a90 0x556847da7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.024+0000 7f7c9276b640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847da5a90 0x556847da7f30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.024+0000 7f7c9276b640 1 -- 172.21.15.102:0/1536072004 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7c84051070 con 0x556847da5a90 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.024+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847da49d0 con 0x556847ca5900 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.024+0000 7f7c92f6c640 1 -- 172.21.15.102:0/1536072004 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847ca5900 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.024+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847da9b20 0x556847dabf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.024+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847dac650 con 0x556847da9b20 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.025+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847da9b20 0x556847dabf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.025+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847da9b20 0x556847dabf10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.025+0000 7f7c91f6a640 1 -- 172.21.15.102:0/1536072004 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7c88009050 con 0x556847da9b20 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.025+0000 7f7c96b2e800 1 Processor -- start 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.025+0000 7f7c96b2e800 1 -- start start 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c96b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dba390 0x556847dba7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c96b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556847b994a0 con 0x556847dba390 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dba390 0x556847dba7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dba390 0x556847dba7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42458/0 (socket says 172.21.15.102:42458) 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c9276b640 1 -- 172.21.15.102:0/3691876063 learned_addr learned my addr 172.21.15.102:0/3691876063 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c9276b640 1 -- 172.21.15.102:0/3691876063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556847dbadf0 con 0x556847dba390 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c9276b640 1 --2- 172.21.15.102:0/3691876063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dba390 0x556847dba7b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7c84074fd0 tx=0x7f7c840744e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7b77fff640 1 -- 172.21.15.102:0/3691876063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84096d00 con 0x556847dba390 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7b77fff640 1 -- 172.21.15.102:0/3691876063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c84068a90 con 0x556847dba390 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c96b2e800 1 -- 172.21.15.102:0/3691876063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556847dbb620 con 0x556847dba390 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7b77fff640 1 -- 172.21.15.102:0/3691876063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c84068d70 con 0x556847dba390 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.026+0000 7f7c96b2e800 1 -- 172.21.15.102:0/3691876063 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556847dbb620 con 0x556847dba390 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.027+0000 7f7b77fff640 1 -- 172.21.15.102:0/3691876063 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7c840980b0 con 0x556847dba390 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.027+0000 7f7b77fff640 1 --2- 172.21.15.102:0/3691876063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b6c03d000 0x7f7b6c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.027+0000 7f7b77fff640 1 -- 172.21.15.102:0/3691876063 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f7c8406d0c0 con 0x556847dba390 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.027+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/3691876063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b6c03d000 0x7f7b6c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c96b2e800 1 Processor -- start 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/3691876063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b6c03d000 0x7f7b6c03f4c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800bf40 tx=0x7f7c8800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c96b2e800 1 -- start start 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c96b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dc6da0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c96b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556847d92e00 con 0x556847dc69c0 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dc6da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dc6da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42474/0 (socket says 172.21.15.102:42474) 2024-09-19T11:13:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c9276b640 1 -- 172.21.15.102:0/2238543853 learned_addr learned my addr 172.21.15.102:0/2238543853 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.028+0000 7f7c9276b640 1 -- 172.21.15.102:0/2238543853 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556847dc7390 con 0x556847dc69c0 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c9276b640 1 --2- 172.21.15.102:0/2238543853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dc6da0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c8404de60 tx=0x7f7c84094e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=76ce98f79000a027 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7b75ffb640 1 -- 172.21.15.102:0/2238543853 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c8408fdf0 con 0x556847dc69c0 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7b75ffb640 1 -- 172.21.15.102:0/2238543853 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c8407dd20 con 0x556847dc69c0 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7b75ffb640 1 -- 172.21.15.102:0/2238543853 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c8408f260 con 0x556847dc69c0 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c96b2e800 1 -- 172.21.15.102:0/2238543853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 msgr2=0x556847dc6da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/2238543853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dc6da0 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7f7c8404de60 tx=0x7f7c84094e30 comp rx=0 tx=0).stop 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c96b2e800 1 -- 172.21.15.102:0/2238543853 shutdown_connections 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/2238543853 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dc6da0 unknown :-1 s=CLOSED pgs=211 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c96b2e800 1 -- 172.21.15.102:0/2238543853 >> 172.21.15.102:0/2238543853 conn(0x556847dc2dc0 msgr2=0x556847dc1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c96b2e800 1 -- 172.21.15.102:0/2238543853 shutdown_connections 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c96b2e800 1 -- 172.21.15.102:0/2238543853 wait complete. 2024-09-19T11:13:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.029+0000 7f7c96b2e800 1 Processor -- start 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.030+0000 7f7c96b2e800 1 -- start start 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.030+0000 7f7c96b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dcde00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.030+0000 7f7c96b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556847dc7820 con 0x556847dc69c0 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.030+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dcde00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.030+0000 7f7c9276b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dcde00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42486/0 (socket says 172.21.15.102:42486) 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.030+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 learned_addr learned my addr 172.21.15.102:0/57896442 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.030+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556847dce360 con 0x556847dc69c0 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.031+0000 7f7c9276b640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dcde00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c8407f080 tx=0x7f7c84098ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.031+0000 7f7b63fff640 1 -- 172.21.15.102:0/57896442 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c840bd030 con 0x556847dc69c0 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.031+0000 7f7b63fff640 1 -- 172.21.15.102:0/57896442 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7c840945a0 con 0x556847dc69c0 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.031+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556847dce360 con 0x556847dc69c0 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.031+0000 7f7b63fff640 1 -- 172.21.15.102:0/57896442 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7c8408f260 con 0x556847dc69c0 2024-09-19T11:13:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.031+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556847dce360 con 0x556847dc69c0 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.032+0000 7f7b63fff640 1 -- 172.21.15.102:0/57896442 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7c840c0070 con 0x556847dc69c0 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.032+0000 7f7b63fff640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b5c03d000 0x7f7b5c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.032+0000 7f7b63fff640 1 -- 172.21.15.102:0/57896442 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f7c840be070 con 0x556847dc69c0 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.032+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b5c03d000 0x7f7b5c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.032+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847dd9180 0x556847ddb640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847ddbd90 con 0x556847dd9180 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b5c03d000 0x7f7b5c03f4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c010 tx=0x7f7c88010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c92f6c640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847dd9180 0x556847ddb640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c92f6c640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847dd9180 0x556847ddb640 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 20 realm 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847ddc1a0 con 0x556847dd9180 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.033+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847ddca70 con 0x556847dd9180 2024-09-19T11:13:52.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c96b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847dddb70 0x556847ddff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847de0520 con 0x556847dddb70 2024-09-19T11:13:52.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c9276b640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847dddb70 0x556847ddff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.034+0000 7f7c9276b640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847dddb70 0x556847ddff60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c96b2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c96b2e800 20 searching for the correct realm 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847de24d0 0x556847de4990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847de5060 con 0x556847de24d0 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847de24d0 0x556847de4990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847de24d0 0x556847de4990 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.035+0000 7f7c91f6a640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7c88037040 0x7f7c88036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.036+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847de5060 con 0x7f7c88037040 2024-09-19T11:13:52.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.036+0000 7f7c92f6c640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7c88037040 0x7f7c88036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.036+0000 7f7c92f6c640 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7c88037040 0x7f7c88036410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.036+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.036+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.036+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.036+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.037+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.037+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.037+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.037+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.037+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.037+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.037+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.037+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x7f7c88037040 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.038+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.038+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847de24d0 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.038+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.038+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.038+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.038+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.038+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.038+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.039+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.039+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x7f7c88037040 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.039+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.039+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847de24d0 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.039+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.039+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847de24d0 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.039+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.039+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.040+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.040+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847de24d0 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.040+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.040+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847de24d0 2024-09-19T11:13:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.040+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.040+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.040+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.040+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.041+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.041+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.041+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.041+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847de24d0 2024-09-19T11:13:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.041+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.041+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x7f7c88037040 2024-09-19T11:13:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.041+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.041+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.042+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.042+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.042+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.042+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847de24d0 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.042+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.042+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.042+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.042+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x7f7c88037040 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.043+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.043+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847de24d0 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.043+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.043+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dddb70 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.043+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.043+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x556847dd9180 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.043+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.043+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556847ddce10 con 0x7f7c88037040 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847de0de0 con 0x556847dd9180 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847de0de0 con 0x556847dd9180 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847de0de0 con 0x556847de24d0 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 zone default found 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 4 Realm: () 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 zonegroup default 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.044+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847de16d0 con 0x556847dddb70 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847de6fd0 con 0x556847de24d0 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847de7450 con 0x556847de24d0 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 20 started sync module instance, tier type = 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.045+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de6370 con 0x7f7c88037040 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.046+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.046+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93906370717808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de6370 con 0x7f7c88037040 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.046+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de7fa0 con 0x556847dd9180 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.048+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.048+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93906370722416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de7fa0 con 0x556847dd9180 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.048+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de8fa0 con 0x556847de24d0 2024-09-19T11:13:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.049+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93906370722416] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.052+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93906370717808] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.052+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.052+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93906370715328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de8390 con 0x556847de24d0 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.052+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de99b0 con 0x7f7c88037040 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.053+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.053+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93906370729696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847dea090 con 0x7f7c88037040 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.053+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847deabb0 con 0x556847dd9180 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.053+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93906370715328] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.055+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.055+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93906370733696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847deab70 con 0x556847dd9180 2024-09-19T11:13:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.055+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847deb5c0 con 0x556847dddb70 2024-09-19T11:13:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.056+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93906370729696] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.056+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93906370733696] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.057+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.057+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93906370726544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de9b00 con 0x556847dddb70 2024-09-19T11:13:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.057+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847debe60 con 0x556847dddb70 2024-09-19T11:13:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.059+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93906370726544] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.059+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.059+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93906370736400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847dec6b0 con 0x556847dddb70 2024-09-19T11:13:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.059+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847decf00 con 0x556847dddb70 2024-09-19T11:13:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.060+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93906370736400] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'24 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93906370741248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847decdd0 con 0x556847dddb70 2024-09-19T11:13:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c96b2e800 20 add_watcher() i=0 2024-09-19T11:13:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c96b2e800 20 add_watcher() i=1 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c96b2e800 20 add_watcher() i=2 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c96b2e800 20 add_watcher() i=3 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c96b2e800 20 add_watcher() i=4 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c96b2e800 20 add_watcher() i=5 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.062+0000 7f7c96b2e800 20 add_watcher() i=6 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.063+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93906370741248] v35'25 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.063+0000 7f7c96b2e800 20 add_watcher() i=7 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.063+0000 7f7c96b2e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.063+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847df0340 con 0x556847dd9180 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.063+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.063+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93906370742368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847ded890 con 0x556847dd9180 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.065+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93906370742368] v35'50 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.065+0000 7f7b48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.065+0000 7f7c96b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.065+0000 7f7c96b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 5 note: GC not initialized 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7ac37fe640 20 reqs_thread_entry: start 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 20 Filter name: none 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7ac17fa640 20 reqs_thread_entry: start 2024-09-19T11:13:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847e23340 con 0x556847dd9180 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x0 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.066+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847e21a20 con 0x556847dd9180 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo@foo.com [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x0 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : miss 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847e21e10 con 0x556847dddb70 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 9te6NH5mcdcq0Tc5i8i1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x0 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 10 adding default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-19T11:13:52.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 10 cache get: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 : hit (negative entry) 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.067+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847e22d50 con 0x556847dd9180 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 foo [delete,create,call,writefull 0~391] v35'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7c96b2e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7c96b2e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7c96b2e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify cookie 93906370961968 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847e26cc0 con 0x556847dd9180 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify (1) cookie 93906370733696 notify 150323855360 ret 0) ==== 609+0+0 (crc 0 0 0) 0x556847e227d0 con 0x556847dd9180 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7b75ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 93906370733696 notifier 4302 bl.length()=567 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7b75ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7b75ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.068+0000 7f7b75ffb640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f7b58003ea0 con 0x556847dd9180 2024-09-19T11:13:52.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.069+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 notify.4 [notify cookie 93906370961968 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.069+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(67 notify.4 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.069+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== watch-notify(notify_complete (2) cookie 93906370961968 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x556847e21fe0 con 0x556847dd9180 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.069+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847e22230 con 0x556847dd9180 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.070+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(68 foo@foo.com [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.070+0000 7f7c96b2e800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.070+0000 7f7c96b2e800 10 moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.070+0000 7f7c96b2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [notify cookie 93906370961968 in=181b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847e270d0 con 0x7f7c88037040 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== watch-notify(notify (1) cookie 93906370729696 notify 150323855360 ret 0) ==== 211+0+0 (crc 0 0 0) 0x556847e21fe0 con 0x7f7c88037040 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7b757fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 93906370729696 notifier 4302 bl.length()=169 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7b757fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x7 2024-09-19T11:13:52.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7b757fa640 10 rgw watcher librados: moving default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7b757fa640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f7ac8003400 con 0x7f7c88037040 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(69 notify.3 [notify cookie 93906370961968 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== watch-notify(notify_complete (2) cookie 93906370961968 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7c8c026620 con 0x7f7c88037040 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(70 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.071+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847e222a0 con 0x556847dddb70 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.072+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 9te6NH5mcdcq0Tc5i8i1 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.072+0000 7f7c96b2e800 10 cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.072+0000 7f7c96b2e800 10 moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.072+0000 7f7c96b2e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.072+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 7.e 7:7759931f:::notify.3:head [notify cookie 93906370971568 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556847e263e0 con 0x7f7c88037040 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.073+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== watch-notify(notify (1) cookie 93906370729696 notify 150323855361 ret 0) ==== 219+0+0 (crc 0 0 0) 0x7f7c8c026620 con 0x7f7c88037040 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.073+0000 7f7b75ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 93906370729696 notifier 4302 bl.length()=177 2024-09-19T11:13:52.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.073+0000 7f7b75ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 info.flags=0x7 2024-09-19T11:13:52.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.073+0000 7f7b75ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+9te6NH5mcdcq0Tc5i8i1 to cache LRU end 2024-09-19T11:13:52.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.073+0000 7f7b75ffb640 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f7b58003ea0 con 0x7f7c88037040 2024-09-19T11:13:52.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.073+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(72 notify.3 [notify cookie 93906370971568 out=8b] v0'0 uv24 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.073+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== watch-notify(notify_complete (2) cookie 93906370971568 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7c8c026ad0 con 0x7f7c88037040 2024-09-19T11:13:52.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.073+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(73 notify.3 [notify-ack] v0'0 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.085 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.074+0000 7f7b48fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.074+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:74 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93906370742368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847e21190 con 0x556847dd9180 2024-09-19T11:13:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.075+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(74 data_loggenerations_metadata [watch unwatch cookie 93906370742368] v35'51 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.075+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:75 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93906370717808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847e21190 con 0x7f7c88037040 2024-09-19T11:13:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.076+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(75 notify.0 [watch unwatch cookie 93906370717808] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.076+0000 7f7c96b2e800 20 remove_watcher() i=0 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.076+0000 7f7c96b2e800 2 removed watcher, disabling cache 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.076+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93906370722416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847e21190 con 0x556847dd9180 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.077+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(76 notify.1 [watch unwatch cookie 93906370722416] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.077+0000 7f7c96b2e800 20 remove_watcher() i=1 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.077+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93906370715328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847e21190 con 0x556847de24d0 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.079+0000 7f7c91f6a640 1 -- 172.21.15.102:0/57896442 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(77 notify.2 [watch unwatch cookie 93906370715328] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c88009050 con 0x556847de24d0 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.079+0000 7f7c96b2e800 20 remove_watcher() i=2 2024-09-19T11:13:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.079+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93906370729696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de6870 con 0x7f7c88037040 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.080+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(78 notify.3 [watch unwatch cookie 93906370729696] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x7f7c88037040 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.080+0000 7f7c96b2e800 20 remove_watcher() i=3 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.080+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:79 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93906370733696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de5ec0 con 0x556847dd9180 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.081+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(79 notify.4 [watch unwatch cookie 93906370733696] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c8c00a4d0 con 0x556847dd9180 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.081+0000 7f7c96b2e800 20 remove_watcher() i=4 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.081+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:80 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93906370726544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de96e0 con 0x556847dddb70 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.082+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(80 notify.5 [watch unwatch cookie 93906370726544] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.082+0000 7f7c96b2e800 20 remove_watcher() i=5 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.082+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:81 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93906370736400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de6870 con 0x556847dddb70 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.083+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(81 notify.6 [watch unwatch cookie 93906370736400] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.083+0000 7f7c96b2e800 20 remove_watcher() i=6 2024-09-19T11:13:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.083+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:82 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93906370741248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556847de96e0 con 0x556847dddb70 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.085+0000 7f7c9276b640 1 -- 172.21.15.102:0/57896442 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(82 notify.7 [watch unwatch cookie 93906370741248] v35'26 uv24 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7c84051070 con 0x556847dddb70 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.085+0000 7f7c96b2e800 20 remove_watcher() i=7 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847dddb70 msgr2=0x556847ddff60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847dddb70 0x556847ddff60 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847dd9180 msgr2=0x556847ddb640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847dd9180 0x556847ddb640 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7c88037040 msgr2=0x7f7c88036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7c88037040 0x7f7c88036410 crc :-1 s=READY pgs=17 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847de24d0 msgr2=0x556847de4990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847de24d0 0x556847de4990 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b5c03d000 msgr2=0x7f7b5c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b5c03d000 0x7f7b5c03f4c0 secure :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800c010 tx=0x7f7c88010000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 msgr2=0x556847dcde00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c92f6c640 1 -- 172.21.15.102:0/57896442 reap_dead start 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dcde00 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7f7c8407f080 tx=0x7f7c84098ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 shutdown_connections 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/57896442 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dc69c0 0x556847dcde00 unknown :-1 s=CLOSED pgs=212 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 >> 172.21.15.102:0/57896442 conn(0x556847dc2dc0 msgr2=0x556847dc0fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 shutdown_connections 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/57896442 wait complete. 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/3691876063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b6c03d000 msgr2=0x7f7b6c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/3691876063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b6c03d000 0x7f7b6c03f4c0 secure :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0x7f7c8800bf40 tx=0x7f7c8800f000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/3691876063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dba390 msgr2=0x556847dba7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/3691876063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dba390 0x556847dba7b0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x7f7c84074fd0 tx=0x7f7c840744e0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/3691876063 shutdown_connections 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/3691876063 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b6c03d000 0x7f7b6c03f4c0 unknown :-1 s=CLOSED pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/3691876063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847dba390 0x556847dba7b0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/3691876063 >> 172.21.15.102:0/3691876063 conn(0x556847dae740 msgr2=0x556847daeb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/3691876063 shutdown_connections 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.086+0000 7f7c96b2e800 1 -- 172.21.15.102:0/3691876063 wait complete. 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847da5a90 msgr2=0x556847da7f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556847da5a90 0x556847da7f30 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847ca5900 msgr2=0x556847da33a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556847ca5900 0x556847da33a0 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847da9b20 msgr2=0x556847dabf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556847da9b20 0x556847dabf10 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b7803d000 msgr2=0x7f7b7803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7b7803d000 0x7f7b7803f4c0 secure :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0x7f7c88001d70 tx=0x7f7c880012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 msgr2=0x556847ca2690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 --2- 172.21.15.102:0/1536072004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556847ca2f70 0x556847ca2690 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7f7c84045f50 tx=0x7f7c84002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c92f6c640 1 -- 172.21.15.102:0/1536072004 reap_dead start 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 shutdown_connections 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 >> 172.21.15.102:0/1536072004 conn(0x556847c9cab0 msgr2=0x556847d8c5b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 shutdown_connections 2024-09-19T11:13:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.087+0000 7f7c96b2e800 1 -- 172.21.15.102:0/1536072004 wait complete. 2024-09-19T11:13:52.097 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:52.097 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-19T11:13:52.097 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--email', 'foo@foo.com'] 2024-09-19T11:13:52.098 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --email foo@foo.com 2024-09-19T11:13:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:52.146 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:52.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.145+0000 7fe990739800 1 Processor -- start 2024-09-19T11:13:52.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe990739800 1 -- start start 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe990739800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a978816880 0x55a97881f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe990739800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a97881f8e0 con 0x55a978814d60 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe990739800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55a9786a17d0 con 0x55a978816880 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe98c481640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55a978814d60 0x55a978815160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52238/0 (socket says 172.21.15.102:52238) 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe98c481640 1 -- 172.21.15.102:0/1337956004 learned_addr learned my addr 172.21.15.102:0/1337956004 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe98bc80640 1 --2- 172.21.15.102:0/1337956004 >> v2:172.21.15.37:3300/0 conn(0x55a978816880 0x55a97881f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe98b47f640 1 -- 172.21.15.102:0/1337956004 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1216535864 0 0) 0x55a97881f8e0 con 0x55a978814d60 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe98b47f640 1 -- 172.21.15.102:0/1337956004 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7fe978001e10 con 0x55a978814d60 2024-09-19T11:13:52.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe98bc80640 1 -- 172.21.15.102:0/1337956004 >> v1:172.21.15.37:6789/0 conn(0x55a978814d60 legacy=0x55a978815160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.146+0000 7fe98bc80640 1 -- 172.21.15.102:0/1337956004 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a978820ac0 con 0x55a978816880 2024-09-19T11:13:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.148+0000 7fe98bc80640 1 --2- 172.21.15.102:0/1337956004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978816880 0x55a97881f3a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe97400a470 tx=0x7fe974045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ce0b3333ca73ccdf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.148+0000 7fe98b47f640 1 -- 172.21.15.102:0/1337956004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974059070 con 0x55a978816880 2024-09-19T11:13:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.148+0000 7fe98b47f640 1 -- 172.21.15.102:0/1337956004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe974054570 con 0x55a978816880 2024-09-19T11:13:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.148+0000 7fe98b47f640 1 -- 172.21.15.102:0/1337956004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe974054870 con 0x55a978816880 2024-09-19T11:13:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.149+0000 7fe990739800 1 -- 172.21.15.102:0/1337956004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978816880 msgr2=0x55a97881f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.149+0000 7fe990739800 1 --2- 172.21.15.102:0/1337956004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978816880 0x55a97881f3a0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7fe97400a470 tx=0x7fe974045920 comp rx=0 tx=0).stop 2024-09-19T11:13:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.149+0000 7fe990739800 1 -- 172.21.15.102:0/1337956004 shutdown_connections 2024-09-19T11:13:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.149+0000 7fe990739800 1 --2- 172.21.15.102:0/1337956004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978816880 0x55a97881f3a0 unknown :-1 s=CLOSED pgs=214 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.149+0000 7fe990739800 1 -- 172.21.15.102:0/1337956004 >> 172.21.15.102:0/1337956004 conn(0x55a978810a70 msgr2=0x55a978812ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.149+0000 7fe990739800 1 -- 172.21.15.102:0/1337956004 shutdown_connections 2024-09-19T11:13:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.149+0000 7fe990739800 1 -- 172.21.15.102:0/1337956004 wait complete. 2024-09-19T11:13:52.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.162+0000 7fe990739800 1 Processor -- start 2024-09-19T11:13:52.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.162+0000 7fe990739800 1 -- start start 2024-09-19T11:13:52.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.162+0000 7fe990739800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a978908400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.162+0000 7fe990739800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a9786aedd0 con 0x55a978814d60 2024-09-19T11:13:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.163+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a978908400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.163+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a978908400 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42506/0 (socket says 172.21.15.102:42506) 2024-09-19T11:13:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.163+0000 7fe98c481640 1 -- 172.21.15.102:0/1947176371 learned_addr learned my addr 172.21.15.102:0/1947176371 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.163+0000 7fe98c481640 1 -- 172.21.15.102:0/1947176371 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9789089f0 con 0x55a978814d60 2024-09-19T11:13:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.163+0000 7fe98c481640 1 --2- 172.21.15.102:0/1947176371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a978908400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe984001e30 tx=0x7fe98400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2085c968dcbd565d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.163+0000 7fe87a60c640 1 -- 172.21.15.102:0/1947176371 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe984012020 con 0x55a978814d60 2024-09-19T11:13:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.163+0000 7fe87a60c640 1 -- 172.21.15.102:0/1947176371 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98400e470 con 0x55a978814d60 2024-09-19T11:13:52.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.163+0000 7fe87a60c640 1 -- 172.21.15.102:0/1947176371 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98400e790 con 0x55a978814d60 2024-09-19T11:13:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 -- 172.21.15.102:0/1947176371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 msgr2=0x55a978908400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 --2- 172.21.15.102:0/1947176371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a978908400 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fe984001e30 tx=0x7fe98400b780 comp rx=0 tx=0).stop 2024-09-19T11:13:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 -- 172.21.15.102:0/1947176371 shutdown_connections 2024-09-19T11:13:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 --2- 172.21.15.102:0/1947176371 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a978908400 unknown :-1 s=CLOSED pgs=215 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 -- 172.21.15.102:0/1947176371 >> 172.21.15.102:0/1947176371 conn(0x55a978810a70 msgr2=0x55a978903d80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 -- 172.21.15.102:0/1947176371 shutdown_connections 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 -- 172.21.15.102:0/1947176371 wait complete. 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 Processor -- start 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 -- start start 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a97890ff70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.164+0000 7fe990739800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a97881fdb0 con 0x55a978814d60 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a97890ff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a97890ff70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42520/0 (socket says 172.21.15.102:42520) 2024-09-19T11:13:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe98c481640 1 -- 172.21.15.102:0/4108554096 learned_addr learned my addr 172.21.15.102:0/4108554096 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe98c481640 1 -- 172.21.15.102:0/4108554096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a9789104d0 con 0x55a978814d60 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe98c481640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a97890ff70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55a978909390 tx=0x7fe9840040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe878e09640 1 -- 172.21.15.102:0/4108554096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe984012030 con 0x55a978814d60 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe878e09640 1 -- 172.21.15.102:0/4108554096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98401a7a0 con 0x55a978814d60 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a978910760 con 0x55a978814d60 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe878e09640 1 -- 172.21.15.102:0/4108554096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98401aaa0 con 0x55a978814d60 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.165+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a978911160 con 0x55a978814d60 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.166+0000 7fe878e09640 1 -- 172.21.15.102:0/4108554096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe984015020 con 0x55a978814d60 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.166+0000 7fe878e09640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe87403d000 0x7fe87403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.166+0000 7fe878e09640 1 -- 172.21.15.102:0/4108554096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe984020070 con 0x55a978814d60 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.166+0000 7fe98bc80640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe87403d000 0x7fe87403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.166+0000 7fe990739800 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a978816880 0x55a9789175c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.166+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978911d40 con 0x55a978816880 2024-09-19T11:13:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.167+0000 7fe98cc82640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a978816880 0x55a9789175c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.167+0000 7fe98bc80640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe87403d000 0x7fe87403f4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55a978789770 tx=0x7fe974050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.167+0000 7fe98cc82640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a978816880 0x55a9789175c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.167+0000 7fe98cc82640 1 -- 172.21.15.102:0/4108554096 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a978816880 2024-09-19T11:13:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.167+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9789115f0 con 0x55a978816880 2024-09-19T11:13:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.167+0000 7fe98cc82640 1 -- 172.21.15.102:0/4108554096 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a978816880 2024-09-19T11:13:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.167+0000 7fe990739800 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978919a90 0x55a97891be80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.167+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a97891c550 con 0x55a978919a90 2024-09-19T11:13:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.168+0000 7fe98c481640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978919a90 0x55a97891be80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.168+0000 7fe98c481640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978919a90 0x55a97891be80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.168+0000 7fe98c481640 1 -- 172.21.15.102:0/4108554096 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe984018ce0 con 0x55a978919a90 2024-09-19T11:13:52.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.168+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978918930 con 0x55a978816880 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.169+0000 7fe98cc82640 1 -- 172.21.15.102:0/4108554096 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a978816880 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.169+0000 7fe990739800 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a97891d990 0x55a97891fd80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.169+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9789204c0 con 0x55a97891d990 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.169+0000 7fe98bc80640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a97891d990 0x55a97891fd80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.169+0000 7fe98bc80640 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a97891d990 0x55a97891fd80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.169+0000 7fe98bc80640 1 -- 172.21.15.102:0/4108554096 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe97405c040 con 0x55a97891d990 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.170+0000 7fe990739800 1 Processor -- start 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.170+0000 7fe990739800 1 -- start start 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.170+0000 7fe990739800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97892e240 0x55a97892e660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.170+0000 7fe990739800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a97870d4a0 con 0x55a97892e240 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.170+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97892e240 0x55a97892e660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.170+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97892e240 0x55a97892e660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42522/0 (socket says 172.21.15.102:42522) 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.170+0000 7fe98c481640 1 -- 172.21.15.102:0/374878111 learned_addr learned my addr 172.21.15.102:0/374878111 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.170+0000 7fe98c481640 1 -- 172.21.15.102:0/374878111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97892eca0 con 0x55a97892e240 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.171+0000 7fe98c481640 1 --2- 172.21.15.102:0/374878111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97892e240 0x55a97892e660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe984000fb0 tx=0x7fe984018720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.171+0000 7fe871ffb640 1 -- 172.21.15.102:0/374878111 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98404d030 con 0x55a97892e240 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.171+0000 7fe871ffb640 1 -- 172.21.15.102:0/374878111 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98404e040 con 0x55a97892e240 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.171+0000 7fe871ffb640 1 -- 172.21.15.102:0/374878111 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe984042b10 con 0x55a97892e240 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.171+0000 7fe990739800 1 -- 172.21.15.102:0/374878111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a97892f4d0 con 0x55a97892e240 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.171+0000 7fe990739800 1 -- 172.21.15.102:0/374878111 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a97892f4d0 con 0x55a97892e240 2024-09-19T11:13:52.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe871ffb640 1 -- 172.21.15.102:0/374878111 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe984042cd0 con 0x55a97892e240 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe871ffb640 1 --2- 172.21.15.102:0/374878111 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe86403d000 0x7fe86403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe871ffb640 1 -- 172.21.15.102:0/374878111 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe98403e450 con 0x55a97892e240 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe98bc80640 1 --2- 172.21.15.102:0/374878111 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe86403d000 0x7fe86403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe990739800 1 Processor -- start 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe990739800 1 -- start start 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe98bc80640 1 --2- 172.21.15.102:0/374878111 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe86403d000 0x7fe86403f4c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55a978917c30 tx=0x7fe974005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe990739800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a97893ad60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.172+0000 7fe990739800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a978908e20 con 0x55a97893a960 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.173+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a97893ad60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.173+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a97893ad60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42538/0 (socket says 172.21.15.102:42538) 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.173+0000 7fe98c481640 1 -- 172.21.15.102:0/670849201 learned_addr learned my addr 172.21.15.102:0/670849201 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.173+0000 7fe98c481640 1 -- 172.21.15.102:0/670849201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a97893b350 con 0x55a97893a960 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.173+0000 7fe98c481640 1 --2- 172.21.15.102:0/670849201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a97893ad60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe98403c810 tx=0x7fe9840518d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a9f26cfe2de678e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.173+0000 7fe8637fe640 1 -- 172.21.15.102:0/670849201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98404b730 con 0x55a97893a960 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.173+0000 7fe8637fe640 1 -- 172.21.15.102:0/670849201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe98404b3a0 con 0x55a97893a960 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.173+0000 7fe8637fe640 1 -- 172.21.15.102:0/670849201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98403e0f0 con 0x55a97893a960 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 -- 172.21.15.102:0/670849201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 msgr2=0x55a97893ad60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 --2- 172.21.15.102:0/670849201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a97893ad60 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7fe98403c810 tx=0x7fe9840518d0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 -- 172.21.15.102:0/670849201 shutdown_connections 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 --2- 172.21.15.102:0/670849201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a97893ad60 unknown :-1 s=CLOSED pgs=218 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 -- 172.21.15.102:0/670849201 >> 172.21.15.102:0/670849201 conn(0x55a978936d60 msgr2=0x55a978934fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 -- 172.21.15.102:0/670849201 shutdown_connections 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 -- 172.21.15.102:0/670849201 wait complete. 2024-09-19T11:13:52.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 Processor -- start 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 -- start start 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a978941de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe990739800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a97893b7c0 con 0x55a97893a960 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a978941de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe98c481640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a978941de0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42544/0 (socket says 172.21.15.102:42544) 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.174+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 learned_addr learned my addr 172.21.15.102:0/1810363977 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.175+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a978942340 con 0x55a97893a960 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.175+0000 7fe98c481640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a978941de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe98403e6c0 tx=0x7fe98403c770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.175+0000 7fe861ffb640 1 -- 172.21.15.102:0/1810363977 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe98406e070 con 0x55a97893a960 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.175+0000 7fe861ffb640 1 -- 172.21.15.102:0/1810363977 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9840414a0 con 0x55a97893a960 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.175+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a978942340 con 0x55a97893a960 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.175+0000 7fe861ffb640 1 -- 172.21.15.102:0/1810363977 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9840417c0 con 0x55a97893a960 2024-09-19T11:13:52.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.175+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a978942340 con 0x55a97893a960 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.176+0000 7fe861ffb640 1 -- 172.21.15.102:0/1810363977 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe984071070 con 0x55a97893a960 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.176+0000 7fe861ffb640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe85403d1a0 0x7fe85403f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.176+0000 7fe861ffb640 1 -- 172.21.15.102:0/1810363977 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe984066070 con 0x55a97893a960 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.176+0000 7fe98bc80640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe85403d1a0 0x7fe85403f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe98bc80640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe85403d1a0 0x7fe85403f660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55a9789208c0 tx=0x7fe974062040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a97894d340 0x55a97894f800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a97894ff50 con 0x55a97894d340 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe98cc82640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a97894d340 0x55a97894f800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe98cc82640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a97894d340 0x55a97894f800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe990739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe990739800 20 realm 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.177+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978950360 con 0x55a97894d340 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978950c30 con 0x55a97894d340 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978950fd0 con 0x55a97894d340 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978951d30 0x55a978954120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9789546e0 con 0x55a978951d30 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.178+0000 7fe98c481640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978951d30 0x55a978954120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.179+0000 7fe98c481640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978951d30 0x55a978954120 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.179+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.179+0000 7fe990739800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.179+0000 7fe990739800 20 searching for the correct realm 2024-09-19T11:13:52.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.179+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a978956690 0x55a978958b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.179+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.179+0000 7fe98bc80640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a978956690 0x55a978958b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.179+0000 7fe98bc80640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a978956690 0x55a978958b50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.180+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.180+0000 7fe98bc80640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe974085040 0x7fe974077430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.180+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x7fe974085040 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.180+0000 7fe98cc82640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe974085040 0x7fe974077430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.180+0000 7fe98cc82640 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe974085040 0x7fe974077430 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.180+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.180+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.181+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.181+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a97894d340 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.181+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.181+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a97894d340 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.181+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.181+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.181+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.181+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x7fe974085040 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a97894d340 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.182+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a97894d340 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x7fe974085040 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.183+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.184+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.184+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.184+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.184+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.184+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.184+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a97894d340 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.184+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.184+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a97894d340 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.185+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.185+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.185+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.185+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.185+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.185+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x7fe974085040 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.185+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.185+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a97894d340 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.186+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.186+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.186+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.186+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.186+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.186+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.186+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.186+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x7fe974085040 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.187+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.187+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978956690 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.187+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.187+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a978951d30 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.187+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.187+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x55a97894d340 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.187+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.187+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a978959220 con 0x7fe974085040 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9789550a0 con 0x55a97894d340 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978955490 con 0x55a97894d340 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978955490 con 0x55a978956690 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 zone default found 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 4 Realm: () 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 zonegroup default 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.188+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a9789596a0 con 0x55a978951d30 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a97895b530 con 0x55a978956690 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a97895b940 con 0x55a978956690 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 20 started sync module instance, tier type = 2024-09-19T11:13:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.189+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895a8d0 con 0x7fe974085040 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.190+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.190+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94186360909296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895a8d0 con 0x7fe974085040 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.190+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895c3f0 con 0x55a97894d340 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.191+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94186360909296] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.192+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.192+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94186360913632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895a8d0 con 0x55a97894d340 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.192+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895cea0 con 0x55a978956690 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.193+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94186360913632] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.193+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.193+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94186360906784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895a840 con 0x55a978956690 2024-09-19T11:13:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.193+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895dd60 con 0x7fe974085040 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.194+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94186360906784] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.194+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.194+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94186360920240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895dcd0 con 0x7fe974085040 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.194+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895ec20 con 0x55a97894d340 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.195+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.195+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94186360924016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895f040 con 0x55a97894d340 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.195+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895faf0 con 0x55a978951d30 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.195+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94186360920240] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.196+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.196+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94186360922448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895fee0 con 0x55a978951d30 2024-09-19T11:13:52.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.196+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9789608a0 con 0x55a978951d30 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.196+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94186360924016] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.197+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94186360922448] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.197+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.197+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94186360931312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978960cc0 con 0x55a978951d30 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.197+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978961510 con 0x55a978951d30 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94186360931312] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'27 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94186360933568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978961590 con 0x55a978951d30 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe990739800 20 add_watcher() i=0 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe990739800 20 add_watcher() i=1 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe990739800 20 add_watcher() i=2 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe990739800 20 add_watcher() i=3 2024-09-19T11:13:52.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe990739800 20 add_watcher() i=4 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe990739800 20 add_watcher() i=5 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.198+0000 7fe990739800 20 add_watcher() i=6 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.199+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94186360933568] v35'28 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.199+0000 7fe990739800 20 add_watcher() i=7 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.199+0000 7fe990739800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.199+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978964890 con 0x55a97894d340 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.200+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.200+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94186360934992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978961b20 con 0x55a97894d340 2024-09-19T11:13:52.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94186360934992] v35'52 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe8427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe990739800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe990739800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe990739800 5 note: GC not initialized 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe8417e2640 20 reqs_thread_entry: start 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe990739800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe990739800 20 Filter name: none 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe7b2ffd640 20 reqs_thread_entry: start 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe990739800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.201+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978997780 con 0x55a978951d30 2024-09-19T11:13:52.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 10 cache get: name=default.rgw.meta+users.email+foo@foo.com : miss 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.3 8:c162d5d1:users.email::foo@foo.com:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978995e40 con 0x55a97894d340 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(63 foo@foo.com [stat out=16b,read 0~7 out=7b] v0'0 uv1 ondisk = 0) ==== 197+0+23 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 20 rados_obj.operate() r=0 bl.length=7 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 10 cache put: name=default.rgw.meta+users.email+foo@foo.com info.flags=0x5 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 10 adding default.rgw.meta+users.email+foo@foo.com to cache LRU end 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.202+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a978996230 con 0x55a97894d340 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe990739800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe990739800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe990739800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe990739800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe990739800 10 chain_cache_entry: cache_locator=default.rgw.meta+users.uid+foo 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe990739800 20 get_user_info_from_index found 0 xattrs 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:could not create user: unable to parse parameters, email: foo@foo.com is the email address of an existing user 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe8427e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.203+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94186360934992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a9789631a0 con 0x55a97894d340 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.204+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94186360934992] v35'53 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.204+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94186360909296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978961250 con 0x7fe974085040 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.205+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94186360909296] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.205+0000 7fe990739800 20 remove_watcher() i=0 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.205+0000 7fe990739800 2 removed watcher, disabling cache 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.205+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94186360913632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978961250 con 0x55a97894d340 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.206+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94186360913632] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.206+0000 7fe990739800 20 remove_watcher() i=1 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.206+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94186360906784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978961250 con 0x55a978956690 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.207+0000 7fe98bc80640 1 -- 172.21.15.102:0/1810363977 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94186360906784] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe974072030 con 0x55a978956690 2024-09-19T11:13:52.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.207+0000 7fe990739800 20 remove_watcher() i=2 2024-09-19T11:13:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.207+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94186360920240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978961250 con 0x7fe974085040 2024-09-19T11:13:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.208+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94186360920240] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x7fe974085040 2024-09-19T11:13:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.208+0000 7fe990739800 20 remove_watcher() i=3 2024-09-19T11:13:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.208+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94186360924016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895d8b0 con 0x55a97894d340 2024-09-19T11:13:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.209+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94186360924016] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe97c00a4d0 con 0x55a97894d340 2024-09-19T11:13:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.209+0000 7fe990739800 20 remove_watcher() i=4 2024-09-19T11:13:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.209+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94186360922448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a978961250 con 0x55a978951d30 2024-09-19T11:13:52.228 DEBUG:teuthology.orchestra.run:got remote process result: 240 2024-09-19T11:13:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.210+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94186360922448] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.210+0000 7fe990739800 20 remove_watcher() i=5 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.210+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94186360931312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895e770 con 0x55a978951d30 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.211+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94186360931312] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.211+0000 7fe990739800 20 remove_watcher() i=6 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.211+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94186360933568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a97895d8b0 con 0x55a978951d30 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe98c481640 1 -- 172.21.15.102:0/1810363977 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94186360933568] v35'29 uv27 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe984070030 con 0x55a978951d30 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 20 remove_watcher() i=7 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978951d30 msgr2=0x55a978954120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978951d30 0x55a978954120 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a97894d340 msgr2=0x55a97894f800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a97894d340 0x55a97894f800 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe974085040 msgr2=0x7fe974077430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe974085040 0x7fe974077430 crc :-1 s=READY pgs=18 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a978956690 msgr2=0x55a978958b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a978956690 0x55a978958b50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe85403d1a0 msgr2=0x7fe85403f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe85403d1a0 0x7fe85403f660 secure :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0x55a9789208c0 tx=0x7fe974062040 comp rx=0 tx=0).stop 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 msgr2=0x55a978941de0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe98cc82640 1 -- 172.21.15.102:0/1810363977 reap_dead start 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a978941de0 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x7fe98403e6c0 tx=0x7fe98403c770 comp rx=0 tx=0).stop 2024-09-19T11:13:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.212+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 shutdown_connections 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/1810363977 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97893a960 0x55a978941de0 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 >> 172.21.15.102:0/1810363977 conn(0x55a978936d60 msgr2=0x55a978934f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 shutdown_connections 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/1810363977 wait complete. 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/374878111 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe86403d000 msgr2=0x7fe86403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/374878111 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe86403d000 0x7fe86403f4c0 secure :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0x55a978917c30 tx=0x7fe974005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/374878111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97892e240 msgr2=0x55a97892e660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/374878111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97892e240 0x55a97892e660 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fe984000fb0 tx=0x7fe984018720 comp rx=0 tx=0).stop 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/374878111 shutdown_connections 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/374878111 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe86403d000 0x7fe86403f4c0 unknown :-1 s=CLOSED pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/374878111 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a97892e240 0x55a97892e660 unknown :-1 s=CLOSED pgs=217 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/374878111 >> 172.21.15.102:0/374878111 conn(0x55a9789225f0 msgr2=0x55a9789229d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/374878111 shutdown_connections 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/374878111 wait complete. 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978919a90 msgr2=0x55a97891be80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a978919a90 0x55a97891be80 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a978816880 msgr2=0x55a9789175c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a978816880 0x55a9789175c0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a97891d990 msgr2=0x55a97891fd80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a97891d990 0x55a97891fd80 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe87403d000 msgr2=0x7fe87403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe87403d000 0x7fe87403f4c0 secure :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0x55a978789770 tx=0x7fe974050000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 msgr2=0x55a97890ff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 --2- 172.21.15.102:0/4108554096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a978814d60 0x55a97890ff70 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55a978909390 tx=0x7fe9840040e0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe98cc82640 1 -- 172.21.15.102:0/4108554096 reap_dead start 2024-09-19T11:13:52.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 shutdown_connections 2024-09-19T11:13:52.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.213+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 >> 172.21.15.102:0/4108554096 conn(0x55a978810a70 msgr2=0x55a9789098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.214+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 shutdown_connections 2024-09-19T11:13:52.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.214+0000 7fe990739800 1 -- 172.21.15.102:0/4108554096 wait complete. 2024-09-19T11:13:52.233 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:13:52.233 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:13:52.234 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:13:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:52.278 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:52.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecf620800 1 Processor -- start 2024-09-19T11:13:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecf620800 1 -- start start 2024-09-19T11:13:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecf620800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55d5b4869d60 0x55d5b486a160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecf620800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d5b486b260 con 0x55d5b486a6a0 2024-09-19T11:13:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecf620800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55d5b46f67d0 con 0x55d5b4869d60 2024-09-19T11:13:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecd10a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55d5b4869d60 0x55d5b486a160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecd10a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55d5b4869d60 0x55d5b486a160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42560/0 (socket says 172.21.15.102:42560) 2024-09-19T11:13:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecd10a640 1 -- 172.21.15.102:0/1592297883 learned_addr learned my addr 172.21.15.102:0/1592297883 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecd10a640 1 -- 172.21.15.102:0/1592297883 >> v1:172.21.15.37:6789/0 conn(0x55d5b486a6a0 legacy=0x55d5b486ab50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.278+0000 7f8ecd10a640 1 -- 172.21.15.102:0/1592297883 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b486b430 con 0x55d5b4869d60 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.280+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/1592297883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b486a160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000a520 tx=0x7f8ec0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=23e4f0ff87811079 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.280+0000 7f8ecc909640 1 -- 172.21.15.102:0/1592297883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec0055070 con 0x55d5b4869d60 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.280+0000 7f8ecc909640 1 -- 172.21.15.102:0/1592297883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec00515b0 con 0x55d5b4869d60 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.280+0000 7f8ecc909640 1 -- 172.21.15.102:0/1592297883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec00518d0 con 0x55d5b4869d60 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.281+0000 7f8ecf620800 1 -- 172.21.15.102:0/1592297883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 msgr2=0x55d5b486a160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.281+0000 7f8ecf620800 1 --2- 172.21.15.102:0/1592297883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b486a160 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f8ec000a520 tx=0x7f8ec0045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.281+0000 7f8ecf620800 1 -- 172.21.15.102:0/1592297883 shutdown_connections 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.281+0000 7f8ecf620800 1 --2- 172.21.15.102:0/1592297883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b486a160 unknown :-1 s=CLOSED pgs=221 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.281+0000 7f8ecf620800 1 -- 172.21.15.102:0/1592297883 >> 172.21.15.102:0/1592297883 conn(0x55d5b4865a90 msgr2=0x55d5b4867ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.281+0000 7f8ecf620800 1 -- 172.21.15.102:0/1592297883 shutdown_connections 2024-09-19T11:13:52.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.281+0000 7f8ecf620800 1 -- 172.21.15.102:0/1592297883 wait complete. 2024-09-19T11:13:52.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.295+0000 7f8ecf620800 1 Processor -- start 2024-09-19T11:13:52.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.295+0000 7f8ecf620800 1 -- start start 2024-09-19T11:13:52.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.295+0000 7f8ecf620800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b495d510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.295+0000 7f8ecf620800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5b4703dd0 con 0x55d5b4869d60 2024-09-19T11:13:52.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.295+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b495d510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.295+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b495d510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42572/0 (socket says 172.21.15.102:42572) 2024-09-19T11:13:52.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.295+0000 7f8ecd10a640 1 -- 172.21.15.102:0/142919397 learned_addr learned my addr 172.21.15.102:0/142919397 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.295+0000 7f8ecd10a640 1 -- 172.21.15.102:0/142919397 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b495db00 con 0x55d5b4869d60 2024-09-19T11:13:52.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.296+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/142919397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b495d510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0025da0 tx=0x7f8ec0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=270af4fde489fa2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.296+0000 7f8dbb606640 1 -- 172.21.15.102:0/142919397 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec0051950 con 0x55d5b4869d60 2024-09-19T11:13:52.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.296+0000 7f8dbb606640 1 -- 172.21.15.102:0/142919397 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec0051af0 con 0x55d5b4869d60 2024-09-19T11:13:52.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.296+0000 7f8dbb606640 1 -- 172.21.15.102:0/142919397 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec0051dd0 con 0x55d5b4869d60 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 -- 172.21.15.102:0/142919397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 msgr2=0x55d5b495d510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 --2- 172.21.15.102:0/142919397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b495d510 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0025da0 tx=0x7f8ec0051000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 -- 172.21.15.102:0/142919397 shutdown_connections 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 --2- 172.21.15.102:0/142919397 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b495d510 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 -- 172.21.15.102:0/142919397 >> 172.21.15.102:0/142919397 conn(0x55d5b4865a90 msgr2=0x55d5b4958e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 -- 172.21.15.102:0/142919397 shutdown_connections 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 -- 172.21.15.102:0/142919397 wait complete. 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 Processor -- start 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 -- start start 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b4964e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecf620800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5b486b960 con 0x55d5b4869d60 2024-09-19T11:13:52.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b4964e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b4964e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42582/0 (socket says 172.21.15.102:42582) 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.297+0000 7f8ecd10a640 1 -- 172.21.15.102:0/944098999 learned_addr learned my addr 172.21.15.102:0/944098999 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.298+0000 7f8ecd10a640 1 -- 172.21.15.102:0/944098999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b49653e0 con 0x55d5b4869d60 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.298+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b4964e80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0067040 tx=0x7f8ec0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.298+0000 7f8db9e03640 1 -- 172.21.15.102:0/944098999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec0073070 con 0x55d5b4869d60 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.298+0000 7f8db9e03640 1 -- 172.21.15.102:0/944098999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec005a450 con 0x55d5b4869d60 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.298+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5b4965670 con 0x55d5b4869d60 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.298+0000 7f8db9e03640 1 -- 172.21.15.102:0/944098999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec005a730 con 0x55d5b4869d60 2024-09-19T11:13:52.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.298+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b4966280 con 0x55d5b4869d60 2024-09-19T11:13:52.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.299+0000 7f8db9e03640 1 -- 172.21.15.102:0/944098999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8ec0076070 con 0x55d5b4869d60 2024-09-19T11:13:52.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.299+0000 7f8db9e03640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8db403d000 0x7f8db403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.299+0000 7f8db9e03640 1 -- 172.21.15.102:0/944098999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f8ec0062070 con 0x55d5b4869d60 2024-09-19T11:13:52.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.299+0000 7f8ec4909640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8db403d000 0x7f8db403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.299+0000 7f8ecf620800 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b486a6a0 0x55d5b496c4d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.299+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b496ca10 con 0x55d5b486a6a0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.299+0000 7f8ecd90b640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b486a6a0 0x55d5b496c4d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.299+0000 7f8ec4909640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8db403d000 0x7f8db403f4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8001e50 tx=0x7f8eb80013d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.300+0000 7f8ecd90b640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b486a6a0 0x55d5b496c4d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.300+0000 7f8ecd90b640 1 -- 172.21.15.102:0/944098999 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b486a6a0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.300+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b496cdb0 con 0x55d5b486a6a0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.300+0000 7f8ecd90b640 1 -- 172.21.15.102:0/944098999 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b486a6a0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.300+0000 7f8ecf620800 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b496e8b0 0x55d5b4970d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.300+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49714c0 con 0x55d5b496e8b0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.300+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b496e8b0 0x55d5b4970d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.301+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b496e8b0 0x55d5b4970d30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.301+0000 7f8ecd10a640 1 -- 172.21.15.102:0/944098999 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8ec007f070 con 0x55d5b496e8b0 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.301+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b496d600 con 0x55d5b486a6a0 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.301+0000 7f8ecd90b640 1 -- 172.21.15.102:0/944098999 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b486a6a0 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.301+0000 7f8ecf620800 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b4972920 0x55d5b4974d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.301+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b4975450 con 0x55d5b4972920 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.301+0000 7f8ec4909640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b4972920 0x55d5b4974d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.302+0000 7f8ec4909640 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b4972920 0x55d5b4974d10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.302+0000 7f8ec4909640 1 -- 172.21.15.102:0/944098999 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8eb8010600 con 0x55d5b4972920 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.302+0000 7f8ecf620800 1 Processor -- start 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.302+0000 7f8ecf620800 1 -- start start 2024-09-19T11:13:52.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.302+0000 7f8ecf620800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4983190 0x55d5b49835b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8ecf620800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5b47624a0 con 0x55d5b4983190 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4983190 0x55d5b49835b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4983190 0x55d5b49835b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42596/0 (socket says 172.21.15.102:42596) 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3891654213 learned_addr learned my addr 172.21.15.102:0/3891654213 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3891654213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b4983bf0 con 0x55d5b4983190 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/3891654213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4983190 0x55d5b49835b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0096e20 tx=0x7f8ec00507b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8db2ffd640 1 -- 172.21.15.102:0/3891654213 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec00644e0 con 0x55d5b4983190 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8db2ffd640 1 -- 172.21.15.102:0/3891654213 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec0064680 con 0x55d5b4983190 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8ecf620800 1 -- 172.21.15.102:0/3891654213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5b4984420 con 0x55d5b4983190 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8db2ffd640 1 -- 172.21.15.102:0/3891654213 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec00981a0 con 0x55d5b4983190 2024-09-19T11:13:52.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.303+0000 7f8ecf620800 1 -- 172.21.15.102:0/3891654213 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b49849c0 con 0x55d5b4983190 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.304+0000 7f8db2ffd640 1 -- 172.21.15.102:0/3891654213 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8ec0058070 con 0x55d5b4983190 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.304+0000 7f8db2ffd640 1 --2- 172.21.15.102:0/3891654213 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8da403d000 0x7f8da403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.304+0000 7f8db2ffd640 1 -- 172.21.15.102:0/3891654213 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f8ec008e070 con 0x55d5b4983190 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.304+0000 7f8ec4909640 1 --2- 172.21.15.102:0/3891654213 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8da403d000 0x7f8da403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecf620800 1 Processor -- start 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecf620800 1 -- start start 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ec4909640 1 --2- 172.21.15.102:0/3891654213 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8da403d000 0x7f8da403f4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55d5b4975850 tx=0x7f8eb8006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecf620800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b498fe10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecf620800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5b495de70 con 0x55d5b498fa30 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b498fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b498fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42602/0 (socket says 172.21.15.102:42602) 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecd10a640 1 -- 172.21.15.102:0/2569005090 learned_addr learned my addr 172.21.15.102:0/2569005090 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecd10a640 1 -- 172.21.15.102:0/2569005090 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b4990400 con 0x55d5b498fa30 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.305+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/2569005090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b498fe10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ec006ef90 tx=0x7f8ec0078930 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4349cd5d376d3f80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8db0ff9640 1 -- 172.21.15.102:0/2569005090 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec009a0b0 con 0x55d5b498fa30 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8db0ff9640 1 -- 172.21.15.102:0/2569005090 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec0078610 con 0x55d5b498fa30 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8db0ff9640 1 -- 172.21.15.102:0/2569005090 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec00961c0 con 0x55d5b498fa30 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 -- 172.21.15.102:0/2569005090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 msgr2=0x55d5b498fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 --2- 172.21.15.102:0/2569005090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b498fe10 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x7f8ec006ef90 tx=0x7f8ec0078930 comp rx=0 tx=0).stop 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 -- 172.21.15.102:0/2569005090 shutdown_connections 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 --2- 172.21.15.102:0/2569005090 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b498fe10 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 -- 172.21.15.102:0/2569005090 >> 172.21.15.102:0/2569005090 conn(0x55d5b498be30 msgr2=0x55d5b498a070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 -- 172.21.15.102:0/2569005090 shutdown_connections 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 -- 172.21.15.102:0/2569005090 wait complete. 2024-09-19T11:13:52.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 Processor -- start 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 -- start start 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.306+0000 7f8ecf620800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b4996e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.307+0000 7f8ecf620800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d5b4990890 con 0x55d5b498fa30 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.307+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b4996e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.307+0000 7f8ecd10a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b4996e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42610/0 (socket says 172.21.15.102:42610) 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.307+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 learned_addr learned my addr 172.21.15.102:0/3040945308 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.307+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d5b49973d0 con 0x55d5b498fa30 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.307+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b4996e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8ec006ef90 tx=0x7f8ec0056f00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.308+0000 7f8da2ffd640 1 -- 172.21.15.102:0/3040945308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec00bd070 con 0x55d5b498fa30 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.308+0000 7f8da2ffd640 1 -- 172.21.15.102:0/3040945308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8ec00961c0 con 0x55d5b498fa30 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.308+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d5b49973d0 con 0x55d5b498fa30 2024-09-19T11:13:52.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.308+0000 7f8da2ffd640 1 -- 172.21.15.102:0/3040945308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8ec007aa40 con 0x55d5b498fa30 2024-09-19T11:13:52.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.308+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d5b49979d0 con 0x55d5b498fa30 2024-09-19T11:13:52.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8da2ffd640 1 -- 172.21.15.102:0/3040945308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8ec00c0070 con 0x55d5b498fa30 2024-09-19T11:13:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8da2ffd640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8d9803cfb0 0x7f8d9803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8da2ffd640 1 -- 172.21.15.102:0/3040945308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f8ec00b5070 con 0x55d5b498fa30 2024-09-19T11:13:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8ec4909640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8d9803cfb0 0x7f8d9803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b49a2410 0x55d5b49a48a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a4ff0 con 0x55d5b49a2410 2024-09-19T11:13:52.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8ecd90b640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b49a2410 0x55d5b49a48a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.309+0000 7f8ec4909640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8d9803cfb0 0x7f8d9803f470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800bf70 tx=0x7f8eb8011000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecd90b640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b49a2410 0x55d5b49a48a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 realm 2024-09-19T11:13:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a5400 con 0x55d5b49a2410 2024-09-19T11:13:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a5cd0 con 0x55d5b49a2410 2024-09-19T11:13:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b49a6b60 0x55d5b49a8f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.310+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a9690 con 0x55d5b49a6b60 2024-09-19T11:13:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.311+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b49a6b60 0x55d5b49a8f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.311+0000 7f8ecd10a640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b49a6b60 0x55d5b49a8f50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.311+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.311+0000 7f8ecf620800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.311+0000 7f8ecf620800 20 searching for the correct realm 2024-09-19T11:13:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.311+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b49ab730 0x55d5b49adbf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.311+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49ae2c0 con 0x55d5b49ab730 2024-09-19T11:13:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.311+0000 7f8ec4909640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b49ab730 0x55d5b49adbf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.312+0000 7f8ec4909640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b49ab730 0x55d5b49adbf0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.312+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.312+0000 7f8ec4909640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8eb80393c0 0x7f8eb80397e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.312+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49ae2c0 con 0x7f8eb80393c0 2024-09-19T11:13:52.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.312+0000 7f8ecd90b640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8eb80393c0 0x7f8eb80397e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.312+0000 7f8ecd90b640 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8eb80393c0 0x7f8eb80397e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.312+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.313+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.314+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.314+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x7f8eb80393c0 2024-09-19T11:13:52.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.314+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.314+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49ab730 2024-09-19T11:13:52.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.314+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.314+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.314+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.314+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.315+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.315+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.315+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.315+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x7f8eb80393c0 2024-09-19T11:13:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.315+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.315+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49ab730 2024-09-19T11:13:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.315+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.315+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49ab730 2024-09-19T11:13:52.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49ab730 2024-09-19T11:13:52.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49ab730 2024-09-19T11:13:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.316+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.317+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.317+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.317+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.317+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49ab730 2024-09-19T11:13:52.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.317+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.317+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x7f8eb80393c0 2024-09-19T11:13:52.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.317+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.317+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.318+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.318+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.318+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.318+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49ab730 2024-09-19T11:13:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.318+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.318+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.318+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.318+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x7f8eb80393c0 2024-09-19T11:13:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.319+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.319+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49ab730 2024-09-19T11:13:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.319+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8eb8036040 con 0x55d5b49ab730 2024-09-19T11:13:52.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.319+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a6b60 2024-09-19T11:13:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.319+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.319+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x55d5b49a2410 2024-09-19T11:13:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.319+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49a6070 con 0x7f8eb80393c0 2024-09-19T11:13:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49aa030 con 0x55d5b49a2410 2024-09-19T11:13:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49aa030 con 0x55d5b49a2410 2024-09-19T11:13:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.320+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49aa030 con 0x55d5b49ab730 2024-09-19T11:13:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8eb80481c0 con 0x55d5b49ab730 2024-09-19T11:13:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 zone default found 2024-09-19T11:13:52.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 4 Realm: () 2024-09-19T11:13:52.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:52.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:52.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:52.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 zonegroup default 2024-09-19T11:13:52.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49aa8d0 con 0x55d5b49a6b60 2024-09-19T11:13:52.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b0130 con 0x55d5b49ab730 2024-09-19T11:13:52.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8eb80481c0 con 0x55d5b49ab730 2024-09-19T11:13:52.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b0500 con 0x55d5b49ab730 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8eb80481c0 con 0x55d5b49ab730 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 started sync module instance, tier type = 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.321+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49af5d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.322+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.322+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94376346450640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49af5d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.322+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b0f60 con 0x55d5b49a2410 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.323+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94376346450640] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.324+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.324+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94376346455184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49af5d0 con 0x55d5b49a2410 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.324+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b19d0 con 0x55d5b49ab730 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.325+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94376346455184] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.325+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb80481c0 con 0x55d5b49ab730 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.325+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94376346448160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49af540 con 0x55d5b49ab730 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.325+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b2890 con 0x7f8eb80393c0 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.326+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94376346448160] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb80481c0 con 0x55d5b49ab730 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.326+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.326+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94376346461152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b2cb0 con 0x7f8eb80393c0 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.326+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b3670 con 0x55d5b49a2410 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.327+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.327+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94376346464704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b3a90 con 0x55d5b49a2410 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.327+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b4530 con 0x55d5b49a6b60 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.327+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94376346461152] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.328+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.328+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94376346464704] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.328+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94376346468352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b4920 con 0x55d5b49a6b60 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.328+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b4e30 con 0x55d5b49a6b60 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.329+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.329+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94376346471984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b5700 con 0x55d5b49a6b60 2024-09-19T11:13:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.329+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b6100 con 0x55d5b49a6b60 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.329+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94376346468352] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'30 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94376346471984] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94376346462208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b5c10 con 0x55d5b49a6b60 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecf620800 20 add_watcher() i=0 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecf620800 20 add_watcher() i=1 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecf620800 20 add_watcher() i=2 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecf620800 20 add_watcher() i=3 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecf620800 20 add_watcher() i=4 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecf620800 20 add_watcher() i=5 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.330+0000 7f8ecf620800 20 add_watcher() i=6 2024-09-19T11:13:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.331+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94376346462208] v35'31 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.331+0000 7f8ecf620800 20 add_watcher() i=7 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.331+0000 7f8ecf620800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.331+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b90f0 con 0x55d5b49a2410 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.332+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.332+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94376346475536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b6510 con 0x55d5b49a2410 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94376346475536] v35'54 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8d837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8ecf620800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8ecf620800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8ecf620800 5 note: GC not initialized 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8d827e4640 20 reqs_thread_entry: start 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8ecf620800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8ecf620800 20 Filter name: none 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8cf3fff640 20 reqs_thread_entry: start 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8ecf620800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.333+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49eba20 con 0x55d5b49a2410 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.334+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.334+0000 7f8ecf620800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:52.371 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.334+0000 7f8d837e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.334+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94376346475536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b499f830 con 0x55d5b49a2410 2024-09-19T11:13:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.335+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94376346475536] v35'55 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.335+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94376346450640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b5c10 con 0x7f8eb80393c0 2024-09-19T11:13:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.336+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94376346450640] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.336+0000 7f8ecf620800 20 remove_watcher() i=0 2024-09-19T11:13:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.336+0000 7f8ecf620800 2 removed watcher, disabling cache 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.336+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94376346455184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b5c10 con 0x55d5b49a2410 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.337+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94376346455184] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.338+0000 7f8ecf620800 20 remove_watcher() i=1 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.338+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94376346448160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b5c10 con 0x55d5b49ab730 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.338+0000 7f8ec4909640 1 -- 172.21.15.102:0/3040945308 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94376346448160] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8eb80481c0 con 0x55d5b49ab730 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.339+0000 7f8ecf620800 20 remove_watcher() i=2 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.339+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94376346461152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49af120 con 0x7f8eb80393c0 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.339+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94376346461152] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x7f8eb80393c0 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.339+0000 7f8ecf620800 20 remove_watcher() i=3 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.339+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94376346464704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b5c10 con 0x55d5b49a2410 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.340+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94376346464704] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec800a4d0 con 0x55d5b49a2410 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.340+0000 7f8ecf620800 20 remove_watcher() i=4 2024-09-19T11:13:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.340+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94376346468352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b23e0 con 0x55d5b49a6b60 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.341+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94376346468352] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.341+0000 7f8ecf620800 20 remove_watcher() i=5 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.341+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94376346471984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49af120 con 0x55d5b49a6b60 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.342+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94376346471984] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.342+0000 7f8ecf620800 20 remove_watcher() i=6 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.342+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94376346462208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d5b49b31c0 con 0x55d5b49a6b60 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecd10a640 1 -- 172.21.15.102:0/3040945308 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94376346462208] v35'32 uv30 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ec00bf030 con 0x55d5b49a6b60 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 20 remove_watcher() i=7 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b49a6b60 msgr2=0x55d5b49a8f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b49a6b60 0x55d5b49a8f50 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b49a2410 msgr2=0x55d5b49a48a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b49a2410 0x55d5b49a48a0 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8eb80393c0 msgr2=0x7f8eb80397e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8eb80393c0 0x7f8eb80397e0 crc :-1 s=READY pgs=19 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b49ab730 msgr2=0x55d5b49adbf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b49ab730 0x55d5b49adbf0 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8d9803cfb0 msgr2=0x7f8d9803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8d9803cfb0 0x7f8d9803f470 secure :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0x7f8eb800bf70 tx=0x7f8eb8011000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 msgr2=0x55d5b4996e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3040945308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b498fa30 0x55d5b4996e70 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x7f8ec006ef90 tx=0x7f8ec0056f00 comp rx=0 tx=0).stop 2024-09-19T11:13:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.343+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 reap_dead start 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecd90b640 1 -- 172.21.15.102:0/3040945308 reap_dead start 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 shutdown_connections 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 >> 172.21.15.102:0/3040945308 conn(0x55d5b498be30 msgr2=0x55d5b498a040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 shutdown_connections 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3040945308 wait complete. 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3891654213 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8da403d000 msgr2=0x7f8da403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3891654213 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8da403d000 0x7f8da403f4c0 secure :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0x55d5b4975850 tx=0x7f8eb8006000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3891654213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4983190 msgr2=0x55d5b49835b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3891654213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4983190 0x55d5b49835b0 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0096e20 tx=0x7f8ec00507b0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3891654213 shutdown_connections 2024-09-19T11:13:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3891654213 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8da403d000 0x7f8da403f4c0 unknown :-1 s=CLOSED pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/3891654213 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4983190 0x55d5b49835b0 unknown :-1 s=CLOSED pgs=224 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3891654213 >> 172.21.15.102:0/3891654213 conn(0x55d5b4977540 msgr2=0x55d5b4977920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3891654213 shutdown_connections 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/3891654213 wait complete. 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b496e8b0 msgr2=0x55d5b4970d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d5b496e8b0 0x55d5b4970d30 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b486a6a0 msgr2=0x55d5b496c4d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d5b486a6a0 0x55d5b496c4d0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b4972920 msgr2=0x55d5b4974d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d5b4972920 0x55d5b4974d10 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8db403d000 msgr2=0x7f8db403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8db403d000 0x7f8db403f4c0 secure :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0x7f8eb8001e50 tx=0x7f8eb80013d0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 msgr2=0x55d5b4964e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecf620800 1 --2- 172.21.15.102:0/944098999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d5b4869d60 0x55d5b4964e80 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x7f8ec0067040 tx=0x7f8ec0002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.344+0000 7f8ecd90b640 1 -- 172.21.15.102:0/944098999 reap_dead start 2024-09-19T11:13:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.345+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 shutdown_connections 2024-09-19T11:13:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.345+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 >> 172.21.15.102:0/944098999 conn(0x55d5b4865a90 msgr2=0x55d5b495e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.345+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 shutdown_connections 2024-09-19T11:13:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.345+0000 7f8ecf620800 1 -- 172.21.15.102:0/944098999 wait complete. 2024-09-19T11:13:52.383 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:52.383 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-19T11:13:52.383 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-19T11:13:52.384 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-19T11:13:52.430 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:52.430 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:52.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a7932c800 1 Processor -- start 2024-09-19T11:13:52.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a7932c800 1 -- start start 2024-09-19T11:13:52.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a7932c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a82fc69f30 0x55a82fc6c320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a7932c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a82fc705e0 con 0x55a82fc6c8c0 2024-09-19T11:13:52.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a7932c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55a82faf47d0 con 0x55a82fc69f30 2024-09-19T11:13:52.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a7504f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a82fc69f30 0x55a82fc6c320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a7504f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a82fc69f30 0x55a82fc6c320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42620/0 (socket says 172.21.15.102:42620) 2024-09-19T11:13:52.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a6ffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55a82fc6c8c0 0x55a82fc6ed80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52248/0 (socket says 172.21.15.102:52248) 2024-09-19T11:13:52.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.428+0000 7f0a7504f640 1 -- 172.21.15.102:0/1777280842 learned_addr learned my addr 172.21.15.102:0/1777280842 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.429+0000 7f0a7504f640 1 -- 172.21.15.102:0/1777280842 >> v1:172.21.15.37:6789/0 conn(0x55a82fc6c8c0 legacy=0x55a82fc6ed80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.429+0000 7f0a7504f640 1 -- 172.21.15.102:0/1777280842 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82fc71810 con 0x55a82fc69f30 2024-09-19T11:13:52.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.430+0000 7f0a7504f640 1 --2- 172.21.15.102:0/1777280842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc6c320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800a520 tx=0x7f0a68045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b5a2375f033c65f6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.430+0000 7f0a7484e640 1 -- 172.21.15.102:0/1777280842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68055070 con 0x55a82fc69f30 2024-09-19T11:13:52.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.430+0000 7f0a7484e640 1 -- 172.21.15.102:0/1777280842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a680515b0 con 0x55a82fc69f30 2024-09-19T11:13:52.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.431+0000 7f0a7484e640 1 -- 172.21.15.102:0/1777280842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a680518d0 con 0x55a82fc69f30 2024-09-19T11:13:52.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.431+0000 7f0a7932c800 1 -- 172.21.15.102:0/1777280842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 msgr2=0x55a82fc6c320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.431+0000 7f0a7932c800 1 --2- 172.21.15.102:0/1777280842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc6c320 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x7f0a6800a520 tx=0x7f0a68045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.431+0000 7f0a7932c800 1 -- 172.21.15.102:0/1777280842 shutdown_connections 2024-09-19T11:13:52.433 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.431+0000 7f0a7932c800 1 --2- 172.21.15.102:0/1777280842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc6c320 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.431+0000 7f0a7932c800 1 -- 172.21.15.102:0/1777280842 >> 172.21.15.102:0/1777280842 conn(0x55a82fc63a90 msgr2=0x55a82fc65ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.431+0000 7f0a7932c800 1 -- 172.21.15.102:0/1777280842 shutdown_connections 2024-09-19T11:13:52.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.431+0000 7f0a7932c800 1 -- 172.21.15.102:0/1777280842 wait complete. 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.445+0000 7f0a7932c800 1 Processor -- start 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.445+0000 7f0a7932c800 1 -- start start 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.445+0000 7f0a7932c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc696a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.445+0000 7f0a7932c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a82fb01dd0 con 0x55a82fc69f30 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.445+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc696a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.445+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc696a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42628/0 (socket says 172.21.15.102:42628) 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.445+0000 7f0a7504f640 1 -- 172.21.15.102:0/4163565776 learned_addr learned my addr 172.21.15.102:0/4163565776 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.445+0000 7f0a7504f640 1 -- 172.21.15.102:0/4163565776 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82fc69c90 con 0x55a82fc69f30 2024-09-19T11:13:52.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0a7504f640 1 --2- 172.21.15.102:0/4163565776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc696a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a68025da0 tx=0x7f0a68051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c26ecef4ebc102 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0963606640 1 -- 172.21.15.102:0/4163565776 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68051950 con 0x55a82fc69f30 2024-09-19T11:13:52.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0963606640 1 -- 172.21.15.102:0/4163565776 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a68051af0 con 0x55a82fc69f30 2024-09-19T11:13:52.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0963606640 1 -- 172.21.15.102:0/4163565776 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68051dd0 con 0x55a82fc69f30 2024-09-19T11:13:52.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0a7932c800 1 -- 172.21.15.102:0/4163565776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 msgr2=0x55a82fc696a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0a7932c800 1 --2- 172.21.15.102:0/4163565776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc696a0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7f0a68025da0 tx=0x7f0a68051000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0a7932c800 1 -- 172.21.15.102:0/4163565776 shutdown_connections 2024-09-19T11:13:52.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0a7932c800 1 --2- 172.21.15.102:0/4163565776 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fc696a0 unknown :-1 s=CLOSED pgs=229 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.446+0000 7f0a7932c800 1 -- 172.21.15.102:0/4163565776 >> 172.21.15.102:0/4163565776 conn(0x55a82fc63a90 msgr2=0x55a82fd54c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7932c800 1 -- 172.21.15.102:0/4163565776 shutdown_connections 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7932c800 1 -- 172.21.15.102:0/4163565776 wait complete. 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7932c800 1 Processor -- start 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7932c800 1 -- start start 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7932c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fd62e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7932c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a82fc70ab0 con 0x55a82fc69f30 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fd62e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fd62e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42642/0 (socket says 172.21.15.102:42642) 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7504f640 1 -- 172.21.15.102:0/3505277982 learned_addr learned my addr 172.21.15.102:0/3505277982 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.447+0000 7f0a7504f640 1 -- 172.21.15.102:0/3505277982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82fd633c0 con 0x55a82fc69f30 2024-09-19T11:13:52.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.448+0000 7f0a7504f640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fd62e60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a68067040 tx=0x7f0a68002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.448+0000 7f0961e03640 1 -- 172.21.15.102:0/3505277982 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68073070 con 0x55a82fc69f30 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.448+0000 7f0961e03640 1 -- 172.21.15.102:0/3505277982 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6805a450 con 0x55a82fc69f30 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.448+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a82fd63650 con 0x55a82fc69f30 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.448+0000 7f0961e03640 1 -- 172.21.15.102:0/3505277982 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a6805a730 con 0x55a82fc69f30 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.448+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a82fd64260 con 0x55a82fc69f30 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.449+0000 7f0961e03640 1 -- 172.21.15.102:0/3505277982 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0a68076070 con 0x55a82fc69f30 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.449+0000 7f0961e03640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f095c03cfb0 0x7f095c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.449+0000 7f0961e03640 1 -- 172.21.15.102:0/3505277982 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f0a68062070 con 0x55a82fc69f30 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.449+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f095c03cfb0 0x7f095c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.449+0000 7f0a7932c800 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fc6c8c0 0x55a82fd6a4b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.449+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fd6a9f0 con 0x55a82fc6c8c0 2024-09-19T11:13:52.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.449+0000 7f0a75850640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fc6c8c0 0x55a82fd6a4b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.449+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f095c03cfb0 0x7f095c03f470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a60001e30 tx=0x7f0a60001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.450+0000 7f0a75850640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fc6c8c0 0x55a82fd6a4b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.450+0000 7f0a75850640 1 -- 172.21.15.102:0/3505277982 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fc6c8c0 2024-09-19T11:13:52.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.450+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fd6ad90 con 0x55a82fc6c8c0 2024-09-19T11:13:52.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.450+0000 7f0a75850640 1 -- 172.21.15.102:0/3505277982 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fc6c8c0 2024-09-19T11:13:52.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.450+0000 7f0a7932c800 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fd6c850 0x55a82fd6ecf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.450+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fd6f480 con 0x55a82fd6c850 2024-09-19T11:13:52.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.450+0000 7f0a7504f640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fd6c850 0x55a82fd6ecf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.451+0000 7f0a7504f640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fd6c850 0x55a82fd6ecf0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.451+0000 7f0a7504f640 1 -- 172.21.15.102:0/3505277982 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0a6807f070 con 0x55a82fd6c850 2024-09-19T11:13:52.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.451+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fd6b5e0 con 0x55a82fc6c8c0 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.451+0000 7f0a75850640 1 -- 172.21.15.102:0/3505277982 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fc6c8c0 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.451+0000 7f0a7932c800 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fd708e0 0x55a82fd72cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.451+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fd73410 con 0x55a82fd708e0 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.451+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fd708e0 0x55a82fd72cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.452+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fd708e0 0x55a82fd72cd0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.452+0000 7f0a6ffff640 1 -- 172.21.15.102:0/3505277982 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0a6000bd50 con 0x55a82fd708e0 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.452+0000 7f0a7932c800 1 Processor -- start 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.452+0000 7f0a7932c800 1 -- start start 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.452+0000 7f0a7932c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd81190 0x55a82fd815b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.452+0000 7f0a7932c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a82fb604a0 con 0x55a82fd81190 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd81190 0x55a82fd815b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd81190 0x55a82fd815b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42658/0 (socket says 172.21.15.102:42658) 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f0a7504f640 1 -- 172.21.15.102:0/1418643455 learned_addr learned my addr 172.21.15.102:0/1418643455 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f0a7504f640 1 -- 172.21.15.102:0/1418643455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82fd81bf0 con 0x55a82fd81190 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f0a7504f640 1 --2- 172.21.15.102:0/1418643455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd81190 0x55a82fd815b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a68050e30 tx=0x7f0a680507b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f095affd640 1 -- 172.21.15.102:0/1418643455 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a6807d040 con 0x55a82fd81190 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f095affd640 1 -- 172.21.15.102:0/1418643455 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a68098af0 con 0x55a82fd81190 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f0a7932c800 1 -- 172.21.15.102:0/1418643455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a82fd82420 con 0x55a82fd81190 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f095affd640 1 -- 172.21.15.102:0/1418643455 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68098dd0 con 0x55a82fd81190 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.453+0000 7f0a7932c800 1 -- 172.21.15.102:0/1418643455 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a82fd829c0 con 0x55a82fd81190 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.454+0000 7f095affd640 1 -- 172.21.15.102:0/1418643455 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0a68058070 con 0x55a82fd81190 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.454+0000 7f095affd640 1 --2- 172.21.15.102:0/1418643455 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094c03cfb0 0x7f094c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.454+0000 7f095affd640 1 -- 172.21.15.102:0/1418643455 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f0a680a2c50 con 0x55a82fd81190 2024-09-19T11:13:52.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.454+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/1418643455 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094c03cfb0 0x7f094c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.454+0000 7f0a7932c800 1 Processor -- start 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a7932c800 1 -- start start 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/1418643455 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094c03cfb0 0x7f094c03f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55a82fd6f850 tx=0x7f0a6000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a7932c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd8deb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a7932c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a82fc68020 con 0x55a82fd8dab0 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd8deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd8deb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42674/0 (socket says 172.21.15.102:42674) 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a7504f640 1 -- 172.21.15.102:0/2971987402 learned_addr learned my addr 172.21.15.102:0/2971987402 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a7504f640 1 -- 172.21.15.102:0/2971987402 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82fd8e4a0 con 0x55a82fd8dab0 2024-09-19T11:13:52.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0a7504f640 1 --2- 172.21.15.102:0/2971987402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd8deb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a6806edd0 tx=0x7f0a68098270 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2289035918522973 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0958ff9640 1 -- 172.21.15.102:0/2971987402 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68066030 con 0x55a82fd8dab0 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0958ff9640 1 -- 172.21.15.102:0/2971987402 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a680af070 con 0x55a82fd8dab0 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.455+0000 7f0958ff9640 1 -- 172.21.15.102:0/2971987402 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a6808f080 con 0x55a82fd8dab0 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 -- 172.21.15.102:0/2971987402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 msgr2=0x55a82fd8deb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 --2- 172.21.15.102:0/2971987402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd8deb0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x7f0a6806edd0 tx=0x7f0a68098270 comp rx=0 tx=0).stop 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 -- 172.21.15.102:0/2971987402 shutdown_connections 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 --2- 172.21.15.102:0/2971987402 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd8deb0 unknown :-1 s=CLOSED pgs=232 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 -- 172.21.15.102:0/2971987402 >> 172.21.15.102:0/2971987402 conn(0x55a82fd89eb0 msgr2=0x55a82fd880f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 -- 172.21.15.102:0/2971987402 shutdown_connections 2024-09-19T11:13:52.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 -- 172.21.15.102:0/2971987402 wait complete. 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 Processor -- start 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 -- start start 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd94eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.456+0000 7f0a7932c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a82fd8e910 con 0x55a82fd8dab0 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd94eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f0a7504f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd94eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42690/0 (socket says 172.21.15.102:42690) 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 learned_addr learned my addr 172.21.15.102:0/340488878 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a82fd95410 con 0x55a82fd8dab0 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f0a7504f640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd94eb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a68088010 tx=0x7f0a68087f60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f094affd640 1 -- 172.21.15.102:0/340488878 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a6808f080 con 0x55a82fd8dab0 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f094affd640 1 -- 172.21.15.102:0/340488878 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0a6806eaa0 con 0x55a82fd8dab0 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a82fd95410 con 0x55a82fd8dab0 2024-09-19T11:13:52.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f094affd640 1 -- 172.21.15.102:0/340488878 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0a68066030 con 0x55a82fd8dab0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.457+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a82fd95410 con 0x55a82fd8dab0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.458+0000 7f094affd640 1 -- 172.21.15.102:0/340488878 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0a6804f070 con 0x55a82fd8dab0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.458+0000 7f094affd640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094003d000 0x7f094003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.458+0000 7f094affd640 1 -- 172.21.15.102:0/340488878 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f0a680a7040 con 0x55a82fd8dab0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.458+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094003d000 0x7f094003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094003d000 0x7f094003f4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55a82fd73810 tx=0x7f0a60010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fda0370 0x55a82fda2830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda2f80 con 0x55a82fda0370 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a75850640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fda0370 0x55a82fda2830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a75850640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fda0370 0x55a82fda2830 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a7932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a7932c800 20 realm 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.459+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda3390 con 0x55a82fda0370 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda3c60 con 0x55a82fda0370 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fda4d60 0x55a82fda7150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda7710 con 0x55a82fda4d60 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7504f640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fda4d60 0x55a82fda7150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.460+0000 7f0a7504f640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fda4d60 0x55a82fda7150 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a7932c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a7932c800 20 searching for the correct realm 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fda96c0 0x55a82fdabb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdac250 con 0x55a82fda96c0 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fda96c0 0x55a82fdabb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fda96c0 0x55a82fdabb80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a60037040 con 0x55a82fda96c0 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a6ffff640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0a6000f070 0x7f0a6002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.461+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdac250 con 0x7f0a6000f070 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.462+0000 7f0a75850640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0a6000f070 0x7f0a6002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.462+0000 7f0a75850640 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0a6000f070 0x7f0a6002e910 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.462+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.462+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.462+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.462+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.463+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.463+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.463+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.463+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.463+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.463+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.464+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.464+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x7f0a6000f070 2024-09-19T11:13:52.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.464+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.464+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda96c0 2024-09-19T11:13:52.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.464+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a60037040 con 0x55a82fda96c0 2024-09-19T11:13:52.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.464+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.464+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.464+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x7f0a6000f070 2024-09-19T11:13:52.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda96c0 2024-09-19T11:13:52.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a60037040 con 0x55a82fda96c0 2024-09-19T11:13:52.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda96c0 2024-09-19T11:13:52.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0a60037040 con 0x55a82fda96c0 2024-09-19T11:13:52.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.465+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.466+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.466+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda96c0 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.466+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a60037040 con 0x55a82fda96c0 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.466+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda96c0 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.466+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a60037040 con 0x55a82fda96c0 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.466+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.466+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.466+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.467+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.467+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.467+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.467+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda96c0 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.467+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a60037040 con 0x55a82fda96c0 2024-09-19T11:13:52.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.467+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x7f0a6000f070 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.467+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.467+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.468+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.468+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.468+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.468+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda96c0 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.468+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a60037040 con 0x55a82fda96c0 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.468+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.469+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.469+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x7f0a6000f070 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.469+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.469+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda96c0 2024-09-19T11:13:52.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.469+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6004a040 con 0x55a82fda96c0 2024-09-19T11:13:52.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.469+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda4d60 2024-09-19T11:13:52.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.469+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.469+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x55a82fda0370 2024-09-19T11:13:52.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda4000 con 0x7f0a6000f070 2024-09-19T11:13:52.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda7fd0 con 0x55a82fda0370 2024-09-19T11:13:52.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda7fd0 con 0x55a82fda0370 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda7fd0 con 0x55a82fda96c0 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0a6004a040 con 0x55a82fda96c0 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 zone default found 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 4 Realm: () 2024-09-19T11:13:52.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 zonegroup default 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.470+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fda8920 con 0x55a82fda4d60 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdae250 con 0x55a82fda96c0 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a6004a040 con 0x55a82fda96c0 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdae720 con 0x55a82fda96c0 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0a6004a040 con 0x55a82fda96c0 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 20 started sync module instance, tier type = 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.471+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdad560 con 0x7f0a6000f070 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.472+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.472+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94180845738592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdad560 con 0x7f0a6000f070 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.472+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdaf1a0 con 0x55a82fda0370 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.473+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94180845738592] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.473+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.473+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94180845743824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdad560 con 0x55a82fda0370 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.473+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdafbf0 con 0x55a82fda96c0 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.474+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94180845743824] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.475+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6004a040 con 0x55a82fda96c0 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.475+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94180845736112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdad4d0 con 0x55a82fda96c0 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.475+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb0ae0 con 0x7f0a6000f070 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.476+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94180845736112] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6004a040 con 0x55a82fda96c0 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.476+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.476+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94180845749808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb0f00 con 0x7f0a6000f070 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.476+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb18c0 con 0x55a82fda0370 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.479+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.479+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94180845753360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb1ce0 con 0x55a82fda0370 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.479+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb2780 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.479+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94180845749808] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.481+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94180845753360] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.482+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.482+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94180845750864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb1ce0 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.482+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb3020 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.483+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94180845750864] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.483+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.483+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94180845754416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb3870 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.483+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb4120 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94180845754416] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94180845763600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb43c0 con 0x55a82fda4d60 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7932c800 20 add_watcher() i=0 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7932c800 20 add_watcher() i=1 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7932c800 20 add_watcher() i=2 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7932c800 20 add_watcher() i=3 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7932c800 20 add_watcher() i=4 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7932c800 20 add_watcher() i=5 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.484+0000 7f0a7932c800 20 add_watcher() i=6 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.485+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94180845763600] v35'34 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.485+0000 7f0a7932c800 20 add_watcher() i=7 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.485+0000 7f0a7932c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:52.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.485+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb7900 con 0x55a82fda0370 2024-09-19T11:13:52.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.485+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.485+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94180845761472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb4e50 con 0x55a82fda0370 2024-09-19T11:13:52.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94180845761472] v35'56 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f092b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a7932c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:52.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a7932c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:52.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a7932c800 5 note: GC not initialized 2024-09-19T11:13:52.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f092a7e4640 20 reqs_thread_entry: start 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a7932c800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a7932c800 20 Filter name: none 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f089bfff640 20 reqs_thread_entry: start 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a7932c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a7932c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.488+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdea740 con 0x55a82fda0370 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.489+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.489+0000 7f0a7932c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.489+0000 7f0a7932c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.489+0000 7f0a7932c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.489+0000 7f0a7932c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:52.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.489+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fded070 con 0x7f0a6000f070 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.489+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.489+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdf0720 con 0x55a82fda0370 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.490+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v35'2 uv2 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.490+0000 7f0a7932c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.490+0000 7f0a7932c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.490+0000 7f0a7932c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.490+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94180846010688 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdec060 con 0x55a82fda0370 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.491+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94180845753360 notify 150323855361 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f0a70018d90 con 0x55a82fda0370 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.491+0000 7f0958ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 94180845753360 notifier 4323 bl.length()=567 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.491+0000 7f0958ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.491+0000 7f0958ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.491+0000 7f0958ff9640 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0938003ea0 con 0x55a82fda0370 2024-09-19T11:13:52.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.491+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(65 notify.4 [notify cookie 94180846010688 out=8b] v0'0 uv33 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.491+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.491+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94180846010688 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0a70040040 con 0x55a82fda0370 2024-09-19T11:13:52.507 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:52.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.492+0000 7f092b7e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.492+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94180845761472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fde85a0 con 0x55a82fda0370 2024-09-19T11:13:52.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.493+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94180845761472] v35'57 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.493+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94180845738592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fde85a0 con 0x7f0a6000f070 2024-09-19T11:13:52.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.496+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94180845738592] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.496+0000 7f0a7932c800 20 remove_watcher() i=0 2024-09-19T11:13:52.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.496+0000 7f0a7932c800 2 removed watcher, disabling cache 2024-09-19T11:13:52.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.496+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94180845743824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fde85a0 con 0x55a82fda0370 2024-09-19T11:13:52.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.497+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94180845743824] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.497+0000 7f0a7932c800 20 remove_watcher() i=1 2024-09-19T11:13:52.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.497+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94180845736112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fde85a0 con 0x55a82fda96c0 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.498+0000 7f0a6ffff640 1 -- 172.21.15.102:0/340488878 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94180845736112] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6004a040 con 0x55a82fda96c0 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.498+0000 7f0a7932c800 20 remove_watcher() i=2 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.498+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94180845749808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdaeed0 con 0x7f0a6000f070 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.499+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94180845749808] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x7f0a6000f070 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.499+0000 7f0a7932c800 20 remove_watcher() i=3 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.499+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94180845753360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdad0b0 con 0x55a82fda0370 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.500+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94180845753360] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a7000a4d0 con 0x55a82fda0370 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.500+0000 7f0a7932c800 20 remove_watcher() i=4 2024-09-19T11:13:52.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.500+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94180845750864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdb0630 con 0x55a82fda4d60 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.501+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94180845750864] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.501+0000 7f0a7932c800 20 remove_watcher() i=5 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.501+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94180845754416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdaeed0 con 0x55a82fda4d60 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.503+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94180845754416] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.503+0000 7f0a7932c800 20 remove_watcher() i=6 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.503+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94180845763600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a82fdad0b0 con 0x55a82fda4d60 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.504+0000 7f0a7504f640 1 -- 172.21.15.102:0/340488878 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94180845763600] v35'35 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0a6809e020 con 0x55a82fda4d60 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 20 remove_watcher() i=7 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fda4d60 msgr2=0x55a82fda7150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fda4d60 0x55a82fda7150 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fda0370 msgr2=0x55a82fda2830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fda0370 0x55a82fda2830 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0a6000f070 msgr2=0x7f0a6002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0a6000f070 0x7f0a6002e910 crc :-1 s=READY pgs=20 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fda96c0 msgr2=0x55a82fdabb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fda96c0 0x55a82fdabb80 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094003d000 msgr2=0x7f094003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094003d000 0x7f094003f4c0 secure :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0x55a82fd73810 tx=0x7f0a60010000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a75850640 1 -- 172.21.15.102:0/340488878 reap_dead start 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 msgr2=0x55a82fd94eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd94eb0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f0a68088010 tx=0x7f0a68087f60 comp rx=0 tx=0).stop 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 shutdown_connections 2024-09-19T11:13:52.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/340488878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd8dab0 0x55a82fd94eb0 unknown :-1 s=CLOSED pgs=233 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 >> 172.21.15.102:0/340488878 conn(0x55a82fd89eb0 msgr2=0x55a82fd880c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 shutdown_connections 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/340488878 wait complete. 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/1418643455 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094c03cfb0 msgr2=0x7f094c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/1418643455 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094c03cfb0 0x7f094c03f470 secure :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0x55a82fd6f850 tx=0x7f0a6000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/1418643455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd81190 msgr2=0x55a82fd815b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/1418643455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd81190 0x55a82fd815b0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7f0a68050e30 tx=0x7f0a680507b0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/1418643455 shutdown_connections 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/1418643455 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f094c03cfb0 0x7f094c03f470 unknown :-1 s=CLOSED pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 --2- 172.21.15.102:0/1418643455 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fd81190 0x55a82fd815b0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/1418643455 >> 172.21.15.102:0/1418643455 conn(0x55a82fd75540 msgr2=0x55a82fd75920 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/1418643455 shutdown_connections 2024-09-19T11:13:52.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.505+0000 7f0a7932c800 1 -- 172.21.15.102:0/1418643455 wait complete. 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fd6c850 msgr2=0x55a82fd6ecf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a82fd6c850 0x55a82fd6ecf0 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fc6c8c0 msgr2=0x55a82fd6a4b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a82fc6c8c0 0x55a82fd6a4b0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fd708e0 msgr2=0x55a82fd72cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a82fd708e0 0x55a82fd72cd0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f095c03cfb0 msgr2=0x7f095c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f095c03cfb0 0x7f095c03f470 secure :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0x7f0a60001e30 tx=0x7f0a60001390 comp rx=0 tx=0).stop 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 msgr2=0x55a82fd62e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 --2- 172.21.15.102:0/3505277982 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a82fc69f30 0x55a82fd62e60 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7f0a68067040 tx=0x7f0a68002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a75850640 1 -- 172.21.15.102:0/3505277982 reap_dead start 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 shutdown_connections 2024-09-19T11:13:52.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 >> 172.21.15.102:0/3505277982 conn(0x55a82fc63a90 msgr2=0x55a82fd547e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 shutdown_connections 2024-09-19T11:13:52.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.506+0000 7f0a7932c800 1 -- 172.21.15.102:0/3505277982 wait complete. 2024-09-19T11:13:52.520 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:52.520 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:13:52.520 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:13:52.520 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:13:52.565 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:52.565 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:52.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.564+0000 7f7294142800 1 Processor -- start 2024-09-19T11:13:52.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.564+0000 7f7294142800 1 -- start start 2024-09-19T11:13:52.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f7294142800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e6c25b2530 0x55e6c2646390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f7294142800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e6c26468d0 con 0x55e6c25b1a20 2024-09-19T11:13:52.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f7294142800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55e6c24c87d0 con 0x55e6c25b2530 2024-09-19T11:13:52.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f728f685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e6c25b2530 0x55e6c2646390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f728f685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e6c25b2530 0x55e6c2646390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42698/0 (socket says 172.21.15.102:42698) 2024-09-19T11:13:52.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f728fe86640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55e6c25b1a20 0x55e6c25b1e20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52260/0 (socket says 172.21.15.102:52260) 2024-09-19T11:13:52.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f728f685640 1 -- 172.21.15.102:0/1799276495 learned_addr learned my addr 172.21.15.102:0/1799276495 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f728f685640 1 -- 172.21.15.102:0/1799276495 >> v1:172.21.15.37:6789/0 conn(0x55e6c25b1a20 legacy=0x55e6c25b1e20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.565+0000 7f728f685640 1 -- 172.21.15.102:0/1799276495 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c2647ab0 con 0x55e6c25b2530 2024-09-19T11:13:52.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.567+0000 7f728f685640 1 --2- 172.21.15.102:0/1799276495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b2530 0x55e6c2646390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f727800a520 tx=0x7f7278045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16f37989b9931916 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.567+0000 7f728ee84640 1 -- 172.21.15.102:0/1799276495 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7278055070 con 0x55e6c25b2530 2024-09-19T11:13:52.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.567+0000 7f728ee84640 1 -- 172.21.15.102:0/1799276495 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72780515b0 con 0x55e6c25b2530 2024-09-19T11:13:52.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.567+0000 7f728ee84640 1 -- 172.21.15.102:0/1799276495 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72780518d0 con 0x55e6c25b2530 2024-09-19T11:13:52.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.568+0000 7f7294142800 1 -- 172.21.15.102:0/1799276495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b2530 msgr2=0x55e6c2646390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.568+0000 7f7294142800 1 --2- 172.21.15.102:0/1799276495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b2530 0x55e6c2646390 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x7f727800a520 tx=0x7f7278045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.568+0000 7f7294142800 1 -- 172.21.15.102:0/1799276495 shutdown_connections 2024-09-19T11:13:52.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.568+0000 7f7294142800 1 --2- 172.21.15.102:0/1799276495 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b2530 0x55e6c2646390 unknown :-1 s=CLOSED pgs=235 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.568+0000 7f7294142800 1 -- 172.21.15.102:0/1799276495 >> 172.21.15.102:0/1799276495 conn(0x55e6c2638c60 msgr2=0x55e6c263b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.568+0000 7f7294142800 1 -- 172.21.15.102:0/1799276495 shutdown_connections 2024-09-19T11:13:52.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.568+0000 7f7294142800 1 -- 172.21.15.102:0/1799276495 wait complete. 2024-09-19T11:13:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.581+0000 7f7294142800 1 Processor -- start 2024-09-19T11:13:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.581+0000 7f7294142800 1 -- start start 2024-09-19T11:13:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.582+0000 7f7294142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c272f4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.582+0000 7f7294142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e6c24d5dd0 con 0x55e6c25b1a20 2024-09-19T11:13:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.582+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c272f4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.582+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c272f4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42700/0 (socket says 172.21.15.102:42700) 2024-09-19T11:13:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.582+0000 7f728fe86640 1 -- 172.21.15.102:0/2076229659 learned_addr learned my addr 172.21.15.102:0/2076229659 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.582+0000 7f728fe86640 1 -- 172.21.15.102:0/2076229659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c272fad0 con 0x55e6c25b1a20 2024-09-19T11:13:52.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.582+0000 7f728fe86640 1 --2- 172.21.15.102:0/2076229659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c272f4e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f72800016e0 tx=0x7f7280001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=221db5bb909620fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f717de0b640 1 -- 172.21.15.102:0/2076229659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280013420 con 0x55e6c25b1a20 2024-09-19T11:13:52.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f717de0b640 1 -- 172.21.15.102:0/2076229659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72800135e0 con 0x55e6c25b1a20 2024-09-19T11:13:52.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f717de0b640 1 -- 172.21.15.102:0/2076229659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280013900 con 0x55e6c25b1a20 2024-09-19T11:13:52.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f7294142800 1 -- 172.21.15.102:0/2076229659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 msgr2=0x55e6c272f4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f7294142800 1 --2- 172.21.15.102:0/2076229659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c272f4e0 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7f72800016e0 tx=0x7f7280001ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f7294142800 1 -- 172.21.15.102:0/2076229659 shutdown_connections 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f7294142800 1 --2- 172.21.15.102:0/2076229659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c272f4e0 unknown :-1 s=CLOSED pgs=236 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f7294142800 1 -- 172.21.15.102:0/2076229659 >> 172.21.15.102:0/2076229659 conn(0x55e6c2638c60 msgr2=0x55e6c272ae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f7294142800 1 -- 172.21.15.102:0/2076229659 shutdown_connections 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.583+0000 7f7294142800 1 -- 172.21.15.102:0/2076229659 wait complete. 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f7294142800 1 Processor -- start 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f7294142800 1 -- start start 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f7294142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c2736ff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f7294142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e6c2646d70 con 0x55e6c25b1a20 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c2736ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c2736ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42710/0 (socket says 172.21.15.102:42710) 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f728fe86640 1 -- 172.21.15.102:0/226557680 learned_addr learned my addr 172.21.15.102:0/226557680 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f728fe86640 1 -- 172.21.15.102:0/226557680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c2737550 con 0x55e6c25b1a20 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.584+0000 7f728fe86640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c2736ff0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7280000f80 tx=0x7f7280001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.585+0000 7f7177fff640 1 -- 172.21.15.102:0/226557680 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280022020 con 0x55e6c25b1a20 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.585+0000 7f7177fff640 1 -- 172.21.15.102:0/226557680 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280019040 con 0x55e6c25b1a20 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.585+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6c27377e0 con 0x55e6c25b1a20 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.585+0000 7f7177fff640 1 -- 172.21.15.102:0/226557680 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280004a40 con 0x55e6c25b1a20 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.585+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6c27381e0 con 0x55e6c25b1a20 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f7177fff640 1 -- 172.21.15.102:0/226557680 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7280025020 con 0x55e6c25b1a20 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f7177fff640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f717803cf60 0x7f717803f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f7177fff640 1 -- 172.21.15.102:0/226557680 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f72800544d0 con 0x55e6c25b1a20 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f728f685640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f717803cf60 0x7f717803f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f7294142800 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c25b2530 0x55e6c273e640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c273eb80 con 0x55e6c25b2530 2024-09-19T11:13:52.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f7290687640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c25b2530 0x55e6c273e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f728f685640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f717803cf60 0x7f717803f420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7278057000 tx=0x7f7278052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.586+0000 7f7290687640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c25b2530 0x55e6c273e640 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.587+0000 7f7290687640 1 -- 172.21.15.102:0/226557680 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72880083e0 con 0x55e6c25b2530 2024-09-19T11:13:52.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.587+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c273ef20 con 0x55e6c25b2530 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.587+0000 7f7290687640 1 -- 172.21.15.102:0/226557680 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72880083e0 con 0x55e6c25b2530 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.587+0000 7f7294142800 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2740a20 0x55e6c2742ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.587+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2743650 con 0x55e6c2740a20 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.587+0000 7f728fe86640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2740a20 0x55e6c2742ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.588+0000 7f728fe86640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2740a20 0x55e6c2742ec0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.588+0000 7f728fe86640 1 -- 172.21.15.102:0/226557680 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f728000f030 con 0x55e6c2740a20 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.588+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c273f770 con 0x55e6c25b2530 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.588+0000 7f7290687640 1 -- 172.21.15.102:0/226557680 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f72880083e0 con 0x55e6c25b2530 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.588+0000 7f7294142800 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c2744ab0 0x55e6c2746ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.588+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2747610 con 0x55e6c2744ab0 2024-09-19T11:13:52.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.588+0000 7f728f685640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c2744ab0 0x55e6c2746ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.589+0000 7f728f685640 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c2744ab0 0x55e6c2746ea0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.589+0000 7f728f685640 1 -- 172.21.15.102:0/226557680 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7278057030 con 0x55e6c2744ab0 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.589+0000 7f7294142800 1 Processor -- start 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.589+0000 7f7294142800 1 -- start start 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.589+0000 7f7294142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2755350 0x55e6c2755770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.589+0000 7f7294142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e6c25344a0 con 0x55e6c2755350 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2755350 0x55e6c2755770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2755350 0x55e6c2755770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42726/0 (socket says 172.21.15.102:42726) 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f728fe86640 1 -- 172.21.15.102:0/3179351026 learned_addr learned my addr 172.21.15.102:0/3179351026 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f728fe86640 1 -- 172.21.15.102:0/3179351026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c2755db0 con 0x55e6c2755350 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f728fe86640 1 --2- 172.21.15.102:0/3179351026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2755350 0x55e6c2755770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72800528f0 tx=0x7f728001dea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f71757fa640 1 -- 172.21.15.102:0/3179351026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728004b320 con 0x55e6c2755350 2024-09-19T11:13:52.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f71757fa640 1 -- 172.21.15.102:0/3179351026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280048020 con 0x55e6c2755350 2024-09-19T11:13:52.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f71757fa640 1 -- 172.21.15.102:0/3179351026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280044ae0 con 0x55e6c2755350 2024-09-19T11:13:52.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f7294142800 1 -- 172.21.15.102:0/3179351026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6c27565e0 con 0x55e6c2755350 2024-09-19T11:13:52.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.590+0000 7f7294142800 1 -- 172.21.15.102:0/3179351026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6c27565e0 con 0x55e6c2755350 2024-09-19T11:13:52.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.591+0000 7f71757fa640 1 -- 172.21.15.102:0/3179351026 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7280010070 con 0x55e6c2755350 2024-09-19T11:13:52.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.591+0000 7f71757fa640 1 --2- 172.21.15.102:0/3179351026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f716803d000 0x7f716803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.591+0000 7f71757fa640 1 -- 172.21.15.102:0/3179351026 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f7280049030 con 0x55e6c2755350 2024-09-19T11:13:52.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.591+0000 7f728f685640 1 --2- 172.21.15.102:0/3179351026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f716803d000 0x7f716803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.591+0000 7f7294142800 1 Processor -- start 2024-09-19T11:13:52.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f7294142800 1 -- start start 2024-09-19T11:13:52.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f728f685640 1 --2- 172.21.15.102:0/3179351026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f716803d000 0x7f716803f4c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7278005570 tx=0x7f7278005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f7294142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2761e90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f7294142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e6c272ff00 con 0x55e6c2761a90 2024-09-19T11:13:52.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2761e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2761e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42736/0 (socket says 172.21.15.102:42736) 2024-09-19T11:13:52.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f728fe86640 1 -- 172.21.15.102:0/3908487507 learned_addr learned my addr 172.21.15.102:0/3908487507 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f728fe86640 1 -- 172.21.15.102:0/3908487507 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c2762480 con 0x55e6c2761a90 2024-09-19T11:13:52.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.592+0000 7f728fe86640 1 --2- 172.21.15.102:0/3908487507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2761e90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f728004b6b0 tx=0x7f7280011fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=74ef29d62f8c9bb2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f716effd640 1 -- 172.21.15.102:0/3908487507 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280024b70 con 0x55e6c2761a90 2024-09-19T11:13:52.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f716effd640 1 -- 172.21.15.102:0/3908487507 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f728003eaa0 con 0x55e6c2761a90 2024-09-19T11:13:52.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f716effd640 1 -- 172.21.15.102:0/3908487507 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7280051150 con 0x55e6c2761a90 2024-09-19T11:13:52.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 -- 172.21.15.102:0/3908487507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 msgr2=0x55e6c2761e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 --2- 172.21.15.102:0/3908487507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2761e90 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f728004b6b0 tx=0x7f7280011fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 -- 172.21.15.102:0/3908487507 shutdown_connections 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 --2- 172.21.15.102:0/3908487507 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2761e90 unknown :-1 s=CLOSED pgs=239 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 -- 172.21.15.102:0/3908487507 >> 172.21.15.102:0/3908487507 conn(0x55e6c275de90 msgr2=0x55e6c275c0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 -- 172.21.15.102:0/3908487507 shutdown_connections 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 -- 172.21.15.102:0/3908487507 wait complete. 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 Processor -- start 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.593+0000 7f7294142800 1 -- start start 2024-09-19T11:13:52.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f7294142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2768ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f7294142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e6c27628f0 con 0x55e6c2761a90 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2768ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f728fe86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2768ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42750/0 (socket says 172.21.15.102:42750) 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 learned_addr learned my addr 172.21.15.102:0/3721073619 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e6c2769450 con 0x55e6c2761a90 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f728fe86640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2768ef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f728001df70 tx=0x7f728003a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f716d7fa640 1 -- 172.21.15.102:0/3721073619 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f728006f070 con 0x55e6c2761a90 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f716d7fa640 1 -- 172.21.15.102:0/3721073619 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7280024b70 con 0x55e6c2761a90 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e6c2769450 con 0x55e6c2761a90 2024-09-19T11:13:52.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f716d7fa640 1 -- 172.21.15.102:0/3721073619 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72800247d0 con 0x55e6c2761a90 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.594+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e6c2769450 con 0x55e6c2761a90 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.595+0000 7f716d7fa640 1 -- 172.21.15.102:0/3721073619 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7280072070 con 0x55e6c2761a90 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.595+0000 7f716d7fa640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f715803d000 0x7f715803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f716d7fa640 1 -- 172.21.15.102:0/3721073619 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f7280075ca0 con 0x55e6c2761a90 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f728f685640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f715803d000 0x7f715803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c27742e0 0x55e6c2776730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2776e80 con 0x55e6c27742e0 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7290687640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c27742e0 0x55e6c2776730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f728f685640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f715803d000 0x7f715803f4c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7278045be0 tx=0x7f727806d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7290687640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c27742e0 0x55e6c2776730 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72880083e0 con 0x55e6c27742e0 2024-09-19T11:13:52.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7294142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7294142800 20 realm 2024-09-19T11:13:52.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.596+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777290 con 0x55e6c27742e0 2024-09-19T11:13:52.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72880083e0 con 0x55e6c27742e0 2024-09-19T11:13:52.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f72880083e0 con 0x55e6c27742e0 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777f00 con 0x55e6c27742e0 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f72880083e0 con 0x55e6c27742e0 2024-09-19T11:13:52.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2778650 0x55e6c277aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c277b1b0 con 0x55e6c2778650 2024-09-19T11:13:52.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.597+0000 7f728fe86640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2778650 0x55e6c277aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.598+0000 7f728fe86640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2778650 0x55e6c277aa40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.598+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.598+0000 7f7294142800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:52.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.598+0000 7f7294142800 20 searching for the correct realm 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.598+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c277d290 0x55e6c277f750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.598+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c277fe20 con 0x55e6c277d290 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.598+0000 7f728f685640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c277d290 0x55e6c277f750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.599+0000 7f728f685640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c277d290 0x55e6c277f750 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.599+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.599+0000 7f728f685640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7278069040 0x7f727806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.599+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c277fe20 con 0x7f7278069040 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.599+0000 7f7290687640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7278069040 0x7f727806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.599+0000 7f7290687640 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7278069040 0x7f727806a940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.599+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880083e0 con 0x7f7278069040 2024-09-19T11:13:52.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.599+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.600+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.600+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.600+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f72880083e0 con 0x55e6c27742e0 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.600+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.600+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.600+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.600+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.600+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.601+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.601+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x7f7278069040 2024-09-19T11:13:52.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.601+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x7f7278069040 2024-09-19T11:13:52.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.601+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c277d290 2024-09-19T11:13:52.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.601+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.601+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.601+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.601+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.602+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.602+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.602+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.602+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x7f7278069040 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.602+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7288026040 con 0x7f7278069040 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.602+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c277d290 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.602+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.602+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c277d290 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c277d290 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c277d290 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.603+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.604+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.604+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.604+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.604+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c277d290 2024-09-19T11:13:52.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.604+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.604+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x7f7278069040 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.604+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x7f7278069040 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.604+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.605+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.605+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.605+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.605+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c277d290 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.605+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.605+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.605+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.605+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x7f7278069040 2024-09-19T11:13:52.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.606+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x7f7278069040 2024-09-19T11:13:52.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.606+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c277d290 2024-09-19T11:13:52.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.606+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.606+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c2778650 2024-09-19T11:13:52.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.606+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.606+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x55e6c27742e0 2024-09-19T11:13:52.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2777b60 con 0x7f7278069040 2024-09-19T11:13:52.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7288026040 con 0x7f7278069040 2024-09-19T11:13:52.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:52.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c277bb50 con 0x55e6c27742e0 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c277bb50 con 0x55e6c27742e0 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7288026040 con 0x55e6c27742e0 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.607+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c277bb00 con 0x55e6c277d290 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 zone default found 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 4 Realm: () 2024-09-19T11:13:52.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 zonegroup default 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c277c3f0 con 0x55e6c2778650 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2781c90 con 0x55e6c277d290 2024-09-19T11:13:52.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2782030 con 0x55e6c277d290 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 started sync module instance, tier type = 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.608+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2781130 con 0x7f7278069040 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.609+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288026040 con 0x7f7278069040 2024-09-19T11:13:52.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.609+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94449593488944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2781130 con 0x7f7278069040 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.609+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2782b00 con 0x55e6c27742e0 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.610+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94449593488944] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x7f7278069040 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.611+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.611+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94449593492976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2781130 con 0x55e6c27742e0 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.611+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2783570 con 0x55e6c277d290 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.612+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94449593492976] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.612+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.612+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94449593486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c27810a0 con 0x55e6c277d290 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.612+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2784460 con 0x7f7278069040 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.613+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94449593486464] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.614+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x7f7278069040 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.615+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94449593499568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c27843d0 con 0x7f7278069040 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.615+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2785320 con 0x55e6c27742e0 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.616+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94449593499568] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x7f7278069040 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.616+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.616+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94449593501696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2785320 con 0x55e6c27742e0 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.616+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2785d30 con 0x55e6c2778650 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.617+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94449593501696] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.617+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.617+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94449593503344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2785290 con 0x55e6c2778650 2024-09-19T11:13:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.617+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2786ba0 con 0x55e6c2778650 2024-09-19T11:13:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.618+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94449593503344] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.618+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.618+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94449593508048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c27873f0 con 0x55e6c2778650 2024-09-19T11:13:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.618+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2787c40 con 0x55e6c2778650 2024-09-19T11:13:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'36 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94449593508048] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94449593513456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2787af0 con 0x55e6c2778650 2024-09-19T11:13:52.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f7294142800 20 add_watcher() i=0 2024-09-19T11:13:52.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f7294142800 20 add_watcher() i=1 2024-09-19T11:13:52.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f7294142800 20 add_watcher() i=2 2024-09-19T11:13:52.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f7294142800 20 add_watcher() i=3 2024-09-19T11:13:52.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f7294142800 20 add_watcher() i=4 2024-09-19T11:13:52.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f7294142800 20 add_watcher() i=5 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.619+0000 7f7294142800 20 add_watcher() i=6 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.620+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94449593513456] v35'37 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.620+0000 7f7294142800 20 add_watcher() i=7 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.620+0000 7f7294142800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.620+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c278b060 con 0x55e6c27742e0 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.621+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.621+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94449593511744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2788580 con 0x55e6c27742e0 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94449593511744] v35'58 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7145fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7294142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7294142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:52.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7294142800 5 note: GC not initialized 2024-09-19T11:13:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7144fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7294142800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7294142800 20 Filter name: none 2024-09-19T11:13:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f70be7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7294142800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.622+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e6c27bdab0 con 0x55e6c27742e0 2024-09-19T11:13:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.623+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.623+0000 7f7294142800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:52.649 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.624+0000 7f7145fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.624+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94449593511744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c278a180 con 0x55e6c27742e0 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.625+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94449593511744] v35'59 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.625+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94449593488944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2789cd0 con 0x7f7278069040 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.626+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94449593488944] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x7f7278069040 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.626+0000 7f7294142800 20 remove_watcher() i=0 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.626+0000 7f7294142800 2 removed watcher, disabling cache 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.626+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94449593492976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2781630 con 0x55e6c27742e0 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.627+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94449593492976] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.627+0000 7f7294142800 20 remove_watcher() i=1 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.627+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94449593486464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2781630 con 0x55e6c277d290 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.628+0000 7f728f685640 1 -- 172.21.15.102:0/3721073619 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94449593486464] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7278057030 con 0x55e6c277d290 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.628+0000 7f7294142800 20 remove_watcher() i=2 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.628+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94449593499568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2780c80 con 0x7f7278069040 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.629+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94449593499568] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x7f7278069040 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.629+0000 7f7294142800 20 remove_watcher() i=3 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.629+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94449593501696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2783fb0 con 0x55e6c27742e0 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.630+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94449593501696] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7288036040 con 0x55e6c27742e0 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.630+0000 7f7294142800 20 remove_watcher() i=4 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.630+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94449593503344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2780c80 con 0x55e6c2778650 2024-09-19T11:13:52.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.631+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94449593503344] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.631+0000 7f7294142800 20 remove_watcher() i=5 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.631+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94449593508048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2783fb0 con 0x55e6c2778650 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.633+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94449593508048] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.633+0000 7f7294142800 20 remove_watcher() i=6 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.633+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94449593513456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e6c2784e70 con 0x55e6c2778650 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f728fe86640 1 -- 172.21.15.102:0/3721073619 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94449593513456] v35'38 uv36 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7280071030 con 0x55e6c2778650 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 20 remove_watcher() i=7 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2778650 msgr2=0x55e6c277aa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2778650 0x55e6c277aa40 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c27742e0 msgr2=0x55e6c2776730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c27742e0 0x55e6c2776730 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7278069040 msgr2=0x7f727806a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7278069040 0x7f727806a940 crc :-1 s=READY pgs=21 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c277d290 msgr2=0x55e6c277f750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c277d290 0x55e6c277f750 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f715803d000 msgr2=0x7f715803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f715803d000 0x7f715803f4c0 secure :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0x7f7278045be0 tx=0x7f727806d040 comp rx=0 tx=0).stop 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7290687640 1 -- 172.21.15.102:0/3721073619 reap_dead start 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 msgr2=0x55e6c2768ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2768ef0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x7f728001df70 tx=0x7f728003a8a0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 shutdown_connections 2024-09-19T11:13:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3721073619 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2761a90 0x55e6c2768ef0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 >> 172.21.15.102:0/3721073619 conn(0x55e6c275de90 msgr2=0x55e6c275c0a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 shutdown_connections 2024-09-19T11:13:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3721073619 wait complete. 2024-09-19T11:13:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3179351026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f716803d000 msgr2=0x7f716803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3179351026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f716803d000 0x7f716803f4c0 secure :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0x7f7278005570 tx=0x7f7278005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 -- 172.21.15.102:0/3179351026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2755350 msgr2=0x55e6c2755770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.634+0000 7f7294142800 1 --2- 172.21.15.102:0/3179351026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2755350 0x55e6c2755770 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7f72800528f0 tx=0x7f728001dea0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/3179351026 shutdown_connections 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 --2- 172.21.15.102:0/3179351026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f716803d000 0x7f716803f4c0 unknown :-1 s=CLOSED pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 --2- 172.21.15.102:0/3179351026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c2755350 0x55e6c2755770 unknown :-1 s=CLOSED pgs=238 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/3179351026 >> 172.21.15.102:0/3179351026 conn(0x55e6c2749700 msgr2=0x55e6c2749ae0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/3179351026 shutdown_connections 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/3179351026 wait complete. 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2740a20 msgr2=0x55e6c2742ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e6c2740a20 0x55e6c2742ec0 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c25b2530 msgr2=0x55e6c273e640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e6c25b2530 0x55e6c273e640 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c2744ab0 msgr2=0x55e6c2746ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e6c2744ab0 0x55e6c2746ea0 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f717803cf60 msgr2=0x7f717803f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f717803cf60 0x7f717803f420 secure :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0x7f7278057000 tx=0x7f7278052000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 msgr2=0x55e6c2736ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 --2- 172.21.15.102:0/226557680 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e6c25b1a20 0x55e6c2736ff0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7f7280000f80 tx=0x7f7280001250 comp rx=0 tx=0).stop 2024-09-19T11:13:52.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7290687640 1 -- 172.21.15.102:0/226557680 reap_dead start 2024-09-19T11:13:52.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 shutdown_connections 2024-09-19T11:13:52.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 >> 172.21.15.102:0/226557680 conn(0x55e6c2638c60 msgr2=0x55e6c27309d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 shutdown_connections 2024-09-19T11:13:52.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.635+0000 7f7294142800 1 -- 172.21.15.102:0/226557680 wait complete. 2024-09-19T11:13:52.662 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:52.662 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-19T11:13:52.662 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-19T11:13:52.662 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-19T11:13:52.707 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:52.801 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:52.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.706+0000 7f1bcce14800 1 Processor -- start 2024-09-19T11:13:52.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bcce14800 1 -- start start 2024-09-19T11:13:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bcce14800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x560f5e741aa0 0x560f5e743f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bcce14800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x560f5e7445e0 con 0x560f5e73df30 2024-09-19T11:13:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bcce14800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x560f5e5c87d0 con 0x560f5e741aa0 2024-09-19T11:13:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bbfcca640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x560f5e741aa0 0x560f5e743f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bc84cb640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x560f5e73df30 0x560f5e740320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52262/0 (socket says 172.21.15.102:52262) 2024-09-19T11:13:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bc84cb640 1 -- 172.21.15.102:0/3709927065 learned_addr learned my addr 172.21.15.102:0/3709927065 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bbfcca640 1 -- 172.21.15.102:0/3709927065 >> v1:172.21.15.37:6789/0 conn(0x560f5e73df30 legacy=0x560f5e740320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.707+0000 7f1bbfcca640 1 -- 172.21.15.102:0/3709927065 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5e745810 con 0x560f5e741aa0 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.709+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/3709927065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e741aa0 0x560f5e743f60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000a470 tx=0x7f1bb0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=39d0ca058dbbf4b1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.709+0000 7f1bc7cca640 1 -- 172.21.15.102:0/3709927065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0053570 con 0x560f5e741aa0 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.709+0000 7f1bc7cca640 1 -- 172.21.15.102:0/3709927065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb0058070 con 0x560f5e741aa0 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.709+0000 7f1bc7cca640 1 -- 172.21.15.102:0/3709927065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb0053880 con 0x560f5e741aa0 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.710+0000 7f1bcce14800 1 -- 172.21.15.102:0/3709927065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e741aa0 msgr2=0x560f5e743f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.710+0000 7f1bcce14800 1 --2- 172.21.15.102:0/3709927065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e741aa0 0x560f5e743f60 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f1bb000a470 tx=0x7f1bb0045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.710+0000 7f1bcce14800 1 -- 172.21.15.102:0/3709927065 shutdown_connections 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.710+0000 7f1bcce14800 1 --2- 172.21.15.102:0/3709927065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e741aa0 0x560f5e743f60 unknown :-1 s=CLOSED pgs=242 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.710+0000 7f1bcce14800 1 -- 172.21.15.102:0/3709927065 >> 172.21.15.102:0/3709927065 conn(0x560f5e737a90 msgr2=0x560f5e739ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.710+0000 7f1bcce14800 1 -- 172.21.15.102:0/3709927065 shutdown_connections 2024-09-19T11:13:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.710+0000 7f1bcce14800 1 -- 172.21.15.102:0/3709927065 wait complete. 2024-09-19T11:13:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.723+0000 7f1bcce14800 1 Processor -- start 2024-09-19T11:13:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.723+0000 7f1bcce14800 1 -- start start 2024-09-19T11:13:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.723+0000 7f1bcce14800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e82d310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.723+0000 7f1bcce14800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560f5e5d5dd0 con 0x560f5e73df30 2024-09-19T11:13:52.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.724+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e82d310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.724+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e82d310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42760/0 (socket says 172.21.15.102:42760) 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.724+0000 7f1bc84cb640 1 -- 172.21.15.102:0/2008582584 learned_addr learned my addr 172.21.15.102:0/2008582584 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.724+0000 7f1bc84cb640 1 -- 172.21.15.102:0/2008582584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5e82d900 con 0x560f5e73df30 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.724+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/2008582584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e82d310 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8001e40 tx=0x7f1bb8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396f9764b4bc371 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.724+0000 7f1ab660c640 1 -- 172.21.15.102:0/2008582584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8012020 con 0x560f5e73df30 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1ab660c640 1 -- 172.21.15.102:0/2008582584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb800e5a0 con 0x560f5e73df30 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1ab660c640 1 -- 172.21.15.102:0/2008582584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb800e8a0 con 0x560f5e73df30 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1bcce14800 1 -- 172.21.15.102:0/2008582584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 msgr2=0x560f5e82d310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2008582584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e82d310 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8001e40 tx=0x7f1bb8001e70 comp rx=0 tx=0).stop 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1bcce14800 1 -- 172.21.15.102:0/2008582584 shutdown_connections 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2008582584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e82d310 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1bcce14800 1 -- 172.21.15.102:0/2008582584 >> 172.21.15.102:0/2008582584 conn(0x560f5e737a90 msgr2=0x560f5e828c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1bcce14800 1 -- 172.21.15.102:0/2008582584 shutdown_connections 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.725+0000 7f1bcce14800 1 -- 172.21.15.102:0/2008582584 wait complete. 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.726+0000 7f1bcce14800 1 Processor -- start 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.726+0000 7f1bcce14800 1 -- start start 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.726+0000 7f1bcce14800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e73d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.726+0000 7f1bcce14800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560f5e744ab0 con 0x560f5e73df30 2024-09-19T11:13:52.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.726+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e73d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.726+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e73d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42764/0 (socket says 172.21.15.102:42764) 2024-09-19T11:13:52.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.726+0000 7f1bc84cb640 1 -- 172.21.15.102:0/2586799874 learned_addr learned my addr 172.21.15.102:0/2586799874 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.726+0000 7f1bc84cb640 1 -- 172.21.15.102:0/2586799874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5e73dbb0 con 0x560f5e73df30 2024-09-19T11:13:52.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.727+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e73d650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c010 tx=0x7f1bb8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.727+0000 7f1ab4e09640 1 -- 172.21.15.102:0/2586799874 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8012030 con 0x560f5e73df30 2024-09-19T11:13:52.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.727+0000 7f1ab4e09640 1 -- 172.21.15.102:0/2586799874 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb80014a0 con 0x560f5e73df30 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.727+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f5e73bf60 con 0x560f5e73df30 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.727+0000 7f1ab4e09640 1 -- 172.21.15.102:0/2586799874 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb801a7a0 con 0x560f5e73df30 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.727+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5e73c520 con 0x560f5e73df30 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1ab4e09640 1 -- 172.21.15.102:0/2586799874 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1bb8015020 con 0x560f5e73df30 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1ab4e09640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1ab003cfb0 0x7f1ab003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1ab4e09640 1 -- 172.21.15.102:0/2586799874 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1bb8020030 con 0x560f5e73df30 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1ab003cfb0 0x7f1ab003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e741aa0 0x560f5e83e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e83e8e0 con 0x560f5e741aa0 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1bc8ccc640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e741aa0 0x560f5e83e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1ab003cfb0 0x7f1ab003f470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0057000 tx=0x7f1bb0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.728+0000 7f1bc8ccc640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e741aa0 0x560f5e83e3a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.729+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/2586799874 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e741aa0 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.729+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e73ca20 con 0x560f5e741aa0 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.729+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/2586799874 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e741aa0 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.729+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e840c10 0x560f5e843000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.729+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8436d0 con 0x560f5e840c10 2024-09-19T11:13:52.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.729+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e840c10 0x560f5e843000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.729+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e840c10 0x560f5e843000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.730+0000 7f1bc84cb640 1 -- 172.21.15.102:0/2586799874 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e840c10 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.730+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e83fab0 con 0x560f5e741aa0 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.730+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/2586799874 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e741aa0 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.730+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e844b10 0x560f5e846f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.730+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e847640 con 0x560f5e844b10 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.730+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e844b10 0x560f5e846f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.730+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e844b10 0x560f5e846f00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.731+0000 7f1bbfcca640 1 -- 172.21.15.102:0/2586799874 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e844b10 2024-09-19T11:13:52.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.731+0000 7f1bcce14800 1 Processor -- start 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.731+0000 7f1bcce14800 1 -- start start 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.731+0000 7f1bcce14800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e8553a0 0x560f5e8557c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.731+0000 7f1bcce14800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560f5e6344a0 con 0x560f5e8553a0 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.731+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e8553a0 0x560f5e8557c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.731+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e8553a0 0x560f5e8557c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42774/0 (socket says 172.21.15.102:42774) 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.731+0000 7f1bc84cb640 1 -- 172.21.15.102:0/2106735995 learned_addr learned my addr 172.21.15.102:0/2106735995 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.732+0000 7f1bc84cb640 1 -- 172.21.15.102:0/2106735995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5e855e00 con 0x560f5e8553a0 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.732+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/2106735995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e8553a0 0x560f5e8557c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8052a60 tx=0x7f1bb80423b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.732+0000 7f1aadffb640 1 -- 172.21.15.102:0/2106735995 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb804f030 con 0x560f5e8553a0 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.732+0000 7f1aadffb640 1 -- 172.21.15.102:0/2106735995 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb80542d0 con 0x560f5e8553a0 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.732+0000 7f1bcce14800 1 -- 172.21.15.102:0/2106735995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f5e856630 con 0x560f5e8553a0 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.732+0000 7f1aadffb640 1 -- 172.21.15.102:0/2106735995 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb80512c0 con 0x560f5e8553a0 2024-09-19T11:13:52.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.732+0000 7f1bcce14800 1 -- 172.21.15.102:0/2106735995 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5e856bd0 con 0x560f5e8553a0 2024-09-19T11:13:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1aadffb640 1 -- 172.21.15.102:0/2106735995 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1bb804b060 con 0x560f5e8553a0 2024-09-19T11:13:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1aadffb640 1 --2- 172.21.15.102:0/2106735995 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1aa003d000 0x7f1aa003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1aadffb640 1 -- 172.21.15.102:0/2106735995 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1bb8050070 con 0x560f5e8553a0 2024-09-19T11:13:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/2106735995 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1aa003d000 0x7f1aa003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1bcce14800 1 Processor -- start 2024-09-19T11:13:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/2106735995 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1aa003d000 0x7f1aa003f4c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x560f5e83ed90 tx=0x7f1bb0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1bcce14800 1 -- start start 2024-09-19T11:13:52.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1bcce14800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e862060 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.733+0000 7f1bcce14800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560f5e82dd30 con 0x560f5e861c60 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.734+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e862060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.734+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e862060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42782/0 (socket says 172.21.15.102:42782) 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.734+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4182802244 learned_addr learned my addr 172.21.15.102:0/4182802244 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.734+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4182802244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5e862650 con 0x560f5e861c60 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.734+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/4182802244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e862060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1bb803a980 tx=0x7f1bb8024ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ace5f747a80e462 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.734+0000 7f1aa77fe640 1 -- 172.21.15.102:0/4182802244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8058020 con 0x560f5e861c60 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.734+0000 7f1aa77fe640 1 -- 172.21.15.102:0/4182802244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb8042d90 con 0x560f5e861c60 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.734+0000 7f1aa77fe640 1 -- 172.21.15.102:0/4182802244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb800cdc0 con 0x560f5e861c60 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 -- 172.21.15.102:0/4182802244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 msgr2=0x560f5e862060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4182802244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e862060 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x7f1bb803a980 tx=0x7f1bb8024ce0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 -- 172.21.15.102:0/4182802244 shutdown_connections 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4182802244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e862060 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 -- 172.21.15.102:0/4182802244 >> 172.21.15.102:0/4182802244 conn(0x560f5e85e060 msgr2=0x560f5e85c2a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 -- 172.21.15.102:0/4182802244 shutdown_connections 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 -- 172.21.15.102:0/4182802244 wait complete. 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 Processor -- start 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 -- start start 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e8690d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bcce14800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560f5e862ac0 con 0x560f5e861c60 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e8690d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bc84cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e8690d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42794/0 (socket says 172.21.15.102:42794) 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.735+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 learned_addr learned my addr 172.21.15.102:0/4271156054 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:52.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.736+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560f5e869630 con 0x560f5e861c60 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.736+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e8690d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1bb804cfd0 tx=0x7f1bb804bf90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.736+0000 7f1aa5ffb640 1 -- 172.21.15.102:0/4271156054 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb8044110 con 0x560f5e861c60 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.736+0000 7f1aa5ffb640 1 -- 172.21.15.102:0/4271156054 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1bb804b350 con 0x560f5e861c60 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.736+0000 7f1aa5ffb640 1 -- 172.21.15.102:0/4271156054 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1bb804b540 con 0x560f5e861c60 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.736+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560f5e869630 con 0x560f5e861c60 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.736+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560f5e869630 con 0x560f5e861c60 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.737+0000 7f1aa5ffb640 1 -- 172.21.15.102:0/4271156054 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1bb805b020 con 0x560f5e861c60 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.737+0000 7f1aa5ffb640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a9803d000 0x7f1a9803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.737+0000 7f1aa5ffb640 1 -- 172.21.15.102:0/4271156054 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1bb806ace0 con 0x560f5e861c60 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.737+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a9803d000 0x7f1a9803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a9803d000 0x7f1a9803f4c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0053570 tx=0x7f1bb0053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e874670 0x560f5e876b30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e877280 con 0x560f5e874670 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bc8ccc640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e874670 0x560f5e876b30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bc8ccc640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e874670 0x560f5e876b30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bcce14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bcce14800 20 realm 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.738+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e877690 con 0x560f5e874670 2024-09-19T11:13:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e877f60 con 0x560f5e874670 2024-09-19T11:13:52.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e879060 0x560f5e87b450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e87ba10 con 0x560f5e879060 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.739+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e879060 0x560f5e87b450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bc84cb640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e879060 0x560f5e87b450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bcce14800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bcce14800 20 searching for the correct realm 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e87d9c0 0x560f5e87fe80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e880550 con 0x560f5e87d9c0 2024-09-19T11:13:52.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e87d9c0 0x560f5e87fe80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e87d9c0 0x560f5e87fe80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bbfcca640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1bb005f040 0x7f1bb005f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.740+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e880550 con 0x7f1bb005f040 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.741+0000 7f1bc8ccc640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1bb005f040 0x7f1bb005f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.741+0000 7f1bc8ccc640 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1bb005f040 0x7f1bb005f930 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.741+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.741+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.742+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.742+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.742+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.742+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.742+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.742+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.742+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x7f1bb005f040 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e87d9c0 2024-09-19T11:13:52.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.743+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.744+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.744+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.744+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.744+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x7f1bb005f040 2024-09-19T11:13:52.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.744+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.744+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e87d9c0 2024-09-19T11:13:52.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.744+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.744+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e87d9c0 2024-09-19T11:13:52.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.745+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.745+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.745+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.745+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e87d9c0 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.745+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.745+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e87d9c0 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.745+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.745+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.746+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.746+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.746+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.746+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.746+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.746+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e87d9c0 2024-09-19T11:13:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.746+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.746+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x7f1bb005f040 2024-09-19T11:13:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.747+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.747+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.747+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.747+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.747+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.747+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e87d9c0 2024-09-19T11:13:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.747+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.747+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.748+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.748+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x7f1bb005f040 2024-09-19T11:13:52.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.748+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.748+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e87d9c0 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.748+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.748+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e879060 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.748+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.748+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x560f5e874670 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560f5e878300 con 0x7f1bb005f040 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e87c2d0 con 0x560f5e874670 2024-09-19T11:13:52.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e87c2d0 con 0x560f5e874670 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.749+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e87c2d0 con 0x560f5e87d9c0 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:52.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 20 zone default found 2024-09-19T11:13:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 4 Realm: () 2024-09-19T11:13:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:52.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 20 zonegroup default 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e87cbd0 con 0x560f5e879060 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8824f0 con 0x560f5e87d9c0 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.750+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e882980 con 0x560f5e87d9c0 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.751+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.751+0000 7f1bcce14800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.751+0000 7f1bcce14800 20 started sync module instance, tier type = 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.751+0000 7f1bcce14800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.751+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e881860 con 0x7f1bb005f040 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.752+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.752+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94624010476928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e881860 con 0x7f1bb005f040 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.752+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e883460 con 0x560f5e874670 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.753+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94624010476928] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.753+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.753+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94624010481488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e881860 con 0x560f5e874670 2024-09-19T11:13:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.753+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e883f10 con 0x560f5e87d9c0 2024-09-19T11:13:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.754+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94624010481488] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.754+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.754+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94624010474416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8817d0 con 0x560f5e87d9c0 2024-09-19T11:13:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.754+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e884dd0 con 0x7f1bb005f040 2024-09-19T11:13:52.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.755+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.755+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94624010488640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e885670 con 0x7f1bb005f040 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.755+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8860e0 con 0x560f5e874670 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.755+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94624010474416] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.756+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.756+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94624010492848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8860a0 con 0x560f5e874670 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.756+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94624010488640] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.756+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e886af0 con 0x560f5e879060 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.757+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94624010492848] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.757+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.757+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94624010490384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e884300 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.757+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e887340 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.758+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.758+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94624010499808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e887fb0 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.758+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e888a00 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.758+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94624010490384] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'39 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94624010503408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e888ca0 con 0x560f5e879060 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bcce14800 20 add_watcher() i=0 2024-09-19T11:13:52.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bcce14800 20 add_watcher() i=1 2024-09-19T11:13:52.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bcce14800 20 add_watcher() i=2 2024-09-19T11:13:52.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bcce14800 20 add_watcher() i=3 2024-09-19T11:13:52.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bcce14800 20 add_watcher() i=4 2024-09-19T11:13:52.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bcce14800 20 add_watcher() i=5 2024-09-19T11:13:52.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94624010499808] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.759+0000 7f1bcce14800 20 add_watcher() i=6 2024-09-19T11:13:52.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.760+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94624010503408] v35'40 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.760+0000 7f1bcce14800 20 add_watcher() i=7 2024-09-19T11:13:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.760+0000 7f1bcce14800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.760+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e887b00 con 0x560f5e874670 2024-09-19T11:13:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.760+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.760+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94624010495552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e887b00 con 0x560f5e874670 2024-09-19T11:13:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.761+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94624010495552] v35'60 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.761+0000 7f1a7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.761+0000 7f1bcce14800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.761+0000 7f1bcce14800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 5 note: GC not initialized 2024-09-19T11:13:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1a7dfe3640 20 reqs_thread_entry: start 2024-09-19T11:13:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 20 Filter name: none 2024-09-19T11:13:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1a777fe640 20 reqs_thread_entry: start 2024-09-19T11:13:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:52.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 20 rados->read ofs=0 len=0 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bebc0 con 0x560f5e874670 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.762+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8c14f0 con 0x7f1bb005f040 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.763+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.763+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8c4bc0 con 0x560f5e874670 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~391] v35'3 uv3 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bcce14800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bcce14800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bcce14800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94624010749376 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8c04e0 con 0x560f5e874670 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94624010492848 notify 150323855362 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f1bc0026410 con 0x560f5e874670 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1aa77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94624010492848 notifier 4337 bl.length()=567 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(65 notify.4 [notify cookie 94624010749376 out=8b] v0'0 uv39 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1aa77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:52.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1aa77fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:52.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1aa77fe640 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1a8c003ea0 con 0x560f5e874670 2024-09-19T11:13:52.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.764+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94624010749376 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1bc00265e0 con 0x560f5e874670 2024-09-19T11:13:52.876 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:52.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.765+0000 7f1a7efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:52.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.765+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94624010495552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x560f5e874670 2024-09-19T11:13:52.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.766+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(67 data_loggenerations_metadata [watch unwatch cookie 94624010495552] v35'61 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.766+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94624010476928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x7f1bb005f040 2024-09-19T11:13:52.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.767+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(68 notify.0 [watch unwatch cookie 94624010476928] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.767+0000 7f1bcce14800 20 remove_watcher() i=0 2024-09-19T11:13:52.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.767+0000 7f1bcce14800 2 removed watcher, disabling cache 2024-09-19T11:13:52.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.767+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94624010481488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x560f5e874670 2024-09-19T11:13:52.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.768+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(69 notify.1 [watch unwatch cookie 94624010481488] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.768+0000 7f1bcce14800 20 remove_watcher() i=1 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.768+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:70 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94624010474416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x560f5e87d9c0 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.769+0000 7f1bbfcca640 1 -- 172.21.15.102:0/4271156054 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(70 notify.2 [watch unwatch cookie 94624010474416] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb0051070 con 0x560f5e87d9c0 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.769+0000 7f1bcce14800 20 remove_watcher() i=2 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.769+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94624010488640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x7f1bb005f040 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.770+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(71 notify.3 [watch unwatch cookie 94624010488640] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x7f1bb005f040 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.770+0000 7f1bcce14800 20 remove_watcher() i=3 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.770+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94624010492848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x560f5e874670 2024-09-19T11:13:52.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.772+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(72 notify.4 [watch unwatch cookie 94624010492848] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bc000a4d0 con 0x560f5e874670 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.772+0000 7f1bcce14800 20 remove_watcher() i=4 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.772+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94624010490384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x560f5e879060 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.773+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(73 notify.5 [watch unwatch cookie 94624010490384] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.773+0000 7f1bcce14800 20 remove_watcher() i=5 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.773+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94624010499808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x560f5e879060 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.774+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(74 notify.6 [watch unwatch cookie 94624010499808] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.774+0000 7f1bcce14800 20 remove_watcher() i=6 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.774+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94624010503408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560f5e8bca80 con 0x560f5e879060 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bc84cb640 1 -- 172.21.15.102:0/4271156054 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 notify.7 [watch unwatch cookie 94624010503408] v35'41 uv39 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1bb801ab20 con 0x560f5e879060 2024-09-19T11:13:52.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 20 remove_watcher() i=7 2024-09-19T11:13:52.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e879060 msgr2=0x560f5e87b450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e879060 0x560f5e87b450 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e874670 msgr2=0x560f5e876b30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e874670 0x560f5e876b30 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1bb005f040 msgr2=0x7f1bb005f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1bb005f040 0x7f1bb005f930 crc :-1 s=READY pgs=22 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e87d9c0 msgr2=0x560f5e87fe80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e87d9c0 0x560f5e87fe80 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a9803d000 msgr2=0x7f1a9803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a9803d000 0x7f1a9803f4c0 secure :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0053570 tx=0x7f1bb0053000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 msgr2=0x560f5e8690d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/4271156054 reap_dead start 2024-09-19T11:13:52.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e8690d0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f1bb804cfd0 tx=0x7f1bb804bf90 comp rx=0 tx=0).stop 2024-09-19T11:13:52.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 shutdown_connections 2024-09-19T11:13:52.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/4271156054 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e861c60 0x560f5e8690d0 unknown :-1 s=CLOSED pgs=247 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 >> 172.21.15.102:0/4271156054 conn(0x560f5e85e060 msgr2=0x560f5e85c270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 shutdown_connections 2024-09-19T11:13:52.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/4271156054 wait complete. 2024-09-19T11:13:52.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/2106735995 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1aa003d000 msgr2=0x7f1aa003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2106735995 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1aa003d000 0x7f1aa003f4c0 secure :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0x560f5e83ed90 tx=0x7f1bb0005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/2106735995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e8553a0 msgr2=0x560f5e8557c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2106735995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e8553a0 0x560f5e8557c0 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f1bb8052a60 tx=0x7f1bb80423b0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/2106735995 shutdown_connections 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2106735995 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1aa003d000 0x7f1aa003f4c0 unknown :-1 s=CLOSED pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2106735995 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e8553a0 0x560f5e8557c0 unknown :-1 s=CLOSED pgs=245 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/2106735995 >> 172.21.15.102:0/2106735995 conn(0x560f5e849750 msgr2=0x560f5e849b30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/2106735995 shutdown_connections 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.775+0000 7f1bcce14800 1 -- 172.21.15.102:0/2106735995 wait complete. 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e840c10 msgr2=0x560f5e843000 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560f5e840c10 0x560f5e843000 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e741aa0 msgr2=0x560f5e83e3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560f5e741aa0 0x560f5e83e3a0 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e844b10 msgr2=0x560f5e846f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560f5e844b10 0x560f5e846f00 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1ab003cfb0 msgr2=0x7f1ab003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1ab003cfb0 0x7f1ab003f470 secure :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0x7f1bb0057000 tx=0x7f1bb0052000 comp rx=0 tx=0).stop 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 msgr2=0x560f5e73d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 --2- 172.21.15.102:0/2586799874 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560f5e73df30 0x560f5e73d650 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f1bb800c010 tx=0x7f1bb8000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bc8ccc640 1 -- 172.21.15.102:0/2586799874 reap_dead start 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 shutdown_connections 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 >> 172.21.15.102:0/2586799874 conn(0x560f5e737a90 msgr2=0x560f5e82e800 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 shutdown_connections 2024-09-19T11:13:52.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.776+0000 7f1bcce14800 1 -- 172.21.15.102:0/2586799874 wait complete. 2024-09-19T11:13:52.891 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:52.892 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:13:52.892 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:13:52.892 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:13:52.937 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:52.937 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:52.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.936+0000 7fae13d23800 1 Processor -- start 2024-09-19T11:13:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.936+0000 7fae13d23800 1 -- start start 2024-09-19T11:13:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.936+0000 7fae13d23800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557bbf906a90 0x557bbf908f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.936+0000 7fae13d23800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557bbf9095d0 con 0x557bbf902f20 2024-09-19T11:13:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.936+0000 7fae13d23800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x557bbf78d7d0 con 0x557bbf906a90 2024-09-19T11:13:52.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.937+0000 7fae0f132640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557bbf906a90 0x557bbf908f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.937+0000 7fae0f933640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x557bbf902f20 0x557bbf905310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52268/0 (socket says 172.21.15.102:52268) 2024-09-19T11:13:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.937+0000 7fae0f132640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557bbf906a90 0x557bbf908f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42808/0 (socket says 172.21.15.102:42808) 2024-09-19T11:13:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.937+0000 7fae0f933640 1 -- 172.21.15.102:0/1284301957 learned_addr learned my addr 172.21.15.102:0/1284301957 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.937+0000 7fae0f132640 1 -- 172.21.15.102:0/1284301957 >> v1:172.21.15.37:6789/0 conn(0x557bbf902f20 legacy=0x557bbf905310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.937+0000 7fae0f132640 1 -- 172.21.15.102:0/1284301957 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbf90a800 con 0x557bbf906a90 2024-09-19T11:13:52.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.939+0000 7fae0f132640 1 --2- 172.21.15.102:0/1284301957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf906a90 0x557bbf908f50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae0400a470 tx=0x7fae04045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8b07c30b290f5c55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:52.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.939+0000 7fae0e931640 1 -- 172.21.15.102:0/1284301957 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae04053570 con 0x557bbf906a90 2024-09-19T11:13:52.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.939+0000 7fae0e931640 1 -- 172.21.15.102:0/1284301957 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae04058070 con 0x557bbf906a90 2024-09-19T11:13:52.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.939+0000 7fae0e931640 1 -- 172.21.15.102:0/1284301957 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae04053880 con 0x557bbf906a90 2024-09-19T11:13:52.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.939+0000 7fae13d23800 1 -- 172.21.15.102:0/1284301957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf906a90 msgr2=0x557bbf908f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:52.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.939+0000 7fae13d23800 1 --2- 172.21.15.102:0/1284301957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf906a90 0x557bbf908f50 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x7fae0400a470 tx=0x7fae04045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:52.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.940+0000 7fae13d23800 1 -- 172.21.15.102:0/1284301957 shutdown_connections 2024-09-19T11:13:52.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.940+0000 7fae13d23800 1 --2- 172.21.15.102:0/1284301957 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf906a90 0x557bbf908f50 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:52.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.940+0000 7fae13d23800 1 -- 172.21.15.102:0/1284301957 >> 172.21.15.102:0/1284301957 conn(0x557bbf8fca60 msgr2=0x557bbf8feec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:52.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.940+0000 7fae13d23800 1 -- 172.21.15.102:0/1284301957 shutdown_connections 2024-09-19T11:13:52.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.940+0000 7fae13d23800 1 -- 172.21.15.102:0/1284301957 wait complete. 2024-09-19T11:13:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.953+0000 7fae13d23800 1 Processor -- start 2024-09-19T11:13:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.953+0000 7fae13d23800 1 -- start start 2024-09-19T11:13:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.953+0000 7fae13d23800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf902690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.953+0000 7fae13d23800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557bbf79add0 con 0x557bbf902f20 2024-09-19T11:13:53.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.954+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf902690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.954+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf902690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42816/0 (socket says 172.21.15.102:42816) 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.954+0000 7fae0f933640 1 -- 172.21.15.102:0/3228711741 learned_addr learned my addr 172.21.15.102:0/3228711741 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.954+0000 7fae0f933640 1 -- 172.21.15.102:0/3228711741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbf902c80 con 0x557bbf902f20 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.954+0000 7fae0f933640 1 --2- 172.21.15.102:0/3228711741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf902690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae00001df0 tx=0x7fae0000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cb758545f32eb96c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.954+0000 7facfde0b640 1 -- 172.21.15.102:0/3228711741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae00012020 con 0x557bbf902f20 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.954+0000 7facfde0b640 1 -- 172.21.15.102:0/3228711741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0000e470 con 0x557bbf902f20 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.954+0000 7facfde0b640 1 -- 172.21.15.102:0/3228711741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae0000e7f0 con 0x557bbf902f20 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 -- 172.21.15.102:0/3228711741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 msgr2=0x557bbf902690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 --2- 172.21.15.102:0/3228711741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf902690 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7fae00001df0 tx=0x7fae0000b6c0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 -- 172.21.15.102:0/3228711741 shutdown_connections 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 --2- 172.21.15.102:0/3228711741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf902690 unknown :-1 s=CLOSED pgs=250 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 -- 172.21.15.102:0/3228711741 >> 172.21.15.102:0/3228711741 conn(0x557bbf8fca60 msgr2=0x557bbf9edca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 -- 172.21.15.102:0/3228711741 shutdown_connections 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 -- 172.21.15.102:0/3228711741 wait complete. 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 Processor -- start 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.955+0000 7fae13d23800 1 -- start start 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7fae13d23800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf9fbfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7fae13d23800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557bbf909aa0 con 0x557bbf902f20 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf9fbfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf9fbfd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42832/0 (socket says 172.21.15.102:42832) 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7fae0f933640 1 -- 172.21.15.102:0/142540748 learned_addr learned my addr 172.21.15.102:0/142540748 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7fae0f933640 1 -- 172.21.15.102:0/142540748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbf9fc530 con 0x557bbf902f20 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7fae0f933640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf9fbfd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x557bbf9021c0 tx=0x7fae00000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7facf7fff640 1 -- 172.21.15.102:0/142540748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae00012030 con 0x557bbf902f20 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7facf7fff640 1 -- 172.21.15.102:0/142540748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae0001a6d0 con 0x557bbf902f20 2024-09-19T11:13:53.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.956+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557bbf9fc820 con 0x557bbf902f20 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.957+0000 7facf7fff640 1 -- 172.21.15.102:0/142540748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae0001a9d0 con 0x557bbf902f20 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.957+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bbf9fd3d0 con 0x557bbf902f20 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.957+0000 7facf7fff640 1 -- 172.21.15.102:0/142540748 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fae00015020 con 0x557bbf902f20 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7facf7fff640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facf803cfb0 0x7facf803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7facf7fff640 1 -- 172.21.15.102:0/142540748 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fae00020030 con 0x557bbf902f20 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7fae0f132640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facf803cfb0 0x7facf803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7fae13d23800 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbf906a90 0x557bbfa03620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa03b60 con 0x557bbf906a90 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7fae10134640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbf906a90 0x557bbfa03620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7fae0f132640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facf803cfb0 0x7facf803f470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae04057000 tx=0x7fae04052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7fae10134640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbf906a90 0x557bbfa03620 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7fae10134640 1 -- 172.21.15.102:0/142540748 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbf906a90 2024-09-19T11:13:53.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.958+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa03f00 con 0x557bbf906a90 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.959+0000 7fae10134640 1 -- 172.21.15.102:0/142540748 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbf906a90 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.959+0000 7fae13d23800 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa05c70 0x557bbfa08060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.959+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa086c0 con 0x557bbfa05c70 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.959+0000 7fae0f933640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa05c70 0x557bbfa08060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.959+0000 7fae0f933640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa05c70 0x557bbfa08060 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.960+0000 7fae0f933640 1 -- 172.21.15.102:0/142540748 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fae0001ad50 con 0x557bbfa05c70 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.960+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa04b10 con 0x557bbf906a90 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.960+0000 7fae10134640 1 -- 172.21.15.102:0/142540748 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbf906a90 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.960+0000 7fae13d23800 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa09b20 0x557bbfa0bf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.960+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa0c650 con 0x557bbfa09b20 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.960+0000 7fae0f132640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa09b20 0x557bbfa0bf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.960+0000 7fae0f132640 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa09b20 0x557bbfa0bf10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.961+0000 7fae0f132640 1 -- 172.21.15.102:0/142540748 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa09b20 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.961+0000 7fae13d23800 1 Processor -- start 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.961+0000 7fae13d23800 1 -- start start 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.961+0000 7fae13d23800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa1a390 0x557bbfa1a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.961+0000 7fae13d23800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557bbf7f94a0 con 0x557bbfa1a390 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.961+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa1a390 0x557bbfa1a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.961+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa1a390 0x557bbfa1a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42846/0 (socket says 172.21.15.102:42846) 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.961+0000 7fae0f933640 1 -- 172.21.15.102:0/2234315929 learned_addr learned my addr 172.21.15.102:0/2234315929 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.962+0000 7fae0f933640 1 -- 172.21.15.102:0/2234315929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbfa1adf0 con 0x557bbfa1a390 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.962+0000 7fae0f933640 1 --2- 172.21.15.102:0/2234315929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa1a390 0x557bbfa1a7b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae00052ba0 tx=0x7fae00018720 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.962+0000 7facf57fa640 1 -- 172.21.15.102:0/2234315929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae0004e070 con 0x557bbfa1a390 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.962+0000 7facf57fa640 1 -- 172.21.15.102:0/2234315929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00048070 con 0x557bbfa1a390 2024-09-19T11:13:53.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.962+0000 7fae13d23800 1 -- 172.21.15.102:0/2234315929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557bbfa1b620 con 0x557bbfa1a390 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.962+0000 7facf57fa640 1 -- 172.21.15.102:0/2234315929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae00042d10 con 0x557bbfa1a390 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.962+0000 7fae13d23800 1 -- 172.21.15.102:0/2234315929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bbfa1b620 con 0x557bbfa1a390 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7facf57fa640 1 -- 172.21.15.102:0/2234315929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fae0004b370 con 0x557bbfa1a390 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7facf57fa640 1 --2- 172.21.15.102:0/2234315929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7face803d000 0x7face803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7facf57fa640 1 -- 172.21.15.102:0/2234315929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fae0003c390 con 0x557bbfa1a390 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7fae0f132640 1 --2- 172.21.15.102:0/2234315929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7face803d000 0x7face803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7fae13d23800 1 Processor -- start 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7fae13d23800 1 -- start start 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7fae0f132640 1 --2- 172.21.15.102:0/2234315929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7face803d000 0x7face803f4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x557bbfa08a90 tx=0x7fae04005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7fae13d23800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa26e40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.963+0000 7fae13d23800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557bbf9010d0 con 0x557bbfa26a40 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa26e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa26e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42858/0 (socket says 172.21.15.102:42858) 2024-09-19T11:13:53.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7fae0f933640 1 -- 172.21.15.102:0/227378671 learned_addr learned my addr 172.21.15.102:0/227378671 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7fae0f933640 1 -- 172.21.15.102:0/227378671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbfa27430 con 0x557bbfa26a40 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7fae0f933640 1 --2- 172.21.15.102:0/227378671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa26e40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae0003a750 tx=0x7fae00054470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d5738a0453099e3d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7faceeffd640 1 -- 172.21.15.102:0/227378671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae0000ddc0 con 0x557bbfa26a40 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7faceeffd640 1 -- 172.21.15.102:0/227378671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00051220 con 0x557bbfa26a40 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7faceeffd640 1 -- 172.21.15.102:0/227378671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae00039390 con 0x557bbfa26a40 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7fae13d23800 1 -- 172.21.15.102:0/227378671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 msgr2=0x557bbfa26e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.964+0000 7fae13d23800 1 --2- 172.21.15.102:0/227378671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa26e40 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7fae0003a750 tx=0x7fae00054470 comp rx=0 tx=0).stop 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 -- 172.21.15.102:0/227378671 shutdown_connections 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 --2- 172.21.15.102:0/227378671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa26e40 unknown :-1 s=CLOSED pgs=253 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 -- 172.21.15.102:0/227378671 >> 172.21.15.102:0/227378671 conn(0x557bbfa22e40 msgr2=0x557bbfa21080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 -- 172.21.15.102:0/227378671 shutdown_connections 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 -- 172.21.15.102:0/227378671 wait complete. 2024-09-19T11:13:53.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 Processor -- start 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 -- start start 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa2de40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae13d23800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557bbfa278a0 con 0x557bbfa26a40 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa2de40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae0f933640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa2de40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42864/0 (socket says 172.21.15.102:42864) 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.965+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 learned_addr learned my addr 172.21.15.102:0/3017601588 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.966+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557bbfa2e3a0 con 0x557bbfa26a40 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.966+0000 7fae0f933640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa2de40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fae00018790 tx=0x7fae0003a6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.966+0000 7faced7fa640 1 -- 172.21.15.102:0/3017601588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae00024420 con 0x557bbfa26a40 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.966+0000 7faced7fa640 1 -- 172.21.15.102:0/3017601588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fae00042340 con 0x557bbfa26a40 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.966+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557bbfa2e3a0 con 0x557bbfa26a40 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.966+0000 7faced7fa640 1 -- 172.21.15.102:0/3017601588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fae0000ddc0 con 0x557bbfa26a40 2024-09-19T11:13:53.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.966+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557bbfa2e3a0 con 0x557bbfa26a40 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.967+0000 7faced7fa640 1 -- 172.21.15.102:0/3017601588 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fae000548d0 con 0x557bbfa26a40 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.967+0000 7faced7fa640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd803d000 0x7facd803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.967+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.967+0000 7faced7fa640 1 -- 172.21.15.102:0/3017601588 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fae00067070 con 0x557bbfa26a40 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.967+0000 7fae0f132640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd803d000 0x7facd803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.967+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbfa393f0 0x557bbfa3b880 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.967+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3bfd0 con 0x557bbfa393f0 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.967+0000 7fae10134640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbfa393f0 0x557bbfa3b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae0f132640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd803d000 0x7facd803f4c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae040539f0 tx=0x7fae04053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae10134640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbfa393f0 0x557bbfa3b880 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 20 realm 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3c3e0 con 0x557bbfa393f0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3ccb0 con 0x557bbfa393f0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.968+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae13d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa3db40 0x557bbfa3ff30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa40670 con 0x557bbfa3db40 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae0f933640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa3db40 0x557bbfa3ff30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae0f933640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa3db40 0x557bbfa3ff30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae13d23800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae13d23800 20 searching for the correct realm 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa42710 0x557bbfa44bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.969+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa452a0 con 0x557bbfa42710 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.970+0000 7fae0f132640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa42710 0x557bbfa44bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.970+0000 7fae0f132640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa42710 0x557bbfa44bd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.970+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.970+0000 7fae0f132640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fae0406c040 0x7fae0405f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.970+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa452a0 con 0x7fae0406c040 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.970+0000 7fae10134640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fae0406c040 0x7fae0405f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.970+0000 7fae10134640 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fae0406c040 0x7fae0405f420 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.971+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.971+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.971+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.971+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.971+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.971+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.971+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.971+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.972+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.972+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.972+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.972+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x7fae0406c040 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.972+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.972+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa42710 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.972+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.972+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.973+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.973+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.973+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.973+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.973+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.973+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x7fae0406c040 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.973+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.973+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa42710 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.974+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.974+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa42710 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.974+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.974+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.974+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.974+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa42710 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.974+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.974+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa42710 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.975+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.975+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.975+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.975+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.975+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.975+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.976+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.976+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa42710 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.976+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.976+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x7fae0406c040 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.976+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.976+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.976+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.976+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.977+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.977+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa42710 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.977+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.977+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.977+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.977+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x7fae0406c040 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.978+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.978+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa42710 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.978+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.978+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa3db40 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.978+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.978+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x557bbfa393f0 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.978+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa3d050 con 0x7fae0406c040 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa41010 con 0x557bbfa393f0 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa41010 con 0x557bbfa393f0 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.979+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa40fc0 con 0x557bbfa42710 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 zone default found 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 4 Realm: () 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 zonegroup default 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa418b0 con 0x557bbfa3db40 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa47110 con 0x557bbfa42710 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa474b0 con 0x557bbfa42710 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 started sync module instance, tier type = 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:53.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.980+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa465b0 con 0x7fae0406c040 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.981+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.981+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93989984561920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa465b0 con 0x7fae0406c040 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.981+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa47fc0 con 0x557bbfa393f0 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.982+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93989984561920] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.983+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.983+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93989984565904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa465b0 con 0x557bbfa393f0 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.983+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa48a60 con 0x557bbfa42710 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.984+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.984+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93989984568656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa49300 con 0x557bbfa42710 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.984+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa49df0 con 0x7fae0406c040 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.984+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93989984565904] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.985+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93989984568656] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.985+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.985+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93989984570960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa46100 con 0x7fae0406c040 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.985+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4a690 con 0x557bbfa393f0 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.986+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.986+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93989984575888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4a5b0 con 0x557bbfa393f0 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.986+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4b590 con 0x557bbfa3db40 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.986+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93989984570960] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.987+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.987+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93989984575888] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.987+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93989984573632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4b0a0 con 0x557bbfa3db40 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.987+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4be60 con 0x557bbfa3db40 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.988+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.988+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93989984582576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4c700 con 0x557bbfa3db40 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.988+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4d180 con 0x557bbfa3db40 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.988+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93989984573632] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'42 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93989984586896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4d180 con 0x557bbfa3db40 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93989984582576] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae13d23800 20 add_watcher() i=0 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae13d23800 20 add_watcher() i=1 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae13d23800 20 add_watcher() i=2 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae13d23800 20 add_watcher() i=3 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae13d23800 20 add_watcher() i=4 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae13d23800 20 add_watcher() i=5 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.989+0000 7fae13d23800 20 add_watcher() i=6 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.990+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93989984586896] v35'43 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.990+0000 7fae13d23800 20 add_watcher() i=7 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.990+0000 7fae13d23800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.990+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa501b0 con 0x557bbfa393f0 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.990+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.990+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93989984578096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa4d630 con 0x557bbfa393f0 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.991+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93989984578096] v35'62 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.991+0000 7facc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.991+0000 7fae13d23800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.991+0000 7fae13d23800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.992+0000 7fae13d23800 5 note: GC not initialized 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.992+0000 7facc4fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.992+0000 7fae13d23800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.992+0000 7fae13d23800 20 Filter name: none 2024-09-19T11:13:53.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.992+0000 7fac3e7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.992+0000 7fae13d23800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.992+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa82af0 con 0x557bbfa393f0 2024-09-19T11:13:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.993+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.993+0000 7fae13d23800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:53.033 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:53.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.993+0000 7facc5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.993+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93989984578096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa81980 con 0x557bbfa393f0 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.994+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93989984578096] v35'63 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.994+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93989984561920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa80a10 con 0x7fae0406c040 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.995+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93989984561920] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.995+0000 7fae13d23800 20 remove_watcher() i=0 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.995+0000 7fae13d23800 2 removed watcher, disabling cache 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.995+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93989984565904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa80a10 con 0x557bbfa393f0 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.997+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93989984565904] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.997+0000 7fae13d23800 20 remove_watcher() i=1 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.997+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93989984568656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa80a10 con 0x557bbfa42710 2024-09-19T11:13:53.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.998+0000 7fae0f132640 1 -- 172.21.15.102:0/3017601588 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93989984568656] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae04051070 con 0x557bbfa42710 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.998+0000 7fae13d23800 20 remove_watcher() i=2 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.998+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93989984570960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa80a10 con 0x7fae0406c040 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.999+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93989984570960] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x7fae0406c040 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.999+0000 7fae13d23800 20 remove_watcher() i=3 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:52.999+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93989984575888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa80a10 con 0x557bbfa393f0 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.000+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93989984575888] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae0800a4d0 con 0x557bbfa393f0 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.000+0000 7fae13d23800 20 remove_watcher() i=4 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.000+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93989984573632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa80a10 con 0x557bbfa3db40 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.001+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93989984573632] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.001+0000 7fae13d23800 20 remove_watcher() i=5 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.001+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93989984582576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa80a10 con 0x557bbfa3db40 2024-09-19T11:13:53.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.002+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93989984582576] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.002+0000 7fae13d23800 20 remove_watcher() i=6 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.002+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93989984586896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557bbfa80a10 con 0x557bbfa3db40 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae0f933640 1 -- 172.21.15.102:0/3017601588 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93989984586896] v35'44 uv42 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fae00071020 con 0x557bbfa3db40 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 20 remove_watcher() i=7 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa3db40 msgr2=0x557bbfa3ff30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa3db40 0x557bbfa3ff30 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbfa393f0 msgr2=0x557bbfa3b880 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbfa393f0 0x557bbfa3b880 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fae0406c040 msgr2=0x7fae0405f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fae0406c040 0x7fae0405f420 crc :-1 s=READY pgs=23 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa42710 msgr2=0x557bbfa44bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa42710 0x557bbfa44bd0 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd803d000 msgr2=0x7facd803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd803d000 0x7facd803f4c0 secure :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0x7fae040539f0 tx=0x7fae04053000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 msgr2=0x557bbfa2de40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae10134640 1 -- 172.21.15.102:0/3017601588 reap_dead start 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa2de40 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7fae00018790 tx=0x7fae0003a6b0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 shutdown_connections 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 --2- 172.21.15.102:0/3017601588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa26a40 0x557bbfa2de40 unknown :-1 s=CLOSED pgs=254 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 >> 172.21.15.102:0/3017601588 conn(0x557bbfa22e40 msgr2=0x557bbfa21050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 shutdown_connections 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.003+0000 7fae13d23800 1 -- 172.21.15.102:0/3017601588 wait complete. 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/2234315929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7face803d000 msgr2=0x7face803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/2234315929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7face803d000 0x7face803f4c0 secure :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0x557bbfa08a90 tx=0x7fae04005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:53.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/2234315929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa1a390 msgr2=0x557bbfa1a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/2234315929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa1a390 0x557bbfa1a7b0 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x7fae00052ba0 tx=0x7fae00018720 comp rx=0 tx=0).stop 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/2234315929 shutdown_connections 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/2234315929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7face803d000 0x7face803f4c0 unknown :-1 s=CLOSED pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/2234315929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbfa1a390 0x557bbfa1a7b0 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/2234315929 >> 172.21.15.102:0/2234315929 conn(0x557bbfa0e740 msgr2=0x557bbfa0eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/2234315929 shutdown_connections 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/2234315929 wait complete. 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa05c70 msgr2=0x557bbfa08060 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557bbfa05c70 0x557bbfa08060 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbf906a90 msgr2=0x557bbfa03620 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557bbf906a90 0x557bbfa03620 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa09b20 msgr2=0x557bbfa0bf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557bbfa09b20 0x557bbfa0bf10 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facf803cfb0 msgr2=0x7facf803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facf803cfb0 0x7facf803f470 secure :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0x7fae04057000 tx=0x7fae04052000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 msgr2=0x557bbf9fbfd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 --2- 172.21.15.102:0/142540748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557bbf902f20 0x557bbf9fbfd0 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x557bbf9021c0 tx=0x7fae00000bc0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae10134640 1 -- 172.21.15.102:0/142540748 reap_dead start 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 shutdown_connections 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 >> 172.21.15.102:0/142540748 conn(0x557bbf8fca60 msgr2=0x557bbf9ed7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 shutdown_connections 2024-09-19T11:13:53.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.004+0000 7fae13d23800 1 -- 172.21.15.102:0/142540748 wait complete. 2024-09-19T11:13:53.044 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:53.045 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-19T11:13:53.045 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'create', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'] 2024-09-19T11:13:53.045 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key create --uid foo --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh 2024-09-19T11:13:53.096 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:53.096 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:53.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f1a013af800 1 Processor -- start 2024-09-19T11:13:53.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f1a013af800 1 -- start start 2024-09-19T11:13:53.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f1a013af800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x558998da0550 0x558998e343b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f1a013af800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558998e348f0 con 0x558998d9fa40 2024-09-19T11:13:53.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f1a013af800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x558998cb67d0 con 0x558998da0550 2024-09-19T11:13:53.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f19f7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x558998da0550 0x558998e343b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f19f7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x558998da0550 0x558998e343b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42872/0 (socket says 172.21.15.102:42872) 2024-09-19T11:13:53.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f19fee99640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x558998d9fa40 0x558998d9fe40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52274/0 (socket says 172.21.15.102:52274) 2024-09-19T11:13:53.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f19f7fff640 1 -- 172.21.15.102:0/390044221 learned_addr learned my addr 172.21.15.102:0/390044221 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f19f7fff640 1 -- 172.21.15.102:0/390044221 >> v1:172.21.15.37:6789/0 conn(0x558998d9fa40 legacy=0x558998d9fe40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.096+0000 7f19f7fff640 1 -- 172.21.15.102:0/390044221 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558998e35ad0 con 0x558998da0550 2024-09-19T11:13:53.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.098+0000 7f19f7fff640 1 --2- 172.21.15.102:0/390044221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998da0550 0x558998e343b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f19e800a520 tx=0x7f19e8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a84caa0fe1321273 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.098+0000 7f19fe698640 1 -- 172.21.15.102:0/390044221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19e8055070 con 0x558998da0550 2024-09-19T11:13:53.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.098+0000 7f19fe698640 1 -- 172.21.15.102:0/390044221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19e80515b0 con 0x558998da0550 2024-09-19T11:13:53.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.098+0000 7f19fe698640 1 -- 172.21.15.102:0/390044221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19e80518d0 con 0x558998da0550 2024-09-19T11:13:53.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.099+0000 7f1a013af800 1 -- 172.21.15.102:0/390044221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998da0550 msgr2=0x558998e343b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.099+0000 7f1a013af800 1 --2- 172.21.15.102:0/390044221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998da0550 0x558998e343b0 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x7f19e800a520 tx=0x7f19e8045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.099+0000 7f1a013af800 1 -- 172.21.15.102:0/390044221 shutdown_connections 2024-09-19T11:13:53.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.099+0000 7f1a013af800 1 --2- 172.21.15.102:0/390044221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998da0550 0x558998e343b0 unknown :-1 s=CLOSED pgs=256 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.099+0000 7f1a013af800 1 -- 172.21.15.102:0/390044221 >> 172.21.15.102:0/390044221 conn(0x558998e26c80 msgr2=0x558998e290e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.099+0000 7f1a013af800 1 -- 172.21.15.102:0/390044221 shutdown_connections 2024-09-19T11:13:53.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.099+0000 7f1a013af800 1 -- 172.21.15.102:0/390044221 wait complete. 2024-09-19T11:13:53.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.112+0000 7f1a013af800 1 Processor -- start 2024-09-19T11:13:53.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.112+0000 7f1a013af800 1 -- start start 2024-09-19T11:13:53.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.113+0000 7f1a013af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f1d5b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.113+0000 7f1a013af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558998cc3dd0 con 0x558998d9fa40 2024-09-19T11:13:53.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.113+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f1d5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.113+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f1d5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42884/0 (socket says 172.21.15.102:42884) 2024-09-19T11:13:53.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.113+0000 7f19fee99640 1 -- 172.21.15.102:0/3271498983 learned_addr learned my addr 172.21.15.102:0/3271498983 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.113+0000 7f19fee99640 1 -- 172.21.15.102:0/3271498983 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558998f1dba0 con 0x558998d9fa40 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f19fee99640 1 --2- 172.21.15.102:0/3271498983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f1d5b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19f0001eb0 tx=0x7f19f000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ee9207b6b02c651a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f18ece09640 1 -- 172.21.15.102:0/3271498983 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f000e5c0 con 0x558998d9fa40 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f18ece09640 1 -- 172.21.15.102:0/3271498983 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f0006070 con 0x558998d9fa40 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f18ece09640 1 -- 172.21.15.102:0/3271498983 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f000e8b0 con 0x558998d9fa40 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f1a013af800 1 -- 172.21.15.102:0/3271498983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 msgr2=0x558998f1d5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f1a013af800 1 --2- 172.21.15.102:0/3271498983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f1d5b0 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f19f0001eb0 tx=0x7f19f000b6c0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f1a013af800 1 -- 172.21.15.102:0/3271498983 shutdown_connections 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f1a013af800 1 --2- 172.21.15.102:0/3271498983 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f1d5b0 unknown :-1 s=CLOSED pgs=257 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f1a013af800 1 -- 172.21.15.102:0/3271498983 >> 172.21.15.102:0/3271498983 conn(0x558998e26c80 msgr2=0x558998f18f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.114+0000 7f1a013af800 1 -- 172.21.15.102:0/3271498983 shutdown_connections 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f1a013af800 1 -- 172.21.15.102:0/3271498983 wait complete. 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f1a013af800 1 Processor -- start 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f1a013af800 1 -- start start 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f1a013af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f250d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f1a013af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558998e34d90 con 0x558998d9fa40 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f250d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f250d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42896/0 (socket says 172.21.15.102:42896) 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f19fee99640 1 -- 172.21.15.102:0/92716895 learned_addr learned my addr 172.21.15.102:0/92716895 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.115+0000 7f19fee99640 1 -- 172.21.15.102:0/92716895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558998f25630 con 0x558998d9fa40 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.116+0000 7f19fee99640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f250d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f19f000b700 tx=0x7f19f0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.116+0000 7f18eb606640 1 -- 172.21.15.102:0/92716895 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f001a7c0 con 0x558998d9fa40 2024-09-19T11:13:53.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.116+0000 7f18eb606640 1 -- 172.21.15.102:0/92716895 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f001a960 con 0x558998d9fa40 2024-09-19T11:13:53.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.116+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558998f258c0 con 0x558998d9fa40 2024-09-19T11:13:53.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.116+0000 7f18eb606640 1 -- 172.21.15.102:0/92716895 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f001acc0 con 0x558998d9fa40 2024-09-19T11:13:53.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.116+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558998f262c0 con 0x558998d9fa40 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f18eb606640 1 -- 172.21.15.102:0/92716895 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f19f0017070 con 0x558998d9fa40 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f18eb606640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18e403cfb0 0x7f18e403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f18eb606640 1 -- 172.21.15.102:0/92716895 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f19f0015020 con 0x558998d9fa40 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f19f7fff640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18e403cfb0 0x7f18e403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f1a013af800 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998da0550 0x558998f2c720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f2cc60 con 0x558998da0550 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f19ff69a640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998da0550 0x558998f2c720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f19f7fff640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18e403cfb0 0x7f18e403f470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f19e8057000 tx=0x7f19e8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.117+0000 7f19ff69a640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998da0550 0x558998f2c720 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.118+0000 7f19ff69a640 1 -- 172.21.15.102:0/92716895 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998da0550 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.118+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f2d000 con 0x558998da0550 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.118+0000 7f19ff69a640 1 -- 172.21.15.102:0/92716895 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998da0550 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.118+0000 7f1a013af800 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f2eb00 0x558998f30f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.118+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f31710 con 0x558998f2eb00 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.118+0000 7f19fee99640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f2eb00 0x558998f30f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.119+0000 7f19fee99640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f2eb00 0x558998f30f80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.119+0000 7f19fee99640 1 -- 172.21.15.102:0/92716895 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f19f002e070 con 0x558998f2eb00 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.119+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f2d850 con 0x558998da0550 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.119+0000 7f19ff69a640 1 -- 172.21.15.102:0/92716895 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998da0550 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.119+0000 7f1a013af800 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f32b70 0x558998f34f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.119+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f356a0 con 0x558998f32b70 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.119+0000 7f19f7fff640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f32b70 0x558998f34f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.120+0000 7f19f7fff640 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f32b70 0x558998f34f60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.120+0000 7f19f7fff640 1 -- 172.21.15.102:0/92716895 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f19e8057030 con 0x558998f32b70 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.120+0000 7f1a013af800 1 Processor -- start 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.120+0000 7f1a013af800 1 -- start start 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f1a013af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f43420 0x558998f43840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f1a013af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558998d224a0 con 0x558998f43420 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f43420 0x558998f43840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f43420 0x558998f43840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42910/0 (socket says 172.21.15.102:42910) 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f19fee99640 1 -- 172.21.15.102:0/3614025567 learned_addr learned my addr 172.21.15.102:0/3614025567 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f19fee99640 1 -- 172.21.15.102:0/3614025567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558998f43e80 con 0x558998f43420 2024-09-19T11:13:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f19fee99640 1 --2- 172.21.15.102:0/3614025567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f43420 0x558998f43840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f19f0053230 tx=0x7f19f0017f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f18e8e01640 1 -- 172.21.15.102:0/3614025567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f0045200 con 0x558998f43420 2024-09-19T11:13:53.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f18e8e01640 1 -- 172.21.15.102:0/3614025567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f004c3c0 con 0x558998f43420 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f1a013af800 1 -- 172.21.15.102:0/3614025567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558998f446b0 con 0x558998f43420 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f18e8e01640 1 -- 172.21.15.102:0/3614025567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f004c800 con 0x558998f43420 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.121+0000 7f1a013af800 1 -- 172.21.15.102:0/3614025567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558998f44c50 con 0x558998f43420 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.122+0000 7f18e8e01640 1 -- 172.21.15.102:0/3614025567 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f19f004c9a0 con 0x558998f43420 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.122+0000 7f18e8e01640 1 --2- 172.21.15.102:0/3614025567 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18d803d1a0 0x7f18d803f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.122+0000 7f18e8e01640 1 -- 172.21.15.102:0/3614025567 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f19f003bda0 con 0x558998f43420 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.122+0000 7f19f7fff640 1 --2- 172.21.15.102:0/3614025567 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18d803d1a0 0x7f18d803f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f1a013af800 1 Processor -- start 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f1a013af800 1 -- start start 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f19f7fff640 1 --2- 172.21.15.102:0/3614025567 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18d803d1a0 0x7f18d803f660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x558998f2dbf0 tx=0x7f19e8005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f1a013af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f50140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f1a013af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558998f1dfd0 con 0x558998f4fd40 2024-09-19T11:13:53.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f50140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f50140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42922/0 (socket says 172.21.15.102:42922) 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f19fee99640 1 -- 172.21.15.102:0/4046798705 learned_addr learned my addr 172.21.15.102:0/4046798705 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f19fee99640 1 -- 172.21.15.102:0/4046798705 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558998f50730 con 0x558998f4fd40 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.123+0000 7f19fee99640 1 --2- 172.21.15.102:0/4046798705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f50140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f19f0017fd0 tx=0x7f19f00453f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c5181d394feff822 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f18e27fc640 1 -- 172.21.15.102:0/4046798705 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f004cdc0 con 0x558998f4fd40 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f18e27fc640 1 -- 172.21.15.102:0/4046798705 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f0043970 con 0x558998f4fd40 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f18e27fc640 1 -- 172.21.15.102:0/4046798705 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f0041610 con 0x558998f4fd40 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 -- 172.21.15.102:0/4046798705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 msgr2=0x558998f50140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 --2- 172.21.15.102:0/4046798705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f50140 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f19f0017fd0 tx=0x7f19f00453f0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 -- 172.21.15.102:0/4046798705 shutdown_connections 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 --2- 172.21.15.102:0/4046798705 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f50140 unknown :-1 s=CLOSED pgs=260 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 -- 172.21.15.102:0/4046798705 >> 172.21.15.102:0/4046798705 conn(0x558998f4c140 msgr2=0x558998f4a380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 -- 172.21.15.102:0/4046798705 shutdown_connections 2024-09-19T11:13:53.134 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 -- 172.21.15.102:0/4046798705 wait complete. 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 Processor -- start 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.124+0000 7f1a013af800 1 -- start start 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f1a013af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f571c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f1a013af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558998f50ba0 con 0x558998f4fd40 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f571c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f19fee99640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f571c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42936/0 (socket says 172.21.15.102:42936) 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 learned_addr learned my addr 172.21.15.102:0/2181603712 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558998f57720 con 0x558998f4fd40 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f19fee99640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f571c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19f000efd0 tx=0x7f19f0046f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f18e0ff9640 1 -- 172.21.15.102:0/2181603712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f0027e20 con 0x558998f4fd40 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f18e0ff9640 1 -- 172.21.15.102:0/2181603712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f19f00455b0 con 0x558998f4fd40 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558998f57720 con 0x558998f4fd40 2024-09-19T11:13:53.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.125+0000 7f18e0ff9640 1 -- 172.21.15.102:0/2181603712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f19f00458b0 con 0x558998f4fd40 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.126+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558998f57720 con 0x558998f4fd40 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.126+0000 7f18e0ff9640 1 -- 172.21.15.102:0/2181603712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f19f0045a50 con 0x558998f4fd40 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.126+0000 7f18e0ff9640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18c803d000 0x7f18c803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.127+0000 7f18e0ff9640 1 -- 172.21.15.102:0/2181603712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f19f0058150 con 0x558998f4fd40 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.127+0000 7f19f7fff640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18c803d000 0x7f18c803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.127+0000 7f19f7fff640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18c803d000 0x7f18c803f4c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f19e8051990 tx=0x7f19e806d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.127+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.127+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998f625a0 0x558998f64a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.127+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f651b0 con 0x558998f625a0 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.127+0000 7f19ff69a640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998f625a0 0x558998f64a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.127+0000 7f19ff69a640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998f625a0 0x558998f64a60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 realm 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f655c0 con 0x558998f625a0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f65e90 con 0x558998f625a0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f66f90 0x558998f69380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.128+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f69940 con 0x558998f66f90 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.129+0000 7f19fee99640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f66f90 0x558998f69380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.129+0000 7f19fee99640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f66f90 0x558998f69380 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.129+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.129+0000 7f1a013af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.129+0000 7f1a013af800 20 searching for the correct realm 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.129+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f6b8f0 0x558998f6ddb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.129+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f6e480 con 0x558998f6b8f0 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.129+0000 7f19f7fff640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f6b8f0 0x558998f6ddb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.130+0000 7f19f7fff640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f6b8f0 0x558998f6ddb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.130+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.130+0000 7f19f7fff640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f19e8069040 0x7f19e806a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.130+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f6e480 con 0x7f19e8069040 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.130+0000 7f19ff69a640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f19e8069040 0x7f19e806a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.130+0000 7f19ff69a640 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f19e8069040 0x7f19e806a430 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.131+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.131+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.131+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.131+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.131+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.131+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.131+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.131+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x7f19e8069040 2024-09-19T11:13:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f6b8f0 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.132+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.133+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.133+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.133+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.133+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x7f19e8069040 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.133+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.133+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f6b8f0 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.133+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.133+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f6b8f0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.134+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.134+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.134+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.134+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f6b8f0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.134+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.134+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f6b8f0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.134+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.134+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.135+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.135+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.135+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.135+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.135+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.135+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f6b8f0 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.135+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.135+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x7f19e8069040 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.136+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.136+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.136+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.136+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.136+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.136+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f6b8f0 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.136+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.136+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.137+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.137+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x7f19e8069040 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.137+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.137+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f6b8f0 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.137+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.137+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f66f90 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.138+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.138+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x558998f625a0 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.138+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.138+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558998f66230 con 0x7f19e8069040 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:53.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f6a200 con 0x558998f625a0 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f6a200 con 0x558998f625a0 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f6a200 con 0x558998f6b8f0 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 zone default found 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 4 Realm: () 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 zonegroup default 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.139+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f6ab00 con 0x558998f66f90 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f70420 con 0x558998f6b8f0 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f70880 con 0x558998f6b8f0 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 20 started sync module instance, tier type = 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.140+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f6f790 con 0x7f19e8069040 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.141+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.141+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94049465203888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f6f790 con 0x7f19e8069040 2024-09-19T11:13:53.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.141+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f71360 con 0x558998f625a0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.142+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94049465203888] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.143+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.143+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94049465208368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f6f790 con 0x558998f625a0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.143+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f71db0 con 0x558998f6b8f0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.144+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.144+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94049465211072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f72680 con 0x558998f6b8f0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.144+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f73190 con 0x7f19e8069040 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.144+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94049465208368] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.145+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.145+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94049465211072] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.145+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94049465216064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f73580 con 0x7f19e8069040 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.145+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f73a90 con 0x558998f625a0 2024-09-19T11:13:53.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.146+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.146+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94049465216064] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.146+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94049465213392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f73f40 con 0x558998f625a0 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.146+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f74450 con 0x558998f66f90 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.147+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.147+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94049465201376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f74ca0 con 0x558998f66f90 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.147+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f75700 con 0x558998f66f90 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.147+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94049465213392] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.148+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.148+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94049465219728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f75f50 con 0x558998f66f90 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.148+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f76910 con 0x558998f66f90 2024-09-19T11:13:53.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.148+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94049465201376] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94049465219728] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'45 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94049465223152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f76910 con 0x558998f66f90 2024-09-19T11:13:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f1a013af800 20 add_watcher() i=0 2024-09-19T11:13:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f1a013af800 20 add_watcher() i=1 2024-09-19T11:13:53.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f1a013af800 20 add_watcher() i=2 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f1a013af800 20 add_watcher() i=3 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f1a013af800 20 add_watcher() i=4 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f1a013af800 20 add_watcher() i=5 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.149+0000 7f1a013af800 20 add_watcher() i=6 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.150+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94049465223152] v35'46 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.150+0000 7f1a013af800 20 add_watcher() i=7 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.150+0000 7f1a013af800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.150+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998f79a80 con 0x558998f625a0 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.150+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.150+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94049465230432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998f76d30 con 0x558998f625a0 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.151+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94049465230432] v35'64 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.151+0000 7f18b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.151+0000 7f1a013af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.151+0000 7f1a013af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.151+0000 7f1a013af800 5 note: GC not initialized 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.151+0000 7f182ffff640 20 reqs_thread_entry: start 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.151+0000 7f1a013af800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 20 Filter name: none 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f182dffb640 20 reqs_thread_entry: start 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998faca50 con 0x558998f625a0 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:53.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998fad360 con 0x558998f66f90 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.152+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~502 in=502b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998fb2d50 con 0x558998f625a0 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~502] v35'4 uv4 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f1a013af800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:53.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f1a013af800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f1a013af800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94049465476880 in=690b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998fae3b0 con 0x558998f625a0 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94049465213392 notify 150323855363 ret 0) ==== 720+0+0 (crc 0 0 0) 0x7f19f8018ac0 con 0x558998f625a0 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f18e27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 94049465213392 notifier 4351 bl.length()=678 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f18e27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f18e27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f18e27fc640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f18c4003ea0 con 0x558998f625a0 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(65 notify.4 [notify cookie 94049465476880 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== watch-notify(notify_complete (2) cookie 94049465476880 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f19f8018c90 con 0x558998f625a0 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.154+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998fb2710 con 0x558998f66f90 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f1a013af800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f1a013af800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f1a013af800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94049465476880 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558998fae490 con 0x558998f6b8f0 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== watch-notify(notify (1) cookie 94049465211072 notify 150323855360 ret 0) ==== 219+0+0 (crc 0 0 0) 0x558998e35ad0 con 0x558998f6b8f0 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f18e1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855360 cookie 94049465211072 notifier 4351 bl.length()=177 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f18e1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f18e1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f18e1ffb640 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1834003400 con 0x558998f6b8f0 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 notify.2 [notify cookie 94049465476880 out=8b] v0'0 uv45 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.156+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== watch-notify(notify_complete (2) cookie 94049465476880 notify 150323855360 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f19e8080880 con 0x558998f6b8f0 2024-09-19T11:13:53.169 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-19T11:13:53.153769Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:53.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.157+0000 7f18b57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.157+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94049465230432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998fb1380 con 0x558998f625a0 2024-09-19T11:13:53.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.158+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94049465230432] v35'65 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.158+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94049465203888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998faa820 con 0x7f19e8069040 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.159+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94049465203888] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.159+0000 7f1a013af800 20 remove_watcher() i=0 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.159+0000 7f1a013af800 2 removed watcher, disabling cache 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.159+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94049465208368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998faa820 con 0x558998f625a0 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.160+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94049465208368] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.160+0000 7f1a013af800 20 remove_watcher() i=1 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.160+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94049465211072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998faa820 con 0x558998f6b8f0 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.161+0000 7f19f7fff640 1 -- 172.21.15.102:0/2181603712 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94049465211072] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19e8057030 con 0x558998f6b8f0 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.161+0000 7f1a013af800 20 remove_watcher() i=2 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.161+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94049465216064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998faa820 con 0x7f19e8069040 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.162+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94049465216064] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x7f19e8069040 2024-09-19T11:13:53.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.162+0000 7f1a013af800 20 remove_watcher() i=3 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.162+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94049465213392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998faa820 con 0x558998f625a0 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.163+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94049465213392] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f800a4d0 con 0x558998f625a0 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.163+0000 7f1a013af800 20 remove_watcher() i=4 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.163+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94049465201376] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998faa820 con 0x558998f66f90 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.165+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94049465201376] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.165+0000 7f1a013af800 20 remove_watcher() i=5 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.165+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94049465219728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998faa820 con 0x558998f66f90 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.166+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94049465219728] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.166+0000 7f1a013af800 20 remove_watcher() i=6 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.166+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94049465223152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558998faa820 con 0x558998f66f90 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f19fee99640 1 -- 172.21.15.102:0/2181603712 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94049465223152] v35'47 uv45 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f19f0038070 con 0x558998f66f90 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 20 remove_watcher() i=7 2024-09-19T11:13:53.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f66f90 msgr2=0x558998f69380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f66f90 0x558998f69380 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998f625a0 msgr2=0x558998f64a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998f625a0 0x558998f64a60 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f19e8069040 msgr2=0x7f19e806a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f19e8069040 0x7f19e806a430 crc :-1 s=READY pgs=24 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f6b8f0 msgr2=0x558998f6ddb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f6b8f0 0x558998f6ddb0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18c803d000 msgr2=0x7f18c803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18c803d000 0x7f18c803f4c0 secure :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0x7f19e8051990 tx=0x7f19e806d040 comp rx=0 tx=0).stop 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 msgr2=0x558998f571c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f571c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f19f000efd0 tx=0x7f19f0046f30 comp rx=0 tx=0).stop 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f19ff69a640 1 -- 172.21.15.102:0/2181603712 reap_dead start 2024-09-19T11:13:53.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 shutdown_connections 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/2181603712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f4fd40 0x558998f571c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 >> 172.21.15.102:0/2181603712 conn(0x558998f4c140 msgr2=0x558998f4a350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 shutdown_connections 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/2181603712 wait complete. 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/3614025567 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18d803d1a0 msgr2=0x7f18d803f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/3614025567 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18d803d1a0 0x7f18d803f660 secure :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0x558998f2dbf0 tx=0x7f19e8005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 -- 172.21.15.102:0/3614025567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f43420 msgr2=0x558998f43840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.167+0000 7f1a013af800 1 --2- 172.21.15.102:0/3614025567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f43420 0x558998f43840 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f19f0053230 tx=0x7f19f0017f40 comp rx=0 tx=0).stop 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/3614025567 shutdown_connections 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 --2- 172.21.15.102:0/3614025567 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18d803d1a0 0x7f18d803f660 unknown :-1 s=CLOSED pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 --2- 172.21.15.102:0/3614025567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998f43420 0x558998f43840 unknown :-1 s=CLOSED pgs=259 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/3614025567 >> 172.21.15.102:0/3614025567 conn(0x558998f377d0 msgr2=0x558998f37bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/3614025567 shutdown_connections 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/3614025567 wait complete. 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f2eb00 msgr2=0x558998f30f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558998f2eb00 0x558998f30f80 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998da0550 msgr2=0x558998f2c720 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558998da0550 0x558998f2c720 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f32b70 msgr2=0x558998f34f60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558998f32b70 0x558998f34f60 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18e403cfb0 msgr2=0x7f18e403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f18e403cfb0 0x7f18e403f470 secure :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0x7f19e8057000 tx=0x7f19e8052000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 msgr2=0x558998f250d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 --2- 172.21.15.102:0/92716895 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558998d9fa40 0x558998f250d0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x7f19f000b700 tx=0x7f19f0000bc0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f19ff69a640 1 -- 172.21.15.102:0/92716895 reap_dead start 2024-09-19T11:13:53.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 shutdown_connections 2024-09-19T11:13:53.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 >> 172.21.15.102:0/92716895 conn(0x558998e26c80 msgr2=0x558998f1eaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 shutdown_connections 2024-09-19T11:13:53.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.168+0000 7f1a013af800 1 -- 172.21.15.102:0/92716895 wait complete. 2024-09-19T11:13:53.180 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-19T11:13:53.153769Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:53.180 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:13:53.180 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:13:53.180 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:13:53.224 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:53.225 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:53.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.224+0000 7f1b45326800 1 Processor -- start 2024-09-19T11:13:53.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.224+0000 7f1b45326800 1 -- start start 2024-09-19T11:13:53.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.224+0000 7f1b45326800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555879c8b860 0x555879c94380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.224+0000 7f1b45326800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555879c948c0 con 0x555879c89d40 2024-09-19T11:13:53.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.224+0000 7f1b45326800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x555879b167d0 con 0x555879c8b860 2024-09-19T11:13:53.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.225+0000 7f1b387d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555879c8b860 0x555879c94380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.225+0000 7f1b387d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555879c8b860 0x555879c94380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42952/0 (socket says 172.21.15.102:42952) 2024-09-19T11:13:53.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.225+0000 7f1b387d8640 1 -- 172.21.15.102:0/1231723635 learned_addr learned my addr 172.21.15.102:0/1231723635 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.225+0000 7f1b387d8640 1 -- 172.21.15.102:0/1231723635 >> v1:172.21.15.37:6789/0 conn(0x555879c89d40 legacy=0x555879c8a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.225+0000 7f1b387d8640 1 -- 172.21.15.102:0/1231723635 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555879c95aa0 con 0x555879c8b860 2024-09-19T11:13:53.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.227+0000 7f1b387d8640 1 --2- 172.21.15.102:0/1231723635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c8b860 0x555879c94380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800a520 tx=0x7f1b28045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=79fb9c8f03dd893 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.227+0000 7f1b3bfff640 1 -- 172.21.15.102:0/1231723635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b28055070 con 0x555879c8b860 2024-09-19T11:13:53.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.227+0000 7f1b3bfff640 1 -- 172.21.15.102:0/1231723635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b280515b0 con 0x555879c8b860 2024-09-19T11:13:53.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.227+0000 7f1b3bfff640 1 -- 172.21.15.102:0/1231723635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b280518d0 con 0x555879c8b860 2024-09-19T11:13:53.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.228+0000 7f1b45326800 1 -- 172.21.15.102:0/1231723635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c8b860 msgr2=0x555879c94380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.228+0000 7f1b45326800 1 --2- 172.21.15.102:0/1231723635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c8b860 0x555879c94380 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7f1b2800a520 tx=0x7f1b28045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.228+0000 7f1b45326800 1 -- 172.21.15.102:0/1231723635 shutdown_connections 2024-09-19T11:13:53.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.228+0000 7f1b45326800 1 --2- 172.21.15.102:0/1231723635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c8b860 0x555879c94380 unknown :-1 s=CLOSED pgs=263 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.228+0000 7f1b45326800 1 -- 172.21.15.102:0/1231723635 >> 172.21.15.102:0/1231723635 conn(0x555879c85a90 msgr2=0x555879c87ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.228+0000 7f1b45326800 1 -- 172.21.15.102:0/1231723635 shutdown_connections 2024-09-19T11:13:53.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.228+0000 7f1b45326800 1 -- 172.21.15.102:0/1231723635 wait complete. 2024-09-19T11:13:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.241+0000 7f1b45326800 1 Processor -- start 2024-09-19T11:13:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.241+0000 7f1b45326800 1 -- start start 2024-09-19T11:13:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.241+0000 7f1b45326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d7d4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.241+0000 7f1b45326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555879b23dd0 con 0x555879c89d40 2024-09-19T11:13:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.242+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d7d4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.242+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d7d4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42960/0 (socket says 172.21.15.102:42960) 2024-09-19T11:13:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.242+0000 7f1b40fd9640 1 -- 172.21.15.102:0/3367687862 learned_addr learned my addr 172.21.15.102:0/3367687862 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.242+0000 7f1b40fd9640 1 -- 172.21.15.102:0/3367687862 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555879d7dad0 con 0x555879c89d40 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.242+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/3367687862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d7d4e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b30001da0 tx=0x7f1b3000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=af147cdf17d4f63d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.242+0000 7f1a2ee0d640 1 -- 172.21.15.102:0/3367687862 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3000f400 con 0x555879c89d40 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.242+0000 7f1a2ee0d640 1 -- 172.21.15.102:0/3367687862 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3000f5a0 con 0x555879c89d40 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.242+0000 7f1a2ee0d640 1 -- 172.21.15.102:0/3367687862 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3000f8c0 con 0x555879c89d40 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 -- 172.21.15.102:0/3367687862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 msgr2=0x555879d7d4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 --2- 172.21.15.102:0/3367687862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d7d4e0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x7f1b30001da0 tx=0x7f1b3000b5b0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 -- 172.21.15.102:0/3367687862 shutdown_connections 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 --2- 172.21.15.102:0/3367687862 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d7d4e0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 -- 172.21.15.102:0/3367687862 >> 172.21.15.102:0/3367687862 conn(0x555879c85a90 msgr2=0x555879d78e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 -- 172.21.15.102:0/3367687862 shutdown_connections 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 -- 172.21.15.102:0/3367687862 wait complete. 2024-09-19T11:13:53.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 Processor -- start 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.243+0000 7f1b45326800 1 -- start start 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b45326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d85000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b45326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555879c94d60 con 0x555879c89d40 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d85000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d85000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42962/0 (socket says 172.21.15.102:42962) 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b40fd9640 1 -- 172.21.15.102:0/993768202 learned_addr learned my addr 172.21.15.102:0/993768202 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b40fd9640 1 -- 172.21.15.102:0/993768202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555879d85560 con 0x555879c89d40 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d85000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x555879d7e470 tx=0x7f1b30000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1a2d60a640 1 -- 172.21.15.102:0/993768202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3001a7c0 con 0x555879c89d40 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1a2d60a640 1 -- 172.21.15.102:0/993768202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b3001a960 con 0x555879c89d40 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555879d857f0 con 0x555879c89d40 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1a2d60a640 1 -- 172.21.15.102:0/993768202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3001ac80 con 0x555879c89d40 2024-09-19T11:13:53.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.244+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555879d86400 con 0x555879c89d40 2024-09-19T11:13:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.245+0000 7f1a2d60a640 1 -- 172.21.15.102:0/993768202 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1b30017070 con 0x555879c89d40 2024-09-19T11:13:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.245+0000 7f1a2d60a640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a2803cfb0 0x7f1a2803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1a2d60a640 1 -- 172.21.15.102:0/993768202 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1b30015020 con 0x555879c89d40 2024-09-19T11:13:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1b387d8640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a2803cfb0 0x7f1a2803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1b45326800 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879c8b860 0x555879d8c650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879d8cb90 con 0x555879c8b860 2024-09-19T11:13:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1b417da640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879c8b860 0x555879d8c650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1b387d8640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a2803cfb0 0x7f1a2803f470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1b28057000 tx=0x7f1b28052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1b417da640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879c8b860 0x555879d8c650 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1b417da640 1 -- 172.21.15.102:0/993768202 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879c8b860 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.246+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879d8cf30 con 0x555879c8b860 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.247+0000 7f1b417da640 1 -- 172.21.15.102:0/993768202 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879c8b860 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.247+0000 7f1b45326800 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879d8ea30 0x555879d90ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.247+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879d91660 con 0x555879d8ea30 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.247+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879d8ea30 0x555879d90ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.247+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879d8ea30 0x555879d90ed0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.248+0000 7f1b40fd9640 1 -- 172.21.15.102:0/993768202 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1b3002e070 con 0x555879d8ea30 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.248+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879d8d780 con 0x555879c8b860 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.248+0000 7f1b417da640 1 -- 172.21.15.102:0/993768202 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879c8b860 2024-09-19T11:13:53.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.248+0000 7f1b45326800 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879d92ac0 0x555879d94eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.248+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879d95620 con 0x555879d92ac0 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.248+0000 7f1b387d8640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879d92ac0 0x555879d94eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.248+0000 7f1b387d8640 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879d92ac0 0x555879d94eb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.249+0000 7f1b387d8640 1 -- 172.21.15.102:0/993768202 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1b28057030 con 0x555879d92ac0 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.249+0000 7f1b45326800 1 Processor -- start 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.249+0000 7f1b45326800 1 -- start start 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.249+0000 7f1b45326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879da3330 0x555879da3750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.249+0000 7f1b45326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555879b824a0 con 0x555879da3330 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.249+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879da3330 0x555879da3750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879da3330 0x555879da3750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42968/0 (socket says 172.21.15.102:42968) 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1b40fd9640 1 -- 172.21.15.102:0/4039232817 learned_addr learned my addr 172.21.15.102:0/4039232817 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1b40fd9640 1 -- 172.21.15.102:0/4039232817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555879da3d90 con 0x555879da3330 2024-09-19T11:13:53.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/4039232817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879da3330 0x555879da3750 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b30052bf0 tx=0x7f1b3001be40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1a267fc640 1 -- 172.21.15.102:0/4039232817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3001ccf0 con 0x555879da3330 2024-09-19T11:13:53.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1a267fc640 1 -- 172.21.15.102:0/4039232817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b30017360 con 0x555879da3330 2024-09-19T11:13:53.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1a267fc640 1 -- 172.21.15.102:0/4039232817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b30017c80 con 0x555879da3330 2024-09-19T11:13:53.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1b45326800 1 -- 172.21.15.102:0/4039232817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555879da45c0 con 0x555879da3330 2024-09-19T11:13:53.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.250+0000 7f1b45326800 1 -- 172.21.15.102:0/4039232817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555879da45c0 con 0x555879da3330 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.251+0000 7f1a267fc640 1 -- 172.21.15.102:0/4039232817 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1b3000e070 con 0x555879da3330 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.251+0000 7f1a267fc640 1 --2- 172.21.15.102:0/4039232817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a1803cfb0 0x7f1a1803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.251+0000 7f1a267fc640 1 -- 172.21.15.102:0/4039232817 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1b3003ad70 con 0x555879da3330 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.251+0000 7f1b387d8640 1 --2- 172.21.15.102:0/4039232817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a1803cfb0 0x7f1a1803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.251+0000 7f1b45326800 1 Processor -- start 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.251+0000 7f1b45326800 1 -- start start 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.251+0000 7f1b387d8640 1 --2- 172.21.15.102:0/4039232817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a1803cfb0 0x7f1a1803f470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005570 tx=0x7f1b28005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1b45326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879dafe70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1b45326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555879d7df00 con 0x555879dafa70 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879dafe70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879dafe70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42970/0 (socket says 172.21.15.102:42970) 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1b40fd9640 1 -- 172.21.15.102:0/1810802707 learned_addr learned my addr 172.21.15.102:0/1810802707 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1b40fd9640 1 -- 172.21.15.102:0/1810802707 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555879db0460 con 0x555879dafa70 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/1810802707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879dafe70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000ea80 tx=0x7f1b300274f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4df72a210402671c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1a17fff640 1 -- 172.21.15.102:0/1810802707 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b30019780 con 0x555879dafa70 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1a17fff640 1 -- 172.21.15.102:0/1810802707 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b30031d00 con 0x555879dafa70 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.252+0000 7f1a17fff640 1 -- 172.21.15.102:0/1810802707 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b30051300 con 0x555879dafa70 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 -- 172.21.15.102:0/1810802707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 msgr2=0x555879dafe70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 --2- 172.21.15.102:0/1810802707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879dafe70 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x7f1b3000ea80 tx=0x7f1b300274f0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 -- 172.21.15.102:0/1810802707 shutdown_connections 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 --2- 172.21.15.102:0/1810802707 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879dafe70 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 -- 172.21.15.102:0/1810802707 >> 172.21.15.102:0/1810802707 conn(0x555879dabe70 msgr2=0x555879daa0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 -- 172.21.15.102:0/1810802707 shutdown_connections 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 -- 172.21.15.102:0/1810802707 wait complete. 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 Processor -- start 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 -- start start 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879db6e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b45326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555879db08d0 con 0x555879dafa70 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879db6e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b40fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879db6e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42976/0 (socket says 172.21.15.102:42976) 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.253+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 learned_addr learned my addr 172.21.15.102:0/736936308 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.254+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555879db73b0 con 0x555879dafa70 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.254+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879db6e50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1b3001bfd0 tx=0x7f1b3003df30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.254+0000 7f1a167fc640 1 -- 172.21.15.102:0/736936308 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3006b020 con 0x555879dafa70 2024-09-19T11:13:53.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.254+0000 7f1a167fc640 1 -- 172.21.15.102:0/736936308 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1b30017e20 con 0x555879dafa70 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.254+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555879db73b0 con 0x555879dafa70 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.254+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555879db73b0 con 0x555879dafa70 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.254+0000 7f1a167fc640 1 -- 172.21.15.102:0/736936308 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1b3004bbc0 con 0x555879dafa70 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.255+0000 7f1a167fc640 1 -- 172.21.15.102:0/736936308 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1b3006e020 con 0x555879dafa70 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.255+0000 7f1a167fc640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a0c03d000 0x7f1a0c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.255+0000 7f1a167fc640 1 -- 172.21.15.102:0/736936308 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1b30064040 con 0x555879dafa70 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.255+0000 7f1b387d8640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a0c03d000 0x7f1a0c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.255+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.255+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879dc2420 0x555879dc48e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.255+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dc5030 con 0x555879dc2420 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.255+0000 7f1b417da640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879dc2420 0x555879dc48e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b387d8640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a0c03d000 0x7f1a0c03f4c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b28045be0 tx=0x7f1b2806d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b417da640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879dc2420 0x555879dc48e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 20 realm 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dc5440 con 0x555879dc2420 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dc5d10 con 0x555879dc2420 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.256+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.257+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.257+0000 7f1b45326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.257+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.257+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879dc6be0 0x555879dc8fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.257+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dc9710 con 0x555879dc6be0 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.257+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879dc6be0 0x555879dc8fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.257+0000 7f1b40fd9640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879dc6be0 0x555879dc8fd0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b45326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b45326800 20 searching for the correct realm 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879dcb7b0 0x555879dcdc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dce340 con 0x555879dcb7b0 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b387d8640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879dcb7b0 0x555879dcdc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b387d8640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879dcb7b0 0x555879dcdc70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b387d8640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1b28069040 0x7f1b2806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dce340 con 0x7f1b28069040 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.258+0000 7f1b417da640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1b28069040 0x7f1b2806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.259+0000 7f1b417da640 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1b28069040 0x7f1b2806a940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.259+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.259+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.259+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.259+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.259+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.260+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.260+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.260+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.260+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.260+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.260+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.260+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x7f1b28069040 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.261+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.261+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dcb7b0 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.261+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.261+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.261+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.261+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.261+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.261+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.262+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.262+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x7f1b28069040 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.262+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.262+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dcb7b0 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.262+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.262+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dcb7b0 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.262+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.262+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dcb7b0 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dcb7b0 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.263+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.264+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.264+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dcb7b0 2024-09-19T11:13:53.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.264+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.264+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x7f1b28069040 2024-09-19T11:13:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.264+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.264+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.265+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.265+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.265+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.265+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dcb7b0 2024-09-19T11:13:53.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.265+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.265+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.266+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.266+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x7f1b28069040 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.266+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.266+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dcb7b0 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.266+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.266+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc6be0 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.266+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.266+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x555879dc2420 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555879dc60b0 con 0x7f1b28069040 2024-09-19T11:13:53.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dca0b0 con 0x555879dc2420 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dca0b0 con 0x555879dc2420 2024-09-19T11:13:53.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.267+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dca060 con 0x555879dcb7b0 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 20 zone default found 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 4 Realm: () 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 20 zonegroup default 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dca950 con 0x555879dc6be0 2024-09-19T11:13:53.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dd01b0 con 0x555879dcb7b0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.268+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dd0550 con 0x555879dcb7b0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.269+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.269+0000 7f1b45326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.269+0000 7f1b45326800 20 started sync module instance, tier type = 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.269+0000 7f1b45326800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.269+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dcf650 con 0x7f1b28069040 2024-09-19T11:13:53.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.270+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.270+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93838490008480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dcf650 con 0x7f1b28069040 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.270+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd0f90 con 0x555879dc2420 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.271+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93838490008480] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.271+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.271+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93838490012256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd0f50 con 0x555879dc2420 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.271+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd1a10 con 0x555879dcb7b0 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.272+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93838490012256] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.273+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.273+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93838490015040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd1e30 con 0x555879dcb7b0 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.273+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd2850 con 0x7f1b28069040 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.274+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.274+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93838490018624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd30f0 con 0x7f1b28069040 2024-09-19T11:13:53.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.274+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd3bb0 con 0x555879dc2420 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.274+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93838490015040] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.275+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.275+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93838490018624] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.275+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93838490023552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd3b70 con 0x555879dc2420 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.275+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd2c40 con 0x555879dc6be0 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.276+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93838490023552] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.276+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.276+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93838490005920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd45c0 con 0x555879dc6be0 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.276+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd4e10 con 0x555879dc6be0 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.277+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.277+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93838490030512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd5a80 con 0x555879dc6be0 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.277+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd64c0 con 0x555879dc6be0 2024-09-19T11:13:53.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.277+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93838490005920] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93838490030512] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'48 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93838490034064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd5610 con 0x555879dc6be0 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b45326800 20 add_watcher() i=0 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b45326800 20 add_watcher() i=1 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b45326800 20 add_watcher() i=2 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b45326800 20 add_watcher() i=3 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b45326800 20 add_watcher() i=4 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b45326800 20 add_watcher() i=5 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.278+0000 7f1b45326800 20 add_watcher() i=6 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.279+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93838490034064] v35'49 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.279+0000 7f1b45326800 20 add_watcher() i=7 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.279+0000 7f1b45326800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:53.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.279+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879dd95c0 con 0x555879dc2420 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.279+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.279+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93838490026256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd6a40 con 0x555879dc2420 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.280+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93838490026256] v35'66 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.280+0000 7f19f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.280+0000 7f1b45326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.280+0000 7f1b45326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.280+0000 7f1b45326800 5 note: GC not initialized 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.281+0000 7f19f67e4640 20 reqs_thread_entry: start 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.281+0000 7f1b45326800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.281+0000 7f1b45326800 20 Filter name: none 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.281+0000 7f19ef7fe640 20 reqs_thread_entry: start 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.281+0000 7f1b45326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.292 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.281+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555879e0bd60 con 0x555879dc2420 2024-09-19T11:13:53.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.281+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.281+0000 7f1b45326800 20 rados_obj.operate() r=0 bl.length=502 2024-09-19T11:13:53.293 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"},{"user":"foo","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-19T11:13:53.153769Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.282+0000 7f19f77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.282+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93838490026256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879e0a850 con 0x555879dc2420 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.283+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93838490026256] v35'67 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.283+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93838490008480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd4110 con 0x7f1b28069040 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.284+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93838490008480] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.284+0000 7f1b45326800 20 remove_watcher() i=0 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.284+0000 7f1b45326800 2 removed watcher, disabling cache 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.284+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93838490012256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dcfba0 con 0x555879dc2420 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.285+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93838490012256] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.285+0000 7f1b45326800 20 remove_watcher() i=1 2024-09-19T11:13:53.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.285+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93838490015040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd0a60 con 0x555879dcb7b0 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.286+0000 7f1b387d8640 1 -- 172.21.15.102:0/736936308 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93838490015040] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b28057030 con 0x555879dcb7b0 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.286+0000 7f1b45326800 20 remove_watcher() i=2 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.286+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93838490018624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd1540 con 0x7f1b28069040 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.287+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93838490018624] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x7f1b28069040 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.287+0000 7f1b45326800 20 remove_watcher() i=3 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.287+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93838490023552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd2340 con 0x555879dc2420 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.288+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93838490023552] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b3c00a4d0 con 0x555879dc2420 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.288+0000 7f1b45326800 20 remove_watcher() i=4 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.288+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93838490005920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd2340 con 0x555879dc6be0 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.289+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93838490005920] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.289+0000 7f1b45326800 20 remove_watcher() i=5 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.289+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93838490030512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd2340 con 0x555879dc6be0 2024-09-19T11:13:53.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.290+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93838490030512] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.290+0000 7f1b45326800 20 remove_watcher() i=6 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.290+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93838490034064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555879dd2340 con 0x555879dc6be0 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.291+0000 7f1b40fd9640 1 -- 172.21.15.102:0/736936308 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93838490034064] v35'50 uv48 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1b30040070 con 0x555879dc6be0 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.291+0000 7f1b45326800 20 remove_watcher() i=7 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.291+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879dc6be0 msgr2=0x555879dc8fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.291+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879dc6be0 0x555879dc8fd0 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.291+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879dc2420 msgr2=0x555879dc48e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.291+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879dc2420 0x555879dc48e0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.291+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1b28069040 msgr2=0x7f1b2806a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.291+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1b28069040 0x7f1b2806a940 crc :-1 s=READY pgs=25 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879dcb7b0 msgr2=0x555879dcdc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879dcb7b0 0x555879dcdc70 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a0c03d000 msgr2=0x7f1a0c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a0c03d000 0x7f1a0c03f4c0 secure :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0x7f1b28045be0 tx=0x7f1b2806d040 comp rx=0 tx=0).stop 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 msgr2=0x555879db6e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b417da640 1 -- 172.21.15.102:0/736936308 reap_dead start 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879db6e50 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f1b3001bfd0 tx=0x7f1b3003df30 comp rx=0 tx=0).stop 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 shutdown_connections 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 --2- 172.21.15.102:0/736936308 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879dafa70 0x555879db6e50 unknown :-1 s=CLOSED pgs=268 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 >> 172.21.15.102:0/736936308 conn(0x555879dabe70 msgr2=0x555879daa080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 shutdown_connections 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/736936308 wait complete. 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/4039232817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a1803cfb0 msgr2=0x7f1a1803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 --2- 172.21.15.102:0/4039232817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a1803cfb0 0x7f1a1803f470 secure :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0x7f1b28005570 tx=0x7f1b28005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/4039232817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879da3330 msgr2=0x555879da3750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 --2- 172.21.15.102:0/4039232817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879da3330 0x555879da3750 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f1b30052bf0 tx=0x7f1b3001be40 comp rx=0 tx=0).stop 2024-09-19T11:13:53.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/4039232817 shutdown_connections 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 --2- 172.21.15.102:0/4039232817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a1803cfb0 0x7f1a1803f470 unknown :-1 s=CLOSED pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 --2- 172.21.15.102:0/4039232817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879da3330 0x555879da3750 unknown :-1 s=CLOSED pgs=266 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/4039232817 >> 172.21.15.102:0/4039232817 conn(0x555879d97710 msgr2=0x555879d97af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/4039232817 shutdown_connections 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/4039232817 wait complete. 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.292+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879d8ea30 msgr2=0x555879d90ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555879d8ea30 0x555879d90ed0 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879c8b860 msgr2=0x555879d8c650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555879c8b860 0x555879d8c650 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879d92ac0 msgr2=0x555879d94eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555879d92ac0 0x555879d94eb0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a2803cfb0 msgr2=0x7f1a2803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1a2803cfb0 0x7f1a2803f470 secure :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0x7f1b28057000 tx=0x7f1b28052000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 msgr2=0x555879d85000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 --2- 172.21.15.102:0/993768202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555879c89d40 0x555879d85000 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x555879d7e470 tx=0x7f1b30000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b417da640 1 -- 172.21.15.102:0/993768202 reap_dead start 2024-09-19T11:13:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 shutdown_connections 2024-09-19T11:13:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 >> 172.21.15.102:0/993768202 conn(0x555879c85a90 msgr2=0x555879d7e9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 shutdown_connections 2024-09-19T11:13:53.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.293+0000 7f1b45326800 1 -- 172.21.15.102:0/993768202 wait complete. 2024-09-19T11:13:53.304 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-19T11:13:53.153769Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:53.304 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-19T11:13:53.304 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--uid', 'foo', '--access-key', 'p5YnriCv1nAtykxBrupQ'] 2024-09-19T11:13:53.304 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --uid foo --access-key p5YnriCv1nAtykxBrupQ 2024-09-19T11:13:53.350 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:53.350 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:53.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.350+0000 7fdc3e898800 1 Processor -- start 2024-09-19T11:13:53.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.350+0000 7fdc3e898800 1 -- start start 2024-09-19T11:13:53.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.350+0000 7fdc3e898800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55752a529890 0x55752a5323b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.350+0000 7fdc3e898800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55752a5328f0 con 0x55752a527d70 2024-09-19T11:13:53.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.350+0000 7fdc3e898800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55752a3b47d0 con 0x55752a529890 2024-09-19T11:13:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.351+0000 7fdc33b81640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55752a529890 0x55752a5323b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.351+0000 7fdc33b81640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55752a529890 0x55752a5323b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:42992/0 (socket says 172.21.15.102:42992) 2024-09-19T11:13:53.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.351+0000 7fdc3c382640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55752a527d70 0x55752a528170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52296/0 (socket says 172.21.15.102:52296) 2024-09-19T11:13:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.351+0000 7fdc33b81640 1 -- 172.21.15.102:0/1017025566 learned_addr learned my addr 172.21.15.102:0/1017025566 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.351+0000 7fdc33b81640 1 -- 172.21.15.102:0/1017025566 >> v1:172.21.15.37:6789/0 conn(0x55752a527d70 legacy=0x55752a528170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.351+0000 7fdc33b81640 1 -- 172.21.15.102:0/1017025566 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752a533ad0 con 0x55752a529890 2024-09-19T11:13:53.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc33b81640 1 --2- 172.21.15.102:0/1017025566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a529890 0x55752a5323b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400a520 tx=0x7fdc24045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6583c5d2c65396b8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3bb81640 1 -- 172.21.15.102:0/1017025566 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc24055070 con 0x55752a529890 2024-09-19T11:13:53.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3bb81640 1 -- 172.21.15.102:0/1017025566 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc240515b0 con 0x55752a529890 2024-09-19T11:13:53.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3bb81640 1 -- 172.21.15.102:0/1017025566 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc240518d0 con 0x55752a529890 2024-09-19T11:13:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3e898800 1 -- 172.21.15.102:0/1017025566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a529890 msgr2=0x55752a5323b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1017025566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a529890 0x55752a5323b0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x7fdc2400a520 tx=0x7fdc24045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3e898800 1 -- 172.21.15.102:0/1017025566 shutdown_connections 2024-09-19T11:13:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1017025566 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a529890 0x55752a5323b0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3e898800 1 -- 172.21.15.102:0/1017025566 >> 172.21.15.102:0/1017025566 conn(0x55752a523aa0 msgr2=0x55752a525ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3e898800 1 -- 172.21.15.102:0/1017025566 shutdown_connections 2024-09-19T11:13:53.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.353+0000 7fdc3e898800 1 -- 172.21.15.102:0/1017025566 wait complete. 2024-09-19T11:13:53.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.368+0000 7fdc3e898800 1 Processor -- start 2024-09-19T11:13:53.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.368+0000 7fdc3e898800 1 -- start start 2024-09-19T11:13:53.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.368+0000 7fdc3e898800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a61b590 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.368+0000 7fdc3e898800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55752a3c1dd0 con 0x55752a527d70 2024-09-19T11:13:53.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.368+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a61b590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.368+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a61b590 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43004/0 (socket says 172.21.15.102:43004) 2024-09-19T11:13:53.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.368+0000 7fdc3c382640 1 -- 172.21.15.102:0/4079234365 learned_addr learned my addr 172.21.15.102:0/4079234365 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.369+0000 7fdc3c382640 1 -- 172.21.15.102:0/4079234365 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752a61bb80 con 0x55752a527d70 2024-09-19T11:13:53.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.369+0000 7fdc3c382640 1 --2- 172.21.15.102:0/4079234365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a61b590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c00b260 tx=0x7fdc2c00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7ef17ae8c3b48ccf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.369+0000 7fdb2a60c640 1 -- 172.21.15.102:0/4079234365 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c00be60 con 0x55752a527d70 2024-09-19T11:13:53.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.369+0000 7fdb2a60c640 1 -- 172.21.15.102:0/4079234365 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c006070 con 0x55752a527d70 2024-09-19T11:13:53.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.369+0000 7fdb2a60c640 1 -- 172.21.15.102:0/4079234365 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c00e710 con 0x55752a527d70 2024-09-19T11:13:53.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.370+0000 7fdc3e898800 1 -- 172.21.15.102:0/4079234365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 msgr2=0x55752a61b590 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.370+0000 7fdc3e898800 1 --2- 172.21.15.102:0/4079234365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a61b590 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c00b260 tx=0x7fdc2c00b660 comp rx=0 tx=0).stop 2024-09-19T11:13:53.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.370+0000 7fdc3e898800 1 -- 172.21.15.102:0/4079234365 shutdown_connections 2024-09-19T11:13:53.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.370+0000 7fdc3e898800 1 --2- 172.21.15.102:0/4079234365 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a61b590 unknown :-1 s=CLOSED pgs=271 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.370+0000 7fdc3e898800 1 -- 172.21.15.102:0/4079234365 >> 172.21.15.102:0/4079234365 conn(0x55752a523aa0 msgr2=0x55752a616f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.370+0000 7fdc3e898800 1 -- 172.21.15.102:0/4079234365 shutdown_connections 2024-09-19T11:13:53.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.370+0000 7fdc3e898800 1 -- 172.21.15.102:0/4079234365 wait complete. 2024-09-19T11:13:53.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.371+0000 7fdc3e898800 1 Processor -- start 2024-09-19T11:13:53.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.371+0000 7fdc3e898800 1 -- start start 2024-09-19T11:13:53.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.371+0000 7fdc3e898800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a623090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.371+0000 7fdc3e898800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55752a532dc0 con 0x55752a527d70 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.371+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a623090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.371+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a623090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43020/0 (socket says 172.21.15.102:43020) 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.371+0000 7fdc3c382640 1 -- 172.21.15.102:0/2879339518 learned_addr learned my addr 172.21.15.102:0/2879339518 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.371+0000 7fdc3c382640 1 -- 172.21.15.102:0/2879339518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752a6235f0 con 0x55752a527d70 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.372+0000 7fdc3c382640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a623090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55752a61c520 tx=0x7fdc2c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.372+0000 7fdb28e09640 1 -- 172.21.15.102:0/2879339518 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c00ee10 con 0x55752a527d70 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.372+0000 7fdb28e09640 1 -- 172.21.15.102:0/2879339518 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c00fa30 con 0x55752a527d70 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.372+0000 7fdb28e09640 1 -- 172.21.15.102:0/2879339518 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c00fd50 con 0x55752a527d70 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.372+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55752a623880 con 0x55752a527d70 2024-09-19T11:13:53.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.372+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752a624280 con 0x55752a527d70 2024-09-19T11:13:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.373+0000 7fdb28e09640 1 -- 172.21.15.102:0/2879339518 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdc2c017070 con 0x55752a527d70 2024-09-19T11:13:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.373+0000 7fdb28e09640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb2403d000 0x7fdb2403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.373+0000 7fdb28e09640 1 -- 172.21.15.102:0/2879339518 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fdc2c015020 con 0x55752a527d70 2024-09-19T11:13:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.373+0000 7fdc33b81640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb2403d000 0x7fdb2403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.373+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a529890 0x55752a62a6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.373+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a62ac20 con 0x55752a529890 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.374+0000 7fdc3cb83640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a529890 0x55752a62a6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.374+0000 7fdc3cb83640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a529890 0x55752a62a6e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.374+0000 7fdc33b81640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb2403d000 0x7fdb2403f4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc24057000 tx=0x7fdc24052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.374+0000 7fdc3cb83640 1 -- 172.21.15.102:0/2879339518 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a529890 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.374+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a62afc0 con 0x55752a529890 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.374+0000 7fdc3cb83640 1 -- 172.21.15.102:0/2879339518 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a529890 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.374+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a62cac0 0x55752a62ef40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.374+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a62f6d0 con 0x55752a62cac0 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.375+0000 7fdc3c382640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a62cac0 0x55752a62ef40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.375+0000 7fdc3c382640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a62cac0 0x55752a62ef40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.375+0000 7fdc3c382640 1 -- 172.21.15.102:0/2879339518 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fdc2c02e070 con 0x55752a62cac0 2024-09-19T11:13:53.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.375+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a62b810 con 0x55752a529890 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.376+0000 7fdc3cb83640 1 -- 172.21.15.102:0/2879339518 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a529890 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.376+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a630b30 0x55752a632f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.376+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a633690 con 0x55752a630b30 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.376+0000 7fdc33b81640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a630b30 0x55752a632f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.376+0000 7fdc33b81640 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a630b30 0x55752a632f20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.376+0000 7fdc33b81640 1 -- 172.21.15.102:0/2879339518 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fdc24057030 con 0x55752a630b30 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.377+0000 7fdc3e898800 1 Processor -- start 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.377+0000 7fdc3e898800 1 -- start start 2024-09-19T11:13:53.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.377+0000 7fdc3e898800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a6413d0 0x55752a6417f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.377+0000 7fdc3e898800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55752a4204a0 con 0x55752a6413d0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.377+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a6413d0 0x55752a6417f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.377+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a6413d0 0x55752a6417f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43036/0 (socket says 172.21.15.102:43036) 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.377+0000 7fdc3c382640 1 -- 172.21.15.102:0/2400020255 learned_addr learned my addr 172.21.15.102:0/2400020255 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.377+0000 7fdc3c382640 1 -- 172.21.15.102:0/2400020255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752a641e30 con 0x55752a6413d0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.378+0000 7fdc3c382640 1 --2- 172.21.15.102:0/2400020255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a6413d0 0x55752a6417f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0174d0 tx=0x7fdc2c0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.378+0000 7fdb21ffb640 1 -- 172.21.15.102:0/2400020255 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c01bc80 con 0x55752a6413d0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.378+0000 7fdc3e898800 1 -- 172.21.15.102:0/2400020255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55752a642660 con 0x55752a6413d0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.378+0000 7fdb21ffb640 1 -- 172.21.15.102:0/2400020255 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c01be20 con 0x55752a6413d0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.378+0000 7fdb21ffb640 1 -- 172.21.15.102:0/2400020255 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c04c010 con 0x55752a6413d0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.378+0000 7fdc3e898800 1 -- 172.21.15.102:0/2400020255 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752a642c00 con 0x55752a6413d0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdb21ffb640 1 -- 172.21.15.102:0/2400020255 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdc2c04c1b0 con 0x55752a6413d0 2024-09-19T11:13:53.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdb21ffb640 1 --2- 172.21.15.102:0/2400020255 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb1403cfb0 0x7fdb1403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdb21ffb640 1 -- 172.21.15.102:0/2400020255 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fdc2c03bcc0 con 0x55752a6413d0 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdc33b81640 1 --2- 172.21.15.102:0/2400020255 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb1403cfb0 0x7fdb1403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdc3e898800 1 Processor -- start 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdc3e898800 1 -- start start 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdc33b81640 1 --2- 172.21.15.102:0/2400020255 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb1403cfb0 0x7fdb1403f470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc24000c00 tx=0x7fdc24005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdc3e898800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a64e030 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.379+0000 7fdc3e898800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55752a61bfb0 con 0x55752a64dc30 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a64e030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a64e030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43044/0 (socket says 172.21.15.102:43044) 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdc3c382640 1 -- 172.21.15.102:0/1117225948 learned_addr learned my addr 172.21.15.102:0/1117225948 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdc3c382640 1 -- 172.21.15.102:0/1117225948 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752a64e620 con 0x55752a64dc30 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdc3c382640 1 --2- 172.21.15.102:0/1117225948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a64e030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c017890 tx=0x7fdc2c031b80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=41febb55ed803181 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdb1b7fe640 1 -- 172.21.15.102:0/1117225948 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c036040 con 0x55752a64dc30 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdb1b7fe640 1 -- 172.21.15.102:0/1117225948 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c046440 con 0x55752a64dc30 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdb1b7fe640 1 -- 172.21.15.102:0/1117225948 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c04c4a0 con 0x55752a64dc30 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdc3e898800 1 -- 172.21.15.102:0/1117225948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 msgr2=0x55752a64e030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1117225948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a64e030 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c017890 tx=0x7fdc2c031b80 comp rx=0 tx=0).stop 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.380+0000 7fdc3e898800 1 -- 172.21.15.102:0/1117225948 shutdown_connections 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1117225948 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a64e030 unknown :-1 s=CLOSED pgs=274 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3e898800 1 -- 172.21.15.102:0/1117225948 >> 172.21.15.102:0/1117225948 conn(0x55752a64a030 msgr2=0x55752a648270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3e898800 1 -- 172.21.15.102:0/1117225948 shutdown_connections 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3e898800 1 -- 172.21.15.102:0/1117225948 wait complete. 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3e898800 1 Processor -- start 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3e898800 1 -- start start 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3e898800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a655030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3e898800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55752a64ea90 con 0x55752a64dc30 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a655030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3c382640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a655030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43048/0 (socket says 172.21.15.102:43048) 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 learned_addr learned my addr 172.21.15.102:0/1834887771 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.381+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55752a655590 con 0x55752a64dc30 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.382+0000 7fdc3c382640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a655030 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c056010 tx=0x7fdc2c0178e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.382+0000 7fdb19ffb640 1 -- 172.21.15.102:0/1834887771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c06c070 con 0x55752a64dc30 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.382+0000 7fdb19ffb640 1 -- 172.21.15.102:0/1834887771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fdc2c04e680 con 0x55752a64dc30 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.382+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55752a655590 con 0x55752a64dc30 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.382+0000 7fdb19ffb640 1 -- 172.21.15.102:0/1834887771 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fdc2c036040 con 0x55752a64dc30 2024-09-19T11:13:53.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.382+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55752a655590 con 0x55752a64dc30 2024-09-19T11:13:53.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.383+0000 7fdb19ffb640 1 -- 172.21.15.102:0/1834887771 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fdc2c06f070 con 0x55752a64dc30 2024-09-19T11:13:53.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.383+0000 7fdb19ffb640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb0c03cf60 0x7fdb0c03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.383+0000 7fdb19ffb640 1 -- 172.21.15.102:0/1834887771 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fdc2c064070 con 0x55752a64dc30 2024-09-19T11:13:53.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.383+0000 7fdc33b81640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb0c03cf60 0x7fdb0c03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.383+0000 7fdc33b81640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb0c03cf60 0x7fdb0c03f420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55752a633a90 tx=0x7fdc2406d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a6605d0 0x55752a662a90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a6631e0 con 0x55752a6605d0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3cb83640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a6605d0 0x55752a662a90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3cb83640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a6605d0 0x55752a662a90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3e898800 20 realm 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.384+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a6635f0 con 0x55752a6605d0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a663ec0 con 0x55752a6605d0 2024-09-19T11:13:53.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a664fc0 0x55752a6673b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a667970 con 0x55752a664fc0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.385+0000 7fdc3c382640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a664fc0 0x55752a6673b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.386+0000 7fdc3c382640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a664fc0 0x55752a6673b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.386+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.386+0000 7fdc3e898800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:53.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.386+0000 7fdc3e898800 20 searching for the correct realm 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.386+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a669920 0x55752a66bde0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.386+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a66c4b0 con 0x55752a669920 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.386+0000 7fdc33b81640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a669920 0x55752a66bde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.387+0000 7fdc33b81640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a669920 0x55752a66bde0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.387+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.387+0000 7fdc33b81640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fdc24069040 0x7fdc2406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.387+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a66c4b0 con 0x7fdc24069040 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.387+0000 7fdc3cb83640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fdc24069040 0x7fdc2406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.387+0000 7fdc3cb83640 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fdc24069040 0x7fdc2406a940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.387+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.388+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.388+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.388+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.388+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.388+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.388+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.388+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.389+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.389+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.389+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.389+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x7fdc24069040 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.389+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.389+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a669920 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.389+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.389+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.390+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.390+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.390+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.390+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.390+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.390+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x7fdc24069040 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.390+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.390+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a669920 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a669920 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a669920 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a669920 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.391+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.392+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.392+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.392+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.392+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.392+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.392+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a669920 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.392+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.392+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x7fdc24069040 2024-09-19T11:13:53.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.393+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.393+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.393+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.393+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.393+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.393+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a669920 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.393+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.394+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.394+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.394+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x7fdc24069040 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.394+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.394+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a669920 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.394+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.394+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a664fc0 2024-09-19T11:13:53.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.394+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x55752a6605d0 2024-09-19T11:13:53.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55752a664260 con 0x7fdc24069040 2024-09-19T11:13:53.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a668230 con 0x55752a6605d0 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.395+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a668230 con 0x55752a6605d0 2024-09-19T11:13:53.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a668230 con 0x55752a669920 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 zone default found 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 4 Realm: () 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 zonegroup default 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a668b10 con 0x55752a664fc0 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a66e420 con 0x55752a669920 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.396+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.397+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a66e850 con 0x55752a669920 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.397+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.397+0000 7fdc3e898800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.397+0000 7fdc3e898800 20 started sync module instance, tier type = 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.397+0000 7fdc3e898800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:53.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.397+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a66d7c0 con 0x7fdc24069040 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.398+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.398+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93961710918848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a66d7c0 con 0x7fdc24069040 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.398+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a66f330 con 0x55752a6605d0 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.399+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93961710918848] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.399+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.399+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93961710923296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a66f2f0 con 0x55752a6605d0 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.399+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a66fda0 con 0x55752a669920 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.400+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.400+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93961710926000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a670650 con 0x55752a669920 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.400+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a671160 con 0x7fdc24069040 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.401+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93961710923296] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.401+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93961710926000] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.401+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.401+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93961710928192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a66d310 con 0x7fdc24069040 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.401+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a671b70 con 0x55752a6605d0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.402+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93961710928192] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.402+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.402+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93961710930960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a671b70 con 0x55752a6605d0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.402+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a672400 con 0x55752a664fc0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.403+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93961710930960] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.404+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.404+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93961710934176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6727f0 con 0x55752a664fc0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.404+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6731b0 con 0x55752a664fc0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.405+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.405+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93961710941600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a673e70 con 0x55752a664fc0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.405+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a674890 con 0x55752a664fc0 2024-09-19T11:13:53.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.405+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93961710934176] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.405+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93961710941600] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'51 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93961710945152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6739c0 con 0x55752a664fc0 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3e898800 20 add_watcher() i=0 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3e898800 20 add_watcher() i=1 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3e898800 20 add_watcher() i=2 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3e898800 20 add_watcher() i=3 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3e898800 20 add_watcher() i=4 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3e898800 20 add_watcher() i=5 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.406+0000 7fdc3e898800 20 add_watcher() i=6 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.407+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93961710945152] v35'52 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.407+0000 7fdc3e898800 20 add_watcher() i=7 2024-09-19T11:13:53.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.407+0000 7fdc3e898800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.407+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a677990 con 0x55752a6605d0 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.407+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.407+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93961710935296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a674e10 con 0x55752a6605d0 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.408+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93961710935296] v35'68 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.408+0000 7fdaf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.408+0000 7fdc3e898800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.408+0000 7fdc3e898800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.408+0000 7fdc3e898800 5 note: GC not initialized 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.408+0000 7fdaf17e2640 20 reqs_thread_entry: start 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.408+0000 7fdc3e898800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 20 Filter name: none 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fda62ffd640 20 reqs_thread_entry: start 2024-09-19T11:13:53.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:53.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a6aa670 con 0x55752a6605d0 2024-09-19T11:13:53.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~502 out=502b,getxattrs out=75b] v0'0 uv4 ondisk = 0) ==== 231+0+625 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 20 rados_obj.operate() r=0 bl.length=502 2024-09-19T11:13:53.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:53.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:53.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.409+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6b0b40 con 0x55752a6605d0 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdc3e898800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdc3e898800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdc3e898800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93961711191424 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a6ac220 con 0x55752a6605d0 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 93961710930960 notify 150323855364 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fdc34018db0 con 0x55752a6605d0 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdb1b7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 93961710930960 notifier 4365 bl.length()=567 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdb1b7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:53.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdb1b7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(64 notify.4 [notify cookie 93961711191424 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.410+0000 7fdb1b7fe640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fdb00003ea0 con 0x55752a6605d0 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.411+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.411+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 93961711191424 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdc34026410 con 0x55752a6605d0 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.411+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6b0580 con 0x55752a664fc0 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.412+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(66 p5YnriCv1nAtykxBrupQ [delete] v35'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.412+0000 7fdc3e898800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.412+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [notify cookie 93961711191424 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55752a6abd70 con 0x55752a669920 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.412+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== watch-notify(notify (1) cookie 93961710926000 notify 150323855361 ret 0) ==== 212+0+0 (crc 0 0 0) 0x55752a533ad0 con 0x55752a669920 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.412+0000 7fdb1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855361 cookie 93961710926000 notifier 4365 bl.length()=170 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.413+0000 7fdb1affd640 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fda700032c0 con 0x55752a669920 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.413+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 notify.2 [notify cookie 93961711191424 out=8b] v0'0 uv51 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.413+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(68 notify.2 [notify-ack] v0'0 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.413+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== watch-notify(notify_complete (2) cookie 93961711191424 notify 150323855361 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fdc24080680 con 0x55752a669920 2024-09-19T11:13:53.422 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.414+0000 7fdaf27e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.414+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93961710935296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x55752a6605d0 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.415+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 93961710935296] v35'69 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.415+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93961710918848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x7fdc24069040 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.416+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 93961710918848] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.416+0000 7fdc3e898800 20 remove_watcher() i=0 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.416+0000 7fdc3e898800 2 removed watcher, disabling cache 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.416+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93961710923296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x55752a6605d0 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.417+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 93961710923296] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.417+0000 7fdc3e898800 20 remove_watcher() i=1 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.417+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93961710926000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x55752a669920 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.418+0000 7fdc33b81640 1 -- 172.21.15.102:0/1834887771 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 93961710926000] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc24057030 con 0x55752a669920 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.418+0000 7fdc3e898800 20 remove_watcher() i=2 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.418+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93961710928192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x7fdc24069040 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.419+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 93961710928192] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x7fdc24069040 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.419+0000 7fdc3e898800 20 remove_watcher() i=3 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.419+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93961710930960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x55752a6605d0 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.420+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 93961710930960] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc3400a4d0 con 0x55752a6605d0 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.420+0000 7fdc3e898800 20 remove_watcher() i=4 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.420+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93961710934176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x55752a664fc0 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.421+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 93961710934176] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.421+0000 7fdc3e898800 20 remove_watcher() i=5 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.421+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93961710941600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x55752a664fc0 2024-09-19T11:13:53.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.422+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 93961710941600] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.422+0000 7fdc3e898800 20 remove_watcher() i=6 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.422+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93961710945152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55752a6a8480 con 0x55752a664fc0 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3c382640 1 -- 172.21.15.102:0/1834887771 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 93961710945152] v35'53 uv51 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fdc2c06e030 con 0x55752a664fc0 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 20 remove_watcher() i=7 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a664fc0 msgr2=0x55752a6673b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a664fc0 0x55752a6673b0 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a6605d0 msgr2=0x55752a662a90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a6605d0 0x55752a662a90 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fdc24069040 msgr2=0x7fdc2406a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fdc24069040 0x7fdc2406a940 crc :-1 s=READY pgs=26 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a669920 msgr2=0x55752a66bde0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a669920 0x55752a66bde0 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb0c03cf60 msgr2=0x7fdb0c03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb0c03cf60 0x7fdb0c03f420 secure :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0x55752a633a90 tx=0x7fdc2406d040 comp rx=0 tx=0).stop 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 msgr2=0x55752a655030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 --2- 172.21.15.102:0/1834887771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a64dc30 0x55752a655030 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c056010 tx=0x7fdc2c0178e0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 reap_dead start 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3cb83640 1 -- 172.21.15.102:0/1834887771 reap_dead start 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 shutdown_connections 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 >> 172.21.15.102:0/1834887771 conn(0x55752a64a030 msgr2=0x55752a648240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 shutdown_connections 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.423+0000 7fdc3e898800 1 -- 172.21.15.102:0/1834887771 wait complete. 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2400020255 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb1403cfb0 msgr2=0x7fdb1403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2400020255 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb1403cfb0 0x7fdb1403f470 secure :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0x7fdc24000c00 tx=0x7fdc24005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2400020255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a6413d0 msgr2=0x55752a6417f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2400020255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a6413d0 0x55752a6417f0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x7fdc2c0174d0 tx=0x7fdc2c0197b0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2400020255 shutdown_connections 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2400020255 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb1403cfb0 0x7fdb1403f470 unknown :-1 s=CLOSED pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2400020255 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a6413d0 0x55752a6417f0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2400020255 >> 172.21.15.102:0/2400020255 conn(0x55752a635780 msgr2=0x55752a635b60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2400020255 shutdown_connections 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2400020255 wait complete. 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a62cac0 msgr2=0x55752a62ef40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55752a62cac0 0x55752a62ef40 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a529890 msgr2=0x55752a62a6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55752a529890 0x55752a62a6e0 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a630b30 msgr2=0x55752a632f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55752a630b30 0x55752a632f20 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb2403d000 msgr2=0x7fdb2403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.431 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fdb2403d000 0x7fdb2403f4c0 secure :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0x7fdc24057000 tx=0x7fdc24052000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 msgr2=0x55752a623090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 --2- 172.21.15.102:0/2879339518 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55752a527d70 0x55752a623090 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x55752a61c520 tx=0x7fdc2c000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3cb83640 1 -- 172.21.15.102:0/2879339518 reap_dead start 2024-09-19T11:13:53.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 shutdown_connections 2024-09-19T11:13:53.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 >> 172.21.15.102:0/2879339518 conn(0x55752a523aa0 msgr2=0x55752a61ca80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 shutdown_connections 2024-09-19T11:13:53.432 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.424+0000 7fdc3e898800 1 -- 172.21.15.102:0/2879339518 wait complete. 2024-09-19T11:13:53.434 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:53.434 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-19T11:13:53.434 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo1', '--access', 'full'] 2024-09-19T11:13:53.434 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo1 --access full 2024-09-19T11:13:53.480 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:53.481 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:53.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.480+0000 7ff1eb72e800 1 Processor -- start 2024-09-19T11:13:53.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.480+0000 7ff1eb72e800 1 -- start start 2024-09-19T11:13:53.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.481+0000 7ff1eb72e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a581822eb0 0x55a5818252a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.481+0000 7ff1eb72e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a5818295f0 con 0x55a5818258d0 2024-09-19T11:13:53.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.481+0000 7ff1eb72e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55a5816ad7d0 con 0x55a581822eb0 2024-09-19T11:13:53.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.481+0000 7ff1e74dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a581822eb0 0x55a5818252a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.481+0000 7ff1dffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55a5818258d0 0x55a581827d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52298/0 (socket says 172.21.15.102:52298) 2024-09-19T11:13:53.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.481+0000 7ff1dffff640 1 -- 172.21.15.102:0/1884792440 learned_addr learned my addr 172.21.15.102:0/1884792440 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:53.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.481+0000 7ff1e74dd640 1 -- 172.21.15.102:0/1884792440 >> v1:172.21.15.37:6789/0 conn(0x55a5818258d0 legacy=0x55a581827d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.481+0000 7ff1e74dd640 1 -- 172.21.15.102:0/1884792440 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58182a820 con 0x55a581822eb0 2024-09-19T11:13:53.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.483+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/1884792440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a5818252a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800a470 tx=0x7ff1d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1df2c2be61d426f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.483+0000 7ff1e6cdc640 1 -- 172.21.15.102:0/1884792440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d8053570 con 0x55a581822eb0 2024-09-19T11:13:53.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.483+0000 7ff1e6cdc640 1 -- 172.21.15.102:0/1884792440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d8058070 con 0x55a581822eb0 2024-09-19T11:13:53.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.483+0000 7ff1e6cdc640 1 -- 172.21.15.102:0/1884792440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d8053880 con 0x55a581822eb0 2024-09-19T11:13:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.483+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1884792440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 msgr2=0x55a5818252a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.483+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/1884792440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a5818252a0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x7ff1d800a470 tx=0x7ff1d8045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.484+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1884792440 shutdown_connections 2024-09-19T11:13:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.484+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/1884792440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a5818252a0 unknown :-1 s=CLOSED pgs=277 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.484+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1884792440 >> 172.21.15.102:0/1884792440 conn(0x55a58181ca70 msgr2=0x55a58181eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.484+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1884792440 shutdown_connections 2024-09-19T11:13:53.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.484+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1884792440 wait complete. 2024-09-19T11:13:53.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.497+0000 7ff1eb72e800 1 Processor -- start 2024-09-19T11:13:53.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.497+0000 7ff1eb72e800 1 -- start start 2024-09-19T11:13:53.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.497+0000 7ff1eb72e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a581912360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.497+0000 7ff1eb72e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a5816badd0 con 0x55a581822eb0 2024-09-19T11:13:53.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.498+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a581912360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.498+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a581912360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43066/0 (socket says 172.21.15.102:43066) 2024-09-19T11:13:53.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.498+0000 7ff1e74dd640 1 -- 172.21.15.102:0/1208782046 learned_addr learned my addr 172.21.15.102:0/1208782046 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.498+0000 7ff1e74dd640 1 -- 172.21.15.102:0/1208782046 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a581912950 con 0x55a581822eb0 2024-09-19T11:13:53.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.498+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/1208782046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a581912360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8025c20 tx=0x7ff1d8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5a87806081dde0da server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.498+0000 7ff0d560a640 1 -- 172.21.15.102:0/1208782046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d805c580 con 0x55a581822eb0 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.498+0000 7ff0d560a640 1 -- 172.21.15.102:0/1208782046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d8063030 con 0x55a581822eb0 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.498+0000 7ff0d560a640 1 -- 172.21.15.102:0/1208782046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d805c850 con 0x55a581822eb0 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1208782046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 msgr2=0x55a581912360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/1208782046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a581912360 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8025c20 tx=0x7ff1d8051000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1208782046 shutdown_connections 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/1208782046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a581912360 unknown :-1 s=CLOSED pgs=278 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1208782046 >> 172.21.15.102:0/1208782046 conn(0x55a58181ca70 msgr2=0x55a58190dce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1208782046 shutdown_connections 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1208782046 wait complete. 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 Processor -- start 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 -- start start 2024-09-19T11:13:53.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a5818225d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.499+0000 7ff1eb72e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a581829ac0 con 0x55a581822eb0 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.500+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a5818225d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.500+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a5818225d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43076/0 (socket says 172.21.15.102:43076) 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.500+0000 7ff1e74dd640 1 -- 172.21.15.102:0/4194416276 learned_addr learned my addr 172.21.15.102:0/4194416276 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.500+0000 7ff1e74dd640 1 -- 172.21.15.102:0/4194416276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a581822b30 con 0x55a581822eb0 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.500+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a5818225d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8045f50 tx=0x7ff1d8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.500+0000 7ff0d3e07640 1 -- 172.21.15.102:0/4194416276 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d8054ad0 con 0x55a581822eb0 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.500+0000 7ff0d3e07640 1 -- 172.21.15.102:0/4194416276 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d8054c70 con 0x55a581822eb0 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.501+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a581820ee0 con 0x55a581822eb0 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.501+0000 7ff0d3e07640 1 -- 172.21.15.102:0/4194416276 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d8068420 con 0x55a581822eb0 2024-09-19T11:13:53.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.501+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a5818214a0 con 0x55a581822eb0 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.501+0000 7ff0d3e07640 1 -- 172.21.15.102:0/4194416276 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff1d80685c0 con 0x55a581822eb0 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff0d3e07640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0cc03d000 0x7ff0cc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff0d3e07640 1 -- 172.21.15.102:0/4194416276 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff1d8070030 con 0x55a581822eb0 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff1dffff640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0cc03d000 0x7ff0cc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a5818258d0 0x55a5819232c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a581923800 con 0x55a5818258d0 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff1e7cde640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a5818258d0 0x55a5819232c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff1dffff640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0cc03d000 0x7ff0cc03f4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0001d70 tx=0x7ff1d00012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.507 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff1e7cde640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a5818258d0 0x55a5819232c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff1e7cde640 1 -- 172.21.15.102:0/4194416276 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a5818258d0 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.502+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a581924080 con 0x55a5818258d0 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.503+0000 7ff1e7cde640 1 -- 172.21.15.102:0/4194416276 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a5818258d0 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.503+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a581925990 0x55a581927e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.503+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a5819285c0 con 0x55a581925990 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.503+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a581925990 0x55a581927e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.503+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a581925990 0x55a581927e30 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.504+0000 7ff1e74dd640 1 -- 172.21.15.102:0/4194416276 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff1d8051070 con 0x55a581925990 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.504+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a5819248d0 con 0x55a5818258d0 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.504+0000 7ff1e7cde640 1 -- 172.21.15.102:0/4194416276 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a5818258d0 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.504+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581929a20 0x55a58192be10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.504+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a58192c550 con 0x55a581929a20 2024-09-19T11:13:53.508 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.504+0000 7ff1dffff640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581929a20 0x55a58192be10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.504+0000 7ff1dffff640 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581929a20 0x55a58192be10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.505+0000 7ff1dffff640 1 -- 172.21.15.102:0/4194416276 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581929a20 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.505+0000 7ff1eb72e800 1 Processor -- start 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.505+0000 7ff1eb72e800 1 -- start start 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.505+0000 7ff1eb72e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a58193a290 0x55a58193a6b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.505+0000 7ff1eb72e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a5817194a0 con 0x55a58193a290 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.505+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a58193a290 0x55a58193a6b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.505+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a58193a290 0x55a58193a6b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43088/0 (socket says 172.21.15.102:43088) 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.505+0000 7ff1e74dd640 1 -- 172.21.15.102:0/1341425941 learned_addr learned my addr 172.21.15.102:0/1341425941 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.506+0000 7ff1e74dd640 1 -- 172.21.15.102:0/1341425941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58193acf0 con 0x55a58193a290 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.506+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/1341425941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a58193a290 0x55a58193a6b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8074fd0 tx=0x7ff1d80744e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.506+0000 7ff0d1602640 1 -- 172.21.15.102:0/1341425941 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d808e020 con 0x55a58193a290 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.506+0000 7ff0d1602640 1 -- 172.21.15.102:0/1341425941 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d8068a90 con 0x55a58193a290 2024-09-19T11:13:53.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.506+0000 7ff0d1602640 1 -- 172.21.15.102:0/1341425941 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d8096e60 con 0x55a58193a290 2024-09-19T11:13:53.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.506+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1341425941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a58193b520 con 0x55a58193a290 2024-09-19T11:13:53.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.506+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1341425941 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58193b520 con 0x55a58193a290 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff0d1602640 1 -- 172.21.15.102:0/1341425941 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff1d80980b0 con 0x55a58193a290 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff0d1602640 1 --2- 172.21.15.102:0/1341425941 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0c003cfb0 0x7ff0c003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff0d1602640 1 -- 172.21.15.102:0/1341425941 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff1d80a2c50 con 0x55a58193a290 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff1dffff640 1 --2- 172.21.15.102:0/1341425941 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0c003cfb0 0x7ff0c003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff1eb72e800 1 Processor -- start 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff1eb72e800 1 -- start start 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff1dffff640 1 --2- 172.21.15.102:0/1341425941 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0c003cfb0 0x7ff0c003f470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000bf40 tx=0x7ff1d000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff1eb72e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a581946d00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.507+0000 7ff1eb72e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a581912d20 con 0x55a581946920 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.508+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a581946d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.508+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a581946d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43098/0 (socket says 172.21.15.102:43098) 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.508+0000 7ff1e74dd640 1 -- 172.21.15.102:0/4121343013 learned_addr learned my addr 172.21.15.102:0/4121343013 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.508+0000 7ff1e74dd640 1 -- 172.21.15.102:0/4121343013 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a5819472f0 con 0x55a581946920 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.508+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/4121343013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a581946d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8095860 tx=0x7ff1d80954a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d22d44f9eb65c9b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.508+0000 7ff0caffd640 1 -- 172.21.15.102:0/4121343013 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d808a620 con 0x55a581946920 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.508+0000 7ff0caffd640 1 -- 172.21.15.102:0/4121343013 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d80b0070 con 0x55a581946920 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.508+0000 7ff0caffd640 1 -- 172.21.15.102:0/4121343013 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d805c450 con 0x55a581946920 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4121343013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 msgr2=0x55a581946d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4121343013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a581946d00 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8095860 tx=0x7ff1d80954a0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4121343013 shutdown_connections 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4121343013 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a581946d00 unknown :-1 s=CLOSED pgs=281 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4121343013 >> 172.21.15.102:0/4121343013 conn(0x55a581942d20 msgr2=0x55a581940f60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4121343013 shutdown_connections 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4121343013 wait complete. 2024-09-19T11:13:53.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 Processor -- start 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 -- start start 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a58194dd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1eb72e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a581947780 con 0x55a581946920 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a58194dd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1e74dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a58194dd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43114/0 (socket says 172.21.15.102:43114) 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.509+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 learned_addr learned my addr 172.21.15.102:0/363507644 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.510+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a58194e2c0 con 0x55a581946920 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.510+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a58194dd60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8067e80 tx=0x7ff1d8058f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.510+0000 7ff0c97fa640 1 -- 172.21.15.102:0/363507644 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d80be070 con 0x55a581946920 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.510+0000 7ff0c97fa640 1 -- 172.21.15.102:0/363507644 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff1d8091510 con 0x55a581946920 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.510+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a58194e2c0 con 0x55a581946920 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.510+0000 7ff0c97fa640 1 -- 172.21.15.102:0/363507644 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff1d8067c60 con 0x55a581946920 2024-09-19T11:13:53.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.510+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a58194e2c0 con 0x55a581946920 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.511+0000 7ff0c97fa640 1 -- 172.21.15.102:0/363507644 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff1d80c1070 con 0x55a581946920 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.511+0000 7ff0c97fa640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0b003cf60 0x7ff0b003f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.511+0000 7ff0c97fa640 1 -- 172.21.15.102:0/363507644 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff1d80a7030 con 0x55a581946920 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.511+0000 7ff1dffff640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0b003cf60 0x7ff0b003f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1dffff640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0b003cf60 0x7ff0b003f420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000c010 tx=0x7ff1d0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a581959140 0x55a58195b600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a58195bd50 con 0x55a581959140 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1e7cde640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a581959140 0x55a58195b600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1e7cde640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a581959140 0x55a58195b600 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1eb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1eb72e800 20 realm 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.512+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a58195c160 con 0x55a581959140 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a58195ca30 con 0x55a581959140 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a58195db30 0x55a58195ff20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a5819604e0 con 0x55a58195db30 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.513+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a58195db30 0x55a58195ff20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.514+0000 7ff1e74dd640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a58195db30 0x55a58195ff20 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.514+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.514+0000 7ff1eb72e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.514+0000 7ff1eb72e800 20 searching for the correct realm 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.514+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581962490 0x55a581964950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.514+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a581965020 con 0x55a581962490 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.514+0000 7ff1dffff640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581962490 0x55a581964950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.515+0000 7ff1dffff640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581962490 0x55a581964950 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.515+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.515+0000 7ff1dffff640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff1d0037040 0x7ff1d0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.515+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a581965020 con 0x7ff1d0037040 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.515+0000 7ff1e7cde640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff1d0037040 0x7ff1d0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.515+0000 7ff1e7cde640 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff1d0037040 0x7ff1d0036410 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.515+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.515+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.516+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.516+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.516+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.516+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.516+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.516+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.516+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.516+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.517+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.517+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x7ff1d0037040 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.517+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.517+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581962490 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.517+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.517+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.517+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.517+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.518+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.518+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.518+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.518+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x7ff1d0037040 2024-09-19T11:13:53.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.518+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.518+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581962490 2024-09-19T11:13:53.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.518+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.518+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581962490 2024-09-19T11:13:53.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581962490 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581962490 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.519+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.520+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.520+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.520+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.520+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581962490 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.520+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.520+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x7ff1d0037040 2024-09-19T11:13:53.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.520+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.520+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.521+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.521+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.521+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.521+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581962490 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.521+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.521+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.521+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.521+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x7ff1d0037040 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.522+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.522+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581962490 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.522+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.522+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a58195db30 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.522+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.522+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x55a581959140 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a58195cdd0 con 0x7ff1d0037040 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a581960da0 con 0x55a581959140 2024-09-19T11:13:53.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a581960da0 con 0x55a581959140 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.523+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a581960da0 con 0x55a581962490 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 20 zone default found 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 4 Realm: () 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:53.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 20 zonegroup default 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a5819616a0 con 0x55a58195db30 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a581966f90 con 0x55a581962490 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.524+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a581967450 con 0x55a581962490 2024-09-19T11:13:53.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.525+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.525+0000 7ff1eb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.525+0000 7ff1eb72e800 20 started sync module instance, tier type = 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.525+0000 7ff1eb72e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.525+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581966330 con 0x7ff1d0037040 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.526+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.526+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94169332082736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581966330 con 0x7ff1d0037040 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.526+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581967f10 con 0x55a581959140 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.527+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94169332082736] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.527+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.527+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94169332080256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581967ed0 con 0x55a581959140 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.527+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a5819689a0 con 0x55a581962490 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.528+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94169332080256] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.528+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.528+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94169332087328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581967e40 con 0x55a581962490 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.528+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581969860 con 0x7ff1d0037040 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.529+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.529+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94169332094384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196a100 con 0x7ff1d0037040 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.529+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196ab70 con 0x55a581959140 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.529+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94169332087328] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.530+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94169332094384] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.530+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.530+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94169332098624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581969bd0 con 0x55a581959140 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.530+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196b410 con 0x55a58195db30 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.531+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94169332098624] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.531+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.531+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94169332095760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581968d90 con 0x55a58195db30 2024-09-19T11:13:53.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.531+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196bdd0 con 0x55a58195db30 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.532+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.532+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94169332105584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196ca40 con 0x55a58195db30 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.532+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196d460 con 0x55a58195db30 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.532+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94169332095760] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94169332105584] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'54 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94169332109136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196d420 con 0x55a58195db30 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1eb72e800 20 add_watcher() i=0 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1eb72e800 20 add_watcher() i=1 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1eb72e800 20 add_watcher() i=2 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1eb72e800 20 add_watcher() i=3 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1eb72e800 20 add_watcher() i=4 2024-09-19T11:13:53.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1eb72e800 20 add_watcher() i=5 2024-09-19T11:13:53.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.533+0000 7ff1eb72e800 20 add_watcher() i=6 2024-09-19T11:13:53.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.534+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94169332109136] v35'55 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.534+0000 7ff1eb72e800 20 add_watcher() i=7 2024-09-19T11:13:53.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.534+0000 7ff1eb72e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:53.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.534+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a581970900 con 0x55a581959140 2024-09-19T11:13:53.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.535+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.535+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94169332110368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196dcf0 con 0x55a581959140 2024-09-19T11:13:53.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.535+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94169332110368] v35'70 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff1eb72e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff1eb72e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff1eb72e800 5 note: GC not initialized 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff09cfe1640 20 reqs_thread_entry: start 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff1eb72e800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff1eb72e800 20 Filter name: none 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff0167fc640 20 reqs_thread_entry: start 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff1eb72e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.536+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a3480 con 0x55a581959140 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : miss 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.8 8:17d68d04:users.swift::foo%3afoo1:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a3d90 con 0x55a581959140 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo:foo1 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x0 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 10 adding default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 10 cache get: name=default.rgw.meta+users.swift+foo:foo1 : hit (negative entry) 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.537+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a9750 con 0x55a581959140 2024-09-19T11:13:53.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~556] v35'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff1eb72e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff1eb72e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff1eb72e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94169332355472 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a4da0 con 0x55a581959140 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify (1) cookie 94169332098624 notify 150323855365 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7ff1e0026410 con 0x55a581959140 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff0caffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 94169332098624 notifier 4372 bl.length()=732 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff0caffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.538+0000 7ff0caffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.539+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(65 notify.4 [notify cookie 94169332355472 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.539+0000 7ff0caffd640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff0ac003ea0 con 0x55a581959140 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.539+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.539+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== watch-notify(notify_complete (2) cookie 94169332355472 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff1e0040040 con 0x55a581959140 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.539+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a9190 con 0x55a581959140 2024-09-19T11:13:53.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(67 foo:foo1 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff1eb72e800 10 cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff1eb72e800 10 moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff1eb72e800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94169332355472 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a48f0 con 0x7ff1d0037040 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== watch-notify(notify (1) cookie 94169332082736 notify 150323855362 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7ff1e0040040 con 0x7ff1d0037040 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff0ca7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94169332082736 notifier 4372 bl.length()=166 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(68 notify.0 [notify cookie 94169332355472 out=8b] v0'0 uv54 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff0ca7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo1 info.flags=0x7 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff0ca7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo1 to cache LRU end 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff0ca7fc640 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff01c003400 con 0x7ff1d0037040 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.540+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.541+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== watch-notify(notify_complete (2) cookie 94169332355472 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff1e00268b0 con 0x7ff1d0037040 2024-09-19T11:13:53.553 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"jYbsdabADo6xDrNIDHJ0XC4NxtLzUaBDDUyER5gx","active":true,"create_date":"2024-09-19T11:13:53.538404Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:53.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.541+0000 7ff09dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.541+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94169332110368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a1320 con 0x55a581959140 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.542+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94169332110368] v35'71 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.542+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94169332082736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a1320 con 0x7ff1d0037040 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.543+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94169332082736] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.543+0000 7ff1eb72e800 20 remove_watcher() i=0 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.543+0000 7ff1eb72e800 2 removed watcher, disabling cache 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.543+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94169332080256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a1320 con 0x55a581959140 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.544+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94169332080256] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.544+0000 7ff1eb72e800 20 remove_watcher() i=1 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.544+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94169332087328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a5819a1320 con 0x55a581962490 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.545+0000 7ff1dffff640 1 -- 172.21.15.102:0/363507644 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94169332087328] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d0009050 con 0x55a581962490 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.545+0000 7ff1eb72e800 20 remove_watcher() i=2 2024-09-19T11:13:53.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.545+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94169332094384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581966830 con 0x7ff1d0037040 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.546+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94169332094384] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x7ff1d0037040 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.546+0000 7ff1eb72e800 20 remove_watcher() i=3 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.546+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94169332098624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581965e80 con 0x55a581959140 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.547+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94169332098624] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1e000a4d0 con 0x55a581959140 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.547+0000 7ff1eb72e800 20 remove_watcher() i=4 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.547+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94169332095760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581967a20 con 0x55a58195db30 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.548+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94169332095760] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.548+0000 7ff1eb72e800 20 remove_watcher() i=5 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.548+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94169332105584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a58196a640 con 0x55a58195db30 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.549+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94169332105584] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.549+0000 7ff1eb72e800 20 remove_watcher() i=6 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.549+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94169332109136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a581965e80 con 0x55a58195db30 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1e74dd640 1 -- 172.21.15.102:0/363507644 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94169332109136] v35'56 uv54 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff1d80c0030 con 0x55a58195db30 2024-09-19T11:13:53.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 20 remove_watcher() i=7 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a58195db30 msgr2=0x55a58195ff20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a58195db30 0x55a58195ff20 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a581959140 msgr2=0x55a58195b600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a581959140 0x55a58195b600 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff1d0037040 msgr2=0x7ff1d0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff1d0037040 0x7ff1d0036410 crc :-1 s=READY pgs=27 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581962490 msgr2=0x55a581964950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581962490 0x55a581964950 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0b003cf60 msgr2=0x7ff0b003f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0b003cf60 0x7ff0b003f420 secure :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000c010 tx=0x7ff1d0010000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 msgr2=0x55a58194dd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/363507644 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581946920 0x55a58194dd60 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8067e80 tx=0x7ff1d8058f30 comp rx=0 tx=0).stop 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 reap_dead start 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1e7cde640 1 -- 172.21.15.102:0/363507644 reap_dead start 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 shutdown_connections 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.550+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 >> 172.21.15.102:0/363507644 conn(0x55a581942d20 msgr2=0x55a581940f30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 shutdown_connections 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/363507644 wait complete. 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1341425941 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0c003cfb0 msgr2=0x7ff0c003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/1341425941 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0c003cfb0 0x7ff0c003f470 secure :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0x7ff1d000bf40 tx=0x7ff1d000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1341425941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a58193a290 msgr2=0x55a58193a6b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/1341425941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a58193a290 0x55a58193a6b0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8074fd0 tx=0x7ff1d80744e0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1341425941 shutdown_connections 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/1341425941 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0c003cfb0 0x7ff0c003f470 unknown :-1 s=CLOSED pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/1341425941 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a58193a290 0x55a58193a6b0 unknown :-1 s=CLOSED pgs=280 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1341425941 >> 172.21.15.102:0/1341425941 conn(0x55a58192e640 msgr2=0x55a58192ea20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1341425941 shutdown_connections 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/1341425941 wait complete. 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a581925990 msgr2=0x55a581927e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a581925990 0x55a581927e30 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a5818258d0 msgr2=0x55a5819232c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a5818258d0 0x55a5819232c0 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581929a20 msgr2=0x55a58192be10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a581929a20 0x55a58192be10 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0cc03d000 msgr2=0x7ff0cc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0cc03d000 0x7ff0cc03f4c0 secure :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0x7ff1d0001d70 tx=0x7ff1d00012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 msgr2=0x55a5818225d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 --2- 172.21.15.102:0/4194416276 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a581822eb0 0x55a5818225d0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x7ff1d8045f50 tx=0x7ff1d8002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1e7cde640 1 -- 172.21.15.102:0/4194416276 reap_dead start 2024-09-19T11:13:53.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 shutdown_connections 2024-09-19T11:13:53.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 >> 172.21.15.102:0/4194416276 conn(0x55a58181ca70 msgr2=0x55a58190c4d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.551+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 shutdown_connections 2024-09-19T11:13:53.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.552+0000 7ff1eb72e800 1 -- 172.21.15.102:0/4194416276 wait complete. 2024-09-19T11:13:53.564 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'jYbsdabADo6xDrNIDHJ0XC4NxtLzUaBDDUyER5gx', 'active': True, 'create_date': '2024-09-19T11:13:53.538404Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:53.564 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-19T11:13:53.564 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'modify', '--subuser', 'foo:foo1', '--secret', 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', '--key-type', 'swift'] 2024-09-19T11:13:53.564 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser modify --subuser foo:foo1 --secret gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL --key-type swift 2024-09-19T11:13:53.613 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:53.613 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98cfc0e800 1 Processor -- start 2024-09-19T11:13:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98cfc0e800 1 -- start start 2024-09-19T11:13:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98cfc0e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56473c6c3ac0 0x56473c6c5f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98cfc0e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56473c6c6600 con 0x56473c6bfec0 2024-09-19T11:13:53.614 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98cfc0e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x56473c54a7d0 con 0x56473c6c3ac0 2024-09-19T11:13:53.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98caaca640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56473c6c3ac0 0x56473c6c5f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98caaca640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56473c6c3ac0 0x56473c6c5f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43124/0 (socket says 172.21.15.102:43124) 2024-09-19T11:13:53.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98caaca640 1 -- 172.21.15.102:0/2044061385 learned_addr learned my addr 172.21.15.102:0/2044061385 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98cb2cb640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x56473c6bfec0 0x56473c6c22b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52306/0 (socket says 172.21.15.102:52306) 2024-09-19T11:13:53.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98caaca640 1 -- 172.21.15.102:0/2044061385 >> v1:172.21.15.37:6789/0 conn(0x56473c6bfec0 legacy=0x56473c6c22b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.613+0000 7f98caaca640 1 -- 172.21.15.102:0/2044061385 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473c6c7830 con 0x56473c6c3ac0 2024-09-19T11:13:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.615+0000 7f98caaca640 1 --2- 172.21.15.102:0/2044061385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6c3ac0 0x56473c6c5f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00a520 tx=0x7f98bc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=de7f560af9d9f4e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.615+0000 7f98ca2c9640 1 -- 172.21.15.102:0/2044061385 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc055070 con 0x56473c6c3ac0 2024-09-19T11:13:53.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.615+0000 7f98ca2c9640 1 -- 172.21.15.102:0/2044061385 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98bc0515b0 con 0x56473c6c3ac0 2024-09-19T11:13:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.615+0000 7f98ca2c9640 1 -- 172.21.15.102:0/2044061385 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98bc0518d0 con 0x56473c6c3ac0 2024-09-19T11:13:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.616+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2044061385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6c3ac0 msgr2=0x56473c6c5f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.616+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2044061385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6c3ac0 0x56473c6c5f80 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f98bc00a520 tx=0x7f98bc045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.616+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2044061385 shutdown_connections 2024-09-19T11:13:53.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.616+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2044061385 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6c3ac0 0x56473c6c5f80 unknown :-1 s=CLOSED pgs=284 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.616+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2044061385 >> 172.21.15.102:0/2044061385 conn(0x56473c6b9a80 msgr2=0x56473c6bbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.616+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2044061385 shutdown_connections 2024-09-19T11:13:53.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.616+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2044061385 wait complete. 2024-09-19T11:13:53.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.630+0000 7f98cfc0e800 1 Processor -- start 2024-09-19T11:13:53.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.630+0000 7f98cfc0e800 1 -- start start 2024-09-19T11:13:53.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.630+0000 7f98cfc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7af3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.630+0000 7f98cfc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56473c557dd0 con 0x56473c6bfec0 2024-09-19T11:13:53.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.630+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7af3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.630+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7af3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43128/0 (socket says 172.21.15.102:43128) 2024-09-19T11:13:53.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.630+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2287652110 learned_addr learned my addr 172.21.15.102:0/2287652110 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.630+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2287652110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473c7af9c0 con 0x56473c6bfec0 2024-09-19T11:13:53.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/2287652110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7af3d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98b400b260 tx=0x7f98b400b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6951f6d9632e6a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f97b960a640 1 -- 172.21.15.102:0/2287652110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b400be60 con 0x56473c6bfec0 2024-09-19T11:13:53.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f97b960a640 1 -- 172.21.15.102:0/2287652110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4006070 con 0x56473c6bfec0 2024-09-19T11:13:53.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f97b960a640 1 -- 172.21.15.102:0/2287652110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b400e710 con 0x56473c6bfec0 2024-09-19T11:13:53.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2287652110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 msgr2=0x56473c7af3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2287652110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7af3d0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x7f98b400b260 tx=0x7f98b400b660 comp rx=0 tx=0).stop 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2287652110 shutdown_connections 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2287652110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7af3d0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.631+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2287652110 >> 172.21.15.102:0/2287652110 conn(0x56473c6b9a80 msgr2=0x56473c7aad50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2287652110 shutdown_connections 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2287652110 wait complete. 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cfc0e800 1 Processor -- start 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cfc0e800 1 -- start start 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cfc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7b6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cfc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56473c6c6ad0 con 0x56473c6bfec0 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7b6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7b6ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43138/0 (socket says 172.21.15.102:43138) 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2963273239 learned_addr learned my addr 172.21.15.102:0/2963273239 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.632+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2963273239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473c7b7440 con 0x56473c6bfec0 2024-09-19T11:13:53.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.633+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7b6ee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x56473c7b0360 tx=0x7f98b4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.633+0000 7f97b7e07640 1 -- 172.21.15.102:0/2963273239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b400f810 con 0x56473c6bfec0 2024-09-19T11:13:53.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.633+0000 7f97b7e07640 1 -- 172.21.15.102:0/2963273239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b400f9b0 con 0x56473c6bfec0 2024-09-19T11:13:53.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.633+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56473c7b76d0 con 0x56473c6bfec0 2024-09-19T11:13:53.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.633+0000 7f97b7e07640 1 -- 172.21.15.102:0/2963273239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b400fcd0 con 0x56473c6bfec0 2024-09-19T11:13:53.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.633+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473c7b80d0 con 0x56473c6bfec0 2024-09-19T11:13:53.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.634+0000 7f97b7e07640 1 -- 172.21.15.102:0/2963273239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98b4017070 con 0x56473c6bfec0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.634+0000 7f97b7e07640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97b003d000 0x7f97b003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.634+0000 7f97b7e07640 1 -- 172.21.15.102:0/2963273239 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f98b4015020 con 0x56473c6bfec0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.634+0000 7f98caaca640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97b003d000 0x7f97b003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.634+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c6c3ac0 0x56473c7be530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.634+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7bea70 con 0x56473c6c3ac0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.634+0000 7f98cbacc640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c6c3ac0 0x56473c7be530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.634+0000 7f98caaca640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97b003d000 0x7f97b003f4c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f98bc057000 tx=0x7f98bc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.635+0000 7f98cbacc640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c6c3ac0 0x56473c7be530 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.635+0000 7f98cbacc640 1 -- 172.21.15.102:0/2963273239 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c6c3ac0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.635+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7bee10 con 0x56473c6c3ac0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.635+0000 7f98cbacc640 1 -- 172.21.15.102:0/2963273239 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c6c3ac0 2024-09-19T11:13:53.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.635+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7c0910 0x56473c7c2d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.635+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7c3520 con 0x56473c7c0910 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.635+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7c0910 0x56473c7c2d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.636+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7c0910 0x56473c7c2d90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.636+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2963273239 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f98b402e070 con 0x56473c7c0910 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.636+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7bf660 con 0x56473c6c3ac0 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.636+0000 7f98cbacc640 1 -- 172.21.15.102:0/2963273239 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c6c3ac0 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.636+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7c4980 0x56473c7c6d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.636+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7c74e0 con 0x56473c7c4980 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.637+0000 7f98caaca640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7c4980 0x56473c7c6d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.637+0000 7f98caaca640 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7c4980 0x56473c7c6d70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.637+0000 7f98caaca640 1 -- 172.21.15.102:0/2963273239 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7c4980 2024-09-19T11:13:53.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.637+0000 7f98cfc0e800 1 Processor -- start 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.637+0000 7f98cfc0e800 1 -- start start 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cfc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bf660 0x56473c6bded0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cfc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56473c5b64a0 con 0x56473c6bf660 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bf660 0x56473c6bded0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bf660 0x56473c6bded0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43144/0 (socket says 172.21.15.102:43144) 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cb2cb640 1 -- 172.21.15.102:0/4105491156 learned_addr learned my addr 172.21.15.102:0/4105491156 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cb2cb640 1 -- 172.21.15.102:0/4105491156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473c6bfb80 con 0x56473c6bf660 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/4105491156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bf660 0x56473c6bded0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f98b40176b0 tx=0x7f98b4019e00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f97b5602640 1 -- 172.21.15.102:0/4105491156 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b401be20 con 0x56473c6bf660 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f97b5602640 1 -- 172.21.15.102:0/4105491156 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b4049030 con 0x56473c6bf660 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cfc0e800 1 -- 172.21.15.102:0/4105491156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56473c6be410 con 0x56473c6bf660 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f97b5602640 1 -- 172.21.15.102:0/4105491156 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b401b520 con 0x56473c6bf660 2024-09-19T11:13:53.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.638+0000 7f98cfc0e800 1 -- 172.21.15.102:0/4105491156 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473c6be960 con 0x56473c6bf660 2024-09-19T11:13:53.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.639+0000 7f97b5602640 1 -- 172.21.15.102:0/4105491156 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98b401a480 con 0x56473c6bf660 2024-09-19T11:13:53.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.639+0000 7f97b5602640 1 --2- 172.21.15.102:0/4105491156 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.639+0000 7f97b5602640 1 -- 172.21.15.102:0/4105491156 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f98b403bc40 con 0x56473c6bf660 2024-09-19T11:13:53.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.639+0000 7f98caaca640 1 --2- 172.21.15.102:0/4105491156 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cfc0e800 1 Processor -- start 2024-09-19T11:13:53.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cfc0e800 1 -- start start 2024-09-19T11:13:53.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98caaca640 1 --2- 172.21.15.102:0/4105491156 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97a403cfb0 0x7f97a403f470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f98bc005570 tx=0x7f98bc005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cfc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7e4140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cfc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56473c7afdf0 con 0x56473c7e3d40 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7e4140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7e4140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43152/0 (socket says 172.21.15.102:43152) 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cb2cb640 1 -- 172.21.15.102:0/1885355927 learned_addr learned my addr 172.21.15.102:0/1885355927 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cb2cb640 1 -- 172.21.15.102:0/1885355927 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473c7e4730 con 0x56473c7e3d40 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.640+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/1885355927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7e4140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f98b4012fd0 tx=0x7f98b401df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=efb22564f2a54633 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f97aeffd640 1 -- 172.21.15.102:0/1885355927 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b404cda0 con 0x56473c7e3d40 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f97aeffd640 1 -- 172.21.15.102:0/1885355927 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b403f070 con 0x56473c7e3d40 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f97aeffd640 1 -- 172.21.15.102:0/1885355927 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b4040e10 con 0x56473c7e3d40 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 -- 172.21.15.102:0/1885355927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 msgr2=0x56473c7e4140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/1885355927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7e4140 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x7f98b4012fd0 tx=0x7f98b401df90 comp rx=0 tx=0).stop 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 -- 172.21.15.102:0/1885355927 shutdown_connections 2024-09-19T11:13:53.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/1885355927 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7e4140 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 -- 172.21.15.102:0/1885355927 >> 172.21.15.102:0/1885355927 conn(0x56473c7e0140 msgr2=0x56473c7de380 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 -- 172.21.15.102:0/1885355927 shutdown_connections 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 -- 172.21.15.102:0/1885355927 wait complete. 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 Processor -- start 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.641+0000 7f98cfc0e800 1 -- start start 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cfc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7eb160 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cfc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56473c7e4ba0 con 0x56473c7e3d40 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7eb160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cb2cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7eb160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43166/0 (socket says 172.21.15.102:43166) 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 learned_addr learned my addr 172.21.15.102:0/2923781817 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56473c7eb6c0 con 0x56473c7e3d40 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7eb160 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f98b404c220 tx=0x7f98b4018ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f97ad7fa640 1 -- 172.21.15.102:0/2923781817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b406d070 con 0x56473c7e3d40 2024-09-19T11:13:53.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f97ad7fa640 1 -- 172.21.15.102:0/2923781817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f98b40277b0 con 0x56473c7e3d40 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56473c7eb6c0 con 0x56473c7e3d40 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f97ad7fa640 1 -- 172.21.15.102:0/2923781817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f98b404c880 con 0x56473c7e3d40 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.642+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56473c7ec2d0 con 0x56473c7e3d40 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.643+0000 7f97ad7fa640 1 -- 172.21.15.102:0/2923781817 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f98b4070070 con 0x56473c7e3d40 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.643+0000 7f97ad7fa640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f979403cfb0 0x7f979403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.643+0000 7f97ad7fa640 1 -- 172.21.15.102:0/2923781817 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f98b4064030 con 0x56473c7e3d40 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.644+0000 7f98caaca640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f979403cfb0 0x7f979403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.644+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.644+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c7f67e0 0x56473c7f8ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.644+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7f93f0 con 0x56473c7f67e0 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.644+0000 7f98caaca640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f979403cfb0 0x7f979403f470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f98bc045be0 tx=0x7f98bc06d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.644+0000 7f98cbacc640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c7f67e0 0x56473c7f8ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.644+0000 7f98cbacc640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c7f67e0 0x56473c7f8ca0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 realm 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7f9800 con 0x56473c7f67e0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa0d0 con 0x56473c7f67e0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7fb1d0 0x56473c7fd5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.645+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fdb80 con 0x56473c7fb1d0 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7fb1d0 0x56473c7fd5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98cb2cb640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7fb1d0 0x56473c7fd5c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98cfc0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98cfc0e800 20 searching for the correct realm 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7ffb60 0x56473c802020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c8026f0 con 0x56473c7ffb60 2024-09-19T11:13:53.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98caaca640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7ffb60 0x56473c802020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.646+0000 7f98caaca640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7ffb60 0x56473c802020 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.647+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.647+0000 7f98caaca640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f98bc069040 0x7f98bc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.647+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c8026f0 con 0x7f98bc069040 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.647+0000 7f98cbacc640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f98bc069040 0x7f98bc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.647+0000 7f98cbacc640 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f98bc069040 0x7f98bc06a940 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.647+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.647+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.648+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.648+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.648+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.648+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.648+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.648+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.648+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.648+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x7f98bc069040 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7ffb60 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.649+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.650+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.650+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x7f98bc069040 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.650+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.650+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7ffb60 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.650+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.650+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7ffb60 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.650+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.650+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.651+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.651+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7ffb60 2024-09-19T11:13:53.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.651+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.651+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7ffb60 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.651+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.651+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.651+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.651+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.652+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.652+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.652+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.652+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7ffb60 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.652+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.652+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x7f98bc069040 2024-09-19T11:13:53.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.652+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.652+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.653+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.653+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.653+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.653+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7ffb60 2024-09-19T11:13:53.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.653+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.653+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.653+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.653+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x7f98bc069040 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.654+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.654+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7ffb60 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.654+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.654+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7fb1d0 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.654+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.654+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x56473c7f67e0 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.654+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.654+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fa470 con 0x7f98bc069040 2024-09-19T11:13:53.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fdf90 con 0x56473c7f67e0 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fdf90 con 0x56473c7f67e0 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fdf90 con 0x56473c7ffb60 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 zone default found 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 4 Realm: () 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:53.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 zonegroup default 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.655+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c7fe8c0 con 0x56473c7fb1d0 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c804690 con 0x56473c7ffb60 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c804b00 con 0x56473c7ffb60 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 20 started sync module instance, tier type = 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.656+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c803a00 con 0x7f98bc069040 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.657+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.657+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94863957704448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c803a00 con 0x7f98bc069040 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.657+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c8055f0 con 0x56473c7f67e0 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.658+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94863957704448] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.658+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.658+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94863957709056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c803a00 con 0x56473c7f67e0 2024-09-19T11:13:53.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.658+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c806070 con 0x56473c7ffb60 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.659+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94863957709056] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.660+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.660+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94863957701968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c803970 con 0x56473c7ffb60 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.660+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c806f30 con 0x7f98bc069040 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.661+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94863957701968] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.661+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.661+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94863957715584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c806ea0 con 0x7f98bc069040 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.661+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c807cf0 con 0x56473c7f67e0 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.662+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.662+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94863957718992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c807cf0 con 0x56473c7f67e0 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.662+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94863957715584] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.662+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c807320 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.663+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.663+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94863957722928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c809100 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.663+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c809ac0 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.663+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94863957718992] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.664+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94863957722928] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.664+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.664+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94863957726736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c809e60 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.664+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c80a6b0 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.665+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94863957726736] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'57 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94863957728864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c80a730 con 0x56473c7fb1d0 2024-09-19T11:13:53.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cfc0e800 20 add_watcher() i=0 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cfc0e800 20 add_watcher() i=1 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cfc0e800 20 add_watcher() i=2 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cfc0e800 20 add_watcher() i=3 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cfc0e800 20 add_watcher() i=4 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cfc0e800 20 add_watcher() i=5 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.666+0000 7f98cfc0e800 20 add_watcher() i=6 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.667+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94863957728864] v35'58 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.667+0000 7f98cfc0e800 20 add_watcher() i=7 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.667+0000 7f98cfc0e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:53.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.667+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c80da60 con 0x56473c7f67e0 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.667+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.667+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94863957730288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c80acc0 con 0x56473c7f67e0 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.668+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94863957730288] v35'72 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.668+0000 7f9781fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f98cfc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f98cfc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f98cfc0e800 5 note: GC not initialized 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f9780fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f98cfc0e800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f98cfc0e800 20 Filter name: none 2024-09-19T11:13:53.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f96fa7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f98cfc0e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f98cfc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.669+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c8409a0 con 0x56473c7f67e0 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.670+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.670+0000 7f98cfc0e800 20 rados_obj.operate() r=0 bl.length=556 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.670+0000 7f98cfc0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.670+0000 7f98cfc0e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.670+0000 7f98cfc0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.670+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c846f90 con 0x56473c7f67e0 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v35'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cfc0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:53.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cfc0e800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cfc0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94863957977488 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56473c842630 con 0x56473c7f67e0 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94863957718992 notify 150323855366 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7f98c4026410 con 0x56473c7f67e0 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f97aeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855366 cookie 94863957718992 notifier 4379 bl.length()=732 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f97aeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(64 notify.4 [notify cookie 94863957977488 out=8b] v0'0 uv57 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f97aeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f97aeffd640 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f9790003ea0 con 0x56473c7f67e0 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.671+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94863957977488 notify 150323855366 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f98c40265e0 con 0x56473c7f67e0 2024-09-19T11:13:53.686 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:53.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.672+0000 7f9781fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.672+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94863957730288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c842a60 con 0x56473c7f67e0 2024-09-19T11:13:53.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.673+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94863957730288] v35'73 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.673+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94863957704448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c83e800 con 0x7f98bc069040 2024-09-19T11:13:53.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.674+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94863957704448] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.674+0000 7f98cfc0e800 20 remove_watcher() i=0 2024-09-19T11:13:53.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.674+0000 7f98cfc0e800 2 removed watcher, disabling cache 2024-09-19T11:13:53.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.674+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94863957709056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c83e800 con 0x56473c7f67e0 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.675+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94863957709056] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.675+0000 7f98cfc0e800 20 remove_watcher() i=1 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.675+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94863957701968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c83e800 con 0x56473c7ffb60 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.676+0000 7f98caaca640 1 -- 172.21.15.102:0/2923781817 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94863957701968] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98bc057030 con 0x56473c7ffb60 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.676+0000 7f98cfc0e800 20 remove_watcher() i=2 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.676+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94863957715584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c805100 con 0x7f98bc069040 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.677+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94863957715584] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x7f98bc069040 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.677+0000 7f98cfc0e800 20 remove_watcher() i=3 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.677+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94863957718992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c803550 con 0x56473c7f67e0 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.678+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94863957718992] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98c400a4d0 con 0x56473c7f67e0 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.678+0000 7f98cfc0e800 20 remove_watcher() i=4 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.678+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94863957722928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c806a80 con 0x56473c7fb1d0 2024-09-19T11:13:53.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.679+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94863957722928] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.679+0000 7f98cfc0e800 20 remove_watcher() i=5 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.679+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94863957726736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c805100 con 0x56473c7fb1d0 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.680+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94863957726736] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.680+0000 7f98cfc0e800 20 remove_watcher() i=6 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.680+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94863957728864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56473c8077d0 con 0x56473c7fb1d0 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cb2cb640 1 -- 172.21.15.102:0/2923781817 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94863957728864] v35'59 uv57 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f98b406f030 con 0x56473c7fb1d0 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 20 remove_watcher() i=7 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7fb1d0 msgr2=0x56473c7fd5c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7fb1d0 0x56473c7fd5c0 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c7f67e0 msgr2=0x56473c7f8ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c7f67e0 0x56473c7f8ca0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f98bc069040 msgr2=0x7f98bc06a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f98bc069040 0x7f98bc06a940 crc :-1 s=READY pgs=28 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7ffb60 msgr2=0x56473c802020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.681+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7ffb60 0x56473c802020 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f979403cfb0 msgr2=0x7f979403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f979403cfb0 0x7f979403f470 secure :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0x7f98bc045be0 tx=0x7f98bc06d040 comp rx=0 tx=0).stop 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 msgr2=0x56473c7eb160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2923781817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c7e3d40 0x56473c7eb160 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x7f98b404c220 tx=0x7f98b4018ef0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 reap_dead start 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cbacc640 1 -- 172.21.15.102:0/2923781817 reap_dead start 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 shutdown_connections 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 >> 172.21.15.102:0/2923781817 conn(0x56473c7e0140 msgr2=0x56473c7de350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 shutdown_connections 2024-09-19T11:13:53.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2923781817 wait complete. 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/4105491156 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97a403cfb0 msgr2=0x7f97a403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/4105491156 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97a403cfb0 0x7f97a403f470 secure :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0x7f98bc005570 tx=0x7f98bc005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/4105491156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bf660 msgr2=0x56473c6bded0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/4105491156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bf660 0x56473c6bded0 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f98b40176b0 tx=0x7f98b4019e00 comp rx=0 tx=0).stop 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/4105491156 shutdown_connections 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/4105491156 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97a403cfb0 0x7f97a403f470 unknown :-1 s=CLOSED pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/4105491156 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bf660 0x56473c6bded0 unknown :-1 s=CLOSED pgs=287 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/4105491156 >> 172.21.15.102:0/4105491156 conn(0x56473c7c95d0 msgr2=0x56473c7c99b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/4105491156 shutdown_connections 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.682+0000 7f98cfc0e800 1 -- 172.21.15.102:0/4105491156 wait complete. 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7c0910 msgr2=0x56473c7c2d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56473c7c0910 0x56473c7c2d90 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c6c3ac0 msgr2=0x56473c7be530 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56473c6c3ac0 0x56473c7be530 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7c4980 msgr2=0x56473c7c6d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56473c7c4980 0x56473c7c6d70 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97b003d000 msgr2=0x7f97b003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f97b003d000 0x7f97b003f4c0 secure :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0x7f98bc057000 tx=0x7f98bc052000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 msgr2=0x56473c7b6ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 --2- 172.21.15.102:0/2963273239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56473c6bfec0 0x56473c7b6ee0 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x56473c7b0360 tx=0x7f98b4000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cbacc640 1 -- 172.21.15.102:0/2963273239 reap_dead start 2024-09-19T11:13:53.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 shutdown_connections 2024-09-19T11:13:53.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 >> 172.21.15.102:0/2963273239 conn(0x56473c6b9a80 msgr2=0x56473c7b08c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 shutdown_connections 2024-09-19T11:13:53.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.683+0000 7f98cfc0e800 1 -- 172.21.15.102:0/2963273239 wait complete. 2024-09-19T11:13:53.698 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:53.698 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:13:53.698 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:13:53.698 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:13:53.742 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:53.743 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.742+0000 7f55f4746800 1 Processor -- start 2024-09-19T11:13:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.742+0000 7f55f4746800 1 -- start start 2024-09-19T11:13:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.743+0000 7f55f4746800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5607af4d1690 0x5607af4d2390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.743+0000 7f55f4746800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5607af4d1d40 con 0x5607af4d28d0 2024-09-19T11:13:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.743+0000 7f55f4746800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5607af35d7d0 con 0x5607af4d1690 2024-09-19T11:13:53.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.743+0000 7f55f2237640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5607af4d1690 0x5607af4d2390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.743+0000 7f55ebfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5607af4d28d0 0x5607af4d7630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52314/0 (socket says 172.21.15.102:52314) 2024-09-19T11:13:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.743+0000 7f55ebfff640 1 -- 172.21.15.102:0/947061742 learned_addr learned my addr 172.21.15.102:0/947061742 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.743+0000 7f55f2237640 1 -- 172.21.15.102:0/947061742 >> v1:172.21.15.37:6789/0 conn(0x5607af4d28d0 legacy=0x5607af4d7630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.743+0000 7f55f2237640 1 -- 172.21.15.102:0/947061742 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607af4d2d80 con 0x5607af4d1690 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.745+0000 7f55f2237640 1 --2- 172.21.15.102:0/947061742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af4d2390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f55e400a470 tx=0x7f55e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3e7b62ed334ae48b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.745+0000 7f55f1a36640 1 -- 172.21.15.102:0/947061742 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e4053570 con 0x5607af4d1690 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.745+0000 7f55f1a36640 1 -- 172.21.15.102:0/947061742 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e4058070 con 0x5607af4d1690 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.745+0000 7f55f1a36640 1 -- 172.21.15.102:0/947061742 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e4053880 con 0x5607af4d1690 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.746+0000 7f55f4746800 1 -- 172.21.15.102:0/947061742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 msgr2=0x5607af4d2390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.746+0000 7f55f4746800 1 --2- 172.21.15.102:0/947061742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af4d2390 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x7f55e400a470 tx=0x7f55e4045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.746+0000 7f55f4746800 1 -- 172.21.15.102:0/947061742 shutdown_connections 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.746+0000 7f55f4746800 1 --2- 172.21.15.102:0/947061742 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af4d2390 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.746+0000 7f55f4746800 1 -- 172.21.15.102:0/947061742 >> 172.21.15.102:0/947061742 conn(0x5607af4cca60 msgr2=0x5607af4ceec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.746+0000 7f55f4746800 1 -- 172.21.15.102:0/947061742 shutdown_connections 2024-09-19T11:13:53.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.746+0000 7f55f4746800 1 -- 172.21.15.102:0/947061742 wait complete. 2024-09-19T11:13:53.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.759+0000 7f55f4746800 1 Processor -- start 2024-09-19T11:13:53.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.759+0000 7f55f4746800 1 -- start start 2024-09-19T11:13:53.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.760+0000 7f55f4746800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af5c1220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.760+0000 7f55f4746800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607af36add0 con 0x5607af4d1690 2024-09-19T11:13:53.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.760+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af5c1220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.760+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af5c1220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43172/0 (socket says 172.21.15.102:43172) 2024-09-19T11:13:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.760+0000 7f55f2237640 1 -- 172.21.15.102:0/2461974491 learned_addr learned my addr 172.21.15.102:0/2461974491 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.760+0000 7f55f2237640 1 -- 172.21.15.102:0/2461974491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607af5c1810 con 0x5607af4d1690 2024-09-19T11:13:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.760+0000 7f55f2237640 1 --2- 172.21.15.102:0/2461974491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af5c1220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f55e4025c20 tx=0x7f55e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=57e9b98a0382a0aa server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.760+0000 7f54e0608640 1 -- 172.21.15.102:0/2461974491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e405c580 con 0x5607af4d1690 2024-09-19T11:13:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f54e0608640 1 -- 172.21.15.102:0/2461974491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e4063030 con 0x5607af4d1690 2024-09-19T11:13:53.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f54e0608640 1 -- 172.21.15.102:0/2461974491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e405c850 con 0x5607af4d1690 2024-09-19T11:13:53.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f55f4746800 1 -- 172.21.15.102:0/2461974491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 msgr2=0x5607af5c1220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f55f4746800 1 --2- 172.21.15.102:0/2461974491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af5c1220 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f55e4025c20 tx=0x7f55e4051000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f55f4746800 1 -- 172.21.15.102:0/2461974491 shutdown_connections 2024-09-19T11:13:53.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f55f4746800 1 --2- 172.21.15.102:0/2461974491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af5c1220 unknown :-1 s=CLOSED pgs=292 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f55f4746800 1 -- 172.21.15.102:0/2461974491 >> 172.21.15.102:0/2461974491 conn(0x5607af4cca60 msgr2=0x5607af5bcba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f55f4746800 1 -- 172.21.15.102:0/2461974491 shutdown_connections 2024-09-19T11:13:53.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.761+0000 7f55f4746800 1 -- 172.21.15.102:0/2461974491 wait complete. 2024-09-19T11:13:53.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.762+0000 7f55f4746800 1 Processor -- start 2024-09-19T11:13:53.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.762+0000 7f55f4746800 1 -- start start 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.762+0000 7f55f4746800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af445810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.762+0000 7f55f4746800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607af4d8d50 con 0x5607af4d1690 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.762+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af445810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.762+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af445810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43188/0 (socket says 172.21.15.102:43188) 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.762+0000 7f55f2237640 1 -- 172.21.15.102:0/517955817 learned_addr learned my addr 172.21.15.102:0/517955817 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.762+0000 7f55f2237640 1 -- 172.21.15.102:0/517955817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607af445d70 con 0x5607af4d1690 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.763+0000 7f55f2237640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af445810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f55e4045f50 tx=0x7f55e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.763+0000 7f54dee05640 1 -- 172.21.15.102:0/517955817 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e4054ad0 con 0x5607af4d1690 2024-09-19T11:13:53.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.763+0000 7f54dee05640 1 -- 172.21.15.102:0/517955817 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e4054c70 con 0x5607af4d1690 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.763+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607af5cc9f0 con 0x5607af4d1690 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.763+0000 7f54dee05640 1 -- 172.21.15.102:0/517955817 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e4068420 con 0x5607af4d1690 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.763+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607af5ccfb0 con 0x5607af4d1690 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f54dee05640 1 -- 172.21.15.102:0/517955817 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f55e40685c0 con 0x5607af4d1690 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f54dee05640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54d803d000 0x7f54d803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f54dee05640 1 -- 172.21.15.102:0/517955817 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f55e4070030 con 0x5607af4d1690 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f55ebfff640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54d803d000 0x7f54d803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f55f4746800 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af4d28d0 0x5607af5d0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af5d1570 con 0x5607af4d28d0 2024-09-19T11:13:53.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f55f2a38640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af4d28d0 0x5607af5d0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f55ebfff640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54d803d000 0x7f54d803f4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f55dc001d70 tx=0x7f55dc0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.764+0000 7f55f2a38640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af4d28d0 0x5607af5d0f70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.765+0000 7f55f2a38640 1 -- 172.21.15.102:0/517955817 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af4d28d0 2024-09-19T11:13:53.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.765+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af5d1e50 con 0x5607af4d28d0 2024-09-19T11:13:53.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.765+0000 7f55f2a38640 1 -- 172.21.15.102:0/517955817 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af4d28d0 2024-09-19T11:13:53.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.765+0000 7f55f4746800 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af5d3760 0x5607af5d5c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.765+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af5d6390 con 0x5607af5d3760 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.765+0000 7f55f2237640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af5d3760 0x5607af5d5c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.766+0000 7f55f2237640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af5d3760 0x5607af5d5c00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.766+0000 7f55f2237640 1 -- 172.21.15.102:0/517955817 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f55e4051070 con 0x5607af5d3760 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.766+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af5d26a0 con 0x5607af4d28d0 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.766+0000 7f55f2a38640 1 -- 172.21.15.102:0/517955817 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af4d28d0 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.766+0000 7f55f4746800 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af5d77f0 0x5607af5d9be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.766+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af5da320 con 0x5607af5d77f0 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.766+0000 7f55ebfff640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af5d77f0 0x5607af5d9be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.767+0000 7f55ebfff640 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af5d77f0 0x5607af5d9be0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.767+0000 7f55ebfff640 1 -- 172.21.15.102:0/517955817 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f55dc009050 con 0x5607af5d77f0 2024-09-19T11:13:53.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.767+0000 7f55f4746800 1 Processor -- start 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.767+0000 7f55f4746800 1 -- start start 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.767+0000 7f55f4746800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5ca100 0x5607af5c8970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.767+0000 7f55f4746800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607af3c94a0 con 0x5607af5ca100 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5ca100 0x5607af5c8970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5ca100 0x5607af5c8970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43202/0 (socket says 172.21.15.102:43202) 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f55f2237640 1 -- 172.21.15.102:0/3549783687 learned_addr learned my addr 172.21.15.102:0/3549783687 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f55f2237640 1 -- 172.21.15.102:0/3549783687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607af5ca620 con 0x5607af5ca100 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f55f2237640 1 --2- 172.21.15.102:0/3549783687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5ca100 0x5607af5c8970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f55e4074fd0 tx=0x7f55e40744e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f54d7fff640 1 -- 172.21.15.102:0/3549783687 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e408e020 con 0x5607af5ca100 2024-09-19T11:13:53.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f54d7fff640 1 -- 172.21.15.102:0/3549783687 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e4068a90 con 0x5607af5ca100 2024-09-19T11:13:53.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f55f4746800 1 -- 172.21.15.102:0/3549783687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607af5c8eb0 con 0x5607af5ca100 2024-09-19T11:13:53.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f54d7fff640 1 -- 172.21.15.102:0/3549783687 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e4009870 con 0x5607af5ca100 2024-09-19T11:13:53.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.768+0000 7f55f4746800 1 -- 172.21.15.102:0/3549783687 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607af5c8eb0 con 0x5607af5ca100 2024-09-19T11:13:53.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.769+0000 7f54d7fff640 1 -- 172.21.15.102:0/3549783687 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f55e4009a10 con 0x5607af5ca100 2024-09-19T11:13:53.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.769+0000 7f54d7fff640 1 --2- 172.21.15.102:0/3549783687 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54cc03cfb0 0x7f54cc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.769+0000 7f54d7fff640 1 -- 172.21.15.102:0/3549783687 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f55e40a2c50 con 0x5607af5ca100 2024-09-19T11:13:53.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.769+0000 7f55ebfff640 1 --2- 172.21.15.102:0/3549783687 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54cc03cfb0 0x7f54cc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f4746800 1 Processor -- start 2024-09-19T11:13:53.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f4746800 1 -- start start 2024-09-19T11:13:53.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55ebfff640 1 --2- 172.21.15.102:0/3549783687 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54cc03cfb0 0x7f54cc03f470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00bf40 tx=0x7f55dc00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f4746800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5f6ce0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f4746800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607af5c1be0 con 0x5607af5f6900 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5f6ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5f6ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43204/0 (socket says 172.21.15.102:43204) 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f2237640 1 -- 172.21.15.102:0/4208710346 learned_addr learned my addr 172.21.15.102:0/4208710346 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f2237640 1 -- 172.21.15.102:0/4208710346 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607af5f72d0 con 0x5607af5f6900 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.770+0000 7f55f2237640 1 --2- 172.21.15.102:0/4208710346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5f6ce0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f55e4090050 tx=0x7f55e40918e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d91430161488982 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f54d5ffb640 1 -- 172.21.15.102:0/4208710346 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e40a3e00 con 0x5607af5f6900 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f54d5ffb640 1 -- 172.21.15.102:0/4208710346 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e40b0070 con 0x5607af5f6900 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f54d5ffb640 1 -- 172.21.15.102:0/4208710346 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e4095580 con 0x5607af5f6900 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 -- 172.21.15.102:0/4208710346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 msgr2=0x5607af5f6ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 --2- 172.21.15.102:0/4208710346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5f6ce0 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7f55e4090050 tx=0x7f55e40918e0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 -- 172.21.15.102:0/4208710346 shutdown_connections 2024-09-19T11:13:53.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 --2- 172.21.15.102:0/4208710346 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5f6ce0 unknown :-1 s=CLOSED pgs=295 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 -- 172.21.15.102:0/4208710346 >> 172.21.15.102:0/4208710346 conn(0x5607af5f2d00 msgr2=0x5607af5f0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 -- 172.21.15.102:0/4208710346 shutdown_connections 2024-09-19T11:13:53.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 -- 172.21.15.102:0/4208710346 wait complete. 2024-09-19T11:13:53.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 Processor -- start 2024-09-19T11:13:53.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 -- start start 2024-09-19T11:13:53.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5fdd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.771+0000 7f55f4746800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5607af5f7760 con 0x5607af5f6900 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5fdd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f55f2237640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5fdd00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43218/0 (socket says 172.21.15.102:43218) 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 learned_addr learned my addr 172.21.15.102:0/3609533342 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5607af5fe260 con 0x5607af5f6900 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f55f2237640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5fdd00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f55e4090050 tx=0x7f55e4085ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f54c3fff640 1 -- 172.21.15.102:0/3609533342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e40be070 con 0x5607af5f6900 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f54c3fff640 1 -- 172.21.15.102:0/3609533342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f55e408a820 con 0x5607af5f6900 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5607af5fe260 con 0x5607af5f6900 2024-09-19T11:13:53.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f54c3fff640 1 -- 172.21.15.102:0/3609533342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f55e4095580 con 0x5607af5f6900 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.772+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5607af5fe260 con 0x5607af5f6900 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.773+0000 7f54c3fff640 1 -- 172.21.15.102:0/3609533342 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f55e40c1070 con 0x5607af5f6900 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.773+0000 7f54c3fff640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54bc03cfb0 0x7f54bc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.773+0000 7f54c3fff640 1 -- 172.21.15.102:0/3609533342 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f55e40a7030 con 0x5607af5f6900 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.773+0000 7f55ebfff640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54bc03cfb0 0x7f54bc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af6090c0 0x5607af60b580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af60bcd0 con 0x5607af6090c0 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55ebfff640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54bc03cfb0 0x7f54bc03f470 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00c010 tx=0x7f55dc010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f2a38640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af6090c0 0x5607af60b580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f2a38640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af6090c0 0x5607af60b580 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f4746800 20 realm 2024-09-19T11:13:53.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.774+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af60c0e0 con 0x5607af6090c0 2024-09-19T11:13:53.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af60c9b0 con 0x5607af6090c0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af60d840 0x5607af60fc30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af610370 con 0x5607af60d840 2024-09-19T11:13:53.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.775+0000 7f55f2237640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af60d840 0x5607af60fc30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.776+0000 7f55f2237640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af60d840 0x5607af60fc30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.776+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.776+0000 7f55f4746800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:53.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.776+0000 7f55f4746800 20 searching for the correct realm 2024-09-19T11:13:53.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.776+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af612440 0x5607af614900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.776+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af614fd0 con 0x5607af612440 2024-09-19T11:13:53.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.776+0000 7f55ebfff640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af612440 0x5607af614900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.776+0000 7f55ebfff640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af612440 0x5607af614900 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.777+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.777+0000 7f55ebfff640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f55dc037040 0x7f55dc036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.777+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af614fd0 con 0x7f55dc037040 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.777+0000 7f55f2a38640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f55dc037040 0x7f55dc036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.777+0000 7f55f2a38640 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f55dc037040 0x7f55dc036410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.777+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.777+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.778+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.778+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.778+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.778+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.778+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.778+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.778+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.778+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.779+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.779+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x7f55dc037040 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.779+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.779+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af612440 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.779+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.779+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.779+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.779+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x7f55dc037040 2024-09-19T11:13:53.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af612440 2024-09-19T11:13:53.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af612440 2024-09-19T11:13:53.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.780+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.781+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.781+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af612440 2024-09-19T11:13:53.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.781+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.781+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af612440 2024-09-19T11:13:53.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.781+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.781+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.781+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.781+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.782+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.782+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.782+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.782+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af612440 2024-09-19T11:13:53.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.782+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.782+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x7f55dc037040 2024-09-19T11:13:53.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.782+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.782+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.783+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.783+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.783+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.783+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af612440 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.783+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.783+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.783+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.783+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x7f55dc037040 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.784+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.784+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af612440 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.784+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.784+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af60d840 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x5607af6090c0 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5607af60cd50 con 0x7f55dc037040 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af610d40 con 0x5607af6090c0 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af610d40 con 0x5607af6090c0 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.785+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af610cf0 con 0x5607af612440 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 20 zone default found 2024-09-19T11:13:53.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 4 Realm: () 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 20 zonegroup default 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af6115e0 con 0x5607af60d840 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.786+0000 7f55f4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af616e40 con 0x5607af612440 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af6171e0 con 0x5607af612440 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 20 started sync module instance, tier type = 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.787+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af6162e0 con 0x7f55dc037040 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.788+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.788+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94591007156192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af6162e0 con 0x7f55dc037040 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.788+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af617cc0 con 0x5607af6090c0 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.789+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94591007156192] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.789+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.789+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94591007160208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af617c80 con 0x5607af6090c0 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.789+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af618740 con 0x5607af612440 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.790+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.790+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94591007162896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af619010 con 0x5607af612440 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.791+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af619ae0 con 0x7f55dc037040 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.791+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94591007160208] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.792+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.792+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94591007167952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af619f00 con 0x7f55dc037040 2024-09-19T11:13:53.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.792+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61a900 con 0x5607af6090c0 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.792+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94591007162896] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.793+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94591007167952] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.793+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.793+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94591007153712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61a410 con 0x5607af6090c0 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.793+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61b1a0 con 0x5607af60d840 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.794+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94591007153712] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.794+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.794+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94591007173872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61a410 con 0x5607af60d840 2024-09-19T11:13:53.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.794+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61bb60 con 0x5607af60d840 2024-09-19T11:13:53.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.795+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94591007173872] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.795+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.795+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94591007165280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61c3b0 con 0x5607af60d840 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.795+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61cc60 con 0x5607af60d840 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94591007165280] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'60 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94591007180624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61d050 con 0x5607af60d840 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f4746800 20 add_watcher() i=0 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f4746800 20 add_watcher() i=1 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f4746800 20 add_watcher() i=2 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f4746800 20 add_watcher() i=3 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f4746800 20 add_watcher() i=4 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f4746800 20 add_watcher() i=5 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.796+0000 7f55f4746800 20 add_watcher() i=6 2024-09-19T11:13:53.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.797+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94591007180624] v35'61 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.797+0000 7f55f4746800 20 add_watcher() i=7 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.797+0000 7f55f4746800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.797+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af620450 con 0x5607af6090c0 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.797+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.798+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94591007178496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61d9a0 con 0x5607af6090c0 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.798+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94591007178496] v35'74 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f54a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f55f4746800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f55f4746800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f55f4746800 5 note: GC not initialized 2024-09-19T11:13:53.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f54237fe640 20 reqs_thread_entry: start 2024-09-19T11:13:53.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f55f4746800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:53.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f55f4746800 20 Filter name: none 2024-09-19T11:13:53.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f54217fa640 20 reqs_thread_entry: start 2024-09-19T11:13:53.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f55f4746800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.799+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5607af652ea0 con 0x5607af6090c0 2024-09-19T11:13:53.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.800+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.800+0000 7f55f4746800 20 rados_obj.operate() r=0 bl.length=556 2024-09-19T11:13:53.822 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.801+0000 7f54a8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.801+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94591007178496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af651990 con 0x5607af6090c0 2024-09-19T11:13:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.801+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94591007178496] v35'75 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.801+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94591007156192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61bf00 con 0x7f55dc037040 2024-09-19T11:13:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.802+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94591007156192] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.803+0000 7f55f4746800 20 remove_watcher() i=0 2024-09-19T11:13:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.803+0000 7f55f4746800 2 removed watcher, disabling cache 2024-09-19T11:13:53.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.803+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94591007160208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af6167e0 con 0x5607af6090c0 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.804+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94591007160208] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.804+0000 7f55f4746800 20 remove_watcher() i=1 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.804+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94591007162896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af6167e0 con 0x5607af612440 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.805+0000 7f55ebfff640 1 -- 172.21.15.102:0/3609533342 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94591007162896] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55dc009050 con 0x5607af612440 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.805+0000 7f55f4746800 20 remove_watcher() i=2 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.805+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94591007167952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af617790 con 0x7f55dc037040 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.806+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94591007167952] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x7f55dc037040 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.806+0000 7f55f4746800 20 remove_watcher() i=3 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.806+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94591007153712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af617790 con 0x5607af6090c0 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.807+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94591007153712] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55ec00a4d0 con 0x5607af6090c0 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.807+0000 7f55f4746800 20 remove_watcher() i=4 2024-09-19T11:13:53.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.807+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94591007173872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af617790 con 0x5607af60d840 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.808+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94591007173872] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.808+0000 7f55f4746800 20 remove_watcher() i=5 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.808+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94591007165280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af61acf0 con 0x5607af60d840 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.809+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94591007165280] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.809+0000 7f55f4746800 20 remove_watcher() i=6 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.809+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94591007180624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5607af618b60 con 0x5607af60d840 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f2237640 1 -- 172.21.15.102:0/3609533342 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94591007180624] v35'62 uv60 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f55e40ca070 con 0x5607af60d840 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 20 remove_watcher() i=7 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af60d840 msgr2=0x5607af60fc30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af60d840 0x5607af60fc30 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af6090c0 msgr2=0x5607af60b580 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af6090c0 0x5607af60b580 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f55dc037040 msgr2=0x7f55dc036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f55dc037040 0x7f55dc036410 crc :-1 s=READY pgs=29 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af612440 msgr2=0x5607af614900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af612440 0x5607af614900 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54bc03cfb0 msgr2=0x7f54bc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54bc03cfb0 0x7f54bc03f470 secure :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00c010 tx=0x7f55dc010000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 msgr2=0x5607af5fdd00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f2a38640 1 -- 172.21.15.102:0/3609533342 reap_dead start 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5fdd00 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7f55e4090050 tx=0x7f55e4085ea0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 shutdown_connections 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3609533342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5f6900 0x5607af5fdd00 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 >> 172.21.15.102:0/3609533342 conn(0x5607af5f2d00 msgr2=0x5607af5f0f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 shutdown_connections 2024-09-19T11:13:53.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3609533342 wait complete. 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3549783687 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54cc03cfb0 msgr2=0x7f54cc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3549783687 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54cc03cfb0 0x7f54cc03f470 secure :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0x7f55dc00bf40 tx=0x7f55dc00f000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3549783687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5ca100 msgr2=0x5607af5c8970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3549783687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5ca100 0x5607af5c8970 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7f55e4074fd0 tx=0x7f55e40744e0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3549783687 shutdown_connections 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3549783687 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54cc03cfb0 0x7f54cc03f470 unknown :-1 s=CLOSED pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 --2- 172.21.15.102:0/3549783687 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af5ca100 0x5607af5c8970 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3549783687 >> 172.21.15.102:0/3549783687 conn(0x5607af5dc410 msgr2=0x5607af5dc7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3549783687 shutdown_connections 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.810+0000 7f55f4746800 1 -- 172.21.15.102:0/3549783687 wait complete. 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af5d3760 msgr2=0x5607af5d5c00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5607af5d3760 0x5607af5d5c00 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af4d28d0 msgr2=0x5607af5d0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5607af4d28d0 0x5607af5d0f70 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af5d77f0 msgr2=0x5607af5d9be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5607af5d77f0 0x5607af5d9be0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54d803d000 msgr2=0x7f54d803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f54d803d000 0x7f54d803f4c0 secure :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0x7f55dc001d70 tx=0x7f55dc0012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 msgr2=0x5607af445810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 --2- 172.21.15.102:0/517955817 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5607af4d1690 0x5607af445810 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7f55e4045f50 tx=0x7f55e4002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f2a38640 1 -- 172.21.15.102:0/517955817 reap_dead start 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 shutdown_connections 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 >> 172.21.15.102:0/517955817 conn(0x5607af4cca60 msgr2=0x5607af5bb390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 shutdown_connections 2024-09-19T11:13:53.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.811+0000 7f55f4746800 1 -- 172.21.15.102:0/517955817 wait complete. 2024-09-19T11:13:53.834 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:53.834 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:13:53.834 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:13:53.834 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:13:53.878 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:53.878 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:53.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42de40f800 1 Processor -- start 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42de40f800 1 -- start start 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42de40f800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559d5a001a00 0x559d5a001e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42de40f800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559d5a0037a0 con 0x559d5a002340 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42de40f800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x559d59f187d0 con 0x559d5a001a00 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42d9b92640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559d5a001a00 0x559d5a001e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42d9391640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x559d5a002340 0x559d5a0953a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52330/0 (socket says 172.21.15.102:52330) 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42d9391640 1 -- 172.21.15.102:0/3561662783 learned_addr learned my addr 172.21.15.102:0/3561662783 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42d9b92640 1 -- 172.21.15.102:0/3561662783 >> v1:172.21.15.37:6789/0 conn(0x559d5a002340 legacy=0x559d5a0953a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.878+0000 7f42d9b92640 1 -- 172.21.15.102:0/3561662783 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5a097ad0 con 0x559d5a001a00 2024-09-19T11:13:53.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.880+0000 7f42d9b92640 1 --2- 172.21.15.102:0/3561662783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a001e00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a470 tx=0x7f42cc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=66d4fa1f358fdbaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.880+0000 7f42d8b90640 1 -- 172.21.15.102:0/3561662783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc053570 con 0x559d5a001a00 2024-09-19T11:13:53.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.880+0000 7f42d8b90640 1 -- 172.21.15.102:0/3561662783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc058070 con 0x559d5a001a00 2024-09-19T11:13:53.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.880+0000 7f42d8b90640 1 -- 172.21.15.102:0/3561662783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc053880 con 0x559d5a001a00 2024-09-19T11:13:53.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.881+0000 7f42de40f800 1 -- 172.21.15.102:0/3561662783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 msgr2=0x559d5a001e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.881+0000 7f42de40f800 1 --2- 172.21.15.102:0/3561662783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a001e00 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a470 tx=0x7f42cc045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:53.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.881+0000 7f42de40f800 1 -- 172.21.15.102:0/3561662783 shutdown_connections 2024-09-19T11:13:53.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.881+0000 7f42de40f800 1 --2- 172.21.15.102:0/3561662783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a001e00 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.881+0000 7f42de40f800 1 -- 172.21.15.102:0/3561662783 >> 172.21.15.102:0/3561662783 conn(0x559d5a088c60 msgr2=0x559d5a08b0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.881+0000 7f42de40f800 1 -- 172.21.15.102:0/3561662783 shutdown_connections 2024-09-19T11:13:53.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.881+0000 7f42de40f800 1 -- 172.21.15.102:0/3561662783 wait complete. 2024-09-19T11:13:53.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.895+0000 7f42de40f800 1 Processor -- start 2024-09-19T11:13:53.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.895+0000 7f42de40f800 1 -- start start 2024-09-19T11:13:53.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.895+0000 7f42de40f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a17f4f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.895+0000 7f42de40f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559d59f25dd0 con 0x559d5a001a00 2024-09-19T11:13:53.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.895+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a17f4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.895+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a17f4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43232/0 (socket says 172.21.15.102:43232) 2024-09-19T11:13:53.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.895+0000 7f42d9b92640 1 -- 172.21.15.102:0/879472848 learned_addr learned my addr 172.21.15.102:0/879472848 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.896+0000 7f42d9b92640 1 -- 172.21.15.102:0/879472848 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5a17fae0 con 0x559d5a001a00 2024-09-19T11:13:53.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.896+0000 7f42d9b92640 1 --2- 172.21.15.102:0/879472848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a17f4f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f42cc025c20 tx=0x7f42cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae1f3d8451957d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.896+0000 7f41c7e07640 1 -- 172.21.15.102:0/879472848 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc053ba0 con 0x559d5a001a00 2024-09-19T11:13:53.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.896+0000 7f41c7e07640 1 -- 172.21.15.102:0/879472848 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc063030 con 0x559d5a001a00 2024-09-19T11:13:53.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.896+0000 7f41c7e07640 1 -- 172.21.15.102:0/879472848 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc053440 con 0x559d5a001a00 2024-09-19T11:13:53.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 -- 172.21.15.102:0/879472848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 msgr2=0x559d5a17f4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 --2- 172.21.15.102:0/879472848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a17f4f0 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f42cc025c20 tx=0x7f42cc051000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 -- 172.21.15.102:0/879472848 shutdown_connections 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 --2- 172.21.15.102:0/879472848 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a17f4f0 unknown :-1 s=CLOSED pgs=299 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 -- 172.21.15.102:0/879472848 >> 172.21.15.102:0/879472848 conn(0x559d5a088c60 msgr2=0x559d5a17ae70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 -- 172.21.15.102:0/879472848 shutdown_connections 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 -- 172.21.15.102:0/879472848 wait complete. 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 Processor -- start 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 -- start start 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a186ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42de40f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559d5a096d90 con 0x559d5a001a00 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a186ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a186ec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43244/0 (socket says 172.21.15.102:43244) 2024-09-19T11:13:53.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.897+0000 7f42d9b92640 1 -- 172.21.15.102:0/20768106 learned_addr learned my addr 172.21.15.102:0/20768106 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.898+0000 7f42d9b92640 1 -- 172.21.15.102:0/20768106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5a187420 con 0x559d5a001a00 2024-09-19T11:13:53.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.898+0000 7f42d9b92640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a186ec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f42cc045f50 tx=0x7f42cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.898+0000 7f41c6604640 1 -- 172.21.15.102:0/20768106 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc078070 con 0x559d5a001a00 2024-09-19T11:13:53.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.898+0000 7f41c6604640 1 -- 172.21.15.102:0/20768106 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc053570 con 0x559d5a001a00 2024-09-19T11:13:53.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.898+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d5a1876b0 con 0x559d5a001a00 2024-09-19T11:13:53.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.898+0000 7f41c6604640 1 -- 172.21.15.102:0/20768106 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc053850 con 0x559d5a001a00 2024-09-19T11:13:53.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.898+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d5a1882c0 con 0x559d5a001a00 2024-09-19T11:13:53.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.899+0000 7f41c6604640 1 -- 172.21.15.102:0/20768106 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f42cc07b070 con 0x559d5a001a00 2024-09-19T11:13:53.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.899+0000 7f41c6604640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41c003cfb0 0x7f41c003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.899+0000 7f41c6604640 1 -- 172.21.15.102:0/20768106 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f42cc070070 con 0x559d5a001a00 2024-09-19T11:13:53.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.899+0000 7f42d9391640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41c003cfb0 0x7f41c003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.899+0000 7f42de40f800 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a002340 0x559d5a18e510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.899+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a18ea50 con 0x559d5a002340 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.900+0000 7f42da393640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a002340 0x559d5a18e510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.900+0000 7f42d9391640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41c003cfb0 0x7f41c003f470 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001d70 tx=0x7f42d00012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.900+0000 7f42da393640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a002340 0x559d5a18e510 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.900+0000 7f42da393640 1 -- 172.21.15.102:0/20768106 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a002340 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.900+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a18edf0 con 0x559d5a002340 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.900+0000 7f42da393640 1 -- 172.21.15.102:0/20768106 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a002340 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.900+0000 7f42de40f800 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a190930 0x559d5a192db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.900+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a193540 con 0x559d5a190930 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.901+0000 7f42d9b92640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a190930 0x559d5a192db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.901+0000 7f42d9b92640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a190930 0x559d5a192db0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.901+0000 7f42d9b92640 1 -- 172.21.15.102:0/20768106 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f42cc07a030 con 0x559d5a190930 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.901+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a18f640 con 0x559d5a002340 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.902+0000 7f42da393640 1 -- 172.21.15.102:0/20768106 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a002340 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.902+0000 7f42de40f800 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1949a0 0x559d5a196d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.902+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a197430 con 0x559d5a1949a0 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.902+0000 7f42d9391640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1949a0 0x559d5a196d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.902+0000 7f42d9391640 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1949a0 0x559d5a196d90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.902+0000 7f42d9391640 1 -- 172.21.15.102:0/20768106 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1949a0 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.902+0000 7f42de40f800 1 Processor -- start 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42de40f800 1 -- start start 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42de40f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1a51b0 0x559d5a1a55d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42de40f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559d59f844a0 con 0x559d5a1a51b0 2024-09-19T11:13:53.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1a51b0 0x559d5a1a55d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1a51b0 0x559d5a1a55d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43248/0 (socket says 172.21.15.102:43248) 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42d9b92640 1 -- 172.21.15.102:0/4110927864 learned_addr learned my addr 172.21.15.102:0/4110927864 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42d9b92640 1 -- 172.21.15.102:0/4110927864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5a1a5c10 con 0x559d5a1a51b0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42d9b92640 1 --2- 172.21.15.102:0/4110927864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1a51b0 0x559d5a1a55d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f42cc098010 tx=0x7f42cc07c4b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f41bf7fe640 1 -- 172.21.15.102:0/4110927864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc095480 con 0x559d5a1a51b0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f41bf7fe640 1 -- 172.21.15.102:0/4110927864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc07cbe0 con 0x559d5a1a51b0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.903+0000 7f42de40f800 1 -- 172.21.15.102:0/4110927864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d5a1a6440 con 0x559d5a1a51b0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.904+0000 7f41bf7fe640 1 -- 172.21.15.102:0/4110927864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc07cd90 con 0x559d5a1a51b0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.904+0000 7f42de40f800 1 -- 172.21.15.102:0/4110927864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d5a1a69e0 con 0x559d5a1a51b0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.904+0000 7f41bf7fe640 1 -- 172.21.15.102:0/4110927864 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f42cc0980b0 con 0x559d5a1a51b0 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.904+0000 7f41bf7fe640 1 --2- 172.21.15.102:0/4110927864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41b403d000 0x7f41b403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.904+0000 7f41bf7fe640 1 -- 172.21.15.102:0/4110927864 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f42cc088030 con 0x559d5a1a51b0 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42d9391640 1 --2- 172.21.15.102:0/4110927864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41b403d000 0x7f41b403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42de40f800 1 Processor -- start 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42de40f800 1 -- start start 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42d9391640 1 --2- 172.21.15.102:0/4110927864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41b403d000 0x7f41b403f4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42d000bf40 tx=0x7f42d000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42de40f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b1e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42de40f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559d5a17feb0 con 0x559d5a1b1a50 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b1e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b1e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43258/0 (socket says 172.21.15.102:43258) 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42d9b92640 1 -- 172.21.15.102:0/2476944489 learned_addr learned my addr 172.21.15.102:0/2476944489 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.905+0000 7f42d9b92640 1 -- 172.21.15.102:0/2476944489 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5a1b2420 con 0x559d5a1b1a50 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42d9b92640 1 --2- 172.21.15.102:0/2476944489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b1e30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f42cc054e30 tx=0x7f42cc05dd90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caaa3f48339b832f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f41bd7fa640 1 -- 172.21.15.102:0/2476944489 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc09d030 con 0x559d5a1b1a50 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f41bd7fa640 1 -- 172.21.15.102:0/2476944489 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc009700 con 0x559d5a1b1a50 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f41bd7fa640 1 -- 172.21.15.102:0/2476944489 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc001000 con 0x559d5a1b1a50 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42de40f800 1 -- 172.21.15.102:0/2476944489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 msgr2=0x559d5a1b1e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42de40f800 1 --2- 172.21.15.102:0/2476944489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b1e30 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7f42cc054e30 tx=0x7f42cc05dd90 comp rx=0 tx=0).stop 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42de40f800 1 -- 172.21.15.102:0/2476944489 shutdown_connections 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42de40f800 1 --2- 172.21.15.102:0/2476944489 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b1e30 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42de40f800 1 -- 172.21.15.102:0/2476944489 >> 172.21.15.102:0/2476944489 conn(0x559d5a1ade50 msgr2=0x559d5a1ac090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42de40f800 1 -- 172.21.15.102:0/2476944489 shutdown_connections 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42de40f800 1 -- 172.21.15.102:0/2476944489 wait complete. 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.906+0000 7f42de40f800 1 Processor -- start 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f42de40f800 1 -- start start 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f42de40f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b8e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f42de40f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559d5a1b28b0 con 0x559d5a1b1a50 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b8e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f42d9b92640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b8e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43270/0 (socket says 172.21.15.102:43270) 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 learned_addr learned my addr 172.21.15.102:0/3013437043 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559d5a1b93e0 con 0x559d5a1b1a50 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f42d9b92640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b8e80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a470 tx=0x7f42cc0a0ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.907+0000 7f41ab7fe640 1 -- 172.21.15.102:0/3013437043 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc0bc070 con 0x559d5a1b1a50 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.908+0000 7f41ab7fe640 1 -- 172.21.15.102:0/3013437043 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42cc05d3a0 con 0x559d5a1b1a50 2024-09-19T11:13:53.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.908+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559d5a1b93e0 con 0x559d5a1b1a50 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.908+0000 7f41ab7fe640 1 -- 172.21.15.102:0/3013437043 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42cc05d550 con 0x559d5a1b1a50 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.908+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559d5a1b93e0 con 0x559d5a1b1a50 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.908+0000 7f41ab7fe640 1 -- 172.21.15.102:0/3013437043 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f42cc0bf070 con 0x559d5a1b1a50 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f41ab7fe640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41a403cfb0 0x7f41a403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f41ab7fe640 1 -- 172.21.15.102:0/3013437043 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f42cc0c2ca0 con 0x559d5a1b1a50 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f42d9391640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41a403cfb0 0x7f41a403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a1c4250 0x559d5a1c6710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c6e60 con 0x559d5a1c4250 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f42da393640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a1c4250 0x559d5a1c6710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f42d9391640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41a403cfb0 0x7f41a403f470 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c010 tx=0x7f42d0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.909+0000 7f42da393640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a1c4250 0x559d5a1c6710 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 realm 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7270 con 0x559d5a1c4250 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7b40 con 0x559d5a1c4250 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a1c89d0 0x559d5a1cadc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.910+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1cb500 con 0x559d5a1c89d0 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42d9b92640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a1c89d0 0x559d5a1cadc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42d9b92640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a1c89d0 0x559d5a1cadc0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42de40f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42de40f800 20 searching for the correct realm 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1cd5a0 0x559d5a1cfa60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d0130 con 0x559d5a1cd5a0 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42d9391640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1cd5a0 0x559d5a1cfa60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.911+0000 7f42d9391640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1cd5a0 0x559d5a1cfa60 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.912+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.912+0000 7f42d9391640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f42d0037040 0x7f42d0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.912+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d0130 con 0x7f42d0037040 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.912+0000 7f42da393640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f42d0037040 0x7f42d0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.912+0000 7f42da393640 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f42d0037040 0x7f42d0036410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.912+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.912+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.913+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.913+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.913+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.913+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.913+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.913+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.913+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.913+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.914+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.914+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x7f42d0037040 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.914+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.914+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.914+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.914+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.914+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.914+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x7f42d0037040 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.915+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.916+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.916+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.916+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.916+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.916+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.916+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.916+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.916+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.917+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.917+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.917+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.917+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.917+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.917+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x7f42d0037040 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.917+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.917+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.918+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.918+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.918+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.918+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.918+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.918+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.918+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.918+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x7f42d0037040 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.919+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.919+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.919+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.919+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c89d0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.919+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.919+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x559d5a1c4250 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.919+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.919+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1c7ee0 con 0x7f42d0037040 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1cbea0 con 0x559d5a1c4250 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1cbea0 con 0x559d5a1c4250 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1cbe50 con 0x559d5a1cd5a0 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 zone default found 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 4 Realm: () 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:53.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 zonegroup default 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.920+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1cc740 con 0x559d5a1c89d0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d1fa0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d2340 con 0x559d5a1cd5a0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 20 started sync module instance, tier type = 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.921+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d1440 con 0x7f42d0037040 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.922+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.922+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94134310082880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d1440 con 0x7f42d0037040 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.922+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d2e20 con 0x559d5a1c4250 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.923+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94134310082880] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.923+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.923+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94134310086896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d1440 con 0x559d5a1c4250 2024-09-19T11:13:53.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.923+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d38d0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.924+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94134310086896] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.925+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.925+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94134310080400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d13b0 con 0x559d5a1cd5a0 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.925+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d4790 con 0x7f42d0037040 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.926+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94134310080400] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.926+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.926+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94134310093536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d4700 con 0x7f42d0037040 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.926+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d5550 con 0x559d5a1c4250 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.927+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94134310093536] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.927+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.927+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94134310095600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d5550 con 0x559d5a1c4250 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.927+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d5f60 con 0x559d5a1c89d0 2024-09-19T11:13:53.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.928+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94134310095600] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.928+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.928+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94134310099632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d6300 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.928+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d6cc0 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.929+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.929+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94134310105264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d7980 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.929+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d83a0 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.929+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94134310099632] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94134310105264] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'63 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94134310108816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d74d0 con 0x559d5a1c89d0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42de40f800 20 add_watcher() i=0 2024-09-19T11:13:53.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42de40f800 20 add_watcher() i=1 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42de40f800 20 add_watcher() i=2 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42de40f800 20 add_watcher() i=3 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42de40f800 20 add_watcher() i=4 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42de40f800 20 add_watcher() i=5 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.930+0000 7f42de40f800 20 add_watcher() i=6 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.931+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94134310108816] v35'64 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.931+0000 7f42de40f800 20 add_watcher() i=7 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.931+0000 7f42de40f800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.931+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1db390 con 0x559d5a1c4250 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.931+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.931+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94134310096656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d8810 con 0x559d5a1c4250 2024-09-19T11:13:53.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.932+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94134310096656] v35'76 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.932+0000 7f418b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.932+0000 7f42de40f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.932+0000 7f42de40f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.932+0000 7f42de40f800 5 note: GC not initialized 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.933+0000 7f418a7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.933+0000 7f42de40f800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.933+0000 7f42de40f800 20 Filter name: none 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.933+0000 7f40fbfff640 20 reqs_thread_entry: start 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.933+0000 7f42de40f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.933+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559d5a20ddb0 con 0x559d5a1c4250 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.933+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.933+0000 7f42de40f800 20 rados_obj.operate() r=0 bl.length=556 2024-09-19T11:13:53.947 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.934+0000 7f418b7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.934+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94134310096656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a20c8e0 con 0x559d5a1c4250 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.935+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94134310096656] v35'77 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.935+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94134310082880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d4f10 con 0x7f42d0037040 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.936+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94134310082880] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.936+0000 7f42de40f800 20 remove_watcher() i=0 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.936+0000 7f42de40f800 2 removed watcher, disabling cache 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.936+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94134310086896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d4f10 con 0x559d5a1c4250 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.937+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94134310086896] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.937+0000 7f42de40f800 20 remove_watcher() i=1 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.937+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94134310080400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d4f10 con 0x559d5a1cd5a0 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.938+0000 7f42d9391640 1 -- 172.21.15.102:0/3013437043 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94134310080400] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d0009050 con 0x559d5a1cd5a0 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.938+0000 7f42de40f800 20 remove_watcher() i=2 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.938+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94134310093536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d0f90 con 0x7f42d0037040 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.939+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94134310093536] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x7f42d0037040 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.939+0000 7f42de40f800 20 remove_watcher() i=3 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.939+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94134310095600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d42e0 con 0x559d5a1c4250 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.940+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94134310095600] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42d400a4d0 con 0x559d5a1c4250 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.940+0000 7f42de40f800 20 remove_watcher() i=4 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.940+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94134310099632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d0f90 con 0x559d5a1c89d0 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.941+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94134310099632] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.941+0000 7f42de40f800 20 remove_watcher() i=5 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.941+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94134310105264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d4af0 con 0x559d5a1c89d0 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.942+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94134310105264] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.942+0000 7f42de40f800 20 remove_watcher() i=6 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.942+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94134310108816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559d5a1d42e0 con 0x559d5a1c89d0 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42d9b92640 1 -- 172.21.15.102:0/3013437043 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94134310108816] v35'65 uv63 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f42cc0be030 con 0x559d5a1c89d0 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 20 remove_watcher() i=7 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a1c89d0 msgr2=0x559d5a1cadc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a1c89d0 0x559d5a1cadc0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a1c4250 msgr2=0x559d5a1c6710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a1c4250 0x559d5a1c6710 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f42d0037040 msgr2=0x7f42d0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f42d0037040 0x7f42d0036410 crc :-1 s=READY pgs=30 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1cd5a0 msgr2=0x559d5a1cfa60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.943+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1cd5a0 0x559d5a1cfa60 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41a403cfb0 msgr2=0x7f41a403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41a403cfb0 0x7f41a403f470 secure :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0x7f42d000c010 tx=0x7f42d0010000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42da393640 1 -- 172.21.15.102:0/3013437043 reap_dead start 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 msgr2=0x559d5a1b8e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b8e80 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7f42cc00a470 tx=0x7f42cc0a0ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 shutdown_connections 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/3013437043 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1b1a50 0x559d5a1b8e80 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 >> 172.21.15.102:0/3013437043 conn(0x559d5a1ade50 msgr2=0x559d5a1ac060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 shutdown_connections 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/3013437043 wait complete. 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/4110927864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41b403d000 msgr2=0x7f41b403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/4110927864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41b403d000 0x7f41b403f4c0 secure :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0x7f42d000bf40 tx=0x7f42d000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/4110927864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1a51b0 msgr2=0x559d5a1a55d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/4110927864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1a51b0 0x559d5a1a55d0 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x7f42cc098010 tx=0x7f42cc07c4b0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/4110927864 shutdown_connections 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/4110927864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41b403d000 0x7f41b403f4c0 unknown :-1 s=CLOSED pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/4110927864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a1a51b0 0x559d5a1a55d0 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/4110927864 >> 172.21.15.102:0/4110927864 conn(0x559d5a199560 msgr2=0x559d5a199940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/4110927864 shutdown_connections 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/4110927864 wait complete. 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a190930 msgr2=0x559d5a192db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559d5a190930 0x559d5a192db0 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a002340 msgr2=0x559d5a18e510 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559d5a002340 0x559d5a18e510 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1949a0 msgr2=0x559d5a196d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559d5a1949a0 0x559d5a196d90 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.944+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41c003cfb0 msgr2=0x7f41c003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.945+0000 7f42de40f800 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f41c003cfb0 0x7f41c003f470 secure :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0x7f42d0001d70 tx=0x7f42d00012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.945+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 msgr2=0x559d5a186ec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.945+0000 7f42de40f800 1 --2- 172.21.15.102:0/20768106 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559d5a001a00 0x559d5a186ec0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f42cc045f50 tx=0x7f42cc002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.945+0000 7f42da393640 1 -- 172.21.15.102:0/20768106 reap_dead start 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.945+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 shutdown_connections 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.945+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 >> 172.21.15.102:0/20768106 conn(0x559d5a088c60 msgr2=0x559d5a179660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.945+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 shutdown_connections 2024-09-19T11:13:53.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:53.945+0000 7f42de40f800 1 -- 172.21.15.102:0/20768106 wait complete. 2024-09-19T11:13:53.958 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:53.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-19T11:13:53.959 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'create', '--subuser', 'foo:foo2', '--secret', 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', '--key-type', 'swift'] 2024-09-19T11:13:53.959 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser create --subuser foo:foo2 --secret ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy --key-type swift 2024-09-19T11:13:54.007 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:54.007 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.007+0000 7f1ed3f2c800 1 Processor -- start 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.007+0000 7f1ed3f2c800 1 -- start start 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.007+0000 7f1ed3f2c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e51e5c5ac0 0x55e51e5c7f80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.007+0000 7f1ed3f2c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e51e5c8600 con 0x55e51e5c1f50 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.007+0000 7f1ed3f2c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55e51e44c7d0 con 0x55e51e5c5ac0 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.008+0000 7f1ec7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e51e5c5ac0 0x55e51e5c7f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.008+0000 7f1ec7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e51e5c5ac0 0x55e51e5c7f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43284/0 (socket says 172.21.15.102:43284) 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.008+0000 7f1ecfcad640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55e51e5c1f50 0x55e51e5c4340 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52346/0 (socket says 172.21.15.102:52346) 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.008+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1754120564 learned_addr learned my addr 172.21.15.102:0/1754120564 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.008+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1754120564 >> v1:172.21.15.37:6789/0 conn(0x55e51e5c1f50 legacy=0x55e51e5c4340 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.008+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1754120564 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51e5c9830 con 0x55e51e5c5ac0 2024-09-19T11:13:54.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/1754120564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c5ac0 0x55e51e5c7f80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800a520 tx=0x7f1eb8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f77ab88e55ee14ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ecf4ac640 1 -- 172.21.15.102:0/1754120564 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb8055070 con 0x55e51e5c5ac0 2024-09-19T11:13:54.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ecf4ac640 1 -- 172.21.15.102:0/1754120564 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1eb80515b0 con 0x55e51e5c5ac0 2024-09-19T11:13:54.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ecf4ac640 1 -- 172.21.15.102:0/1754120564 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1eb80518d0 con 0x55e51e5c5ac0 2024-09-19T11:13:54.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1754120564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c5ac0 msgr2=0x55e51e5c7f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1754120564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c5ac0 0x55e51e5c7f80 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f1eb800a520 tx=0x7f1eb8045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1754120564 shutdown_connections 2024-09-19T11:13:54.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1754120564 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c5ac0 0x55e51e5c7f80 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1754120564 >> 172.21.15.102:0/1754120564 conn(0x55e51e5bbab0 msgr2=0x55e51e5bdef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1754120564 shutdown_connections 2024-09-19T11:13:54.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.010+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1754120564 wait complete. 2024-09-19T11:13:54.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.024+0000 7f1ed3f2c800 1 Processor -- start 2024-09-19T11:13:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.024+0000 7f1ed3f2c800 1 -- start start 2024-09-19T11:13:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.024+0000 7f1ed3f2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e6b13a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.024+0000 7f1ed3f2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e51e459dd0 con 0x55e51e5c1f50 2024-09-19T11:13:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.024+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e6b13a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.024+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e6b13a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43298/0 (socket says 172.21.15.102:43298) 2024-09-19T11:13:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.024+0000 7f1ecfcad640 1 -- 172.21.15.102:0/2902708326 learned_addr learned my addr 172.21.15.102:0/2902708326 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.025+0000 7f1ecfcad640 1 -- 172.21.15.102:0/2902708326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51e6b1990 con 0x55e51e5c1f50 2024-09-19T11:13:54.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.025+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/2902708326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e6b13a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0001eb0 tx=0x7f1ec000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=491c076bf9e7bacf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.025+0000 7f1dbde0b640 1 -- 172.21.15.102:0/2902708326 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec000e5c0 con 0x55e51e5c1f50 2024-09-19T11:13:54.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.025+0000 7f1dbde0b640 1 -- 172.21.15.102:0/2902708326 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec0006070 con 0x55e51e5c1f50 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.025+0000 7f1dbde0b640 1 -- 172.21.15.102:0/2902708326 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec000e8b0 con 0x55e51e5c1f50 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2902708326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 msgr2=0x55e51e6b13a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2902708326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e6b13a0 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0001eb0 tx=0x7f1ec000b6c0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2902708326 shutdown_connections 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2902708326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e6b13a0 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2902708326 >> 172.21.15.102:0/2902708326 conn(0x55e51e5bbab0 msgr2=0x55e51e6acd20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2902708326 shutdown_connections 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2902708326 wait complete. 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 Processor -- start 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 -- start start 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e5c1670 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ed3f2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e51e5c8ad0 con 0x55e51e5c1f50 2024-09-19T11:13:54.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e5c1670 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e5c1670 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43302/0 (socket says 172.21.15.102:43302) 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.026+0000 7f1ecfcad640 1 -- 172.21.15.102:0/2897776487 learned_addr learned my addr 172.21.15.102:0/2897776487 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.027+0000 7f1ecfcad640 1 -- 172.21.15.102:0/2897776487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51e5c1bd0 con 0x55e51e5c1f50 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.027+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e5c1670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55e51e6b2330 tx=0x7f1ec0000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.027+0000 7f1db7fff640 1 -- 172.21.15.102:0/2897776487 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec001a7c0 con 0x55e51e5c1f50 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.027+0000 7f1db7fff640 1 -- 172.21.15.102:0/2897776487 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec001a960 con 0x55e51e5c1f50 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.027+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51e5bff80 con 0x55e51e5c1f50 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.027+0000 7f1db7fff640 1 -- 172.21.15.102:0/2897776487 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec001ac40 con 0x55e51e5c1f50 2024-09-19T11:13:54.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.027+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51e5c0540 con 0x55e51e5c1f50 2024-09-19T11:13:54.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.028+0000 7f1db7fff640 1 -- 172.21.15.102:0/2897776487 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1ec0017070 con 0x55e51e5c1f50 2024-09-19T11:13:54.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.028+0000 7f1db7fff640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1db803cfb0 0x7f1db803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.028+0000 7f1db7fff640 1 -- 172.21.15.102:0/2897776487 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1ec0015020 con 0x55e51e5c1f50 2024-09-19T11:13:54.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.028+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1db803cfb0 0x7f1db803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.028+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e5c5ac0 0x55e51e6c23d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.028+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6c2960 con 0x55e51e5c5ac0 2024-09-19T11:13:54.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.028+0000 7f1ed04ae640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e5c5ac0 0x55e51e6c23d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.029+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1db803cfb0 0x7f1db803f470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8057000 tx=0x7f1eb8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.029+0000 7f1ed04ae640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e5c5ac0 0x55e51e6c23d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.029+0000 7f1ed04ae640 1 -- 172.21.15.102:0/2897776487 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e5c5ac0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.029+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e5c0a70 con 0x55e51e5c5ac0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.029+0000 7f1ed04ae640 1 -- 172.21.15.102:0/2897776487 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e5c5ac0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.029+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6c4c90 0x55e51e6c7080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.029+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6c7750 con 0x55e51e6c4c90 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.029+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6c4c90 0x55e51e6c7080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.030+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6c4c90 0x55e51e6c7080 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.030+0000 7f1ecfcad640 1 -- 172.21.15.102:0/2897776487 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f1ec002e070 con 0x55e51e6c4c90 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.030+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6c3b30 con 0x55e51e5c5ac0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.030+0000 7f1ed04ae640 1 -- 172.21.15.102:0/2897776487 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e5c5ac0 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.030+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e6c8b90 0x55e51e6caf80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.030+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6cb6c0 con 0x55e51e6c8b90 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.031+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e6c8b90 0x55e51e6caf80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.031+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e6c8b90 0x55e51e6caf80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.031+0000 7f1ec7fff640 1 -- 172.21.15.102:0/2897776487 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e6c8b90 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ed3f2c800 1 Processor -- start 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ed3f2c800 1 -- start start 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ed3f2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6d9440 0x55e51e6d9860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ed3f2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e51e4b84a0 con 0x55e51e6d9440 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6d9440 0x55e51e6d9860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6d9440 0x55e51e6d9860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43304/0 (socket says 172.21.15.102:43304) 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ecfcad640 1 -- 172.21.15.102:0/41105757 learned_addr learned my addr 172.21.15.102:0/41105757 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ecfcad640 1 -- 172.21.15.102:0/41105757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51e6d9ea0 con 0x55e51e6d9440 2024-09-19T11:13:54.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.032+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/41105757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6d9440 0x55e51e6d9860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0053260 tx=0x7f1ec001bed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.033+0000 7f1db57fa640 1 -- 172.21.15.102:0/41105757 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec00174a0 con 0x55e51e6d9440 2024-09-19T11:13:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.033+0000 7f1db57fa640 1 -- 172.21.15.102:0/41105757 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec0019840 con 0x55e51e6d9440 2024-09-19T11:13:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.033+0000 7f1db57fa640 1 -- 172.21.15.102:0/41105757 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec0019b20 con 0x55e51e6d9440 2024-09-19T11:13:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.033+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/41105757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51e6da6d0 con 0x55e51e6d9440 2024-09-19T11:13:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.033+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/41105757 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51e6da6d0 con 0x55e51e6d9440 2024-09-19T11:13:54.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.033+0000 7f1db57fa640 1 -- 172.21.15.102:0/41105757 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1ec004c090 con 0x55e51e6d9440 2024-09-19T11:13:54.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.033+0000 7f1db57fa640 1 --2- 172.21.15.102:0/41105757 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1da803d000 0x7f1da803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.033+0000 7f1db57fa640 1 -- 172.21.15.102:0/41105757 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1ec004b070 con 0x55e51e6d9440 2024-09-19T11:13:54.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/41105757 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1da803d000 0x7f1da803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ed3f2c800 1 Processor -- start 2024-09-19T11:13:54.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ed3f2c800 1 -- start start 2024-09-19T11:13:54.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/41105757 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1da803d000 0x7f1da803f4c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55e51e6c2e10 tx=0x7f1eb8005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ed3f2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6e5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ed3f2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e51e6b1dc0 con 0x55e51e6e5bd0 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6e5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6e5fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43308/0 (socket says 172.21.15.102:43308) 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.034+0000 7f1ecfcad640 1 -- 172.21.15.102:0/2686169403 learned_addr learned my addr 172.21.15.102:0/2686169403 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ecfcad640 1 -- 172.21.15.102:0/2686169403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51e6e65a0 con 0x55e51e6e5bd0 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/2686169403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6e5fb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1ec004c7f0 tx=0x7f1ec00544a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=99780a64ca06d79 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1daeffd640 1 -- 172.21.15.102:0/2686169403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec0027cc0 con 0x55e51e6e5bd0 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1daeffd640 1 -- 172.21.15.102:0/2686169403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec00405e0 con 0x55e51e6e5bd0 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1daeffd640 1 -- 172.21.15.102:0/2686169403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec0019cc0 con 0x55e51e6e5bd0 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2686169403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 msgr2=0x55e51e6e5fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2686169403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6e5fb0 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f1ec004c7f0 tx=0x7f1ec00544a0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2686169403 shutdown_connections 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2686169403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6e5fb0 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2686169403 >> 172.21.15.102:0/2686169403 conn(0x55e51e6e1fd0 msgr2=0x55e51e6e0210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2686169403 shutdown_connections 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.035+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2686169403 wait complete. 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.036+0000 7f1ed3f2c800 1 Processor -- start 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.036+0000 7f1ed3f2c800 1 -- start start 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.036+0000 7f1ed3f2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6ecf90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.036+0000 7f1ed3f2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e51e6e6a30 con 0x55e51e6e5bd0 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.036+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6ecf90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.036+0000 7f1ecfcad640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6ecf90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43318/0 (socket says 172.21.15.102:43318) 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.036+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 learned_addr learned my addr 172.21.15.102:0/1434952509 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.036+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e51e6ed4f0 con 0x55e51e6e5bd0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.037+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6ecf90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0029fd0 tx=0x7f1ec0044f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.037+0000 7f1dad7fa640 1 -- 172.21.15.102:0/1434952509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec0072070 con 0x55e51e6e5bd0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.037+0000 7f1dad7fa640 1 -- 172.21.15.102:0/1434952509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1ec0066040 con 0x55e51e6e5bd0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.037+0000 7f1dad7fa640 1 -- 172.21.15.102:0/1434952509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1ec004c990 con 0x55e51e6e5bd0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.037+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e51e6ed4f0 con 0x55e51e6e5bd0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.037+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e51e6ed4f0 con 0x55e51e6e5bd0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.038+0000 7f1dad7fa640 1 -- 172.21.15.102:0/1434952509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1ec0045b30 con 0x55e51e6e5bd0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.038+0000 7f1dad7fa640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1d9803cfb0 0x7f1d9803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.038+0000 7f1dad7fa640 1 -- 172.21.15.102:0/1434952509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1ec0077c50 con 0x55e51e6e5bd0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.038+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1d9803cfb0 0x7f1d9803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.038+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.038+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e6f84d0 0x55e51e6fa990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.038+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fb0e0 con 0x55e51e6f84d0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed04ae640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e6f84d0 0x55e51e6fa990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1d9803cfb0 0x7f1d9803f470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8051580 tx=0x7f1eb806d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed04ae640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e6f84d0 0x55e51e6fa990 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed3f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed3f2c800 20 realm 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fb4f0 con 0x55e51e6f84d0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed3f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed3f2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.039+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fbdc0 con 0x55e51e6f84d0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed3f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed3f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6fcec0 0x55e51e6ff2b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6ff8c0 con 0x55e51e6fcec0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6fcec0 0x55e51e6ff2b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.040+0000 7f1ecfcad640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6fcec0 0x55e51e6ff2b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ed3f2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:54.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ed3f2c800 20 searching for the correct realm 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e701820 0x55e51e703ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e704360 con 0x55e51e701820 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e701820 0x55e51e703ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e701820 0x55e51e703ce0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ec7fff640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1eb8069040 0x7f1eb808b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.041+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e704360 con 0x7f1eb8069040 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.042+0000 7f1ed04ae640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1eb8069040 0x7f1eb808b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.042+0000 7f1ed04ae640 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1eb8069040 0x7f1eb808b430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.042+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.042+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.042+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.042+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.042+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.043+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.043+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.043+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.043+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.043+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.043+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.043+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x7f1eb8069040 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.044+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.044+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e701820 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.044+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.044+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.044+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.044+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.044+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.044+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.045+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.045+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x7f1eb8069040 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.045+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.045+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e701820 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.045+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.045+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e701820 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.045+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.045+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.046+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.046+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e701820 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.046+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.046+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e701820 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.046+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.046+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.046+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.046+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.047+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.047+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.047+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.047+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e701820 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.047+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.047+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x7f1eb8069040 2024-09-19T11:13:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.047+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.047+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.048+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.048+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.048+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.048+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e701820 2024-09-19T11:13:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.048+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.048+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.049+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.049+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x7f1eb8069040 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.049+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.049+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e701820 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.049+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.049+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6fcec0 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.049+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.049+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x55e51e6f84d0 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e51e6fc160 con 0x7f1eb8069040 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e700110 con 0x55e51e6f84d0 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e700110 con 0x55e51e6f84d0 2024-09-19T11:13:54.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.050+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e700110 con 0x55e51e701820 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 zone default found 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 4 Realm: () 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 zonegroup default 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e700a90 con 0x55e51e6fcec0 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e706330 con 0x55e51e701820 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e706790 con 0x55e51e701820 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 started sync module instance, tier type = 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.051+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e705670 con 0x7f1eb8069040 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.052+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.052+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94442546551696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e705670 con 0x7f1eb8069040 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.052+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e7072c0 con 0x55e51e6f84d0 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.053+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94442546551696] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.054+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.054+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94442546556304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e705670 con 0x55e51e6f84d0 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.054+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e707d70 con 0x55e51e701820 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.055+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94442546556304] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.055+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.055+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94442546549184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e7055e0 con 0x55e51e701820 2024-09-19T11:13:54.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.055+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e708c30 con 0x7f1eb8069040 2024-09-19T11:13:54.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.056+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.056+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94442546549184] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.056+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94442546563488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e7094d0 con 0x7f1eb8069040 2024-09-19T11:13:54.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.056+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e708160 con 0x55e51e6f84d0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.057+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.057+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94442546567696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e708160 con 0x55e51e6f84d0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.057+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e70a940 con 0x55e51e6fcec0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.057+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94442546563488] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.058+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.058+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94442546565152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e70ad30 con 0x55e51e6fcec0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.058+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e70b6f0 con 0x55e51e6fcec0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.058+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94442546567696] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.059+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94442546565152] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.059+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.059+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94442546573888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e70bae0 con 0x55e51e6fcec0 2024-09-19T11:13:54.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.059+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e70c330 con 0x55e51e6fcec0 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94442546573888] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'66 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94442546576096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e70c3b0 con 0x55e51e6fcec0 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ed3f2c800 20 add_watcher() i=0 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ed3f2c800 20 add_watcher() i=1 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ed3f2c800 20 add_watcher() i=2 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ed3f2c800 20 add_watcher() i=3 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ed3f2c800 20 add_watcher() i=4 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ed3f2c800 20 add_watcher() i=5 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.060+0000 7f1ed3f2c800 20 add_watcher() i=6 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.061+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94442546576096] v35'67 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.061+0000 7f1ed3f2c800 20 add_watcher() i=7 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.061+0000 7f1ed3f2c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.061+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e70f6c0 con 0x55e51e6f84d0 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.062+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.062+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94442546577520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e70c940 con 0x55e51e6f84d0 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.062+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94442546577520] v35'78 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.062+0000 7f1d85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 5 note: GC not initialized 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1d84fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:54.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 20 Filter name: none 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1cfe7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e742530 con 0x55e51e6f84d0 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 20 rados_obj.operate() r=0 bl.length=556 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.063+0000 7f1ed3f2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed3f2c800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : miss 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed3f2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.2 8:45671577:users.swift::foo%3afoo2:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e743110 con 0x7f1eb8069040 2024-09-19T11:13:54.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 foo:foo2 [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 194+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed3f2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed3f2c800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x0 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed3f2c800 10 adding default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed3f2c800 10 cache get: name=default.rgw.meta+users.swift+foo:foo2 : hit (negative entry) 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.064+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~673 in=673b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e748e10 con 0x55e51e6f84d0 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 foo [delete,create,call,call,writefull 0~673] v35'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1ed3f2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1ed3f2c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1ed3f2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94442546825264 in=861b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e745a00 con 0x55e51e6f84d0 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94442546567696 notify 150323855367 ret 0) ==== 891+0+0 (crc 0 0 0) 0x7f1ec80267f0 con 0x55e51e6f84d0 2024-09-19T11:13:54.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1daeffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 94442546567696 notifier 4400 bl.length()=849 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1daeffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1daeffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1daeffd640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1d94003ea0 con 0x55e51e6f84d0 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(65 notify.4 [notify cookie 94442546825264 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.065+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.066+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94442546825264 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1ec8018d50 con 0x55e51e6f84d0 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.066+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 8.2 8:45671577:users.swift::foo%3afoo2:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e748830 con 0x7f1eb8069040 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 foo:foo2 [delete,create,writefull 0~7] v35'1 uv1 ondisk = 0) ==== 236+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1ed3f2c800 10 cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1ed3f2c800 10 moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1ed3f2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94442546825264 in=178b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e51e7434b0 con 0x7f1eb8069040 2024-09-19T11:13:54.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== watch-notify(notify (1) cookie 94442546551696 notify 150323855363 ret 0) ==== 208+0+0 (crc 0 0 0) 0x7f1ec8018d50 con 0x7f1eb8069040 2024-09-19T11:13:54.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1dae7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 94442546551696 notifier 4400 bl.length()=166 2024-09-19T11:13:54.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1dae7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.swift+foo:foo2 info.flags=0x7 2024-09-19T11:13:54.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1dae7fc640 10 rgw watcher librados: moving default.rgw.meta+users.swift+foo:foo2 to cache LRU end 2024-09-19T11:13:54.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1dae7fc640 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1d04003400 con 0x7f1eb8069040 2024-09-19T11:13:54.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.067+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(68 notify.0 [notify cookie 94442546825264 out=8b] v0'0 uv66 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.068+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== watch-notify(notify_complete (2) cookie 94442546825264 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f1ec8026a90 con 0x7f1eb8069040 2024-09-19T11:13:54.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.068+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(69 notify.0 [notify-ack] v0'0 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.082 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-19T11:13:54.065107Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:54.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.068+0000 7f1d85fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.068+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94442546577520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e740370 con 0x55e51e6f84d0 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.069+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94442546577520] v35'79 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.069+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94442546551696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e740370 con 0x7f1eb8069040 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.070+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94442546551696] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.070+0000 7f1ed3f2c800 20 remove_watcher() i=0 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.070+0000 7f1ed3f2c800 2 removed watcher, disabling cache 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.070+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94442546556304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e740370 con 0x55e51e6f84d0 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.071+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94442546556304] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.071+0000 7f1ed3f2c800 20 remove_watcher() i=1 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.071+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94442546549184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e740370 con 0x55e51e701820 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.072+0000 7f1ec7fff640 1 -- 172.21.15.102:0/1434952509 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94442546549184] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1eb8057030 con 0x55e51e701820 2024-09-19T11:13:54.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.072+0000 7f1ed3f2c800 20 remove_watcher() i=2 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.072+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94442546563488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e705b90 con 0x7f1eb8069040 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.073+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94442546563488] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x7f1eb8069040 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.073+0000 7f1ed3f2c800 20 remove_watcher() i=3 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.073+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94442546567696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e706d90 con 0x55e51e6f84d0 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.075+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94442546567696] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec800a4d0 con 0x55e51e6f84d0 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.075+0000 7f1ed3f2c800 20 remove_watcher() i=4 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.075+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94442546565152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e7051c0 con 0x55e51e6fcec0 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.076+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94442546565152] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.076+0000 7f1ed3f2c800 20 remove_watcher() i=5 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.076+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94442546573888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e705b90 con 0x55e51e6fcec0 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.077+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94442546573888] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.077+0000 7f1ed3f2c800 20 remove_watcher() i=6 2024-09-19T11:13:54.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.077+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94442546576096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e51e709a10 con 0x55e51e6fcec0 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.077+0000 7f1ecfcad640 1 -- 172.21.15.102:0/1434952509 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94442546576096] v35'68 uv66 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1ec0037020 con 0x55e51e6fcec0 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.077+0000 7f1ed3f2c800 20 remove_watcher() i=7 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6fcec0 msgr2=0x55e51e6ff2b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6fcec0 0x55e51e6ff2b0 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e6f84d0 msgr2=0x55e51e6fa990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e6f84d0 0x55e51e6fa990 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1eb8069040 msgr2=0x7f1eb808b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1eb8069040 0x7f1eb808b430 crc :-1 s=READY pgs=31 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e701820 msgr2=0x55e51e703ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e701820 0x55e51e703ce0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1d9803cfb0 msgr2=0x7f1d9803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1d9803cfb0 0x7f1d9803f470 secure :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8051580 tx=0x7f1eb806d040 comp rx=0 tx=0).stop 2024-09-19T11:13:54.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 msgr2=0x55e51e6ecf90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/1434952509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6e5bd0 0x55e51e6ecf90 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0029fd0 tx=0x7f1ec0044f70 comp rx=0 tx=0).stop 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 reap_dead start 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed04ae640 1 -- 172.21.15.102:0/1434952509 reap_dead start 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 shutdown_connections 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 >> 172.21.15.102:0/1434952509 conn(0x55e51e6e1fd0 msgr2=0x55e51e6e01e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 shutdown_connections 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/1434952509 wait complete. 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/41105757 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1da803d000 msgr2=0x7f1da803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/41105757 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1da803d000 0x7f1da803f4c0 secure :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0x55e51e6c2e10 tx=0x7f1eb8005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/41105757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6d9440 msgr2=0x55e51e6d9860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/41105757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6d9440 0x55e51e6d9860 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f1ec0053260 tx=0x7f1ec001bed0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/41105757 shutdown_connections 2024-09-19T11:13:54.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/41105757 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1da803d000 0x7f1da803f4c0 unknown :-1 s=CLOSED pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/41105757 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e6d9440 0x55e51e6d9860 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/41105757 >> 172.21.15.102:0/41105757 conn(0x55e51e6cd7f0 msgr2=0x55e51e6cdbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/41105757 shutdown_connections 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.078+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/41105757 wait complete. 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6c4c90 msgr2=0x55e51e6c7080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e51e6c4c90 0x55e51e6c7080 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e5c5ac0 msgr2=0x55e51e6c23d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e51e5c5ac0 0x55e51e6c23d0 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e6c8b90 msgr2=0x55e51e6caf80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e51e6c8b90 0x55e51e6caf80 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1db803cfb0 msgr2=0x7f1db803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f1db803cfb0 0x7f1db803f470 secure :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0x7f1eb8057000 tx=0x7f1eb8052000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 msgr2=0x55e51e5c1670 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 --2- 172.21.15.102:0/2897776487 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e51e5c1f50 0x55e51e5c1670 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x55e51e6b2330 tx=0x7f1ec0000bc0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed04ae640 1 -- 172.21.15.102:0/2897776487 reap_dead start 2024-09-19T11:13:54.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 shutdown_connections 2024-09-19T11:13:54.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 >> 172.21.15.102:0/2897776487 conn(0x55e51e5bbab0 msgr2=0x55e51e6b2890 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 shutdown_connections 2024-09-19T11:13:54.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.079+0000 7f1ed3f2c800 1 -- 172.21.15.102:0/2897776487 wait complete. 2024-09-19T11:13:54.094 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-19T11:13:54.065107Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:54.094 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:13:54.094 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:13:54.094 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:13:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:54.139 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.138+0000 7fef79c63800 1 Processor -- start 2024-09-19T11:13:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef79c63800 1 -- start start 2024-09-19T11:13:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef79c63800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x558cc0076aa0 0x558cc0078f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef79c63800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x558cc00795e0 con 0x558cc0072f30 2024-09-19T11:13:54.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef79c63800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x558cbfefd7d0 con 0x558cc0076aa0 2024-09-19T11:13:54.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef76f53640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x558cc0076aa0 0x558cc0078f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef76f53640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x558cc0076aa0 0x558cc0078f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43324/0 (socket says 172.21.15.102:43324) 2024-09-19T11:13:54.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef76f53640 1 -- 172.21.15.102:0/3825192436 learned_addr learned my addr 172.21.15.102:0/3825192436 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef76f53640 1 -- 172.21.15.102:0/3825192436 >> v1:172.21.15.37:6789/0 conn(0x558cc0072f30 legacy=0x558cc0075320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.139+0000 7fef76f53640 1 -- 172.21.15.102:0/3825192436 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc007a810 con 0x558cc0076aa0 2024-09-19T11:13:54.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.141+0000 7fef76f53640 1 --2- 172.21.15.102:0/3825192436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 0x558cc0078f60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fef6000a520 tx=0x7fef60045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cdc820b7649abf1d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.141+0000 7fef76752640 1 -- 172.21.15.102:0/3825192436 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef60055070 con 0x558cc0076aa0 2024-09-19T11:13:54.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.141+0000 7fef76752640 1 -- 172.21.15.102:0/3825192436 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef600515b0 con 0x558cc0076aa0 2024-09-19T11:13:54.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.141+0000 7fef76752640 1 -- 172.21.15.102:0/3825192436 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef600518d0 con 0x558cc0076aa0 2024-09-19T11:13:54.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.142+0000 7fef79c63800 1 -- 172.21.15.102:0/3825192436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 msgr2=0x558cc0078f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.142+0000 7fef79c63800 1 --2- 172.21.15.102:0/3825192436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 0x558cc0078f60 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x7fef6000a520 tx=0x7fef60045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.142+0000 7fef79c63800 1 -- 172.21.15.102:0/3825192436 shutdown_connections 2024-09-19T11:13:54.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.142+0000 7fef79c63800 1 --2- 172.21.15.102:0/3825192436 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 0x558cc0078f60 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.142+0000 7fef79c63800 1 -- 172.21.15.102:0/3825192436 >> 172.21.15.102:0/3825192436 conn(0x558cc006ca90 msgr2=0x558cc006eed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.142+0000 7fef79c63800 1 -- 172.21.15.102:0/3825192436 shutdown_connections 2024-09-19T11:13:54.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.142+0000 7fef79c63800 1 -- 172.21.15.102:0/3825192436 wait complete. 2024-09-19T11:13:54.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.155+0000 7fef79c63800 1 Processor -- start 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.156+0000 7fef79c63800 1 -- start start 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.156+0000 7fef79c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0072f30 0x558cc0162310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.156+0000 7fef79c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558cbff0add0 con 0x558cc0072f30 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.156+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0072f30 0x558cc0162310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.156+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0072f30 0x558cc0162310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43336/0 (socket says 172.21.15.102:43336) 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.156+0000 7fef77754640 1 -- 172.21.15.102:0/84530826 learned_addr learned my addr 172.21.15.102:0/84530826 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.156+0000 7fef77754640 1 -- 172.21.15.102:0/84530826 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc0162900 con 0x558cc0072f30 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.156+0000 7fef77754640 1 --2- 172.21.15.102:0/84530826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0072f30 0x558cc0162310 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fef68001680 tx=0x7fef68001b40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f8f0cba7add5a80d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fee6560a640 1 -- 172.21.15.102:0/84530826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef68016070 con 0x558cc0072f30 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fee6560a640 1 -- 172.21.15.102:0/84530826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6800f640 con 0x558cc0072f30 2024-09-19T11:13:54.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fee6560a640 1 -- 172.21.15.102:0/84530826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef6800f960 con 0x558cc0072f30 2024-09-19T11:13:54.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fef79c63800 1 -- 172.21.15.102:0/84530826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0072f30 msgr2=0x558cc0162310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fef79c63800 1 --2- 172.21.15.102:0/84530826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0072f30 0x558cc0162310 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7fef68001680 tx=0x7fef68001b40 comp rx=0 tx=0).stop 2024-09-19T11:13:54.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fef79c63800 1 -- 172.21.15.102:0/84530826 shutdown_connections 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fef79c63800 1 --2- 172.21.15.102:0/84530826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0072f30 0x558cc0162310 unknown :-1 s=CLOSED pgs=313 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fef79c63800 1 -- 172.21.15.102:0/84530826 >> 172.21.15.102:0/84530826 conn(0x558cc006ca90 msgr2=0x558cc015dc90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fef79c63800 1 -- 172.21.15.102:0/84530826 shutdown_connections 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.157+0000 7fef79c63800 1 -- 172.21.15.102:0/84530826 wait complete. 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef79c63800 1 Processor -- start 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef79c63800 1 -- start start 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef79c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 0x558cc016a050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef79c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558cc0079ab0 con 0x558cc0076aa0 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 0x558cc016a050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 0x558cc016a050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43340/0 (socket says 172.21.15.102:43340) 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef77754640 1 -- 172.21.15.102:0/679713783 learned_addr learned my addr 172.21.15.102:0/679713783 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef77754640 1 -- 172.21.15.102:0/679713783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc016a5b0 con 0x558cc0076aa0 2024-09-19T11:13:54.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.158+0000 7fef77754640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 0x558cc016a050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef68000f80 tx=0x7fef68001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.159+0000 7fee63e07640 1 -- 172.21.15.102:0/679713783 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef68020070 con 0x558cc0076aa0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.159+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc016a840 con 0x558cc0076aa0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.159+0000 7fee63e07640 1 -- 172.21.15.102:0/679713783 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef68011770 con 0x558cc0076aa0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.159+0000 7fee63e07640 1 -- 172.21.15.102:0/679713783 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef6802a060 con 0x558cc0076aa0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.159+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc016b240 con 0x558cc0076aa0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.160+0000 7fee63e07640 1 -- 172.21.15.102:0/679713783 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fef68023070 con 0x558cc0076aa0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.160+0000 7fee63e07640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5c03cfb0 0x7fee5c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.160+0000 7fee63e07640 1 -- 172.21.15.102:0/679713783 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fef68053e60 con 0x558cc0076aa0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.160+0000 7fef76f53640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5c03cfb0 0x7fee5c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.160+0000 7fef79c63800 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc016bd40 0x558cc01716a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.160+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc0171c20 con 0x558cc016bd40 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.160+0000 7fef77f55640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc016bd40 0x558cc01716a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.160+0000 7fef76f53640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5c03cfb0 0x7fee5c03f470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef60057000 tx=0x7fef60052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.161+0000 7fef77f55640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc016bd40 0x558cc01716a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.161+0000 7fef77f55640 1 -- 172.21.15.102:0/679713783 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef700083e0 con 0x558cc016bd40 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.161+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc016b6f0 con 0x558cc016bd40 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.161+0000 7fef77f55640 1 -- 172.21.15.102:0/679713783 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef700083e0 con 0x558cc016bd40 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.161+0000 7fef79c63800 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc0173f30 0x558cc0176320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.161+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01769f0 con 0x558cc0173f30 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.161+0000 7fef77754640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc0173f30 0x558cc0176320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.162+0000 7fef77754640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc0173f30 0x558cc0176320 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.162+0000 7fef77754640 1 -- 172.21.15.102:0/679713783 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fef68022030 con 0x558cc0173f30 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.162+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc0172da0 con 0x558cc016bd40 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.162+0000 7fef77f55640 1 -- 172.21.15.102:0/679713783 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef700083e0 con 0x558cc016bd40 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.162+0000 7fef79c63800 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc0177e30 0x558cc017a220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.162+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc017a990 con 0x558cc0177e30 2024-09-19T11:13:54.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.163+0000 7fef76f53640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc0177e30 0x558cc017a220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.163+0000 7fef76f53640 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc0177e30 0x558cc017a220 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.163+0000 7fef76f53640 1 -- 172.21.15.102:0/679713783 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fef60057030 con 0x558cc0177e30 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef79c63800 1 Processor -- start 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef79c63800 1 -- start start 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef79c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0188690 0x558cc0188ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef79c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558cbff694a0 con 0x558cc0188690 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0188690 0x558cc0188ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0188690 0x558cc0188ab0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43346/0 (socket says 172.21.15.102:43346) 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef77754640 1 -- 172.21.15.102:0/436543167 learned_addr learned my addr 172.21.15.102:0/436543167 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef77754640 1 -- 172.21.15.102:0/436543167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc01890f0 con 0x558cc0188690 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fef77754640 1 --2- 172.21.15.102:0/436543167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0188690 0x558cc0188ab0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fef6800f610 tx=0x7fef680254c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fee61602640 1 -- 172.21.15.102:0/436543167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef68046230 con 0x558cc0188690 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.164+0000 7fee61602640 1 -- 172.21.15.102:0/436543167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6804b0b0 con 0x558cc0188690 2024-09-19T11:13:54.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.165+0000 7fef79c63800 1 -- 172.21.15.102:0/436543167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc0189920 con 0x558cc0188690 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.165+0000 7fee61602640 1 -- 172.21.15.102:0/436543167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef6804b390 con 0x558cc0188690 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.165+0000 7fef79c63800 1 -- 172.21.15.102:0/436543167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc0189ec0 con 0x558cc0188690 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.165+0000 7fee61602640 1 -- 172.21.15.102:0/436543167 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fef6804b530 con 0x558cc0188690 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.165+0000 7fee61602640 1 --2- 172.21.15.102:0/436543167 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5003d000 0x7fee5003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.165+0000 7fee61602640 1 -- 172.21.15.102:0/436543167 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fef68039c90 con 0x558cc0188690 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.165+0000 7fef76f53640 1 --2- 172.21.15.102:0/436543167 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5003d000 0x7fee5003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef79c63800 1 Processor -- start 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef79c63800 1 -- start start 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef76f53640 1 --2- 172.21.15.102:0/436543167 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5003d000 0x7fee5003f4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef60005570 tx=0x7fef60005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef79c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0195320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef79c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558cc0162d30 con 0x558cc0194f20 2024-09-19T11:13:54.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0195320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0195320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43350/0 (socket says 172.21.15.102:43350) 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef77754640 1 -- 172.21.15.102:0/3511152761 learned_addr learned my addr 172.21.15.102:0/3511152761 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.166+0000 7fef77754640 1 -- 172.21.15.102:0/3511152761 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc0195910 con 0x558cc0194f20 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef77754640 1 --2- 172.21.15.102:0/3511152761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0195320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef6801b660 tx=0x7fef6802fa30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bc081237fbaaba40 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fee5affd640 1 -- 172.21.15.102:0/3511152761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef6803d040 con 0x558cc0194f20 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fee5affd640 1 -- 172.21.15.102:0/3511152761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef6805f070 con 0x558cc0194f20 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fee5affd640 1 -- 172.21.15.102:0/3511152761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef680237c0 con 0x558cc0194f20 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef79c63800 1 -- 172.21.15.102:0/3511152761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 msgr2=0x558cc0195320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef79c63800 1 --2- 172.21.15.102:0/3511152761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0195320 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7fef6801b660 tx=0x7fef6802fa30 comp rx=0 tx=0).stop 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef79c63800 1 -- 172.21.15.102:0/3511152761 shutdown_connections 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef79c63800 1 --2- 172.21.15.102:0/3511152761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0195320 unknown :-1 s=CLOSED pgs=316 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef79c63800 1 -- 172.21.15.102:0/3511152761 >> 172.21.15.102:0/3511152761 conn(0x558cc0191320 msgr2=0x558cc018f560 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef79c63800 1 -- 172.21.15.102:0/3511152761 shutdown_connections 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef79c63800 1 -- 172.21.15.102:0/3511152761 wait complete. 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.167+0000 7fef79c63800 1 Processor -- start 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fef79c63800 1 -- start start 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fef79c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0072650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fef79c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558cc0195d80 con 0x558cc0194f20 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0072650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fef77754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0072650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43364/0 (socket says 172.21.15.102:43364) 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 learned_addr learned my addr 172.21.15.102:0/4213681263 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558cc0072bb0 con 0x558cc0194f20 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fef77754640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0072650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fef680463d0 tx=0x7fef6801df90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fee597fa640 1 -- 172.21.15.102:0/4213681263 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef6803d070 con 0x558cc0194f20 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.168+0000 7fee597fa640 1 -- 172.21.15.102:0/4213681263 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fef680237c0 con 0x558cc0194f20 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.169+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558cc0072bb0 con 0x558cc0194f20 2024-09-19T11:13:54.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.169+0000 7fee597fa640 1 -- 172.21.15.102:0/4213681263 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fef68051290 con 0x558cc0194f20 2024-09-19T11:13:54.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.169+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x558cc0072bb0 con 0x558cc0194f20 2024-09-19T11:13:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.169+0000 7fee597fa640 1 -- 172.21.15.102:0/4213681263 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fef68057070 con 0x558cc0194f20 2024-09-19T11:13:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fee597fa640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee4003d000 0x7fee4003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fee597fa640 1 -- 172.21.15.102:0/4213681263 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fef68070ca0 con 0x558cc0194f20 2024-09-19T11:13:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fef76f53640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee4003d000 0x7fee4003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc01a9900 0x558cc01abd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ac4e0 con 0x558cc01a9900 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fef77f55640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc01a9900 0x558cc01abd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fef76f53640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee4003d000 0x7fee4003f4c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fef60045be0 tx=0x7fef6006d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.170+0000 7fef77f55640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc01a9900 0x558cc01abd90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef700083e0 con 0x558cc01a9900 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 realm 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ac8f0 con 0x558cc01a9900 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef700083e0 con 0x558cc01a9900 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:54.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef700083e0 con 0x558cc01a9900 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad560 con 0x558cc01a9900 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fef700083e0 con 0x558cc01a9900 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc01adcb0 0x558cc01b00a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.171+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b0810 con 0x558cc01adcb0 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.172+0000 7fef77754640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc01adcb0 0x558cc01b00a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.172+0000 7fef77754640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc01adcb0 0x558cc01b00a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.172+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.172+0000 7fef79c63800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.172+0000 7fef79c63800 20 searching for the correct realm 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.172+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc01b28f0 0x558cc01b4db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.172+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b5480 con 0x558cc01b28f0 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.172+0000 7fef76f53640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc01b28f0 0x558cc01b4db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.173+0000 7fef76f53640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc01b28f0 0x558cc01b4db0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.173+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.173+0000 7fef76f53640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fef60069040 0x7fef6006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.173+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b5480 con 0x7fef60069040 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.173+0000 7fef77f55640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fef60069040 0x7fef6006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.173+0000 7fef77f55640 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fef60069040 0x7fef6006a940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.174+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef700083e0 con 0x7fef60069040 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.174+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.174+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.174+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.174+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef700083e0 con 0x558cc01a9900 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.174+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.174+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.174+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.175+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.175+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.175+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.175+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x7fef60069040 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.175+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x7fef60069040 2024-09-19T11:13:54.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.175+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01b28f0 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.175+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.175+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x7fef60069040 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fef70026040 con 0x7fef60069040 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01b28f0 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.176+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01b28f0 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01b28f0 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01b28f0 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.177+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.178+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.178+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.178+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.178+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.178+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.178+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01b28f0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.178+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.178+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x7fef60069040 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.179+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x7fef60069040 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.179+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.179+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.179+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.179+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.179+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01b28f0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.180+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.180+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.180+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.180+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x7fef60069040 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.180+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x7fef60069040 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.180+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01b28f0 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.180+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.180+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x558cc01a9900 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ad1c0 con 0x7fef60069040 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fef70026040 con 0x7fef60069040 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:54.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b11b0 con 0x558cc01a9900 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.181+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b11b0 con 0x558cc01a9900 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fef70026040 con 0x558cc01a9900 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b11b0 con 0x558cc01b28f0 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 zone default found 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 4 Realm: () 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 zonegroup default 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b1a50 con 0x558cc01adcb0 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b72f0 con 0x558cc01b28f0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.182+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b7690 con 0x558cc01b28f0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.183+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.183+0000 7fef79c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.183+0000 7fef79c63800 20 started sync module instance, tier type = 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.183+0000 7fef79c63800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.183+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b6790 con 0x7fef60069040 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.184+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70026040 con 0x7fef60069040 2024-09-19T11:13:54.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.184+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94063006805216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b6790 con 0x7fef60069040 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.184+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b80e0 con 0x558cc01a9900 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.185+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94063006805216] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x7fef60069040 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.185+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.185+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94063006809040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b6790 con 0x558cc01a9900 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.185+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b8b60 con 0x558cc01b28f0 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.186+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94063006809040] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.186+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.186+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94063006802656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b6700 con 0x558cc01b28f0 2024-09-19T11:13:54.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.186+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b9a20 con 0x7fef60069040 2024-09-19T11:13:54.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.187+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94063006802656] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.187+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x7fef60069040 2024-09-19T11:13:54.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.187+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94063006815600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b9e40 con 0x7fef60069040 2024-09-19T11:13:54.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.187+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ba800 con 0x558cc01a9900 2024-09-19T11:13:54.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.188+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94063006815600] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x7fef60069040 2024-09-19T11:13:54.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.188+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.188+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94063006817136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ba800 con 0x558cc01a9900 2024-09-19T11:13:54.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.188+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01bb1c0 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.189+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.189+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94063006821648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01bba10 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.189+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01bc450 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.189+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94063006817136] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.190+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.190+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94063006819152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01bcca0 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.190+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01bd660 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.190+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94063006821648] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'69 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94063006831024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01bda80 con 0x558cc01adcb0 2024-09-19T11:13:54.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef79c63800 20 add_watcher() i=0 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef79c63800 20 add_watcher() i=1 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef79c63800 20 add_watcher() i=2 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef79c63800 20 add_watcher() i=3 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef79c63800 20 add_watcher() i=4 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef79c63800 20 add_watcher() i=5 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94063006819152] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.191+0000 7fef79c63800 20 add_watcher() i=6 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.192+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94063006831024] v35'70 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.192+0000 7fef79c63800 20 add_watcher() i=7 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.192+0000 7fef79c63800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.192+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01c0ab0 con 0x558cc01a9900 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.193+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.193+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94063006832080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01bdea0 con 0x558cc01a9900 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94063006832080] v35'80 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fee2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fef79c63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fef79c63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fef79c63800 5 note: GC not initialized 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fee2cfe1640 20 reqs_thread_entry: start 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fef79c63800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fef79c63800 20 Filter name: none 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7feda67fc640 20 reqs_thread_entry: start 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fef79c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.194+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558cc01f3340 con 0x558cc01a9900 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.195+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.195+0000 7fef79c63800 20 rados_obj.operate() r=0 bl.length=673 2024-09-19T11:13:54.207 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[{"user":"foo:foo1","secret_key":"gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL","active":true,"create_date":"0.000000"},{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-19T11:13:54.065107Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.196+0000 7fee2dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.196+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94063006832080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01f3750 con 0x558cc01a9900 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.197+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94063006832080] v35'81 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.197+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94063006805216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01f3750 con 0x7fef60069040 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.198+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94063006805216] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x7fef60069040 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.198+0000 7fef79c63800 20 remove_watcher() i=0 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.198+0000 7fef79c63800 2 removed watcher, disabling cache 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.198+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94063006809040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b6cc0 con 0x558cc01a9900 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.199+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94063006809040] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.199+0000 7fef79c63800 20 remove_watcher() i=1 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.199+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94063006802656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b7bd0 con 0x558cc01b28f0 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.200+0000 7fef76f53640 1 -- 172.21.15.102:0/4213681263 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94063006802656] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef60057030 con 0x558cc01b28f0 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.200+0000 7fef79c63800 20 remove_watcher() i=2 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.200+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94063006815600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b62e0 con 0x7fef60069040 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.201+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94063006815600] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x7fef60069040 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.201+0000 7fef79c63800 20 remove_watcher() i=3 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.201+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94063006817136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b62e0 con 0x558cc01a9900 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.202+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94063006817136] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef70036040 con 0x558cc01a9900 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.202+0000 7fef79c63800 20 remove_watcher() i=4 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.202+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94063006821648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b62e0 con 0x558cc01adcb0 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.203+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94063006821648] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.203+0000 7fef79c63800 20 remove_watcher() i=5 2024-09-19T11:13:54.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.203+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94063006819152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01b62e0 con 0x558cc01adcb0 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.204+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94063006819152] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.204+0000 7fef79c63800 20 remove_watcher() i=6 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.204+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94063006831024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558cc01ba350 con 0x558cc01adcb0 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef77754640 1 -- 172.21.15.102:0/4213681263 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94063006831024] v35'71 uv69 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fef68022030 con 0x558cc01adcb0 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 20 remove_watcher() i=7 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc01adcb0 msgr2=0x558cc01b00a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc01adcb0 0x558cc01b00a0 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc01a9900 msgr2=0x558cc01abd90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc01a9900 0x558cc01abd90 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fef60069040 msgr2=0x7fef6006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fef60069040 0x7fef6006a940 crc :-1 s=READY pgs=32 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc01b28f0 msgr2=0x558cc01b4db0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc01b28f0 0x558cc01b4db0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee4003d000 msgr2=0x7fee4003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee4003d000 0x7fee4003f4c0 secure :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0x7fef60045be0 tx=0x7fef6006d040 comp rx=0 tx=0).stop 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 msgr2=0x558cc0072650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef77f55640 1 -- 172.21.15.102:0/4213681263 reap_dead start 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0072650 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x7fef680463d0 tx=0x7fef6801df90 comp rx=0 tx=0).stop 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 shutdown_connections 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 --2- 172.21.15.102:0/4213681263 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0194f20 0x558cc0072650 unknown :-1 s=CLOSED pgs=317 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.205+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 >> 172.21.15.102:0/4213681263 conn(0x558cc0191320 msgr2=0x558cc018f530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 shutdown_connections 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/4213681263 wait complete. 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/436543167 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5003d000 msgr2=0x7fee5003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/436543167 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5003d000 0x7fee5003f4c0 secure :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0x7fef60005570 tx=0x7fef60005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/436543167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0188690 msgr2=0x558cc0188ab0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/436543167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0188690 0x558cc0188ab0 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x7fef6800f610 tx=0x7fef680254c0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/436543167 shutdown_connections 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/436543167 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5003d000 0x7fee5003f4c0 unknown :-1 s=CLOSED pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/436543167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0188690 0x558cc0188ab0 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/436543167 >> 172.21.15.102:0/436543167 conn(0x558cc017ca40 msgr2=0x558cc017ce20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/436543167 shutdown_connections 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/436543167 wait complete. 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc0173f30 msgr2=0x558cc0176320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558cc0173f30 0x558cc0176320 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc016bd40 msgr2=0x558cc01716a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558cc016bd40 0x558cc01716a0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc0177e30 msgr2=0x558cc017a220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558cc0177e30 0x558cc017a220 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5c03cfb0 msgr2=0x7fee5c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fee5c03cfb0 0x7fee5c03f470 secure :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0x7fef60057000 tx=0x7fef60052000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 msgr2=0x558cc016a050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 --2- 172.21.15.102:0/679713783 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558cc0076aa0 0x558cc016a050 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7fef68000f80 tx=0x7fef68001250 comp rx=0 tx=0).stop 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef77f55640 1 -- 172.21.15.102:0/679713783 reap_dead start 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 shutdown_connections 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.206+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 >> 172.21.15.102:0/679713783 conn(0x558cc006ca90 msgr2=0x558cc0163880 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.207+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 shutdown_connections 2024-09-19T11:13:54.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.207+0000 7fef79c63800 1 -- 172.21.15.102:0/679713783 wait complete. 2024-09-19T11:13:54.218 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True, 'create_date': '0.000000'}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-19T11:13:54.065107Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:54.218 INFO:tasks.util.rgw:rgwadmin: client.0 : ['key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-19T11:13:54.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'key', 'rm', '--subuser', 'foo:foo1', '--key-type', 'swift'] 2024-09-19T11:13:54.219 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph key rm --subuser foo:foo1 --key-type swift 2024-09-19T11:13:54.265 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:54.265 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:54.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.264+0000 7eff77946800 1 Processor -- start 2024-09-19T11:13:54.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff77946800 1 -- start start 2024-09-19T11:13:54.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff77946800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x560392039d40 0x56039203a140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff77946800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56039203b240 con 0x56039203a680 2024-09-19T11:13:54.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff77946800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x560391ec67d0 con 0x560392039d40 2024-09-19T11:13:54.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff75437640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x560392039d40 0x56039203a140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff74c36640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x56039203a680 0x56039203ab30 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52370/0 (socket says 172.21.15.102:52370) 2024-09-19T11:13:54.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff74c36640 1 -- 172.21.15.102:0/274050460 learned_addr learned my addr 172.21.15.102:0/274050460 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:54.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff75437640 1 -- 172.21.15.102:0/274050460 >> v1:172.21.15.37:6789/0 conn(0x56039203a680 legacy=0x56039203ab30 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.265+0000 7eff75437640 1 -- 172.21.15.102:0/274050460 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56039203b410 con 0x560392039d40 2024-09-19T11:13:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.267+0000 7eff75437640 1 --2- 172.21.15.102:0/274050460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039203a140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7eff68005fd0 tx=0x7eff68045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ffd6bb4cd6019f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.267+0000 7eff6ffff640 1 -- 172.21.15.102:0/274050460 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68058530 con 0x560392039d40 2024-09-19T11:13:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.267+0000 7eff6ffff640 1 -- 172.21.15.102:0/274050460 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff680586d0 con 0x560392039d40 2024-09-19T11:13:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.267+0000 7eff6ffff640 1 -- 172.21.15.102:0/274050460 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff680589d0 con 0x560392039d40 2024-09-19T11:13:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.268+0000 7eff77946800 1 -- 172.21.15.102:0/274050460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 msgr2=0x56039203a140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.268+0000 7eff77946800 1 --2- 172.21.15.102:0/274050460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039203a140 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x7eff68005fd0 tx=0x7eff68045c30 comp rx=0 tx=0).stop 2024-09-19T11:13:54.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.268+0000 7eff77946800 1 -- 172.21.15.102:0/274050460 shutdown_connections 2024-09-19T11:13:54.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.268+0000 7eff77946800 1 --2- 172.21.15.102:0/274050460 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039203a140 unknown :-1 s=CLOSED pgs=319 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.268+0000 7eff77946800 1 -- 172.21.15.102:0/274050460 >> 172.21.15.102:0/274050460 conn(0x560392035a70 msgr2=0x560392037ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.268+0000 7eff77946800 1 -- 172.21.15.102:0/274050460 shutdown_connections 2024-09-19T11:13:54.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.268+0000 7eff77946800 1 -- 172.21.15.102:0/274050460 wait complete. 2024-09-19T11:13:54.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.281+0000 7eff77946800 1 Processor -- start 2024-09-19T11:13:54.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.281+0000 7eff77946800 1 -- start start 2024-09-19T11:13:54.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7eff77946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039212d580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7eff77946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560391ed3dd0 con 0x560392039d40 2024-09-19T11:13:54.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039212d580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039212d580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43384/0 (socket says 172.21.15.102:43384) 2024-09-19T11:13:54.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7eff75437640 1 -- 172.21.15.102:0/1272094440 learned_addr learned my addr 172.21.15.102:0/1272094440 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7eff75437640 1 -- 172.21.15.102:0/1272094440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56039212db70 con 0x560392039d40 2024-09-19T11:13:54.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7eff75437640 1 --2- 172.21.15.102:0/1272094440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039212d580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7eff6800a3f0 tx=0x7eff68051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a1e85b8cb4060f61 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7efe63606640 1 -- 172.21.15.102:0/1272094440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff680589b0 con 0x560392039d40 2024-09-19T11:13:54.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7efe63606640 1 -- 172.21.15.102:0/1272094440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff68068070 con 0x560392039d40 2024-09-19T11:13:54.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.282+0000 7efe63606640 1 -- 172.21.15.102:0/1272094440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68058c80 con 0x560392039d40 2024-09-19T11:13:54.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.283+0000 7eff77946800 1 -- 172.21.15.102:0/1272094440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 msgr2=0x56039212d580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.283+0000 7eff77946800 1 --2- 172.21.15.102:0/1272094440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039212d580 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x7eff6800a3f0 tx=0x7eff68051000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.283+0000 7eff77946800 1 -- 172.21.15.102:0/1272094440 shutdown_connections 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.283+0000 7eff77946800 1 --2- 172.21.15.102:0/1272094440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392039d40 0x56039212d580 unknown :-1 s=CLOSED pgs=320 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.283+0000 7eff77946800 1 -- 172.21.15.102:0/1272094440 >> 172.21.15.102:0/1272094440 conn(0x560392035a70 msgr2=0x560392128f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.283+0000 7eff77946800 1 -- 172.21.15.102:0/1272094440 shutdown_connections 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.283+0000 7eff77946800 1 -- 172.21.15.102:0/1272094440 wait complete. 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.283+0000 7eff77946800 1 Processor -- start 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff77946800 1 -- start start 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff77946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039203a680 0x560392135260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff77946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56039203b9a0 con 0x56039203a680 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039203a680 0x560392135260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039203a680 0x560392135260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43392/0 (socket says 172.21.15.102:43392) 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff75437640 1 -- 172.21.15.102:0/903411490 learned_addr learned my addr 172.21.15.102:0/903411490 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff75437640 1 -- 172.21.15.102:0/903411490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603921357c0 con 0x56039203a680 2024-09-19T11:13:54.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff75437640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039203a680 0x560392135260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7eff68065040 tx=0x7eff68003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7efe61e03640 1 -- 172.21.15.102:0/903411490 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68063520 con 0x56039203a680 2024-09-19T11:13:54.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7efe61e03640 1 -- 172.21.15.102:0/903411490 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff680636c0 con 0x56039203a680 2024-09-19T11:13:54.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7efe61e03640 1 -- 172.21.15.102:0/903411490 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff680639a0 con 0x56039203a680 2024-09-19T11:13:54.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.284+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560392135a50 con 0x56039203a680 2024-09-19T11:13:54.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.285+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560392136450 con 0x56039203a680 2024-09-19T11:13:54.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.285+0000 7efe61e03640 1 -- 172.21.15.102:0/903411490 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7eff68074020 con 0x56039203a680 2024-09-19T11:13:54.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.285+0000 7efe61e03640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5c03d000 0x7efe5c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7efe61e03640 1 -- 172.21.15.102:0/903411490 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7eff680982e0 con 0x56039203a680 2024-09-19T11:13:54.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7eff74c36640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5c03d000 0x7efe5c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7eff77946800 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392136f30 0x56039213c8b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56039213cdf0 con 0x560392136f30 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7eff75c38640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392136f30 0x56039213c8b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7eff74c36640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5c03d000 0x7efe5c03f4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff60001d70 tx=0x7eff600012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7eff75c38640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392136f30 0x56039213c8b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7eff75c38640 1 -- 172.21.15.102:0/903411490 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff700083e0 con 0x560392136f30 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.286+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56039213d6b0 con 0x560392136f30 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.287+0000 7eff75c38640 1 -- 172.21.15.102:0/903411490 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff700083e0 con 0x560392136f30 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.287+0000 7eff77946800 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56039213efc0 0x560392141460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.287+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560392141bf0 con 0x56039213efc0 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.287+0000 7eff75437640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56039213efc0 0x560392141460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.287+0000 7eff75437640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56039213efc0 0x560392141460 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.288+0000 7eff75437640 1 -- 172.21.15.102:0/903411490 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7eff6806c910 con 0x56039213efc0 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.288+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56039213df00 con 0x560392136f30 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.288+0000 7eff75c38640 1 -- 172.21.15.102:0/903411490 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff700083e0 con 0x560392136f30 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.288+0000 7eff77946800 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560392143050 0x560392145440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.288+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560392145bb0 con 0x560392143050 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.288+0000 7eff74c36640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560392143050 0x560392145440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.288+0000 7eff74c36640 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560392143050 0x560392145440 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.289+0000 7eff74c36640 1 -- 172.21.15.102:0/903411490 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7eff60009050 con 0x560392143050 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.289+0000 7eff77946800 1 Processor -- start 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.289+0000 7eff77946800 1 -- start start 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.289+0000 7eff77946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392153890 0x560392153cb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.289+0000 7eff77946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560391f324a0 con 0x560392153890 2024-09-19T11:13:54.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.289+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392153890 0x560392153cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.289+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392153890 0x560392153cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43404/0 (socket says 172.21.15.102:43404) 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.289+0000 7eff75437640 1 -- 172.21.15.102:0/3105345472 learned_addr learned my addr 172.21.15.102:0/3105345472 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.290+0000 7eff75437640 1 -- 172.21.15.102:0/3105345472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5603921542f0 con 0x560392153890 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.290+0000 7eff75437640 1 --2- 172.21.15.102:0/3105345472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392153890 0x560392153cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7eff6804e4f0 tx=0x7eff6806c6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.290+0000 7efe5affd640 1 -- 172.21.15.102:0/3105345472 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6806d070 con 0x560392153890 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.290+0000 7efe5affd640 1 -- 172.21.15.102:0/3105345472 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6806d210 con 0x560392153890 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.290+0000 7eff77946800 1 -- 172.21.15.102:0/3105345472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560392154b20 con 0x560392153890 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.290+0000 7efe5affd640 1 -- 172.21.15.102:0/3105345472 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68096a20 con 0x560392153890 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.290+0000 7eff77946800 1 -- 172.21.15.102:0/3105345472 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5603921550c0 con 0x560392153890 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7efe5affd640 1 -- 172.21.15.102:0/3105345472 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7eff68089070 con 0x560392153890 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7efe5affd640 1 --2- 172.21.15.102:0/3105345472 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5003d000 0x7efe5003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7efe5affd640 1 -- 172.21.15.102:0/3105345472 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7eff68086050 con 0x560392153890 2024-09-19T11:13:54.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7eff74c36640 1 --2- 172.21.15.102:0/3105345472 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5003d000 0x7efe5003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7eff77946800 1 Processor -- start 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7eff77946800 1 -- start start 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7eff74c36640 1 --2- 172.21.15.102:0/3105345472 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5003d000 0x7efe5003f4c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff6000bf40 tx=0x7eff6000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7eff77946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392160550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7eff77946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56039212dee0 con 0x560392160170 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.291+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392160550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.292+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392160550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43420/0 (socket says 172.21.15.102:43420) 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.292+0000 7eff75437640 1 -- 172.21.15.102:0/3405455932 learned_addr learned my addr 172.21.15.102:0/3405455932 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.292+0000 7eff75437640 1 -- 172.21.15.102:0/3405455932 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560392160b40 con 0x560392160170 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.292+0000 7eff75437640 1 --2- 172.21.15.102:0/3405455932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392160550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7eff680986f0 tx=0x7eff68076700 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e32ad8d3175a6125 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.292+0000 7efe58ff9640 1 -- 172.21.15.102:0/3405455932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68002280 con 0x560392160170 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.292+0000 7efe58ff9640 1 -- 172.21.15.102:0/3405455932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff680ac070 con 0x560392160170 2024-09-19T11:13:54.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.292+0000 7efe58ff9640 1 -- 172.21.15.102:0/3405455932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff6806dc70 con 0x560392160170 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.292+0000 7eff77946800 1 -- 172.21.15.102:0/3405455932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 msgr2=0x560392160550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 --2- 172.21.15.102:0/3405455932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392160550 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7eff680986f0 tx=0x7eff68076700 comp rx=0 tx=0).stop 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 -- 172.21.15.102:0/3405455932 shutdown_connections 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 --2- 172.21.15.102:0/3405455932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392160550 unknown :-1 s=CLOSED pgs=323 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 -- 172.21.15.102:0/3405455932 >> 172.21.15.102:0/3405455932 conn(0x56039215c570 msgr2=0x56039215a7b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 -- 172.21.15.102:0/3405455932 shutdown_connections 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 -- 172.21.15.102:0/3405455932 wait complete. 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 Processor -- start 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 -- start start 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392167560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff77946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x560392160fd0 con 0x560392160170 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392167560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff75437640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392167560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43428/0 (socket says 172.21.15.102:43428) 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.293+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 learned_addr learned my addr 172.21.15.102:0/876578392 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.294+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x560392167ac0 con 0x560392160170 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.294+0000 7eff75437640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392167560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7eff6800a3f0 tx=0x7eff6809af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.294+0000 7efe46ffd640 1 -- 172.21.15.102:0/876578392 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff680bf070 con 0x560392160170 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.294+0000 7efe46ffd640 1 -- 172.21.15.102:0/876578392 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7eff6804f3f0 con 0x560392160170 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.294+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x560392167ac0 con 0x560392160170 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.294+0000 7efe46ffd640 1 -- 172.21.15.102:0/876578392 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7eff68067d40 con 0x560392160170 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.294+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x560392167ac0 con 0x560392160170 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.295+0000 7efe46ffd640 1 -- 172.21.15.102:0/876578392 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7eff680c2070 con 0x560392160170 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.295+0000 7efe46ffd640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe4003d000 0x7efe4003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.295+0000 7efe46ffd640 1 -- 172.21.15.102:0/876578392 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7eff680c5ca0 con 0x560392160170 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.295+0000 7eff74c36640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe4003d000 0x7efe4003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.295+0000 7eff74c36640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe4003d000 0x7efe4003f4c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff6000c010 tx=0x7eff60010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392172850 0x560392174d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560392175460 con 0x560392172850 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff75c38640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392172850 0x560392174d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff75c38640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392172850 0x560392174d10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff700083e0 con 0x560392172850 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff77946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff77946800 20 realm 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560392175870 con 0x560392172850 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.296+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff700083e0 con 0x560392172850 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:54.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff700083e0 con 0x560392172850 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603921764e0 con 0x560392172850 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7eff700083e0 con 0x560392172850 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560392176ea0 0x560392179290 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603921798a0 con 0x560392176ea0 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.297+0000 7eff75437640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560392176ea0 0x560392179290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.298+0000 7eff75437640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560392176ea0 0x560392179290 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.298+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.298+0000 7eff77946800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.298+0000 7eff77946800 20 searching for the correct realm 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.298+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56039217b850 0x56039217dd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.298+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56039217e390 con 0x56039217b850 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.298+0000 7eff74c36640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56039217b850 0x56039217dd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.298+0000 7eff74c36640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56039217b850 0x56039217dd10 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.299+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.299+0000 7eff74c36640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7eff60037040 0x7eff60036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.299+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56039217e390 con 0x7eff60037040 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.299+0000 7eff75c38640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7eff60037040 0x7eff60036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.299+0000 7eff75c38640 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7eff60037040 0x7eff60036410 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.299+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff700083e0 con 0x7eff60037040 2024-09-19T11:13:54.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.299+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.300+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.300+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.300+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff700083e0 con 0x560392172850 2024-09-19T11:13:54.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.300+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.300+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.300+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.301+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.301+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.301+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.301+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x7eff60037040 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.301+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x7eff60037040 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.301+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x56039217b850 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.301+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.301+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.302+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.302+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.302+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.302+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.302+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.302+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x7eff60037040 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.302+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7eff70026040 con 0x7eff60037040 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.302+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x56039217b850 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x56039217b850 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x56039217b850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x56039217b850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.303+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.304+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.304+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.304+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.304+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.304+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.304+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x56039217b850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.305+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.305+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x7eff60037040 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.305+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x7eff60037040 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.305+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.305+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.305+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.305+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.305+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x56039217b850 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.306+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.306+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.306+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.306+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x7eff60037040 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.306+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x7eff60037040 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.306+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x56039217b850 2024-09-19T11:13:54.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.306+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.306+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392176ea0 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x560392172850 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x560392176140 con 0x7eff60037040 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7eff70026040 con 0x7eff60037040 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:54.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56039217a160 con 0x560392172850 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56039217a160 con 0x560392172850 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7eff70026040 con 0x560392172850 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.307+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56039217a160 con 0x56039217b850 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 20 zone default found 2024-09-19T11:13:54.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 4 Realm: () 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 20 zonegroup default 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56039217aa90 con 0x560392176ea0 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x560392180330 con 0x56039217b850 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.308+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603921807c0 con 0x56039217b850 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.309+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.309+0000 7eff77946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.309+0000 7eff77946800 20 started sync module instance, tier type = 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.309+0000 7eff77946800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.309+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56039217f6a0 con 0x7eff60037040 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.310+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70026040 con 0x7eff60037040 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.310+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94573335935936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56039217f6a0 con 0x7eff60037040 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.310+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921812f0 con 0x560392172850 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.311+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94573335935936] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x7eff60037040 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.311+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.311+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94573335940576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56039217f6a0 con 0x560392172850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.311+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392181db0 con 0x56039217b850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.312+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94573335940576] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.312+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.312+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94573335933424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56039217f610 con 0x56039217b850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.312+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392182c70 con 0x7eff60037040 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.313+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x7eff60037040 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.313+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94573335947680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392183510 con 0x7eff60037040 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.313+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392183f80 con 0x560392172850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.313+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94573335933424] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.314+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.314+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94573335951952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392183f40 con 0x560392172850 2024-09-19T11:13:54.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.314+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392184990 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.314+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94573335947680] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x7eff60037040 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.315+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.315+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94573335954656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392184d30 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.315+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921856f0 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.315+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94573335951952] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.316+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94573335954656] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.316+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.316+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94573335958080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392185a90 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.316+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921862e0 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'72 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94573335960720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392186720 con 0x560392176ea0 2024-09-19T11:13:54.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff77946800 20 add_watcher() i=0 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff77946800 20 add_watcher() i=1 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff77946800 20 add_watcher() i=2 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff77946800 20 add_watcher() i=3 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff77946800 20 add_watcher() i=4 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff77946800 20 add_watcher() i=5 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94573335958080] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.317+0000 7eff77946800 20 add_watcher() i=6 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.318+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94573335960720] v35'73 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.318+0000 7eff77946800 20 add_watcher() i=7 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.318+0000 7eff77946800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.318+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603921821a0 con 0x560392172850 2024-09-19T11:13:54.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.318+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.318+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94573335962032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921821a0 con 0x560392172850 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.319+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94573335962032] v35'82 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7efe2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7eff77946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7eff77946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7eff77946800 5 note: GC not initialized 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7efe2afe5640 20 reqs_thread_entry: start 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7eff77946800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7eff77946800 20 Filter name: none 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7efe28fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7eff77946800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7eff77946800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.320+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603921bc690 con 0x560392172850 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.321+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~673 out=673b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+796 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.321+0000 7eff77946800 20 rados_obj.operate() r=0 bl.length=673 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.321+0000 7eff77946800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.321+0000 7eff77946800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.321+0000 7eff77946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.321+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~582 in=582b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921c2fd0 con 0x560392172850 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~582] v35'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff77946800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff77946800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff77946800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94573336210000 in=770b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603921be6d0 con 0x560392172850 2024-09-19T11:13:54.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94573335951952 notify 150323855368 ret 0) ==== 800+0+0 (crc 0 0 0) 0x7eff70010040 con 0x560392172850 2024-09-19T11:13:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7efe58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94573335951952 notifier 4414 bl.length()=758 2024-09-19T11:13:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7efe58ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(64 notify.4 [notify cookie 94573336210000 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7efe58ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7efe58ff9640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7efe38003ea0 con 0x560392172850 2024-09-19T11:13:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94573336210000 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff7000a800 con 0x560392172850 2024-09-19T11:13:54.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.322+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 8.8 8:17d68d04:users.swift::foo%3afoo1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921c2a50 con 0x560392172850 2024-09-19T11:13:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.323+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(66 foo:foo1 [delete] v35'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.323+0000 7eff77946800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo1, ofs0, ns] 2024-09-19T11:13:54.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.323+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94573336210000 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5603921be220 con 0x7eff60037040 2024-09-19T11:13:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.324+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== watch-notify(notify (1) cookie 94573335935936 notify 150323855364 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7eff7000a800 con 0x7eff60037040 2024-09-19T11:13:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.324+0000 7efe58ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 94573335935936 notifier 4414 bl.length()=159 2024-09-19T11:13:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.324+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [notify cookie 94573336210000 out=8b] v0'0 uv72 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7eff70036040 con 0x7eff60037040 2024-09-19T11:13:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.324+0000 7efe58ff9640 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7efe38003ea0 con 0x7eff60037040 2024-09-19T11:13:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.324+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== watch-notify(notify_complete (2) cookie 94573336210000 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7eff7002a650 con 0x7eff60037040 2024-09-19T11:13:54.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.324+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x7eff60037040 2024-09-19T11:13:54.339 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo1","permissions":"full-control"},{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-19T11:13:54.065107Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:54.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.325+0000 7efe2bfe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.325+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94573335962032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921ba510 con 0x560392172850 2024-09-19T11:13:54.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.326+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94573335962032] v35'83 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.326+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94573335935936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921ba510 con 0x7eff60037040 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.327+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94573335935936] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x7eff60037040 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.327+0000 7eff77946800 20 remove_watcher() i=0 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.327+0000 7eff77946800 2 removed watcher, disabling cache 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.327+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94573335940576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921ba510 con 0x560392172850 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.328+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94573335940576] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.328+0000 7eff77946800 20 remove_watcher() i=1 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.328+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94573335933424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5603921ba510 con 0x56039217b850 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.329+0000 7eff74c36640 1 -- 172.21.15.102:0/876578392 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94573335933424] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff60009050 con 0x56039217b850 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.329+0000 7eff77946800 20 remove_watcher() i=2 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.329+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94573335947680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56039217f1f0 con 0x7eff60037040 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.330+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94573335947680] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x7eff60037040 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.330+0000 7eff77946800 20 remove_watcher() i=3 2024-09-19T11:13:54.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.330+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94573335951952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56039217f1f0 con 0x560392172850 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.331+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94573335951952] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff70036040 con 0x560392172850 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.331+0000 7eff77946800 20 remove_watcher() i=4 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.331+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94573335954656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392183a50 con 0x560392176ea0 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.333+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94573335954656] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.333+0000 7eff77946800 20 remove_watcher() i=5 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.333+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94573335958080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56039217f1f0 con 0x560392176ea0 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.334+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94573335958080] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.334+0000 7eff77946800 20 remove_watcher() i=6 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.334+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94573335960720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x560392183a50 con 0x560392176ea0 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff75437640 1 -- 172.21.15.102:0/876578392 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94573335960720] v35'74 uv72 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7eff680c1030 con 0x560392176ea0 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 20 remove_watcher() i=7 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560392176ea0 msgr2=0x560392179290 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x560392176ea0 0x560392179290 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392172850 msgr2=0x560392174d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392172850 0x560392174d10 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7eff60037040 msgr2=0x7eff60036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7eff60037040 0x7eff60036410 crc :-1 s=READY pgs=33 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56039217b850 msgr2=0x56039217dd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56039217b850 0x56039217dd10 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe4003d000 msgr2=0x7efe4003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe4003d000 0x7efe4003f4c0 secure :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0x7eff6000c010 tx=0x7eff60010000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 msgr2=0x560392167560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 --2- 172.21.15.102:0/876578392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392160170 0x560392167560 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x7eff6800a3f0 tx=0x7eff6809af70 comp rx=0 tx=0).stop 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 reap_dead start 2024-09-19T11:13:54.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff75c38640 1 -- 172.21.15.102:0/876578392 reap_dead start 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 shutdown_connections 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 >> 172.21.15.102:0/876578392 conn(0x56039215c570 msgr2=0x56039215a780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 shutdown_connections 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.335+0000 7eff77946800 1 -- 172.21.15.102:0/876578392 wait complete. 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/3105345472 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5003d000 msgr2=0x7efe5003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/3105345472 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5003d000 0x7efe5003f4c0 secure :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0x7eff6000bf40 tx=0x7eff6000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/3105345472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392153890 msgr2=0x560392153cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/3105345472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392153890 0x560392153cb0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x7eff6804e4f0 tx=0x7eff6806c6e0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/3105345472 shutdown_connections 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/3105345472 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5003d000 0x7efe5003f4c0 unknown :-1 s=CLOSED pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/3105345472 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x560392153890 0x560392153cb0 unknown :-1 s=CLOSED pgs=322 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/3105345472 >> 172.21.15.102:0/3105345472 conn(0x560392147c40 msgr2=0x560392148020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/3105345472 shutdown_connections 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/3105345472 wait complete. 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56039213efc0 msgr2=0x560392141460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56039213efc0 0x560392141460 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392136f30 msgr2=0x56039213c8b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x560392136f30 0x56039213c8b0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560392143050 msgr2=0x560392145440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x560392143050 0x560392145440 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5c03d000 msgr2=0x7efe5c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efe5c03d000 0x7efe5c03f4c0 secure :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0x7eff60001d70 tx=0x7eff600012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039203a680 msgr2=0x560392135260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 --2- 172.21.15.102:0/903411490 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56039203a680 0x560392135260 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x7eff68065040 tx=0x7eff68003330 comp rx=0 tx=0).stop 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff75c38640 1 -- 172.21.15.102:0/903411490 reap_dead start 2024-09-19T11:13:54.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 shutdown_connections 2024-09-19T11:13:54.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 >> 172.21.15.102:0/903411490 conn(0x560392035a70 msgr2=0x56039212e9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 shutdown_connections 2024-09-19T11:13:54.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.336+0000 7eff77946800 1 -- 172.21.15.102:0/903411490 wait complete. 2024-09-19T11:13:54.351 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': 'full-control'}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-19T11:13:54.065107Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:54.351 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-19T11:13:54.351 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo1'] 2024-09-19T11:13:54.351 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo1 2024-09-19T11:13:54.395 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:54.395 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:54.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.395+0000 7fe59df46800 1 Processor -- start 2024-09-19T11:13:54.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.395+0000 7fe59df46800 1 -- start start 2024-09-19T11:13:54.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.395+0000 7fe59df46800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a12186b860 0x55a121874380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.395+0000 7fe59df46800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a1218748c0 con 0x55a121869d40 2024-09-19T11:13:54.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.395+0000 7fe59df46800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55a1216f67d0 con 0x55a12186b860 2024-09-19T11:13:54.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.395+0000 7fe59b22f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a12186b860 0x55a121874380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.395+0000 7fe59b22f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a12186b860 0x55a121874380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43444/0 (socket says 172.21.15.102:43444) 2024-09-19T11:13:54.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.395+0000 7fe59b22f640 1 -- 172.21.15.102:0/548409136 learned_addr learned my addr 172.21.15.102:0/548409136 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.396+0000 7fe59b22f640 1 -- 172.21.15.102:0/548409136 >> v1:172.21.15.37:6789/0 conn(0x55a121869d40 legacy=0x55a12186a140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.396+0000 7fe59b22f640 1 -- 172.21.15.102:0/548409136 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a121875aa0 con 0x55a12186b860 2024-09-19T11:13:54.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.396+0000 7fe59aa2e640 1 -- 172.21.15.102:0/548409136 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 715246315 0 0) 0x55a1218748c0 con 0x55a121869d40 2024-09-19T11:13:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.397+0000 7fe59b22f640 1 --2- 172.21.15.102:0/548409136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12186b860 0x55a121874380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe59000a520 tx=0x7fe590045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d77ce22531faa8a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59aa2e640 1 -- 172.21.15.102:0/548409136 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe590055070 con 0x55a12186b860 2024-09-19T11:13:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59aa2e640 1 -- 172.21.15.102:0/548409136 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe5900515b0 con 0x55a12186b860 2024-09-19T11:13:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59aa2e640 1 -- 172.21.15.102:0/548409136 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe5900518d0 con 0x55a12186b860 2024-09-19T11:13:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59df46800 1 -- 172.21.15.102:0/548409136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12186b860 msgr2=0x55a121874380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59df46800 1 --2- 172.21.15.102:0/548409136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12186b860 0x55a121874380 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7fe59000a520 tx=0x7fe590045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59df46800 1 -- 172.21.15.102:0/548409136 shutdown_connections 2024-09-19T11:13:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59df46800 1 --2- 172.21.15.102:0/548409136 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12186b860 0x55a121874380 unknown :-1 s=CLOSED pgs=326 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59df46800 1 -- 172.21.15.102:0/548409136 >> 172.21.15.102:0/548409136 conn(0x55a121865a90 msgr2=0x55a121867ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59df46800 1 -- 172.21.15.102:0/548409136 shutdown_connections 2024-09-19T11:13:54.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.398+0000 7fe59df46800 1 -- 172.21.15.102:0/548409136 wait complete. 2024-09-19T11:13:54.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.412+0000 7fe59df46800 1 Processor -- start 2024-09-19T11:13:54.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.412+0000 7fe59df46800 1 -- start start 2024-09-19T11:13:54.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.412+0000 7fe59df46800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a12195d350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.412+0000 7fe59df46800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a121703dd0 con 0x55a121869d40 2024-09-19T11:13:54.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.412+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a12195d350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.412+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a12195d350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43460/0 (socket says 172.21.15.102:43460) 2024-09-19T11:13:54.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.412+0000 7fe59ba30640 1 -- 172.21.15.102:0/3920333112 learned_addr learned my addr 172.21.15.102:0/3920333112 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.413+0000 7fe59ba30640 1 -- 172.21.15.102:0/3920333112 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a12195d940 con 0x55a121869d40 2024-09-19T11:13:54.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.413+0000 7fe59ba30640 1 --2- 172.21.15.102:0/3920333112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a12195d350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe58c001de0 tx=0x7fe58c00b590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3d11cfa8c46a43cb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.413+0000 7fe489e0b640 1 -- 172.21.15.102:0/3920333112 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c016070 con 0x55a121869d40 2024-09-19T11:13:54.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.413+0000 7fe489e0b640 1 -- 172.21.15.102:0/3920333112 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c00f4d0 con 0x55a121869d40 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.413+0000 7fe489e0b640 1 -- 172.21.15.102:0/3920333112 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c00f830 con 0x55a121869d40 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 -- 172.21.15.102:0/3920333112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 msgr2=0x55a12195d350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 --2- 172.21.15.102:0/3920333112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a12195d350 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x7fe58c001de0 tx=0x7fe58c00b590 comp rx=0 tx=0).stop 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 -- 172.21.15.102:0/3920333112 shutdown_connections 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 --2- 172.21.15.102:0/3920333112 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a12195d350 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 -- 172.21.15.102:0/3920333112 >> 172.21.15.102:0/3920333112 conn(0x55a121865a90 msgr2=0x55a121958cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 -- 172.21.15.102:0/3920333112 shutdown_connections 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 -- 172.21.15.102:0/3920333112 wait complete. 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 Processor -- start 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 -- start start 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a121964ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59df46800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a121874d60 con 0x55a121869d40 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a121964ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a121964ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43474/0 (socket says 172.21.15.102:43474) 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59ba30640 1 -- 172.21.15.102:0/2490597219 learned_addr learned my addr 172.21.15.102:0/2490597219 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.414+0000 7fe59ba30640 1 -- 172.21.15.102:0/2490597219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a121965440 con 0x55a121869d40 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.415+0000 7fe59ba30640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a121964ee0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55a12195e2e0 tx=0x7fe58c000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.415+0000 7fe483fff640 1 -- 172.21.15.102:0/2490597219 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c016070 con 0x55a121869d40 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.415+0000 7fe483fff640 1 -- 172.21.15.102:0/2490597219 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c023070 con 0x55a121869d40 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.415+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1219656d0 con 0x55a121869d40 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.415+0000 7fe483fff640 1 -- 172.21.15.102:0/2490597219 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c011d40 con 0x55a121869d40 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.415+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a121966080 con 0x55a121869d40 2024-09-19T11:13:54.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe483fff640 1 -- 172.21.15.102:0/2490597219 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe58c028460 con 0x55a121869d40 2024-09-19T11:13:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe483fff640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe48403cfb0 0x7fe48403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe483fff640 1 -- 172.21.15.102:0/2490597219 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe58c0547a0 con 0x55a121869d40 2024-09-19T11:13:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe48403cfb0 0x7fe48403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe59df46800 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a12186b860 0x55a12196c4e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a12196ca20 con 0x55a12186b860 2024-09-19T11:13:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe59c231640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a12186b860 0x55a12196c4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe48403cfb0 0x7fe48403f470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe590057000 tx=0x7fe590052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.416+0000 7fe59c231640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a12186b860 0x55a12196c4e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.417+0000 7fe59c231640 1 -- 172.21.15.102:0/2490597219 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a12186b860 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.417+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a12196cdc0 con 0x55a12186b860 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.417+0000 7fe59c231640 1 -- 172.21.15.102:0/2490597219 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a12186b860 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.417+0000 7fe59df46800 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a12196e840 0x55a121970ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.417+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a121971470 con 0x55a12196e840 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.417+0000 7fe59ba30640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a12196e840 0x55a121970ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.418+0000 7fe59ba30640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a12196e840 0x55a121970ce0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.418+0000 7fe59ba30640 1 -- 172.21.15.102:0/2490597219 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe58c028c70 con 0x55a12196e840 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.418+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a12196d610 con 0x55a12186b860 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.418+0000 7fe59c231640 1 -- 172.21.15.102:0/2490597219 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a12186b860 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.418+0000 7fe59df46800 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219728d0 0x55a121974cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.418+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219753b0 con 0x55a1219728d0 2024-09-19T11:13:54.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.419+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219728d0 0x55a121974cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.419+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219728d0 0x55a121974cc0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.419+0000 7fe59b22f640 1 -- 172.21.15.102:0/2490597219 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe590057030 con 0x55a1219728d0 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.419+0000 7fe59df46800 1 Processor -- start 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.419+0000 7fe59df46800 1 -- start start 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe59df46800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121983110 0x55a121983530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe59df46800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a1217624a0 con 0x55a121983110 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121983110 0x55a121983530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121983110 0x55a121983530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43488/0 (socket says 172.21.15.102:43488) 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe59ba30640 1 -- 172.21.15.102:0/1260394239 learned_addr learned my addr 172.21.15.102:0/1260394239 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe59ba30640 1 -- 172.21.15.102:0/1260394239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a121983b70 con 0x55a121983110 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe59ba30640 1 --2- 172.21.15.102:0/1260394239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121983110 0x55a121983530 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe58c01e720 tx=0x7fe58c03ee90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe4817fa640 1 -- 172.21.15.102:0/1260394239 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c04e030 con 0x55a121983110 2024-09-19T11:13:54.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe4817fa640 1 -- 172.21.15.102:0/1260394239 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c048070 con 0x55a121983110 2024-09-19T11:13:54.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe4817fa640 1 -- 172.21.15.102:0/1260394239 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c0424a0 con 0x55a121983110 2024-09-19T11:13:54.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.420+0000 7fe59df46800 1 -- 172.21.15.102:0/1260394239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a1219843a0 con 0x55a121983110 2024-09-19T11:13:54.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.421+0000 7fe59df46800 1 -- 172.21.15.102:0/1260394239 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a121984940 con 0x55a121983110 2024-09-19T11:13:54.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.421+0000 7fe4817fa640 1 -- 172.21.15.102:0/1260394239 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe58c04a020 con 0x55a121983110 2024-09-19T11:13:54.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.421+0000 7fe4817fa640 1 --2- 172.21.15.102:0/1260394239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe47403d000 0x7fe47403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.421+0000 7fe4817fa640 1 -- 172.21.15.102:0/1260394239 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe58c03cc40 con 0x55a121983110 2024-09-19T11:13:54.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59b22f640 1 --2- 172.21.15.102:0/1260394239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe47403d000 0x7fe47403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59df46800 1 Processor -- start 2024-09-19T11:13:54.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59df46800 1 -- start start 2024-09-19T11:13:54.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59b22f640 1 --2- 172.21.15.102:0/1260394239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe47403d000 0x7fe47403f4c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55a121966f50 tx=0x7fe590005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59df46800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a12198ff50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59df46800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a12195dd70 con 0x55a12198fb50 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a12198ff50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a12198ff50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43504/0 (socket says 172.21.15.102:43504) 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59ba30640 1 -- 172.21.15.102:0/3943358226 learned_addr learned my addr 172.21.15.102:0/3943358226 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.422+0000 7fe59ba30640 1 -- 172.21.15.102:0/3943358226 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a121990540 con 0x55a12198fb50 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe59ba30640 1 --2- 172.21.15.102:0/3943358226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a12198ff50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe58c042ee0 tx=0x7fe58c01d8c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7da6408c6518573e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe47affd640 1 -- 172.21.15.102:0/3943358226 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c037070 con 0x55a12198fb50 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe47affd640 1 -- 172.21.15.102:0/3943358226 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c04f040 con 0x55a12198fb50 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe47affd640 1 -- 172.21.15.102:0/3943358226 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c053ef0 con 0x55a12198fb50 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe59df46800 1 -- 172.21.15.102:0/3943358226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 msgr2=0x55a12198ff50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe59df46800 1 --2- 172.21.15.102:0/3943358226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a12198ff50 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x7fe58c042ee0 tx=0x7fe58c01d8c0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe59df46800 1 -- 172.21.15.102:0/3943358226 shutdown_connections 2024-09-19T11:13:54.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe59df46800 1 --2- 172.21.15.102:0/3943358226 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a12198ff50 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe59df46800 1 -- 172.21.15.102:0/3943358226 >> 172.21.15.102:0/3943358226 conn(0x55a12198bf50 msgr2=0x55a12198a190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe59df46800 1 -- 172.21.15.102:0/3943358226 shutdown_connections 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.423+0000 7fe59df46800 1 -- 172.21.15.102:0/3943358226 wait complete. 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.424+0000 7fe59df46800 1 Processor -- start 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.424+0000 7fe59df46800 1 -- start start 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.424+0000 7fe59df46800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a121996fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.424+0000 7fe59df46800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a1219909b0 con 0x55a12198fb50 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.424+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a121996fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.424+0000 7fe59ba30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a121996fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43518/0 (socket says 172.21.15.102:43518) 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.424+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 learned_addr learned my addr 172.21.15.102:0/2954838736 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.424+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a121997520 con 0x55a12198fb50 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.425+0000 7fe59ba30640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a121996fc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe58c040010 tx=0x7fe58c04b850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.425+0000 7fe4797fa640 1 -- 172.21.15.102:0/2954838736 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c06e070 con 0x55a12198fb50 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.425+0000 7fe4797fa640 1 -- 172.21.15.102:0/2954838736 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe58c017040 con 0x55a12198fb50 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.425+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a121997520 con 0x55a12198fb50 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.425+0000 7fe4797fa640 1 -- 172.21.15.102:0/2954838736 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe58c01d370 con 0x55a12198fb50 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.425+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a121997520 con 0x55a12198fb50 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.425+0000 7fe4797fa640 1 -- 172.21.15.102:0/2954838736 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe58c071070 con 0x55a12198fb50 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.426+0000 7fe4797fa640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe46403d000 0x7fe46403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.426+0000 7fe4797fa640 1 -- 172.21.15.102:0/2954838736 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe58c065030 con 0x55a12198fb50 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.426+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe46403d000 0x7fe46403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.426+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe46403d000 0x7fe46403f4c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe590051b50 tx=0x7fe590053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.426+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.426+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a1219a2570 0x55a1219a4a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.426+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a5180 con 0x55a1219a2570 2024-09-19T11:13:54.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59c231640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a1219a2570 0x55a1219a4a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59c231640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a1219a2570 0x55a1219a4a30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 20 realm 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a5590 con 0x55a1219a2570 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a5e60 con 0x55a1219a2570 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.427+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.428+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.428+0000 7fe59df46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.428+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.428+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a1219a6f60 0x55a1219a9350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.428+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a99a0 con 0x55a1219a6f60 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.428+0000 7fe59ba30640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a1219a6f60 0x55a1219a9350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.428+0000 7fe59ba30640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a1219a6f60 0x55a1219a9350 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59df46800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59df46800 20 searching for the correct realm 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219ab970 0x55a1219ade30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ae4b0 con 0x55a1219ab970 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219ab970 0x55a1219ade30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219ab970 0x55a1219ade30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59b22f640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe590069040 0x7fe59006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ae4b0 con 0x7fe590069040 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.429+0000 7fe59c231640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe590069040 0x7fe59006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.430+0000 7fe59c231640 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe590069040 0x7fe59006a940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.430+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.430+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.430+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.430+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.430+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.430+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.431+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.431+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.431+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.431+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.431+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.431+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x7fe590069040 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.431+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.431+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219ab970 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.432+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.432+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.432+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.432+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.432+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.432+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.432+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.432+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x7fe590069040 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.433+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.433+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219ab970 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.433+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.433+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219ab970 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.433+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.433+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.434+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.434+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219ab970 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.434+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.434+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219ab970 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.434+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.434+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.434+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.434+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.435+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.435+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.435+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.435+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219ab970 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.435+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.435+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x7fe590069040 2024-09-19T11:13:54.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.435+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.435+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.436+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.436+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.436+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.436+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219ab970 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.436+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.436+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.436+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.436+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x7fe590069040 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219ab970 2024-09-19T11:13:54.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a6f60 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x55a1219a2570 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55a1219a6200 con 0x7fe590069040 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.437+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:54.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219aa260 con 0x55a1219a2570 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219aa260 con 0x55a1219a2570 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219aa260 con 0x55a1219ab970 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 zone default found 2024-09-19T11:13:54.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 4 Realm: () 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 zonegroup default 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.438+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219aab00 con 0x55a1219a6f60 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b0420 con 0x55a1219ab970 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b0830 con 0x55a1219ab970 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 20 started sync module instance, tier type = 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.439+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219af7c0 con 0x7fe590069040 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.440+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.440+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94150541900992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219af7c0 con 0x7fe590069040 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.440+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b1280 con 0x55a1219a2570 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.441+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94150541900992] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.441+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.441+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94150541898512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b1280 con 0x55a1219a2570 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.441+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b1d00 con 0x55a1219ab970 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.442+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94150541898512] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.443+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.443+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94150541907952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b20a0 con 0x55a1219ab970 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.443+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b2b70 con 0x7fe590069040 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.444+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.444+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94150541911648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b3440 con 0x7fe590069040 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.444+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b3f30 con 0x55a1219a2570 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.444+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94150541907952] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.445+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94150541911648] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.445+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.445+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94150541916672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b2f40 con 0x55a1219a2570 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.445+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b47d0 con 0x55a1219a6f60 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.446+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.446+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94150541919008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b2f40 con 0x55a1219a6f60 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.446+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b5770 con 0x55a1219a6f60 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.446+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94150541916672] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.447+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.447+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94150541922880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b0ed0 con 0x55a1219a6f60 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.447+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b6520 con 0x55a1219a6f60 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.447+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94150541919008] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94150541922880] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'75 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94150541924688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b4b70 con 0x55a1219a6f60 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59df46800 20 add_watcher() i=0 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59df46800 20 add_watcher() i=1 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59df46800 20 add_watcher() i=2 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59df46800 20 add_watcher() i=3 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59df46800 20 add_watcher() i=4 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59df46800 20 add_watcher() i=5 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.448+0000 7fe59df46800 20 add_watcher() i=6 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.449+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94150541924688] v35'76 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.449+0000 7fe59df46800 20 add_watcher() i=7 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.449+0000 7fe59df46800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:54.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.449+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b9550 con 0x55a1219a2570 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.449+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.449+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94150541926480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219b69d0 con 0x55a1219a2570 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.450+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94150541926480] v35'84 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.450+0000 7fe451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.450+0000 7fe59df46800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.450+0000 7fe59df46800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.450+0000 7fe59df46800 5 note: GC not initialized 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.450+0000 7fe450fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 20 Filter name: none 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe3ca7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:54.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ec2a0 con 0x55a1219a2570 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~582 out=582b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+705 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 20 rados_obj.operate() r=0 bl.length=582 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.451+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~556 in=556b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219f2780 con 0x55a1219a2570 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.452+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~556] v35'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.452+0000 7fe59df46800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.452+0000 7fe59df46800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.452+0000 7fe59df46800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:54.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.452+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94150542172544 in=744b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ee0f0 con 0x55a1219a2570 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.453+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94150541916672 notify 150323855369 ret 0) ==== 774+0+0 (crc 0 0 0) 0x7fe594026410 con 0x55a1219a2570 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.453+0000 7fe47affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 94150541916672 notifier 4421 bl.length()=732 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.453+0000 7fe47affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.453+0000 7fe47affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.453+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(64 notify.4 [notify cookie 94150542172544 out=8b] v0'0 uv75 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.453+0000 7fe47affd640 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fe460003ea0 con 0x55a1219a2570 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.453+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.453+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94150542172544 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe5940265e0 con 0x55a1219a2570 2024-09-19T11:13:54.466 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[{"id":"foo:foo2","permissions":""}],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[{"user":"foo:foo2","secret_key":"ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy","active":true,"create_date":"2024-09-19T11:13:54.065107Z"}],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:54.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.454+0000 7fe451fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.454+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94150541926480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x55a1219a2570 2024-09-19T11:13:54.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.455+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94150541926480] v35'85 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.455+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94150541900992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x7fe590069040 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.456+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94150541900992] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.456+0000 7fe59df46800 20 remove_watcher() i=0 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.456+0000 7fe59df46800 2 removed watcher, disabling cache 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.456+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94150541898512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x55a1219a2570 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.457+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94150541898512] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.457+0000 7fe59df46800 20 remove_watcher() i=1 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.457+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94150541907952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x55a1219ab970 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.458+0000 7fe59b22f640 1 -- 172.21.15.102:0/2954838736 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94150541907952] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe590057030 con 0x55a1219ab970 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.458+0000 7fe59df46800 20 remove_watcher() i=2 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.458+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94150541911648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x7fe590069040 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.459+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94150541911648] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x7fe590069040 2024-09-19T11:13:54.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.459+0000 7fe59df46800 20 remove_watcher() i=3 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.459+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94150541916672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x55a1219a2570 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.460+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94150541916672] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe59400a4d0 con 0x55a1219a2570 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.460+0000 7fe59df46800 20 remove_watcher() i=4 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.460+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94150541919008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x55a1219a6f60 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.461+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94150541919008] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.461+0000 7fe59df46800 20 remove_watcher() i=5 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.461+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94150541922880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x55a1219a6f60 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.462+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94150541922880] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.462+0000 7fe59df46800 20 remove_watcher() i=6 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.462+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94150541924688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55a1219ea160 con 0x55a1219a6f60 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59ba30640 1 -- 172.21.15.102:0/2954838736 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94150541924688] v35'77 uv75 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe58c070030 con 0x55a1219a6f60 2024-09-19T11:13:54.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 20 remove_watcher() i=7 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a1219a6f60 msgr2=0x55a1219a9350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a1219a6f60 0x55a1219a9350 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a1219a2570 msgr2=0x55a1219a4a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a1219a2570 0x55a1219a4a30 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe590069040 msgr2=0x7fe59006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe590069040 0x7fe59006a940 crc :-1 s=READY pgs=34 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219ab970 msgr2=0x55a1219ade30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219ab970 0x55a1219ade30 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe46403d000 msgr2=0x7fe46403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe46403d000 0x7fe46403f4c0 secure :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0x7fe590051b50 tx=0x7fe590053000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 msgr2=0x55a121996fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a121996fc0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7fe58c040010 tx=0x7fe58c04b850 comp rx=0 tx=0).stop 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59c231640 1 -- 172.21.15.102:0/2954838736 reap_dead start 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 shutdown_connections 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.463+0000 7fe59df46800 1 --2- 172.21.15.102:0/2954838736 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a12198fb50 0x55a121996fc0 unknown :-1 s=CLOSED pgs=331 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 >> 172.21.15.102:0/2954838736 conn(0x55a12198bf50 msgr2=0x55a12198a160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 shutdown_connections 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2954838736 wait complete. 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/1260394239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe47403d000 msgr2=0x7fe47403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/1260394239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe47403d000 0x7fe47403f4c0 secure :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0x55a121966f50 tx=0x7fe590005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/1260394239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121983110 msgr2=0x55a121983530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/1260394239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121983110 0x55a121983530 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7fe58c01e720 tx=0x7fe58c03ee90 comp rx=0 tx=0).stop 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/1260394239 shutdown_connections 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/1260394239 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe47403d000 0x7fe47403f4c0 unknown :-1 s=CLOSED pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/1260394239 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121983110 0x55a121983530 unknown :-1 s=CLOSED pgs=329 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/1260394239 >> 172.21.15.102:0/1260394239 conn(0x55a1219774c0 msgr2=0x55a1219778a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/1260394239 shutdown_connections 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/1260394239 wait complete. 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a12196e840 msgr2=0x55a121970ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a12196e840 0x55a121970ce0 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a12186b860 msgr2=0x55a12196c4e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a12186b860 0x55a12196c4e0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219728d0 msgr2=0x55a121974cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a1219728d0 0x55a121974cc0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe48403cfb0 msgr2=0x7fe48403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe48403cfb0 0x7fe48403f470 secure :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0x7fe590057000 tx=0x7fe590052000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 msgr2=0x55a121964ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 --2- 172.21.15.102:0/2490597219 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a121869d40 0x55a121964ee0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x55a12195e2e0 tx=0x7fe58c000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59c231640 1 -- 172.21.15.102:0/2490597219 reap_dead start 2024-09-19T11:13:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 shutdown_connections 2024-09-19T11:13:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 >> 172.21.15.102:0/2490597219 conn(0x55a121865a90 msgr2=0x55a12195e840 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.464+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 shutdown_connections 2024-09-19T11:13:54.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.465+0000 7fe59df46800 1 -- 172.21.15.102:0/2490597219 wait complete. 2024-09-19T11:13:54.478 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True, 'create_date': '2024-09-19T11:13:54.065107Z'}], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:54.478 INFO:tasks.util.rgw:rgwadmin: client.0 : ['subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-19T11:13:54.478 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'subuser', 'rm', '--subuser', 'foo:foo2', '--key-type', 'swift', '--purge-keys'] 2024-09-19T11:13:54.478 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph subuser rm --subuser foo:foo2 --key-type swift --purge-keys 2024-09-19T11:13:54.525 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:54.525 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.525+0000 7f5839d2c800 1 Processor -- start 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.525+0000 7f5839d2c800 1 -- start start 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.525+0000 7f5839d2c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56475cc5b2a0 0x56475ccef3f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.525+0000 7f5839d2c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56475ccef930 con 0x56475cc5c630 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.525+0000 7f5839d2c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x56475cb717d0 con 0x56475cc5b2a0 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.526+0000 7f583524e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56475cc5b2a0 0x56475ccef3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.526+0000 7f5835a4f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x56475cc5c630 0x56475cc5aa20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52396/0 (socket says 172.21.15.102:52396) 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.526+0000 7f5835a4f640 1 -- 172.21.15.102:0/2800733775 learned_addr learned my addr 172.21.15.102:0/2800733775 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.526+0000 7f583524e640 1 -- 172.21.15.102:0/2800733775 >> v1:172.21.15.37:6789/0 conn(0x56475cc5c630 legacy=0x56475cc5aa20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.526+0000 7f5834a4d640 1 -- 172.21.15.102:0/2800733775 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2434608466 0 0) 0x56475ccef930 con 0x56475cc5c630 2024-09-19T11:13:54.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.526+0000 7f583524e640 1 -- 172.21.15.102:0/2800733775 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475ccf0b10 con 0x56475cc5b2a0 2024-09-19T11:13:54.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f583524e640 1 --2- 172.21.15.102:0/2800733775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475ccef3f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f582000a470 tx=0x7f5820045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4c6b73f61367bc18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5834a4d640 1 -- 172.21.15.102:0/2800733775 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820053570 con 0x56475cc5b2a0 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5834a4d640 1 -- 172.21.15.102:0/2800733775 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5820058070 con 0x56475cc5b2a0 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5834a4d640 1 -- 172.21.15.102:0/2800733775 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5820053880 con 0x56475cc5b2a0 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5839d2c800 1 -- 172.21.15.102:0/2800733775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 msgr2=0x56475ccef3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5839d2c800 1 --2- 172.21.15.102:0/2800733775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475ccef3f0 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x7f582000a470 tx=0x7f5820045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5839d2c800 1 -- 172.21.15.102:0/2800733775 shutdown_connections 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5839d2c800 1 --2- 172.21.15.102:0/2800733775 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475ccef3f0 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5839d2c800 1 -- 172.21.15.102:0/2800733775 >> 172.21.15.102:0/2800733775 conn(0x56475cce1c80 msgr2=0x56475cce40e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.528+0000 7f5839d2c800 1 -- 172.21.15.102:0/2800733775 shutdown_connections 2024-09-19T11:13:54.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.529+0000 7f5839d2c800 1 -- 172.21.15.102:0/2800733775 wait complete. 2024-09-19T11:13:54.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.542+0000 7f5839d2c800 1 Processor -- start 2024-09-19T11:13:54.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.542+0000 7f5839d2c800 1 -- start start 2024-09-19T11:13:54.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.542+0000 7f5839d2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475cdd82f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.542+0000 7f5839d2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56475cb7edd0 con 0x56475cc5b2a0 2024-09-19T11:13:54.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.543+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475cdd82f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.543+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475cdd82f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43534/0 (socket says 172.21.15.102:43534) 2024-09-19T11:13:54.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.543+0000 7f5835a4f640 1 -- 172.21.15.102:0/3382210751 learned_addr learned my addr 172.21.15.102:0/3382210751 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.543+0000 7f5835a4f640 1 -- 172.21.15.102:0/3382210751 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475cdd88e0 con 0x56475cc5b2a0 2024-09-19T11:13:54.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.543+0000 7f5835a4f640 1 --2- 172.21.15.102:0/3382210751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475cdd82f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5830001dc0 tx=0x7f583000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2679b78468188491 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5723e07640 1 -- 172.21.15.102:0/3382210751 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5830012020 con 0x56475cc5b2a0 2024-09-19T11:13:54.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5723e07640 1 -- 172.21.15.102:0/3382210751 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583000e5a0 con 0x56475cc5b2a0 2024-09-19T11:13:54.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5723e07640 1 -- 172.21.15.102:0/3382210751 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583000e8c0 con 0x56475cc5b2a0 2024-09-19T11:13:54.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5839d2c800 1 -- 172.21.15.102:0/3382210751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 msgr2=0x56475cdd82f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5839d2c800 1 --2- 172.21.15.102:0/3382210751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475cdd82f0 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f5830001dc0 tx=0x7f583000b6c0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5839d2c800 1 -- 172.21.15.102:0/3382210751 shutdown_connections 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5839d2c800 1 --2- 172.21.15.102:0/3382210751 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5b2a0 0x56475cdd82f0 unknown :-1 s=CLOSED pgs=334 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5839d2c800 1 -- 172.21.15.102:0/3382210751 >> 172.21.15.102:0/3382210751 conn(0x56475cce1c80 msgr2=0x56475cdd3c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5839d2c800 1 -- 172.21.15.102:0/3382210751 shutdown_connections 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.544+0000 7f5839d2c800 1 -- 172.21.15.102:0/3382210751 wait complete. 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.545+0000 7f5839d2c800 1 Processor -- start 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.545+0000 7f5839d2c800 1 -- start start 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.545+0000 7f5839d2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5c630 0x56475cde00f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.545+0000 7f5839d2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56475ccefe00 con 0x56475cc5c630 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.545+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5c630 0x56475cde00f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.545+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5c630 0x56475cde00f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43542/0 (socket says 172.21.15.102:43542) 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.545+0000 7f5835a4f640 1 -- 172.21.15.102:0/1778837551 learned_addr learned my addr 172.21.15.102:0/1778837551 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.545+0000 7f5835a4f640 1 -- 172.21.15.102:0/1778837551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475cde0650 con 0x56475cc5c630 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.546+0000 7f5835a4f640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5c630 0x56475cde00f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5830000fb0 tx=0x7f5830000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.546+0000 7f5722604640 1 -- 172.21.15.102:0/1778837551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5830012030 con 0x56475cc5c630 2024-09-19T11:13:54.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.546+0000 7f5722604640 1 -- 172.21.15.102:0/1778837551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583001a700 con 0x56475cc5c630 2024-09-19T11:13:54.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.546+0000 7f5722604640 1 -- 172.21.15.102:0/1778837551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583001a930 con 0x56475cc5c630 2024-09-19T11:13:54.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.546+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56475cde08e0 con 0x56475cc5c630 2024-09-19T11:13:54.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.546+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475cde12e0 con 0x56475cc5c630 2024-09-19T11:13:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.547+0000 7f5722604640 1 -- 172.21.15.102:0/1778837551 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5830015020 con 0x56475cc5c630 2024-09-19T11:13:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.547+0000 7f5722604640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571c03d000 0x7f571c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.547+0000 7f5722604640 1 -- 172.21.15.102:0/1778837551 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5830020030 con 0x56475cc5c630 2024-09-19T11:13:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.547+0000 7f583524e640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571c03d000 0x7f571c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.547+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475cde1e00 0x56475cde7740 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.547+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475cde7cc0 con 0x56475cde1e00 2024-09-19T11:13:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.547+0000 7f5836250640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475cde1e00 0x56475cde7740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.547+0000 7f583524e640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571c03d000 0x7f571c03f4c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5820057000 tx=0x7f5820052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.548+0000 7f5836250640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475cde1e00 0x56475cde7740 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.548+0000 7f5836250640 1 -- 172.21.15.102:0/1778837551 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475cde1e00 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.548+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475cde1790 con 0x56475cde1e00 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.548+0000 7f5836250640 1 -- 172.21.15.102:0/1778837551 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f582800a4d0 con 0x56475cde1e00 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.548+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475cde9fd0 0x56475cdec3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.548+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475cdeca90 con 0x56475cde9fd0 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.548+0000 7f5835a4f640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475cde9fd0 0x56475cdec3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.549+0000 7f5835a4f640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475cde9fd0 0x56475cdec3c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.549+0000 7f5835a4f640 1 -- 172.21.15.102:0/1778837551 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f58300424a0 con 0x56475cde9fd0 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.549+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475cde8e70 con 0x56475cde1e00 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.549+0000 7f5836250640 1 -- 172.21.15.102:0/1778837551 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f582800a4d0 con 0x56475cde1e00 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.550+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475cdeded0 0x56475cdf02c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.550+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475cdf0a00 con 0x56475cdeded0 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.550+0000 7f583524e640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475cdeded0 0x56475cdf02c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.550+0000 7f583524e640 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475cdeded0 0x56475cdf02c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.550+0000 7f583524e640 1 -- 172.21.15.102:0/1778837551 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5820051070 con 0x56475cdeded0 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.550+0000 7f5839d2c800 1 Processor -- start 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.551+0000 7f5839d2c800 1 -- start start 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.551+0000 7f5839d2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cdfe700 0x56475cdfeb20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.551+0000 7f5839d2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56475cbdd4a0 con 0x56475cdfe700 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.551+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cdfe700 0x56475cdfeb20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.551+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cdfe700 0x56475cdfeb20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43554/0 (socket says 172.21.15.102:43554) 2024-09-19T11:13:54.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.551+0000 7f5835a4f640 1 -- 172.21.15.102:0/2314884821 learned_addr learned my addr 172.21.15.102:0/2314884821 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.551+0000 7f5835a4f640 1 -- 172.21.15.102:0/2314884821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475cdff160 con 0x56475cdfe700 2024-09-19T11:13:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.552+0000 7f5835a4f640 1 --2- 172.21.15.102:0/2314884821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cdfe700 0x56475cdfeb20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5830001580 tx=0x7f58300449c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.552+0000 7f571b7fe640 1 -- 172.21.15.102:0/2314884821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5830048020 con 0x56475cdfe700 2024-09-19T11:13:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.552+0000 7f571b7fe640 1 -- 172.21.15.102:0/2314884821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5830042050 con 0x56475cdfe700 2024-09-19T11:13:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.552+0000 7f5839d2c800 1 -- 172.21.15.102:0/2314884821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56475cdff990 con 0x56475cdfe700 2024-09-19T11:13:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.552+0000 7f571b7fe640 1 -- 172.21.15.102:0/2314884821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583002d3f0 con 0x56475cdfe700 2024-09-19T11:13:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.552+0000 7f5839d2c800 1 -- 172.21.15.102:0/2314884821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475cdff990 con 0x56475cdfe700 2024-09-19T11:13:54.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.552+0000 7f571b7fe640 1 -- 172.21.15.102:0/2314884821 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f583004b310 con 0x56475cdfe700 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.553+0000 7f571b7fe640 1 --2- 172.21.15.102:0/2314884821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571003d000 0x7f571003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.553+0000 7f571b7fe640 1 -- 172.21.15.102:0/2314884821 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f583003d030 con 0x56475cdfe700 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.553+0000 7f583524e640 1 --2- 172.21.15.102:0/2314884821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571003d000 0x7f571003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.553+0000 7f5839d2c800 1 Processor -- start 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.553+0000 7f5839d2c800 1 -- start start 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.553+0000 7f583524e640 1 --2- 172.21.15.102:0/2314884821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571003d000 0x7f571003f4c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x56475cde8150 tx=0x7f5820005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.553+0000 7f5839d2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce0b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.553+0000 7f5839d2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56475cdd8d10 con 0x56475ce0ade0 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.554+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce0b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.554+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce0b1e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43566/0 (socket says 172.21.15.102:43566) 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.554+0000 7f5835a4f640 1 -- 172.21.15.102:0/1464620335 learned_addr learned my addr 172.21.15.102:0/1464620335 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.554+0000 7f5835a4f640 1 -- 172.21.15.102:0/1464620335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475ce0b7d0 con 0x56475ce0ade0 2024-09-19T11:13:54.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.554+0000 7f5835a4f640 1 --2- 172.21.15.102:0/1464620335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce0b1e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5830018790 tx=0x7f5830044130 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d63e88a9ee1bf93 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.554+0000 7f57197fa640 1 -- 172.21.15.102:0/1464620335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583004bd00 con 0x56475ce0ade0 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.554+0000 7f57197fa640 1 -- 172.21.15.102:0/1464620335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f583000cb60 con 0x56475ce0ade0 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.554+0000 7f57197fa640 1 -- 172.21.15.102:0/1464620335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5830024cd0 con 0x56475ce0ade0 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 -- 172.21.15.102:0/1464620335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 msgr2=0x56475ce0b1e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1464620335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce0b1e0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f5830018790 tx=0x7f5830044130 comp rx=0 tx=0).stop 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 -- 172.21.15.102:0/1464620335 shutdown_connections 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1464620335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce0b1e0 unknown :-1 s=CLOSED pgs=337 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 -- 172.21.15.102:0/1464620335 >> 172.21.15.102:0/1464620335 conn(0x56475ce071e0 msgr2=0x56475ce05420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 -- 172.21.15.102:0/1464620335 shutdown_connections 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 -- 172.21.15.102:0/1464620335 wait complete. 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 Processor -- start 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 -- start start 2024-09-19T11:13:54.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce122c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5839d2c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56475ce0bc40 con 0x56475ce0ade0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce122c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5835a4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce122c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43576/0 (socket says 172.21.15.102:43576) 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.555+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 learned_addr learned my addr 172.21.15.102:0/1213369662 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.556+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56475ce12820 con 0x56475ce0ade0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.556+0000 7f5835a4f640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce122c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f583000bbe0 tx=0x7f583003b350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.556+0000 7f57077fe640 1 -- 172.21.15.102:0/1213369662 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583000c7e0 con 0x56475ce0ade0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.556+0000 7f57077fe640 1 -- 172.21.15.102:0/1213369662 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5830044250 con 0x56475ce0ade0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.556+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56475ce12820 con 0x56475ce0ade0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.556+0000 7f57077fe640 1 -- 172.21.15.102:0/1213369662 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f583000c980 con 0x56475ce0ade0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.556+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56475ce12820 con 0x56475ce0ade0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.557+0000 7f57077fe640 1 -- 172.21.15.102:0/1213369662 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f583005c070 con 0x56475ce0ade0 2024-09-19T11:13:54.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.557+0000 7f57077fe640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f570003cfb0 0x7f570003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.557+0000 7f57077fe640 1 -- 172.21.15.102:0/1213369662 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f583005a070 con 0x56475ce0ade0 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.557+0000 7f583524e640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f570003cfb0 0x7f570003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475ce1d820 0x56475ce1fce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce20430 con 0x56475ce1d820 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f583524e640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f570003cfb0 0x7f570003f470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56475cdf0e00 tx=0x7f582006b040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5836250640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475ce1d820 0x56475ce1fce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5836250640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475ce1d820 0x56475ce1fce0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 20 realm 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce20840 con 0x56475ce1d820 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.558+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce21110 con 0x56475ce1d820 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5839d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5839d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475ce22210 0x56475ce24600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce24bc0 con 0x56475ce22210 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.559+0000 7f5835a4f640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475ce22210 0x56475ce24600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f5835a4f640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475ce22210 0x56475ce24600 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f5839d2c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f5839d2c800 20 searching for the correct realm 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475ce26b70 0x56475ce29030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce29700 con 0x56475ce26b70 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f583524e640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475ce26b70 0x56475ce29030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f583524e640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475ce26b70 0x56475ce29030 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.560+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.561+0000 7f583524e640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f582008a040 0x7f582005f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.561+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce29700 con 0x7f582008a040 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.561+0000 7f5836250640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f582008a040 0x7f582005f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.561+0000 7f5836250640 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f582008a040 0x7f582005f420 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.561+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.561+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.561+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.561+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.562+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.562+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.562+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.562+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.562+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.562+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.562+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.562+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x7f582008a040 2024-09-19T11:13:54.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.563+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.563+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce26b70 2024-09-19T11:13:54.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.563+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.563+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.563+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.563+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.563+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.563+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.564+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.564+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x7f582008a040 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.564+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.564+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce26b70 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.564+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.564+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce26b70 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.564+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.564+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce26b70 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce26b70 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.565+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.566+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.566+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce26b70 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.566+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.566+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x7f582008a040 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.566+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.566+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.566+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.566+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.567+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.567+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce26b70 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.567+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.567+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.567+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.567+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x7f582008a040 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.567+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.568+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce26b70 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.568+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.568+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce22210 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.568+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.568+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x56475ce1d820 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.568+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.568+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x56475ce214b0 con 0x7f582008a040 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.568+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:54.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce25480 con 0x56475ce1d820 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce25480 con 0x56475ce1d820 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce25480 con 0x56475ce26b70 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 zone default found 2024-09-19T11:13:54.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 4 Realm: () 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 zonegroup default 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.569+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce25d60 con 0x56475ce22210 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2b670 con 0x56475ce26b70 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2baa0 con 0x56475ce26b70 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 20 started sync module instance, tier type = 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.570+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2aa10 con 0x7f582008a040 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.571+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.571+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94864501026624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2aa10 con 0x7f582008a040 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.571+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2c550 con 0x56475ce1d820 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.572+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.572+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94864501030976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2c550 con 0x56475ce1d820 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.572+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94864501026624] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.572+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2a5a0 con 0x56475ce26b70 2024-09-19T11:13:54.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.573+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94864501030976] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.574+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.574+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94864501033328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2d4c0 con 0x56475ce26b70 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.574+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2de80 con 0x7f582008a040 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.575+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.575+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94864501033328] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.575+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94864501038000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2e640 con 0x7f582008a040 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.575+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2d010 con 0x56475ce1d820 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.576+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94864501038000] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.576+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.576+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94864501039248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2d010 con 0x56475ce1d820 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.576+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2f700 con 0x56475ce22210 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.577+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.577+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94864501039248] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.577+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94864501043792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2ff50 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.577+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce2ec30 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.578+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94864501043792] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.578+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.578+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94864501048416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce30d30 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.578+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce31580 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94864501048416] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'78 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94864501049952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce31470 con 0x56475ce22210 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5839d2c800 20 add_watcher() i=0 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5839d2c800 20 add_watcher() i=1 2024-09-19T11:13:54.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5839d2c800 20 add_watcher() i=2 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5839d2c800 20 add_watcher() i=3 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5839d2c800 20 add_watcher() i=4 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5839d2c800 20 add_watcher() i=5 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.579+0000 7f5839d2c800 20 add_watcher() i=6 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.580+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94864501049952] v35'79 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.580+0000 7f5839d2c800 20 add_watcher() i=7 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.580+0000 7f5839d2c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.580+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce34980 con 0x56475ce1d820 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.580+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.581+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94864501051136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce31ed0 con 0x56475ce1d820 2024-09-19T11:13:54.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.581+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94864501051136] v35'86 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.581+0000 7f56e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5839d2c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:54.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5839d2c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:54.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5839d2c800 5 note: GC not initialized 2024-09-19T11:13:54.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f56e67fc640 20 reqs_thread_entry: start 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5839d2c800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5839d2c800 20 Filter name: none 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5657fff640 20 reqs_thread_entry: start 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5839d2c800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5839d2c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.582+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce67880 con 0x56475ce1d820 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.583+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~556 out=556b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+679 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.583+0000 7f5839d2c800 20 rados_obj.operate() r=0 bl.length=556 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.583+0000 7f5839d2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.583+0000 7f5839d2c800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.583+0000 7f5839d2c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.583+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce6de40 con 0x56475ce1d820 2024-09-19T11:13:54.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v35'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5839d2c800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5839d2c800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5839d2c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94864501299328 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce69560 con 0x56475ce1d820 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94864501039248 notify 150323855370 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f5828018db0 con 0x56475ce1d820 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f57197fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 94864501039248 notifier 4428 bl.length()=567 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f57197fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f57197fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(64 notify.4 [notify cookie 94864501299328 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f57197fa640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f56f8003ea0 con 0x56475ce1d820 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== watch-notify(notify_complete (2) cookie 94864501299328 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5828026410 con 0x56475ce1d820 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.584+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 8.2 8:45671577:users.swift::foo%3afoo2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce6d880 con 0x7f582008a040 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 foo:foo2 [delete] v35'2 uv2 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5839d2c800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.swift:foo:foo2, ofs0, ns] 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94864501299328 in=171b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x56475ce690b0 con 0x7f582008a040 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== watch-notify(notify (1) cookie 94864501026624 notify 150323855365 ret 0) ==== 201+0+0 (crc 0 0 0) 0x7f5828026410 con 0x7f582008a040 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5718ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 94864501026624 notifier 4428 bl.length()=159 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(67 notify.0 [notify cookie 94864501299328 out=8b] v0'0 uv78 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5718ff9640 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f56600032c0 con 0x7f582008a040 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== watch-notify(notify_complete (2) cookie 94864501299328 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5828040020 con 0x7f582008a040 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.586+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(68 notify.0 [notify-ack] v0'0 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.598 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.587+0000 7f56e77fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.587+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94864501051136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x56475ce1d820 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.588+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(69 data_loggenerations_metadata [watch unwatch cookie 94864501051136] v35'87 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.588+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94864501026624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x7f582008a040 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.589+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(70 notify.0 [watch unwatch cookie 94864501026624] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.589+0000 7f5839d2c800 20 remove_watcher() i=0 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.589+0000 7f5839d2c800 2 removed watcher, disabling cache 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.589+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94864501030976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x56475ce1d820 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.590+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(71 notify.1 [watch unwatch cookie 94864501030976] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.590+0000 7f5839d2c800 20 remove_watcher() i=1 2024-09-19T11:13:54.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.590+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:72 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94864501033328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x56475ce26b70 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.591+0000 7f583524e640 1 -- 172.21.15.102:0/1213369662 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(72 notify.2 [watch unwatch cookie 94864501033328] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5820051070 con 0x56475ce26b70 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.591+0000 7f5839d2c800 20 remove_watcher() i=2 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.591+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:73 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94864501038000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x7f582008a040 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.592+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(73 notify.3 [watch unwatch cookie 94864501038000] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x7f582008a040 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.592+0000 7f5839d2c800 20 remove_watcher() i=3 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.592+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94864501039248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x56475ce1d820 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.593+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(74 notify.4 [watch unwatch cookie 94864501039248] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f582800a4d0 con 0x56475ce1d820 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.593+0000 7f5839d2c800 20 remove_watcher() i=4 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.593+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94864501043792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x56475ce22210 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.594+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(75 notify.5 [watch unwatch cookie 94864501043792] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.594+0000 7f5839d2c800 20 remove_watcher() i=5 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.594+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94864501048416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x56475ce22210 2024-09-19T11:13:54.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.595+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(76 notify.6 [watch unwatch cookie 94864501048416] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.595+0000 7f5839d2c800 20 remove_watcher() i=6 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.595+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94864501049952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x56475ce65720 con 0x56475ce22210 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5835a4f640 1 -- 172.21.15.102:0/1213369662 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(77 notify.7 [watch unwatch cookie 94864501049952] v35'80 uv78 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f583006e020 con 0x56475ce22210 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 20 remove_watcher() i=7 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475ce22210 msgr2=0x56475ce24600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475ce22210 0x56475ce24600 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475ce1d820 msgr2=0x56475ce1fce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475ce1d820 0x56475ce1fce0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f582008a040 msgr2=0x7f582005f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f582008a040 0x7f582005f420 crc :-1 s=READY pgs=35 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475ce26b70 msgr2=0x56475ce29030 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475ce26b70 0x56475ce29030 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f570003cfb0 msgr2=0x7f570003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f570003cfb0 0x7f570003f470 secure :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0x56475cdf0e00 tx=0x7f582006b040 comp rx=0 tx=0).stop 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 msgr2=0x56475ce122c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1213369662 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475ce0ade0 0x56475ce122c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f583000bbe0 tx=0x7f583003b350 comp rx=0 tx=0).stop 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 reap_dead start 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5836250640 1 -- 172.21.15.102:0/1213369662 reap_dead start 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 shutdown_connections 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 >> 172.21.15.102:0/1213369662 conn(0x56475ce071e0 msgr2=0x56475ce053f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 shutdown_connections 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.596+0000 7f5839d2c800 1 -- 172.21.15.102:0/1213369662 wait complete. 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/2314884821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571003d000 msgr2=0x7f571003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/2314884821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571003d000 0x7f571003f4c0 secure :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0x56475cde8150 tx=0x7f5820005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/2314884821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cdfe700 msgr2=0x56475cdfeb20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/2314884821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cdfe700 0x56475cdfeb20 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f5830001580 tx=0x7f58300449c0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/2314884821 shutdown_connections 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/2314884821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571003d000 0x7f571003f4c0 unknown :-1 s=CLOSED pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/2314884821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cdfe700 0x56475cdfeb20 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/2314884821 >> 172.21.15.102:0/2314884821 conn(0x56475cdf2ab0 msgr2=0x56475cdf2e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/2314884821 shutdown_connections 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/2314884821 wait complete. 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475cde9fd0 msgr2=0x56475cdec3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56475cde9fd0 0x56475cdec3c0 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475cde1e00 msgr2=0x56475cde7740 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56475cde1e00 0x56475cde7740 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475cdeded0 msgr2=0x56475cdf02c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56475cdeded0 0x56475cdf02c0 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571c03d000 msgr2=0x7f571c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f571c03d000 0x7f571c03f4c0 secure :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0x7f5820057000 tx=0x7f5820052000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5c630 msgr2=0x56475cde00f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 --2- 172.21.15.102:0/1778837551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56475cc5c630 0x56475cde00f0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f5830000fb0 tx=0x7f5830000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5836250640 1 -- 172.21.15.102:0/1778837551 reap_dead start 2024-09-19T11:13:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 shutdown_connections 2024-09-19T11:13:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 >> 172.21.15.102:0/1778837551 conn(0x56475cce1c80 msgr2=0x56475cdd9860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 shutdown_connections 2024-09-19T11:13:54.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.597+0000 7f5839d2c800 1 -- 172.21.15.102:0/1778837551 wait complete. 2024-09-19T11:13:54.610 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:54.610 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-19T11:13:54.610 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-19T11:13:54.610 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-19T11:13:54.654 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:54.654 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.654+0000 7f47bc326800 1 Processor -- start 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.654+0000 7f47bc326800 1 -- start start 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.654+0000 7f47bc326800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x556ed3395d30 0x556ed3396130 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.654+0000 7f47bc326800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556ed3397230 con 0x556ed3396670 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.654+0000 7f47bc326800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x556ed32227d0 con 0x556ed3395d30 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.655+0000 7f47b7fd9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x556ed3395d30 0x556ed3396130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.655+0000 7f47af7d8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x556ed3396670 0x556ed3396b20 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52400/0 (socket says 172.21.15.102:52400) 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.655+0000 7f47af7d8640 1 -- 172.21.15.102:0/902382769 learned_addr learned my addr 172.21.15.102:0/902382769 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:54.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.655+0000 7f47b7fd9640 1 -- 172.21.15.102:0/902382769 >> v1:172.21.15.37:6789/0 conn(0x556ed3396670 legacy=0x556ed3396b20 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.655+0000 7f47b7fd9640 1 -- 172.21.15.102:0/902382769 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed3397400 con 0x556ed3395d30 2024-09-19T11:13:54.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/902382769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3396130 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f47a800a470 tx=0x7f47a8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eb5e97df712602b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47b77d8640 1 -- 172.21.15.102:0/902382769 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a8053570 con 0x556ed3395d30 2024-09-19T11:13:54.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47b77d8640 1 -- 172.21.15.102:0/902382769 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8058070 con 0x556ed3395d30 2024-09-19T11:13:54.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47b77d8640 1 -- 172.21.15.102:0/902382769 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a8053880 con 0x556ed3395d30 2024-09-19T11:13:54.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47bc326800 1 -- 172.21.15.102:0/902382769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 msgr2=0x556ed3396130 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47bc326800 1 --2- 172.21.15.102:0/902382769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3396130 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f47a800a470 tx=0x7f47a8045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:54.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47bc326800 1 -- 172.21.15.102:0/902382769 shutdown_connections 2024-09-19T11:13:54.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47bc326800 1 --2- 172.21.15.102:0/902382769 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3396130 unknown :-1 s=CLOSED pgs=340 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47bc326800 1 -- 172.21.15.102:0/902382769 >> 172.21.15.102:0/902382769 conn(0x556ed3391a60 msgr2=0x556ed3393ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47bc326800 1 -- 172.21.15.102:0/902382769 shutdown_connections 2024-09-19T11:13:54.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.657+0000 7f47bc326800 1 -- 172.21.15.102:0/902382769 wait complete. 2024-09-19T11:13:54.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.671+0000 7f47bc326800 1 Processor -- start 2024-09-19T11:13:54.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.671+0000 7f47bc326800 1 -- start start 2024-09-19T11:13:54.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.671+0000 7f47bc326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3489520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.671+0000 7f47bc326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ed322fdd0 con 0x556ed3395d30 2024-09-19T11:13:54.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.671+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3489520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.671+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3489520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43586/0 (socket says 172.21.15.102:43586) 2024-09-19T11:13:54.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.671+0000 7f47b7fd9640 1 -- 172.21.15.102:0/2342093030 learned_addr learned my addr 172.21.15.102:0/2342093030 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.672+0000 7f47b7fd9640 1 -- 172.21.15.102:0/2342093030 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed3489b10 con 0x556ed3395d30 2024-09-19T11:13:54.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.672+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/2342093030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3489520 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47a8025c20 tx=0x7f47a8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34b2497b7724298d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.672+0000 7f46a5e0b640 1 -- 172.21.15.102:0/2342093030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a805c580 con 0x556ed3395d30 2024-09-19T11:13:54.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.672+0000 7f46a5e0b640 1 -- 172.21.15.102:0/2342093030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8063030 con 0x556ed3395d30 2024-09-19T11:13:54.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.672+0000 7f46a5e0b640 1 -- 172.21.15.102:0/2342093030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a805c850 con 0x556ed3395d30 2024-09-19T11:13:54.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 -- 172.21.15.102:0/2342093030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 msgr2=0x556ed3489520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 --2- 172.21.15.102:0/2342093030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3489520 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f47a8025c20 tx=0x7f47a8051000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 -- 172.21.15.102:0/2342093030 shutdown_connections 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 --2- 172.21.15.102:0/2342093030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3489520 unknown :-1 s=CLOSED pgs=341 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 -- 172.21.15.102:0/2342093030 >> 172.21.15.102:0/2342093030 conn(0x556ed3391a60 msgr2=0x556ed3484ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 -- 172.21.15.102:0/2342093030 shutdown_connections 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 -- 172.21.15.102:0/2342093030 wait complete. 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 Processor -- start 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 -- start start 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3490f60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47bc326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ed3397990 con 0x556ed3395d30 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3490f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3490f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43598/0 (socket says 172.21.15.102:43598) 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.673+0000 7f47b7fd9640 1 -- 172.21.15.102:0/22032523 learned_addr learned my addr 172.21.15.102:0/22032523 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.674+0000 7f47b7fd9640 1 -- 172.21.15.102:0/22032523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed34914c0 con 0x556ed3395d30 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.674+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3490f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f47a8045f50 tx=0x7f47a8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.674+0000 7f469ffff640 1 -- 172.21.15.102:0/22032523 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a8054ad0 con 0x556ed3395d30 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.674+0000 7f469ffff640 1 -- 172.21.15.102:0/22032523 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8054c70 con 0x556ed3395d30 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.674+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ed3491750 con 0x556ed3395d30 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.674+0000 7f469ffff640 1 -- 172.21.15.102:0/22032523 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a8068420 con 0x556ed3395d30 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.674+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ed3492150 con 0x556ed3395d30 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.675+0000 7f469ffff640 1 -- 172.21.15.102:0/22032523 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f47a80685c0 con 0x556ed3395d30 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.675+0000 7f469ffff640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f46a003cfb0 0x7f46a003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.675+0000 7f469ffff640 1 -- 172.21.15.102:0/22032523 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f47a8070030 con 0x556ed3395d30 2024-09-19T11:13:54.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.675+0000 7f47af7d8640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f46a003cfb0 0x7f46a003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.675+0000 7f47bc326800 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed3396670 0x556ed34985b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.675+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed3498af0 con 0x556ed3396670 2024-09-19T11:13:54.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.675+0000 7f47b87da640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed3396670 0x556ed34985b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.676+0000 7f47af7d8640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f46a003cfb0 0x7f46a003f470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f47a0001d70 tx=0x7f47a00012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.676+0000 7f47b87da640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed3396670 0x556ed34985b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.676+0000 7f47b87da640 1 -- 172.21.15.102:0/22032523 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed3396670 2024-09-19T11:13:54.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.676+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed3498e90 con 0x556ed3396670 2024-09-19T11:13:54.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.676+0000 7f47b87da640 1 -- 172.21.15.102:0/22032523 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed3396670 2024-09-19T11:13:54.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.676+0000 7f47bc326800 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed349a9d0 0x556ed349ce40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.676+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed349d5d0 con 0x556ed349a9d0 2024-09-19T11:13:54.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.677+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed349a9d0 0x556ed349ce40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.677+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed349a9d0 0x556ed349ce40 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.677+0000 7f47b7fd9640 1 -- 172.21.15.102:0/22032523 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f47a8051070 con 0x556ed349a9d0 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.677+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34996e0 con 0x556ed3396670 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.678+0000 7f47b87da640 1 -- 172.21.15.102:0/22032523 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed3396670 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.678+0000 7f47bc326800 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed349ea30 0x556ed34a0e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.678+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34a1560 con 0x556ed349ea30 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.678+0000 7f47af7d8640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed349ea30 0x556ed34a0e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.678+0000 7f47af7d8640 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed349ea30 0x556ed34a0e20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.678+0000 7f47af7d8640 1 -- 172.21.15.102:0/22032523 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f47a0009050 con 0x556ed349ea30 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.679+0000 7f47bc326800 1 Processor -- start 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.679+0000 7f47bc326800 1 -- start start 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.679+0000 7f47bc326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34af2a0 0x556ed34af6c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.679+0000 7f47bc326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ed328e4a0 con 0x556ed34af2a0 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.679+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34af2a0 0x556ed34af6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.679+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34af2a0 0x556ed34af6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43608/0 (socket says 172.21.15.102:43608) 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.679+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1803320576 learned_addr learned my addr 172.21.15.102:0/1803320576 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.679+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1803320576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed34afd00 con 0x556ed34af2a0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.680+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/1803320576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34af2a0 0x556ed34af6c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f47a807dfb0 tx=0x7f47a805ef00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.680+0000 7f469d7fa640 1 -- 172.21.15.102:0/1803320576 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a805e420 con 0x556ed34af2a0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.680+0000 7f469d7fa640 1 -- 172.21.15.102:0/1803320576 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a8093040 con 0x556ed34af2a0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.680+0000 7f469d7fa640 1 -- 172.21.15.102:0/1803320576 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a805e5c0 con 0x556ed34af2a0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.680+0000 7f47bc326800 1 -- 172.21.15.102:0/1803320576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ed34b0530 con 0x556ed34af2a0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.680+0000 7f47bc326800 1 -- 172.21.15.102:0/1803320576 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ed34b0ad0 con 0x556ed34af2a0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.680+0000 7f469d7fa640 1 -- 172.21.15.102:0/1803320576 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f47a8000ed0 con 0x556ed34af2a0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f469d7fa640 1 --2- 172.21.15.102:0/1803320576 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f469003d000 0x7f469003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f469d7fa640 1 -- 172.21.15.102:0/1803320576 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f47a8089070 con 0x556ed34af2a0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47af7d8640 1 --2- 172.21.15.102:0/1803320576 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f469003d000 0x7f469003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47bc326800 1 Processor -- start 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47af7d8640 1 --2- 172.21.15.102:0/1803320576 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f469003d000 0x7f469003f4c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47a000bf40 tx=0x7f47a000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47bc326800 1 -- start start 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47bc326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34bbf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47bc326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ed3489ee0 con 0x556ed34bbb80 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34bbf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34bbf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43620/0 (socket says 172.21.15.102:43620) 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.681+0000 7f47b7fd9640 1 -- 172.21.15.102:0/726283831 learned_addr learned my addr 172.21.15.102:0/726283831 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47b7fd9640 1 -- 172.21.15.102:0/726283831 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed34bc550 con 0x556ed34bbb80 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/726283831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34bbf60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f47a8082870 tx=0x7f47a8082ce0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=629d5ac706f1bfec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f4696ffd640 1 -- 172.21.15.102:0/726283831 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a807d610 con 0x556ed34bbb80 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f4696ffd640 1 -- 172.21.15.102:0/726283831 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a80a7070 con 0x556ed34bbb80 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f4696ffd640 1 -- 172.21.15.102:0/726283831 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a808f5a0 con 0x556ed34bbb80 2024-09-19T11:13:54.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47bc326800 1 -- 172.21.15.102:0/726283831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 msgr2=0x556ed34bbf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47bc326800 1 --2- 172.21.15.102:0/726283831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34bbf60 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f47a8082870 tx=0x7f47a8082ce0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47bc326800 1 -- 172.21.15.102:0/726283831 shutdown_connections 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47bc326800 1 --2- 172.21.15.102:0/726283831 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34bbf60 unknown :-1 s=CLOSED pgs=344 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47bc326800 1 -- 172.21.15.102:0/726283831 >> 172.21.15.102:0/726283831 conn(0x556ed34b7f80 msgr2=0x556ed34b61c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47bc326800 1 -- 172.21.15.102:0/726283831 shutdown_connections 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.682+0000 7f47bc326800 1 -- 172.21.15.102:0/726283831 wait complete. 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.683+0000 7f47bc326800 1 Processor -- start 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.683+0000 7f47bc326800 1 -- start start 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.683+0000 7f47bc326800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34c3060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.683+0000 7f47bc326800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556ed34bc9e0 con 0x556ed34bbb80 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.683+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34c3060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.683+0000 7f47b7fd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34c3060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43626/0 (socket says 172.21.15.102:43626) 2024-09-19T11:13:54.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.683+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 learned_addr learned my addr 172.21.15.102:0/1914104617 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.683+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556ed34c35c0 con 0x556ed34bbb80 2024-09-19T11:13:54.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.684+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34c3060 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f47a8095520 tx=0x7f47a8086f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.684+0000 7f46957fa640 1 -- 172.21.15.102:0/1914104617 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a80bc070 con 0x556ed34bbb80 2024-09-19T11:13:54.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.684+0000 7f46957fa640 1 -- 172.21.15.102:0/1914104617 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f47a805e8d0 con 0x556ed34bbb80 2024-09-19T11:13:54.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.684+0000 7f46957fa640 1 -- 172.21.15.102:0/1914104617 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f47a807d990 con 0x556ed34bbb80 2024-09-19T11:13:54.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.684+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556ed34c35c0 con 0x556ed34bbb80 2024-09-19T11:13:54.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.684+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556ed34c35c0 con 0x556ed34bbb80 2024-09-19T11:13:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.684+0000 7f46957fa640 1 -- 172.21.15.102:0/1914104617 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f47a80bf070 con 0x556ed34bbb80 2024-09-19T11:13:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f46957fa640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f468003d000 0x7f468003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f46957fa640 1 -- 172.21.15.102:0/1914104617 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f47a80c2ca0 con 0x556ed34bbb80 2024-09-19T11:13:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f47af7d8640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f468003d000 0x7f468003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed34ce4d0 0x556ed34d0990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d10e0 con 0x556ed34ce4d0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f47b87da640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed34ce4d0 0x556ed34d0990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f47af7d8640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f468003d000 0x7f468003f4c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f47a000c010 tx=0x7f47a0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.685+0000 7f47b87da640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed34ce4d0 0x556ed34d0990 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 realm 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d14f0 con 0x556ed34ce4d0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:54.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d1dc0 con 0x556ed34ce4d0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed34d2c50 0x556ed34d5040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.686+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d5780 con 0x556ed34d2c50 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.687+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed34d2c50 0x556ed34d5040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.687+0000 7f47b7fd9640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed34d2c50 0x556ed34d5040 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.687+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47bc326800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47bc326800 20 searching for the correct realm 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed34d7820 0x556ed34d9ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34da3b0 con 0x556ed34d7820 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47af7d8640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed34d7820 0x556ed34d9ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47af7d8640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed34d7820 0x556ed34d9ce0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47af7d8640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f47a0037040 0x7f47a0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34da3b0 con 0x7f47a0037040 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.688+0000 7f47b87da640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f47a0037040 0x7f47a0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b87da640 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f47a0037040 0x7f47a0036410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.689+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.690+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.690+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.690+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.690+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x7f47a0037040 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.690+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.690+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d7820 2024-09-19T11:13:54.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.690+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.690+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.691+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.691+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.691+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.691+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.691+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.691+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x7f47a0037040 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.691+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.691+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d7820 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.692+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.692+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d7820 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.692+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.692+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.692+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.692+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d7820 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.692+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.692+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d7820 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d7820 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.693+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x7f47a0037040 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d7820 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.694+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.695+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.695+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x7f47a0037040 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.695+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.695+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d7820 2024-09-19T11:13:54.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.695+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.695+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34d2c50 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x556ed34ce4d0 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d2160 con 0x7f47a0037040 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:54.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d6120 con 0x556ed34ce4d0 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d6120 con 0x556ed34ce4d0 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.696+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d60d0 con 0x556ed34d7820 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 20 zone default found 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 4 Realm: () 2024-09-19T11:13:54.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 20 zonegroup default 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34d69c0 con 0x556ed34d2c50 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dc220 con 0x556ed34d7820 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.697+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dc5c0 con 0x556ed34d7820 2024-09-19T11:13:54.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.698+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.698+0000 7f47bc326800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.698+0000 7f47bc326800 20 started sync module instance, tier type = 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.698+0000 7f47bc326800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.698+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34db6c0 con 0x7f47a0037040 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.699+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.699+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93934479850464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dca00 con 0x7f47a0037040 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.699+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dd250 con 0x556ed34ce4d0 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.700+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.700+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93934479850464] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.700+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93934479854352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dd5c0 con 0x556ed34ce4d0 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.700+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34db250 con 0x556ed34d7820 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.701+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.701+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93934479858608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34de480 con 0x556ed34d7820 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.701+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34def30 con 0x7f47a0037040 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.701+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93934479854352] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.702+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.702+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93934479862288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34df320 con 0x7f47a0037040 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.702+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dfce0 con 0x556ed34ce4d0 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.702+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93934479858608] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.703+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.703+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93934479859664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dfce0 con 0x556ed34ce4d0 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.703+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34e06f0 con 0x556ed34d2c50 2024-09-19T11:13:54.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.703+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93934479862288] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.704+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93934479859664] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.704+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.704+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93934479855632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dfce0 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.704+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34e0f90 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.705+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.705+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93934479871168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34e1710 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.705+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34e2230 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.705+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93934479855632] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93934479871168] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'81 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93934479875328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34e1160 con 0x556ed34d2c50 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47bc326800 20 add_watcher() i=0 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47bc326800 20 add_watcher() i=1 2024-09-19T11:13:54.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47bc326800 20 add_watcher() i=2 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47bc326800 20 add_watcher() i=3 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47bc326800 20 add_watcher() i=4 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47bc326800 20 add_watcher() i=5 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.706+0000 7f47bc326800 20 add_watcher() i=6 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.707+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93934479875328] v35'82 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.707+0000 7f47bc326800 20 add_watcher() i=7 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.707+0000 7f47bc326800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.707+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed34e5220 con 0x556ed34ce4d0 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.707+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.707+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93934479865904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34e26d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.708+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93934479865904] v35'88 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.708+0000 7f466dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.708+0000 7f47bc326800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:54.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.708+0000 7f47bc326800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.708+0000 7f47bc326800 5 note: GC not initialized 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.708+0000 7f466cfe1640 20 reqs_thread_entry: start 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47bc326800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47bc326800 20 Filter name: none 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f45e67fc640 20 reqs_thread_entry: start 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed3517b80 con 0x556ed34ce4d0 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47bc326800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47bc326800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed3518440 con 0x556ed34ce4d0 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.709+0000 7f47bc326800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.710+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x556ed3519450 con 0x7f47a0037040 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.710+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.711+0000 7f466dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.711+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93934479865904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed3515aa0 con 0x556ed34ce4d0 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.711+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 93934479865904] v35'89 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.712+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93934479850464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed3515aa0 con 0x7f47a0037040 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.712+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 93934479850464] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.713+0000 7f47bc326800 20 remove_watcher() i=0 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.713+0000 7f47bc326800 2 removed watcher, disabling cache 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.713+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93934479854352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed3515aa0 con 0x556ed34ce4d0 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.714+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 93934479854352] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.714+0000 7f47bc326800 20 remove_watcher() i=1 2024-09-19T11:13:54.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.714+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93934479858608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed3515aa0 con 0x556ed34d7820 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.715+0000 7f47af7d8640 1 -- 172.21.15.102:0/1914104617 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 93934479858608] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a0009050 con 0x556ed34d7820 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.715+0000 7f47bc326800 20 remove_watcher() i=2 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.715+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93934479862288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34ddbb0 con 0x7f47a0037040 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.716+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 93934479862288] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x7f47a0037040 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.716+0000 7f47bc326800 20 remove_watcher() i=3 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.716+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93934479859664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dea10 con 0x556ed34ce4d0 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.717+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 93934479859664] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47b000a4d0 con 0x556ed34ce4d0 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.717+0000 7f47bc326800 20 remove_watcher() i=4 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.717+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93934479855632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dea10 con 0x556ed34d2c50 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.718+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 93934479855632] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.718+0000 7f47bc326800 20 remove_watcher() i=5 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.718+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93934479871168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34dea10 con 0x556ed34d2c50 2024-09-19T11:13:54.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.719+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 93934479871168] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.719+0000 7f47bc326800 20 remove_watcher() i=6 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.719+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93934479875328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x556ed34e0cc0 con 0x556ed34d2c50 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47b7fd9640 1 -- 172.21.15.102:0/1914104617 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 93934479875328] v35'83 uv81 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f47a80be030 con 0x556ed34d2c50 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 20 remove_watcher() i=7 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed34d2c50 msgr2=0x556ed34d5040 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed34d2c50 0x556ed34d5040 crc :-1 s=READY pgs=62 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed34ce4d0 msgr2=0x556ed34d0990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed34ce4d0 0x556ed34d0990 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f47a0037040 msgr2=0x7f47a0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f47a0037040 0x7f47a0036410 crc :-1 s=READY pgs=36 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed34d7820 msgr2=0x556ed34d9ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed34d7820 0x556ed34d9ce0 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f468003d000 msgr2=0x7f468003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f468003d000 0x7f468003f4c0 secure :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0x7f47a000c010 tx=0x7f47a0010000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 msgr2=0x556ed34c3060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 --2- 172.21.15.102:0/1914104617 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34bbb80 0x556ed34c3060 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x7f47a8095520 tx=0x7f47a8086f50 comp rx=0 tx=0).stop 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 reap_dead start 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47b87da640 1 -- 172.21.15.102:0/1914104617 reap_dead start 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 shutdown_connections 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.720+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 >> 172.21.15.102:0/1914104617 conn(0x556ed34b7f80 msgr2=0x556ed34b6190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 shutdown_connections 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/1914104617 wait complete. 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/1803320576 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f469003d000 msgr2=0x7f469003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/1803320576 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f469003d000 0x7f469003f4c0 secure :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0x7f47a000bf40 tx=0x7f47a000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/1803320576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34af2a0 msgr2=0x556ed34af6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/1803320576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34af2a0 0x556ed34af6c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f47a807dfb0 tx=0x7f47a805ef00 comp rx=0 tx=0).stop 2024-09-19T11:13:54.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/1803320576 shutdown_connections 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/1803320576 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f469003d000 0x7f469003f4c0 unknown :-1 s=CLOSED pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/1803320576 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed34af2a0 0x556ed34af6c0 unknown :-1 s=CLOSED pgs=343 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/1803320576 >> 172.21.15.102:0/1803320576 conn(0x556ed34a3650 msgr2=0x556ed34a3a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/1803320576 shutdown_connections 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/1803320576 wait complete. 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed349a9d0 msgr2=0x556ed349ce40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556ed349a9d0 0x556ed349ce40 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed3396670 msgr2=0x556ed34985b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556ed3396670 0x556ed34985b0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed349ea30 msgr2=0x556ed34a0e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556ed349ea30 0x556ed34a0e20 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f46a003cfb0 msgr2=0x7f46a003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f46a003cfb0 0x7f46a003f470 secure :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0x7f47a0001d70 tx=0x7f47a00012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 msgr2=0x556ed3490f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 --2- 172.21.15.102:0/22032523 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556ed3395d30 0x556ed3490f60 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x7f47a8045f50 tx=0x7f47a8002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47b87da640 1 -- 172.21.15.102:0/22032523 reap_dead start 2024-09-19T11:13:54.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 shutdown_connections 2024-09-19T11:13:54.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 >> 172.21.15.102:0/22032523 conn(0x556ed3391a60 msgr2=0x556ed3483690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.721+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 shutdown_connections 2024-09-19T11:13:54.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.722+0000 7f47bc326800 1 -- 172.21.15.102:0/22032523 wait complete. 2024-09-19T11:13:54.734 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-19T11:13:54.734 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T11:13:54.734 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-19T11:13:54.734 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-19T11:13:54.735 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-19T11:13:54.821 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:54.822 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:54.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.821+0000 7f25cae98800 1 Processor -- start 2024-09-19T11:13:54.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.821+0000 7f25cae98800 1 -- start start 2024-09-19T11:13:54.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25cae98800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55cf193a2b60 0x55cf193a8700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25cae98800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cf193a1f40 con 0x55cf193a1890 2024-09-19T11:13:54.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25cae98800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55cf1922c7d0 con 0x55cf193a2b60 2024-09-19T11:13:54.823 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25c8181640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55cf193a2b60 0x55cf193a8700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25c8181640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55cf193a2b60 0x55cf193a8700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43628/0 (socket says 172.21.15.102:43628) 2024-09-19T11:13:54.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25c8181640 1 -- 172.21.15.102:0/369508872 learned_addr learned my addr 172.21.15.102:0/369508872 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25c8982640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55cf193a1890 0x55cf193a2450 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52414/0 (socket says 172.21.15.102:52414) 2024-09-19T11:13:54.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25c8181640 1 -- 172.21.15.102:0/369508872 >> v1:172.21.15.37:6789/0 conn(0x55cf193a1890 legacy=0x55cf193a2450 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.822+0000 7f25c8181640 1 -- 172.21.15.102:0/369508872 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf193a3010 con 0x55cf193a2b60 2024-09-19T11:13:54.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.824+0000 7f25c8181640 1 --2- 172.21.15.102:0/369508872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a2b60 0x55cf193a8700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00a520 tx=0x7f25bc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b92dafdf6837003e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.824+0000 7f25c7980640 1 -- 172.21.15.102:0/369508872 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25bc055070 con 0x55cf193a2b60 2024-09-19T11:13:54.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.824+0000 7f25c7980640 1 -- 172.21.15.102:0/369508872 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25bc0515b0 con 0x55cf193a2b60 2024-09-19T11:13:54.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.824+0000 7f25c7980640 1 -- 172.21.15.102:0/369508872 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25bc0518d0 con 0x55cf193a2b60 2024-09-19T11:13:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.825+0000 7f25cae98800 1 -- 172.21.15.102:0/369508872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a2b60 msgr2=0x55cf193a8700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.825+0000 7f25cae98800 1 --2- 172.21.15.102:0/369508872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a2b60 0x55cf193a8700 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7f25bc00a520 tx=0x7f25bc045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.825+0000 7f25cae98800 1 -- 172.21.15.102:0/369508872 shutdown_connections 2024-09-19T11:13:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.825+0000 7f25cae98800 1 --2- 172.21.15.102:0/369508872 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a2b60 0x55cf193a8700 unknown :-1 s=CLOSED pgs=347 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.825+0000 7f25cae98800 1 -- 172.21.15.102:0/369508872 >> 172.21.15.102:0/369508872 conn(0x55cf1939cc60 msgr2=0x55cf1939f0c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.825+0000 7f25cae98800 1 -- 172.21.15.102:0/369508872 shutdown_connections 2024-09-19T11:13:54.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.825+0000 7f25cae98800 1 -- 172.21.15.102:0/369508872 wait complete. 2024-09-19T11:13:54.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.838+0000 7f25cae98800 1 Processor -- start 2024-09-19T11:13:54.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.838+0000 7f25cae98800 1 -- start start 2024-09-19T11:13:54.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.838+0000 7f25cae98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf194912e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.838+0000 7f25cae98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cf19239dd0 con 0x55cf193a1890 2024-09-19T11:13:54.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.839+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf194912e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.839+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf194912e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43640/0 (socket says 172.21.15.102:43640) 2024-09-19T11:13:54.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.839+0000 7f25c8982640 1 -- 172.21.15.102:0/1033015651 learned_addr learned my addr 172.21.15.102:0/1033015651 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.839+0000 7f25c8982640 1 -- 172.21.15.102:0/1033015651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf194918d0 con 0x55cf193a1890 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.839+0000 7f25c8982640 1 --2- 172.21.15.102:0/1033015651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf194912e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f25b800b260 tx=0x7f25b800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=17ca4114dfc4e920 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.839+0000 7f24b6e0d640 1 -- 172.21.15.102:0/1033015651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b800be60 con 0x55cf193a1890 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.839+0000 7f24b6e0d640 1 -- 172.21.15.102:0/1033015651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b8006070 con 0x55cf193a1890 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.839+0000 7f24b6e0d640 1 -- 172.21.15.102:0/1033015651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b800e710 con 0x55cf193a1890 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 -- 172.21.15.102:0/1033015651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 msgr2=0x55cf194912e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 --2- 172.21.15.102:0/1033015651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf194912e0 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x7f25b800b260 tx=0x7f25b800b660 comp rx=0 tx=0).stop 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 -- 172.21.15.102:0/1033015651 shutdown_connections 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 --2- 172.21.15.102:0/1033015651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf194912e0 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 -- 172.21.15.102:0/1033015651 >> 172.21.15.102:0/1033015651 conn(0x55cf1939cc60 msgr2=0x55cf1948cc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 -- 172.21.15.102:0/1033015651 shutdown_connections 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 -- 172.21.15.102:0/1033015651 wait complete. 2024-09-19T11:13:54.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 Processor -- start 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 -- start start 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.840+0000 7f25cae98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf19498e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f25cae98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cf193a8e50 con 0x55cf193a1890 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf19498e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf19498e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43642/0 (socket says 172.21.15.102:43642) 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f25c8982640 1 -- 172.21.15.102:0/4259529118 learned_addr learned my addr 172.21.15.102:0/4259529118 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f25c8982640 1 -- 172.21.15.102:0/4259529118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf19499390 con 0x55cf193a1890 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f25c8982640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf19498e30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55cf19492270 tx=0x7f25b8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f24b560a640 1 -- 172.21.15.102:0/4259529118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b800ee10 con 0x55cf193a1890 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f24b560a640 1 -- 172.21.15.102:0/4259529118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b800fa30 con 0x55cf193a1890 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf19499620 con 0x55cf193a1890 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f24b560a640 1 -- 172.21.15.102:0/4259529118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b800fd30 con 0x55cf193a1890 2024-09-19T11:13:54.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.841+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf1949a020 con 0x55cf193a1890 2024-09-19T11:13:54.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.842+0000 7f24b560a640 1 -- 172.21.15.102:0/4259529118 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f25b8017070 con 0x55cf193a1890 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.842+0000 7f24b560a640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24b003cfb0 0x7f24b003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.842+0000 7f24b560a640 1 -- 172.21.15.102:0/4259529118 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f25b8015020 con 0x55cf193a1890 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.842+0000 7f25c8181640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24b003cfb0 0x7f24b003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.843+0000 7f25cae98800 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf193a2b60 0x55cf194a0480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.843+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194a09c0 con 0x55cf193a2b60 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.843+0000 7f25c9183640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf193a2b60 0x55cf194a0480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.843+0000 7f25c8181640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24b003cfb0 0x7f24b003f470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25bc057000 tx=0x7f25bc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.843+0000 7f25c9183640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf193a2b60 0x55cf194a0480 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.843+0000 7f25c9183640 1 -- 172.21.15.102:0/4259529118 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf193a2b60 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.843+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194a0d60 con 0x55cf193a2b60 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.843+0000 7f25c9183640 1 -- 172.21.15.102:0/4259529118 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf193a2b60 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.844+0000 7f25cae98800 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194a2860 0x55cf194a4ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.844+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194a5470 con 0x55cf194a2860 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.844+0000 7f25c8982640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194a2860 0x55cf194a4ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.844+0000 7f25c8982640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194a2860 0x55cf194a4ce0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.845+0000 7f25c8982640 1 -- 172.21.15.102:0/4259529118 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25b802e070 con 0x55cf194a2860 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.845+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194a15b0 con 0x55cf193a2b60 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.845+0000 7f25c9183640 1 -- 172.21.15.102:0/4259529118 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf193a2b60 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.845+0000 7f25cae98800 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194a68d0 0x55cf194a8cc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.845+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194a9400 con 0x55cf194a68d0 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.845+0000 7f25c8181640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194a68d0 0x55cf194a8cc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.845+0000 7f25c8181640 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194a68d0 0x55cf194a8cc0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.845+0000 7f25c8181640 1 -- 172.21.15.102:0/4259529118 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194a68d0 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.846+0000 7f25cae98800 1 Processor -- start 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.846+0000 7f25cae98800 1 -- start start 2024-09-19T11:13:54.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.846+0000 7f25cae98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19317190 0x55cf19315a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.846+0000 7f25cae98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cf192984a0 con 0x55cf19317190 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.846+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19317190 0x55cf19315a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.846+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19317190 0x55cf19315a00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43654/0 (socket says 172.21.15.102:43654) 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.846+0000 7f25c8982640 1 -- 172.21.15.102:0/503330782 learned_addr learned my addr 172.21.15.102:0/503330782 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.847+0000 7f25c8982640 1 -- 172.21.15.102:0/503330782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf193176b0 con 0x55cf19317190 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.847+0000 7f25c8982640 1 --2- 172.21.15.102:0/503330782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19317190 0x55cf19315a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f25b80176b0 tx=0x7f25b80197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.847+0000 7f24ae7fc640 1 -- 172.21.15.102:0/503330782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b801a9f0 con 0x55cf19317190 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.847+0000 7f24ae7fc640 1 -- 172.21.15.102:0/503330782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b80450d0 con 0x55cf19317190 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.847+0000 7f25cae98800 1 -- 172.21.15.102:0/503330782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf19315f40 con 0x55cf19317190 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.847+0000 7f24ae7fc640 1 -- 172.21.15.102:0/503330782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b804c030 con 0x55cf19317190 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.847+0000 7f25cae98800 1 -- 172.21.15.102:0/503330782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf19316490 con 0x55cf19317190 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f24ae7fc640 1 -- 172.21.15.102:0/503330782 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f25b804c1d0 con 0x55cf19317190 2024-09-19T11:13:54.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f24ae7fc640 1 --2- 172.21.15.102:0/503330782 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f24ae7fc640 1 -- 172.21.15.102:0/503330782 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f25b803bda0 con 0x55cf19317190 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f25c8181640 1 --2- 172.21.15.102:0/503330782 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f25cae98800 1 Processor -- start 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f25cae98800 1 -- start start 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f25c8181640 1 --2- 172.21.15.102:0/503330782 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f25bc000c00 tx=0x7f25bc005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f25cae98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194c6050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.848+0000 7f25cae98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cf19491d00 con 0x55cf194c5c50 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.849+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194c6050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.849+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194c6050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43668/0 (socket says 172.21.15.102:43668) 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.849+0000 7f25c8982640 1 -- 172.21.15.102:0/365407438 learned_addr learned my addr 172.21.15.102:0/365407438 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.849+0000 7f25c8982640 1 -- 172.21.15.102:0/365407438 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf194c6640 con 0x55cf194c5c50 2024-09-19T11:13:54.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.849+0000 7f25c8982640 1 --2- 172.21.15.102:0/365407438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194c6050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f25b801bfd0 tx=0x7f25b80453f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=921f6703cecd3496 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.849+0000 7f249ffff640 1 -- 172.21.15.102:0/365407438 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b804c5f0 con 0x55cf194c5c50 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.849+0000 7f249ffff640 1 -- 172.21.15.102:0/365407438 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b804c800 con 0x55cf194c5c50 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.849+0000 7f249ffff640 1 -- 172.21.15.102:0/365407438 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b8032ca0 con 0x55cf194c5c50 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 -- 172.21.15.102:0/365407438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 msgr2=0x55cf194c6050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 --2- 172.21.15.102:0/365407438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194c6050 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x7f25b801bfd0 tx=0x7f25b80453f0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 -- 172.21.15.102:0/365407438 shutdown_connections 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 --2- 172.21.15.102:0/365407438 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194c6050 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 -- 172.21.15.102:0/365407438 >> 172.21.15.102:0/365407438 conn(0x55cf194c2050 msgr2=0x55cf194c0290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 -- 172.21.15.102:0/365407438 shutdown_connections 2024-09-19T11:13:54.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 -- 172.21.15.102:0/365407438 wait complete. 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 Processor -- start 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 -- start start 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194cd0b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25cae98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cf194c6ab0 con 0x55cf194c5c50 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194cd0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25c8982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194cd0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43680/0 (socket says 172.21.15.102:43680) 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.850+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 learned_addr learned my addr 172.21.15.102:0/2505783367 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.851+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cf194cd610 con 0x55cf194c5c50 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.851+0000 7f25c8982640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194cd0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f25b8057010 tx=0x7f25b8017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.851+0000 7f249e7fc640 1 -- 172.21.15.102:0/2505783367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b80457c0 con 0x55cf194c5c50 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.851+0000 7f249e7fc640 1 -- 172.21.15.102:0/2505783367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b8047a70 con 0x55cf194c5c50 2024-09-19T11:13:54.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.851+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cf194cd610 con 0x55cf194c5c50 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.851+0000 7f249e7fc640 1 -- 172.21.15.102:0/2505783367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b8047d50 con 0x55cf194c5c50 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.851+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cf194cdc10 con 0x55cf194c5c50 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f249e7fc640 1 -- 172.21.15.102:0/2505783367 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f25b806f030 con 0x55cf194c5c50 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f249e7fc640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249403d000 0x7f249403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f249e7fc640 1 -- 172.21.15.102:0/2505783367 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f25b806d070 con 0x55cf194c5c50 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f25c8181640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249403d000 0x7f249403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf194d8650 0x55cf194daac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194db210 con 0x55cf194d8650 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f25c9183640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf194d8650 0x55cf194daac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.852+0000 7f25c8181640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249403d000 0x7f249403f4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55cf194a9800 tx=0x7f25bc06d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25c9183640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf194d8650 0x55cf194daac0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 20 realm 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194db620 con 0x55cf194d8650 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dbef0 con 0x55cf194d8650 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.853+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25cae98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194dcd80 0x55cf194df170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194df8b0 con 0x55cf194dcd80 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25c8982640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194dcd80 0x55cf194df170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25c8982640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194dcd80 0x55cf194df170 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25cae98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.854+0000 7f25cae98800 20 searching for the correct realm 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194e1950 0x55cf194e3e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e44e0 con 0x55cf194e1950 2024-09-19T11:13:54.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25c8181640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194e1950 0x55cf194e3e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25c8181640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194e1950 0x55cf194e3e10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25c8181640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25bc069040 0x7f25bc06a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e44e0 con 0x7f25bc069040 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25c9183640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25bc069040 0x7f25bc06a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.855+0000 7f25c9183640 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25bc069040 0x7f25bc06a940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.856+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.856+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.856+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.856+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.856+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.856+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.856+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.856+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.857+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.857+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.857+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.857+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x7f25bc069040 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.857+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.857+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194e1950 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.857+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.857+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.858+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.858+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.858+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.858+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.858+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.858+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x7f25bc069040 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.858+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.858+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194e1950 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.859+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.859+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194e1950 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.859+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.859+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.859+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.859+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194e1950 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.860+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.860+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194e1950 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.860+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.860+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.860+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.860+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.860+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.860+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.861+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.861+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194e1950 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.861+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.861+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x7f25bc069040 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.861+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.861+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.861+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.861+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.862+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.862+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194e1950 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.862+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.862+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.862+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.862+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x7f25bc069040 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.862+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.862+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194e1950 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194dcd80 2024-09-19T11:13:54.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x55cf194d8650 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55cf194dc290 con 0x7f25bc069040 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25cae98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25cae98800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25cae98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25cae98800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25cae98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25cae98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.863+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e0250 con 0x55cf194d8650 2024-09-19T11:13:54.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e0250 con 0x55cf194d8650 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e0250 con 0x55cf194e1950 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 zone default found 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 4 Realm: () 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:54.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 zonegroup default 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e0af0 con 0x55cf194dcd80 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.864+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e6350 con 0x55cf194e1950 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25cae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e66f0 con 0x55cf194e1950 2024-09-19T11:13:54.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25cae98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:54.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25cae98800 20 started sync module instance, tier type = 2024-09-19T11:13:54.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25cae98800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:54.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.865+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e57f0 con 0x7f25bc069040 2024-09-19T11:13:54.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.866+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.866+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94347971157232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e57f0 con 0x7f25bc069040 2024-09-19T11:13:54.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.866+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e7110 con 0x55cf194d8650 2024-09-19T11:13:54.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.867+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94347971157232] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.867+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.867+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94347971161088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e57f0 con 0x55cf194d8650 2024-09-19T11:13:54.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.867+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e7ba0 con 0x55cf194e1950 2024-09-19T11:13:54.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.868+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.868+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94347971163760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e8440 con 0x55cf194e1950 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.868+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e8f20 con 0x7f25bc069040 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.869+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94347971161088] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.869+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94347971163760] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.869+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.869+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94347971166096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e5340 con 0x7f25bc069040 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.870+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e97c0 con 0x55cf194d8650 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.871+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94347971166096] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.871+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.871+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94347971168816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e9770 con 0x55cf194d8650 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.871+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194ea1d0 con 0x55cf194dcd80 2024-09-19T11:13:54.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.872+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94347971168816] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.872+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.872+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94347971171008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e96e0 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.872+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194eb040 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.873+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.873+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94347971179488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194ebcb0 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.873+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194ec6b0 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.873+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94347971171008] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94347971179488] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'84 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94347971180544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194ec240 con 0x55cf194dcd80 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25cae98800 20 add_watcher() i=0 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25cae98800 20 add_watcher() i=1 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25cae98800 20 add_watcher() i=2 2024-09-19T11:13:54.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25cae98800 20 add_watcher() i=3 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25cae98800 20 add_watcher() i=4 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25cae98800 20 add_watcher() i=5 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.874+0000 7f25cae98800 20 add_watcher() i=6 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.875+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94347971180544] v35'85 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.875+0000 7f25cae98800 20 add_watcher() i=7 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.875+0000 7f25cae98800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.875+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf194ef920 con 0x55cf194d8650 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.875+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.875+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94347971175792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194ece40 con 0x55cf194d8650 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.876+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94347971175792] v35'90 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.876+0000 7f247efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.876+0000 7f25cae98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:54.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.876+0000 7f25cae98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.876+0000 7f25cae98800 5 note: GC not initialized 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.876+0000 7f247dfe3640 20 reqs_thread_entry: start 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 20 Filter name: none 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f23ef7fe640 20 reqs_thread_entry: start 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf19522320 con 0x55cf194d8650 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 20 rados->read ofs=0 len=0 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf19522be0 con 0x55cf194d8650 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.877+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55cf19523bf0 con 0x7f25bc069040 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.878+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 foo.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 155+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.878+0000 7f247efe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.878+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94347971175792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf19520260 con 0x55cf194d8650 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.880+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94347971175792] v35'91 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.880+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94347971157232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf19520260 con 0x7f25bc069040 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.880+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94347971157232] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.880+0000 7f25cae98800 20 remove_watcher() i=0 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.880+0000 7f25cae98800 2 removed watcher, disabling cache 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.880+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94347971161088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf19520260 con 0x55cf194d8650 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.882+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94347971161088] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.882+0000 7f25cae98800 20 remove_watcher() i=1 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.882+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94347971163760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf19520260 con 0x55cf194e1950 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.882+0000 7f25c8181640 1 -- 172.21.15.102:0/2505783367 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94347971163760] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25bc057030 con 0x55cf194e1950 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.883+0000 7f25cae98800 20 remove_watcher() i=2 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.883+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94347971166096] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e6c00 con 0x7f25bc069040 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.883+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94347971166096] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25bc069040 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.884+0000 7f25cae98800 20 remove_watcher() i=3 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.884+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94347971168816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e7f90 con 0x55cf194d8650 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.884+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94347971168816] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55cf194d8650 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.884+0000 7f25cae98800 20 remove_watcher() i=4 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.884+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94347971171008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e6c00 con 0x55cf194dcd80 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.886+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94347971171008] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.886+0000 7f25cae98800 20 remove_watcher() i=5 2024-09-19T11:13:54.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.886+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94347971179488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e92c0 con 0x55cf194dcd80 2024-09-19T11:13:54.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.887+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94347971179488] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.887+0000 7f25cae98800 20 remove_watcher() i=6 2024-09-19T11:13:54.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.887+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94347971180544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55cf194e6c00 con 0x55cf194dcd80 2024-09-19T11:13:54.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25c8982640 1 -- 172.21.15.102:0/2505783367 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94347971180544] v35'86 uv84 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b8038070 con 0x55cf194dcd80 2024-09-19T11:13:54.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 20 remove_watcher() i=7 2024-09-19T11:13:54.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194dcd80 msgr2=0x55cf194df170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194dcd80 0x55cf194df170 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf194d8650 msgr2=0x55cf194daac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf194d8650 0x55cf194daac0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25bc069040 msgr2=0x7f25bc06a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25bc069040 0x7f25bc06a940 crc :-1 s=READY pgs=37 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194e1950 msgr2=0x55cf194e3e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194e1950 0x55cf194e3e10 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.888+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249403d000 msgr2=0x7f249403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249403d000 0x7f249403f4c0 secure :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0x55cf194a9800 tx=0x7f25bc06d040 comp rx=0 tx=0).stop 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 msgr2=0x55cf194cd0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194cd0b0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7f25b8057010 tx=0x7f25b8017f50 comp rx=0 tx=0).stop 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25c9183640 1 -- 172.21.15.102:0/2505783367 reap_dead start 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 shutdown_connections 2024-09-19T11:13:54.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/2505783367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf194c5c50 0x55cf194cd0b0 unknown :-1 s=CLOSED pgs=352 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 >> 172.21.15.102:0/2505783367 conn(0x55cf194c2050 msgr2=0x55cf194c0260 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 shutdown_connections 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/2505783367 wait complete. 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/503330782 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 msgr2=0x7f24a003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/503330782 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 secure :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0x7f25bc000c00 tx=0x7f25bc005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/503330782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19317190 msgr2=0x55cf19315a00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/503330782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19317190 0x55cf19315a00 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7f25b80176b0 tx=0x7f25b80197b0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/503330782 shutdown_connections 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/503330782 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 unknown :-1 s=CLOSED pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/503330782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf19317190 0x55cf19315a00 unknown :-1 s=CLOSED pgs=350 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/503330782 >> 172.21.15.102:0/503330782 conn(0x55cf194ab4f0 msgr2=0x55cf194ab8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/503330782 shutdown_connections 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/503330782 wait complete. 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194a2860 msgr2=0x55cf194a4ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cf194a2860 0x55cf194a4ce0 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf193a2b60 msgr2=0x55cf194a0480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cf193a2b60 0x55cf194a0480 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194a68d0 msgr2=0x55cf194a8cc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cf194a68d0 0x55cf194a8cc0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24b003cfb0 msgr2=0x7f24b003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24b003cfb0 0x7f24b003f470 secure :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0x7f25bc057000 tx=0x7f25bc052000 comp rx=0 tx=0).stop 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 msgr2=0x55cf19498e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25cae98800 1 --2- 172.21.15.102:0/4259529118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cf193a1890 0x55cf19498e30 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x55cf19492270 tx=0x7f25b8000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:54.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.889+0000 7f25c9183640 1 -- 172.21.15.102:0/4259529118 reap_dead start 2024-09-19T11:13:54.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.890+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 shutdown_connections 2024-09-19T11:13:54.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.890+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 >> 172.21.15.102:0/4259529118 conn(0x55cf1939cc60 msgr2=0x55cf194927d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:54.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.890+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 shutdown_connections 2024-09-19T11:13:54.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:54.890+0000 7f25cae98800 1 -- 172.21.15.102:0/4259529118 wait complete. 2024-09-19T11:13:54.904 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-19T11:13:54.904 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T11:13:54.986 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:54.986 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list', '--uid', 'foo'] 2024-09-19T11:13:54.986 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list', '--uid', 'foo'] 2024-09-19T11:13:54.987 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list --uid foo 2024-09-19T11:13:55.031 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:55.031 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:55.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe825339800 1 Processor -- start 2024-09-19T11:13:55.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe825339800 1 -- start start 2024-09-19T11:13:55.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe825339800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5594fd171880 0x5594fd17a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe825339800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5594fd17a8e0 con 0x5594fd16fd60 2024-09-19T11:13:55.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe825339800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5594fcffc7d0 con 0x5594fd171880 2024-09-19T11:13:55.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe8187cd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5594fd171880 0x5594fd17a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe8187cd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5594fd171880 0x5594fd17a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43694/0 (socket says 172.21.15.102:43694) 2024-09-19T11:13:55.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe820fce640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5594fd16fd60 0x5594fd170160 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52424/0 (socket says 172.21.15.102:52424) 2024-09-19T11:13:55.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.031+0000 7fe8187cd640 1 -- 172.21.15.102:0/859546447 learned_addr learned my addr 172.21.15.102:0/859546447 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.032+0000 7fe8187cd640 1 -- 172.21.15.102:0/859546447 >> v1:172.21.15.37:6789/0 conn(0x5594fd16fd60 legacy=0x5594fd170160 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.032+0000 7fe8187cd640 1 -- 172.21.15.102:0/859546447 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd17bac0 con 0x5594fd171880 2024-09-19T11:13:55.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.033+0000 7fe8187cd640 1 --2- 172.21.15.102:0/859546447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd171880 0x5594fd17a3a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe80800a520 tx=0x7fe808045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a4ab6e8d5322d1db server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe81bfff640 1 -- 172.21.15.102:0/859546447 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe808055070 con 0x5594fd171880 2024-09-19T11:13:55.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe81bfff640 1 -- 172.21.15.102:0/859546447 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe8080515b0 con 0x5594fd171880 2024-09-19T11:13:55.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe81bfff640 1 -- 172.21.15.102:0/859546447 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe8080518d0 con 0x5594fd171880 2024-09-19T11:13:55.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe825339800 1 -- 172.21.15.102:0/859546447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd171880 msgr2=0x5594fd17a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe825339800 1 --2- 172.21.15.102:0/859546447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd171880 0x5594fd17a3a0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x7fe80800a520 tx=0x7fe808045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe825339800 1 -- 172.21.15.102:0/859546447 shutdown_connections 2024-09-19T11:13:55.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe825339800 1 --2- 172.21.15.102:0/859546447 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd171880 0x5594fd17a3a0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe825339800 1 -- 172.21.15.102:0/859546447 >> 172.21.15.102:0/859546447 conn(0x5594fd16ba50 msgr2=0x5594fd16deb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe825339800 1 -- 172.21.15.102:0/859546447 shutdown_connections 2024-09-19T11:13:55.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.034+0000 7fe825339800 1 -- 172.21.15.102:0/859546447 wait complete. 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.048+0000 7fe825339800 1 Processor -- start 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.048+0000 7fe825339800 1 -- start start 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.048+0000 7fe825339800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd2634b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.048+0000 7fe825339800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594fd009dd0 con 0x5594fd16fd60 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.048+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd2634b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.048+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd2634b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43710/0 (socket says 172.21.15.102:43710) 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.048+0000 7fe820fce640 1 -- 172.21.15.102:0/3683734418 learned_addr learned my addr 172.21.15.102:0/3683734418 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.048+0000 7fe820fce640 1 -- 172.21.15.102:0/3683734418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd263aa0 con 0x5594fd16fd60 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.049+0000 7fe820fce640 1 --2- 172.21.15.102:0/3683734418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd2634b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe810001eb0 tx=0x7fe81000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ecce739b98d9c27d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.049+0000 7fe70ee0d640 1 -- 172.21.15.102:0/3683734418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe81000e5c0 con 0x5594fd16fd60 2024-09-19T11:13:55.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.049+0000 7fe70ee0d640 1 -- 172.21.15.102:0/3683734418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810006070 con 0x5594fd16fd60 2024-09-19T11:13:55.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.049+0000 7fe70ee0d640 1 -- 172.21.15.102:0/3683734418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe81000e8b0 con 0x5594fd16fd60 2024-09-19T11:13:55.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 -- 172.21.15.102:0/3683734418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 msgr2=0x5594fd2634b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 --2- 172.21.15.102:0/3683734418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd2634b0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fe810001eb0 tx=0x7fe81000b6c0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 -- 172.21.15.102:0/3683734418 shutdown_connections 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 --2- 172.21.15.102:0/3683734418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd2634b0 unknown :-1 s=CLOSED pgs=355 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 -- 172.21.15.102:0/3683734418 >> 172.21.15.102:0/3683734418 conn(0x5594fd16ba50 msgr2=0x5594fd25ee30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 -- 172.21.15.102:0/3683734418 shutdown_connections 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 -- 172.21.15.102:0/3683734418 wait complete. 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 Processor -- start 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 -- start start 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd26b000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe825339800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594fd17adb0 con 0x5594fd16fd60 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd26b000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd26b000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43722/0 (socket says 172.21.15.102:43722) 2024-09-19T11:13:55.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.050+0000 7fe820fce640 1 -- 172.21.15.102:0/4102365154 learned_addr learned my addr 172.21.15.102:0/4102365154 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.051+0000 7fe820fce640 1 -- 172.21.15.102:0/4102365154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd26b560 con 0x5594fd16fd60 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.051+0000 7fe820fce640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd26b000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b700 tx=0x7fe810000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.051+0000 7fe70d60a640 1 -- 172.21.15.102:0/4102365154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe81001a7c0 con 0x5594fd16fd60 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.051+0000 7fe70d60a640 1 -- 172.21.15.102:0/4102365154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81001a960 con 0x5594fd16fd60 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.051+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594fd26b7f0 con 0x5594fd16fd60 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.051+0000 7fe70d60a640 1 -- 172.21.15.102:0/4102365154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe81001acc0 con 0x5594fd16fd60 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.051+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594fd26c1f0 con 0x5594fd16fd60 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.052+0000 7fe70d60a640 1 -- 172.21.15.102:0/4102365154 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe810017070 con 0x5594fd16fd60 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.052+0000 7fe70d60a640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe70803d000 0x7fe70803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.052+0000 7fe70d60a640 1 -- 172.21.15.102:0/4102365154 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe810015020 con 0x5594fd16fd60 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.052+0000 7fe8187cd640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe70803d000 0x7fe70803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.052+0000 7fe825339800 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd171880 0x5594fd272650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.052+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd272b90 con 0x5594fd171880 2024-09-19T11:13:55.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.052+0000 7fe8217cf640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd171880 0x5594fd272650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.053+0000 7fe8187cd640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe70803d000 0x7fe70803f4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe808057000 tx=0x7fe808052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.053+0000 7fe8217cf640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd171880 0x5594fd272650 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.053+0000 7fe8217cf640 1 -- 172.21.15.102:0/4102365154 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd171880 2024-09-19T11:13:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.053+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd272f30 con 0x5594fd171880 2024-09-19T11:13:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.053+0000 7fe8217cf640 1 -- 172.21.15.102:0/4102365154 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd171880 2024-09-19T11:13:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.053+0000 7fe825339800 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd274a30 0x5594fd276eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.053+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd277640 con 0x5594fd274a30 2024-09-19T11:13:55.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.053+0000 7fe820fce640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd274a30 0x5594fd276eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.054+0000 7fe820fce640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd274a30 0x5594fd276eb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.054+0000 7fe820fce640 1 -- 172.21.15.102:0/4102365154 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe81002e070 con 0x5594fd274a30 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.054+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd273780 con 0x5594fd171880 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.054+0000 7fe8217cf640 1 -- 172.21.15.102:0/4102365154 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd171880 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.054+0000 7fe825339800 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd278aa0 0x5594fd27ae90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.055+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd27b5d0 con 0x5594fd278aa0 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.055+0000 7fe8187cd640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd278aa0 0x5594fd27ae90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.055+0000 7fe8187cd640 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd278aa0 0x5594fd27ae90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.055+0000 7fe8187cd640 1 -- 172.21.15.102:0/4102365154 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe808057030 con 0x5594fd278aa0 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.055+0000 7fe825339800 1 Processor -- start 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.055+0000 7fe825339800 1 -- start start 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe825339800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd289310 0x5594fd289730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe825339800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594fd0684a0 con 0x5594fd289310 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd289310 0x5594fd289730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd289310 0x5594fd289730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43728/0 (socket says 172.21.15.102:43728) 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe820fce640 1 -- 172.21.15.102:0/3630085428 learned_addr learned my addr 172.21.15.102:0/3630085428 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe820fce640 1 -- 172.21.15.102:0/3630085428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd289d70 con 0x5594fd289310 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe820fce640 1 --2- 172.21.15.102:0/3630085428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd289310 0x5594fd289730 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe8100174d0 tx=0x7fe81001dc60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe7067fc640 1 -- 172.21.15.102:0/3630085428 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe81004c340 con 0x5594fd289310 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe7067fc640 1 -- 172.21.15.102:0/3630085428 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81004c4e0 con 0x5594fd289310 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe825339800 1 -- 172.21.15.102:0/3630085428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594fd28a5a0 con 0x5594fd289310 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.056+0000 7fe7067fc640 1 -- 172.21.15.102:0/3630085428 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe81004c910 con 0x5594fd289310 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.057+0000 7fe825339800 1 -- 172.21.15.102:0/3630085428 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594fd28ab40 con 0x5594fd289310 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.057+0000 7fe7067fc640 1 -- 172.21.15.102:0/3630085428 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe81004cab0 con 0x5594fd289310 2024-09-19T11:13:55.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.057+0000 7fe7067fc640 1 --2- 172.21.15.102:0/3630085428 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6f803d000 0x7fe6f803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.057+0000 7fe7067fc640 1 -- 172.21.15.102:0/3630085428 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe81003e020 con 0x5594fd289310 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.057+0000 7fe8187cd640 1 --2- 172.21.15.102:0/3630085428 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6f803d000 0x7fe6f803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe825339800 1 Processor -- start 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe825339800 1 -- start start 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe8187cd640 1 --2- 172.21.15.102:0/3630085428 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6f803d000 0x7fe6f803f4c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe808005930 tx=0x7fe808005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe825339800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd295fd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe825339800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594fd263ed0 con 0x5594fd295bd0 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd295fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd295fd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43732/0 (socket says 172.21.15.102:43732) 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe820fce640 1 -- 172.21.15.102:0/708132610 learned_addr learned my addr 172.21.15.102:0/708132610 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.058+0000 7fe820fce640 1 -- 172.21.15.102:0/708132610 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd2965c0 con 0x5594fd295bd0 2024-09-19T11:13:55.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe820fce640 1 --2- 172.21.15.102:0/708132610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd295fd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe81001be20 tx=0x7fe8100197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9603d7f554cd0b2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe6f7fff640 1 -- 172.21.15.102:0/708132610 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe810036070 con 0x5594fd295bd0 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe6f7fff640 1 -- 172.21.15.102:0/708132610 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe81004cda0 con 0x5594fd295bd0 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe6f7fff640 1 -- 172.21.15.102:0/708132610 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe810043e50 con 0x5594fd295bd0 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 -- 172.21.15.102:0/708132610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 msgr2=0x5594fd295fd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 --2- 172.21.15.102:0/708132610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd295fd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7fe81001be20 tx=0x7fe8100197b0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 -- 172.21.15.102:0/708132610 shutdown_connections 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 --2- 172.21.15.102:0/708132610 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd295fd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 -- 172.21.15.102:0/708132610 >> 172.21.15.102:0/708132610 conn(0x5594fd291fd0 msgr2=0x5594fd290210 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 -- 172.21.15.102:0/708132610 shutdown_connections 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 -- 172.21.15.102:0/708132610 wait complete. 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 Processor -- start 2024-09-19T11:13:55.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.059+0000 7fe825339800 1 -- start start 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe825339800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd29cfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe825339800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5594fd296a30 con 0x5594fd295bd0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd29cfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe820fce640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd29cfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43734/0 (socket says 172.21.15.102:43734) 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 learned_addr learned my addr 172.21.15.102:0/913099202 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5594fd29d540 con 0x5594fd295bd0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe820fce640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd29cfe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe81001be20 tx=0x7fe81003c340 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe6f67fc640 1 -- 172.21.15.102:0/913099202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe810019860 con 0x5594fd295bd0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe6f67fc640 1 -- 172.21.15.102:0/913099202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe810019a00 con 0x5594fd295bd0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5594fd29d540 con 0x5594fd295bd0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe6f67fc640 1 -- 172.21.15.102:0/913099202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe810019d60 con 0x5594fd295bd0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.060+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5594fd29d540 con 0x5594fd295bd0 2024-09-19T11:13:55.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.061+0000 7fe6f67fc640 1 -- 172.21.15.102:0/913099202 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe81003c7c0 con 0x5594fd295bd0 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.061+0000 7fe6f67fc640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6ec03cf10 0x7fe6ec03f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.062+0000 7fe6f67fc640 1 -- 172.21.15.102:0/913099202 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fe81005b030 con 0x5594fd295bd0 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.062+0000 7fe8187cd640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6ec03cf10 0x7fe6ec03f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.062+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.062+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd2a8580 0x5594fd2aaa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.062+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ab190 con 0x5594fd2a8580 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.062+0000 7fe8217cf640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd2a8580 0x5594fd2aaa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.062+0000 7fe8187cd640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6ec03cf10 0x7fe6ec03f3d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe808051990 tx=0x7fe80806d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.062+0000 7fe8217cf640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd2a8580 0x5594fd2aaa40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 realm 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ab5a0 con 0x5594fd2a8580 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2abe70 con 0x5594fd2a8580 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd2acd00 0x5594fd2af0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.063+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2af830 con 0x5594fd2acd00 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.064+0000 7fe820fce640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd2acd00 0x5594fd2af0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.064+0000 7fe820fce640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd2acd00 0x5594fd2af0f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.064+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.064+0000 7fe825339800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.064+0000 7fe825339800 20 searching for the correct realm 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.064+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd2b18d0 0x5594fd2b3d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.064+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b4460 con 0x5594fd2b18d0 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.064+0000 7fe8187cd640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd2b18d0 0x5594fd2b3d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.065+0000 7fe8187cd640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd2b18d0 0x5594fd2b3d90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.065+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.065+0000 7fe8187cd640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe808069040 0x7fe80808b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.065+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b4460 con 0x7fe808069040 2024-09-19T11:13:55.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.065+0000 7fe8217cf640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe808069040 0x7fe80808b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.065+0000 7fe8217cf640 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe808069040 0x7fe80808b940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.065+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.066+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.066+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.066+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.066+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.066+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.066+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.066+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.067+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.067+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.067+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.067+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x7fe808069040 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.067+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.067+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2b18d0 2024-09-19T11:13:55.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.067+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.067+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.068+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.068+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.068+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.068+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.068+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.068+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x7fe808069040 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.068+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.068+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2b18d0 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.069+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.069+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2b18d0 2024-09-19T11:13:55.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.069+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.069+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2b18d0 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2b18d0 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.070+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.071+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.071+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2b18d0 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.071+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.071+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x7fe808069040 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.071+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.071+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.071+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.071+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.072+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.072+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2b18d0 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.072+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.072+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.072+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.072+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x7fe808069040 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.072+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2b18d0 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2acd00 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x5594fd2a8580 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ac210 con 0x7fe808069040 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe825339800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe825339800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:55.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe825339800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe825339800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe825339800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe825339800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.073+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b01d0 con 0x5594fd2a8580 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b01d0 con 0x5594fd2a8580 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b01d0 con 0x5594fd2b18d0 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 20 zone default found 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 4 Realm: () 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 20 zonegroup default 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.074+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b0a70 con 0x5594fd2acd00 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b62d0 con 0x5594fd2b18d0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b6670 con 0x5594fd2b18d0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 20 started sync module instance, tier type = 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.075+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b5770 con 0x7fe808069040 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.076+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.076+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94098390998208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b5770 con 0x7fe808069040 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.076+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b7090 con 0x5594fd2a8580 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.077+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94098390998208] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.077+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.077+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94098391001984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b5770 con 0x5594fd2a8580 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.077+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b7b30 con 0x5594fd2b18d0 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.078+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94098391001984] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.079+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.079+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94098390995648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b56e0 con 0x5594fd2b18d0 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.079+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b89f0 con 0x7fe808069040 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.080+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94098390995648] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.080+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.080+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94098391008576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b8e10 con 0x7fe808069040 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.080+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b97d0 con 0x5594fd2a8580 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.081+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94098391008576] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.081+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.081+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94098391010112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b97d0 con 0x5594fd2a8580 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.081+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ba190 con 0x5594fd2acd00 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.082+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.082+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94098391014624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2ba9e0 con 0x5594fd2acd00 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.082+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2bb460 con 0x5594fd2acd00 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.082+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94098391010112] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.083+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94098391014624] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.083+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.083+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94098391019344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2bb850 con 0x5594fd2acd00 2024-09-19T11:13:55.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.083+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2bc0a0 con 0x5594fd2acd00 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94098391019344] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'87 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94098391022576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2bc4c0 con 0x5594fd2acd00 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe825339800 20 add_watcher() i=0 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe825339800 20 add_watcher() i=1 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe825339800 20 add_watcher() i=2 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe825339800 20 add_watcher() i=3 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe825339800 20 add_watcher() i=4 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe825339800 20 add_watcher() i=5 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.084+0000 7fe825339800 20 add_watcher() i=6 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.085+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94098391022576] v35'88 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.085+0000 7fe825339800 20 add_watcher() i=7 2024-09-19T11:13:55.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.085+0000 7fe825339800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:55.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.085+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2bf820 con 0x5594fd2a8580 2024-09-19T11:13:55.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.086+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.086+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94098391024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2bca50 con 0x5594fd2a8580 2024-09-19T11:13:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.087+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94098391024000] v35'92 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.087+0000 7fe6d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.087+0000 7fe825339800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.087+0000 7fe825339800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.087+0000 7fe825339800 5 note: GC not initialized 2024-09-19T11:13:55.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.087+0000 7fe6d5fe3640 20 reqs_thread_entry: start 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.087+0000 7fe825339800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.087+0000 7fe825339800 20 Filter name: none 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe6477fe640 20 reqs_thread_entry: start 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2f22d0 con 0x5594fd2a8580 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe825339800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe825339800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2f2b60 con 0x5594fd2a8580 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe825339800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.088+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2f3b70 con 0x7fe808069040 2024-09-19T11:13:55.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.089+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv2 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.089+0000 7fe6d6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.089+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94098391024000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2f01f0 con 0x5594fd2a8580 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.090+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94098391024000] v35'93 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.090+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94098390998208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2f01f0 con 0x7fe808069040 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.091+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94098390998208] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.091+0000 7fe825339800 20 remove_watcher() i=0 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.091+0000 7fe825339800 2 removed watcher, disabling cache 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.091+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94098391001984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2f01f0 con 0x5594fd2a8580 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.093+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94098391001984] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.093+0000 7fe825339800 20 remove_watcher() i=1 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.093+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94098390995648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2f01f0 con 0x5594fd2b18d0 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.094+0000 7fe8187cd640 1 -- 172.21.15.102:0/913099202 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94098390995648] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe808057030 con 0x5594fd2b18d0 2024-09-19T11:13:55.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.094+0000 7fe825339800 20 remove_watcher() i=2 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.094+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94098391008576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b6b80 con 0x7fe808069040 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.094+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94098391008576] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x7fe808069040 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.094+0000 7fe825339800 20 remove_watcher() i=3 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.094+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94098391010112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b52c0 con 0x5594fd2a8580 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.096+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94098391010112] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe81c00a4d0 con 0x5594fd2a8580 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.096+0000 7fe825339800 20 remove_watcher() i=4 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.096+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94098391014624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b8540 con 0x5594fd2acd00 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.097+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94098391014624] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.097+0000 7fe825339800 20 remove_watcher() i=5 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.097+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94098391019344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b6b80 con 0x5594fd2acd00 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.098+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94098391019344] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.098+0000 7fe825339800 20 remove_watcher() i=6 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.098+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94098391022576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5594fd2b8b40 con 0x5594fd2acd00 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe820fce640 1 -- 172.21.15.102:0/913099202 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94098391022576] v35'89 uv87 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe810071020 con 0x5594fd2acd00 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 20 remove_watcher() i=7 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd2acd00 msgr2=0x5594fd2af0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd2acd00 0x5594fd2af0f0 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd2a8580 msgr2=0x5594fd2aaa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd2a8580 0x5594fd2aaa40 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe808069040 msgr2=0x7fe80808b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe808069040 0x7fe80808b940 crc :-1 s=READY pgs=38 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd2b18d0 msgr2=0x5594fd2b3d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd2b18d0 0x5594fd2b3d90 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6ec03cf10 msgr2=0x7fe6ec03f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6ec03cf10 0x7fe6ec03f3d0 secure :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0x7fe808051990 tx=0x7fe80806d040 comp rx=0 tx=0).stop 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 msgr2=0x5594fd29cfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe8217cf640 1 -- 172.21.15.102:0/913099202 reap_dead start 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd29cfe0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7fe81001be20 tx=0x7fe81003c340 comp rx=0 tx=0).stop 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 shutdown_connections 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/913099202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd295bd0 0x5594fd29cfe0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 >> 172.21.15.102:0/913099202 conn(0x5594fd291fd0 msgr2=0x5594fd2901e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 shutdown_connections 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/913099202 wait complete. 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/3630085428 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6f803d000 msgr2=0x7fe6f803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/3630085428 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6f803d000 0x7fe6f803f4c0 secure :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0x7fe808005930 tx=0x7fe808005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/3630085428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd289310 msgr2=0x5594fd289730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/3630085428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd289310 0x5594fd289730 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7fe8100174d0 tx=0x7fe81001dc60 comp rx=0 tx=0).stop 2024-09-19T11:13:55.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/3630085428 shutdown_connections 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/3630085428 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe6f803d000 0x7fe6f803f4c0 unknown :-1 s=CLOSED pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 --2- 172.21.15.102:0/3630085428 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd289310 0x5594fd289730 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/3630085428 >> 172.21.15.102:0/3630085428 conn(0x5594fd27d6c0 msgr2=0x5594fd27daa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/3630085428 shutdown_connections 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.099+0000 7fe825339800 1 -- 172.21.15.102:0/3630085428 wait complete. 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd274a30 msgr2=0x5594fd276eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5594fd274a30 0x5594fd276eb0 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd171880 msgr2=0x5594fd272650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5594fd171880 0x5594fd272650 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd278aa0 msgr2=0x5594fd27ae90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5594fd278aa0 0x5594fd27ae90 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe70803d000 msgr2=0x7fe70803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe70803d000 0x7fe70803f4c0 secure :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0x7fe808057000 tx=0x7fe808052000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 msgr2=0x5594fd26b000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 --2- 172.21.15.102:0/4102365154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5594fd16fd60 0x5594fd26b000 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe81000b700 tx=0x7fe810000bc0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe8217cf640 1 -- 172.21.15.102:0/4102365154 reap_dead start 2024-09-19T11:13:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 shutdown_connections 2024-09-19T11:13:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 >> 172.21.15.102:0/4102365154 conn(0x5594fd16ba50 msgr2=0x5594fd2649a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 shutdown_connections 2024-09-19T11:13:55.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.100+0000 7fe825339800 1 -- 172.21.15.102:0/4102365154 wait complete. 2024-09-19T11:13:55.115 INFO:teuthology.orchestra.run.smithi102.stdout:["myfoo"] 2024-09-19T11:13:55.115 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-19T11:13:55.153 INFO:tasks.radosgw_admin:RL: list_buckets foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:55.153 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'list'] 2024-09-19T11:13:55.154 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'list'] 2024-09-19T11:13:55.154 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket list 2024-09-19T11:13:55.197 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:55.197 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:55.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.196+0000 7f25c9487800 1 Processor -- start 2024-09-19T11:13:55.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.196+0000 7f25c9487800 1 -- start start 2024-09-19T11:13:55.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25c9487800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55d773f7fcf0 0x55d773f800f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25c9487800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55d773f86520 con 0x55d773f82800 2024-09-19T11:13:55.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25c9487800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55d773e0b7d0 con 0x55d773f7fcf0 2024-09-19T11:13:55.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25c6f71640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55d773f7fcf0 0x55d773f800f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25c6f71640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55d773f7fcf0 0x55d773f800f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43744/0 (socket says 172.21.15.102:43744) 2024-09-19T11:13:55.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25c6f71640 1 -- 172.21.15.102:0/1263726006 learned_addr learned my addr 172.21.15.102:0/1263726006 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25bffff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55d773f82800 0x55d773f84cc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52428/0 (socket says 172.21.15.102:52428) 2024-09-19T11:13:55.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25c6f71640 1 -- 172.21.15.102:0/1263726006 >> v1:172.21.15.37:6789/0 conn(0x55d773f82800 legacy=0x55d773f84cc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.197+0000 7f25c6f71640 1 -- 172.21.15.102:0/1263726006 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d773f87750 con 0x55d773f7fcf0 2024-09-19T11:13:55.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.199+0000 7f25c6f71640 1 --2- 172.21.15.102:0/1263726006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d773f800f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f25b800a520 tx=0x7f25b8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9e1d5ac4b9f179ad server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.199+0000 7f25c6770640 1 -- 172.21.15.102:0/1263726006 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b8055070 con 0x55d773f7fcf0 2024-09-19T11:13:55.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.199+0000 7f25c6770640 1 -- 172.21.15.102:0/1263726006 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b80515b0 con 0x55d773f7fcf0 2024-09-19T11:13:55.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.199+0000 7f25c6770640 1 -- 172.21.15.102:0/1263726006 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b80518d0 con 0x55d773f7fcf0 2024-09-19T11:13:55.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.200+0000 7f25c9487800 1 -- 172.21.15.102:0/1263726006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 msgr2=0x55d773f800f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.200+0000 7f25c9487800 1 --2- 172.21.15.102:0/1263726006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d773f800f0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7f25b800a520 tx=0x7f25b8045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.200+0000 7f25c9487800 1 -- 172.21.15.102:0/1263726006 shutdown_connections 2024-09-19T11:13:55.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.200+0000 7f25c9487800 1 --2- 172.21.15.102:0/1263726006 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d773f800f0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.200+0000 7f25c9487800 1 -- 172.21.15.102:0/1263726006 >> 172.21.15.102:0/1263726006 conn(0x55d773f7a1b0 msgr2=0x55d773f7c630 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.200+0000 7f25c9487800 1 -- 172.21.15.102:0/1263726006 shutdown_connections 2024-09-19T11:13:55.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.200+0000 7f25c9487800 1 -- 172.21.15.102:0/1263726006 wait complete. 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.213+0000 7f25c9487800 1 Processor -- start 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.213+0000 7f25c9487800 1 -- start start 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f25c9487800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d77406f250 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f25c9487800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d773e18dd0 con 0x55d773f7fcf0 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d77406f250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d77406f250 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43748/0 (socket says 172.21.15.102:43748) 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f25c6f71640 1 -- 172.21.15.102:0/4288524654 learned_addr learned my addr 172.21.15.102:0/4288524654 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f25c6f71640 1 -- 172.21.15.102:0/4288524654 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d77406f840 con 0x55d773f7fcf0 2024-09-19T11:13:55.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f25c6f71640 1 --2- 172.21.15.102:0/4288524654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d77406f250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f25b8025da0 tx=0x7f25b8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e5024543dc1d4d0d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f24b4e09640 1 -- 172.21.15.102:0/4288524654 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b8051950 con 0x55d773f7fcf0 2024-09-19T11:13:55.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f24b4e09640 1 -- 172.21.15.102:0/4288524654 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b8051af0 con 0x55d773f7fcf0 2024-09-19T11:13:55.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.214+0000 7f24b4e09640 1 -- 172.21.15.102:0/4288524654 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b8051dd0 con 0x55d773f7fcf0 2024-09-19T11:13:55.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.215+0000 7f25c9487800 1 -- 172.21.15.102:0/4288524654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 msgr2=0x55d77406f250 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.215+0000 7f25c9487800 1 --2- 172.21.15.102:0/4288524654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d77406f250 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f25b8025da0 tx=0x7f25b8051000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.215+0000 7f25c9487800 1 -- 172.21.15.102:0/4288524654 shutdown_connections 2024-09-19T11:13:55.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.215+0000 7f25c9487800 1 --2- 172.21.15.102:0/4288524654 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d77406f250 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.215+0000 7f25c9487800 1 -- 172.21.15.102:0/4288524654 >> 172.21.15.102:0/4288524654 conn(0x55d773f7a1b0 msgr2=0x55d77406abd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.215+0000 7f25c9487800 1 -- 172.21.15.102:0/4288524654 shutdown_connections 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.215+0000 7f25c9487800 1 -- 172.21.15.102:0/4288524654 wait complete. 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.215+0000 7f25c9487800 1 Processor -- start 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.216+0000 7f25c9487800 1 -- start start 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.216+0000 7f25c9487800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d773f7ede0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.216+0000 7f25c9487800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d773f869f0 con 0x55d773f7fcf0 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.216+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d773f7ede0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.216+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d773f7ede0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43754/0 (socket says 172.21.15.102:43754) 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.216+0000 7f25c6f71640 1 -- 172.21.15.102:0/4090080401 learned_addr learned my addr 172.21.15.102:0/4090080401 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.216+0000 7f25c6f71640 1 -- 172.21.15.102:0/4090080401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d773f7f320 con 0x55d773f7fcf0 2024-09-19T11:13:55.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.217+0000 7f25c6f71640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d773f7ede0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f25b8067040 tx=0x7f25b8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.217+0000 7f24b3606640 1 -- 172.21.15.102:0/4090080401 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b8073070 con 0x55d773f7fcf0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.217+0000 7f24b3606640 1 -- 172.21.15.102:0/4090080401 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b805a450 con 0x55d773f7fcf0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.217+0000 7f24b3606640 1 -- 172.21.15.102:0/4090080401 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b805a730 con 0x55d773f7fcf0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.217+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d77407cd70 con 0x55d773f7fcf0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.217+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d77407d220 con 0x55d773f7fcf0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.217+0000 7f24b3606640 1 -- 172.21.15.102:0/4090080401 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f25b8076070 con 0x55d773f7fcf0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.218+0000 7f24b3606640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24ac03d000 0x7f24ac03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.218+0000 7f24b3606640 1 -- 172.21.15.102:0/4090080401 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f25b8062070 con 0x55d773f7fcf0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.218+0000 7f25bffff640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24ac03d000 0x7f24ac03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.218+0000 7f25c9487800 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d773f82800 0x55d774081190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.218+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d774081790 con 0x55d773f82800 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.218+0000 7f25c7772640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d773f82800 0x55d774081190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.218+0000 7f25bffff640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24ac03d000 0x7f24ac03f4c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25b0001e30 tx=0x7f25b0001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.218+0000 7f25c7772640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d773f82800 0x55d774081190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.219+0000 7f25c7772640 1 -- 172.21.15.102:0/4090080401 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d773f82800 2024-09-19T11:13:55.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.219+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d774082050 con 0x55d773f82800 2024-09-19T11:13:55.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.219+0000 7f25c7772640 1 -- 172.21.15.102:0/4090080401 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d773f82800 2024-09-19T11:13:55.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.219+0000 7f25c9487800 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d774083960 0x55d774085e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.219+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d774086590 con 0x55d774083960 2024-09-19T11:13:55.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.219+0000 7f25c6f71640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d774083960 0x55d774085e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.219+0000 7f25c6f71640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d774083960 0x55d774085e00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.220+0000 7f25c6f71640 1 -- 172.21.15.102:0/4090080401 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f25b8075030 con 0x55d774083960 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.220+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740828a0 con 0x55d773f82800 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.220+0000 7f25c7772640 1 -- 172.21.15.102:0/4090080401 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d773f82800 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.220+0000 7f25c9487800 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740879f0 0x55d774089de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.220+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d77408a520 con 0x55d7740879f0 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.220+0000 7f25bffff640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740879f0 0x55d774089de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.220+0000 7f25bffff640 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740879f0 0x55d774089de0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.221+0000 7f25bffff640 1 -- 172.21.15.102:0/4090080401 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f25b000bd50 con 0x55d7740879f0 2024-09-19T11:13:55.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.221+0000 7f25c9487800 1 Processor -- start 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.221+0000 7f25c9487800 1 -- start start 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.221+0000 7f25c9487800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d774098260 0x55d774098680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.221+0000 7f25c9487800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d773e774a0 con 0x55d774098260 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.221+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d774098260 0x55d774098680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.221+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d774098260 0x55d774098680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43758/0 (socket says 172.21.15.102:43758) 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.221+0000 7f25c6f71640 1 -- 172.21.15.102:0/4105899505 learned_addr learned my addr 172.21.15.102:0/4105899505 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.222+0000 7f25c6f71640 1 -- 172.21.15.102:0/4105899505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d774098cc0 con 0x55d774098260 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.222+0000 7f25c6f71640 1 --2- 172.21.15.102:0/4105899505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d774098260 0x55d774098680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f25b801bb90 tx=0x7f25b80647f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.222+0000 7f24b0e01640 1 -- 172.21.15.102:0/4105899505 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b8065cb0 con 0x55d774098260 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.222+0000 7f24b0e01640 1 -- 172.21.15.102:0/4105899505 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b8065e50 con 0x55d774098260 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.222+0000 7f25c9487800 1 -- 172.21.15.102:0/4105899505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7740994f0 con 0x55d774098260 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.222+0000 7f24b0e01640 1 -- 172.21.15.102:0/4105899505 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b80814d0 con 0x55d774098260 2024-09-19T11:13:55.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.222+0000 7f25c9487800 1 -- 172.21.15.102:0/4105899505 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d774099a90 con 0x55d774098260 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f24b0e01640 1 -- 172.21.15.102:0/4105899505 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f25b8058070 con 0x55d774098260 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f24b0e01640 1 --2- 172.21.15.102:0/4105899505 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f24b0e01640 1 -- 172.21.15.102:0/4105899505 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f25b808f070 con 0x55d774098260 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f25bffff640 1 --2- 172.21.15.102:0/4105899505 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f25c9487800 1 Processor -- start 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f25c9487800 1 -- start start 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f25bffff640 1 --2- 172.21.15.102:0/4105899505 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55d77407e7c0 tx=0x7f25b000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f25c9487800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740a4e50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.223+0000 7f25c9487800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d77406fbb0 con 0x55d7740a4a50 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.224+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740a4e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.224+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740a4e50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43772/0 (socket says 172.21.15.102:43772) 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.224+0000 7f25c6f71640 1 -- 172.21.15.102:0/186219452 learned_addr learned my addr 172.21.15.102:0/186219452 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.224+0000 7f25c6f71640 1 -- 172.21.15.102:0/186219452 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7740a5440 con 0x55d7740a4a50 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.224+0000 7f25c6f71640 1 --2- 172.21.15.102:0/186219452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740a4e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f25b8081ef0 tx=0x7f25b80839d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3fd72ecd912839b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.224+0000 7f24aa7fc640 1 -- 172.21.15.102:0/186219452 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b80ab020 con 0x55d7740a4a50 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.224+0000 7f24aa7fc640 1 -- 172.21.15.102:0/186219452 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b806e3c0 con 0x55d7740a4a50 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.224+0000 7f24aa7fc640 1 -- 172.21.15.102:0/186219452 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b8078450 con 0x55d7740a4a50 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 -- 172.21.15.102:0/186219452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 msgr2=0x55d7740a4e50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 --2- 172.21.15.102:0/186219452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740a4e50 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7f25b8081ef0 tx=0x7f25b80839d0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 -- 172.21.15.102:0/186219452 shutdown_connections 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 --2- 172.21.15.102:0/186219452 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740a4e50 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 -- 172.21.15.102:0/186219452 >> 172.21.15.102:0/186219452 conn(0x55d7740a0e50 msgr2=0x55d77409f090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 -- 172.21.15.102:0/186219452 shutdown_connections 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 -- 172.21.15.102:0/186219452 wait complete. 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 Processor -- start 2024-09-19T11:13:55.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 -- start start 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740abe90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c9487800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55d7740a58b0 con 0x55d7740a4a50 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740abe90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c6f71640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740abe90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43786/0 (socket says 172.21.15.102:43786) 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.225+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 learned_addr learned my addr 172.21.15.102:0/487467250 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.226+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55d7740ac3f0 con 0x55d7740a4a50 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.226+0000 7f25c6f71640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740abe90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f25b8005a60 tx=0x7f25b807ada0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.226+0000 7f24a8ff9640 1 -- 172.21.15.102:0/487467250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b80c0070 con 0x55d7740a4a50 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.226+0000 7f24a8ff9640 1 -- 172.21.15.102:0/487467250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25b808aa80 con 0x55d7740a4a50 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.226+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55d7740ac3f0 con 0x55d7740a4a50 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.226+0000 7f24a8ff9640 1 -- 172.21.15.102:0/487467250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25b808ad60 con 0x55d7740a4a50 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.226+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55d7740ac3f0 con 0x55d7740a4a50 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.227+0000 7f24a8ff9640 1 -- 172.21.15.102:0/487467250 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f25b80c3070 con 0x55d7740a4a50 2024-09-19T11:13:55.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.227+0000 7f24a8ff9640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249003cfb0 0x7f249003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.227+0000 7f24a8ff9640 1 -- 172.21.15.102:0/487467250 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f25b80b7030 con 0x55d7740a4a50 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.227+0000 7f25bffff640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249003cfb0 0x7f249003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.227+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.227+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d7740b73d0 0x55d7740b9890 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740b9fe0 con 0x55d7740b73d0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c7772640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d7740b73d0 0x55d7740b9890 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25bffff640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249003cfb0 0x7f249003f470 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55d77408a900 tx=0x7f25b0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c7772640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d7740b73d0 0x55d7740b9890 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 20 realm 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740ba3f0 con 0x55d7740b73d0 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.228+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bacc0 con 0x55d7740b73d0 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c9487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d7740bbb50 0x55d7740bdf40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740be680 con 0x55d7740bbb50 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c6f71640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d7740bbb50 0x55d7740bdf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.229+0000 7f25c6f71640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d7740bbb50 0x55d7740bdf40 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.230+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.230+0000 7f25c9487800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.230+0000 7f25c9487800 20 searching for the correct realm 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.230+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740c0720 0x55d7740c2be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.230+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c32b0 con 0x55d7740c0720 2024-09-19T11:13:55.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.230+0000 7f25bffff640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740c0720 0x55d7740c2be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.230+0000 7f25bffff640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740c0720 0x55d7740c2be0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.231+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0037040 con 0x55d7740c0720 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.231+0000 7f25bffff640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25b000f070 0x7f25b002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.231+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c32b0 con 0x7f25b000f070 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.231+0000 7f25c7772640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25b000f070 0x7f25b002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.231+0000 7f25c7772640 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25b000f070 0x7f25b002e910 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.231+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.231+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.232+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.232+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.232+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.232+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.232+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.232+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.232+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.232+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.233+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.233+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x7f25b000f070 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.233+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.233+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.233+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0037040 con 0x55d7740c0720 2024-09-19T11:13:55.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.233+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.233+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.233+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x7f25b000f070 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0037040 con 0x55d7740c0720 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f25b0037040 con 0x55d7740c0720 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.234+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.235+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.235+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.235+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0037040 con 0x55d7740c0720 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.235+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.235+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0037040 con 0x55d7740c0720 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.235+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.235+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.235+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.236+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.236+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.236+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.236+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.236+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0037040 con 0x55d7740c0720 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.236+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x7f25b000f070 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.236+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.236+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.237+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.237+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.237+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.237+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.237+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0037040 con 0x55d7740c0720 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.237+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.237+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.237+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x7f25b000f070 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.238+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.238+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.238+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.238+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.238+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.238+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.238+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.238+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x7f25b000f070 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:55.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bf020 con 0x55d7740b73d0 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bf020 con 0x55d7740b73d0 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740beff0 con 0x55d7740c0720 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 zone default found 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 4 Realm: () 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 zonegroup default 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.239+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bf8c0 con 0x55d7740bbb50 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.240+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.240+0000 7f25c9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.240+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.240+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c5120 con 0x55d7740c0720 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.240+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.240+0000 7f25c9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.240+0000 7f25c9487800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.240+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c54c0 con 0x55d7740c0720 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.241+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.241+0000 7f25c9487800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.241+0000 7f25c9487800 20 started sync module instance, tier type = 2024-09-19T11:13:55.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.241+0000 7f25c9487800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.241+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c45c0 con 0x7f25b000f070 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.242+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.242+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94383853292256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c45c0 con 0x7f25b000f070 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.242+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c5fe0 con 0x55d7740b73d0 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.243+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94383853292256] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.243+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.243+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94383853289744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c5fa0 con 0x55d7740b73d0 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.243+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c6aa0 con 0x55d7740c0720 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.244+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94383853289744] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.244+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.244+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94383853296368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c5f10 con 0x55d7740c0720 2024-09-19T11:13:55.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.244+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c7960 con 0x7f25b000f070 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.245+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.245+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94383853303440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c80e0 con 0x7f25b000f070 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.245+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8be0 con 0x55d7740b73d0 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.245+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94383853296368] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.246+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94383853303440] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.246+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.246+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94383853307600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740b73d0 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.246+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c94b0 con 0x55d7740bbb50 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.247+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.247+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94383853309952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740bbb50 2024-09-19T11:13:55.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.247+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740ca3b0 con 0x55d7740bbb50 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.247+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94383853307600] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.248+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.248+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94383853313696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740ca7a0 con 0x55d7740bbb50 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.248+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94383853309952] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.248+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c9850 con 0x55d7740bbb50 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94383853313696] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'90 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94383853312080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740cacb0 con 0x55d7740bbb50 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c9487800 20 add_watcher() i=0 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c9487800 20 add_watcher() i=1 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c9487800 20 add_watcher() i=2 2024-09-19T11:13:55.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c9487800 20 add_watcher() i=3 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c9487800 20 add_watcher() i=4 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c9487800 20 add_watcher() i=5 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.250+0000 7f25c9487800 20 add_watcher() i=6 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.251+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94383853312080] v35'91 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.251+0000 7f25c9487800 20 add_watcher() i=7 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.251+0000 7f25c9487800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.251+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55d7740ce190 con 0x55d7740b73d0 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.251+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.251+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94383853317296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740cb5f0 con 0x55d7740b73d0 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.252+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94383853317296] v35'94 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f247d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f25c9487800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:55.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f25c9487800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f25c9487800 5 note: GC not initialized 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f23f7fff640 20 reqs_thread_entry: start 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f25c9487800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f25c9487800 20 Filter name: none 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f23f5ffb640 20 reqs_thread_entry: start 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:62 8.0 8:00000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7741006b0 con 0x55d7740c0720 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(62 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.253+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:63 8.10 8:08000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7741006b0 con 0x55d7740c0720 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.254+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(63 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.254+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 8.8 8:10000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7741006b0 con 0x55d7740b73d0 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.254+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(64 [pgnls start_epoch 35 out=49b] v35'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.254+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 8.18 8:18000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.254+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 [pgnls start_epoch 35 out=49b] v35'11 uv11 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.254+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 8.4 8:20000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x7f25b000f070 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.254+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.254+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 8.14 8:28000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.255+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(67 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.255+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 8.c 8:30000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.255+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.255+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 8.1c 8:38000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.255+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(69 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.255+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 8.2 8:40000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x7f25b000f070 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.255+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 [pgnls start_epoch 35 out=49b] v35'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.255+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 8.12 8:48000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.256+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(71 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.256+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 8.a 8:50000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.256+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(72 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.256+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 8.1a 8:58000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740bbb50 2024-09-19T11:13:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.256+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(73 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.256+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 8.6 8:60000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740bbb50 2024-09-19T11:13:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.257+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(74 [pgnls start_epoch 35 out=127b] v35'1 uv1 ondisk = 1) ==== 144+0+127 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.257+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 8.16 8:68000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740c0720 2024-09-19T11:13:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.257+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(75 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.257+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 8.e 8:70000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740bbb50 2024-09-19T11:13:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.257+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(76 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.257+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 8.1e 8:78000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740bbb50 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.257+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(77 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.257+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 8.1 8:80000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740bbb50 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(78 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 8.11 8:88000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740c0720 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(79 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:80 8.9 8:90000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x7f25b000f070 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(80 [pgnls start_epoch 35 out=70b] v35'2 uv2 ondisk = 1) ==== 144+0+70 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 8.19 8:98000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740b73d0 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(81 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:82 8.5 8:a0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740b73d0 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.258+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(82 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.259+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:83 8.15 8:a8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740c0720 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.259+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(83 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.259+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:84 8.d 8:b0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x7f25b000f070 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.259+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(84 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.259+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 8.1d 8:b8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740bbb50 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.259+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(85 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.259+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:86 8.3 8:c0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740b73d0 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.260+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(86 [pgnls start_epoch 35 out=49b] v35'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.260+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:87 8.13 8:c8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740bbb50 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.260+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(87 [pgnls start_epoch 35 out=49b] v35'2 uv2 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.260+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:88 8.b 8:d0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740c0720 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.260+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(88 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.260+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:89 8.1b 8:d8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x7f25b000f070 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.260+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(89 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.260+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 8.7 8:e0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740bbb50 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(90 [pgnls start_epoch 35 out=49b] v35'1 uv1 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:91 8.17 8:e8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740b73d0 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(91 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:92 8.f 8:f0000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x55d7740c0720 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(92 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 8.1f 8:f8000000:root:::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c8ba0 con 0x7f25b000f070 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(93 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25c9487800 20 RGWRados::pool_iterate: got .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.261+0000 7f25c9487800 20 RGWRados::pool_iterate: got myfoo 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.262+0000 7f247d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.262+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94383853317296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.263+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94383853317296] v35'95 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.263+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94383853292256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x7f25b000f070 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.264+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94383853292256] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.264+0000 7f25c9487800 20 remove_watcher() i=0 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.264+0000 7f25c9487800 2 removed watcher, disabling cache 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.264+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94383853289744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740b73d0 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.265+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94383853289744] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.265+0000 7f25c9487800 20 remove_watcher() i=1 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.265+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94383853296368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740bb060 con 0x55d7740c0720 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.266+0000 7f25bffff640 1 -- 172.21.15.102:0/487467250 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94383853296368] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b0049040 con 0x55d7740c0720 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.266+0000 7f25c9487800 20 remove_watcher() i=2 2024-09-19T11:13:55.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.266+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94383853303440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740fe8b0 con 0x7f25b000f070 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.267+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94383853303440] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x7f25b000f070 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.267+0000 7f25c9487800 20 remove_watcher() i=3 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.267+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94383853307600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740fe8b0 con 0x55d7740b73d0 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.268+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94383853307600] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25c000a4d0 con 0x55d7740b73d0 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.268+0000 7f25c9487800 20 remove_watcher() i=4 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.269+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94383853309952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740fe8b0 con 0x55d7740bbb50 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.269+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94383853309952] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.269+0000 7f25c9487800 20 remove_watcher() i=5 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.269+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94383853313696] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c4110 con 0x55d7740bbb50 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.270+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94383853313696] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.270+0000 7f25c9487800 20 remove_watcher() i=6 2024-09-19T11:13:55.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.270+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94383853312080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55d7740c5af0 con 0x55d7740bbb50 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.271+0000 7f25c6f71640 1 -- 172.21.15.102:0/487467250 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94383853312080] v35'92 uv90 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f25b80c2030 con 0x55d7740bbb50 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.271+0000 7f25c9487800 20 remove_watcher() i=7 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.271+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d7740bbb50 msgr2=0x55d7740bdf40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d7740bbb50 0x55d7740bdf40 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d7740b73d0 msgr2=0x55d7740b9890 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d7740b73d0 0x55d7740b9890 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25b000f070 msgr2=0x7f25b002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f25b000f070 0x7f25b002e910 crc :-1 s=READY pgs=39 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740c0720 msgr2=0x55d7740c2be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740c0720 0x55d7740c2be0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249003cfb0 msgr2=0x7f249003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f249003cfb0 0x7f249003f470 secure :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0x55d77408a900 tx=0x7f25b0010000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 msgr2=0x55d7740abe90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740abe90 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7f25b8005a60 tx=0x7f25b807ada0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c7772640 1 -- 172.21.15.102:0/487467250 reap_dead start 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 shutdown_connections 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/487467250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d7740a4a50 0x55d7740abe90 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 >> 172.21.15.102:0/487467250 conn(0x55d7740a0e50 msgr2=0x55d77409f060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 shutdown_connections 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/487467250 wait complete. 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/4105899505 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 msgr2=0x7f24a003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/4105899505 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 secure :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0x55d77407e7c0 tx=0x7f25b000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/4105899505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d774098260 msgr2=0x55d774098680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/4105899505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d774098260 0x55d774098680 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7f25b801bb90 tx=0x7f25b80647f0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/4105899505 shutdown_connections 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/4105899505 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24a003d000 0x7f24a003f4c0 unknown :-1 s=CLOSED pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 --2- 172.21.15.102:0/4105899505 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d774098260 0x55d774098680 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/4105899505 >> 172.21.15.102:0/4105899505 conn(0x55d77408c610 msgr2=0x55d77408c9f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/4105899505 shutdown_connections 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.272+0000 7f25c9487800 1 -- 172.21.15.102:0/4105899505 wait complete. 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d774083960 msgr2=0x55d774085e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55d774083960 0x55d774085e00 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d773f82800 msgr2=0x55d774081190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55d773f82800 0x55d774081190 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740879f0 msgr2=0x55d774089de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55d7740879f0 0x55d774089de0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24ac03d000 msgr2=0x7f24ac03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f24ac03d000 0x7f24ac03f4c0 secure :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0x7f25b0001e30 tx=0x7f25b0001390 comp rx=0 tx=0).stop 2024-09-19T11:13:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 msgr2=0x55d773f7ede0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 --2- 172.21.15.102:0/4090080401 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55d773f7fcf0 0x55d773f7ede0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f25b8067040 tx=0x7f25b8002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c7772640 1 -- 172.21.15.102:0/4090080401 reap_dead start 2024-09-19T11:13:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 shutdown_connections 2024-09-19T11:13:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 >> 172.21.15.102:0/4090080401 conn(0x55d773f7a1b0 msgr2=0x55d774070580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 shutdown_connections 2024-09-19T11:13:55.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.273+0000 7f25c9487800 1 -- 172.21.15.102:0/4090080401 wait complete. 2024-09-19T11:13:55.289 INFO:teuthology.orchestra.run.smithi102.stdout:["myfoo"] 2024-09-19T11:13:55.289 DEBUG:tasks.util.rgw: json result: ['myfoo'] 2024-09-19T11:13:55.299 INFO:tasks.radosgw_admin:RL: create_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:55.311 INFO:tasks.radosgw_admin:RL: create_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:55.320 INFO:tasks.radosgw_admin:RL: create_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:55.365 INFO:tasks.radosgw_admin:RL: create_bucket myfoo5 foo bytes_out=0 bytes_in=237 failed=True 2024-09-19T11:13:55.395 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo2 foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:55.423 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo3 foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:55.451 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo4 foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:55.451 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-19T11:13:55.451 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-19T11:13:55.451 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-19T11:13:55.495 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:55.495 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4c0212c800 1 Processor -- start 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4c0212c800 1 -- start start 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4c0212c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5612c96b4890 0x5612c96b5450 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4c0212c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5612c96b4f40 con 0x5612c96b5990 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4c0212c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5612c953f7d0 con 0x5612c96b4890 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4bfde4f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5612c96b4890 0x5612c96b5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4bfde4f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5612c96b4890 0x5612c96b5450 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43798/0 (socket says 172.21.15.102:43798) 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4bfde4f640 1 -- 172.21.15.102:0/1508376661 learned_addr learned my addr 172.21.15.102:0/1508376661 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.495+0000 7f4bf7fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5612c96b5990 0x5612c96ba6f0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52438/0 (socket says 172.21.15.102:52438) 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.496+0000 7f4bfde4f640 1 -- 172.21.15.102:0/1508376661 >> v1:172.21.15.37:6789/0 conn(0x5612c96b5990 legacy=0x5612c96ba6f0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.496+0000 7f4bfde4f640 1 -- 172.21.15.102:0/1508376661 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c96b5e40 con 0x5612c96b4890 2024-09-19T11:13:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.497+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/1508376661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c96b5450 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000a520 tx=0x7f4bf0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7aad574ca9c96957 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4bfd64e640 1 -- 172.21.15.102:0/1508376661 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf0055070 con 0x5612c96b4890 2024-09-19T11:13:55.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4bfd64e640 1 -- 172.21.15.102:0/1508376661 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf00515b0 con 0x5612c96b4890 2024-09-19T11:13:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4bfd64e640 1 -- 172.21.15.102:0/1508376661 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf00518d0 con 0x5612c96b4890 2024-09-19T11:13:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4c0212c800 1 -- 172.21.15.102:0/1508376661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 msgr2=0x5612c96b5450 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4c0212c800 1 --2- 172.21.15.102:0/1508376661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c96b5450 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7f4bf000a520 tx=0x7f4bf0045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4c0212c800 1 -- 172.21.15.102:0/1508376661 shutdown_connections 2024-09-19T11:13:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4c0212c800 1 --2- 172.21.15.102:0/1508376661 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c96b5450 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4c0212c800 1 -- 172.21.15.102:0/1508376661 >> 172.21.15.102:0/1508376661 conn(0x5612c96afc60 msgr2=0x5612c96b20c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4c0212c800 1 -- 172.21.15.102:0/1508376661 shutdown_connections 2024-09-19T11:13:55.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.498+0000 7f4c0212c800 1 -- 172.21.15.102:0/1508376661 wait complete. 2024-09-19T11:13:55.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.512+0000 7f4c0212c800 1 Processor -- start 2024-09-19T11:13:55.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.512+0000 7f4c0212c800 1 -- start start 2024-09-19T11:13:55.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.512+0000 7f4c0212c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97a42e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.512+0000 7f4c0212c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612c954cdd0 con 0x5612c96b4890 2024-09-19T11:13:55.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.512+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97a42e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.512+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97a42e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43802/0 (socket says 172.21.15.102:43802) 2024-09-19T11:13:55.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.512+0000 7f4bfde4f640 1 -- 172.21.15.102:0/1416388838 learned_addr learned my addr 172.21.15.102:0/1416388838 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.512+0000 7f4bfde4f640 1 -- 172.21.15.102:0/1416388838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c97a48d0 con 0x5612c96b4890 2024-09-19T11:13:55.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.513+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/1416388838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97a42e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0025da0 tx=0x7f4bf0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7f6603ce07d7a1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.513+0000 7f4aebe07640 1 -- 172.21.15.102:0/1416388838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf0051950 con 0x5612c96b4890 2024-09-19T11:13:55.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.513+0000 7f4aebe07640 1 -- 172.21.15.102:0/1416388838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf0051af0 con 0x5612c96b4890 2024-09-19T11:13:55.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.513+0000 7f4aebe07640 1 -- 172.21.15.102:0/1416388838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf0051dd0 con 0x5612c96b4890 2024-09-19T11:13:55.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 -- 172.21.15.102:0/1416388838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 msgr2=0x5612c97a42e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 --2- 172.21.15.102:0/1416388838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97a42e0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0025da0 tx=0x7f4bf0051000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 -- 172.21.15.102:0/1416388838 shutdown_connections 2024-09-19T11:13:55.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 --2- 172.21.15.102:0/1416388838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97a42e0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 -- 172.21.15.102:0/1416388838 >> 172.21.15.102:0/1416388838 conn(0x5612c96afc60 msgr2=0x5612c979fc60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 -- 172.21.15.102:0/1416388838 shutdown_connections 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 -- 172.21.15.102:0/1416388838 wait complete. 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 Processor -- start 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 -- start start 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97abc50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4c0212c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612c96bbe10 con 0x5612c96b4890 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97abc50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97abc50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43808/0 (socket says 172.21.15.102:43808) 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.514+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4002804650 learned_addr learned my addr 172.21.15.102:0/4002804650 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.515+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4002804650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c97ac1b0 con 0x5612c96b4890 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.515+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97abc50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0067040 tx=0x7f4bf0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.515+0000 7f4aea604640 1 -- 172.21.15.102:0/4002804650 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf0073070 con 0x5612c96b4890 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.515+0000 7f4aea604640 1 -- 172.21.15.102:0/4002804650 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf005a450 con 0x5612c96b4890 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.515+0000 7f4aea604640 1 -- 172.21.15.102:0/4002804650 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf005a730 con 0x5612c96b4890 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.515+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612c97ac440 con 0x5612c96b4890 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.515+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c97ad050 con 0x5612c96b4890 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.516+0000 7f4aea604640 1 -- 172.21.15.102:0/4002804650 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4bf0076070 con 0x5612c96b4890 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.516+0000 7f4aea604640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ae403cfb0 0x7f4ae403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.516+0000 7f4aea604640 1 -- 172.21.15.102:0/4002804650 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4bf0062070 con 0x5612c96b4890 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.516+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ae403cfb0 0x7f4ae403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.516+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c96b5990 0x5612c97b32a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.516+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97b37e0 con 0x5612c96b5990 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.516+0000 7f4bfe650640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c96b5990 0x5612c97b32a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.516+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ae403cfb0 0x7f4ae403f470 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4be8001e30 tx=0x7f4be8001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.517+0000 7f4bfe650640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c96b5990 0x5612c97b32a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.517+0000 7f4bfe650640 1 -- 172.21.15.102:0/4002804650 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c96b5990 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.517+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97b3b80 con 0x5612c96b5990 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.517+0000 7f4bfe650640 1 -- 172.21.15.102:0/4002804650 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c96b5990 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.517+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97b5640 0x5612c97b7ae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.517+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97b8270 con 0x5612c97b5640 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.517+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97b5640 0x5612c97b7ae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.518+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97b5640 0x5612c97b7ae0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.518+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4002804650 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4bf007f070 con 0x5612c97b5640 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.518+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97b43d0 con 0x5612c96b5990 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.518+0000 7f4bfe650640 1 -- 172.21.15.102:0/4002804650 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c96b5990 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.518+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97b96d0 0x5612c97bbac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.518+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97bc200 con 0x5612c97b96d0 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.519+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97b96d0 0x5612c97bbac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.519+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97b96d0 0x5612c97bbac0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.519+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4002804650 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4be800bd50 con 0x5612c97b96d0 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.519+0000 7f4c0212c800 1 Processor -- start 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.519+0000 7f4c0212c800 1 -- start start 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4c0212c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97c9f80 0x5612c97ca3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4c0212c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612c95ab4a0 con 0x5612c97c9f80 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97c9f80 0x5612c97ca3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97c9f80 0x5612c97ca3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43816/0 (socket says 172.21.15.102:43816) 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4252471264 learned_addr learned my addr 172.21.15.102:0/4252471264 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4252471264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c97ca9e0 con 0x5612c97c9f80 2024-09-19T11:13:55.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/4252471264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97c9f80 0x5612c97ca3a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0050e30 tx=0x7f4bf005af70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4ae37fe640 1 -- 172.21.15.102:0/4252471264 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf007d040 con 0x5612c97c9f80 2024-09-19T11:13:55.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4ae37fe640 1 -- 172.21.15.102:0/4252471264 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf00645c0 con 0x5612c97c9f80 2024-09-19T11:13:55.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4c0212c800 1 -- 172.21.15.102:0/4252471264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612c97cb210 con 0x5612c97c9f80 2024-09-19T11:13:55.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4ae37fe640 1 -- 172.21.15.102:0/4252471264 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf00648a0 con 0x5612c97c9f80 2024-09-19T11:13:55.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.520+0000 7f4c0212c800 1 -- 172.21.15.102:0/4252471264 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c97cb7b0 con 0x5612c97c9f80 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.521+0000 7f4ae37fe640 1 -- 172.21.15.102:0/4252471264 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4bf0058070 con 0x5612c97c9f80 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.521+0000 7f4ae37fe640 1 --2- 172.21.15.102:0/4252471264 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ad803d000 0x7f4ad803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.521+0000 7f4ae37fe640 1 -- 172.21.15.102:0/4252471264 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4bf0088070 con 0x5612c97c9f80 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.521+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4252471264 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ad803d000 0x7f4ad803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4c0212c800 1 Processor -- start 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4c0212c800 1 -- start start 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4252471264 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ad803d000 0x7f4ad803f4c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5612c97b8640 tx=0x7f4be800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4c0212c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97d6c20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4c0212c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612c97a4c40 con 0x5612c97d6820 2024-09-19T11:13:55.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97d6c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97d6c20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43820/0 (socket says 172.21.15.102:43820) 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4bfde4f640 1 -- 172.21.15.102:0/1154098341 learned_addr learned my addr 172.21.15.102:0/1154098341 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4bfde4f640 1 -- 172.21.15.102:0/1154098341 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c97d7210 con 0x5612c97d6820 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.522+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/1154098341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97d6c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0054000 tx=0x7f4bf0098370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2112859e09bb1ee5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4ae17fa640 1 -- 172.21.15.102:0/1154098341 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf00aa020 con 0x5612c97d6820 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4ae17fa640 1 -- 172.21.15.102:0/1154098341 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf0066030 con 0x5612c97d6820 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4ae17fa640 1 -- 172.21.15.102:0/1154098341 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf008fb60 con 0x5612c97d6820 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 -- 172.21.15.102:0/1154098341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 msgr2=0x5612c97d6c20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 --2- 172.21.15.102:0/1154098341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97d6c20 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0054000 tx=0x7f4bf0098370 comp rx=0 tx=0).stop 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 -- 172.21.15.102:0/1154098341 shutdown_connections 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 --2- 172.21.15.102:0/1154098341 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97d6c20 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 -- 172.21.15.102:0/1154098341 >> 172.21.15.102:0/1154098341 conn(0x5612c97d2c20 msgr2=0x5612c97d0e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 -- 172.21.15.102:0/1154098341 shutdown_connections 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 -- 172.21.15.102:0/1154098341 wait complete. 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 Processor -- start 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.523+0000 7f4c0212c800 1 -- start start 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4c0212c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97ddc20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4c0212c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5612c97d7680 con 0x5612c97d6820 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97ddc20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4bfde4f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97ddc20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43828/0 (socket says 172.21.15.102:43828) 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 learned_addr learned my addr 172.21.15.102:0/4102903972 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5612c97de180 con 0x5612c97d6820 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97ddc20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0070fd0 tx=0x7f4bf008af80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4acf7fe640 1 -- 172.21.15.102:0/4102903972 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf00be070 con 0x5612c97d6820 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4acf7fe640 1 -- 172.21.15.102:0/4102903972 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bf0094a70 con 0x5612c97d6820 2024-09-19T11:13:55.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4acf7fe640 1 -- 172.21.15.102:0/4102903972 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bf0094d50 con 0x5612c97d6820 2024-09-19T11:13:55.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.524+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5612c97de180 con 0x5612c97d6820 2024-09-19T11:13:55.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.525+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5612c97de180 con 0x5612c97d6820 2024-09-19T11:13:55.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.525+0000 7f4acf7fe640 1 -- 172.21.15.102:0/4102903972 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4bf00c1070 con 0x5612c97d6820 2024-09-19T11:13:55.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.525+0000 7f4acf7fe640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac803d000 0x7f4ac803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.526+0000 7f4acf7fe640 1 -- 172.21.15.102:0/4102903972 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4bf00c4ca0 con 0x5612c97d6820 2024-09-19T11:13:55.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.526+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac803d000 0x7f4ac803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.526+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.526+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c97e9090 0x5612c97eb500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.526+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97ebc50 con 0x5612c97e9090 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.526+0000 7f4bfe650640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c97e9090 0x5612c97eb500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.526+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac803d000 0x7f4ac803f4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5612c97ad750 tx=0x7f4be8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.526+0000 7f4bfe650640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c97e9090 0x5612c97eb500 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 realm 2024-09-19T11:13:55.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97ec060 con 0x5612c97e9090 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97ec930 con 0x5612c97e9090 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97ed7c0 0x5612c97efbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.527+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f02f0 con 0x5612c97ed7c0 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.528+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97ed7c0 0x5612c97efbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.528+0000 7f4bfde4f640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97ed7c0 0x5612c97efbb0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.528+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.528+0000 7f4c0212c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.528+0000 7f4c0212c800 20 searching for the correct realm 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.528+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97f2390 0x5612c97f4850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.528+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f4f20 con 0x5612c97f2390 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.528+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97f2390 0x5612c97f4850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.529+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97f2390 0x5612c97f4850 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.529+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8037040 con 0x5612c97f2390 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.529+0000 7f4bf7fff640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4be800f070 0x7f4be802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.529+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f4f20 con 0x7f4be800f070 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.529+0000 7f4bfe650640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4be800f070 0x7f4be802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.529+0000 7f4bfe650640 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4be800f070 0x7f4be802e910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.529+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.529+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.530+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.530+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.530+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.530+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.530+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.530+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.530+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.530+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.531+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.531+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x7f4be800f070 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.531+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.531+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97f2390 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.531+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8037040 con 0x5612c97f2390 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.531+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.531+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.531+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x7f4be800f070 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97f2390 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8037040 con 0x5612c97f2390 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97f2390 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4be8037040 con 0x5612c97f2390 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.532+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.533+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.533+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97f2390 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.533+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8037040 con 0x5612c97f2390 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.533+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97f2390 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.533+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8037040 con 0x5612c97f2390 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.533+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.533+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.533+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.534+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.534+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.534+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.534+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97f2390 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.534+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8037040 con 0x5612c97f2390 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.534+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x7f4be800f070 2024-09-19T11:13:55.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.534+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.534+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.535+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.535+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.535+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.535+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97f2390 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.535+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8037040 con 0x5612c97f2390 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.535+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.535+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.535+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x7f4be800f070 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.536+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.536+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97f2390 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.536+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.536+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97ed7c0 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.536+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.536+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x5612c97e9090 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.536+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.536+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5612c97eccd0 con 0x7f4be800f070 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:55.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f0c90 con 0x5612c97e9090 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f0c90 con 0x5612c97e9090 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f0c90 con 0x5612c97f2390 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 zone default found 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 4 Realm: () 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 zonegroup default 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.537+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f1530 con 0x5612c97ed7c0 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f6d90 con 0x5612c97f2390 2024-09-19T11:13:55.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f7130 con 0x5612c97f2390 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 20 started sync module instance, tier type = 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.538+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f6230 con 0x7f4be800f070 2024-09-19T11:13:55.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.539+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.539+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94638689969968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f6230 con 0x7f4be800f070 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.539+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f7b70 con 0x5612c97e9090 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.540+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94638689969968] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.540+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.540+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94638689973824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f6230 con 0x5612c97e9090 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.540+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f85f0 con 0x5612c97f2390 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.541+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.541+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94638689976576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f8ec0 con 0x5612c97f2390 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.541+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f99c0 con 0x7f4be800f070 2024-09-19T11:13:55.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.542+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94638689973824] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.542+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.542+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94638689981616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97f9db0 con 0x7f4be800f070 2024-09-19T11:13:55.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.542+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fa7d0 con 0x5612c97e9090 2024-09-19T11:13:55.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.542+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94638689976576] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.544+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.544+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94638689985216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fa790 con 0x5612c97e9090 2024-09-19T11:13:55.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.544+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fb1e0 con 0x5612c97ed7c0 2024-09-19T11:13:55.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.544+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94638689981616] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.545+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.545+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94638689987888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fb5d0 con 0x5612c97ed7c0 2024-09-19T11:13:55.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.545+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fbf90 con 0x5612c97ed7c0 2024-09-19T11:13:55.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.545+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94638689985216] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.546+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.546+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94638689978896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fc830 con 0x5612c97ed7c0 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.546+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fd080 con 0x5612c97ed7c0 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.546+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94638689987888] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94638689978896] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'93 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94638689967488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fcd00 con 0x5612c97ed7c0 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4c0212c800 20 add_watcher() i=0 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4c0212c800 20 add_watcher() i=1 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4c0212c800 20 add_watcher() i=2 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4c0212c800 20 add_watcher() i=3 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4c0212c800 20 add_watcher() i=4 2024-09-19T11:13:55.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4c0212c800 20 add_watcher() i=5 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.547+0000 7f4c0212c800 20 add_watcher() i=6 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.548+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94638689967488] v35'94 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.548+0000 7f4c0212c800 20 add_watcher() i=7 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.548+0000 7f4c0212c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.548+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fff50 con 0x5612c97e9090 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.548+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.548+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94638689995200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c97fd290 con 0x5612c97e9090 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.549+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94638689995200] v35'96 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.549+0000 7f4aaf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.549+0000 7f4c0212c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.549+0000 7f4c0212c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.549+0000 7f4c0212c800 5 note: GC not initialized 2024-09-19T11:13:55.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.549+0000 7f4aae7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.549+0000 7f4c0212c800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.550+0000 7f4c0212c800 20 Filter name: none 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.550+0000 7f4a1ffff640 20 reqs_thread_entry: start 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.550+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.550+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9832e70 con 0x7f4be800f070 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.550+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.550+0000 7f4c0212c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.550+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.550+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9833700 con 0x5612c97ed7c0 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4c0212c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:55.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4c0212c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c98338c0 con 0x7f4be800f070 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4c0212c800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4c0212c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.551+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9834d30 con 0x5612c97ed7c0 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(65 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:55.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 4.e 4:735adac5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9836620 con 0x7f4be800f070 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 4.15 4:a8990202:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9839030 con 0x5612c97f2390 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 4.0 4:015ead7d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c983b990 con 0x5612c97f2390 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 4.2a 4:54dc5602:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c983e390 con 0x5612c97e9090 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 4.28 4:14a92d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9841200 con 0x5612c97e9090 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 4.4 4:22751d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c98440c0 con 0x5612c97ed7c0 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 4.2d 4:b7aa4218:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9841240 con 0x5612c97ed7c0 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 4.1f 4:f9ffeb7c:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9849550 con 0x5612c97f2390 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 4.e 4:72d65baa:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c984c030 con 0x7f4be800f070 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:75 4.1 4:80601e6d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c984e900 con 0x7f4be800f070 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:76 4.0 4:02fa5d61:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5612c9851310 con 0x5612c97f2390 2024-09-19T11:13:55.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(66 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(69 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(70 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(75 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(73 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(67 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.552+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.553+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(72 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.553+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.553+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(76 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.553+0000 7f4aaf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.554+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94638689995200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9841240 con 0x5612c97e9090 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.554+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94638689995200] v35'97 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.554+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94638689969968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9830830 con 0x7f4be800f070 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.555+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94638689969968] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.555+0000 7f4c0212c800 20 remove_watcher() i=0 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.555+0000 7f4c0212c800 2 removed watcher, disabling cache 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.555+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94638689973824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9830830 con 0x5612c97e9090 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.557+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94638689973824] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.557+0000 7f4c0212c800 20 remove_watcher() i=1 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.557+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94638689976576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9830830 con 0x5612c97f2390 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.558+0000 7f4bf7fff640 1 -- 172.21.15.102:0/4102903972 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94638689976576] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4be8049040 con 0x5612c97f2390 2024-09-19T11:13:55.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.558+0000 7f4c0212c800 20 remove_watcher() i=2 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.558+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94638689981616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9830830 con 0x7f4be800f070 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.559+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94638689981616] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x7f4be800f070 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.559+0000 7f4c0212c800 20 remove_watcher() i=3 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.559+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94638689985216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9830830 con 0x5612c97e9090 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.560+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94638689985216] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf800a4d0 con 0x5612c97e9090 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.560+0000 7f4c0212c800 20 remove_watcher() i=4 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.560+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94638689987888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9830830 con 0x5612c97ed7c0 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.560+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94638689987888] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.561+0000 7f4c0212c800 20 remove_watcher() i=5 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.561+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94638689978896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9830830 con 0x5612c97ed7c0 2024-09-19T11:13:55.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.561+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94638689978896] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.561+0000 7f4c0212c800 20 remove_watcher() i=6 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.561+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94638689967488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5612c9830830 con 0x5612c97ed7c0 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.562+0000 7f4bfde4f640 1 -- 172.21.15.102:0/4102903972 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94638689967488] v35'95 uv93 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bf00c0030 con 0x5612c97ed7c0 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.562+0000 7f4c0212c800 20 remove_watcher() i=7 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97ed7c0 msgr2=0x5612c97efbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97ed7c0 0x5612c97efbb0 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c97e9090 msgr2=0x5612c97eb500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c97e9090 0x5612c97eb500 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4be800f070 msgr2=0x7f4be802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4be800f070 0x7f4be802e910 crc :-1 s=READY pgs=40 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97f2390 msgr2=0x5612c97f4850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97f2390 0x5612c97f4850 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac803d000 msgr2=0x7f4ac803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac803d000 0x7f4ac803f4c0 secure :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0x5612c97ad750 tx=0x7f4be8010000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 msgr2=0x5612c97ddc20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4102903972 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97d6820 0x5612c97ddc20 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0070fd0 tx=0x7f4bf008af80 comp rx=0 tx=0).stop 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 reap_dead start 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4bfe650640 1 -- 172.21.15.102:0/4102903972 reap_dead start 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 shutdown_connections 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 >> 172.21.15.102:0/4102903972 conn(0x5612c97d2c20 msgr2=0x5612c97d0e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 shutdown_connections 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4102903972 wait complete. 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4252471264 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ad803d000 msgr2=0x7f4ad803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4252471264 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ad803d000 0x7f4ad803f4c0 secure :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0x5612c97b8640 tx=0x7f4be800f000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4252471264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97c9f80 msgr2=0x5612c97ca3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4252471264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97c9f80 0x5612c97ca3a0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0050e30 tx=0x7f4bf005af70 comp rx=0 tx=0).stop 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4252471264 shutdown_connections 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4252471264 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ad803d000 0x7f4ad803f4c0 unknown :-1 s=CLOSED pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4252471264 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c97c9f80 0x5612c97ca3a0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4252471264 >> 172.21.15.102:0/4252471264 conn(0x5612c97be330 msgr2=0x5612c97be710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4252471264 shutdown_connections 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.563+0000 7f4c0212c800 1 -- 172.21.15.102:0/4252471264 wait complete. 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97b5640 msgr2=0x5612c97b7ae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5612c97b5640 0x5612c97b7ae0 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c96b5990 msgr2=0x5612c97b32a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5612c96b5990 0x5612c97b32a0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97b96d0 msgr2=0x5612c97bbac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5612c97b96d0 0x5612c97bbac0 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ae403cfb0 msgr2=0x7f4ae403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ae403cfb0 0x7f4ae403f470 secure :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0x7f4be8001e30 tx=0x7f4be8001390 comp rx=0 tx=0).stop 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 msgr2=0x5612c97abc50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 --2- 172.21.15.102:0/4002804650 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5612c96b4890 0x5612c97abc50 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f4bf0067040 tx=0x7f4bf0002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4bfe650640 1 -- 172.21.15.102:0/4002804650 reap_dead start 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 shutdown_connections 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 >> 172.21.15.102:0/4002804650 conn(0x5612c96afc60 msgr2=0x5612c97a5610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 shutdown_connections 2024-09-19T11:13:55.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.564+0000 7f4c0212c800 1 -- 172.21.15.102:0/4002804650 wait complete. 2024-09-19T11:13:55.586 INFO:teuthology.orchestra.run.smithi102.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"68013f1d-b756-462e-83a9-97539995db13","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","marker":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-19T11:13:54.980611Z","creation_time":"2024-09-19T11:13:54.975364Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-19T11:13:55.586 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68013f1d-b756-462e-83a9-97539995db13', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-19T11:13:54.980611Z', 'creation_time': '2024-09-19T11:13:54.975364Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-19T11:13:55.587 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--uid', 'foo'] 2024-09-19T11:13:55.587 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--uid', 'foo'] 2024-09-19T11:13:55.587 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --uid foo 2024-09-19T11:13:55.631 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:55.632 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:55.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.631+0000 7f4d5f719800 1 Processor -- start 2024-09-19T11:13:55.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.631+0000 7f4d5f719800 1 -- start start 2024-09-19T11:13:55.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.631+0000 7f4d5f719800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5566d55c2ea0 0x5566d55c5290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.631+0000 7f4d5f719800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5566d55c95e0 con 0x5566d55c58c0 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.631+0000 7f4d5f719800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5566d544d7d0 con 0x5566d55c2ea0 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.632+0000 7f4d5d20a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5566d55c2ea0 0x5566d55c5290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.632+0000 7f4d5d20a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5566d55c2ea0 0x5566d55c5290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43840/0 (socket says 172.21.15.102:43840) 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.632+0000 7f4d54a09640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5566d55c58c0 0x5566d55c7d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52446/0 (socket says 172.21.15.102:52446) 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.632+0000 7f4d5d20a640 1 -- 172.21.15.102:0/639105883 learned_addr learned my addr 172.21.15.102:0/639105883 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.632+0000 7f4d5d20a640 1 -- 172.21.15.102:0/639105883 >> v1:172.21.15.37:6789/0 conn(0x5566d55c58c0 legacy=0x5566d55c7d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.632+0000 7f4d5ca09640 1 -- 172.21.15.102:0/639105883 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3962861632 0 0) 0x5566d55c95e0 con 0x5566d55c58c0 2024-09-19T11:13:55.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.632+0000 7f4d5d20a640 1 -- 172.21.15.102:0/639105883 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d55ca810 con 0x5566d55c2ea0 2024-09-19T11:13:55.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/639105883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c5290 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000a520 tx=0x7f4d50045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3c204715e5b58f55 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5ca09640 1 -- 172.21.15.102:0/639105883 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50055070 con 0x5566d55c2ea0 2024-09-19T11:13:55.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5ca09640 1 -- 172.21.15.102:0/639105883 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d500515b0 con 0x5566d55c2ea0 2024-09-19T11:13:55.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5ca09640 1 -- 172.21.15.102:0/639105883 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d500518d0 con 0x5566d55c2ea0 2024-09-19T11:13:55.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5f719800 1 -- 172.21.15.102:0/639105883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 msgr2=0x5566d55c5290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5f719800 1 --2- 172.21.15.102:0/639105883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c5290 secure :-1 s=READY pgs=375 cs=0 l=1 rev1=1 crypto rx=0x7f4d5000a520 tx=0x7f4d50045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5f719800 1 -- 172.21.15.102:0/639105883 shutdown_connections 2024-09-19T11:13:55.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5f719800 1 --2- 172.21.15.102:0/639105883 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c5290 unknown :-1 s=CLOSED pgs=375 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5f719800 1 -- 172.21.15.102:0/639105883 >> 172.21.15.102:0/639105883 conn(0x5566d55bca60 msgr2=0x5566d55beec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5f719800 1 -- 172.21.15.102:0/639105883 shutdown_connections 2024-09-19T11:13:55.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.634+0000 7f4d5f719800 1 -- 172.21.15.102:0/639105883 wait complete. 2024-09-19T11:13:55.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.648+0000 7f4d5f719800 1 Processor -- start 2024-09-19T11:13:55.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.648+0000 7f4d5f719800 1 -- start start 2024-09-19T11:13:55.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.648+0000 7f4d5f719800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c2630 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.648+0000 7f4d5f719800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5566d545add0 con 0x5566d55c2ea0 2024-09-19T11:13:55.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.648+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.648+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43844/0 (socket says 172.21.15.102:43844) 2024-09-19T11:13:55.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.648+0000 7f4d5d20a640 1 -- 172.21.15.102:0/278626479 learned_addr learned my addr 172.21.15.102:0/278626479 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.649+0000 7f4d5d20a640 1 -- 172.21.15.102:0/278626479 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d55c2c20 con 0x5566d55c2ea0 2024-09-19T11:13:55.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.649+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/278626479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c2630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d50025da0 tx=0x7f4d50051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f17567c5e00e1b0c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.649+0000 7f4c4b606640 1 -- 172.21.15.102:0/278626479 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50051ac0 con 0x5566d55c2ea0 2024-09-19T11:13:55.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.649+0000 7f4c4b606640 1 -- 172.21.15.102:0/278626479 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d50051c60 con 0x5566d55c2ea0 2024-09-19T11:13:55.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.649+0000 7f4c4b606640 1 -- 172.21.15.102:0/278626479 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50066460 con 0x5566d55c2ea0 2024-09-19T11:13:55.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 -- 172.21.15.102:0/278626479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 msgr2=0x5566d55c2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 --2- 172.21.15.102:0/278626479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c2630 secure :-1 s=READY pgs=376 cs=0 l=1 rev1=1 crypto rx=0x7f4d50025da0 tx=0x7f4d50051000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 -- 172.21.15.102:0/278626479 shutdown_connections 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 --2- 172.21.15.102:0/278626479 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d55c2630 unknown :-1 s=CLOSED pgs=376 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 -- 172.21.15.102:0/278626479 >> 172.21.15.102:0/278626479 conn(0x5566d55bca60 msgr2=0x5566d56adac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 -- 172.21.15.102:0/278626479 shutdown_connections 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 -- 172.21.15.102:0/278626479 wait complete. 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 Processor -- start 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 -- start start 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d56bbdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5f719800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5566d55c9ab0 con 0x5566d55c2ea0 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.650+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d56bbdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d56bbdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43858/0 (socket says 172.21.15.102:43858) 2024-09-19T11:13:55.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4d5d20a640 1 -- 172.21.15.102:0/3703773561 learned_addr learned my addr 172.21.15.102:0/3703773561 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4d5d20a640 1 -- 172.21.15.102:0/3703773561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d56bc350 con 0x5566d55c2ea0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d56bbdf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5566d55c2160 tx=0x7f4d50003020 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4c49e03640 1 -- 172.21.15.102:0/3703773561 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50066650 con 0x5566d55c2ea0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4c49e03640 1 -- 172.21.15.102:0/3703773561 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d50066810 con 0x5566d55c2ea0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566d56bc5e0 con 0x5566d55c2ea0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4c49e03640 1 -- 172.21.15.102:0/3703773561 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d50066b30 con 0x5566d55c2ea0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.651+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d56bcfe0 con 0x5566d55c2ea0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.652+0000 7f4c49e03640 1 -- 172.21.15.102:0/3703773561 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4d50058070 con 0x5566d55c2ea0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.652+0000 7f4c49e03640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c4403cfb0 0x7f4c4403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.652+0000 7f4c49e03640 1 -- 172.21.15.102:0/3703773561 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4d50062070 con 0x5566d55c2ea0 2024-09-19T11:13:55.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.652+0000 7f4d54a09640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c4403cfb0 0x7f4c4403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.652+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d55c58c0 0x5566d56c3440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.652+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56c3980 con 0x5566d55c58c0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.653+0000 7f4d5da0b640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d55c58c0 0x5566d56c3440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.653+0000 7f4d54a09640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c4403cfb0 0x7f4c4403f470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d48000c00 tx=0x7f4d480013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.653+0000 7f4d5da0b640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d55c58c0 0x5566d56c3440 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.653+0000 7f4d5da0b640 1 -- 172.21.15.102:0/3703773561 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d55c58c0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.653+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56c3d20 con 0x5566d55c58c0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.653+0000 7f4d5da0b640 1 -- 172.21.15.102:0/3703773561 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d55c58c0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.653+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56c57e0 0x5566d56c7c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.653+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56c8410 con 0x5566d56c57e0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.654+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56c57e0 0x5566d56c7c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.654+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56c57e0 0x5566d56c7c80 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.654+0000 7f4d5d20a640 1 -- 172.21.15.102:0/3703773561 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4d50057030 con 0x5566d56c57e0 2024-09-19T11:13:55.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.654+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56c4570 con 0x5566d55c58c0 2024-09-19T11:13:55.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.655+0000 7f4d5da0b640 1 -- 172.21.15.102:0/3703773561 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d55c58c0 2024-09-19T11:13:55.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.655+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d56c9870 0x5566d56cbc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.655+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56cc3a0 con 0x5566d56c9870 2024-09-19T11:13:55.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.655+0000 7f4d54a09640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d56c9870 0x5566d56cbc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.655+0000 7f4d54a09640 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d56c9870 0x5566d56cbc60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.656+0000 7f4d54a09640 1 -- 172.21.15.102:0/3703773561 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4d4800f670 con 0x5566d56c9870 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.656+0000 7f4d5f719800 1 Processor -- start 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.656+0000 7f4d5f719800 1 -- start start 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.656+0000 7f4d5f719800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56da0e0 0x5566d56da500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.656+0000 7f4d5f719800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5566d54b94a0 con 0x5566d56da0e0 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.656+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56da0e0 0x5566d56da500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.656+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56da0e0 0x5566d56da500 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43864/0 (socket says 172.21.15.102:43864) 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.656+0000 7f4d5d20a640 1 -- 172.21.15.102:0/1304839633 learned_addr learned my addr 172.21.15.102:0/1304839633 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.657+0000 7f4d5d20a640 1 -- 172.21.15.102:0/1304839633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d56dab40 con 0x5566d56da0e0 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.657+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/1304839633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56da0e0 0x5566d56da500 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4d50072fd0 tx=0x7f4d5008fc20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.657+0000 7f4c42ffd640 1 -- 172.21.15.102:0/1304839633 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5005aaa0 con 0x5566d56da0e0 2024-09-19T11:13:55.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.657+0000 7f4c42ffd640 1 -- 172.21.15.102:0/1304839633 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d5007a360 con 0x5566d56da0e0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.657+0000 7f4d5f719800 1 -- 172.21.15.102:0/1304839633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566d56dab40 con 0x5566d56da0e0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.657+0000 7f4c42ffd640 1 -- 172.21.15.102:0/1304839633 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5005a450 con 0x5566d56da0e0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.657+0000 7f4d5f719800 1 -- 172.21.15.102:0/1304839633 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d56dab40 con 0x5566d56da0e0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4c42ffd640 1 -- 172.21.15.102:0/1304839633 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4d50089070 con 0x5566d56da0e0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4c42ffd640 1 --2- 172.21.15.102:0/1304839633 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c3403d000 0x7f4c3403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4c42ffd640 1 -- 172.21.15.102:0/1304839633 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4d50086070 con 0x5566d56da0e0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4d54a09640 1 --2- 172.21.15.102:0/1304839633 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c3403d000 0x7f4c3403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4d5f719800 1 Processor -- start 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4d5f719800 1 -- start start 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4d54a09640 1 --2- 172.21.15.102:0/1304839633 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c3403d000 0x7f4c3403f4c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5566d56cc7a0 tx=0x7f4d48006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4d5f719800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56e69b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.658+0000 7f4d5f719800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5566d55c0fc0 con 0x5566d56e65d0 2024-09-19T11:13:55.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.659+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56e69b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.659+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56e69b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43868/0 (socket says 172.21.15.102:43868) 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.659+0000 7f4d5d20a640 1 -- 172.21.15.102:0/3709433122 learned_addr learned my addr 172.21.15.102:0/3709433122 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.659+0000 7f4d5d20a640 1 -- 172.21.15.102:0/3709433122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d56e6fa0 con 0x5566d56e65d0 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.659+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/3709433122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56e69b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4d5008d000 tx=0x7f4d50006ea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=59a3bd3b332b883f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.659+0000 7f4c40ff9640 1 -- 172.21.15.102:0/3709433122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d500a8040 con 0x5566d56e65d0 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.659+0000 7f4c40ff9640 1 -- 172.21.15.102:0/3709433122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d50096e30 con 0x5566d56e65d0 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.659+0000 7f4c40ff9640 1 -- 172.21.15.102:0/3709433122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d500a1430 con 0x5566d56e65d0 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 -- 172.21.15.102:0/3709433122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 msgr2=0x5566d56e69b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3709433122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56e69b0 secure :-1 s=READY pgs=379 cs=0 l=1 rev1=1 crypto rx=0x7f4d5008d000 tx=0x7f4d50006ea0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 -- 172.21.15.102:0/3709433122 shutdown_connections 2024-09-19T11:13:55.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3709433122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56e69b0 unknown :-1 s=CLOSED pgs=379 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 -- 172.21.15.102:0/3709433122 >> 172.21.15.102:0/3709433122 conn(0x5566d56e29d0 msgr2=0x5566d56e0c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 -- 172.21.15.102:0/3709433122 shutdown_connections 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 -- 172.21.15.102:0/3709433122 wait complete. 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 Processor -- start 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 -- start start 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56ed9b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5f719800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5566d56e7430 con 0x5566d56e65d0 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56ed9b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5d20a640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56ed9b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43884/0 (socket says 172.21.15.102:43884) 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.660+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 learned_addr learned my addr 172.21.15.102:0/2716342242 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.661+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5566d56edf10 con 0x5566d56e65d0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.661+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56ed9b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4d5008d000 tx=0x7f4d5004df60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.661+0000 7f4c32ffd640 1 -- 172.21.15.102:0/2716342242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d500bc070 con 0x5566d56e65d0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.661+0000 7f4c32ffd640 1 -- 172.21.15.102:0/2716342242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4d500a1430 con 0x5566d56e65d0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.661+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5566d56edf10 con 0x5566d56e65d0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.661+0000 7f4c32ffd640 1 -- 172.21.15.102:0/2716342242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4d5008f340 con 0x5566d56e65d0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.661+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5566d56edf10 con 0x5566d56e65d0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.662+0000 7f4c32ffd640 1 -- 172.21.15.102:0/2716342242 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4d500bf070 con 0x5566d56e65d0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.662+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.662+0000 7f4c32ffd640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c2803d000 0x7f4c2803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.662+0000 7f4c32ffd640 1 -- 172.21.15.102:0/2716342242 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f4d500b1020 con 0x5566d56e65d0 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.662+0000 7f4d54a09640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c2803d000 0x7f4c2803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d56f8f10 0x5566d56fb3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fbaf0 con 0x5566d56f8f10 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5da0b640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d56f8f10 0x5566d56fb3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d54a09640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c2803d000 0x7f4c2803f4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800ffd0 tx=0x7f4d48023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5da0b640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d56f8f10 0x5566d56fb3a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 20 realm 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fbf00 con 0x5566d56f8f10 2024-09-19T11:13:55.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.663+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fc7d0 con 0x5566d56f8f10 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5f719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56fd660 0x5566d56ffa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5700190 con 0x5566d56fd660 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56fd660 0x5566d56ffa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.664+0000 7f4d5d20a640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56fd660 0x5566d56ffa50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d5f719800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d5f719800 20 searching for the correct realm 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d5702230 0x5566d57046f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d5704dc0 con 0x5566d5702230 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d54a09640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d5702230 0x5566d57046f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d54a09640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d5702230 0x5566d57046f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d54a09640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4d4802e910 0x7f4d4803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d5704dc0 con 0x7f4d4802e910 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.665+0000 7f4d5da0b640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4d4802e910 0x7f4d4803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.666+0000 7f4d5da0b640 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4d4802e910 0x7f4d4803a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.666+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.666+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.666+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.666+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.667+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.667+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.667+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.667+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.667+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.667+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.667+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.667+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x7f4d4802e910 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.668+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.668+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d5702230 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.668+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.668+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.668+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.668+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.668+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.668+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x7f4d4802e910 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d5702230 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d5702230 2024-09-19T11:13:55.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.669+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d5702230 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d5702230 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.670+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.671+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.671+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d5702230 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.671+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.671+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x7f4d4802e910 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.671+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.671+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.671+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.671+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.672+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.672+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d5702230 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.672+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.672+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.672+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.672+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x7f4d4802e910 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.672+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.672+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d5702230 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d48037040 con 0x5566d5702230 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56fd660 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x5566d56f8f10 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5566d56fcb70 con 0x7f4d4802e910 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5f719800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5f719800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5f719800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5f719800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5f719800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5f719800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.673+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5700b30 con 0x5566d56f8f10 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5700b30 con 0x5566d56f8f10 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5700b30 con 0x5566d5702230 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 zone default found 2024-09-19T11:13:55.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 4 Realm: () 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 zonegroup default 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d57013d0 con 0x5566d56fd660 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.674+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5706c30 con 0x5566d5702230 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d5f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5706fd0 con 0x5566d5702230 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d5f719800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d5f719800 20 started sync module instance, tier type = 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d5f719800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.675+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d57060d0 con 0x7f4d4802e910 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.676+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.676+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93900155938288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d57060d0 con 0x7f4d4802e910 2024-09-19T11:13:55.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.676+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5707a30 con 0x5566d56f8f10 2024-09-19T11:13:55.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.677+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93900155938288] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.677+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.677+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93900155942160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d57060d0 con 0x5566d56f8f10 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.678+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d57084a0 con 0x5566d5702230 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.679+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.679+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93900155944848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5708d40 con 0x5566d5702230 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.679+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5709840 con 0x7f4d4802e910 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.679+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93900155942160] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.680+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.680+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93900155949872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5709c30 con 0x7f4d4802e910 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.680+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93900155944848] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.680+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570a140 con 0x5566d56f8f10 2024-09-19T11:13:55.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.680+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93900155949872] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.681+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.681+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93900155947152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570a140 con 0x5566d56f8f10 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.681+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570ab50 con 0x5566d56fd660 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.682+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.682+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93900155954848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570b3a0 con 0x5566d56fd660 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.682+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570bde0 con 0x5566d56fd660 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.682+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93900155947152] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.683+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93900155954848] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.683+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.683+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93900155959472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570c1d0 con 0x5566d56fd660 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.683+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570ca20 con 0x5566d56fd660 2024-09-19T11:13:55.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'96 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93900155959472] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93900155963216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570d1e0 con 0x5566d56fd660 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5f719800 20 add_watcher() i=0 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5f719800 20 add_watcher() i=1 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5f719800 20 add_watcher() i=2 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5f719800 20 add_watcher() i=3 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5f719800 20 add_watcher() i=4 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5f719800 20 add_watcher() i=5 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.684+0000 7f4d5f719800 20 add_watcher() i=6 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.685+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93900155963216] v35'97 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.685+0000 7f4d5f719800 20 add_watcher() i=7 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.685+0000 7f4d5f719800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.685+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5705cb0 con 0x5566d56f8f10 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.685+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.685+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93900155964528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d570dae0 con 0x5566d56f8f10 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.686+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93900155964528] v35'98 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.686+0000 7f4c137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.686+0000 7f4d5f719800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.686+0000 7f4d5f719800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.686+0000 7f4d5f719800 5 note: GC not initialized 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.686+0000 7f4c127e4640 20 reqs_thread_entry: start 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.686+0000 7f4d5f719800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:55.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.686+0000 7f4d5f719800 20 Filter name: none 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4b83fff640 20 reqs_thread_entry: start 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5742c80 con 0x5566d56f8f10 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5f719800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5743540 con 0x5566d56f8f10 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5f719800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.687+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5744550 con 0x7f4d4802e910 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.688+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.688+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.688+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5741e00 con 0x7f4d4802e910 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.688+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.688+0000 7f4d5f719800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.688+0000 7f4d5f719800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.688+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5744260 con 0x5566d56fd660 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(66 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 4.e 4:735adac5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5745e20 con 0x7f4d4802e910 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 4.15 4:a8990202:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5748980 con 0x5566d5702230 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 4.0 4:015ead7d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d574b520 con 0x5566d5702230 2024-09-19T11:13:55.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 4.2a 4:54dc5602:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d574de10 con 0x5566d56f8f10 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 4.28 4:14a92d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5750680 con 0x5566d56f8f10 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 4.4 4:22751d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5750680 con 0x5566d56fd660 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 4.2d 4:b7aa4218:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d574de10 con 0x5566d56fd660 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:74 4.1f 4:f9ffeb7c:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d5758930 con 0x5566d5702230 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:75 4.e 4:72d65baa:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d575b340 con 0x7f4d4802e910 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:76 4.1 4:80601e6d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d574de10 con 0x7f4d4802e910 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(67 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 4.0 4:02fa5d61:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5566d574de10 con 0x5566d5702230 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(70 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(71 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(74 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(75 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.689+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(76 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.690+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.690+0000 7f4c137e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.690+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:78 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93900155964528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x5566d56f8f10 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.691+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(78 data_loggenerations_metadata [watch unwatch cookie 93900155964528] v35'99 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.691+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:79 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93900155938288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x7f4d4802e910 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.692+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(79 notify.0 [watch unwatch cookie 93900155938288] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.692+0000 7f4d5f719800 20 remove_watcher() i=0 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.692+0000 7f4d5f719800 2 removed watcher, disabling cache 2024-09-19T11:13:55.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.692+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93900155942160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x5566d56f8f10 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.693+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(80 notify.1 [watch unwatch cookie 93900155942160] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.693+0000 7f4d5f719800 20 remove_watcher() i=1 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.693+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:81 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93900155944848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x5566d5702230 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.694+0000 7f4d54a09640 1 -- 172.21.15.102:0/2716342242 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(81 notify.2 [watch unwatch cookie 93900155944848] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d480491c0 con 0x5566d5702230 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.694+0000 7f4d5f719800 20 remove_watcher() i=2 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.694+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:82 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93900155949872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x7f4d4802e910 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.695+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(82 notify.3 [watch unwatch cookie 93900155949872] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x7f4d4802e910 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.695+0000 7f4d5f719800 20 remove_watcher() i=3 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.695+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:83 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93900155947152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x5566d56f8f10 2024-09-19T11:13:55.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.696+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(83 notify.4 [watch unwatch cookie 93900155947152] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d5800a4d0 con 0x5566d56f8f10 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.696+0000 7f4d5f719800 20 remove_watcher() i=4 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.696+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:84 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93900155954848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x5566d56fd660 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.697+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(84 notify.5 [watch unwatch cookie 93900155954848] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.697+0000 7f4d5f719800 20 remove_watcher() i=5 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.697+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93900155959472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x5566d56fd660 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.698+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(85 notify.6 [watch unwatch cookie 93900155959472] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.698+0000 7f4d5f719800 20 remove_watcher() i=6 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.698+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:86 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93900155963216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5566d5740b60 con 0x5566d56fd660 2024-09-19T11:13:55.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5d20a640 1 -- 172.21.15.102:0/2716342242 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(86 notify.7 [watch unwatch cookie 93900155963216] v35'98 uv96 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4d500c8070 con 0x5566d56fd660 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 20 remove_watcher() i=7 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56fd660 msgr2=0x5566d56ffa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56fd660 0x5566d56ffa50 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d56f8f10 msgr2=0x5566d56fb3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d56f8f10 0x5566d56fb3a0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4d4802e910 msgr2=0x7f4d4803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4d4802e910 0x7f4d4803a3c0 crc :-1 s=READY pgs=41 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d5702230 msgr2=0x5566d57046f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d5702230 0x5566d57046f0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c2803d000 msgr2=0x7f4c2803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c2803d000 0x7f4c2803f4c0 secure :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0x7f4d4800ffd0 tx=0x7f4d48023040 comp rx=0 tx=0).stop 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5da0b640 1 -- 172.21.15.102:0/2716342242 reap_dead start 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 msgr2=0x5566d56ed9b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56ed9b0 secure :-1 s=READY pgs=380 cs=0 l=1 rev1=1 crypto rx=0x7f4d5008d000 tx=0x7f4d5004df60 comp rx=0 tx=0).stop 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 shutdown_connections 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 --2- 172.21.15.102:0/2716342242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56e65d0 0x5566d56ed9b0 unknown :-1 s=CLOSED pgs=380 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.699+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 >> 172.21.15.102:0/2716342242 conn(0x5566d56e29d0 msgr2=0x5566d56e0be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 shutdown_connections 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/2716342242 wait complete. 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/1304839633 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c3403d000 msgr2=0x7f4c3403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/1304839633 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c3403d000 0x7f4c3403f4c0 secure :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0x5566d56cc7a0 tx=0x7f4d48006000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/1304839633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56da0e0 msgr2=0x5566d56da500 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/1304839633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56da0e0 0x5566d56da500 secure :-1 s=READY pgs=378 cs=0 l=1 rev1=1 crypto rx=0x7f4d50072fd0 tx=0x7f4d5008fc20 comp rx=0 tx=0).stop 2024-09-19T11:13:55.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/1304839633 shutdown_connections 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/1304839633 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c3403d000 0x7f4c3403f4c0 unknown :-1 s=CLOSED pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/1304839633 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d56da0e0 0x5566d56da500 unknown :-1 s=CLOSED pgs=378 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/1304839633 >> 172.21.15.102:0/1304839633 conn(0x5566d56ce490 msgr2=0x5566d56ce870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/1304839633 shutdown_connections 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/1304839633 wait complete. 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56c57e0 msgr2=0x5566d56c7c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5566d56c57e0 0x5566d56c7c80 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d55c58c0 msgr2=0x5566d56c3440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5566d55c58c0 0x5566d56c3440 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d56c9870 msgr2=0x5566d56cbc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5566d56c9870 0x5566d56cbc60 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c4403cfb0 msgr2=0x7f4c4403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4c4403cfb0 0x7f4c4403f470 secure :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0x7f4d48000c00 tx=0x7f4d480013b0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 msgr2=0x5566d56bbdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 --2- 172.21.15.102:0/3703773561 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5566d55c2ea0 0x5566d56bbdf0 secure :-1 s=READY pgs=377 cs=0 l=1 rev1=1 crypto rx=0x5566d55c2160 tx=0x7f4d50003020 comp rx=0 tx=0).stop 2024-09-19T11:13:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5da0b640 1 -- 172.21.15.102:0/3703773561 reap_dead start 2024-09-19T11:13:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 shutdown_connections 2024-09-19T11:13:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.700+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 >> 172.21.15.102:0/3703773561 conn(0x5566d55bca60 msgr2=0x5566d56ad610 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.701+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 shutdown_connections 2024-09-19T11:13:55.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.701+0000 7f4d5f719800 1 -- 172.21.15.102:0/3703773561 wait complete. 2024-09-19T11:13:55.722 INFO:teuthology.orchestra.run.smithi102.stdout:[{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"68013f1d-b756-462e-83a9-97539995db13","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","marker":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-19T11:13:54.980611Z","creation_time":"2024-09-19T11:13:54.975364Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1}] 2024-09-19T11:13:55.722 DEBUG:tasks.util.rgw: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68013f1d-b756-462e-83a9-97539995db13', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-19T11:13:54.980611Z', 'creation_time': '2024-09-19T11:13:54.975364Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-19T11:13:55.729 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-19T11:13:55.730 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-19T11:13:55.730 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-19T11:13:55.730 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-19T11:13:55.774 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:55.774 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:55.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.773+0000 7fd614b2e800 1 Processor -- start 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.773+0000 7fd614b2e800 1 -- start start 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd614b2e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555d334a3f20 0x555d334a6310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd614b2e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555d334aa5d0 con 0x555d334a68b0 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd614b2e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x555d3332e7d0 con 0x555d334a3f20 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd6108dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555d334a3f20 0x555d334a6310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd6108dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555d334a3f20 0x555d334a6310 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43892/0 (socket says 172.21.15.102:43892) 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd6080dc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x555d334a68b0 0x555d334a8d70 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52460/0 (socket says 172.21.15.102:52460) 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd6108dd640 1 -- 172.21.15.102:0/3882816184 learned_addr learned my addr 172.21.15.102:0/3882816184 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd6108dd640 1 -- 172.21.15.102:0/3882816184 >> v1:172.21.15.37:6789/0 conn(0x555d334a68b0 legacy=0x555d334a8d70 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.774+0000 7fd6108dd640 1 -- 172.21.15.102:0/3882816184 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d334ab800 con 0x555d334a3f20 2024-09-19T11:13:55.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.776+0000 7fd6108dd640 1 --2- 172.21.15.102:0/3882816184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d334a6310 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd60000a520 tx=0x7fd600045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c2ad5a8efb76b284 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.776+0000 7fd60bfff640 1 -- 172.21.15.102:0/3882816184 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600055070 con 0x555d334a3f20 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.776+0000 7fd60bfff640 1 -- 172.21.15.102:0/3882816184 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000515b0 con 0x555d334a3f20 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.776+0000 7fd60bfff640 1 -- 172.21.15.102:0/3882816184 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000518d0 con 0x555d334a3f20 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.777+0000 7fd614b2e800 1 -- 172.21.15.102:0/3882816184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 msgr2=0x555d334a6310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.777+0000 7fd614b2e800 1 --2- 172.21.15.102:0/3882816184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d334a6310 secure :-1 s=READY pgs=382 cs=0 l=1 rev1=1 crypto rx=0x7fd60000a520 tx=0x7fd600045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.777+0000 7fd614b2e800 1 -- 172.21.15.102:0/3882816184 shutdown_connections 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.777+0000 7fd614b2e800 1 --2- 172.21.15.102:0/3882816184 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d334a6310 unknown :-1 s=CLOSED pgs=382 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.777+0000 7fd614b2e800 1 -- 172.21.15.102:0/3882816184 >> 172.21.15.102:0/3882816184 conn(0x555d3349da60 msgr2=0x555d3349fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.777+0000 7fd614b2e800 1 -- 172.21.15.102:0/3882816184 shutdown_connections 2024-09-19T11:13:55.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.777+0000 7fd614b2e800 1 -- 172.21.15.102:0/3882816184 wait complete. 2024-09-19T11:13:55.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.790+0000 7fd614b2e800 1 Processor -- start 2024-09-19T11:13:55.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.790+0000 7fd614b2e800 1 -- start start 2024-09-19T11:13:55.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.790+0000 7fd614b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d33595510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.790+0000 7fd614b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555d3333bdd0 con 0x555d334a3f20 2024-09-19T11:13:55.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.791+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d33595510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.791+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d33595510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43906/0 (socket says 172.21.15.102:43906) 2024-09-19T11:13:55.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.791+0000 7fd6108dd640 1 -- 172.21.15.102:0/3149935528 learned_addr learned my addr 172.21.15.102:0/3149935528 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.791+0000 7fd6108dd640 1 -- 172.21.15.102:0/3149935528 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d33595b00 con 0x555d334a3f20 2024-09-19T11:13:55.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.791+0000 7fd6108dd640 1 --2- 172.21.15.102:0/3149935528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d33595510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd600025da0 tx=0x7fd600051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70a9244d1e79a110 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.791+0000 7fd4fee0d640 1 -- 172.21.15.102:0/3149935528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600051890 con 0x555d334a3f20 2024-09-19T11:13:55.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.791+0000 7fd4fee0d640 1 -- 172.21.15.102:0/3149935528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd600051ac0 con 0x555d334a3f20 2024-09-19T11:13:55.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.791+0000 7fd4fee0d640 1 -- 172.21.15.102:0/3149935528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600051da0 con 0x555d334a3f20 2024-09-19T11:13:55.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.792+0000 7fd614b2e800 1 -- 172.21.15.102:0/3149935528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 msgr2=0x555d33595510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.792+0000 7fd614b2e800 1 --2- 172.21.15.102:0/3149935528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d33595510 secure :-1 s=READY pgs=383 cs=0 l=1 rev1=1 crypto rx=0x7fd600025da0 tx=0x7fd600051000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.792+0000 7fd614b2e800 1 -- 172.21.15.102:0/3149935528 shutdown_connections 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.792+0000 7fd614b2e800 1 --2- 172.21.15.102:0/3149935528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d33595510 unknown :-1 s=CLOSED pgs=383 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.792+0000 7fd614b2e800 1 -- 172.21.15.102:0/3149935528 >> 172.21.15.102:0/3149935528 conn(0x555d3349da60 msgr2=0x555d33590e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.792+0000 7fd614b2e800 1 -- 172.21.15.102:0/3149935528 shutdown_connections 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.792+0000 7fd614b2e800 1 -- 172.21.15.102:0/3149935528 wait complete. 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.792+0000 7fd614b2e800 1 Processor -- start 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd614b2e800 1 -- start start 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd614b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d3359ced0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd614b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555d334aaa40 con 0x555d334a3f20 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d3359ced0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d3359ced0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43914/0 (socket says 172.21.15.102:43914) 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd6108dd640 1 -- 172.21.15.102:0/4234770937 learned_addr learned my addr 172.21.15.102:0/4234770937 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd6108dd640 1 -- 172.21.15.102:0/4234770937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d3359d430 con 0x555d334a3f20 2024-09-19T11:13:55.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd6108dd640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d3359ced0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x555d335964a0 tx=0x7fd600002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd4fd60a640 1 -- 172.21.15.102:0/4234770937 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600073070 con 0x555d334a3f20 2024-09-19T11:13:55.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd4fd60a640 1 -- 172.21.15.102:0/4234770937 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60005a580 con 0x555d334a3f20 2024-09-19T11:13:55.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d3359d6c0 con 0x555d334a3f20 2024-09-19T11:13:55.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.793+0000 7fd4fd60a640 1 -- 172.21.15.102:0/4234770937 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60005a880 con 0x555d334a3f20 2024-09-19T11:13:55.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.794+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d3359e2d0 con 0x555d334a3f20 2024-09-19T11:13:55.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.794+0000 7fd4fd60a640 1 -- 172.21.15.102:0/4234770937 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd600076070 con 0x555d334a3f20 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.794+0000 7fd4fd60a640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f803d000 0x7fd4f803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.794+0000 7fd4fd60a640 1 -- 172.21.15.102:0/4234770937 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fd600062070 con 0x555d334a3f20 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.795+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d334a68b0 0x555d335a4520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.795+0000 7fd6080dc640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f803d000 0x7fd4f803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.795+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335a4a60 con 0x555d334a68b0 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.795+0000 7fd6110de640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d334a68b0 0x555d335a4520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.795+0000 7fd6080dc640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f803d000 0x7fd4f803f4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8001e30 tx=0x7fd5f8001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.795+0000 7fd6110de640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d334a68b0 0x555d335a4520 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.795+0000 7fd6110de640 1 -- 172.21.15.102:0/4234770937 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d334a68b0 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.795+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335a4e00 con 0x555d334a68b0 2024-09-19T11:13:55.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.796+0000 7fd6110de640 1 -- 172.21.15.102:0/4234770937 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d334a68b0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.796+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335a6940 0x555d335a8de0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.796+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335a9570 con 0x555d335a6940 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.796+0000 7fd6108dd640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335a6940 0x555d335a8de0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.796+0000 7fd6108dd640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335a6940 0x555d335a8de0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.797+0000 7fd6108dd640 1 -- 172.21.15.102:0/4234770937 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fd60007f070 con 0x555d335a6940 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.797+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335a5650 con 0x555d334a68b0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.797+0000 7fd6110de640 1 -- 172.21.15.102:0/4234770937 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d334a68b0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.797+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335aa9d0 0x555d335acdc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.797+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335ad4c0 con 0x555d335aa9d0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.797+0000 7fd6080dc640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335aa9d0 0x555d335acdc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.797+0000 7fd6080dc640 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335aa9d0 0x555d335acdc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd6080dc640 1 -- 172.21.15.102:0/4234770937 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fd5f800bd50 con 0x555d335aa9d0 2024-09-19T11:13:55.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd614b2e800 1 Processor -- start 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd614b2e800 1 -- start start 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd614b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335bb240 0x555d335bb660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd614b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555d3339a4a0 con 0x555d335bb240 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335bb240 0x555d335bb660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335bb240 0x555d335bb660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43926/0 (socket says 172.21.15.102:43926) 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd6108dd640 1 -- 172.21.15.102:0/15530159 learned_addr learned my addr 172.21.15.102:0/15530159 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.798+0000 7fd6108dd640 1 -- 172.21.15.102:0/15530159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d335bbca0 con 0x555d335bb240 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.799+0000 7fd6108dd640 1 --2- 172.21.15.102:0/15530159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335bb240 0x555d335bb660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd600067040 tx=0x7fd60005adf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.799+0000 7fd4f67fc640 1 -- 172.21.15.102:0/15530159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600092020 con 0x555d335bb240 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.799+0000 7fd4f67fc640 1 -- 172.21.15.102:0/15530159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd6000503e0 con 0x555d335bb240 2024-09-19T11:13:55.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.799+0000 7fd614b2e800 1 -- 172.21.15.102:0/15530159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d335bc4d0 con 0x555d335bb240 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.799+0000 7fd4f67fc640 1 -- 172.21.15.102:0/15530159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600070cb0 con 0x555d335bb240 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.799+0000 7fd614b2e800 1 -- 172.21.15.102:0/15530159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d335bca70 con 0x555d335bb240 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd4f67fc640 1 -- 172.21.15.102:0/15530159 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd600058070 con 0x555d335bb240 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd4f67fc640 1 --2- 172.21.15.102:0/15530159 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4e803d000 0x7fd4e803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd4f67fc640 1 -- 172.21.15.102:0/15530159 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fd60009da00 con 0x555d335bb240 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd6080dc640 1 --2- 172.21.15.102:0/15530159 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4e803d000 0x7fd4e803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd614b2e800 1 Processor -- start 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd614b2e800 1 -- start start 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd6080dc640 1 --2- 172.21.15.102:0/15530159 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4e803d000 0x7fd4e803f4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x555d335a9940 tx=0x7fd5f800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd614b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335c7f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.800+0000 7fd614b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555d33595e70 con 0x555d335c7b60 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335c7f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335c7f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43936/0 (socket says 172.21.15.102:43936) 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd6108dd640 1 -- 172.21.15.102:0/4283128651 learned_addr learned my addr 172.21.15.102:0/4283128651 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd6108dd640 1 -- 172.21.15.102:0/4283128651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d335c8550 con 0x555d335c7b60 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd6108dd640 1 --2- 172.21.15.102:0/4283128651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335c7f60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd60008e7b0 tx=0x7fd600083f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ac939f066d0f0997 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd4e7fff640 1 -- 172.21.15.102:0/4283128651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000ab020 con 0x555d335c7b60 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd4e7fff640 1 -- 172.21.15.102:0/4283128651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd600070990 con 0x555d335c7b60 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd4e7fff640 1 -- 172.21.15.102:0/4283128651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600078450 con 0x555d335c7b60 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd614b2e800 1 -- 172.21.15.102:0/4283128651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 msgr2=0x555d335c7f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4283128651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335c7f60 secure :-1 s=READY pgs=386 cs=0 l=1 rev1=1 crypto rx=0x7fd60008e7b0 tx=0x7fd600083f40 comp rx=0 tx=0).stop 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd614b2e800 1 -- 172.21.15.102:0/4283128651 shutdown_connections 2024-09-19T11:13:55.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4283128651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335c7f60 unknown :-1 s=CLOSED pgs=386 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.801+0000 7fd614b2e800 1 -- 172.21.15.102:0/4283128651 >> 172.21.15.102:0/4283128651 conn(0x555d335c3f60 msgr2=0x555d335c21a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd614b2e800 1 -- 172.21.15.102:0/4283128651 shutdown_connections 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd614b2e800 1 -- 172.21.15.102:0/4283128651 wait complete. 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd614b2e800 1 Processor -- start 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd614b2e800 1 -- start start 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd614b2e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335cefa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd614b2e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555d335c89c0 con 0x555d335c7b60 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335cefa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd6108dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335cefa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43950/0 (socket says 172.21.15.102:43950) 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.802+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 learned_addr learned my addr 172.21.15.102:0/2163704018 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.803+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555d335cf500 con 0x555d335c7b60 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.803+0000 7fd6108dd640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335cefa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd600070b60 tx=0x7fd60009ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.803+0000 7fd4e67fc640 1 -- 172.21.15.102:0/2163704018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd6000c0070 con 0x555d335c7b60 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.803+0000 7fd4e67fc640 1 -- 172.21.15.102:0/2163704018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd600083460 con 0x555d335c7b60 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.803+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555d335cf500 con 0x555d335c7b60 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.803+0000 7fd4e67fc640 1 -- 172.21.15.102:0/2163704018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd600083740 con 0x555d335c7b60 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.803+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555d335cf500 con 0x555d335c7b60 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.804+0000 7fd4e67fc640 1 -- 172.21.15.102:0/2163704018 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd6000c3070 con 0x555d335c7b60 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.804+0000 7fd4e67fc640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4dc03d000 0x7fd4dc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.804+0000 7fd4e67fc640 1 -- 172.21.15.102:0/2163704018 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fd6000b7030 con 0x555d335c7b60 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.804+0000 7fd6080dc640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4dc03d000 0x7fd4dc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.804+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.804+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d335da380 0x555d335dc7f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.804+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335dcf40 con 0x555d335da380 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd6110de640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d335da380 0x555d335dc7f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd6080dc640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4dc03d000 0x7fd4dc03f4c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x555d335ad8c0 tx=0x7fd5f8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd6110de640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d335da380 0x555d335dc7f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 20 realm 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335dd350 con 0x555d335da380 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddc20 con 0x555d335da380 2024-09-19T11:13:55.826 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.805+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd614b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335deab0 0x555d335e0ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335e15e0 con 0x555d335deab0 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd6108dd640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335deab0 0x555d335e0ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd6108dd640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335deab0 0x555d335e0ea0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd614b2e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd614b2e800 20 searching for the correct realm 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.806+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335e3680 0x555d335e5b40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.807+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335e6210 con 0x555d335e3680 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.807+0000 7fd6080dc640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335e3680 0x555d335e5b40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.807+0000 7fd6080dc640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335e3680 0x555d335e5b40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.807+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8037040 con 0x555d335e3680 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.807+0000 7fd6080dc640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fd5f800f070 0x7fd5f802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.807+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335e6210 con 0x7fd5f800f070 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.807+0000 7fd6110de640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fd5f800f070 0x7fd5f802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.808+0000 7fd6110de640 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fd5f800f070 0x7fd5f802e910 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.808+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.808+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.808+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.808+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.809+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.809+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.809+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.809+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x7fd5f800f070 2024-09-19T11:13:55.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335e3680 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8037040 con 0x555d335e3680 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.810+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.811+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.811+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.811+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.811+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x7fd5f800f070 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.811+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.811+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335e3680 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.811+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8037040 con 0x555d335e3680 2024-09-19T11:13:55.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.811+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335e3680 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.812+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fd5f8037040 con 0x555d335e3680 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.812+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.812+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.812+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335e3680 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.812+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8037040 con 0x555d335e3680 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.812+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335e3680 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.812+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8037040 con 0x555d335e3680 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.812+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.813+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.813+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.813+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.813+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.813+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.813+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335e3680 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.813+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8037040 con 0x555d335e3680 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.813+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x7fd5f800f070 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.814+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.814+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.814+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.814+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.814+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.814+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335e3680 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.814+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8037040 con 0x555d335e3680 2024-09-19T11:13:55.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.815+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.815+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.815+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x7fd5f800f070 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.815+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.815+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335e3680 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.815+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.815+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335deab0 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x555d335da380 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555d335ddfc0 con 0x7fd5f800f070 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335e1f80 con 0x555d335da380 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.816+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335e1f80 con 0x555d335da380 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335e1f30 con 0x555d335e3680 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 zone default found 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 4 Realm: () 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 zonegroup default 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335e2820 con 0x555d335deab0 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335e8080 con 0x555d335e3680 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.817+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335e8420 con 0x555d335e3680 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.818+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.818+0000 7fd614b2e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.818+0000 7fd614b2e800 20 started sync module instance, tier type = 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.818+0000 7fd614b2e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.818+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335e7520 con 0x7fd5f800f070 2024-09-19T11:13:55.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.819+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.819+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93858782149200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335e7520 con 0x7fd5f800f070 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.819+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335e8f50 con 0x555d335da380 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.820+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93858782149200] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.820+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.820+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93858782153248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335e7520 con 0x555d335da380 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.820+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335e99f0 con 0x555d335e3680 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.821+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.821+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93858782156000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335ea290 con 0x555d335e3680 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.821+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335ead80 con 0x7fd5f800f070 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.821+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93858782153248] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.822+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.822+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93858782156000] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.822+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93858782160976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335e7070 con 0x7fd5f800f070 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.822+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335eb620 con 0x555d335da380 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.823+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.823+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93858782163232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335eb540 con 0x555d335da380 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.823+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335ec520 con 0x555d335deab0 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.823+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93858782160976] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.824+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.824+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93858782158304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335ec940 con 0x555d335deab0 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.824+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335ed300 con 0x555d335deab0 2024-09-19T11:13:55.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.825+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93858782163232] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.825+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93858782158304] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.825+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.825+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93858782165520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335ed300 con 0x555d335deab0 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.825+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335edba0 con 0x555d335deab0 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93858782165520] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'99 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93858782170704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335edda0 con 0x555d335deab0 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd614b2e800 20 add_watcher() i=0 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd614b2e800 20 add_watcher() i=1 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd614b2e800 20 add_watcher() i=2 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd614b2e800 20 add_watcher() i=3 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd614b2e800 20 add_watcher() i=4 2024-09-19T11:13:55.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd614b2e800 20 add_watcher() i=5 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.828+0000 7fd614b2e800 20 add_watcher() i=6 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.829+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93858782170704] v35'100 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.829+0000 7fd614b2e800 20 add_watcher() i=7 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.829+0000 7fd614b2e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.829+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d335f0f10 con 0x555d335da380 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.829+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.829+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93858782185568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d335edc70 con 0x555d335da380 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.830+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93858782185568] v35'100 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.830+0000 7fd4c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.830+0000 7fd614b2e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.830+0000 7fd614b2e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.830+0000 7fd614b2e800 5 note: GC not initialized 2024-09-19T11:13:55.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd4c5fe3640 20 reqs_thread_entry: start 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd614b2e800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd614b2e800 20 Filter name: none 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd4377fe640 20 reqs_thread_entry: start 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33624030 con 0x7fd5f800f070 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd614b2e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.831+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d336248c0 con 0x555d335deab0 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:13:55.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33624a80 con 0x7fd5f800f070 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33625ed0 con 0x555d335deab0 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(65 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 4.e 4:735adac5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33627510 con 0x7fd5f800f070 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.832+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 4.15 4:a8990202:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d3362a0b0 con 0x555d335e3680 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 4.0 4:015ead7d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d3362ca10 con 0x555d335e3680 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 4.2a 4:54dc5602:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d3362f280 con 0x555d335da380 2024-09-19T11:13:55.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 4.28 4:14a92d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33631e20 con 0x555d335da380 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 4.4 4:22751d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33634cb0 con 0x555d335deab0 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 4.2d 4:b7aa4218:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33631e20 con 0x555d335deab0 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 4.1f 4:f9ffeb7c:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33639b10 con 0x555d335e3680 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 4.e 4:72d65baa:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d3363c1b0 con 0x7fd5f800f070 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(66 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:75 4.1 4:80601e6d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33624f80 con 0x7fd5f800f070 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(69 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:76 4.0 4:02fa5d61:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555d33634680 con 0x555d335e3680 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(72 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(70 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(73 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(75 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.833+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(76 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.834+0000 7fd4c6fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.834+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93858782185568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d33624f80 con 0x555d335da380 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.835+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 93858782185568] v35'101 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.835+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93858782149200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d336219b0 con 0x7fd5f800f070 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.836+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 93858782149200] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.836+0000 7fd614b2e800 20 remove_watcher() i=0 2024-09-19T11:13:55.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.836+0000 7fd614b2e800 2 removed watcher, disabling cache 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.836+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93858782153248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d336219b0 con 0x555d335da380 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.837+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 93858782153248] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.837+0000 7fd614b2e800 20 remove_watcher() i=1 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.837+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93858782156000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d336219b0 con 0x555d335e3680 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.838+0000 7fd6080dc640 1 -- 172.21.15.102:0/2163704018 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 93858782156000] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd5f8049040 con 0x555d335e3680 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.838+0000 7fd614b2e800 20 remove_watcher() i=2 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.838+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93858782160976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d336219b0 con 0x7fd5f800f070 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.839+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 93858782160976] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x7fd5f800f070 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.839+0000 7fd614b2e800 20 remove_watcher() i=3 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.839+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93858782163232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d336219b0 con 0x555d335da380 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.840+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 93858782163232] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd60c00a4d0 con 0x555d335da380 2024-09-19T11:13:55.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.840+0000 7fd614b2e800 20 remove_watcher() i=4 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.840+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93858782158304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d336219b0 con 0x555d335deab0 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.841+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 93858782158304] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.841+0000 7fd614b2e800 20 remove_watcher() i=5 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.841+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93858782165520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d336219b0 con 0x555d335deab0 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.842+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 93858782165520] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.842+0000 7fd614b2e800 20 remove_watcher() i=6 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.842+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93858782170704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555d336219b0 con 0x555d335deab0 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd6108dd640 1 -- 172.21.15.102:0/2163704018 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 93858782170704] v35'101 uv99 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fd6000c2030 con 0x555d335deab0 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 20 remove_watcher() i=7 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335deab0 msgr2=0x555d335e0ea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335deab0 0x555d335e0ea0 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d335da380 msgr2=0x555d335dc7f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d335da380 0x555d335dc7f0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fd5f800f070 msgr2=0x7fd5f802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fd5f800f070 0x7fd5f802e910 crc :-1 s=READY pgs=42 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335e3680 msgr2=0x555d335e5b40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335e3680 0x555d335e5b40 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4dc03d000 msgr2=0x7fd4dc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4dc03d000 0x7fd4dc03f4c0 secure :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0x555d335ad8c0 tx=0x7fd5f8010000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 msgr2=0x555d335cefa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd6110de640 1 -- 172.21.15.102:0/2163704018 reap_dead start 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335cefa0 secure :-1 s=READY pgs=387 cs=0 l=1 rev1=1 crypto rx=0x7fd600070b60 tx=0x7fd60009ef60 comp rx=0 tx=0).stop 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.843+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 shutdown_connections 2024-09-19T11:13:55.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/2163704018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335c7b60 0x555d335cefa0 unknown :-1 s=CLOSED pgs=387 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 >> 172.21.15.102:0/2163704018 conn(0x555d335c3f60 msgr2=0x555d335c2170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 shutdown_connections 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/2163704018 wait complete. 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/15530159 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4e803d000 msgr2=0x7fd4e803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/15530159 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4e803d000 0x7fd4e803f4c0 secure :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0x555d335a9940 tx=0x7fd5f800f000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/15530159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335bb240 msgr2=0x555d335bb660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/15530159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335bb240 0x555d335bb660 secure :-1 s=READY pgs=385 cs=0 l=1 rev1=1 crypto rx=0x7fd600067040 tx=0x7fd60005adf0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/15530159 shutdown_connections 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/15530159 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4e803d000 0x7fd4e803f4c0 unknown :-1 s=CLOSED pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/15530159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d335bb240 0x555d335bb660 unknown :-1 s=CLOSED pgs=385 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/15530159 >> 172.21.15.102:0/15530159 conn(0x555d335af5f0 msgr2=0x555d335af9d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/15530159 shutdown_connections 2024-09-19T11:13:55.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/15530159 wait complete. 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335a6940 msgr2=0x555d335a8de0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555d335a6940 0x555d335a8de0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d334a68b0 msgr2=0x555d335a4520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555d334a68b0 0x555d335a4520 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335aa9d0 msgr2=0x555d335acdc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555d335aa9d0 0x555d335acdc0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f803d000 msgr2=0x7fd4f803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f803d000 0x7fd4f803f4c0 secure :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0x7fd5f8001e30 tx=0x7fd5f8001390 comp rx=0 tx=0).stop 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 msgr2=0x555d3359ced0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 --2- 172.21.15.102:0/4234770937 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555d334a3f20 0x555d3359ced0 secure :-1 s=READY pgs=384 cs=0 l=1 rev1=1 crypto rx=0x555d335964a0 tx=0x7fd600002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd6110de640 1 -- 172.21.15.102:0/4234770937 reap_dead start 2024-09-19T11:13:55.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 shutdown_connections 2024-09-19T11:13:55.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 >> 172.21.15.102:0/4234770937 conn(0x555d3349da60 msgr2=0x555d3358f680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.844+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 shutdown_connections 2024-09-19T11:13:55.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.845+0000 7fd614b2e800 1 -- 172.21.15.102:0/4234770937 wait complete. 2024-09-19T11:13:55.861 INFO:teuthology.orchestra.run.smithi102.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"68013f1d-b756-462e-83a9-97539995db13","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","marker":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-19T11:13:54.980611Z","creation_time":"2024-09-19T11:13:54.975364Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":3,"size_actual":4096,"size_utilized":3,"size_kb":1,"size_kb_actual":4,"size_kb_utilized":1,"num_objects":1}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":1} 2024-09-19T11:13:55.861 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68013f1d-b756-462e-83a9-97539995db13', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-19T11:13:54.980611Z', 'creation_time': '2024-09-19T11:13:54.975364Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-19T11:13:55.861 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-19T11:13:55.861 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'stats', '--uid', 'foo', '--sync-stats'] 2024-09-19T11:13:55.862 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user stats --uid foo --sync-stats 2024-09-19T11:13:55.906 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:55.906 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:55.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.906+0000 7efc8072e800 1 Processor -- start 2024-09-19T11:13:55.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.906+0000 7efc8072e800 1 -- start start 2024-09-19T11:13:55.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.906+0000 7efc8072e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e35e21ffd0 0x55e35e2223c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.906+0000 7efc8072e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e35e2265f0 con 0x55e35e222900 2024-09-19T11:13:55.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.906+0000 7efc8072e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55e35e0aa7d0 con 0x55e35e21ffd0 2024-09-19T11:13:55.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.907+0000 7efc7c4dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e35e21ffd0 0x55e35e2223c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.907+0000 7efc73fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55e35e222900 0x55e35e224d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52470/0 (socket says 172.21.15.102:52470) 2024-09-19T11:13:55.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.907+0000 7efc73fff640 1 -- 172.21.15.102:0/4010932649 learned_addr learned my addr 172.21.15.102:0/4010932649 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:55.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.907+0000 7efc7c4dd640 1 -- 172.21.15.102:0/4010932649 >> v1:172.21.15.37:6789/0 conn(0x55e35e222900 legacy=0x55e35e224d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.907+0000 7efc7bcdc640 1 -- 172.21.15.102:0/4010932649 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3734764809 0 0) 0x55e35e2265f0 con 0x55e35e222900 2024-09-19T11:13:55.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.907+0000 7efc7c4dd640 1 -- 172.21.15.102:0/4010932649 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35e227820 con 0x55e35e21ffd0 2024-09-19T11:13:55.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/4010932649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e2223c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00a470 tx=0x7efc6c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc0a9c506911c28e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc7bcdc640 1 -- 172.21.15.102:0/4010932649 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c053570 con 0x55e35e21ffd0 2024-09-19T11:13:55.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc7bcdc640 1 -- 172.21.15.102:0/4010932649 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c058070 con 0x55e35e21ffd0 2024-09-19T11:13:55.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc7bcdc640 1 -- 172.21.15.102:0/4010932649 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c053880 con 0x55e35e21ffd0 2024-09-19T11:13:55.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc8072e800 1 -- 172.21.15.102:0/4010932649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 msgr2=0x55e35e2223c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc8072e800 1 --2- 172.21.15.102:0/4010932649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e2223c0 secure :-1 s=READY pgs=389 cs=0 l=1 rev1=1 crypto rx=0x7efc6c00a470 tx=0x7efc6c045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:55.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc8072e800 1 -- 172.21.15.102:0/4010932649 shutdown_connections 2024-09-19T11:13:55.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc8072e800 1 --2- 172.21.15.102:0/4010932649 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e2223c0 unknown :-1 s=CLOSED pgs=389 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc8072e800 1 -- 172.21.15.102:0/4010932649 >> 172.21.15.102:0/4010932649 conn(0x55e35e219a70 msgr2=0x55e35e21bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.909+0000 7efc8072e800 1 -- 172.21.15.102:0/4010932649 shutdown_connections 2024-09-19T11:13:55.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.910+0000 7efc8072e800 1 -- 172.21.15.102:0/4010932649 wait complete. 2024-09-19T11:13:55.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.923+0000 7efc8072e800 1 Processor -- start 2024-09-19T11:13:55.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.923+0000 7efc8072e800 1 -- start start 2024-09-19T11:13:55.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.923+0000 7efc8072e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e30f140 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.923+0000 7efc8072e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e35e0b7dd0 con 0x55e35e21ffd0 2024-09-19T11:13:55.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.924+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e30f140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.924+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e30f140 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43966/0 (socket says 172.21.15.102:43966) 2024-09-19T11:13:55.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.924+0000 7efc7c4dd640 1 -- 172.21.15.102:0/464164168 learned_addr learned my addr 172.21.15.102:0/464164168 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.924+0000 7efc7c4dd640 1 -- 172.21.15.102:0/464164168 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35e30f730 con 0x55e35e21ffd0 2024-09-19T11:13:55.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.924+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/464164168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e30f140 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efc6c045f50 tx=0x7efc6c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2219313e3f7b9c32 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.924+0000 7efb6a60c640 1 -- 172.21.15.102:0/464164168 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c053c20 con 0x55e35e21ffd0 2024-09-19T11:13:55.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.924+0000 7efb6a60c640 1 -- 172.21.15.102:0/464164168 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c063030 con 0x55e35e21ffd0 2024-09-19T11:13:55.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.924+0000 7efb6a60c640 1 -- 172.21.15.102:0/464164168 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c053440 con 0x55e35e21ffd0 2024-09-19T11:13:55.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 -- 172.21.15.102:0/464164168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 msgr2=0x55e35e30f140 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 --2- 172.21.15.102:0/464164168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e30f140 secure :-1 s=READY pgs=390 cs=0 l=1 rev1=1 crypto rx=0x7efc6c045f50 tx=0x7efc6c051000 comp rx=0 tx=0).stop 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 -- 172.21.15.102:0/464164168 shutdown_connections 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 --2- 172.21.15.102:0/464164168 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e30f140 unknown :-1 s=CLOSED pgs=390 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 -- 172.21.15.102:0/464164168 >> 172.21.15.102:0/464164168 conn(0x55e35e219a70 msgr2=0x55e35e30aac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 -- 172.21.15.102:0/464164168 shutdown_connections 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 -- 172.21.15.102:0/464164168 wait complete. 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 Processor -- start 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 -- start start 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e316bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.925+0000 7efc8072e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e35e226ac0 con 0x55e35e21ffd0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e316bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e316bf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43970/0 (socket says 172.21.15.102:43970) 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efc7c4dd640 1 -- 172.21.15.102:0/4203536484 learned_addr learned my addr 172.21.15.102:0/4203536484 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efc7c4dd640 1 -- 172.21.15.102:0/4203536484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35e317150 con 0x55e35e21ffd0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e316bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efc6c045f20 tx=0x7efc6c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efb68e09640 1 -- 172.21.15.102:0/4203536484 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c053570 con 0x55e35e21ffd0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efb68e09640 1 -- 172.21.15.102:0/4203536484 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c053710 con 0x55e35e21ffd0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e35e3173e0 con 0x55e35e21ffd0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efb68e09640 1 -- 172.21.15.102:0/4203536484 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c068420 con 0x55e35e21ffd0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.926+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e35e317d60 con 0x55e35e21ffd0 2024-09-19T11:13:55.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.927+0000 7efb68e09640 1 -- 172.21.15.102:0/4203536484 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efc6c0685c0 con 0x55e35e21ffd0 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.927+0000 7efb68e09640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb6403d000 0x7efb6403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.927+0000 7efb68e09640 1 -- 172.21.15.102:0/4203536484 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7efc6c070070 con 0x55e35e21ffd0 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.927+0000 7efc73fff640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb6403d000 0x7efb6403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.928+0000 7efc8072e800 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e222900 0x55e35e31e240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.928+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e318960 con 0x55e35e222900 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.928+0000 7efc7ccde640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e222900 0x55e35e31e240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.928+0000 7efc73fff640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb6403d000 0x7efb6403f4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc64000c00 tx=0x7efc640013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.928+0000 7efc7ccde640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e222900 0x55e35e31e240 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.928+0000 7efc7ccde640 1 -- 172.21.15.102:0/4203536484 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e222900 2024-09-19T11:13:55.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.928+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e318280 con 0x55e35e222900 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.929+0000 7efc7ccde640 1 -- 172.21.15.102:0/4203536484 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e222900 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.929+0000 7efc8072e800 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e3206b0 0x55e35e322aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.929+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e323170 con 0x55e35e3206b0 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.929+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e3206b0 0x55e35e322aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.929+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e3206b0 0x55e35e322aa0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.929+0000 7efc7c4dd640 1 -- 172.21.15.102:0/4203536484 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efc6c051070 con 0x55e35e3206b0 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.929+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e31f490 con 0x55e35e222900 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.930+0000 7efc7ccde640 1 -- 172.21.15.102:0/4203536484 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e222900 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.930+0000 7efc8072e800 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e3245b0 0x55e35e3269a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.930+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e327040 con 0x55e35e3245b0 2024-09-19T11:13:55.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.930+0000 7efc73fff640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e3245b0 0x55e35e3269a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.930+0000 7efc73fff640 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e3245b0 0x55e35e3269a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.930+0000 7efc73fff640 1 -- 172.21.15.102:0/4203536484 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efc6400f670 con 0x55e35e3245b0 2024-09-19T11:13:55.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.931+0000 7efc8072e800 1 Processor -- start 2024-09-19T11:13:55.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.931+0000 7efc8072e800 1 -- start start 2024-09-19T11:13:55.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.931+0000 7efc8072e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21f770 0x55e35e21dfe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.931+0000 7efc8072e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e35e1164a0 con 0x55e35e21f770 2024-09-19T11:13:55.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.931+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21f770 0x55e35e21dfe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.931+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21f770 0x55e35e21dfe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43984/0 (socket says 172.21.15.102:43984) 2024-09-19T11:13:55.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.931+0000 7efc7c4dd640 1 -- 172.21.15.102:0/2853953898 learned_addr learned my addr 172.21.15.102:0/2853953898 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.932+0000 7efc7c4dd640 1 -- 172.21.15.102:0/2853953898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35e21fc90 con 0x55e35e21f770 2024-09-19T11:13:55.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.932+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/2853953898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21f770 0x55e35e21dfe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efc6c098010 tx=0x7efc6c05cf60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.932+0000 7efb61ffb640 1 -- 172.21.15.102:0/2853953898 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c0920c0 con 0x55e35e21f770 2024-09-19T11:13:55.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.932+0000 7efb61ffb640 1 -- 172.21.15.102:0/2853953898 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c092260 con 0x55e35e21f770 2024-09-19T11:13:55.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.932+0000 7efc8072e800 1 -- 172.21.15.102:0/2853953898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e35e21e520 con 0x55e35e21f770 2024-09-19T11:13:55.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.932+0000 7efb61ffb640 1 -- 172.21.15.102:0/2853953898 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c095300 con 0x55e35e21f770 2024-09-19T11:13:55.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.932+0000 7efc8072e800 1 -- 172.21.15.102:0/2853953898 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e35e21ea70 con 0x55e35e21f770 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efb61ffb640 1 -- 172.21.15.102:0/2853953898 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efc6c08f2c0 con 0x55e35e21f770 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efb61ffb640 1 --2- 172.21.15.102:0/2853953898 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb5403d000 0x7efb5403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efb61ffb640 1 -- 172.21.15.102:0/2853953898 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7efc6c08ac90 con 0x55e35e21f770 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efc73fff640 1 --2- 172.21.15.102:0/2853953898 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb5403d000 0x7efb5403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efc8072e800 1 Processor -- start 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efc8072e800 1 -- start start 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efc73fff640 1 --2- 172.21.15.102:0/2853953898 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb5403d000 0x7efb5403f4c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55e35e31e850 tx=0x7efc64006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efc8072e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e343cd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.933+0000 7efc8072e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e35e30fb00 con 0x55e35e3438f0 2024-09-19T11:13:55.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.934+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e343cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.934+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e343cd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43988/0 (socket says 172.21.15.102:43988) 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.934+0000 7efc7c4dd640 1 -- 172.21.15.102:0/2923251440 learned_addr learned my addr 172.21.15.102:0/2923251440 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.934+0000 7efc7c4dd640 1 -- 172.21.15.102:0/2923251440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35e3442c0 con 0x55e35e3438f0 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.934+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/2923251440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e343cd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efc6c06dfd0 tx=0x7efc6c002ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=242233c8726339d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.934+0000 7efb5b7fe640 1 -- 172.21.15.102:0/2923251440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c0a7070 con 0x55e35e3438f0 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.934+0000 7efb5b7fe640 1 -- 172.21.15.102:0/2923251440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c0954a0 con 0x55e35e3438f0 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.934+0000 7efb5b7fe640 1 -- 172.21.15.102:0/2923251440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c009410 con 0x55e35e3438f0 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 -- 172.21.15.102:0/2923251440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 msgr2=0x55e35e343cd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 --2- 172.21.15.102:0/2923251440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e343cd0 secure :-1 s=READY pgs=393 cs=0 l=1 rev1=1 crypto rx=0x7efc6c06dfd0 tx=0x7efc6c002ee0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 -- 172.21.15.102:0/2923251440 shutdown_connections 2024-09-19T11:13:55.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 --2- 172.21.15.102:0/2923251440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e343cd0 unknown :-1 s=CLOSED pgs=393 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 -- 172.21.15.102:0/2923251440 >> 172.21.15.102:0/2923251440 conn(0x55e35e33fcf0 msgr2=0x55e35e33df30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 -- 172.21.15.102:0/2923251440 shutdown_connections 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 -- 172.21.15.102:0/2923251440 wait complete. 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 Processor -- start 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 -- start start 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e34add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc8072e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e35e344750 con 0x55e35e3438f0 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.935+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e34add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efc7c4dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e34add0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43990/0 (socket says 172.21.15.102:43990) 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 learned_addr learned my addr 172.21.15.102:0/1899258319 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:55.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e35e34b330 con 0x55e35e3438f0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e34add0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efc6c06de80 tx=0x7efc6c0076c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efb59ffb640 1 -- 172.21.15.102:0/1899258319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c07cc80 con 0x55e35e3438f0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efb59ffb640 1 -- 172.21.15.102:0/1899258319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efc6c009840 con 0x55e35e3438f0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efb59ffb640 1 -- 172.21.15.102:0/1899258319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efc6c07ce60 con 0x55e35e3438f0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e35e34b330 con 0x55e35e3438f0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.936+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e35e34b330 con 0x55e35e3438f0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.937+0000 7efb59ffb640 1 -- 172.21.15.102:0/1899258319 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efc6c0bd030 con 0x55e35e3438f0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.937+0000 7efb59ffb640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb4c03d000 0x7efb4c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.937+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.937+0000 7efb59ffb640 1 -- 172.21.15.102:0/1899258319 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7efc6c0bb070 con 0x55e35e3438f0 2024-09-19T11:13:55.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc73fff640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb4c03d000 0x7efb4c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e356190 0x55e35e358600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e358d50 con 0x55e35e356190 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc7ccde640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e356190 0x55e35e358600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc73fff640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb4c03d000 0x7efb4c03f4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc6400ffd0 tx=0x7efc64023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc7ccde640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e356190 0x55e35e358600 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc8072e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc8072e800 20 realm 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.938+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359160 con 0x55e35e356190 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359a30 con 0x55e35e356190 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e35a8c0 0x55e35e35ccb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e35d3f0 con 0x55e35e35a8c0 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.939+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e35a8c0 0x55e35e35ccb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc7c4dd640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e35a8c0 0x55e35e35ccb0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc8072e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc8072e800 20 searching for the correct realm 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e35f490 0x55e35e361950 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e362020 con 0x55e35e35f490 2024-09-19T11:13:55.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc73fff640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e35f490 0x55e35e361950 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc73fff640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e35f490 0x55e35e361950 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.940+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.941+0000 7efc73fff640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efc6402e910 0x7efc6403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.941+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e362020 con 0x7efc6402e910 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.941+0000 7efc7ccde640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efc6402e910 0x7efc6403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.941+0000 7efc7ccde640 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efc6402e910 0x7efc6403a3c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.941+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.941+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.941+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.941+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.942+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.942+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.942+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.942+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.942+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.942+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.943+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.943+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x7efc6402e910 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.943+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.943+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35f490 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.943+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.943+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.943+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.943+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x7efc6402e910 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35f490 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35f490 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.944+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.945+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.945+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35f490 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.945+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.945+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35f490 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.945+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.945+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.945+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.945+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.946+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.946+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.946+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.946+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35f490 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.946+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.946+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x7efc6402e910 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.946+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.946+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.947+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.947+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.947+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.947+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35f490 2024-09-19T11:13:55.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.947+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.947+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.948+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.948+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x7efc6402e910 2024-09-19T11:13:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.948+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.948+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35f490 2024-09-19T11:13:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.948+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc64037040 con 0x55e35e35f490 2024-09-19T11:13:55.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.948+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e35a8c0 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.948+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.948+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x55e35e356190 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55e35e359dd0 con 0x7efc6402e910 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:55.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e35dd90 con 0x55e35e356190 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e35dd90 con 0x55e35e356190 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.949+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e35dd90 con 0x55e35e35f490 2024-09-19T11:13:55.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 zone default found 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 4 Realm: () 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 zonegroup default 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e35e630 con 0x55e35e35a8c0 2024-09-19T11:13:55.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e363e90 con 0x55e35e35f490 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e364230 con 0x55e35e35f490 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:55.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 started sync module instance, tier type = 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.950+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e363330 con 0x7efc6402e910 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.951+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.951+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94435026548816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e363330 con 0x7efc6402e910 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.951+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e364cb0 con 0x55e35e356190 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.952+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94435026548816] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.953+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.953+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94435026546304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e364c70 con 0x55e35e356190 2024-09-19T11:13:55.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.953+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3656f0 con 0x55e35e35f490 2024-09-19T11:13:55.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.954+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.954+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94435026555392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e365fc0 con 0x55e35e35f490 2024-09-19T11:13:55.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.954+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e366aa0 con 0x7efc6402e910 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.954+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94435026546304] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.955+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94435026555392] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.955+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.955+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94435026557712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3665b0 con 0x7efc6402e910 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.955+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e367370 con 0x55e35e356190 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.956+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.956+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94435026562672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e367290 con 0x55e35e356190 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.956+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e368290 con 0x55e35e35a8c0 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.957+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94435026557712] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.957+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.957+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94435026566528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e368680 con 0x55e35e35a8c0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.957+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e369040 con 0x55e35e35a8c0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.958+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94435026562672] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.958+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94435026566528] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.958+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.958+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94435026564960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e369040 con 0x55e35e35a8c0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.958+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3698e0 con 0x55e35e35a8c0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'102 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94435026572336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e369d00 con 0x55e35e35a8c0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc8072e800 20 add_watcher() i=0 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc8072e800 20 add_watcher() i=1 2024-09-19T11:13:55.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc8072e800 20 add_watcher() i=2 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc8072e800 20 add_watcher() i=3 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc8072e800 20 add_watcher() i=4 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc8072e800 20 add_watcher() i=5 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94435026564960] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.959+0000 7efc8072e800 20 add_watcher() i=6 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.960+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94435026572336] v35'103 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.960+0000 7efc8072e800 20 add_watcher() i=7 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.960+0000 7efc8072e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.960+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e369d00 con 0x55e35e356190 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.961+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.961+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94435026573392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e369c70 con 0x55e35e356190 2024-09-19T11:13:55.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94435026573392] v35'102 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efb327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efc8072e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efc8072e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efc8072e800 5 note: GC not initialized 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efb317e2640 20 reqs_thread_entry: start 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efc8072e800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efc8072e800 20 Filter name: none 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efaa2ffd640 20 reqs_thread_entry: start 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.962+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e39f710 con 0x55e35e356190 2024-09-19T11:13:55.991 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.963+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.963+0000 7efc8072e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.963+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a0b30 con 0x7efc6402e910 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.963+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv14 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.963+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.963+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a0b00 con 0x55e35e35a8c0 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 4.e 4:735adac5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a2550 con 0x7efc6402e910 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 4.15 4:a8990202:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a5170 con 0x55e35e35f490 2024-09-19T11:13:55.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 4.0 4:015ead7d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a7e60 con 0x55e35e35f490 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 4.2a 4:54dc5602:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3aab90 con 0x55e35e356190 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 4.28 4:14a92d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3ad8e0 con 0x55e35e356190 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 4.4 4:22751d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3b0550 con 0x55e35e35a8c0 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 4.2d 4:b7aa4218:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a7ec0 con 0x55e35e35a8c0 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:72 4.1f 4:f9ffeb7c:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3ad8e0 con 0x55e35e35f490 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:73 4.e 4:72d65baa:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3aab90 con 0x7efc6402e910 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 4.1 4:80601e6d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3b0550 con 0x7efc6402e910 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 4.0 4:02fa5d61:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3bc1d0 con 0x55e35e35f490 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5 [call out=128b] v0'0 uv3 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(66 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(68 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(72 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(75 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(69 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(74 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.964+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(73 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8 [call out=89b] v0'0 uv2 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.965+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:76 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ae0 con 0x7efc6402e910 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.966+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(76 foo.buckets [call] v35'15 uv15 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.966+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:77 8.9 8:96d98480:users.uid::foo.buckets:head [call user.complete_stats_sync in=37b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3aa500 con 0x7efc6402e910 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.967+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(77 foo.buckets [call] v35'16 uv16 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7efc7400a4d0 con 0x7efc6402e910 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.967+0000 7efc8072e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.967+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:78 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x55e35e356190 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.967+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(78 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7efc7400a4d0 con 0x55e35e356190 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.967+0000 7efc8072e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.967+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:79 8.9 8:96d98480:users.uid::foo.buckets:head [call user.get_header in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x7efc6402e910 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.967+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(79 foo.buckets [call out=58b] v0'0 uv16 ondisk = 0) ==== 155+0+58 (crc 0 0 0) 0x7efc7404b050 con 0x7efc6402e910 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.968+0000 7efb327e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.968+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94435026573392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x55e35e356190 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.969+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 data_loggenerations_metadata [watch unwatch cookie 94435026573392] v35'103 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efc7404b050 con 0x55e35e356190 2024-09-19T11:13:55.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.969+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:81 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94435026548816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x7efc6402e910 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.970+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(81 notify.0 [watch unwatch cookie 94435026548816] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7404b050 con 0x7efc6402e910 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.970+0000 7efc8072e800 20 remove_watcher() i=0 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.970+0000 7efc8072e800 2 removed watcher, disabling cache 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.970+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:82 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94435026546304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x55e35e356190 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.971+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(82 notify.1 [watch unwatch cookie 94435026546304] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7404b050 con 0x55e35e356190 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.971+0000 7efc8072e800 20 remove_watcher() i=1 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.971+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:83 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94435026555392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x55e35e35f490 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.972+0000 7efc73fff640 1 -- 172.21.15.102:0/1899258319 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(83 notify.2 [watch unwatch cookie 94435026555392] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc640491c0 con 0x55e35e35f490 2024-09-19T11:13:55.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.972+0000 7efc8072e800 20 remove_watcher() i=2 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.972+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:84 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94435026557712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x7efc6402e910 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.973+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(84 notify.3 [watch unwatch cookie 94435026557712] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7404b050 con 0x7efc6402e910 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.973+0000 7efc8072e800 20 remove_watcher() i=3 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.973+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:85 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94435026562672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x55e35e356190 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.974+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(85 notify.4 [watch unwatch cookie 94435026562672] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc7404b050 con 0x55e35e356190 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.974+0000 7efc8072e800 20 remove_watcher() i=4 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.974+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:86 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94435026566528] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x55e35e35a8c0 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.975+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(86 notify.5 [watch unwatch cookie 94435026566528] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.975+0000 7efc8072e800 20 remove_watcher() i=5 2024-09-19T11:13:55.997 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.975+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:87 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94435026564960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x55e35e35a8c0 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.976+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(87 notify.6 [watch unwatch cookie 94435026564960] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.976+0000 7efc8072e800 20 remove_watcher() i=6 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.976+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94435026572336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55e35e3a4ac0 con 0x55e35e35a8c0 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc7c4dd640 1 -- 172.21.15.102:0/1899258319 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(88 notify.7 [watch unwatch cookie 94435026572336] v35'104 uv102 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efc6c0a9030 con 0x55e35e35a8c0 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 20 remove_watcher() i=7 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e35a8c0 msgr2=0x55e35e35ccb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e35a8c0 0x55e35e35ccb0 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e356190 msgr2=0x55e35e358600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e356190 0x55e35e358600 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efc6402e910 msgr2=0x7efc6403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efc6402e910 0x7efc6403a3c0 crc :-1 s=READY pgs=43 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e35f490 msgr2=0x55e35e361950 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e35f490 0x55e35e361950 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb4c03d000 msgr2=0x7efb4c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb4c03d000 0x7efb4c03f4c0 secure :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0x7efc6400ffd0 tx=0x7efc64023040 comp rx=0 tx=0).stop 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc7ccde640 1 -- 172.21.15.102:0/1899258319 reap_dead start 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 msgr2=0x55e35e34add0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.977+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e34add0 secure :-1 s=READY pgs=394 cs=0 l=1 rev1=1 crypto rx=0x7efc6c06de80 tx=0x7efc6c0076c0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 shutdown_connections 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/1899258319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e3438f0 0x55e35e34add0 unknown :-1 s=CLOSED pgs=394 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 >> 172.21.15.102:0/1899258319 conn(0x55e35e33fcf0 msgr2=0x55e35e33df00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:55.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 shutdown_connections 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/1899258319 wait complete. 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/2853953898 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb5403d000 msgr2=0x7efb5403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/2853953898 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb5403d000 0x7efb5403f4c0 secure :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0x55e35e31e850 tx=0x7efc64006000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/2853953898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21f770 msgr2=0x55e35e21dfe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/2853953898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21f770 0x55e35e21dfe0 secure :-1 s=READY pgs=392 cs=0 l=1 rev1=1 crypto rx=0x7efc6c098010 tx=0x7efc6c05cf60 comp rx=0 tx=0).stop 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/2853953898 shutdown_connections 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/2853953898 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb5403d000 0x7efb5403f4c0 unknown :-1 s=CLOSED pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/2853953898 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21f770 0x55e35e21dfe0 unknown :-1 s=CLOSED pgs=392 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/2853953898 >> 172.21.15.102:0/2853953898 conn(0x55e35e329130 msgr2=0x55e35e329510 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/2853953898 shutdown_connections 2024-09-19T11:13:56.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/2853953898 wait complete. 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e3206b0 msgr2=0x55e35e322aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e35e3206b0 0x55e35e322aa0 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e222900 msgr2=0x55e35e31e240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e35e222900 0x55e35e31e240 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e3245b0 msgr2=0x55e35e3269a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e35e3245b0 0x55e35e3269a0 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb6403d000 msgr2=0x7efb6403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efb6403d000 0x7efb6403f4c0 secure :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0x7efc64000c00 tx=0x7efc640013b0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 msgr2=0x55e35e316bf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 --2- 172.21.15.102:0/4203536484 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e35e21ffd0 0x55e35e316bf0 secure :-1 s=READY pgs=391 cs=0 l=1 rev1=1 crypto rx=0x7efc6c045f20 tx=0x7efc6c002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc7ccde640 1 -- 172.21.15.102:0/4203536484 reap_dead start 2024-09-19T11:13:56.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.978+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 shutdown_connections 2024-09-19T11:13:56.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.979+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 >> 172.21.15.102:0/4203536484 conn(0x55e35e219a70 msgr2=0x55e35e310530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.979+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 shutdown_connections 2024-09-19T11:13:56.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:55.979+0000 7efc8072e800 1 -- 172.21.15.102:0/4203536484 wait complete. 2024-09-19T11:13:56.003 INFO:teuthology.orchestra.run.smithi102.stdout:{"stats":{"size":3,"size_actual":4096,"size_kb":1,"size_kb_actual":4,"num_objects":1},"last_stats_sync":"2024-09-19T11:13:55.966870Z","last_stats_update":"2024-09-19T11:13:55.965832Z"} 2024-09-19T11:13:56.003 DEBUG:tasks.util.rgw: json result: {'stats': {'size': 3, 'size_actual': 4096, 'size_kb': 1, 'size_kb_actual': 4, 'num_objects': 1}, 'last_stats_sync': '2024-09-19T11:13:55.966870Z', 'last_stats_update': '2024-09-19T11:13:55.965832Z'} 2024-09-19T11:13:56.009 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:56.009 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-19T11:13:56.009 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'foo', '--bucket', 'myfoo'] 2024-09-19T11:13:56.009 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid foo --bucket myfoo 2024-09-19T11:13:56.055 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:56.056 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.055+0000 7fb201c63800 1 Processor -- start 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.055+0000 7fb201c63800 1 -- start start 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.055+0000 7fb201c63800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5638dca5c6a0 0x5638dca5d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.055+0000 7fb201c63800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5638dca5cd50 con 0x5638dca5d8e0 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.055+0000 7fb201c63800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5638dc8e87d0 con 0x5638dca5c6a0 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.056+0000 7fb1ff754640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5638dca5c6a0 0x5638dca5d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.056+0000 7fb1f6f53640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5638dca5d8e0 0x5638dca62640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52480/0 (socket says 172.21.15.102:52480) 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.056+0000 7fb1f6f53640 1 -- 172.21.15.102:0/492606353 learned_addr learned my addr 172.21.15.102:0/492606353 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:56.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.056+0000 7fb1ff754640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5638dca5c6a0 0x5638dca5d3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44000/0 (socket says 172.21.15.102:44000) 2024-09-19T11:13:56.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.056+0000 7fb1ff754640 1 -- 172.21.15.102:0/492606353 >> v1:172.21.15.37:6789/0 conn(0x5638dca5d8e0 legacy=0x5638dca62640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.056+0000 7fb1ff754640 1 -- 172.21.15.102:0/492606353 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638dca5dd90 con 0x5638dca5c6a0 2024-09-19T11:13:56.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb1ff754640 1 --2- 172.21.15.102:0/492606353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dca5d3a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000a470 tx=0x7fb1f0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=950a0741b69f4380 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb1fef53640 1 -- 172.21.15.102:0/492606353 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f0053570 con 0x5638dca5c6a0 2024-09-19T11:13:56.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb1fef53640 1 -- 172.21.15.102:0/492606353 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f0058070 con 0x5638dca5c6a0 2024-09-19T11:13:56.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb1fef53640 1 -- 172.21.15.102:0/492606353 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f0053880 con 0x5638dca5c6a0 2024-09-19T11:13:56.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb201c63800 1 -- 172.21.15.102:0/492606353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 msgr2=0x5638dca5d3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb201c63800 1 --2- 172.21.15.102:0/492606353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dca5d3a0 secure :-1 s=READY pgs=396 cs=0 l=1 rev1=1 crypto rx=0x7fb1f000a470 tx=0x7fb1f0045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:56.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb201c63800 1 -- 172.21.15.102:0/492606353 shutdown_connections 2024-09-19T11:13:56.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb201c63800 1 --2- 172.21.15.102:0/492606353 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dca5d3a0 unknown :-1 s=CLOSED pgs=396 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb201c63800 1 -- 172.21.15.102:0/492606353 >> 172.21.15.102:0/492606353 conn(0x5638dca57a70 msgr2=0x5638dca59ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb201c63800 1 -- 172.21.15.102:0/492606353 shutdown_connections 2024-09-19T11:13:56.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.058+0000 7fb201c63800 1 -- 172.21.15.102:0/492606353 wait complete. 2024-09-19T11:13:56.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.072+0000 7fb201c63800 1 Processor -- start 2024-09-19T11:13:56.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.072+0000 7fb201c63800 1 -- start start 2024-09-19T11:13:56.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.072+0000 7fb201c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb4d340 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.072+0000 7fb201c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5638dc8f5dd0 con 0x5638dca5c6a0 2024-09-19T11:13:56.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.072+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb4d340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.073+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb4d340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44012/0 (socket says 172.21.15.102:44012) 2024-09-19T11:13:56.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.073+0000 7fb1ff754640 1 -- 172.21.15.102:0/683500992 learned_addr learned my addr 172.21.15.102:0/683500992 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.073+0000 7fb1ff754640 1 -- 172.21.15.102:0/683500992 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638dcb4d930 con 0x5638dca5c6a0 2024-09-19T11:13:56.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.073+0000 7fb1ff754640 1 --2- 172.21.15.102:0/683500992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb4d340 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0025c20 tx=0x7fb1f0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=204a0a18b8921900 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.073+0000 7fb0ed60a640 1 -- 172.21.15.102:0/683500992 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f005c580 con 0x5638dca5c6a0 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.073+0000 7fb0ed60a640 1 -- 172.21.15.102:0/683500992 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f0063030 con 0x5638dca5c6a0 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.073+0000 7fb0ed60a640 1 -- 172.21.15.102:0/683500992 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f005c850 con 0x5638dca5c6a0 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 -- 172.21.15.102:0/683500992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 msgr2=0x5638dcb4d340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 --2- 172.21.15.102:0/683500992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb4d340 secure :-1 s=READY pgs=397 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0025c20 tx=0x7fb1f0051000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 -- 172.21.15.102:0/683500992 shutdown_connections 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 --2- 172.21.15.102:0/683500992 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb4d340 unknown :-1 s=CLOSED pgs=397 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 -- 172.21.15.102:0/683500992 >> 172.21.15.102:0/683500992 conn(0x5638dca57a70 msgr2=0x5638dcb4b6c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 -- 172.21.15.102:0/683500992 shutdown_connections 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 -- 172.21.15.102:0/683500992 wait complete. 2024-09-19T11:13:56.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 Processor -- start 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 -- start start 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb54db0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.074+0000 7fb201c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5638dca63d60 con 0x5638dca5c6a0 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb54db0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb54db0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44022/0 (socket says 172.21.15.102:44022) 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb1ff754640 1 -- 172.21.15.102:0/1456027120 learned_addr learned my addr 172.21.15.102:0/1456027120 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb1ff754640 1 -- 172.21.15.102:0/1456027120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638dcb55310 con 0x5638dca5c6a0 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb1ff754640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb54db0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0045f50 tx=0x7fb1f0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb0ebe07640 1 -- 172.21.15.102:0/1456027120 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f0054ad0 con 0x5638dca5c6a0 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb0ebe07640 1 -- 172.21.15.102:0/1456027120 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f0054c70 con 0x5638dca5c6a0 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638dcb555a0 con 0x5638dca5c6a0 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb0ebe07640 1 -- 172.21.15.102:0/1456027120 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f0068420 con 0x5638dca5c6a0 2024-09-19T11:13:56.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.075+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638dcb55fa0 con 0x5638dca5c6a0 2024-09-19T11:13:56.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.076+0000 7fb0ebe07640 1 -- 172.21.15.102:0/1456027120 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb1f00685c0 con 0x5638dca5c6a0 2024-09-19T11:13:56.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.077+0000 7fb0ebe07640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0e403d050 0x7fb0e403f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.077+0000 7fb0ebe07640 1 -- 172.21.15.102:0/1456027120 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb1f0070030 con 0x5638dca5c6a0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.077+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0e403d050 0x7fb0e403f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.077+0000 7fb201c63800 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dca5d8e0 0x5638dcb5c400 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.077+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb5c940 con 0x5638dca5d8e0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.077+0000 7fb1fff55640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dca5d8e0 0x5638dcb5c400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.077+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0e403d050 0x7fb0e403f510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8001d70 tx=0x7fb1e80012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.077+0000 7fb1fff55640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dca5d8e0 0x5638dcb5c400 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.078+0000 7fb1fff55640 1 -- 172.21.15.102:0/1456027120 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dca5d8e0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.078+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb5cce0 con 0x5638dca5d8e0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.078+0000 7fb1fff55640 1 -- 172.21.15.102:0/1456027120 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dca5d8e0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.078+0000 7fb201c63800 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb5e7a0 0x5638dcb60c40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.078+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb613d0 con 0x5638dcb5e7a0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.078+0000 7fb1ff754640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb5e7a0 0x5638dcb60c40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.079+0000 7fb1ff754640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb5e7a0 0x5638dcb60c40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.079+0000 7fb1ff754640 1 -- 172.21.15.102:0/1456027120 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb1f0051070 con 0x5638dcb5e7a0 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.079+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb5d530 con 0x5638dca5d8e0 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.079+0000 7fb1fff55640 1 -- 172.21.15.102:0/1456027120 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dca5d8e0 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.079+0000 7fb201c63800 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb62830 0x5638dcb64c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.079+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb65310 con 0x5638dcb62830 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.079+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb62830 0x5638dcb64c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.079+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb62830 0x5638dcb64c20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.080+0000 7fb1f6f53640 1 -- 172.21.15.102:0/1456027120 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb62830 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.080+0000 7fb201c63800 1 Processor -- start 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.080+0000 7fb201c63800 1 -- start start 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.080+0000 7fb201c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb73090 0x5638dcb734b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.080+0000 7fb201c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5638dc9544a0 con 0x5638dcb73090 2024-09-19T11:13:56.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.080+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb73090 0x5638dcb734b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.080+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb73090 0x5638dcb734b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44036/0 (socket says 172.21.15.102:44036) 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.080+0000 7fb1ff754640 1 -- 172.21.15.102:0/3837187717 learned_addr learned my addr 172.21.15.102:0/3837187717 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.081+0000 7fb1ff754640 1 -- 172.21.15.102:0/3837187717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638dcb73af0 con 0x5638dcb73090 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.081+0000 7fb1ff754640 1 --2- 172.21.15.102:0/3837187717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb73090 0x5638dcb734b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0096ac0 tx=0x7fb1f00744e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.081+0000 7fb0e9602640 1 -- 172.21.15.102:0/3837187717 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f005e550 con 0x5638dcb73090 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.081+0000 7fb0e9602640 1 -- 172.21.15.102:0/3837187717 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f0096bd0 con 0x5638dcb73090 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.081+0000 7fb201c63800 1 -- 172.21.15.102:0/3837187717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638dcb74320 con 0x5638dcb73090 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.081+0000 7fb0e9602640 1 -- 172.21.15.102:0/3837187717 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f005e7a0 con 0x5638dcb73090 2024-09-19T11:13:56.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.081+0000 7fb201c63800 1 -- 172.21.15.102:0/3837187717 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638dcb748c0 con 0x5638dcb73090 2024-09-19T11:13:56.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.082+0000 7fb0e9602640 1 -- 172.21.15.102:0/3837187717 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb1f00688b0 con 0x5638dcb73090 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.082+0000 7fb0e9602640 1 --2- 172.21.15.102:0/3837187717 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0d803d000 0x7fb0d803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.082+0000 7fb0e9602640 1 -- 172.21.15.102:0/3837187717 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb1f0055070 con 0x5638dcb73090 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.082+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/3837187717 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0d803d000 0x7fb0d803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.082+0000 7fb201c63800 1 Processor -- start 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.082+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/3837187717 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0d803d000 0x7fb0d803f4c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800bf40 tx=0x7fb1e800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.083+0000 7fb201c63800 1 -- start start 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.083+0000 7fb201c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb7fd10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.083+0000 7fb201c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5638dcb4dd00 con 0x5638dcb7f930 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.083+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb7fd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.083+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb7fd10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44046/0 (socket says 172.21.15.102:44046) 2024-09-19T11:13:56.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.083+0000 7fb1ff754640 1 -- 172.21.15.102:0/3063364032 learned_addr learned my addr 172.21.15.102:0/3063364032 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.083+0000 7fb1ff754640 1 -- 172.21.15.102:0/3063364032 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638dcb80300 con 0x5638dcb7f930 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.083+0000 7fb1ff754640 1 --2- 172.21.15.102:0/3063364032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb7fd10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb1f005cce0 tx=0x7fb1f0009fc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=62d4c75c73876236 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb0e2ffd640 1 -- 172.21.15.102:0/3063364032 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f0089420 con 0x5638dcb7f930 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb0e2ffd640 1 -- 172.21.15.102:0/3063364032 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f005c450 con 0x5638dcb7f930 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb0e2ffd640 1 -- 172.21.15.102:0/3063364032 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f00895c0 con 0x5638dcb7f930 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 -- 172.21.15.102:0/3063364032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 msgr2=0x5638dcb7fd10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 --2- 172.21.15.102:0/3063364032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb7fd10 secure :-1 s=READY pgs=400 cs=0 l=1 rev1=1 crypto rx=0x7fb1f005cce0 tx=0x7fb1f0009fc0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 -- 172.21.15.102:0/3063364032 shutdown_connections 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 --2- 172.21.15.102:0/3063364032 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb7fd10 unknown :-1 s=CLOSED pgs=400 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 -- 172.21.15.102:0/3063364032 >> 172.21.15.102:0/3063364032 conn(0x5638dcb7bd30 msgr2=0x5638dcb79f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 -- 172.21.15.102:0/3063364032 shutdown_connections 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 -- 172.21.15.102:0/3063364032 wait complete. 2024-09-19T11:13:56.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 Processor -- start 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.084+0000 7fb201c63800 1 -- start start 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb201c63800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb86d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb201c63800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5638dcb80790 con 0x5638dcb7f930 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb86d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb1ff754640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb86d00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44054/0 (socket says 172.21.15.102:44054) 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 learned_addr learned my addr 172.21.15.102:0/4056221732 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5638dcb87260 con 0x5638dcb7f930 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb1ff754640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb86d00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb1f005cc70 tx=0x7fb1f0002ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb0e17fa640 1 -- 172.21.15.102:0/4056221732 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f00bf030 con 0x5638dcb7f930 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb0e17fa640 1 -- 172.21.15.102:0/4056221732 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb1f006bc60 con 0x5638dcb7f930 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5638dcb87260 con 0x5638dcb7f930 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb0e17fa640 1 -- 172.21.15.102:0/4056221732 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb1f00899d0 con 0x5638dcb7f930 2024-09-19T11:13:56.100 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.085+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5638dcb87260 con 0x5638dcb7f930 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.086+0000 7fb0e17fa640 1 -- 172.21.15.102:0/4056221732 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb1f00c2070 con 0x5638dcb7f930 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.086+0000 7fb0e17fa640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0c803d000 0x7fb0c803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.086+0000 7fb0e17fa640 1 -- 172.21.15.102:0/4056221732 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb1f00c0070 con 0x5638dcb7f930 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.086+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0c803d000 0x7fb0c803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.087+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0c803d000 0x7fb0c803f4c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c010 tx=0x7fb1e8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.087+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.087+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dcb92100 0x5638dcb945c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.087+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb94d10 con 0x5638dcb92100 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.087+0000 7fb1fff55640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dcb92100 0x5638dcb945c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.087+0000 7fb1fff55640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dcb92100 0x5638dcb945c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.101 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 realm 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95120 con 0x5638dcb92100 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb959f0 con 0x5638dcb92100 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb96af0 0x5638dcb98ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.088+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb99530 con 0x5638dcb96af0 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.089+0000 7fb1ff754640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb96af0 0x5638dcb98ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.089+0000 7fb1ff754640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb96af0 0x5638dcb98ee0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.089+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.089+0000 7fb201c63800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.089+0000 7fb201c63800 20 searching for the correct realm 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.089+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb9b500 0x5638dcb9d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.089+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb9e040 con 0x5638dcb9b500 2024-09-19T11:13:56.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.090+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb9b500 0x5638dcb9d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.090+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb9b500 0x5638dcb9d9c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.090+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.090+0000 7fb1f6f53640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb1e8037040 0x7fb1e8036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.090+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb9e040 con 0x7fb1e8037040 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.090+0000 7fb1fff55640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb1e8037040 0x7fb1e8036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.091+0000 7fb1fff55640 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb1e8037040 0x7fb1e8036410 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.091+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.091+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.091+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.091+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.091+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.091+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.092+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.092+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.092+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.092+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.092+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.092+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x7fb1e8037040 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.092+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.092+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb9b500 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x7fb1e8037040 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.093+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.094+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb9b500 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.094+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.094+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb9b500 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.094+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.094+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.094+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.094+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb9b500 2024-09-19T11:13:56.106 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.095+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.095+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb9b500 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.095+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.095+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.095+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.095+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.095+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.095+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.096+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.096+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb9b500 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.096+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.096+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x7fb1e8037040 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.096+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.096+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.107 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.096+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.096+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb9b500 2024-09-19T11:13:56.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x7fb1e8037040 2024-09-19T11:13:56.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb9b500 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.097+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb96af0 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x5638dcb92100 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb95d90 con 0x7fb1e8037040 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:56.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb99df0 con 0x5638dcb92100 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.098+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb99df0 con 0x5638dcb92100 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb99df0 con 0x5638dcb9b500 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 20 zone default found 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 4 Realm: () 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 20 zonegroup default 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb9a740 con 0x5638dcb96af0 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.099+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba0040 con 0x5638dcb9b500 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb201c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba0510 con 0x5638dcb9b500 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb201c63800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb201c63800 20 started sync module instance, tier type = 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb201c63800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:56.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.100+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb9f350 con 0x7fb1e8037040 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.101+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.101+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94802221332592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb9f350 con 0x7fb1e8037040 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.101+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba0fd0 con 0x5638dcb92100 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.102+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94802221332592] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.102+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.102+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94802221337312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb9f350 con 0x5638dcb92100 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.102+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba1a60 con 0x5638dcb9b500 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.103+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.103+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94802221339952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba2300 con 0x5638dcb9b500 2024-09-19T11:13:56.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.103+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba2e00 con 0x7fb1e8037040 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.103+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94802221337312] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.104+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.104+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94802221345008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba31f0 con 0x7fb1e8037040 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.104+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba3bf0 con 0x5638dcb92100 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.104+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94802221339952] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.105+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.105+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94802221345008] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.105+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94802221342288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba3bb0 con 0x5638dcb92100 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.105+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcb9eea0 con 0x5638dcb96af0 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.106+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.106+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94802221351248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba4a20 con 0x5638dcb96af0 2024-09-19T11:13:56.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.106+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94802221342288] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.106+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba3700 con 0x5638dcb96af0 2024-09-19T11:13:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.107+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94802221351248] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.107+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.107+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94802221352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba5480 con 0x5638dcb96af0 2024-09-19T11:13:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.107+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba5f70 con 0x5638dcb96af0 2024-09-19T11:13:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'105 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94802221357632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba6760 con 0x5638dcb96af0 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb201c63800 20 add_watcher() i=0 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb201c63800 20 add_watcher() i=1 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb201c63800 20 add_watcher() i=2 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb201c63800 20 add_watcher() i=3 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb201c63800 20 add_watcher() i=4 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb201c63800 20 add_watcher() i=5 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 94802221352304] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.109+0000 7fb201c63800 20 add_watcher() i=6 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.110+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94802221357632] v35'106 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.110+0000 7fb201c63800 20 add_watcher() i=7 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.110+0000 7fb201c63800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:56.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.110+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba4f30 con 0x5638dcb92100 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.110+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.110+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94802221359600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba4f30 con 0x5638dcb92100 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.111+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94802221359600] v35'104 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.111+0000 7fb0b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.111+0000 7fb201c63800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.111+0000 7fb201c63800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.111+0000 7fb201c63800 5 note: GC not initialized 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.111+0000 7fb0b4fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 20 Filter name: none 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb02e7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:56.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbdc670 con 0x5638dcb92100 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbdc0d0 con 0x7fb1e8037040 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv1 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.112+0000 7fb201c63800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:13:56.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbdfdd0 con 0x5638dcb96af0 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.113+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbe2fd0 con 0x7fb1e8037040 2024-09-19T11:13:56.131 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.114+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 foo.buckets [call] v35'17 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.114+0000 7fb201c63800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.114+0000 7fb201c63800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.114+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbe2090 con 0x7fb1e8037040 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.115+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.115+0000 7fb201c63800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.115+0000 7fb201c63800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.115+0000 7fb201c63800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.115+0000 7fb201c63800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.115+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbe6d70 con 0x7fb1e8037040 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v35'18 uv18 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb201c63800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb201c63800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.132 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb201c63800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94802221623488 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbe3a90 con 0x5638dcb96af0 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== watch-notify(notify (1) cookie 94802221352304 notify 150323855362 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5638dcbde2b0 con 0x5638dcb96af0 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb0e2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94802221352304 notifier 4491 bl.length()=338 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(68 notify.6 [notify cookie 94802221623488 out=8b] v0'0 uv105 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb0e2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb0e2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.116+0000 7fb0e2ffd640 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb0c4003ea0 con 0x5638dcb96af0 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.117+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.117+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== watch-notify(notify_complete (2) cookie 94802221623488 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5638dcb73af0 con 0x5638dcb96af0 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.117+0000 7fb0b5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.118+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94802221359600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbda4f0 con 0x5638dcb92100 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.118+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94802221359600] v35'105 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.133 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.119+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94802221332592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbda4f0 con 0x7fb1e8037040 2024-09-19T11:13:56.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.119+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94802221332592] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.119+0000 7fb201c63800 20 remove_watcher() i=0 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.119+0000 7fb201c63800 2 removed watcher, disabling cache 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.119+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94802221337312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbda4f0 con 0x5638dcb92100 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.121+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94802221337312] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.121+0000 7fb201c63800 20 remove_watcher() i=1 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.121+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94802221339952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcbda4f0 con 0x5638dcb9b500 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.122+0000 7fb1f6f53640 1 -- 172.21.15.102:0/4056221732 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94802221339952] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1e8009050 con 0x5638dcb9b500 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.122+0000 7fb201c63800 20 remove_watcher() i=2 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.122+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94802221345008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba0ae0 con 0x7fb1e8037040 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.123+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94802221345008] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x7fb1e8037040 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.123+0000 7fb201c63800 20 remove_watcher() i=3 2024-09-19T11:13:56.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.123+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94802221342288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba0ae0 con 0x5638dcb92100 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.124+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94802221342288] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f800a4d0 con 0x5638dcb92100 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.124+0000 7fb201c63800 20 remove_watcher() i=4 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.124+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94802221351248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba0ae0 con 0x5638dcb96af0 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.125+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94802221351248] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.125+0000 7fb201c63800 20 remove_watcher() i=5 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.125+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94802221352304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba0ae0 con 0x5638dcb96af0 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.126+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94802221352304] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.126+0000 7fb201c63800 20 remove_watcher() i=6 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.126+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94802221357632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5638dcba0ae0 con 0x5638dcb96af0 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb1ff754640 1 -- 172.21.15.102:0/4056221732 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94802221357632] v35'107 uv105 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb1f008f070 con 0x5638dcb96af0 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 20 remove_watcher() i=7 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb96af0 msgr2=0x5638dcb98ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb96af0 0x5638dcb98ee0 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dcb92100 msgr2=0x5638dcb945c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dcb92100 0x5638dcb945c0 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb1e8037040 msgr2=0x7fb1e8036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb1e8037040 0x7fb1e8036410 crc :-1 s=READY pgs=44 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb9b500 msgr2=0x5638dcb9d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb9b500 0x5638dcb9d9c0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0c803d000 msgr2=0x7fb0c803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0c803d000 0x7fb0c803f4c0 secure :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800c010 tx=0x7fb1e8010000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 msgr2=0x5638dcb86d00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 --2- 172.21.15.102:0/4056221732 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb7f930 0x5638dcb86d00 secure :-1 s=READY pgs=401 cs=0 l=1 rev1=1 crypto rx=0x7fb1f005cc70 tx=0x7fb1f0002ee0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 reap_dead start 2024-09-19T11:13:56.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb1fff55640 1 -- 172.21.15.102:0/4056221732 reap_dead start 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 shutdown_connections 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 >> 172.21.15.102:0/4056221732 conn(0x5638dcb7bd30 msgr2=0x5638dcb79f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 shutdown_connections 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.127+0000 7fb201c63800 1 -- 172.21.15.102:0/4056221732 wait complete. 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/3837187717 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0d803d000 msgr2=0x7fb0d803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/3837187717 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0d803d000 0x7fb0d803f4c0 secure :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0x7fb1e800bf40 tx=0x7fb1e800f000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/3837187717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb73090 msgr2=0x5638dcb734b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/3837187717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb73090 0x5638dcb734b0 secure :-1 s=READY pgs=399 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0096ac0 tx=0x7fb1f00744e0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/3837187717 shutdown_connections 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/3837187717 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0d803d000 0x7fb0d803f4c0 unknown :-1 s=CLOSED pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/3837187717 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dcb73090 0x5638dcb734b0 unknown :-1 s=CLOSED pgs=399 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/3837187717 >> 172.21.15.102:0/3837187717 conn(0x5638dcb67440 msgr2=0x5638dcb67820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/3837187717 shutdown_connections 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/3837187717 wait complete. 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb5e7a0 msgr2=0x5638dcb60c40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5638dcb5e7a0 0x5638dcb60c40 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dca5d8e0 msgr2=0x5638dcb5c400 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5638dca5d8e0 0x5638dcb5c400 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb62830 msgr2=0x5638dcb64c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5638dcb62830 0x5638dcb64c20 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0e403d050 msgr2=0x7fb0e403f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb0e403d050 0x7fb0e403f510 secure :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0x7fb1e8001d70 tx=0x7fb1e80012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 msgr2=0x5638dcb54db0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 --2- 172.21.15.102:0/1456027120 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5638dca5c6a0 0x5638dcb54db0 secure :-1 s=READY pgs=398 cs=0 l=1 rev1=1 crypto rx=0x7fb1f0045f50 tx=0x7fb1f0002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb1fff55640 1 -- 172.21.15.102:0/1456027120 reap_dead start 2024-09-19T11:13:56.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 shutdown_connections 2024-09-19T11:13:56.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 >> 172.21.15.102:0/1456027120 conn(0x5638dca57a70 msgr2=0x5638dcb46bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 shutdown_connections 2024-09-19T11:13:56.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.128+0000 7fb201c63800 1 -- 172.21.15.102:0/1456027120 wait complete. 2024-09-19T11:13:56.144 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-19T11:13:56.144 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-19T11:13:56.144 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-19T11:13:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:56.197 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:56.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.197+0000 7fa9efda9800 1 Processor -- start 2024-09-19T11:13:56.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.197+0000 7fa9efda9800 1 -- start start 2024-09-19T11:13:56.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.197+0000 7fa9efda9800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5626e22652c0 0x5626e22f9410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.197+0000 7fa9efda9800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5626e22f9950 con 0x5626e2266650 2024-09-19T11:13:56.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.197+0000 7fa9efda9800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5626e217b7d0 con 0x5626e22652c0 2024-09-19T11:13:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.197+0000 7fa9e7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5626e22652c0 0x5626e22f9410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.197+0000 7fa9ed893640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5626e2266650 0x5626e2264a40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52488/0 (socket says 172.21.15.102:52488) 2024-09-19T11:13:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.198+0000 7fa9e7fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5626e22652c0 0x5626e22f9410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44064/0 (socket says 172.21.15.102:44064) 2024-09-19T11:13:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.198+0000 7fa9ed893640 1 -- 172.21.15.102:0/2308406063 learned_addr learned my addr 172.21.15.102:0/2308406063 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.198+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2308406063 >> v1:172.21.15.37:6789/0 conn(0x5626e2266650 legacy=0x5626e2264a40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.198+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2308406063 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626e22fab30 con 0x5626e22652c0 2024-09-19T11:13:56.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.198+0000 7fa9ed092640 1 -- 172.21.15.102:0/2308406063 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1434556767 0 0) 0x5626e22f9950 con 0x5626e2266650 2024-09-19T11:13:56.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/2308406063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e22f9410 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800a470 tx=0x7fa9d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=569d73531b882e6f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9ed092640 1 -- 172.21.15.102:0/2308406063 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d8053570 con 0x5626e22652c0 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9ed092640 1 -- 172.21.15.102:0/2308406063 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9d8058070 con 0x5626e22652c0 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9ed092640 1 -- 172.21.15.102:0/2308406063 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9d8053880 con 0x5626e22652c0 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9efda9800 1 -- 172.21.15.102:0/2308406063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 msgr2=0x5626e22f9410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2308406063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e22f9410 secure :-1 s=READY pgs=403 cs=0 l=1 rev1=1 crypto rx=0x7fa9d800a470 tx=0x7fa9d8045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9efda9800 1 -- 172.21.15.102:0/2308406063 shutdown_connections 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2308406063 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e22f9410 unknown :-1 s=CLOSED pgs=403 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9efda9800 1 -- 172.21.15.102:0/2308406063 >> 172.21.15.102:0/2308406063 conn(0x5626e22ebca0 msgr2=0x5626e22ee100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9efda9800 1 -- 172.21.15.102:0/2308406063 shutdown_connections 2024-09-19T11:13:56.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.200+0000 7fa9efda9800 1 -- 172.21.15.102:0/2308406063 wait complete. 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.214+0000 7fa9efda9800 1 Processor -- start 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.214+0000 7fa9efda9800 1 -- start start 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.214+0000 7fa9efda9800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e2410 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.214+0000 7fa9efda9800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5626e2188dd0 con 0x5626e22652c0 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.215+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e2410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.215+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e2410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44066/0 (socket says 172.21.15.102:44066) 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.215+0000 7fa9ed893640 1 -- 172.21.15.102:0/3079555866 learned_addr learned my addr 172.21.15.102:0/3079555866 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.215+0000 7fa9ed893640 1 -- 172.21.15.102:0/3079555866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626e23e2a00 con 0x5626e22652c0 2024-09-19T11:13:56.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.215+0000 7fa9ed893640 1 --2- 172.21.15.102:0/3079555866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e2410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0001dc0 tx=0x7fa9e000b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=95314379d5c753d8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.215+0000 7fa8dbe07640 1 -- 172.21.15.102:0/3079555866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e0012020 con 0x5626e22652c0 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.215+0000 7fa8dbe07640 1 -- 172.21.15.102:0/3079555866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e000e5a0 con 0x5626e22652c0 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.215+0000 7fa8dbe07640 1 -- 172.21.15.102:0/3079555866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e000e8c0 con 0x5626e22652c0 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 -- 172.21.15.102:0/3079555866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 msgr2=0x5626e23e2410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 --2- 172.21.15.102:0/3079555866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e2410 secure :-1 s=READY pgs=404 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0001dc0 tx=0x7fa9e000b6c0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 -- 172.21.15.102:0/3079555866 shutdown_connections 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 --2- 172.21.15.102:0/3079555866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e2410 unknown :-1 s=CLOSED pgs=404 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 -- 172.21.15.102:0/3079555866 >> 172.21.15.102:0/3079555866 conn(0x5626e22ebca0 msgr2=0x5626e23ddd90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 -- 172.21.15.102:0/3079555866 shutdown_connections 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 -- 172.21.15.102:0/3079555866 wait complete. 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 Processor -- start 2024-09-19T11:13:56.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 -- start start 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e9f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.216+0000 7fa9efda9800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5626e22f9e20 con 0x5626e22652c0 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e9f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e9f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44082/0 (socket says 172.21.15.102:44082) 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa9ed893640 1 -- 172.21.15.102:0/171194409 learned_addr learned my addr 172.21.15.102:0/171194409 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa9ed893640 1 -- 172.21.15.102:0/171194409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626e23ea480 con 0x5626e22652c0 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa9ed893640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e9f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0000c00 tx=0x7fa9e0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa8da604640 1 -- 172.21.15.102:0/171194409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e0012030 con 0x5626e22652c0 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa8da604640 1 -- 172.21.15.102:0/171194409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e001a720 con 0x5626e22652c0 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626e23ea710 con 0x5626e22652c0 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa8da604640 1 -- 172.21.15.102:0/171194409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e001aa80 con 0x5626e22652c0 2024-09-19T11:13:56.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.217+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626e23eb110 con 0x5626e22652c0 2024-09-19T11:13:56.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.218+0000 7fa8da604640 1 -- 172.21.15.102:0/171194409 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa9e0015020 con 0x5626e22652c0 2024-09-19T11:13:56.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.218+0000 7fa8da604640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8d403d000 0x7fa8d403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.218+0000 7fa8da604640 1 -- 172.21.15.102:0/171194409 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fa9e0020030 con 0x5626e22652c0 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.219+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8d403d000 0x7fa8d403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.219+0000 7fa9efda9800 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2266650 0x5626e23f1570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.219+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e23f1ab0 con 0x5626e2266650 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.219+0000 7fa9ee094640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2266650 0x5626e23f1570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.219+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8d403d000 0x7fa8d403f4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8057000 tx=0x7fa9d8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.219+0000 7fa9ee094640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2266650 0x5626e23f1570 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.219+0000 7fa9ee094640 1 -- 172.21.15.102:0/171194409 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2266650 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.219+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e23f1e50 con 0x5626e2266650 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.220+0000 7fa9ee094640 1 -- 172.21.15.102:0/171194409 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2266650 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.220+0000 7fa9efda9800 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e23f3910 0x5626e23f5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.220+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e23f6510 con 0x5626e23f3910 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.220+0000 7fa9ed893640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e23f3910 0x5626e23f5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.220+0000 7fa9ed893640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e23f3910 0x5626e23f5d80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.220+0000 7fa9ed893640 1 -- 172.21.15.102:0/171194409 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fa9e0018950 con 0x5626e23f3910 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.220+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e23f26a0 con 0x5626e2266650 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.221+0000 7fa9ee094640 1 -- 172.21.15.102:0/171194409 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2266650 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.221+0000 7fa9efda9800 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e23f7970 0x5626e23f9d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.221+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e23fa4a0 con 0x5626e23f7970 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.221+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e23f7970 0x5626e23f9d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.221+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e23f7970 0x5626e23f9d60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.222+0000 7fa9e7fff640 1 -- 172.21.15.102:0/171194409 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fa9d8051070 con 0x5626e23f7970 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.222+0000 7fa9efda9800 1 Processor -- start 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.222+0000 7fa9efda9800 1 -- start start 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.222+0000 7fa9efda9800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24081e0 0x5626e2408600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.222+0000 7fa9efda9800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5626e21e74a0 con 0x5626e24081e0 2024-09-19T11:13:56.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.222+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24081e0 0x5626e2408600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.222+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24081e0 0x5626e2408600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44084/0 (socket says 172.21.15.102:44084) 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.222+0000 7fa9ed893640 1 -- 172.21.15.102:0/30880984 learned_addr learned my addr 172.21.15.102:0/30880984 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.223+0000 7fa9ed893640 1 -- 172.21.15.102:0/30880984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626e2408c40 con 0x5626e24081e0 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.223+0000 7fa9ed893640 1 --2- 172.21.15.102:0/30880984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24081e0 0x5626e2408600 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0017fd0 tx=0x7fa9e0041350 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.223+0000 7fa8d37fe640 1 -- 172.21.15.102:0/30880984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e0016860 con 0x5626e24081e0 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.223+0000 7fa8d37fe640 1 -- 172.21.15.102:0/30880984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e0016a00 con 0x5626e24081e0 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.223+0000 7fa9efda9800 1 -- 172.21.15.102:0/30880984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626e2409470 con 0x5626e24081e0 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.223+0000 7fa8d37fe640 1 -- 172.21.15.102:0/30880984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e0042c00 con 0x5626e24081e0 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.223+0000 7fa9efda9800 1 -- 172.21.15.102:0/30880984 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626e2409470 con 0x5626e24081e0 2024-09-19T11:13:56.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa8d37fe640 1 -- 172.21.15.102:0/30880984 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa9e004b3a0 con 0x5626e24081e0 2024-09-19T11:13:56.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa8d37fe640 1 --2- 172.21.15.102:0/30880984 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8c803d000 0x7fa8c803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa8d37fe640 1 -- 172.21.15.102:0/30880984 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fa9e003d490 con 0x5626e24081e0 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/30880984 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8c803d000 0x7fa8c803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa9efda9800 1 Processor -- start 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/30880984 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8c803d000 0x7fa8c803f4c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5626e23ebff0 tx=0x7fa9d8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa9efda9800 1 -- start start 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa9efda9800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e2414cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.224+0000 7fa9efda9800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5626e23e2e30 con 0x5626e24148b0 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.225+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e2414cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.225+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e2414cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44086/0 (socket says 172.21.15.102:44086) 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.225+0000 7fa9ed893640 1 -- 172.21.15.102:0/2810984040 learned_addr learned my addr 172.21.15.102:0/2810984040 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.225+0000 7fa9ed893640 1 -- 172.21.15.102:0/2810984040 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626e24152a0 con 0x5626e24148b0 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.225+0000 7fa9ed893640 1 --2- 172.21.15.102:0/2810984040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e2414cb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa9e003b850 tx=0x7fa9e002d850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5b185da64cf8a9ab server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.225+0000 7fa8d17fa640 1 -- 172.21.15.102:0/2810984040 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e004b690 con 0x5626e24148b0 2024-09-19T11:13:56.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.225+0000 7fa8d17fa640 1 -- 172.21.15.102:0/2810984040 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e004b940 con 0x5626e24148b0 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.225+0000 7fa8d17fa640 1 -- 172.21.15.102:0/2810984040 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e002d3f0 con 0x5626e24148b0 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 -- 172.21.15.102:0/2810984040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 msgr2=0x5626e2414cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2810984040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e2414cb0 secure :-1 s=READY pgs=407 cs=0 l=1 rev1=1 crypto rx=0x7fa9e003b850 tx=0x7fa9e002d850 comp rx=0 tx=0).stop 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 -- 172.21.15.102:0/2810984040 shutdown_connections 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2810984040 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e2414cb0 unknown :-1 s=CLOSED pgs=407 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 -- 172.21.15.102:0/2810984040 >> 172.21.15.102:0/2810984040 conn(0x5626e2410cb0 msgr2=0x5626e240eef0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 -- 172.21.15.102:0/2810984040 shutdown_connections 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 -- 172.21.15.102:0/2810984040 wait complete. 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 Processor -- start 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 -- start start 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e241bc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.226+0000 7fa9efda9800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5626e2415710 con 0x5626e24148b0 2024-09-19T11:13:56.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e241bc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa9ed893640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e241bc90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44092/0 (socket says 172.21.15.102:44092) 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 learned_addr learned my addr 172.21.15.102:0/2018761151 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5626e241c1f0 con 0x5626e24148b0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa9ed893640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e241bc90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa9e001a6f0 tx=0x7fa9e003b7b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa8bf7fe640 1 -- 172.21.15.102:0/2018761151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e006e070 con 0x5626e24148b0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa8bf7fe640 1 -- 172.21.15.102:0/2018761151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fa9e00513b0 con 0x5626e24148b0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5626e241c1f0 con 0x5626e24148b0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa8bf7fe640 1 -- 172.21.15.102:0/2018761151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fa9e000d880 con 0x5626e24148b0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.227+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5626e241c1f0 con 0x5626e24148b0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.228+0000 7fa8bf7fe640 1 -- 172.21.15.102:0/2018761151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fa9e0071070 con 0x5626e24148b0 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.228+0000 7fa8bf7fe640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8b803d000 0x7fa8b803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.228+0000 7fa8bf7fe640 1 -- 172.21.15.102:0/2018761151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fa9e005a030 con 0x5626e24148b0 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.228+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8b803d000 0x7fa8b803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.229+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8b803d000 0x7fa8b803f4c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5626e23fa880 tx=0x7fa9d8053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.229+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.229+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2427210 0x5626e24296d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.229+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e2429e20 con 0x5626e2427210 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.229+0000 7fa9ee094640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2427210 0x5626e24296d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.229+0000 7fa9ee094640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2427210 0x5626e24296d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 realm 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e242a230 con 0x5626e2427210 2024-09-19T11:13:56.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e242ab00 con 0x5626e2427210 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e242bc00 0x5626e242dff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.230+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e242e5b0 con 0x5626e242bc00 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.231+0000 7fa9ed893640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e242bc00 0x5626e242dff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.231+0000 7fa9ed893640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e242bc00 0x5626e242dff0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.231+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.231+0000 7fa9efda9800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.231+0000 7fa9efda9800 20 searching for the correct realm 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.231+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e2430560 0x5626e2432a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.231+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e24330f0 con 0x5626e2430560 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.231+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e2430560 0x5626e2432a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.232+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e2430560 0x5626e2432a20 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.232+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.232+0000 7fa9e7fff640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fa9d805f040 0x7fa9d805f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.232+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e24330f0 con 0x7fa9d805f040 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.232+0000 7fa9ee094640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fa9d805f040 0x7fa9d805f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.232+0000 7fa9ee094640 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fa9d805f040 0x7fa9d805f930 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.232+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.232+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.233+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.233+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.233+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.233+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.233+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.233+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x7fa9d805f040 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2430560 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.234+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.235+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.235+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.235+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.235+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x7fa9d805f040 2024-09-19T11:13:56.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.235+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.235+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2430560 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.235+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.235+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2430560 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.236+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.236+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.236+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.236+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2430560 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.236+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.236+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2430560 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.236+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.236+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.237+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.237+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.237+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.237+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.237+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.237+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2430560 2024-09-19T11:13:56.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.237+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.237+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x7fa9d805f040 2024-09-19T11:13:56.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.238+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.238+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.238+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.238+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.238+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.238+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2430560 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.238+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.238+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.239+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.239+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x7fa9d805f040 2024-09-19T11:13:56.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.239+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.239+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2430560 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.239+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.239+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e242bc00 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.239+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.239+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x5626e2427210 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5626e242aea0 con 0x7fa9d805f040 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:56.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e242ee70 con 0x5626e2427210 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e242ee70 con 0x5626e2427210 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.240+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e242ee70 con 0x5626e2430560 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 zone default found 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 4 Realm: () 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 zonegroup default 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e242f760 con 0x5626e242bc00 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e2435060 con 0x5626e2430560 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e24354d0 con 0x5626e2430560 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 started sync module instance, tier type = 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.241+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2434400 con 0x7fa9d805f040 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.243+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.243+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94725004806400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2434400 con 0x7fa9d805f040 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.243+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2436020 con 0x5626e2427210 2024-09-19T11:13:56.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.243+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94725004806400] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.244+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.244+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94725004810992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2434400 con 0x5626e2427210 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.244+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2436ad0 con 0x5626e2430560 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.246+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94725004810992] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.246+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.246+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94725004803920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2434370 con 0x5626e2430560 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.246+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2437990 con 0x7fa9d805f040 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.247+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.247+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94725004803920] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.247+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94725004817632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2437900 con 0x7fa9d805f040 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.247+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2436f00 con 0x5626e2427210 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.248+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94725004817632] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.248+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.248+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94725004819760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2436f00 con 0x5626e2427210 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.248+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2438df0 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.249+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.249+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94725004822784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2439690 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.249+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94725004819760] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.249+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e243a0f0 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.250+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94725004822784] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.250+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.250+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94725004827600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e243a490 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.250+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e243ace0 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94725004827600] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'108 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94725004830768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e243ac50 con 0x5626e242bc00 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9efda9800 20 add_watcher() i=0 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9efda9800 20 add_watcher() i=1 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9efda9800 20 add_watcher() i=2 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9efda9800 20 add_watcher() i=3 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9efda9800 20 add_watcher() i=4 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9efda9800 20 add_watcher() i=5 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.251+0000 7fa9efda9800 20 add_watcher() i=6 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.252+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94725004830768] v35'109 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.252+0000 7fa9efda9800 20 add_watcher() i=7 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.252+0000 7fa9efda9800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.252+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e243e5b0 con 0x5626e2427210 2024-09-19T11:13:56.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.252+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.252+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94725004832976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e243b9e0 con 0x5626e2427210 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.253+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94725004832976] v35'106 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.253+0000 7fa89f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.253+0000 7fa9efda9800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.253+0000 7fa9efda9800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.253+0000 7fa9efda9800 5 note: GC not initialized 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.253+0000 7fa89e7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.253+0000 7fa9efda9800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 20 Filter name: none 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa80ffff640 20 reqs_thread_entry: start 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e24713f0 con 0x5626e242bc00 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e246fa90 con 0x5626e242bc00 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:56.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.254+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e2470360 con 0x5626e242bc00 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.255+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v35'1 uv1 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.255+0000 7fa9efda9800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.255+0000 7fa9efda9800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.255+0000 7fa9efda9800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.255+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94725005049520 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e24748c0 con 0x5626e242bc00 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== watch-notify(notify (1) cookie 94725004822784 notify 150323855363 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5626e2470d40 con 0x5626e242bc00 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(65 notify.5 [notify cookie 94725005049520 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa8d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 94725004822784 notifier 4498 bl.length()=556 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa8d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa8d17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:56.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa8d17fa640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa8b0003ea0 con 0x5626e242bc00 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== watch-notify(notify_complete (2) cookie 94725005049520 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5626e2408c40 con 0x5626e242bc00 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.256+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246fe60 con 0x5626e242bc00 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.257+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v35'3 uv3 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.257+0000 7fa9efda9800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.257+0000 7fa9efda9800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.257+0000 7fa9efda9800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.257+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94725005049440 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5626e2474d10 con 0x5626e2430560 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.257+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== watch-notify(notify (1) cookie 94725004803920 notify 150323855362 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5626e22fab30 con 0x5626e2430560 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.258+0000 7fa8d17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855362 cookie 94725004803920 notifier 4498 bl.length()=177 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.258+0000 7fa8d17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.258+0000 7fa8d17fa640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:56.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.258+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 notify.2 [notify cookie 94725005049440 out=8b] v0'0 uv108 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.258+0000 7fa8d17fa640 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fa8b0003ea0 con 0x5626e2430560 2024-09-19T11:13:56.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.258+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== watch-notify(notify_complete (2) cookie 94725005049440 notify 150323855362 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fa9d80808b0 con 0x5626e2430560 2024-09-19T11:13:56.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.258+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.272 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-19T11:13:56.255672Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:56.255663Z","tags":[],"group_ids":[]} 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.259+0000 7fa89f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.259+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94725004832976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x5626e2427210 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.260+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94725004832976] v35'107 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.260+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94725004806400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x7fa9d805f040 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.261+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94725004806400] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.261+0000 7fa9efda9800 20 remove_watcher() i=0 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.261+0000 7fa9efda9800 2 removed watcher, disabling cache 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.261+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94725004810992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x5626e2427210 2024-09-19T11:13:56.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.262+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94725004810992] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.262+0000 7fa9efda9800 20 remove_watcher() i=1 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.262+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94725004803920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x5626e2430560 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.263+0000 7fa9e7fff640 1 -- 172.21.15.102:0/2018761151 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94725004803920] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9d807c040 con 0x5626e2430560 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.263+0000 7fa9efda9800 20 remove_watcher() i=2 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.263+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94725004817632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x7fa9d805f040 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.264+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94725004817632] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x7fa9d805f040 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.264+0000 7fa9efda9800 20 remove_watcher() i=3 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.264+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94725004819760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x5626e2427210 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.265+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94725004819760] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e800a4d0 con 0x5626e2427210 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.265+0000 7fa9efda9800 20 remove_watcher() i=4 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.265+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94725004822784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x5626e242bc00 2024-09-19T11:13:56.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.266+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94725004822784] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.266+0000 7fa9efda9800 20 remove_watcher() i=5 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.266+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94725004827600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x5626e242bc00 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.267+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94725004827600] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.267+0000 7fa9efda9800 20 remove_watcher() i=6 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.267+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94725004830768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5626e246f200 con 0x5626e242bc00 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9ed893640 1 -- 172.21.15.102:0/2018761151 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94725004830768] v35'110 uv108 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fa9e0070030 con 0x5626e242bc00 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 20 remove_watcher() i=7 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e242bc00 msgr2=0x5626e242dff0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e242bc00 0x5626e242dff0 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2427210 msgr2=0x5626e24296d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2427210 0x5626e24296d0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fa9d805f040 msgr2=0x7fa9d805f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fa9d805f040 0x7fa9d805f930 crc :-1 s=READY pgs=45 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e2430560 msgr2=0x5626e2432a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e2430560 0x5626e2432a20 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8b803d000 msgr2=0x7fa8b803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8b803d000 0x7fa8b803f4c0 secure :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0x5626e23fa880 tx=0x7fa9d8053000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 msgr2=0x5626e241bc90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9ee094640 1 -- 172.21.15.102:0/2018761151 reap_dead start 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e241bc90 secure :-1 s=READY pgs=408 cs=0 l=1 rev1=1 crypto rx=0x7fa9e001a6f0 tx=0x7fa9e003b7b0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 shutdown_connections 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 --2- 172.21.15.102:0/2018761151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24148b0 0x5626e241bc90 unknown :-1 s=CLOSED pgs=408 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 >> 172.21.15.102:0/2018761151 conn(0x5626e2410cb0 msgr2=0x5626e240eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 shutdown_connections 2024-09-19T11:13:56.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.268+0000 7fa9efda9800 1 -- 172.21.15.102:0/2018761151 wait complete. 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/30880984 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8c803d000 msgr2=0x7fa8c803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/30880984 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8c803d000 0x7fa8c803f4c0 secure :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0x5626e23ebff0 tx=0x7fa9d8005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/30880984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24081e0 msgr2=0x5626e2408600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/30880984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24081e0 0x5626e2408600 secure :-1 s=READY pgs=406 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0017fd0 tx=0x7fa9e0041350 comp rx=0 tx=0).stop 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/30880984 shutdown_connections 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/30880984 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8c803d000 0x7fa8c803f4c0 unknown :-1 s=CLOSED pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/30880984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e24081e0 0x5626e2408600 unknown :-1 s=CLOSED pgs=406 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/30880984 >> 172.21.15.102:0/30880984 conn(0x5626e23fc590 msgr2=0x5626e23fc970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/30880984 shutdown_connections 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/30880984 wait complete. 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e23f3910 msgr2=0x5626e23f5d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5626e23f3910 0x5626e23f5d80 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2266650 msgr2=0x5626e23f1570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5626e2266650 0x5626e23f1570 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e23f7970 msgr2=0x5626e23f9d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5626e23f7970 0x5626e23f9d60 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8d403d000 msgr2=0x7fa8d403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa8d403d000 0x7fa8d403f4c0 secure :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0x7fa9d8057000 tx=0x7fa9d8052000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 msgr2=0x5626e23e9f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 --2- 172.21.15.102:0/171194409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5626e22652c0 0x5626e23e9f20 secure :-1 s=READY pgs=405 cs=0 l=1 rev1=1 crypto rx=0x7fa9e0000c00 tx=0x7fa9e0000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9ee094640 1 -- 172.21.15.102:0/171194409 reap_dead start 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 shutdown_connections 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 >> 172.21.15.102:0/171194409 conn(0x5626e22ebca0 msgr2=0x5626e23e3900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 shutdown_connections 2024-09-19T11:13:56.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.269+0000 7fa9efda9800 1 -- 172.21.15.102:0/171194409 wait complete. 2024-09-19T11:13:56.284 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-19T11:13:56.255672Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:56.255663Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:56.289 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-19T11:13:56.293 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:56.293 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:myfoo'] 2024-09-19T11:13:56.294 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:myfoo'] 2024-09-19T11:13:56.294 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:myfoo 2024-09-19T11:13:56.337 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:56.337 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:56.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.336+0000 7f36a7c13800 1 Processor -- start 2024-09-19T11:13:56.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.336+0000 7f36a7c13800 1 -- start start 2024-09-19T11:13:56.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f36a7c13800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x563b53db0f30 0x563b53db3320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f36a7c13800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563b53db75e0 con 0x563b53db38c0 2024-09-19T11:13:56.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f36a7c13800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x563b53c3b7d0 con 0x563b53db0f30 2024-09-19T11:13:56.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f36a3348640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x563b53db0f30 0x563b53db3320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f369ab47640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x563b53db38c0 0x563b53db5d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52498/0 (socket says 172.21.15.102:52498) 2024-09-19T11:13:56.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f369ab47640 1 -- 172.21.15.102:0/2993144118 learned_addr learned my addr 172.21.15.102:0/2993144118 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:56.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f36a3348640 1 --2- 172.21.15.102:0/2993144118 >> v2:172.21.15.37:3300/0 conn(0x563b53db0f30 0x563b53db3320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44098/0 (socket says 172.21.15.102:44098) 2024-09-19T11:13:56.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f36a3348640 1 -- 172.21.15.102:0/2993144118 >> v1:172.21.15.37:6789/0 conn(0x563b53db38c0 legacy=0x563b53db5d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.337+0000 7f36a3348640 1 -- 172.21.15.102:0/2993144118 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b53db8810 con 0x563b53db0f30 2024-09-19T11:13:56.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.339+0000 7f36a3348640 1 --2- 172.21.15.102:0/2993144118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db3320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f369400a470 tx=0x7f3694045880 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bd11e0324ce7753a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.339+0000 7f36a2b47640 1 -- 172.21.15.102:0/2993144118 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3694059070 con 0x563b53db0f30 2024-09-19T11:13:56.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.339+0000 7f36a2b47640 1 -- 172.21.15.102:0/2993144118 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3694054570 con 0x563b53db0f30 2024-09-19T11:13:56.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.340+0000 7f36a2b47640 1 -- 172.21.15.102:0/2993144118 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3694054870 con 0x563b53db0f30 2024-09-19T11:13:56.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.340+0000 7f36a7c13800 1 -- 172.21.15.102:0/2993144118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 msgr2=0x563b53db3320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.340+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2993144118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db3320 secure :-1 s=READY pgs=410 cs=0 l=1 rev1=1 crypto rx=0x7f369400a470 tx=0x7f3694045880 comp rx=0 tx=0).stop 2024-09-19T11:13:56.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.340+0000 7f36a7c13800 1 -- 172.21.15.102:0/2993144118 shutdown_connections 2024-09-19T11:13:56.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.340+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2993144118 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db3320 unknown :-1 s=CLOSED pgs=410 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.340+0000 7f36a7c13800 1 -- 172.21.15.102:0/2993144118 >> 172.21.15.102:0/2993144118 conn(0x563b53daaa90 msgr2=0x563b53daced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.340+0000 7f36a7c13800 1 -- 172.21.15.102:0/2993144118 shutdown_connections 2024-09-19T11:13:56.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.340+0000 7f36a7c13800 1 -- 172.21.15.102:0/2993144118 wait complete. 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.354+0000 7f36a7c13800 1 Processor -- start 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.354+0000 7f36a7c13800 1 -- start start 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.354+0000 7f36a7c13800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db06a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.354+0000 7f36a7c13800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b53c48dd0 con 0x563b53db0f30 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.354+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db06a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.354+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db06a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44112/0 (socket says 172.21.15.102:44112) 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.354+0000 7f36a3348640 1 -- 172.21.15.102:0/266130398 learned_addr learned my addr 172.21.15.102:0/266130398 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.354+0000 7f36a3348640 1 -- 172.21.15.102:0/266130398 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b53db0c90 con 0x563b53db0f30 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f36a3348640 1 --2- 172.21.15.102:0/266130398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db06a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3694057040 tx=0x7f369404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=98b933f16b200082 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f359160a640 1 -- 172.21.15.102:0/266130398 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3694065070 con 0x563b53db0f30 2024-09-19T11:13:56.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f359160a640 1 -- 172.21.15.102:0/266130398 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369405a040 con 0x563b53db0f30 2024-09-19T11:13:56.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f359160a640 1 -- 172.21.15.102:0/266130398 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3694059070 con 0x563b53db0f30 2024-09-19T11:13:56.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f36a7c13800 1 -- 172.21.15.102:0/266130398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 msgr2=0x563b53db06a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f36a7c13800 1 --2- 172.21.15.102:0/266130398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db06a0 secure :-1 s=READY pgs=411 cs=0 l=1 rev1=1 crypto rx=0x7f3694057040 tx=0x7f369404e000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f36a7c13800 1 -- 172.21.15.102:0/266130398 shutdown_connections 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f36a7c13800 1 --2- 172.21.15.102:0/266130398 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53db06a0 unknown :-1 s=CLOSED pgs=411 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f36a7c13800 1 -- 172.21.15.102:0/266130398 >> 172.21.15.102:0/266130398 conn(0x563b53daaa90 msgr2=0x563b53e9bd10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.355+0000 7f36a7c13800 1 -- 172.21.15.102:0/266130398 shutdown_connections 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.356+0000 7f36a7c13800 1 -- 172.21.15.102:0/266130398 wait complete. 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.356+0000 7f36a7c13800 1 Processor -- start 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.356+0000 7f36a7c13800 1 -- start start 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.356+0000 7f36a7c13800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53ea9fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.356+0000 7f36a7c13800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b53db7ab0 con 0x563b53db0f30 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.356+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53ea9fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.356+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53ea9fe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44116/0 (socket says 172.21.15.102:44116) 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.356+0000 7f36a3348640 1 -- 172.21.15.102:0/298405639 learned_addr learned my addr 172.21.15.102:0/298405639 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.357+0000 7f36a3348640 1 -- 172.21.15.102:0/298405639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b53eaa540 con 0x563b53db0f30 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.357+0000 7f36a3348640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53ea9fe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3694063040 tx=0x7f3694002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.357+0000 7f358fe07640 1 -- 172.21.15.102:0/298405639 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3694065050 con 0x563b53db0f30 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.357+0000 7f358fe07640 1 -- 172.21.15.102:0/298405639 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3694066040 con 0x563b53db0f30 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.357+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b53eaa7d0 con 0x563b53db0f30 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.357+0000 7f358fe07640 1 -- 172.21.15.102:0/298405639 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3694054a40 con 0x563b53db0f30 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.357+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b53eab3e0 con 0x563b53db0f30 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.358+0000 7f358fe07640 1 -- 172.21.15.102:0/298405639 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3694054be0 con 0x563b53db0f30 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.358+0000 7f358fe07640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f358803d000 0x7f358803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.358+0000 7f358fe07640 1 -- 172.21.15.102:0/298405639 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3694097550 con 0x563b53db0f30 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.358+0000 7f369ab47640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f358803d000 0x7f358803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.358+0000 7f36a7c13800 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53db38c0 0x563b53eb1630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.358+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eb1b70 con 0x563b53db38c0 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.358+0000 7f36a3b49640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53db38c0 0x563b53eb1630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.359+0000 7f369ab47640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f358803d000 0x7f358803f4c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f368c00b3b0 tx=0x7f368c001560 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.359+0000 7f36a3b49640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53db38c0 0x563b53eb1630 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.359+0000 7f36a3b49640 1 -- 172.21.15.102:0/298405639 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53db38c0 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.359+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eb1f10 con 0x563b53db38c0 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.359+0000 7f36a3b49640 1 -- 172.21.15.102:0/298405639 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53db38c0 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.359+0000 7f36a7c13800 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eb3a10 0x563b53eb5eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.359+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eb6640 con 0x563b53eb3a10 2024-09-19T11:13:56.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.359+0000 7f36a3348640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eb3a10 0x563b53eb5eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.360+0000 7f36a3348640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eb3a10 0x563b53eb5eb0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.360+0000 7f36a3348640 1 -- 172.21.15.102:0/298405639 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3694068070 con 0x563b53eb3a10 2024-09-19T11:13:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.360+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eb2760 con 0x563b53db38c0 2024-09-19T11:13:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.360+0000 7f36a3b49640 1 -- 172.21.15.102:0/298405639 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53db38c0 2024-09-19T11:13:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.360+0000 7f36a7c13800 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53eb7aa0 0x563b53eb9e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.360+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eba5d0 con 0x563b53eb7aa0 2024-09-19T11:13:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.361+0000 7f369ab47640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53eb7aa0 0x563b53eb9e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.361+0000 7f369ab47640 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53eb7aa0 0x563b53eb9e90 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.361+0000 7f369ab47640 1 -- 172.21.15.102:0/298405639 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f368c00f870 con 0x563b53eb7aa0 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.361+0000 7f36a7c13800 1 Processor -- start 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.361+0000 7f36a7c13800 1 -- start start 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a7c13800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ec8310 0x563b53ec8730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a7c13800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b53ca74a0 con 0x563b53ec8310 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ec8310 0x563b53ec8730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ec8310 0x563b53ec8730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44126/0 (socket says 172.21.15.102:44126) 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a3348640 1 -- 172.21.15.102:0/383412998 learned_addr learned my addr 172.21.15.102:0/383412998 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a3348640 1 -- 172.21.15.102:0/383412998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b53ec8d70 con 0x563b53ec8310 2024-09-19T11:13:56.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a3348640 1 --2- 172.21.15.102:0/383412998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ec8310 0x563b53ec8730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f36940958e0 tx=0x7f369405eb30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f358d602640 1 -- 172.21.15.102:0/383412998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369405e380 con 0x563b53ec8310 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f358d602640 1 -- 172.21.15.102:0/383412998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369405e520 con 0x563b53ec8310 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a7c13800 1 -- 172.21.15.102:0/383412998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b53ec95a0 con 0x563b53ec8310 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f358d602640 1 -- 172.21.15.102:0/383412998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3694069ab0 con 0x563b53ec8310 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.362+0000 7f36a7c13800 1 -- 172.21.15.102:0/383412998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b53ec95a0 con 0x563b53ec8310 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.363+0000 7f358d602640 1 -- 172.21.15.102:0/383412998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3694069c50 con 0x563b53ec8310 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.363+0000 7f358d602640 1 --2- 172.21.15.102:0/383412998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f357c03d000 0x7f357c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.363+0000 7f358d602640 1 -- 172.21.15.102:0/383412998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3694089070 con 0x563b53ec8310 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.363+0000 7f369ab47640 1 --2- 172.21.15.102:0/383412998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f357c03d000 0x7f357c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a7c13800 1 Processor -- start 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a7c13800 1 -- start start 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f369ab47640 1 --2- 172.21.15.102:0/383412998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f357c03d000 0x7f357c03f4c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x563b53eba9d0 tx=0x7f368c006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a7c13800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53ed4df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a7c13800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b53daf020 con 0x563b53ed49f0 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53ed4df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53ed4df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44134/0 (socket says 172.21.15.102:44134) 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a3348640 1 -- 172.21.15.102:0/138908782 learned_addr learned my addr 172.21.15.102:0/138908782 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a3348640 1 -- 172.21.15.102:0/138908782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b53ed53e0 con 0x563b53ed49f0 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.364+0000 7f36a3348640 1 --2- 172.21.15.102:0/138908782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53ed4df0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f369407e5b0 tx=0x7f3694081a10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=87962183848e5122 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f3586ffd640 1 -- 172.21.15.102:0/138908782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369406acd0 con 0x563b53ed49f0 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f3586ffd640 1 -- 172.21.15.102:0/138908782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f36940a6070 con 0x563b53ed49f0 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f3586ffd640 1 -- 172.21.15.102:0/138908782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369406a940 con 0x563b53ed49f0 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 -- 172.21.15.102:0/138908782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 msgr2=0x563b53ed4df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 --2- 172.21.15.102:0/138908782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53ed4df0 secure :-1 s=READY pgs=414 cs=0 l=1 rev1=1 crypto rx=0x7f369407e5b0 tx=0x7f3694081a10 comp rx=0 tx=0).stop 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 -- 172.21.15.102:0/138908782 shutdown_connections 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 --2- 172.21.15.102:0/138908782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53ed4df0 unknown :-1 s=CLOSED pgs=414 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 -- 172.21.15.102:0/138908782 >> 172.21.15.102:0/138908782 conn(0x563b53ed0df0 msgr2=0x563b53ecf030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 -- 172.21.15.102:0/138908782 shutdown_connections 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 -- 172.21.15.102:0/138908782 wait complete. 2024-09-19T11:13:56.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 Processor -- start 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.365+0000 7f36a7c13800 1 -- start start 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a7c13800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53edbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a7c13800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563b53ed5850 con 0x563b53ed49f0 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53edbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a3348640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53edbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44148/0 (socket says 172.21.15.102:44148) 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 learned_addr learned my addr 172.21.15.102:0/2626854209 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563b53edc330 con 0x563b53ed49f0 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a3348640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53edbdd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f369405a010 tx=0x7f369405cfb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f35857fa640 1 -- 172.21.15.102:0/2626854209 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f36940b9070 con 0x563b53ed49f0 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f35857fa640 1 -- 172.21.15.102:0/2626854209 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f369406da30 con 0x563b53ed49f0 2024-09-19T11:13:56.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f35857fa640 1 -- 172.21.15.102:0/2626854209 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f369406d550 con 0x563b53ed49f0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563b53edc330 con 0x563b53ed49f0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.366+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563b53edc330 con 0x563b53ed49f0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.367+0000 7f35857fa640 1 -- 172.21.15.102:0/2626854209 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f36940bc070 con 0x563b53ed49f0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.367+0000 7f35857fa640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f356c03d000 0x7f356c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.367+0000 7f35857fa640 1 -- 172.21.15.102:0/2626854209 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f369409d030 con 0x563b53ed49f0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f369ab47640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f356c03d000 0x7f356c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53ee71e0 0x563b53ee9650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53ee9da0 con 0x563b53ee71e0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a3b49640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53ee71e0 0x563b53ee9650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f369ab47640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f356c03d000 0x7f356c03f4c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f368c0217f0 tx=0x7f368c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a3b49640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53ee71e0 0x563b53ee9650 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a7c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a7c13800 20 realm 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.368+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eea1b0 con 0x563b53ee71e0 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:56.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeaa80 con 0x563b53ee71e0 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eeb910 0x563b53eedd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eee440 con 0x563b53eeb910 2024-09-19T11:13:56.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.369+0000 7f36a3348640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eeb910 0x563b53eedd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.370+0000 7f36a3348640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eeb910 0x563b53eedd00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.370+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.370+0000 7f36a7c13800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.370+0000 7f36a7c13800 20 searching for the correct realm 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.370+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53ef04e0 0x563b53ef29a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.370+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef3070 con 0x563b53ef04e0 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.370+0000 7f369ab47640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53ef04e0 0x563b53ef29a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.370+0000 7f369ab47640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53ef04e0 0x563b53ef29a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.371+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f368c037040 con 0x563b53ef04e0 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.371+0000 7f369ab47640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f368c03a3c0 0x7f368c03a810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.371+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef3070 con 0x7f368c03a3c0 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.371+0000 7f36a3b49640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f368c03a3c0 0x7f368c03a810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.371+0000 7f36a3b49640 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f368c03a3c0 0x7f368c03a810 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.371+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.371+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.372+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.372+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.372+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.372+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.372+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.372+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.372+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.372+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.373+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.373+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x7f368c03a3c0 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.373+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.373+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ef04e0 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.373+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f368c037040 con 0x563b53ef04e0 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.373+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.373+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.373+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.374+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.374+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.374+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.374+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x7f368c03a3c0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.374+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.374+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ef04e0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.374+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f368c037040 con 0x563b53ef04e0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.374+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ef04e0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.375+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f368c037040 con 0x563b53ef04e0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.375+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.375+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.375+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ef04e0 2024-09-19T11:13:56.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.375+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f368c037040 con 0x563b53ef04e0 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.375+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ef04e0 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.375+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f368c037040 con 0x563b53ef04e0 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.375+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.376+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.376+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.376+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.376+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.376+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.376+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ef04e0 2024-09-19T11:13:56.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.376+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f368c037040 con 0x563b53ef04e0 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.376+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x7f368c03a3c0 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.377+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.377+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.377+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.377+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.377+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.377+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ef04e0 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.377+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f368c037040 con 0x563b53ef04e0 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.377+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.378+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.378+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x7f368c03a3c0 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.378+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.378+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ef04e0 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.378+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f368c049040 con 0x563b53ef04e0 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.378+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53eeb910 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x563b53ee71e0 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeae20 con 0x7f368c03a3c0 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeede0 con 0x563b53ee71e0 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeede0 con 0x563b53ee71e0 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.379+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eeede0 con 0x563b53ef04e0 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f368c049040 con 0x563b53ef04e0 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 20 zone default found 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 4 Realm: () 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:56.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 20 zonegroup default 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53eef680 con 0x563b53eeb910 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef4ee0 con 0x563b53ef04e0 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f368c049040 con 0x563b53ef04e0 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.380+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef5280 con 0x563b53ef04e0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.381+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f368c049040 con 0x563b53ef04e0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.381+0000 7f36a7c13800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.381+0000 7f36a7c13800 20 started sync module instance, tier type = 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.381+0000 7f36a7c13800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.381+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef4380 con 0x7f368c03a3c0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.382+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.382+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94812811249872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef4380 con 0x7f368c03a3c0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.382+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef5d00 con 0x563b53ee71e0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.383+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94812811249872] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.383+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.383+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94812811253744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef4380 con 0x563b53ee71e0 2024-09-19T11:13:56.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.383+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef6780 con 0x563b53ef04e0 2024-09-19T11:13:56.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.384+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94812811253744] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.384+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f368c049040 con 0x563b53ef04e0 2024-09-19T11:13:56.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.384+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94812811247312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef42f0 con 0x563b53ef04e0 2024-09-19T11:13:56.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.384+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef7670 con 0x7f368c03a3c0 2024-09-19T11:13:56.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.385+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94812811247312] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f368c049040 con 0x563b53ef04e0 2024-09-19T11:13:56.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.385+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.385+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94812811260352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef75e0 con 0x7f368c03a3c0 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.385+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef8530 con 0x563b53ee71e0 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.386+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.386+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94812811264128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef8950 con 0x563b53ee71e0 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.386+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef93c0 con 0x563b53eeb910 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.386+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94812811260352] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.387+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.387+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94812811267728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef97b0 con 0x563b53eeb910 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.387+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efa170 con 0x563b53eeb910 2024-09-19T11:13:56.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.387+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94812811264128] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.388+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94812811267728] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.388+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.388+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94812811271360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efa590 con 0x563b53eeb910 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.389+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efade0 con 0x563b53eeb910 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.389+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94812811271360] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.389+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'111 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94812811273536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efae10 con 0x563b53eeb910 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 20 add_watcher() i=0 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 20 add_watcher() i=1 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 20 add_watcher() i=2 2024-09-19T11:13:56.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 20 add_watcher() i=3 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 20 add_watcher() i=4 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 20 add_watcher() i=5 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 20 add_watcher() i=6 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94812811273536] v35'112 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 20 add_watcher() i=7 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.390+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53efe140 con 0x563b53ee71e0 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.391+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.391+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94812811274960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efb3a0 con 0x563b53ee71e0 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94812811274960] v35'108 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f3559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f36a7c13800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f36a7c13800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f36a7c13800 5 note: GC not initialized 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f3558fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f36a7c13800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f36a7c13800 20 Filter name: none 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f34d27fc640 20 reqs_thread_entry: start 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.392+0000 7f36a7c13800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.393+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x563b53f30bb0 con 0x7f368c03a3c0 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.393+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(62 myfoo [call out=48b,stat out=16b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv18 ondisk = 0) ==== 275+0+304 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.393+0000 7f36a7c13800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.394+0000 7f3559fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.394+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94812811274960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efd2f0 con 0x563b53ee71e0 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.395+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94812811274960] v35'109 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.395+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94812811249872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efaad0 con 0x7f368c03a3c0 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.396+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94812811249872] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.396+0000 7f36a7c13800 20 remove_watcher() i=0 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.396+0000 7f36a7c13800 2 removed watcher, disabling cache 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.396+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94812811253744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efaad0 con 0x563b53ee71e0 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.397+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94812811253744] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.397+0000 7f36a7c13800 20 remove_watcher() i=1 2024-09-19T11:13:56.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.397+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94812811247312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53efaad0 con 0x563b53ef04e0 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.398+0000 7f369ab47640 1 -- 172.21.15.102:0/2626854209 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94812811247312] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f368c049040 con 0x563b53ef04e0 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.398+0000 7f36a7c13800 20 remove_watcher() i=2 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.398+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94812811260352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef3ed0 con 0x7f368c03a3c0 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.399+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94812811260352] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x7f368c03a3c0 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.399+0000 7f36a7c13800 20 remove_watcher() i=3 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.399+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94812811264128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef71c0 con 0x563b53ee71e0 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.400+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94812811264128] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f369c00a4d0 con 0x563b53ee71e0 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.400+0000 7f36a7c13800 20 remove_watcher() i=4 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.400+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94812811267728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef3ed0 con 0x563b53eeb910 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.401+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94812811267728] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.401+0000 7f36a7c13800 20 remove_watcher() i=5 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.401+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94812811271360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef8080 con 0x563b53eeb910 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.402+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94812811271360] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.402+0000 7f36a7c13800 20 remove_watcher() i=6 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.402+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94812811273536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x563b53ef71c0 con 0x563b53eeb910 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a3348640 1 -- 172.21.15.102:0/2626854209 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94812811273536] v35'113 uv111 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f36940bb030 con 0x563b53eeb910 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 20 remove_watcher() i=7 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eeb910 msgr2=0x563b53eedd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eeb910 0x563b53eedd00 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53ee71e0 msgr2=0x563b53ee9650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53ee71e0 0x563b53ee9650 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f368c03a3c0 msgr2=0x7f368c03a810 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f368c03a3c0 0x7f368c03a810 crc :-1 s=READY pgs=46 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53ef04e0 msgr2=0x563b53ef29a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53ef04e0 0x563b53ef29a0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f356c03d000 msgr2=0x7f356c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f356c03d000 0x7f356c03f4c0 secure :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0x7f368c0217f0 tx=0x7f368c010000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a3b49640 1 -- 172.21.15.102:0/2626854209 reap_dead start 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 msgr2=0x563b53edbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53edbdd0 secure :-1 s=READY pgs=415 cs=0 l=1 rev1=1 crypto rx=0x7f369405a010 tx=0x7f369405cfb0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 shutdown_connections 2024-09-19T11:13:56.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/2626854209 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ed49f0 0x563b53edbdd0 unknown :-1 s=CLOSED pgs=415 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 >> 172.21.15.102:0/2626854209 conn(0x563b53ed0df0 msgr2=0x563b53ecf000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 shutdown_connections 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/2626854209 wait complete. 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/383412998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f357c03d000 msgr2=0x7f357c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/383412998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f357c03d000 0x7f357c03f4c0 secure :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0x563b53eba9d0 tx=0x7f368c006000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 -- 172.21.15.102:0/383412998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ec8310 msgr2=0x563b53ec8730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.403+0000 7f36a7c13800 1 --2- 172.21.15.102:0/383412998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ec8310 0x563b53ec8730 secure :-1 s=READY pgs=413 cs=0 l=1 rev1=1 crypto rx=0x7f36940958e0 tx=0x7f369405eb30 comp rx=0 tx=0).stop 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/383412998 shutdown_connections 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 --2- 172.21.15.102:0/383412998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f357c03d000 0x7f357c03f4c0 unknown :-1 s=CLOSED pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 --2- 172.21.15.102:0/383412998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53ec8310 0x563b53ec8730 unknown :-1 s=CLOSED pgs=413 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/383412998 >> 172.21.15.102:0/383412998 conn(0x563b53ebc6c0 msgr2=0x563b53ebcaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/383412998 shutdown_connections 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/383412998 wait complete. 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eb3a10 msgr2=0x563b53eb5eb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563b53eb3a10 0x563b53eb5eb0 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53db38c0 msgr2=0x563b53eb1630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563b53db38c0 0x563b53eb1630 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53eb7aa0 msgr2=0x563b53eb9e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563b53eb7aa0 0x563b53eb9e90 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f358803d000 msgr2=0x7f358803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f358803d000 0x7f358803f4c0 secure :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0x7f368c00b3b0 tx=0x7f368c001560 comp rx=0 tx=0).stop 2024-09-19T11:13:56.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 msgr2=0x563b53ea9fe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 --2- 172.21.15.102:0/298405639 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563b53db0f30 0x563b53ea9fe0 secure :-1 s=READY pgs=412 cs=0 l=1 rev1=1 crypto rx=0x7f3694063040 tx=0x7f3694002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a3b49640 1 -- 172.21.15.102:0/298405639 reap_dead start 2024-09-19T11:13:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 shutdown_connections 2024-09-19T11:13:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 >> 172.21.15.102:0/298405639 conn(0x563b53daaa90 msgr2=0x563b53e9b860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 shutdown_connections 2024-09-19T11:13:56.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.404+0000 7f36a7c13800 1 -- 172.21.15.102:0/298405639 wait complete. 2024-09-19T11:13:56.427 INFO:teuthology.orchestra.run.smithi102.stdout:{"key":"bucket:myfoo","ver":{"tag":"_j2Fk8XBAiYlMZGBnICbp9QD","ver":2},"mtime":"2024-09-19T11:13:56.115967Z","data":{"bucket":{"name":"myfoo","marker":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","bucket_id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","tenant":"","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"foo","creation_time":"2024-09-19T11:13:54.975364Z","linked":false,"has_bucket_info":false}} 2024-09-19T11:13:56.427 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:myfoo', 'ver': {'tag': '_j2Fk8XBAiYlMZGBnICbp9QD', 'ver': 2}, 'mtime': '2024-09-19T11:13:56.115967Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'bucket_id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'tenant': '', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'foo', 'creation_time': '2024-09-19T11:13:54.975364Z', 'linked': False, 'has_bucket_info': False}} 2024-09-19T11:13:56.427 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1'] 2024-09-19T11:13:56.428 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'fud', '--bucket', 'myfoo', '--bucket-id', '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1'] 2024-09-19T11:13:56.428 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid fud --bucket myfoo --bucket-id 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:56.515 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:56.516 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:56.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.515+0000 7f6921f40800 1 Processor -- start 2024-09-19T11:13:56.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.515+0000 7f6921f40800 1 -- start start 2024-09-19T11:13:56.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.515+0000 7f6921f40800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55f0c7117800 0x55f0c7117cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.515+0000 7f6921f40800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f0c71182b0 con 0x55f0c7116c00 2024-09-19T11:13:56.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.515+0000 7f6921f40800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55f0c6fa27d0 con 0x55f0c7117800 2024-09-19T11:13:56.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.516+0000 7f691d4bf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55f0c7117800 0x55f0c7117cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.516+0000 7f691d4bf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55f0c7117800 0x55f0c7117cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44164/0 (socket says 172.21.15.102:44164) 2024-09-19T11:13:56.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.516+0000 7f691dcc0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55f0c7116c00 0x55f0c7117000 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52500/0 (socket says 172.21.15.102:52500) 2024-09-19T11:13:56.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.516+0000 7f691d4bf640 1 -- 172.21.15.102:0/3343069163 learned_addr learned my addr 172.21.15.102:0/3343069163 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.516+0000 7f691d4bf640 1 -- 172.21.15.102:0/3343069163 >> v1:172.21.15.37:6789/0 conn(0x55f0c7116c00 legacy=0x55f0c7117000 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.516+0000 7f691d4bf640 1 -- 172.21.15.102:0/3343069163 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c711e7b0 con 0x55f0c7117800 2024-09-19T11:13:56.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3343069163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7117800 0x55f0c7117cb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f691000a520 tx=0x7f6910045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9cfeceed458dc5bc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f691ccbe640 1 -- 172.21.15.102:0/3343069163 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6910055070 con 0x55f0c7117800 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f691ccbe640 1 -- 172.21.15.102:0/3343069163 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f69100515b0 con 0x55f0c7117800 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f691ccbe640 1 -- 172.21.15.102:0/3343069163 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69100518d0 con 0x55f0c7117800 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f6921f40800 1 -- 172.21.15.102:0/3343069163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7117800 msgr2=0x55f0c7117cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f6921f40800 1 --2- 172.21.15.102:0/3343069163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7117800 0x55f0c7117cb0 secure :-1 s=READY pgs=417 cs=0 l=1 rev1=1 crypto rx=0x7f691000a520 tx=0x7f6910045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f6921f40800 1 -- 172.21.15.102:0/3343069163 shutdown_connections 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f6921f40800 1 --2- 172.21.15.102:0/3343069163 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7117800 0x55f0c7117cb0 unknown :-1 s=CLOSED pgs=417 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f6921f40800 1 -- 172.21.15.102:0/3343069163 >> 172.21.15.102:0/3343069163 conn(0x55f0c71111e0 msgr2=0x55f0c7113660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f6921f40800 1 -- 172.21.15.102:0/3343069163 shutdown_connections 2024-09-19T11:13:56.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.518+0000 7f6921f40800 1 -- 172.21.15.102:0/3343069163 wait complete. 2024-09-19T11:13:56.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.532+0000 7f6921f40800 1 Processor -- start 2024-09-19T11:13:56.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.532+0000 7f6921f40800 1 -- start start 2024-09-19T11:13:56.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.532+0000 7f6921f40800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c7206320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.532+0000 7f6921f40800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f0c6fafdd0 con 0x55f0c7116c00 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.533+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c7206320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.533+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c7206320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44180/0 (socket says 172.21.15.102:44180) 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.533+0000 7f691dcc0640 1 -- 172.21.15.102:0/967270765 learned_addr learned my addr 172.21.15.102:0/967270765 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.533+0000 7f691dcc0640 1 -- 172.21.15.102:0/967270765 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c7206910 con 0x55f0c7116c00 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.533+0000 7f691dcc0640 1 --2- 172.21.15.102:0/967270765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c7206320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f690800b260 tx=0x7f690800b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=df68cb29b444adcb server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.533+0000 7f680be07640 1 -- 172.21.15.102:0/967270765 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f690800be60 con 0x55f0c7116c00 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.533+0000 7f680be07640 1 -- 172.21.15.102:0/967270765 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6908006070 con 0x55f0c7116c00 2024-09-19T11:13:56.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.533+0000 7f680be07640 1 -- 172.21.15.102:0/967270765 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f690800e710 con 0x55f0c7116c00 2024-09-19T11:13:56.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 -- 172.21.15.102:0/967270765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 msgr2=0x55f0c7206320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 --2- 172.21.15.102:0/967270765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c7206320 secure :-1 s=READY pgs=418 cs=0 l=1 rev1=1 crypto rx=0x7f690800b260 tx=0x7f690800b660 comp rx=0 tx=0).stop 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 -- 172.21.15.102:0/967270765 shutdown_connections 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 --2- 172.21.15.102:0/967270765 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c7206320 unknown :-1 s=CLOSED pgs=418 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 -- 172.21.15.102:0/967270765 >> 172.21.15.102:0/967270765 conn(0x55f0c71111e0 msgr2=0x55f0c7201ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 -- 172.21.15.102:0/967270765 shutdown_connections 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 -- 172.21.15.102:0/967270765 wait complete. 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 Processor -- start 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.534+0000 7f6921f40800 1 -- start start 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.535+0000 7f6921f40800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c720de70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.535+0000 7f6921f40800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f0c711da70 con 0x55f0c7116c00 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.535+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c720de70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.535+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c720de70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44186/0 (socket says 172.21.15.102:44186) 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.535+0000 7f691dcc0640 1 -- 172.21.15.102:0/3658413285 learned_addr learned my addr 172.21.15.102:0/3658413285 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.535+0000 7f691dcc0640 1 -- 172.21.15.102:0/3658413285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c720e3d0 con 0x55f0c7116c00 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.535+0000 7f691dcc0640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c720de70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55f0c72072b0 tx=0x7f6908000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.536+0000 7f680a604640 1 -- 172.21.15.102:0/3658413285 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f690800ee10 con 0x55f0c7116c00 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.536+0000 7f680a604640 1 -- 172.21.15.102:0/3658413285 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690800fa30 con 0x55f0c7116c00 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.536+0000 7f680a604640 1 -- 172.21.15.102:0/3658413285 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f690800fd30 con 0x55f0c7116c00 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.536+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0c720e660 con 0x55f0c7116c00 2024-09-19T11:13:56.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.536+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c720f060 con 0x55f0c7116c00 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.536+0000 7f680a604640 1 -- 172.21.15.102:0/3658413285 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6908017070 con 0x55f0c7116c00 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.537+0000 7f680a604640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f680403d000 0x7f680403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.537+0000 7f680a604640 1 -- 172.21.15.102:0/3658413285 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f6908015020 con 0x55f0c7116c00 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.537+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f680403d000 0x7f680403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.537+0000 7f6921f40800 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c7117800 0x55f0c72154c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.537+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7215a00 con 0x55f0c7117800 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.537+0000 7f691e4c1640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c7117800 0x55f0c72154c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.537+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f680403d000 0x7f680403f4c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6910057000 tx=0x7f6910052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.537+0000 7f691e4c1640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c7117800 0x55f0c72154c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.538+0000 7f691e4c1640 1 -- 172.21.15.102:0/3658413285 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c7117800 2024-09-19T11:13:56.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.538+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7215da0 con 0x55f0c7117800 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.538+0000 7f691e4c1640 1 -- 172.21.15.102:0/3658413285 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c7117800 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.538+0000 7f6921f40800 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c72178a0 0x55f0c7219d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.538+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c721a4b0 con 0x55f0c72178a0 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.538+0000 7f691dcc0640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c72178a0 0x55f0c7219d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.538+0000 7f691dcc0640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c72178a0 0x55f0c7219d20 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.539+0000 7f691dcc0640 1 -- 172.21.15.102:0/3658413285 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f690802e070 con 0x55f0c72178a0 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.539+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72165f0 con 0x55f0c7117800 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.539+0000 7f691e4c1640 1 -- 172.21.15.102:0/3658413285 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c7117800 2024-09-19T11:13:56.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.539+0000 7f6921f40800 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c721b910 0x55f0c721dd00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.539+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c721e470 con 0x55f0c721b910 2024-09-19T11:13:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.539+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c721b910 0x55f0c721dd00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.539+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c721b910 0x55f0c721dd00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.540+0000 7f691d4bf640 1 -- 172.21.15.102:0/3658413285 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6910057030 con 0x55f0c721b910 2024-09-19T11:13:56.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.540+0000 7f6921f40800 1 Processor -- start 2024-09-19T11:13:56.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.540+0000 7f6921f40800 1 -- start start 2024-09-19T11:13:56.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.540+0000 7f6921f40800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c722c1b0 0x55f0c722c5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.540+0000 7f6921f40800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f0c700e4a0 con 0x55f0c722c1b0 2024-09-19T11:13:56.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.540+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c722c1b0 0x55f0c722c5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.540+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c722c1b0 0x55f0c722c5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44194/0 (socket says 172.21.15.102:44194) 2024-09-19T11:13:56.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.540+0000 7f691dcc0640 1 -- 172.21.15.102:0/813814062 learned_addr learned my addr 172.21.15.102:0/813814062 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.541+0000 7f691dcc0640 1 -- 172.21.15.102:0/813814062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c722cc10 con 0x55f0c722c1b0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.541+0000 7f691dcc0640 1 --2- 172.21.15.102:0/813814062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c722c1b0 0x55f0c722c5d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6908017ca0 tx=0x7f6908017910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.541+0000 7f68037fe640 1 -- 172.21.15.102:0/813814062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6908035020 con 0x55f0c722c1b0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.541+0000 7f68037fe640 1 -- 172.21.15.102:0/813814062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f690801b500 con 0x55f0c722c1b0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.541+0000 7f6921f40800 1 -- 172.21.15.102:0/813814062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0c722d440 con 0x55f0c722c1b0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.541+0000 7f68037fe640 1 -- 172.21.15.102:0/813814062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f690804a020 con 0x55f0c722c1b0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.541+0000 7f6921f40800 1 -- 172.21.15.102:0/813814062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c722d9e0 con 0x55f0c722c1b0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f68037fe640 1 -- 172.21.15.102:0/813814062 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f690801a480 con 0x55f0c722c1b0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f68037fe640 1 --2- 172.21.15.102:0/813814062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67f803d000 0x7f67f803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f68037fe640 1 -- 172.21.15.102:0/813814062 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f6908043780 con 0x55f0c722c1b0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f691d4bf640 1 --2- 172.21.15.102:0/813814062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67f803d000 0x7f67f803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f6921f40800 1 Processor -- start 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f6921f40800 1 -- start start 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f691d4bf640 1 --2- 172.21.15.102:0/813814062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67f803d000 0x7f67f803f4c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6910000c00 tx=0x7f6910005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f6921f40800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c723a070 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.542+0000 7f6921f40800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f0c7206d40 con 0x55f0c7239c70 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.543+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c723a070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.543+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c723a070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44206/0 (socket says 172.21.15.102:44206) 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.543+0000 7f691dcc0640 1 -- 172.21.15.102:0/4178754588 learned_addr learned my addr 172.21.15.102:0/4178754588 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.543+0000 7f691dcc0640 1 -- 172.21.15.102:0/4178754588 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c723a640 con 0x55f0c7239c70 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.543+0000 7f691dcc0640 1 --2- 172.21.15.102:0/4178754588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c723a070 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f690803bff0 tx=0x7f6908027850 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ab53f7577dda02b9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.543+0000 7f68017fa640 1 -- 172.21.15.102:0/4178754588 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f690801b820 con 0x55f0c7239c70 2024-09-19T11:13:56.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.543+0000 7f68017fa640 1 -- 172.21.15.102:0/4178754588 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6908046b20 con 0x55f0c7239c70 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.543+0000 7f68017fa640 1 -- 172.21.15.102:0/4178754588 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6908027430 con 0x55f0c7239c70 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 -- 172.21.15.102:0/4178754588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 msgr2=0x55f0c723a070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 --2- 172.21.15.102:0/4178754588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c723a070 secure :-1 s=READY pgs=421 cs=0 l=1 rev1=1 crypto rx=0x7f690803bff0 tx=0x7f6908027850 comp rx=0 tx=0).stop 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 -- 172.21.15.102:0/4178754588 shutdown_connections 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 --2- 172.21.15.102:0/4178754588 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c723a070 unknown :-1 s=CLOSED pgs=421 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 -- 172.21.15.102:0/4178754588 >> 172.21.15.102:0/4178754588 conn(0x55f0c7234e70 msgr2=0x55f0c72330b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 -- 172.21.15.102:0/4178754588 shutdown_connections 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 -- 172.21.15.102:0/4178754588 wait complete. 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 Processor -- start 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 -- start start 2024-09-19T11:13:56.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c7243190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f6921f40800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f0c7238820 con 0x55f0c7239c70 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c7243190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f691dcc0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c7243190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44216/0 (socket says 172.21.15.102:44216) 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.544+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 learned_addr learned my addr 172.21.15.102:0/3806306244 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.545+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f0c72436f0 con 0x55f0c7239c70 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.545+0000 7f691dcc0640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c7243190 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f690801ab60 tx=0x7f6908041ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.545+0000 7f67ef7fe640 1 -- 172.21.15.102:0/3806306244 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f69080439d0 con 0x55f0c7239c70 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.545+0000 7f67ef7fe640 1 -- 172.21.15.102:0/3806306244 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6908043b70 con 0x55f0c7239c70 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.545+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f0c72436f0 con 0x55f0c7239c70 2024-09-19T11:13:56.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.545+0000 7f67ef7fe640 1 -- 172.21.15.102:0/3806306244 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6908043e50 con 0x55f0c7239c70 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.545+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f0c72436f0 con 0x55f0c7239c70 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.546+0000 7f67ef7fe640 1 -- 172.21.15.102:0/3806306244 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6908046440 con 0x55f0c7239c70 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.546+0000 7f67ef7fe640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67e803d0b0 0x7f67e803f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.546+0000 7f67ef7fe640 1 -- 172.21.15.102:0/3806306244 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f6908068070 con 0x55f0c7239c70 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.546+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67e803d0b0 0x7f67e803f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67e803d0b0 0x7f67e803f570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55f0c721e870 tx=0x7f691006d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c724e720 0x55f0c7250be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7251330 con 0x55f0c724e720 2024-09-19T11:13:56.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f691e4c1640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c724e720 0x55f0c7250be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f691e4c1640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c724e720 0x55f0c7250be0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f6921f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f6921f40800 20 realm 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.547+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7251740 con 0x55f0c724e720 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7252010 con 0x55f0c724e720 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c7253110 0x55f0c7255500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.548+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7255ac0 con 0x55f0c7253110 2024-09-19T11:13:56.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.549+0000 7f691dcc0640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c7253110 0x55f0c7255500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.549+0000 7f691dcc0640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c7253110 0x55f0c7255500 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.549+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.549+0000 7f6921f40800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.549+0000 7f6921f40800 20 searching for the correct realm 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.549+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c7257a90 0x55f0c7259f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.549+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725a5f0 con 0x55f0c7257a90 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.549+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c7257a90 0x55f0c7259f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.550+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c7257a90 0x55f0c7259f20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.550+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.550+0000 7f691d4bf640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6910069040 0x7f691006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.550+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725a5f0 con 0x7f6910069040 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.550+0000 7f691e4c1640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6910069040 0x7f691006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.550+0000 7f691e4c1640 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6910069040 0x7f691006a940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.550+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.550+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.551+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.551+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.551+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.551+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.551+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.551+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x7f6910069040 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7257a90 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.552+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.553+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.553+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.553+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.553+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x7f6910069040 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.553+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.553+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7257a90 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.553+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.553+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7257a90 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7257a90 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7257a90 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.554+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.555+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.555+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.555+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.555+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7257a90 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.555+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.555+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x7f6910069040 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.555+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.555+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.556+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.556+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.556+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.556+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7257a90 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.556+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.556+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.556+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.556+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x7f6910069040 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.557+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.557+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7257a90 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.557+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.557+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c7253110 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.557+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.557+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x55f0c724e720 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.557+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.557+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72523b0 con 0x7f6910069040 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7256380 con 0x55f0c724e720 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7256380 con 0x55f0c724e720 2024-09-19T11:13:56.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7256380 con 0x55f0c7257a90 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 zone default found 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 4 Realm: () 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:56.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 zonegroup default 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.558+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7256c20 con 0x55f0c7253110 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725c560 con 0x55f0c7257a90 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725c950 con 0x55f0c7257a90 2024-09-19T11:13:56.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 20 started sync module instance, tier type = 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.559+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725b900 con 0x7f6910069040 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.560+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.560+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94492621651456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725b900 con 0x7f6910069040 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.560+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725d400 con 0x55f0c724e720 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.561+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94492621651456] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.561+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.561+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94492621655792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725b900 con 0x55f0c724e720 2024-09-19T11:13:56.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.561+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725de90 con 0x55f0c7257a90 2024-09-19T11:13:56.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.563+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.563+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94492621655792] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.563+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94492621658464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725e730 con 0x55f0c7257a90 2024-09-19T11:13:56.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.563+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725b450 con 0x7f6910069040 2024-09-19T11:13:56.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.564+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.564+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94492621663520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725f5f0 con 0x7f6910069040 2024-09-19T11:13:56.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.564+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7260030 con 0x55f0c724e720 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.564+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94492621658464] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.565+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94492621663520] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.565+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.565+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94492621667072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725f140 con 0x55f0c724e720 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.565+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72608d0 con 0x55f0c7253110 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.566+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94492621667072] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.566+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.566+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94492621669408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c725f140 con 0x55f0c7253110 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.566+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7261290 con 0x55f0c7253110 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.567+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.567+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94492621674032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7261f00 con 0x55f0c7253110 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.567+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7262940 con 0x55f0c7253110 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.567+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94492621669408] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94492621674032] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'114 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94492621677584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7261a50 con 0x55f0c7253110 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f6921f40800 20 add_watcher() i=0 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f6921f40800 20 add_watcher() i=1 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f6921f40800 20 add_watcher() i=2 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f6921f40800 20 add_watcher() i=3 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f6921f40800 20 add_watcher() i=4 2024-09-19T11:13:56.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f6921f40800 20 add_watcher() i=5 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.568+0000 7f6921f40800 20 add_watcher() i=6 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.569+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94492621677584] v35'115 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.569+0000 7f6921f40800 20 add_watcher() i=7 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.569+0000 7f6921f40800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.569+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7265a40 con 0x55f0c724e720 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.569+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.569+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94492621660800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7262ec0 con 0x55f0c724e720 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.570+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94492621660800] v35'110 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.570+0000 7f67cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.570+0000 7f6921f40800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.570+0000 7f6921f40800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:56.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.570+0000 7f6921f40800 5 note: GC not initialized 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f67ce7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 20 Filter name: none 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f673ffff640 20 reqs_thread_entry: start 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c7298720 con 0x55f0c7253110 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 20 rados_obj.operate() r=0 bl.length=380 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-19T11:13:56.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.571+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729a6b0 con 0x7f6910069040 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv18 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729c130 con 0x55f0c7253110 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(64 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.572+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72a0360 con 0x7f6910069040 2024-09-19T11:13:56.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.573+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 foo.buckets [call] v35'19 uv17 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.573+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72a6130 con 0x55f0c7253110 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.574+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(66 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'2 uv2 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.574+0000 7f6921f40800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.574+0000 7f6921f40800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.574+0000 7f6921f40800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.574+0000 7f6921f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1, ofs0, ns] 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.574+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94492621914272 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72a0790 con 0x55f0c7253110 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== watch-notify(notify (1) cookie 94492621674032 notify 150323855364 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55f0c729b670 con 0x55f0c7253110 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f68017fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 94492621674032 notifier 4512 bl.length()=760 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f68017fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:56.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f68017fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f68017fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(67 notify.6 [notify cookie 94492621914272 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f68017fa640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f67e0003ea0 con 0x55f0c7253110 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== watch-notify(notify_complete (2) cookie 94492621914272 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f0c722cc10 con 0x55f0c7253110 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f6921f40800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_sources= new_sources= 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f6921f40800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential sources added=[] removed=[] 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f6921f40800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_dests= new_dests= 2024-09-19T11:13:56.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f6921f40800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential dests added=[] removed=[] 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.575+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729c050 con 0x55f0c7253110 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.576+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(69 fud.buckets [call] v35'1 uv1 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.576+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729c050 con 0x7f6910069040 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.577+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'20 uv20 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.577+0000 7f6921f40800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.577+0000 7f6921f40800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.577+0000 7f6921f40800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.577+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94492621902320 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729c050 con 0x55f0c7253110 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.578+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== watch-notify(notify (1) cookie 94492621674032 notify 150323855365 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55f0c720f060 con 0x55f0c7253110 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.578+0000 7f6800ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 94492621674032 notifier 4512 bl.length()=314 2024-09-19T11:13:56.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.578+0000 7f6800ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.578+0000 7f6800ff9640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.578+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(71 notify.6 [notify cookie 94492621902320 out=8b] v0'0 uv114 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.578+0000 7f6800ff9640 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f6748003400 con 0x55f0c7253110 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.578+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.578+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== watch-notify(notify_complete (2) cookie 94492621902320 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55f0c720e660 con 0x55f0c7253110 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.579+0000 7f67cf7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.579+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94492621660800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72965a0 con 0x55f0c724e720 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.580+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94492621660800] v35'111 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.580+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94492621651456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72965a0 con 0x7f6910069040 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.581+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94492621651456] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.581+0000 7f6921f40800 20 remove_watcher() i=0 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.581+0000 7f6921f40800 2 removed watcher, disabling cache 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.581+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94492621655792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72965a0 con 0x55f0c724e720 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.582+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94492621655792] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.582+0000 7f6921f40800 20 remove_watcher() i=1 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.582+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94492621658464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c72965a0 con 0x55f0c7257a90 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.583+0000 7f691d4bf640 1 -- 172.21.15.102:0/3806306244 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94492621658464] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6910057030 con 0x55f0c7257a90 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.583+0000 7f6921f40800 20 remove_watcher() i=2 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.583+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94492621663520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729bff0 con 0x7f6910069040 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.584+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94492621663520] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x7f6910069040 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.584+0000 7f6921f40800 20 remove_watcher() i=3 2024-09-19T11:13:56.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.584+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94492621667072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729bff0 con 0x55f0c724e720 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.585+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94492621667072] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f691800a4d0 con 0x55f0c724e720 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.585+0000 7f6921f40800 20 remove_watcher() i=4 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.585+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94492621669408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729bff0 con 0x55f0c7253110 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.586+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94492621669408] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.586+0000 7f6921f40800 20 remove_watcher() i=5 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.586+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94492621674032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729bff0 con 0x55f0c7253110 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.587+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94492621674032] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.587+0000 7f6921f40800 20 remove_watcher() i=6 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.587+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94492621677584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55f0c729bff0 con 0x55f0c7253110 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f691dcc0640 1 -- 172.21.15.102:0/3806306244 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94492621677584] v35'116 uv114 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f690807e040 con 0x55f0c7253110 2024-09-19T11:13:56.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 20 remove_watcher() i=7 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c7253110 msgr2=0x55f0c7255500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c7253110 0x55f0c7255500 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c724e720 msgr2=0x55f0c7250be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c724e720 0x55f0c7250be0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6910069040 msgr2=0x7f691006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6910069040 0x7f691006a940 crc :-1 s=READY pgs=47 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c7257a90 msgr2=0x55f0c7259f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c7257a90 0x55f0c7259f20 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.588+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67e803d0b0 msgr2=0x7f67e803f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67e803d0b0 0x7f67e803f570 secure :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0x55f0c721e870 tx=0x7f691006d040 comp rx=0 tx=0).stop 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 msgr2=0x55f0c7243190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c7243190 secure :-1 s=READY pgs=422 cs=0 l=1 rev1=1 crypto rx=0x7f690801ab60 tx=0x7f6908041ae0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f691e4c1640 1 -- 172.21.15.102:0/3806306244 reap_dead start 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 shutdown_connections 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/3806306244 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7239c70 0x55f0c7243190 unknown :-1 s=CLOSED pgs=422 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 >> 172.21.15.102:0/3806306244 conn(0x55f0c7234e70 msgr2=0x55f0c7233080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 shutdown_connections 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3806306244 wait complete. 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/813814062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67f803d000 msgr2=0x7f67f803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/813814062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67f803d000 0x7f67f803f4c0 secure :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0x7f6910000c00 tx=0x7f6910005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/813814062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c722c1b0 msgr2=0x55f0c722c5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/813814062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c722c1b0 0x55f0c722c5d0 secure :-1 s=READY pgs=420 cs=0 l=1 rev1=1 crypto rx=0x7f6908017ca0 tx=0x7f6908017910 comp rx=0 tx=0).stop 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/813814062 shutdown_connections 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/813814062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f67f803d000 0x7f67f803f4c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/813814062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c722c1b0 0x55f0c722c5d0 unknown :-1 s=CLOSED pgs=420 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/813814062 >> 172.21.15.102:0/813814062 conn(0x55f0c7220560 msgr2=0x55f0c7220940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/813814062 shutdown_connections 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/813814062 wait complete. 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c72178a0 msgr2=0x55f0c7219d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f0c72178a0 0x55f0c7219d20 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c7117800 msgr2=0x55f0c72154c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f0c7117800 0x55f0c72154c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c721b910 msgr2=0x55f0c721dd00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f0c721b910 0x55f0c721dd00 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f680403d000 msgr2=0x7f680403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f680403d000 0x7f680403f4c0 secure :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0x7f6910057000 tx=0x7f6910052000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 msgr2=0x55f0c720de70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f6921f40800 1 --2- 172.21.15.102:0/3658413285 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f0c7116c00 0x55f0c720de70 secure :-1 s=READY pgs=419 cs=0 l=1 rev1=1 crypto rx=0x55f0c72072b0 tx=0x7f6908000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.589+0000 7f691e4c1640 1 -- 172.21.15.102:0/3658413285 reap_dead start 2024-09-19T11:13:56.612 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.590+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 shutdown_connections 2024-09-19T11:13:56.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.590+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 >> 172.21.15.102:0/3658413285 conn(0x55f0c71111e0 msgr2=0x55f0c7207810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.590+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 shutdown_connections 2024-09-19T11:13:56.613 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.590+0000 7f6921f40800 1 -- 172.21.15.102:0/3658413285 wait complete. 2024-09-19T11:13:56.614 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-19T11:13:56.614 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-19T11:13:56.614 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-19T11:13:56.658 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:56.659 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:56.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.658+0000 7f5d17612800 1 Processor -- start 2024-09-19T11:13:56.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.658+0000 7f5d17612800 1 -- start start 2024-09-19T11:13:56.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.658+0000 7f5d17612800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5573d17eba20 0x5573d17ebe20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.658+0000 7f5d17612800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5573d17ed7c0 con 0x5573d17ec360 2024-09-19T11:13:56.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.658+0000 7f5d17612800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5573d17027d0 con 0x5573d17eba20 2024-09-19T11:13:56.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.659+0000 7f5d12ccb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5573d17eba20 0x5573d17ebe20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.659+0000 7f5d124ca640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5573d17ec360 0x5573d187f380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52512/0 (socket says 172.21.15.102:52512) 2024-09-19T11:13:56.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.659+0000 7f5d124ca640 1 -- 172.21.15.102:0/986809337 learned_addr learned my addr 172.21.15.102:0/986809337 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:56.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.659+0000 7f5d12ccb640 1 -- 172.21.15.102:0/986809337 >> v1:172.21.15.37:6789/0 conn(0x5573d17ec360 legacy=0x5573d187f380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.659+0000 7f5d12ccb640 1 -- 172.21.15.102:0/986809337 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d1881ab0 con 0x5573d17eba20 2024-09-19T11:13:56.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/986809337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d17ebe20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5d04005fd0 tx=0x7f5d04045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8775439da9817a84 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d11cc9640 1 -- 172.21.15.102:0/986809337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d04058530 con 0x5573d17eba20 2024-09-19T11:13:56.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d11cc9640 1 -- 172.21.15.102:0/986809337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d040586d0 con 0x5573d17eba20 2024-09-19T11:13:56.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d11cc9640 1 -- 172.21.15.102:0/986809337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d040589d0 con 0x5573d17eba20 2024-09-19T11:13:56.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d17612800 1 -- 172.21.15.102:0/986809337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 msgr2=0x5573d17ebe20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d17612800 1 --2- 172.21.15.102:0/986809337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d17ebe20 secure :-1 s=READY pgs=424 cs=0 l=1 rev1=1 crypto rx=0x7f5d04005fd0 tx=0x7f5d04045c30 comp rx=0 tx=0).stop 2024-09-19T11:13:56.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d17612800 1 -- 172.21.15.102:0/986809337 shutdown_connections 2024-09-19T11:13:56.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d17612800 1 --2- 172.21.15.102:0/986809337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d17ebe20 unknown :-1 s=CLOSED pgs=424 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d17612800 1 -- 172.21.15.102:0/986809337 >> 172.21.15.102:0/986809337 conn(0x5573d1872c60 msgr2=0x5573d18750c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d17612800 1 -- 172.21.15.102:0/986809337 shutdown_connections 2024-09-19T11:13:56.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.661+0000 7f5d17612800 1 -- 172.21.15.102:0/986809337 wait complete. 2024-09-19T11:13:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.675+0000 7f5d17612800 1 Processor -- start 2024-09-19T11:13:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.675+0000 7f5d17612800 1 -- start start 2024-09-19T11:13:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.675+0000 7f5d17612800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1969510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.675+0000 7f5d17612800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5573d170fdd0 con 0x5573d17eba20 2024-09-19T11:13:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.675+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1969510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.675+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1969510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44224/0 (socket says 172.21.15.102:44224) 2024-09-19T11:13:56.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.675+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3736009237 learned_addr learned my addr 172.21.15.102:0/3736009237 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.676+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3736009237 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d1969b00 con 0x5573d17eba20 2024-09-19T11:13:56.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.676+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/3736009237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1969510 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400a3f0 tx=0x7f5d04051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bea2d7946f661f29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.676+0000 7f5c00e09640 1 -- 172.21.15.102:0/3736009237 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d04068070 con 0x5573d17eba20 2024-09-19T11:13:56.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.676+0000 7f5c00e09640 1 -- 172.21.15.102:0/3736009237 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d04058880 con 0x5573d17eba20 2024-09-19T11:13:56.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.676+0000 7f5c00e09640 1 -- 172.21.15.102:0/3736009237 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d04058b60 con 0x5573d17eba20 2024-09-19T11:13:56.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 -- 172.21.15.102:0/3736009237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 msgr2=0x5573d1969510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 --2- 172.21.15.102:0/3736009237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1969510 secure :-1 s=READY pgs=425 cs=0 l=1 rev1=1 crypto rx=0x7f5d0400a3f0 tx=0x7f5d04051000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 -- 172.21.15.102:0/3736009237 shutdown_connections 2024-09-19T11:13:56.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 --2- 172.21.15.102:0/3736009237 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1969510 unknown :-1 s=CLOSED pgs=425 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 -- 172.21.15.102:0/3736009237 >> 172.21.15.102:0/3736009237 conn(0x5573d1872c60 msgr2=0x5573d1964e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 -- 172.21.15.102:0/3736009237 shutdown_connections 2024-09-19T11:13:56.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 -- 172.21.15.102:0/3736009237 wait complete. 2024-09-19T11:13:56.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 Processor -- start 2024-09-19T11:13:56.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 -- start start 2024-09-19T11:13:56.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1970f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d17612800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5573d1880da0 con 0x5573d17eba20 2024-09-19T11:13:56.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1970f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1970f80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44236/0 (socket says 172.21.15.102:44236) 2024-09-19T11:13:56.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.677+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3035394110 learned_addr learned my addr 172.21.15.102:0/3035394110 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.678+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3035394110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d19714e0 con 0x5573d17eba20 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.678+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1970f80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5d04066040 tx=0x7f5d04003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.678+0000 7f5bff606640 1 -- 172.21.15.102:0/3035394110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d04071070 con 0x5573d17eba20 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.678+0000 7f5bff606640 1 -- 172.21.15.102:0/3035394110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d04063780 con 0x5573d17eba20 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.678+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d1971770 con 0x5573d17eba20 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.678+0000 7f5bff606640 1 -- 172.21.15.102:0/3035394110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d04068040 con 0x5573d17eba20 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.678+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d1972170 con 0x5573d17eba20 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.679+0000 7f5bff606640 1 -- 172.21.15.102:0/3035394110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5d04074070 con 0x5573d17eba20 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.679+0000 7f5bff606640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bf803cfb0 0x7f5bf803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.679+0000 7f5bff606640 1 -- 172.21.15.102:0/3035394110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5d040974e0 con 0x5573d17eba20 2024-09-19T11:13:56.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.679+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bf803cfb0 0x7f5bf803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.679+0000 7f5d17612800 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d17ec360 0x5573d19785d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.679+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d1978b10 con 0x5573d17ec360 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.679+0000 7f5d134cc640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d17ec360 0x5573d19785d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.680+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bf803cfb0 0x7f5bf803f470 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d08001d70 tx=0x7f5d080012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.680+0000 7f5d134cc640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d17ec360 0x5573d19785d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.680+0000 7f5d134cc640 1 -- 172.21.15.102:0/3035394110 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0c0083e0 con 0x5573d17ec360 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.680+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d1978eb0 con 0x5573d17ec360 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.680+0000 7f5d134cc640 1 -- 172.21.15.102:0/3035394110 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d0c0083e0 con 0x5573d17ec360 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.680+0000 7f5d17612800 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d197a9b0 0x5573d197ce30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.680+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d197d5c0 con 0x5573d197a9b0 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.681+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d197a9b0 0x5573d197ce30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.681+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d197a9b0 0x5573d197ce30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.681+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3035394110 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5d04073030 con 0x5573d197a9b0 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.681+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d1979700 con 0x5573d17ec360 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.682+0000 7f5d134cc640 1 -- 172.21.15.102:0/3035394110 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d0c0083e0 con 0x5573d17ec360 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.682+0000 7f5d17612800 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d197ea20 0x5573d1980e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.682+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d1981580 con 0x5573d197ea20 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.682+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d197ea20 0x5573d1980e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.682+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d197ea20 0x5573d1980e10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.682+0000 7f5d124ca640 1 -- 172.21.15.102:0/3035394110 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5d08009050 con 0x5573d197ea20 2024-09-19T11:13:56.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.683+0000 7f5d17612800 1 Processor -- start 2024-09-19T11:13:56.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.683+0000 7f5d17612800 1 -- start start 2024-09-19T11:13:56.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.683+0000 7f5d17612800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d198f300 0x5573d198f720 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.683+0000 7f5d17612800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5573d176e4a0 con 0x5573d198f300 2024-09-19T11:13:56.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.683+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d198f300 0x5573d198f720 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.683+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d198f300 0x5573d198f720 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44246/0 (socket says 172.21.15.102:44246) 2024-09-19T11:13:56.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.683+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3114627690 learned_addr learned my addr 172.21.15.102:0/3114627690 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.683+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3114627690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d198fd60 con 0x5573d198f300 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.684+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/3114627690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d198f300 0x5573d198f720 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5d04095840 tx=0x7f5d04097280 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.684+0000 7f5bfce01640 1 -- 172.21.15.102:0/3114627690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d0408f070 con 0x5573d198f300 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.684+0000 7f5bfce01640 1 -- 172.21.15.102:0/3114627690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d04063a60 con 0x5573d198f300 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.684+0000 7f5bfce01640 1 -- 172.21.15.102:0/3114627690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d04063d60 con 0x5573d198f300 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.684+0000 7f5d17612800 1 -- 172.21.15.102:0/3114627690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d1990590 con 0x5573d198f300 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.684+0000 7f5d17612800 1 -- 172.21.15.102:0/3114627690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d1990b30 con 0x5573d198f300 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.684+0000 7f5bfce01640 1 -- 172.21.15.102:0/3114627690 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5d04092070 con 0x5573d198f300 2024-09-19T11:13:56.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5bfce01640 1 --2- 172.21.15.102:0/3114627690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bec03d000 0x7f5bec03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5bfce01640 1 -- 172.21.15.102:0/3114627690 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5d04087070 con 0x5573d198f300 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3114627690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bec03d000 0x7f5bec03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d17612800 1 Processor -- start 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3114627690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bec03d000 0x7f5bec03f4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800bf40 tx=0x7f5d0800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d17612800 1 -- start start 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d17612800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d199bf40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d17612800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5573d1969e70 con 0x5573d199bb60 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d199bf40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d199bf40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44256/0 (socket says 172.21.15.102:44256) 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.685+0000 7f5d12ccb640 1 -- 172.21.15.102:0/4050030128 learned_addr learned my addr 172.21.15.102:0/4050030128 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d12ccb640 1 -- 172.21.15.102:0/4050030128 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d199c530 con 0x5573d199bb60 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/4050030128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d199bf40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5d0406dfc0 tx=0x7f5d0406c520 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4f14eec4923cea04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5bf67fc640 1 -- 172.21.15.102:0/4050030128 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d040a4020 con 0x5573d199bb60 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5bf67fc640 1 -- 172.21.15.102:0/4050030128 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d04080d80 con 0x5573d199bb60 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5bf67fc640 1 -- 172.21.15.102:0/4050030128 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d04057c50 con 0x5573d199bb60 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d17612800 1 -- 172.21.15.102:0/4050030128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 msgr2=0x5573d199bf40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d17612800 1 --2- 172.21.15.102:0/4050030128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d199bf40 secure :-1 s=READY pgs=428 cs=0 l=1 rev1=1 crypto rx=0x7f5d0406dfc0 tx=0x7f5d0406c520 comp rx=0 tx=0).stop 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d17612800 1 -- 172.21.15.102:0/4050030128 shutdown_connections 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d17612800 1 --2- 172.21.15.102:0/4050030128 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d199bf40 unknown :-1 s=CLOSED pgs=428 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d17612800 1 -- 172.21.15.102:0/4050030128 >> 172.21.15.102:0/4050030128 conn(0x5573d1997f60 msgr2=0x5573d19961a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d17612800 1 -- 172.21.15.102:0/4050030128 shutdown_connections 2024-09-19T11:13:56.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.686+0000 7f5d17612800 1 -- 172.21.15.102:0/4050030128 wait complete. 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.687+0000 7f5d17612800 1 Processor -- start 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.687+0000 7f5d17612800 1 -- start start 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.687+0000 7f5d17612800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d19a2fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.687+0000 7f5d17612800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5573d199c9c0 con 0x5573d199bb60 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.687+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d19a2fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.687+0000 7f5d12ccb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d19a2fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44268/0 (socket says 172.21.15.102:44268) 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.687+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 learned_addr learned my addr 172.21.15.102:0/3077240635 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.688+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5573d19a3500 con 0x5573d199bb60 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.688+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d19a2fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5d04081e20 tx=0x7f5d0404f3f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.688+0000 7f5bf4ff9640 1 -- 172.21.15.102:0/3077240635 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d04057490 con 0x5573d199bb60 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.688+0000 7f5bf4ff9640 1 -- 172.21.15.102:0/3077240635 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5d04083050 con 0x5573d199bb60 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.688+0000 7f5bf4ff9640 1 -- 172.21.15.102:0/3077240635 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5d0406c7b0 con 0x5573d199bb60 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.688+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5573d19a3500 con 0x5573d199bb60 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.688+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5573d19a3500 con 0x5573d199bb60 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.689+0000 7f5bf4ff9640 1 -- 172.21.15.102:0/3077240635 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5d040a7020 con 0x5573d199bb60 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.689+0000 7f5bf4ff9640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bdc03d000 0x7f5bdc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.689+0000 7f5bf4ff9640 1 -- 172.21.15.102:0/3077240635 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5d040b0050 con 0x5573d199bb60 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.689+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bdc03d000 0x7f5bdc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bdc03d000 0x7f5bdc03f4c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c010 tx=0x7f5d08010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d19ae540 0x5573d19b0a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1150 con 0x5573d19ae540 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d134cc640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d19ae540 0x5573d19b0a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d134cc640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d19ae540 0x5573d19b0a00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0c0083e0 con 0x5573d19ae540 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d17612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d17612800 20 realm 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.690+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1560 con 0x5573d19ae540 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0c0083e0 con 0x5573d19ae540 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0c0083e0 con 0x5573d19ae540 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b21d0 con 0x5573d19ae540 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5d0c0083e0 con 0x5573d19ae540 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d19b2b90 0x5573d19b4f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b55d0 con 0x5573d19b2b90 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.691+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d19b2b90 0x5573d19b4f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.692+0000 7f5d12ccb640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d19b2b90 0x5573d19b4f80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.692+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.692+0000 7f5d17612800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.692+0000 7f5d17612800 20 searching for the correct realm 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.692+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d19b7560 0x5573d19b9a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.692+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19ba0a0 con 0x5573d19b7560 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.692+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d19b7560 0x5573d19b9a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.692+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d19b7560 0x5573d19b9a20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.693+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.693+0000 7f5d124ca640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5d08037040 0x7f5d08036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.693+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19ba0a0 con 0x7f5d08037040 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.693+0000 7f5d134cc640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5d08037040 0x7f5d08036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.693+0000 7f5d134cc640 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5d08037040 0x7f5d08036410 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.693+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c0083e0 con 0x7f5d08037040 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.693+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.694+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.694+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.694+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c0083e0 con 0x5573d19ae540 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.694+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.694+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.694+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.694+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.694+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.695+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.695+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x7f5d08037040 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.695+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x7f5d08037040 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.695+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b7560 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.695+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.695+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.695+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.695+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x7f5d08037040 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5d0c026040 con 0x7f5d08037040 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b7560 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b7560 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.696+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b7560 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b7560 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.697+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.698+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.698+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.698+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.698+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b7560 2024-09-19T11:13:56.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.698+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.698+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x7f5d08037040 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.698+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x7f5d08037040 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.698+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.699+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.699+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.699+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.699+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b7560 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.699+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.699+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.699+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.699+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x7f5d08037040 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.700+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x7f5d08037040 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.700+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b7560 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.700+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.700+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19b2b90 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.700+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.700+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x5573d19ae540 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.700+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.700+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b1e30 con 0x7f5d08037040 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5d0c026040 con 0x7f5d08037040 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:56.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b5970 con 0x5573d19ae540 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b5970 con 0x5573d19ae540 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5d0c026040 con 0x5573d19ae540 2024-09-19T11:13:56.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.701+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b5970 con 0x5573d19b7560 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 zone default found 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 4 Realm: () 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 zonegroup default 2024-09-19T11:13:56.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19b6210 con 0x5573d19b2b90 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bc010 con 0x5573d19b7560 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bc430 con 0x5573d19b7560 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 started sync module instance, tier type = 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.702+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bb3b0 con 0x7f5d08037040 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.704+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c026040 con 0x7f5d08037040 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.704+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93955926243504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bb3b0 con 0x7f5d08037040 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.704+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bcf80 con 0x5573d19ae540 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.705+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93955926243504] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.705+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.705+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93955926248016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bb3b0 con 0x5573d19ae540 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.705+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bd9d0 con 0x5573d19b7560 2024-09-19T11:13:56.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.706+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93955926248016] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.706+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.706+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93955926241024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bb320 con 0x5573d19b7560 2024-09-19T11:13:56.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.706+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19be8c0 con 0x7f5d08037040 2024-09-19T11:13:56.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.707+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93955926241024] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.707+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.707+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93955926254608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bece0 con 0x7f5d08037040 2024-09-19T11:13:56.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.708+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bf6a0 con 0x5573d19ae540 2024-09-19T11:13:56.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.708+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.708+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93955926258160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19bf610 con 0x5573d19ae540 2024-09-19T11:13:56.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.708+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c05f0 con 0x5573d19b2b90 2024-09-19T11:13:56.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.708+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93955926254608] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.709+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93955926258160] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.709+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.709+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93955926260368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19be830 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.710+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c0e40 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.710+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.710+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93955926266416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c1b00 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.710+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c2530 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93955926260368] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93955926266416] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'117 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93955926261984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c1690 con 0x5573d19b2b90 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d17612800 20 add_watcher() i=0 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d17612800 20 add_watcher() i=1 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d17612800 20 add_watcher() i=2 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d17612800 20 add_watcher() i=3 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d17612800 20 add_watcher() i=4 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d17612800 20 add_watcher() i=5 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.711+0000 7f5d17612800 20 add_watcher() i=6 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.712+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93955926261984] v35'118 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.712+0000 7f5d17612800 20 add_watcher() i=7 2024-09-19T11:13:56.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.712+0000 7f5d17612800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.712+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c5630 con 0x5573d19ae540 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.713+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.713+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93955926270016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c2ab0 con 0x5573d19ae540 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.714+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93955926270016] v35'112 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.714+0000 7f5bc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.714+0000 7f5d17612800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.714+0000 7f5d17612800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.714+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cddf0 con 0x5573d19ae540 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.715+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.715+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cddf0 con 0x5573d19b2b90 2024-09-19T11:13:56.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.716+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'14 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.716+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cddf0 con 0x5573d19b7560 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.717+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.717+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cd460 con 0x5573d19ae540 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.718+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'113 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.718+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cd460 con 0x7f5d08037040 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.719+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'32 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.719+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cf590 con 0x5573d19b7560 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.720+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'22 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.720+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cf9d0 con 0x5573d19ae540 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.721+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.721+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cf900 con 0x5573d19b2b90 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.722+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'21 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.722+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cf9a0 con 0x7f5d08037040 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.723+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.723+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cf9c0 con 0x5573d19b7560 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.724+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.724+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0030 con 0x7f5d08037040 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.725+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.725+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0010 con 0x5573d19b2b90 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.727+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.727+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0010 con 0x7f5d08037040 2024-09-19T11:13:56.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.728+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.728+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0010 con 0x5573d19b2b90 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.729+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'27 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.729+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0010 con 0x5573d19ae540 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.730+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'114 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.730+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0010 con 0x5573d19b7560 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.731+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.731+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cffc0 con 0x7f5d08037040 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.732+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'34 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.732+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19cffc0 con 0x5573d19b7560 2024-09-19T11:13:56.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.733+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.733+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d00f0 con 0x5573d19ae540 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.734+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.734+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d00f0 con 0x5573d19ae540 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.735+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'115 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.735+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d00f0 con 0x5573d19b7560 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.736+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'27 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.736+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d01c0 con 0x7f5d08037040 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.737+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'24 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.737+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b7560 2024-09-19T11:13:56.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.738+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.738+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b7560 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.739+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.739+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b7560 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.740+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'10 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.740+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b7560 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.741+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'23 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.741+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b2b90 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.742+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'16 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.742+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b7560 2024-09-19T11:13:56.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.743+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'14 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.743+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b2b90 2024-09-19T11:13:56.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.744+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'22 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.744+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b7560 2024-09-19T11:13:56.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.745+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'28 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.745+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x5573d19b2b90 2024-09-19T11:13:56.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.746+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'28 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.746+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19d0180 con 0x7f5d08037040 2024-09-19T11:13:56.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.747+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.747+0000 7f5b43fff640 20 reqs_thread_entry: start 2024-09-19T11:13:56.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.747+0000 7f5d17612800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:56.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.747+0000 7f5d17612800 20 Filter name: none 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.747+0000 7f5b41ffb640 20 reqs_thread_entry: start 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.747+0000 7f5d17612800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.747+0000 7f5d17612800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.747+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19fb050 con 0x5573d19b2b90 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.748+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.748+0000 7f5d17612800 20 rados_obj.operate() r=0 bl.length=380 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.748+0000 7f5d17612800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.748+0000 7f5d17612800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.748+0000 7f5d17612800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.748+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5573d19fd950 con 0x5573d19b2b90 2024-09-19T11:13:56.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.748+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(95 fud.buckets [call out=183b] v0'0 uv1 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.751 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-19T11:13:56.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.749+0000 7f5bc97e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.749+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93955926270016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19ce810 con 0x5573d19ae540 2024-09-19T11:13:56.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.750+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 93955926270016] v35'116 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.750+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93955926243504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c2040 con 0x7f5d08037040 2024-09-19T11:13:56.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.751+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 93955926243504] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.751+0000 7f5d17612800 20 remove_watcher() i=0 2024-09-19T11:13:56.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.751+0000 7f5d17612800 2 removed watcher, disabling cache 2024-09-19T11:13:56.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.751+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93955926248016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c2040 con 0x5573d19ae540 2024-09-19T11:13:56.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.752+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 93955926248016] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.752+0000 7f5d17612800 20 remove_watcher() i=1 2024-09-19T11:13:56.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.752+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93955926241024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c2040 con 0x5573d19b7560 2024-09-19T11:13:56.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.753+0000 7f5d124ca640 1 -- 172.21.15.102:0/3077240635 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 93955926241024] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d08009050 con 0x5573d19b7560 2024-09-19T11:13:56.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.753+0000 7f5d17612800 20 remove_watcher() i=2 2024-09-19T11:13:56.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.753+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93955926254608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19baf00 con 0x7f5d08037040 2024-09-19T11:13:56.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.754+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 93955926254608] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x7f5d08037040 2024-09-19T11:13:56.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.754+0000 7f5d17612800 20 remove_watcher() i=3 2024-09-19T11:13:56.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.754+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93955926258160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c2040 con 0x5573d19ae540 2024-09-19T11:13:56.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.755+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 93955926258160] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d0c036040 con 0x5573d19ae540 2024-09-19T11:13:56.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.755+0000 7f5d17612800 20 remove_watcher() i=4 2024-09-19T11:13:56.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.755+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93955926260368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19be410 con 0x5573d19b2b90 2024-09-19T11:13:56.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.756+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 93955926260368] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.756+0000 7f5d17612800 20 remove_watcher() i=5 2024-09-19T11:13:56.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.756+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93955926266416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19baf00 con 0x5573d19b2b90 2024-09-19T11:13:56.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.757+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 93955926266416] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.757+0000 7f5d17612800 20 remove_watcher() i=6 2024-09-19T11:13:56.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.757+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93955926261984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5573d19c2040 con 0x5573d19b2b90 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d12ccb640 1 -- 172.21.15.102:0/3077240635 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 93955926261984] v35'119 uv117 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5d04091030 con 0x5573d19b2b90 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 20 remove_watcher() i=7 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d19b2b90 msgr2=0x5573d19b4f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d19b2b90 0x5573d19b4f80 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d19ae540 msgr2=0x5573d19b0a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d19ae540 0x5573d19b0a00 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5d08037040 msgr2=0x7f5d08036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5d08037040 0x7f5d08036410 crc :-1 s=READY pgs=48 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d19b7560 msgr2=0x5573d19b9a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d19b7560 0x5573d19b9a20 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bdc03d000 msgr2=0x7f5bdc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bdc03d000 0x7f5bdc03f4c0 secure :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800c010 tx=0x7f5d08010000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 msgr2=0x5573d19a2fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d134cc640 1 -- 172.21.15.102:0/3077240635 reap_dead start 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.758+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d19a2fa0 secure :-1 s=READY pgs=429 cs=0 l=1 rev1=1 crypto rx=0x7f5d04081e20 tx=0x7f5d0404f3f0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 shutdown_connections 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3077240635 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d199bb60 0x5573d19a2fa0 unknown :-1 s=CLOSED pgs=429 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 >> 172.21.15.102:0/3077240635 conn(0x5573d1997f60 msgr2=0x5573d1996170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 shutdown_connections 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3077240635 wait complete. 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3114627690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bec03d000 msgr2=0x7f5bec03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3114627690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bec03d000 0x7f5bec03f4c0 secure :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0x7f5d0800bf40 tx=0x7f5d0800f000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.763 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3114627690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d198f300 msgr2=0x5573d198f720 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3114627690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d198f300 0x5573d198f720 secure :-1 s=READY pgs=427 cs=0 l=1 rev1=1 crypto rx=0x7f5d04095840 tx=0x7f5d04097280 comp rx=0 tx=0).stop 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3114627690 shutdown_connections 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3114627690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bec03d000 0x7f5bec03f4c0 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3114627690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d198f300 0x5573d198f720 unknown :-1 s=CLOSED pgs=427 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3114627690 >> 172.21.15.102:0/3114627690 conn(0x5573d19836b0 msgr2=0x5573d1983a90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3114627690 shutdown_connections 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3114627690 wait complete. 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d197a9b0 msgr2=0x5573d197ce30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5573d197a9b0 0x5573d197ce30 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d17ec360 msgr2=0x5573d19785d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5573d17ec360 0x5573d19785d0 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d197ea20 msgr2=0x5573d1980e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5573d197ea20 0x5573d1980e10 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bf803cfb0 msgr2=0x7f5bf803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5bf803cfb0 0x7f5bf803f470 secure :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0x7f5d08001d70 tx=0x7f5d080012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 msgr2=0x5573d1970f80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 --2- 172.21.15.102:0/3035394110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5573d17eba20 0x5573d1970f80 secure :-1 s=READY pgs=426 cs=0 l=1 rev1=1 crypto rx=0x7f5d04066040 tx=0x7f5d04003330 comp rx=0 tx=0).stop 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d134cc640 1 -- 172.21.15.102:0/3035394110 reap_dead start 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 shutdown_connections 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.759+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 >> 172.21.15.102:0/3035394110 conn(0x5573d1872c60 msgr2=0x5573d1963680 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.760+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 shutdown_connections 2024-09-19T11:13:56.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.760+0000 7f5d17612800 1 -- 172.21.15.102:0/3035394110 wait complete. 2024-09-19T11:13:56.768 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-19T11:13:56.769 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-19T11:13:56.769 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'unlink', '--uid', 'fud', '--bucket', 'myfoo'] 2024-09-19T11:13:56.769 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket unlink --uid fud --bucket myfoo 2024-09-19T11:13:56.815 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:56.815 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:56.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb10c731800 1 Processor -- start 2024-09-19T11:13:56.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb10c731800 1 -- start start 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb10c731800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557893301f30 0x557893304320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb10c731800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5578933085e0 con 0x5578933048c0 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb10c731800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55789318c7d0 con 0x557893301f30 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb108476640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557893301f30 0x557893304320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb0ffc75640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5578933048c0 0x557893306d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52524/0 (socket says 172.21.15.102:52524) 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb0ffc75640 1 -- 172.21.15.102:0/3950317154 learned_addr learned my addr 172.21.15.102:0/3950317154 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb108476640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557893301f30 0x557893304320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44284/0 (socket says 172.21.15.102:44284) 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb108476640 1 -- 172.21.15.102:0/3950317154 >> v1:172.21.15.37:6789/0 conn(0x5578933048c0 legacy=0x557893306d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.815+0000 7fb108476640 1 -- 172.21.15.102:0/3950317154 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557893309810 con 0x557893301f30 2024-09-19T11:13:56.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.817+0000 7fb108476640 1 --2- 172.21.15.102:0/3950317154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x557893304320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800a470 tx=0x7fb0f8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3b3a99b81b9a98e3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.817+0000 7fb107c75640 1 -- 172.21.15.102:0/3950317154 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f8053570 con 0x557893301f30 2024-09-19T11:13:56.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.817+0000 7fb107c75640 1 -- 172.21.15.102:0/3950317154 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8058070 con 0x557893301f30 2024-09-19T11:13:56.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.817+0000 7fb107c75640 1 -- 172.21.15.102:0/3950317154 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f8053880 con 0x557893301f30 2024-09-19T11:13:56.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.818+0000 7fb10c731800 1 -- 172.21.15.102:0/3950317154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 msgr2=0x557893304320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.818+0000 7fb10c731800 1 --2- 172.21.15.102:0/3950317154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x557893304320 secure :-1 s=READY pgs=431 cs=0 l=1 rev1=1 crypto rx=0x7fb0f800a470 tx=0x7fb0f8045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:56.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.818+0000 7fb10c731800 1 -- 172.21.15.102:0/3950317154 shutdown_connections 2024-09-19T11:13:56.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.818+0000 7fb10c731800 1 --2- 172.21.15.102:0/3950317154 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x557893304320 unknown :-1 s=CLOSED pgs=431 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.818+0000 7fb10c731800 1 -- 172.21.15.102:0/3950317154 >> 172.21.15.102:0/3950317154 conn(0x5578932fba70 msgr2=0x5578932fded0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.818+0000 7fb10c731800 1 -- 172.21.15.102:0/3950317154 shutdown_connections 2024-09-19T11:13:56.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.818+0000 7fb10c731800 1 -- 172.21.15.102:0/3950317154 wait complete. 2024-09-19T11:13:56.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.831+0000 7fb10c731800 1 Processor -- start 2024-09-19T11:13:56.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.831+0000 7fb10c731800 1 -- start start 2024-09-19T11:13:56.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7fb10c731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933016c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7fb10c731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557893199dd0 con 0x557893301f30 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933016c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933016c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44294/0 (socket says 172.21.15.102:44294) 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7fb108476640 1 -- 172.21.15.102:0/1356134725 learned_addr learned my addr 172.21.15.102:0/1356134725 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7fb108476640 1 -- 172.21.15.102:0/1356134725 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557893301cb0 con 0x557893301f30 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7fb108476640 1 --2- 172.21.15.102:0/1356134725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933016c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8025c20 tx=0x7fb0f8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1e010d87363aa019 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7faff660c640 1 -- 172.21.15.102:0/1356134725 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f805c580 con 0x557893301f30 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7faff660c640 1 -- 172.21.15.102:0/1356134725 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8063030 con 0x557893301f30 2024-09-19T11:13:56.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.832+0000 7faff660c640 1 -- 172.21.15.102:0/1356134725 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f805c850 con 0x557893301f30 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.833+0000 7fb10c731800 1 -- 172.21.15.102:0/1356134725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 msgr2=0x5578933016c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.833+0000 7fb10c731800 1 --2- 172.21.15.102:0/1356134725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933016c0 secure :-1 s=READY pgs=432 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8025c20 tx=0x7fb0f8051000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.833+0000 7fb10c731800 1 -- 172.21.15.102:0/1356134725 shutdown_connections 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.833+0000 7fb10c731800 1 --2- 172.21.15.102:0/1356134725 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933016c0 unknown :-1 s=CLOSED pgs=432 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.833+0000 7fb10c731800 1 -- 172.21.15.102:0/1356134725 >> 172.21.15.102:0/1356134725 conn(0x5578932fba70 msgr2=0x5578933eccc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.833+0000 7fb10c731800 1 -- 172.21.15.102:0/1356134725 shutdown_connections 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.833+0000 7fb10c731800 1 -- 172.21.15.102:0/1356134725 wait complete. 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.833+0000 7fb10c731800 1 Processor -- start 2024-09-19T11:13:56.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.834+0000 7fb10c731800 1 -- start start 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.834+0000 7fb10c731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933fafb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.834+0000 7fb10c731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557893308ab0 con 0x557893301f30 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.834+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933fafb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.834+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933fafb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44308/0 (socket says 172.21.15.102:44308) 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.834+0000 7fb108476640 1 -- 172.21.15.102:0/2673667125 learned_addr learned my addr 172.21.15.102:0/2673667125 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.834+0000 7fb108476640 1 -- 172.21.15.102:0/2673667125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5578933fb510 con 0x557893301f30 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.834+0000 7fb108476640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933fafb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8045f50 tx=0x7fb0f8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.835+0000 7faff4e09640 1 -- 172.21.15.102:0/2673667125 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f8054ad0 con 0x557893301f30 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.835+0000 7faff4e09640 1 -- 172.21.15.102:0/2673667125 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8054c70 con 0x557893301f30 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.835+0000 7faff4e09640 1 -- 172.21.15.102:0/2673667125 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f8068420 con 0x557893301f30 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.835+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5578933fb7a0 con 0x557893301f30 2024-09-19T11:13:56.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.835+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5578933fc1a0 con 0x557893301f30 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.835+0000 7faff4e09640 1 -- 172.21.15.102:0/2673667125 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb0f80685c0 con 0x557893301f30 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.836+0000 7faff4e09640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faff003cfb0 0x7faff003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.836+0000 7faff4e09640 1 -- 172.21.15.102:0/2673667125 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb0f8070030 con 0x557893301f30 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.836+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faff003cfb0 0x7faff003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.836+0000 7fb10c731800 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578933048c0 0x557893402600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.836+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893402b40 con 0x5578933048c0 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.836+0000 7fb108c77640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578933048c0 0x557893402600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.836+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faff003cfb0 0x7faff003f470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0001d70 tx=0x7fb0f00012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.836+0000 7fb108c77640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578933048c0 0x557893402600 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.837+0000 7fb108c77640 1 -- 172.21.15.102:0/2673667125 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578933048c0 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.837+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893402ee0 con 0x5578933048c0 2024-09-19T11:13:56.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.837+0000 7fb108c77640 1 -- 172.21.15.102:0/2673667125 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578933048c0 2024-09-19T11:13:56.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.837+0000 7fb10c731800 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557893404a20 0x557893406e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.837+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893407620 con 0x557893404a20 2024-09-19T11:13:56.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.837+0000 7fb108476640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557893404a20 0x557893406e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.837+0000 7fb108476640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557893404a20 0x557893406e90 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.838+0000 7fb108476640 1 -- 172.21.15.102:0/2673667125 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb0f8051070 con 0x557893404a20 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.838+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893403730 con 0x5578933048c0 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.838+0000 7fb108c77640 1 -- 172.21.15.102:0/2673667125 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578933048c0 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.838+0000 7fb10c731800 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893408a80 0x55789340ae70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.838+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55789340b5b0 con 0x557893408a80 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.838+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893408a80 0x55789340ae70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.838+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893408a80 0x55789340ae70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.839+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2673667125 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb0f0009050 con 0x557893408a80 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.839+0000 7fb10c731800 1 Processor -- start 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.839+0000 7fb10c731800 1 -- start start 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.839+0000 7fb10c731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578934192f0 0x557893419710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.839+0000 7fb10c731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5578931f84a0 con 0x5578934192f0 2024-09-19T11:13:56.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.839+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578934192f0 0x557893419710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.839+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578934192f0 0x557893419710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44318/0 (socket says 172.21.15.102:44318) 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.839+0000 7fb108476640 1 -- 172.21.15.102:0/1327820387 learned_addr learned my addr 172.21.15.102:0/1327820387 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.840+0000 7fb108476640 1 -- 172.21.15.102:0/1327820387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557893419d50 con 0x5578934192f0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.840+0000 7fb108476640 1 --2- 172.21.15.102:0/1327820387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578934192f0 0x557893419710 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8096a30 tx=0x7fb0f807d530 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.840+0000 7fafedffb640 1 -- 172.21.15.102:0/1327820387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f8068ca0 con 0x5578934192f0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.840+0000 7fafedffb640 1 -- 172.21.15.102:0/1327820387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f80980b0 con 0x5578934192f0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.840+0000 7fb10c731800 1 -- 172.21.15.102:0/1327820387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55789341a580 con 0x5578934192f0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.840+0000 7fafedffb640 1 -- 172.21.15.102:0/1327820387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f80983d0 con 0x5578934192f0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.840+0000 7fb10c731800 1 -- 172.21.15.102:0/1327820387 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55789341ab20 con 0x5578934192f0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.841+0000 7fafedffb640 1 -- 172.21.15.102:0/1327820387 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb0f8009870 con 0x5578934192f0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.841+0000 7fafedffb640 1 --2- 172.21.15.102:0/1327820387 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafe003cfb0 0x7fafe003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.841+0000 7fafedffb640 1 -- 172.21.15.102:0/1327820387 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb0f808e070 con 0x5578934192f0 2024-09-19T11:13:56.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.841+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/1327820387 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafe003cfb0 0x7fafe003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.841+0000 7fb10c731800 1 Processor -- start 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.841+0000 7fb10c731800 1 -- start start 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.841+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/1327820387 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafe003cfb0 0x7fafe003f470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000bf40 tx=0x7fb0f000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fb10c731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x557893425f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fb10c731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5578933000b0 con 0x557893425b60 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x557893425f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x557893425f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44332/0 (socket says 172.21.15.102:44332) 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fb108476640 1 -- 172.21.15.102:0/2200333584 learned_addr learned my addr 172.21.15.102:0/2200333584 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fb108476640 1 -- 172.21.15.102:0/2200333584 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557893426530 con 0x557893425b60 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fb108476640 1 --2- 172.21.15.102:0/2200333584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x557893425f40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80745e0 tx=0x7fb0f805e740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2fb084491cf2c43 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fafe77fe640 1 -- 172.21.15.102:0/2200333584 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f809d040 con 0x557893425b60 2024-09-19T11:13:56.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fafe77fe640 1 -- 172.21.15.102:0/2200333584 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f8009b60 con 0x557893425b60 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.842+0000 7fafe77fe640 1 -- 172.21.15.102:0/2200333584 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f80673d0 con 0x557893425b60 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 -- 172.21.15.102:0/2200333584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 msgr2=0x557893425f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 --2- 172.21.15.102:0/2200333584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x557893425f40 secure :-1 s=READY pgs=435 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80745e0 tx=0x7fb0f805e740 comp rx=0 tx=0).stop 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 -- 172.21.15.102:0/2200333584 shutdown_connections 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 --2- 172.21.15.102:0/2200333584 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x557893425f40 unknown :-1 s=CLOSED pgs=435 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 -- 172.21.15.102:0/2200333584 >> 172.21.15.102:0/2200333584 conn(0x557893421f60 msgr2=0x5578934201a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 -- 172.21.15.102:0/2200333584 shutdown_connections 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 -- 172.21.15.102:0/2200333584 wait complete. 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 Processor -- start 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 -- start start 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x55789342cf70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb10c731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5578934269c0 con 0x557893425b60 2024-09-19T11:13:56.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x55789342cf70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb108476640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x55789342cf70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44340/0 (socket says 172.21.15.102:44340) 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.843+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 learned_addr learned my addr 172.21.15.102:0/2402645483 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.844+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55789342d4d0 con 0x557893425b60 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.844+0000 7fb108476640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x55789342cf70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80547e0 tx=0x7fb0f806cf50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.844+0000 7fafe5ffb640 1 -- 172.21.15.102:0/2402645483 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f80bb070 con 0x557893425b60 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.844+0000 7fafe5ffb640 1 -- 172.21.15.102:0/2402645483 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb0f805c660 con 0x557893425b60 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.844+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55789342d4d0 con 0x557893425b60 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.844+0000 7fafe5ffb640 1 -- 172.21.15.102:0/2402645483 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb0f809d040 con 0x557893425b60 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.844+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55789342d4d0 con 0x557893425b60 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.845+0000 7fafe5ffb640 1 -- 172.21.15.102:0/2402645483 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb0f80be070 con 0x557893425b60 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.845+0000 7fafe5ffb640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafd803d000 0x7fafd803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.845+0000 7fafe5ffb640 1 -- 172.21.15.102:0/2402645483 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb0f80b7cd0 con 0x557893425b60 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.845+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafd803d000 0x7fafd803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.846+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafd803d000 0x7fafd803f4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000c010 tx=0x7fb0f0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.846+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.846+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578934384e0 0x55789343a9a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.846+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55789343b0f0 con 0x5578934384e0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.846+0000 7fb108c77640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578934384e0 0x55789343a9a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.846+0000 7fb108c77640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578934384e0 0x55789343a9a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 realm 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55789343b500 con 0x5578934384e0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55789343bdd0 con 0x5578934384e0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55789343ced0 0x55789343f2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.847+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55789343f880 con 0x55789343ced0 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.848+0000 7fb108476640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55789343ced0 0x55789343f2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.848+0000 7fb108476640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55789343ced0 0x55789343f2c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.848+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.848+0000 7fb10c731800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.848+0000 7fb10c731800 20 searching for the correct realm 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.848+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893441830 0x557893443cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.848+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578934443c0 con 0x557893441830 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.848+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893441830 0x557893443cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.849+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893441830 0x557893443cf0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.849+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.849+0000 7fb0ffc75640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb0f0037040 0x7fb0f0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.849+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5578934443c0 con 0x7fb0f0037040 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.849+0000 7fb108c77640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb0f0037040 0x7fb0f0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.849+0000 7fb108c77640 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb0f0037040 0x7fb0f0036410 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.849+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.849+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.850+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.850+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.850+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.850+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.850+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.850+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.850+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.850+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.851+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.851+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x7fb0f0037040 2024-09-19T11:13:56.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.851+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.851+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x557893441830 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.851+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.851+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.851+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.851+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.852+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.852+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.852+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.852+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x7fb0f0037040 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.852+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.852+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x557893441830 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.852+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.852+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x557893441830 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.853+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.853+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.853+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.853+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x557893441830 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.853+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.853+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x557893441830 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.854+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.854+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.854+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.854+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.854+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.854+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.855+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.855+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x557893441830 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.855+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.855+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x7fb0f0037040 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.855+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.855+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.855+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.855+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.856+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.856+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x557893441830 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.856+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.856+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.856+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.856+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x7fb0f0037040 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.857+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.857+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x557893441830 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.857+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.857+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x55789343ced0 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.857+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.857+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x5578934384e0 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.857+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.857+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55789343c170 con 0x7fb0f0037040 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893440140 con 0x5578934384e0 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893440140 con 0x5578934384e0 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893440140 con 0x557893441830 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 zone default found 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 4 Realm: () 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 zonegroup default 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.858+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893440a30 con 0x55789343ced0 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893446330 con 0x557893441830 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578934467b0 con 0x557893441830 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 20 started sync module instance, tier type = 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:56.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.859+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578934456d0 con 0x7fb0f0037040 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.860+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.860+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93976355167184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578934456d0 con 0x7fb0f0037040 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.860+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893447300 con 0x5578934384e0 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.861+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93976355167184] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.861+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.861+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93976355171792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578934456d0 con 0x5578934384e0 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.861+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893447db0 con 0x557893441830 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.862+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93976355171792] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.863+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.863+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93976355164704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893445640 con 0x557893441830 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.863+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893448c70 con 0x7fb0f0037040 2024-09-19T11:13:56.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.863+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93976355164704] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.864+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.864+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93976355178432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893448be0 con 0x7fb0f0037040 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.864+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893449a00 con 0x5578934384e0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.865+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.865+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93976355178432] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.865+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93976355181840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893449a00 con 0x5578934384e0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.865+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5578934490a0 con 0x55789343ced0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.866+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93976355181840] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.866+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.866+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93976355184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789344a8f0 con 0x55789343ced0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.866+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789344b1a0 con 0x55789343ced0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.867+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.867+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93976355187856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789344ba40 con 0x55789343ced0 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.867+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789344c4c0 con 0x55789343ced0 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.867+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93976355184112] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93976355187856] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'120 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93976355192752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789344b540 con 0x55789343ced0 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb10c731800 20 add_watcher() i=0 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb10c731800 20 add_watcher() i=1 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb10c731800 20 add_watcher() i=2 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb10c731800 20 add_watcher() i=3 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb10c731800 20 add_watcher() i=4 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb10c731800 20 add_watcher() i=5 2024-09-19T11:13:56.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.868+0000 7fb10c731800 20 add_watcher() i=6 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.869+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93976355192752] v35'121 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.869+0000 7fb10c731800 20 add_watcher() i=7 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.869+0000 7fb10c731800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.869+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55789344f4b0 con 0x5578934384e0 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.869+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.869+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93976355185728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789344c930 con 0x5578934384e0 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.870+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93976355185728] v35'117 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.870+0000 7fafbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.870+0000 7fb10c731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.870+0000 7fb10c731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.870+0000 7fb10c731800 5 note: GC not initialized 2024-09-19T11:13:56.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.870+0000 7fafbd7e2640 20 reqs_thread_entry: start 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 20 Filter name: none 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7faf2effd640 20 reqs_thread_entry: start 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893482150 con 0x55789343ced0 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(62 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 20 rados_obj.operate() r=0 bl.length=380 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.871+0000 7fb10c731800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5578934840e0 con 0x7fb0f0037040 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv20 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb10c731800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb10c731800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb10c731800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb10c731800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.872+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893485b30 con 0x55789343ced0 2024-09-19T11:13:56.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(64 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb10c731800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:56.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb10c731800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:56.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb10c731800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb10c731800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb10c731800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb10c731800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb10c731800 10 cache get: name=default.rgw.meta+users.uid+fud : hit (requested=0x13, cached=0x13) 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.873+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893488cf0 con 0x55789343ced0 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(65 fud.buckets [call] v35'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb10c731800 10 cache get: name=default.rgw.meta+root+myfoo : type miss (requested=0x13, cached=0x11) 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb10c731800 20 rados->read ofs=0 len=0 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557893487e00 con 0x7fb0f0037040 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 myfoo [call out=48b,read 0~165 out=165b,getxattrs out=75b] v0'0 uv20 ondisk = 0) ==== 233+0+288 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb10c731800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb10c731800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x13 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb10c731800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb10c731800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.874+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 8.9 8:91b71841:root::myfoo:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893488950 con 0x7fb0f0037040 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(67 myfoo [delete,create,call,call,writefull 0~165] v35'21 uv21 ondisk = 0) ==== 317+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb10c731800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb10c731800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb10c731800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93976355439424 in=350b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55789348a5c0 con 0x55789343ced0 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== watch-notify(notify (1) cookie 93976355187856 notify 150323855366 ret 0) ==== 380+0+0 (crc 0 0 0) 0x5578934850a0 con 0x55789343ced0 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fafe77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855366 cookie 93976355187856 notifier 4526 bl.length()=338 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fafe77fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x17 2024-09-19T11:13:56.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fafe77fe640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(68 notify.6 [notify cookie 93976355439424 out=8b] v0'0 uv120 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fafe77fe640 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fafcc003ea0 con 0x55789343ced0 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(69 notify.6 [notify-ack] v0'0 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.876+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== watch-notify(notify_complete (2) cookie 93976355439424 notify 150323855366 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557893419d50 con 0x55789343ced0 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.877+0000 7fafbe7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.877+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93976355185728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789347ffb0 con 0x5578934384e0 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.878+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93976355185728] v35'118 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.878+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93976355167184] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789347ffb0 con 0x7fb0f0037040 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.879+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93976355167184] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.879+0000 7fb10c731800 20 remove_watcher() i=0 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.879+0000 7fb10c731800 2 removed watcher, disabling cache 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.879+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93976355171792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789347ffb0 con 0x5578934384e0 2024-09-19T11:13:56.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.880+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93976355171792] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.880+0000 7fb10c731800 20 remove_watcher() i=1 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.880+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93976355164704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55789347ffb0 con 0x557893441830 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.881+0000 7fb0ffc75640 1 -- 172.21.15.102:0/2402645483 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93976355164704] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f0009050 con 0x557893441830 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.881+0000 7fb10c731800 20 remove_watcher() i=2 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.881+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93976355178432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893488910 con 0x7fb0f0037040 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.882+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93976355178432] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x7fb0f0037040 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.882+0000 7fb10c731800 20 remove_watcher() i=3 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.882+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93976355181840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893488910 con 0x5578934384e0 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.883+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93976355181840] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb10000a4d0 con 0x5578934384e0 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.883+0000 7fb10c731800 20 remove_watcher() i=4 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.883+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93976355184112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893488910 con 0x55789343ced0 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.884+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93976355184112] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.884+0000 7fb10c731800 20 remove_watcher() i=5 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.884+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93976355187856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893488910 con 0x55789343ced0 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.885+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93976355187856] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.885+0000 7fb10c731800 20 remove_watcher() i=6 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.885+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93976355192752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557893488910 con 0x55789343ced0 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb108476640 1 -- 172.21.15.102:0/2402645483 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93976355192752] v35'122 uv120 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb0f80bd030 con 0x55789343ced0 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 20 remove_watcher() i=7 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55789343ced0 msgr2=0x55789343f2c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55789343ced0 0x55789343f2c0 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578934384e0 msgr2=0x55789343a9a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578934384e0 0x55789343a9a0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb0f0037040 msgr2=0x7fb0f0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb0f0037040 0x7fb0f0036410 crc :-1 s=READY pgs=49 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893441830 msgr2=0x557893443cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893441830 0x557893443cf0 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafd803d000 msgr2=0x7fafd803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafd803d000 0x7fafd803f4c0 secure :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000c010 tx=0x7fb0f0010000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 msgr2=0x55789342cf70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 --2- 172.21.15.102:0/2402645483 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893425b60 0x55789342cf70 secure :-1 s=READY pgs=436 cs=0 l=1 rev1=1 crypto rx=0x7fb0f80547e0 tx=0x7fb0f806cf50 comp rx=0 tx=0).stop 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 reap_dead start 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb108c77640 1 -- 172.21.15.102:0/2402645483 reap_dead start 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 shutdown_connections 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 >> 172.21.15.102:0/2402645483 conn(0x557893421f60 msgr2=0x557893420170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 shutdown_connections 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.886+0000 7fb10c731800 1 -- 172.21.15.102:0/2402645483 wait complete. 2024-09-19T11:13:56.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/1327820387 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafe003cfb0 msgr2=0x7fafe003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/1327820387 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafe003cfb0 0x7fafe003f470 secure :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0x7fb0f000bf40 tx=0x7fb0f000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/1327820387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578934192f0 msgr2=0x557893419710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/1327820387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578934192f0 0x557893419710 secure :-1 s=READY pgs=434 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8096a30 tx=0x7fb0f807d530 comp rx=0 tx=0).stop 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/1327820387 shutdown_connections 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/1327820387 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fafe003cfb0 0x7fafe003f470 unknown :-1 s=CLOSED pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/1327820387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5578934192f0 0x557893419710 unknown :-1 s=CLOSED pgs=434 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/1327820387 >> 172.21.15.102:0/1327820387 conn(0x55789340d6a0 msgr2=0x55789340da80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/1327820387 shutdown_connections 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/1327820387 wait complete. 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557893404a20 msgr2=0x557893406e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557893404a20 0x557893406e90 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578933048c0 msgr2=0x557893402600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5578933048c0 0x557893402600 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893408a80 msgr2=0x55789340ae70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557893408a80 0x55789340ae70 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faff003cfb0 msgr2=0x7faff003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faff003cfb0 0x7faff003f470 secure :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0x7fb0f0001d70 tx=0x7fb0f00012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 msgr2=0x5578933fafb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 --2- 172.21.15.102:0/2673667125 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557893301f30 0x5578933fafb0 secure :-1 s=READY pgs=433 cs=0 l=1 rev1=1 crypto rx=0x7fb0f8045f50 tx=0x7fb0f8002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb108c77640 1 -- 172.21.15.102:0/2673667125 reap_dead start 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 shutdown_connections 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 >> 172.21.15.102:0/2673667125 conn(0x5578932fba70 msgr2=0x5578933ec810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 shutdown_connections 2024-09-19T11:13:56.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.887+0000 7fb10c731800 1 -- 172.21.15.102:0/2673667125 wait complete. 2024-09-19T11:13:56.902 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1'] 2024-09-19T11:13:56.902 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--uid', 'foo', '--bucket', 'myfoo', '--bucket-id', '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1'] 2024-09-19T11:13:56.903 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --uid foo --bucket myfoo --bucket-id 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:56.951 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:56.952 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:56.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.951+0000 7f1498932800 1 Processor -- start 2024-09-19T11:13:56.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.951+0000 7f1498932800 1 -- start start 2024-09-19T11:13:56.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.951+0000 7f1498932800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c93ff32890 0x55c93ff3b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.951+0000 7f1498932800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c93ff3b8f0 con 0x55c93ff30d70 2024-09-19T11:13:56.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.951+0000 7f1498932800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55c93fdbd7d0 con 0x55c93ff32890 2024-09-19T11:13:56.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.952+0000 7f1493eaf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c93ff32890 0x55c93ff3b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.952+0000 7f1493eaf640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c93ff32890 0x55c93ff3b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44346/0 (socket says 172.21.15.102:44346) 2024-09-19T11:13:56.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.952+0000 7f1493eaf640 1 -- 172.21.15.102:0/451258256 learned_addr learned my addr 172.21.15.102:0/451258256 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.952+0000 7f14946b0640 1 --1- 172.21.15.102:0/451258256 >> v1:172.21.15.37:6789/0 conn(0x55c93ff30d70 0x55c93ff31170 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52538/0 (socket says 172.21.15.102:52538) 2024-09-19T11:13:56.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.952+0000 7f1493eaf640 1 -- 172.21.15.102:0/451258256 >> v1:172.21.15.37:6789/0 conn(0x55c93ff30d70 legacy=0x55c93ff31170 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.952+0000 7f1493eaf640 1 -- 172.21.15.102:0/451258256 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c93ff3cad0 con 0x55c93ff32890 2024-09-19T11:13:56.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.952+0000 7f14936ae640 1 -- 172.21.15.102:0/451258256 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4033875940 0 0) 0x55c93ff3b8f0 con 0x55c93ff30d70 2024-09-19T11:13:56.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f1493eaf640 1 --2- 172.21.15.102:0/451258256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 0x55c93ff3b3b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f148800a520 tx=0x7f1488045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b0ebe4c7da453c7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f14936ae640 1 -- 172.21.15.102:0/451258256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1488055070 con 0x55c93ff32890 2024-09-19T11:13:56.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f14936ae640 1 -- 172.21.15.102:0/451258256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f14880515b0 con 0x55c93ff32890 2024-09-19T11:13:56.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f14936ae640 1 -- 172.21.15.102:0/451258256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14880518d0 con 0x55c93ff32890 2024-09-19T11:13:56.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f1498932800 1 -- 172.21.15.102:0/451258256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 msgr2=0x55c93ff3b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f1498932800 1 --2- 172.21.15.102:0/451258256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 0x55c93ff3b3b0 secure :-1 s=READY pgs=438 cs=0 l=1 rev1=1 crypto rx=0x7f148800a520 tx=0x7f1488045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f1498932800 1 -- 172.21.15.102:0/451258256 shutdown_connections 2024-09-19T11:13:56.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f1498932800 1 --2- 172.21.15.102:0/451258256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 0x55c93ff3b3b0 unknown :-1 s=CLOSED pgs=438 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f1498932800 1 -- 172.21.15.102:0/451258256 >> 172.21.15.102:0/451258256 conn(0x55c93ff2ca80 msgr2=0x55c93ff2eee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f1498932800 1 -- 172.21.15.102:0/451258256 shutdown_connections 2024-09-19T11:13:56.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.954+0000 7f1498932800 1 -- 172.21.15.102:0/451258256 wait complete. 2024-09-19T11:13:56.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.968+0000 7f1498932800 1 Processor -- start 2024-09-19T11:13:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.968+0000 7f1498932800 1 -- start start 2024-09-19T11:13:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.968+0000 7f1498932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff30d70 0x55c940024430 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.968+0000 7f1498932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c93fdcadd0 con 0x55c93ff30d70 2024-09-19T11:13:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.969+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff30d70 0x55c940024430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.969+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff30d70 0x55c940024430 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44356/0 (socket says 172.21.15.102:44356) 2024-09-19T11:13:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.969+0000 7f14946b0640 1 -- 172.21.15.102:0/2973012567 learned_addr learned my addr 172.21.15.102:0/2973012567 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.969+0000 7f14946b0640 1 -- 172.21.15.102:0/2973012567 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c940024a20 con 0x55c93ff30d70 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.969+0000 7f14946b0640 1 --2- 172.21.15.102:0/2973012567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff30d70 0x55c940024430 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1484001ea0 tx=0x7f148400b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be2ee7af7a209780 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.969+0000 7f138260c640 1 -- 172.21.15.102:0/2973012567 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1484008070 con 0x55c93ff30d70 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.969+0000 7f138260c640 1 -- 172.21.15.102:0/2973012567 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f148400d500 con 0x55c93ff30d70 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.969+0000 7f138260c640 1 -- 172.21.15.102:0/2973012567 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f148400d880 con 0x55c93ff30d70 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.970+0000 7f1498932800 1 -- 172.21.15.102:0/2973012567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff30d70 msgr2=0x55c940024430 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.970+0000 7f1498932800 1 --2- 172.21.15.102:0/2973012567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff30d70 0x55c940024430 secure :-1 s=READY pgs=439 cs=0 l=1 rev1=1 crypto rx=0x7f1484001ea0 tx=0x7f148400b6a0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.970+0000 7f1498932800 1 -- 172.21.15.102:0/2973012567 shutdown_connections 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.970+0000 7f1498932800 1 --2- 172.21.15.102:0/2973012567 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff30d70 0x55c940024430 unknown :-1 s=CLOSED pgs=439 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.970+0000 7f1498932800 1 -- 172.21.15.102:0/2973012567 >> 172.21.15.102:0/2973012567 conn(0x55c93ff2ca80 msgr2=0x55c94001fdb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.970+0000 7f1498932800 1 -- 172.21.15.102:0/2973012567 shutdown_connections 2024-09-19T11:13:56.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.970+0000 7f1498932800 1 -- 172.21.15.102:0/2973012567 wait complete. 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.970+0000 7f1498932800 1 Processor -- start 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f1498932800 1 -- start start 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f1498932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 0x55c94002c1b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f1498932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c93ff3bdc0 con 0x55c93ff32890 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 0x55c94002c1b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 0x55c94002c1b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44368/0 (socket says 172.21.15.102:44368) 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f14946b0640 1 -- 172.21.15.102:0/523638074 learned_addr learned my addr 172.21.15.102:0/523638074 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f14946b0640 1 -- 172.21.15.102:0/523638074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94002c710 con 0x55c93ff32890 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f14946b0640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 0x55c94002c1b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55c9400253c0 tx=0x7f1484000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f1380e09640 1 -- 172.21.15.102:0/523638074 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f148400de50 con 0x55c93ff32890 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f1380e09640 1 -- 172.21.15.102:0/523638074 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f148400f830 con 0x55c93ff32890 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f1380e09640 1 -- 172.21.15.102:0/523638074 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f148400fb10 con 0x55c93ff32890 2024-09-19T11:13:56.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c94002c9a0 con 0x55c93ff32890 2024-09-19T11:13:56.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.971+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c94002d3a0 con 0x55c93ff32890 2024-09-19T11:13:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.972+0000 7f1380e09640 1 -- 172.21.15.102:0/523638074 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1484017040 con 0x55c93ff32890 2024-09-19T11:13:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.972+0000 7f1380e09640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f137c03d150 0x7f137c03f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1380e09640 1 -- 172.21.15.102:0/523638074 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1484015020 con 0x55c93ff32890 2024-09-19T11:13:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1493eaf640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f137c03d150 0x7f137c03f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1498932800 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c94002dea0 0x55c940033800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c940033de0 con 0x55c94002dea0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1494eb1640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c94002dea0 0x55c940033800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1493eaf640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f137c03d150 0x7f137c03f610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1488057000 tx=0x7f1488052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1494eb1640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c94002dea0 0x55c940033800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1494eb1640 1 -- 172.21.15.102:0/523638074 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c94002dea0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.973+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c94002d850 con 0x55c94002dea0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.974+0000 7f1494eb1640 1 -- 172.21.15.102:0/523638074 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c94002dea0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.974+0000 7f1498932800 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c940036130 0x55c940038520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.974+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c940038bf0 con 0x55c940036130 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.974+0000 7f14946b0640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c940036130 0x55c940038520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.974+0000 7f14946b0640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c940036130 0x55c940038520 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.974+0000 7f14946b0640 1 -- 172.21.15.102:0/523638074 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f148402d070 con 0x55c940036130 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.974+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c940034fd0 con 0x55c94002dea0 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.975+0000 7f1494eb1640 1 -- 172.21.15.102:0/523638074 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c94002dea0 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.975+0000 7f1498932800 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c94003a030 0x55c94003c420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.975+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c94003cb60 con 0x55c94003a030 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.975+0000 7f1493eaf640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c94003a030 0x55c94003c420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.975+0000 7f1493eaf640 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c94003a030 0x55c94003c420 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.975+0000 7f1493eaf640 1 -- 172.21.15.102:0/523638074 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f1488057030 con 0x55c94003a030 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.976+0000 7f1498932800 1 Processor -- start 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.976+0000 7f1498932800 1 -- start start 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.976+0000 7f1498932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c94004a8e0 0x55c94004ad00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.976+0000 7f1498932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c93fe294a0 con 0x55c94004a8e0 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.976+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c94004a8e0 0x55c94004ad00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.976+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c94004a8e0 0x55c94004ad00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44382/0 (socket says 172.21.15.102:44382) 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.976+0000 7f14946b0640 1 -- 172.21.15.102:0/2854262183 learned_addr learned my addr 172.21.15.102:0/2854262183 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.976+0000 7f14946b0640 1 -- 172.21.15.102:0/2854262183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94004b340 con 0x55c94004a8e0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.977+0000 7f14946b0640 1 --2- 172.21.15.102:0/2854262183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c94004a8e0 0x55c94004ad00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f148400fd40 tx=0x7f14840187a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.977+0000 7f1379ffb640 1 -- 172.21.15.102:0/2854262183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f148401a8c0 con 0x55c94004a8e0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.977+0000 7f1379ffb640 1 -- 172.21.15.102:0/2854262183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f148404be40 con 0x55c94004a8e0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.977+0000 7f1498932800 1 -- 172.21.15.102:0/2854262183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c94004bb70 con 0x55c94004a8e0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.977+0000 7f1379ffb640 1 -- 172.21.15.102:0/2854262183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f148404c120 con 0x55c94004a8e0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.977+0000 7f1498932800 1 -- 172.21.15.102:0/2854262183 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c94004c110 con 0x55c94004a8e0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.977+0000 7f1379ffb640 1 -- 172.21.15.102:0/2854262183 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f148404c2c0 con 0x55c94004a8e0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.978+0000 7f1379ffb640 1 --2- 172.21.15.102:0/2854262183 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136c03d000 0x7f136c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.978+0000 7f1379ffb640 1 -- 172.21.15.102:0/2854262183 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f1484041040 con 0x55c94004a8e0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.978+0000 7f1493eaf640 1 --2- 172.21.15.102:0/2854262183 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136c03d000 0x7f136c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.978+0000 7f1498932800 1 Processor -- start 2024-09-19T11:13:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.978+0000 7f1498932800 1 -- start start 2024-09-19T11:13:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.978+0000 7f1493eaf640 1 --2- 172.21.15.102:0/2854262183 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136c03d000 0x7f136c03f4c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55c9400342b0 tx=0x7f1488005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.978+0000 7f1498932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c940057750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.978+0000 7f1498932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c940024e50 con 0x55c940057350 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.979+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c940057750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.979+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c940057750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44396/0 (socket says 172.21.15.102:44396) 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.979+0000 7f14946b0640 1 -- 172.21.15.102:0/2352415499 learned_addr learned my addr 172.21.15.102:0/2352415499 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.979+0000 7f14946b0640 1 -- 172.21.15.102:0/2352415499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c940057d40 con 0x55c940057350 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.979+0000 7f14946b0640 1 --2- 172.21.15.102:0/2352415499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c940057750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f14840197d0 tx=0x7f148403c030 comp rx=0 tx=0).ready entity=mon.0 client_cookie=489bc72533f0d0c5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.979+0000 7f13737fe640 1 -- 172.21.15.102:0/2352415499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1484039c10 con 0x55c940057350 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.979+0000 7f13737fe640 1 -- 172.21.15.102:0/2352415499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1484039db0 con 0x55c940057350 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.979+0000 7f13737fe640 1 -- 172.21.15.102:0/2352415499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1484026560 con 0x55c940057350 2024-09-19T11:13:56.998 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 -- 172.21.15.102:0/2352415499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 msgr2=0x55c940057750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 --2- 172.21.15.102:0/2352415499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c940057750 secure :-1 s=READY pgs=442 cs=0 l=1 rev1=1 crypto rx=0x7f14840197d0 tx=0x7f148403c030 comp rx=0 tx=0).stop 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 -- 172.21.15.102:0/2352415499 shutdown_connections 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 --2- 172.21.15.102:0/2352415499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c940057750 unknown :-1 s=CLOSED pgs=442 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 -- 172.21.15.102:0/2352415499 >> 172.21.15.102:0/2352415499 conn(0x55c940053750 msgr2=0x55c940051990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 -- 172.21.15.102:0/2352415499 shutdown_connections 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 -- 172.21.15.102:0/2352415499 wait complete. 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 Processor -- start 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 -- start start 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c94005e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f1498932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c9400581b0 con 0x55c940057350 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c94005e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:56.999 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f14946b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c94005e7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44400/0 (socket says 172.21.15.102:44400) 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.980+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 learned_addr learned my addr 172.21.15.102:0/3322746093 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.981+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c94005ed10 con 0x55c940057350 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.981+0000 7f14946b0640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c94005e7b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f148404bac0 tx=0x7f148403bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.981+0000 7f1371ffb640 1 -- 172.21.15.102:0/3322746093 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f14840268b0 con 0x55c940057350 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.981+0000 7f1371ffb640 1 -- 172.21.15.102:0/3322746093 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1484026a70 con 0x55c940057350 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.981+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c94005ed10 con 0x55c940057350 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.981+0000 7f1371ffb640 1 -- 172.21.15.102:0/3322746093 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1484026dd0 con 0x55c940057350 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.981+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c94005f310 con 0x55c940057350 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.982+0000 7f1371ffb640 1 -- 172.21.15.102:0/3322746093 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1484053870 con 0x55c940057350 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.982+0000 7f1371ffb640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136403cf60 0x7f136403f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.982+0000 7f1371ffb640 1 -- 172.21.15.102:0/3322746093 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f148405b030 con 0x55c940057350 2024-09-19T11:13:57.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.982+0000 7f1493eaf640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136403cf60 0x7f136403f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.982+0000 7f1493eaf640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136403cf60 0x7f136403f420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1488045be0 tx=0x7f1488053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c940069d40 0x55c94006c200 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c94006c950 con 0x55c940069d40 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1494eb1640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c940069d40 0x55c94006c200 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1494eb1640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c940069d40 0x55c94006c200 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 20 realm 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c94006cd60 con 0x55c940069d40 2024-09-19T11:13:57.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.983+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d630 con 0x55c940069d40 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1498932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1498932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c94006e730 0x55c940070b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400710e0 con 0x55c94006e730 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.984+0000 7f14946b0640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c94006e730 0x55c940070b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.985+0000 7f14946b0640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c94006e730 0x55c940070b20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.985+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.985+0000 7f1498932800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.985+0000 7f1498932800 20 searching for the correct realm 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.985+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c940073090 0x55c940075550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.985+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c940075c20 con 0x55c940073090 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.985+0000 7f1493eaf640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c940073090 0x55c940075550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.985+0000 7f1493eaf640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c940073090 0x55c940075550 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.986+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.986+0000 7f1493eaf640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1488069040 0x7f14880769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.986+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c940075c20 con 0x7f1488069040 2024-09-19T11:13:57.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.986+0000 7f1494eb1640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1488069040 0x7f14880769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.986+0000 7f1494eb1640 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1488069040 0x7f14880769a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.986+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.986+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.987+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.987+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.987+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.987+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.987+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.987+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.987+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.987+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.988+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.988+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x7f1488069040 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.988+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.988+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940073090 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.988+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.988+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.988+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.988+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x7f1488069040 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940073090 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940073090 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.989+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.990+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.990+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940073090 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.990+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.990+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940073090 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.990+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.990+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.990+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.990+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.991+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.991+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.991+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.991+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940073090 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.991+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.991+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x7f1488069040 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.991+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.991+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.992+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.992+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.992+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.992+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940073090 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.992+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.992+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.992+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.992+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x7f1488069040 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.993+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.993+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940073090 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.993+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.993+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c94006e730 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.993+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.993+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x55c940069d40 2024-09-19T11:13:57.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55c94006d9d0 con 0x7f1488069040 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400719a0 con 0x55c940069d40 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400719a0 con 0x55c940069d40 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.994+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400719a0 con 0x55c940073090 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 zone default found 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 4 Realm: () 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:57.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 zonegroup default 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c940072290 con 0x55c94006e730 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c940077b90 con 0x55c940073090 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c940077fa0 con 0x55c940073090 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.995+0000 7f1498932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.996+0000 7f1498932800 20 started sync module instance, tier type = 2024-09-19T11:13:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.996+0000 7f1498932800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.996+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c940076f30 con 0x7f1488069040 2024-09-19T11:13:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.996+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.996+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94322851017776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c940076f30 con 0x7f1488069040 2024-09-19T11:13:57.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.997+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c940078ab0 con 0x55c940069d40 2024-09-19T11:13:57.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.997+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94322851017776] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.998+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.998+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94322851022240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c940076f30 con 0x55c940069d40 2024-09-19T11:13:57.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.998+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c940079530 con 0x55c940073090 2024-09-19T11:13:57.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.999+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94322851022240] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.999+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.999+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94322851015296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c940076ea0 con 0x55c940073090 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:56.999+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007a420 con 0x7f1488069040 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.000+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.000+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94322851015296] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.000+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94322851029328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007a810 con 0x7f1488069040 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.000+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007b1d0 con 0x55c940069d40 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.001+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.001+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94322851032352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007b140 con 0x55c940069d40 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.001+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007c130 con 0x55c94006e730 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.001+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94322851029328] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.002+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94322851032352] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.002+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.002+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94322851034608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007bc10 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.002+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007c9d0 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.003+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94322851034608] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.003+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.003+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94322851027280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007d220 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.004+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007daf0 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.004+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94322851027280] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.004+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'123 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.004+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94322851042752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007dd70 con 0x55c94006e730 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 20 add_watcher() i=0 2024-09-19T11:13:57.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 20 add_watcher() i=1 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 20 add_watcher() i=2 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 20 add_watcher() i=3 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 20 add_watcher() i=4 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 20 add_watcher() i=5 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 20 add_watcher() i=6 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94322851042752] v35'124 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 20 add_watcher() i=7 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.005+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400812b0 con 0x55c940069d40 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.006+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.006+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94322851040624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c94007e800 con 0x55c940069d40 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.007+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94322851040624] v35'119 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.007+0000 7f134a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.007+0000 7f1498932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.007+0000 7f1498932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.007+0000 7f1498932800 5 note: GC not initialized 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.007+0000 7f13497e2640 20 reqs_thread_entry: start 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.007+0000 7f1498932800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.007+0000 7f1498932800 20 Filter name: none 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f12baffd640 20 reqs_thread_entry: start 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b4190 con 0x55c940069d40 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:57.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b6120 con 0x7f1488069040 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv21 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.008+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b79d0 con 0x55c94006e730 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv2 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f1498932800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f1498932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f1498932800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f1498932800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f1498932800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f1498932800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f1498932800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.009+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400bbc90 con 0x55c94006e730 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.010+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(65 fud.buckets [call] v35'3 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.010+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400c19f0 con 0x55c94006e730 2024-09-19T11:13:57.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.011+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(66 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'3 uv3 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.011+0000 7f1498932800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.011+0000 7f1498932800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.011+0000 7f1498932800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.011+0000 7f1498932800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1, ofs0, ns] 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.011+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94322851281136 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400bc0c0 con 0x55c94006e730 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.011+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== watch-notify(notify (1) cookie 94322851027280 notify 150323855367 ret 0) ==== 802+0+0 (crc 0 0 0) 0x55c9400b6f10 con 0x55c94006e730 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f13737fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855367 cookie 94322851027280 notifier 4533 bl.length()=760 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f13737fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f13737fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f13737fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(67 notify.6 [notify cookie 94322851281136 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f13737fe640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f1358003ea0 con 0x55c94006e730 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== watch-notify(notify_complete (2) cookie 94322851281136 notify 150323855367 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c94004bb70 con 0x55c94006e730 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f1498932800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_sources= new_sources= 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f1498932800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential sources added=[] removed=[] 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f1498932800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_dests= new_dests= 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f1498932800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential dests added=[] removed=[] 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.012+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b78f0 con 0x7f1488069040 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.013+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(69 foo.buckets [call] v35'22 uv22 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.013+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b78f0 con 0x7f1488069040 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'23 uv23 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1498932800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1498932800 10 moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:57.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1498932800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94322851281136 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55c9400c0860 con 0x55c94006e730 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== watch-notify(notify (1) cookie 94322851027280 notify 150323855368 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55c94004b340 con 0x55c94006e730 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1372ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855368 cookie 94322851027280 notifier 4533 bl.length()=314 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1372ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1372ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(71 notify.6 [notify cookie 94322851281136 out=8b] v0'0 uv123 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f1372ffd640 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f12c8003400 con 0x55c94006e730 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.014+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.015+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== watch-notify(notify_complete (2) cookie 94322851281136 notify 150323855368 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55c94002d3a0 con 0x55c94006e730 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.015+0000 7f134a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.015+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:73 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94322851040624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x55c940069d40 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.016+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(73 data_loggenerations_metadata [watch unwatch cookie 94322851040624] v35'120 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.016+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94322851017776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x7f1488069040 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.017+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 notify.0 [watch unwatch cookie 94322851017776] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.017+0000 7f1498932800 20 remove_watcher() i=0 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.017+0000 7f1498932800 2 removed watcher, disabling cache 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.017+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94322851022240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x55c940069d40 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.018+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(75 notify.1 [watch unwatch cookie 94322851022240] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.018+0000 7f1498932800 20 remove_watcher() i=1 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.018+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:76 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94322851015296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x55c940073090 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.019+0000 7f1493eaf640 1 -- 172.21.15.102:0/3322746093 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(76 notify.2 [watch unwatch cookie 94322851015296] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1488057030 con 0x55c940073090 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.019+0000 7f1498932800 20 remove_watcher() i=2 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.019+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:77 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94322851029328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x7f1488069040 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.020+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(77 notify.3 [watch unwatch cookie 94322851029328] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x7f1488069040 2024-09-19T11:13:57.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.020+0000 7f1498932800 20 remove_watcher() i=3 2024-09-19T11:13:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.020+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:78 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94322851032352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x55c940069d40 2024-09-19T11:13:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.021+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(78 notify.4 [watch unwatch cookie 94322851032352] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f148c00a4d0 con 0x55c940069d40 2024-09-19T11:13:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.021+0000 7f1498932800 20 remove_watcher() i=4 2024-09-19T11:13:57.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.021+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:79 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94322851034608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x55c94006e730 2024-09-19T11:13:57.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.022+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(79 notify.5 [watch unwatch cookie 94322851034608] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.022+0000 7f1498932800 20 remove_watcher() i=5 2024-09-19T11:13:57.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.022+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:80 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94322851027280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x55c94006e730 2024-09-19T11:13:57.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.023+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(80 notify.6 [watch unwatch cookie 94322851027280] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.023+0000 7f1498932800 20 remove_watcher() i=6 2024-09-19T11:13:57.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.023+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:81 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94322851042752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55c9400b2030 con 0x55c94006e730 2024-09-19T11:13:57.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f14946b0640 1 -- 172.21.15.102:0/3322746093 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(81 notify.7 [watch unwatch cookie 94322851042752] v35'125 uv123 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f1484044070 con 0x55c94006e730 2024-09-19T11:13:57.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 20 remove_watcher() i=7 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c94006e730 msgr2=0x55c940070b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c94006e730 0x55c940070b20 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c940069d40 msgr2=0x55c94006c200 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c940069d40 0x55c94006c200 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1488069040 msgr2=0x7f14880769a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f1488069040 0x7f14880769a0 crc :-1 s=READY pgs=50 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c940073090 msgr2=0x55c940075550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c940073090 0x55c940075550 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136403cf60 msgr2=0x7f136403f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136403cf60 0x7f136403f420 secure :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0x7f1488045be0 tx=0x7f1488053000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 msgr2=0x55c94005e7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1494eb1640 1 -- 172.21.15.102:0/3322746093 reap_dead start 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c94005e7b0 secure :-1 s=READY pgs=443 cs=0 l=1 rev1=1 crypto rx=0x7f148404bac0 tx=0x7f148403bdc0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 shutdown_connections 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 --2- 172.21.15.102:0/3322746093 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c940057350 0x55c94005e7b0 unknown :-1 s=CLOSED pgs=443 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.024+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 >> 172.21.15.102:0/3322746093 conn(0x55c940053750 msgr2=0x55c940051960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 shutdown_connections 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/3322746093 wait complete. 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/2854262183 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136c03d000 msgr2=0x7f136c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/2854262183 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136c03d000 0x7f136c03f4c0 secure :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0x55c9400342b0 tx=0x7f1488005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/2854262183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c94004a8e0 msgr2=0x55c94004ad00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/2854262183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c94004a8e0 0x55c94004ad00 secure :-1 s=READY pgs=441 cs=0 l=1 rev1=1 crypto rx=0x7f148400fd40 tx=0x7f14840187a0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/2854262183 shutdown_connections 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/2854262183 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f136c03d000 0x7f136c03f4c0 unknown :-1 s=CLOSED pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/2854262183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c94004a8e0 0x55c94004ad00 unknown :-1 s=CLOSED pgs=441 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/2854262183 >> 172.21.15.102:0/2854262183 conn(0x55c94003ec90 msgr2=0x55c94003f070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/2854262183 shutdown_connections 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/2854262183 wait complete. 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c940036130 msgr2=0x55c940038520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c940036130 0x55c940038520 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c94002dea0 msgr2=0x55c940033800 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c94002dea0 0x55c940033800 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c94003a030 msgr2=0x55c94003c420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c94003a030 0x55c94003c420 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f137c03d150 msgr2=0x7f137c03f610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f137c03d150 0x7f137c03f610 secure :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0x7f1488057000 tx=0x7f1488052000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 msgr2=0x55c94002c1b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 --2- 172.21.15.102:0/523638074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c93ff32890 0x55c94002c1b0 secure :-1 s=READY pgs=440 cs=0 l=1 rev1=1 crypto rx=0x55c9400253c0 tx=0x7f1484000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1494eb1640 1 -- 172.21.15.102:0/523638074 reap_dead start 2024-09-19T11:13:57.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 shutdown_connections 2024-09-19T11:13:57.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 >> 172.21.15.102:0/523638074 conn(0x55c93ff2ca80 msgr2=0x55c9400259a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 shutdown_connections 2024-09-19T11:13:57.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.025+0000 7f1498932800 1 -- 172.21.15.102:0/523638074 wait complete. 2024-09-19T11:13:57.041 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud'] 2024-09-19T11:13:57.041 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud'] 2024-09-19T11:13:57.042 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud 2024-09-19T11:13:57.085 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:57.086 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:57.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.085+0000 7f3225f0c800 1 Processor -- start 2024-09-19T11:13:57.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.085+0000 7f3225f0c800 1 -- start start 2024-09-19T11:13:57.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.085+0000 7f3225f0c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x561a541eba90 0x561a541edf50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.085+0000 7f3225f0c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561a541ee5d0 con 0x561a541e7f20 2024-09-19T11:13:57.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.085+0000 7f3225f0c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x561a540727d0 con 0x561a541eba90 2024-09-19T11:13:57.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.086+0000 7f321b1f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x561a541eba90 0x561a541edf50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.086+0000 7f321b1f5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x561a541eba90 0x561a541edf50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44410/0 (socket says 172.21.15.102:44410) 2024-09-19T11:13:57.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.086+0000 7f32239f6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x561a541e7f20 0x561a541ea310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52548/0 (socket says 172.21.15.102:52548) 2024-09-19T11:13:57.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.086+0000 7f321b1f5640 1 -- 172.21.15.102:0/2266349377 learned_addr learned my addr 172.21.15.102:0/2266349377 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.086+0000 7f321b1f5640 1 -- 172.21.15.102:0/2266349377 >> v1:172.21.15.37:6789/0 conn(0x561a541e7f20 legacy=0x561a541ea310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.086+0000 7f321b1f5640 1 -- 172.21.15.102:0/2266349377 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a541ef800 con 0x561a541eba90 2024-09-19T11:13:57.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2266349377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541eba90 0x561a541edf50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f320c00a520 tx=0x7f320c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a328ac1cf9d6c8b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f32231f5640 1 -- 172.21.15.102:0/2266349377 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320c055070 con 0x561a541eba90 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f32231f5640 1 -- 172.21.15.102:0/2266349377 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f320c0515b0 con 0x561a541eba90 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f32231f5640 1 -- 172.21.15.102:0/2266349377 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f320c0518d0 con 0x561a541eba90 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f3225f0c800 1 -- 172.21.15.102:0/2266349377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541eba90 msgr2=0x561a541edf50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2266349377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541eba90 0x561a541edf50 secure :-1 s=READY pgs=445 cs=0 l=1 rev1=1 crypto rx=0x7f320c00a520 tx=0x7f320c045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f3225f0c800 1 -- 172.21.15.102:0/2266349377 shutdown_connections 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2266349377 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541eba90 0x561a541edf50 unknown :-1 s=CLOSED pgs=445 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.088+0000 7f3225f0c800 1 -- 172.21.15.102:0/2266349377 >> 172.21.15.102:0/2266349377 conn(0x561a541e1a60 msgr2=0x561a541e3ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.089+0000 7f3225f0c800 1 -- 172.21.15.102:0/2266349377 shutdown_connections 2024-09-19T11:13:57.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.089+0000 7f3225f0c800 1 -- 172.21.15.102:0/2266349377 wait complete. 2024-09-19T11:13:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.102+0000 7f3225f0c800 1 Processor -- start 2024-09-19T11:13:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.102+0000 7f3225f0c800 1 -- start start 2024-09-19T11:13:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.102+0000 7f3225f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a541e7690 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.102+0000 7f3225f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a5407fdd0 con 0x561a541e7f20 2024-09-19T11:13:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.102+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a541e7690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.102+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a541e7690 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44418/0 (socket says 172.21.15.102:44418) 2024-09-19T11:13:57.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.102+0000 7f32239f6640 1 -- 172.21.15.102:0/1510512486 learned_addr learned my addr 172.21.15.102:0/1510512486 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.103+0000 7f32239f6640 1 -- 172.21.15.102:0/1510512486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a541e7c80 con 0x561a541e7f20 2024-09-19T11:13:57.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.103+0000 7f32239f6640 1 --2- 172.21.15.102:0/1510512486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a541e7690 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3214001eb0 tx=0x7f321400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5aed2c4da63c1c6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.103+0000 7f3111e0b640 1 -- 172.21.15.102:0/1510512486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f321400e5c0 con 0x561a541e7f20 2024-09-19T11:13:57.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.103+0000 7f3111e0b640 1 -- 172.21.15.102:0/1510512486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3214006070 con 0x561a541e7f20 2024-09-19T11:13:57.105 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.103+0000 7f3111e0b640 1 -- 172.21.15.102:0/1510512486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f321400e8b0 con 0x561a541e7f20 2024-09-19T11:13:57.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 -- 172.21.15.102:0/1510512486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 msgr2=0x561a541e7690 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 --2- 172.21.15.102:0/1510512486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a541e7690 secure :-1 s=READY pgs=446 cs=0 l=1 rev1=1 crypto rx=0x7f3214001eb0 tx=0x7f321400b6c0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 -- 172.21.15.102:0/1510512486 shutdown_connections 2024-09-19T11:13:57.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 --2- 172.21.15.102:0/1510512486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a541e7690 unknown :-1 s=CLOSED pgs=446 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 -- 172.21.15.102:0/1510512486 >> 172.21.15.102:0/1510512486 conn(0x561a541e1a60 msgr2=0x561a542d2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 -- 172.21.15.102:0/1510512486 shutdown_connections 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 -- 172.21.15.102:0/1510512486 wait complete. 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 Processor -- start 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 -- start start 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a542e1010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f3225f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a541eeaa0 con 0x561a541e7f20 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a542e1010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a542e1010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44432/0 (socket says 172.21.15.102:44432) 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f32239f6640 1 -- 172.21.15.102:0/2330397952 learned_addr learned my addr 172.21.15.102:0/2330397952 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.104+0000 7f32239f6640 1 -- 172.21.15.102:0/2330397952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a542e1570 con 0x561a541e7f20 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.105+0000 7f32239f6640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a542e1010 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f321400b700 tx=0x7f3214000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.105+0000 7f310bfff640 1 -- 172.21.15.102:0/2330397952 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f321401a7c0 con 0x561a541e7f20 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.105+0000 7f310bfff640 1 -- 172.21.15.102:0/2330397952 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321401a960 con 0x561a541e7f20 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.105+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a542e1860 con 0x561a541e7f20 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.105+0000 7f310bfff640 1 -- 172.21.15.102:0/2330397952 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f321401acc0 con 0x561a541e7f20 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.105+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a542e2410 con 0x561a541e7f20 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.106+0000 7f310bfff640 1 -- 172.21.15.102:0/2330397952 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3214017070 con 0x561a541e7f20 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.106+0000 7f310bfff640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f310c03d000 0x7f310c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.106+0000 7f310bfff640 1 -- 172.21.15.102:0/2330397952 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3214015020 con 0x561a541e7f20 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.106+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f310c03d000 0x7f310c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.106+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a541eba90 0x561a542e8660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.106+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a542e8ba0 con 0x561a541eba90 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.106+0000 7f32241f7640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a541eba90 0x561a542e8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.106+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f310c03d000 0x7f310c03f4c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f320c057000 tx=0x7f320c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.110 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.107+0000 7f32241f7640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a541eba90 0x561a542e8660 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.107+0000 7f32241f7640 1 -- 172.21.15.102:0/2330397952 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a541eba90 2024-09-19T11:13:57.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.107+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a542e8f40 con 0x561a541eba90 2024-09-19T11:13:57.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.107+0000 7f32241f7640 1 -- 172.21.15.102:0/2330397952 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a541eba90 2024-09-19T11:13:57.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.107+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a542eacb0 0x561a542ed0a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.107+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a542ed6f0 con 0x561a542eacb0 2024-09-19T11:13:57.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.107+0000 7f32239f6640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a542eacb0 0x561a542ed0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.108+0000 7f32239f6640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a542eacb0 0x561a542ed0a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.108+0000 7f32239f6640 1 -- 172.21.15.102:0/2330397952 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3214054040 con 0x561a542eacb0 2024-09-19T11:13:57.121 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.108+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a542e9b50 con 0x561a541eba90 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.108+0000 7f32241f7640 1 -- 172.21.15.102:0/2330397952 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a541eba90 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.108+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a542eeb50 0x561a542f0f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.108+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a542f1680 con 0x561a542eeb50 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.109+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a542eeb50 0x561a542f0f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.109+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a542eeb50 0x561a542f0f40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.109+0000 7f321b1f5640 1 -- 172.21.15.102:0/2330397952 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f320c057030 con 0x561a542eeb50 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.109+0000 7f3225f0c800 1 Processor -- start 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.109+0000 7f3225f0c800 1 -- start start 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f3225f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a542ff3e0 0x561a542ff800 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f3225f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a540de4a0 con 0x561a542ff3e0 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a542ff3e0 0x561a542ff800 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a542ff3e0 0x561a542ff800 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44438/0 (socket says 172.21.15.102:44438) 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f32239f6640 1 -- 172.21.15.102:0/3881689127 learned_addr learned my addr 172.21.15.102:0/3881689127 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.122 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f32239f6640 1 -- 172.21.15.102:0/3881689127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a542ffe40 con 0x561a542ff3e0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f32239f6640 1 --2- 172.21.15.102:0/3881689127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a542ff3e0 0x561a542ff800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f32140017f0 tx=0x7f3214017f40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f31097fa640 1 -- 172.21.15.102:0/3881689127 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3214019990 con 0x561a542ff3e0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f31097fa640 1 -- 172.21.15.102:0/3881689127 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3214019b30 con 0x561a542ff3e0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f3225f0c800 1 -- 172.21.15.102:0/3881689127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a54300670 con 0x561a542ff3e0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f31097fa640 1 -- 172.21.15.102:0/3881689127 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f321404bf80 con 0x561a542ff3e0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.110+0000 7f3225f0c800 1 -- 172.21.15.102:0/3881689127 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a54300c10 con 0x561a542ff3e0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.111+0000 7f31097fa640 1 -- 172.21.15.102:0/3881689127 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f321404c120 con 0x561a542ff3e0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.111+0000 7f31097fa640 1 --2- 172.21.15.102:0/3881689127 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30fc03d000 0x7f30fc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.111+0000 7f31097fa640 1 -- 172.21.15.102:0/3881689127 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f3214028020 con 0x561a542ff3e0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.111+0000 7f321b1f5640 1 --2- 172.21.15.102:0/3881689127 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30fc03d000 0x7f30fc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f3225f0c800 1 Processor -- start 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f3225f0c800 1 -- start start 2024-09-19T11:13:57.123 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f321b1f5640 1 --2- 172.21.15.102:0/3881689127 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30fc03d000 0x7f30fc03f4c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x561a542eda90 tx=0x7f320c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f3225f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a5430bff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f3225f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a541e60d0 con 0x561a5430bbf0 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a5430bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a5430bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44452/0 (socket says 172.21.15.102:44452) 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f32239f6640 1 -- 172.21.15.102:0/431593298 learned_addr learned my addr 172.21.15.102:0/431593298 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f32239f6640 1 -- 172.21.15.102:0/431593298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a5430c5e0 con 0x561a5430bbf0 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f32239f6640 1 --2- 172.21.15.102:0/431593298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a5430bff0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f321400bfc0 tx=0x7f321404ef60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4d1d0205a26cbbc9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f3102ffd640 1 -- 172.21.15.102:0/431593298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3214047c70 con 0x561a5430bbf0 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f3102ffd640 1 -- 172.21.15.102:0/431593298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321403a3f0 con 0x561a5430bbf0 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.112+0000 7f3102ffd640 1 -- 172.21.15.102:0/431593298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f321401e040 con 0x561a5430bbf0 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 -- 172.21.15.102:0/431593298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 msgr2=0x561a5430bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 --2- 172.21.15.102:0/431593298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a5430bff0 secure :-1 s=READY pgs=449 cs=0 l=1 rev1=1 crypto rx=0x7f321400bfc0 tx=0x7f321404ef60 comp rx=0 tx=0).stop 2024-09-19T11:13:57.124 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 -- 172.21.15.102:0/431593298 shutdown_connections 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 --2- 172.21.15.102:0/431593298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a5430bff0 unknown :-1 s=CLOSED pgs=449 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 -- 172.21.15.102:0/431593298 >> 172.21.15.102:0/431593298 conn(0x561a54307ff0 msgr2=0x561a54306230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 -- 172.21.15.102:0/431593298 shutdown_connections 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 -- 172.21.15.102:0/431593298 wait complete. 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 Processor -- start 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 -- start start 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a54313020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.113+0000 7f3225f0c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561a5430ca50 con 0x561a5430bbf0 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a54313020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f32239f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a54313020 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44458/0 (socket says 172.21.15.102:44458) 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 learned_addr learned my addr 172.21.15.102:0/2511778058 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561a54313580 con 0x561a5430bbf0 2024-09-19T11:13:57.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f32239f6640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a54313020 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f321401ded0 tx=0x7f3214015f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f31017fa640 1 -- 172.21.15.102:0/2511778058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3214047c70 con 0x561a5430bbf0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f31017fa640 1 -- 172.21.15.102:0/2511778058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f321406a070 con 0x561a5430bbf0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561a54313580 con 0x561a5430bbf0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f31017fa640 1 -- 172.21.15.102:0/2511778058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f321401ec00 con 0x561a5430bbf0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.114+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561a54313580 con 0x561a5430bbf0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.115+0000 7f31017fa640 1 -- 172.21.15.102:0/2511778058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3214029050 con 0x561a5430bbf0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.115+0000 7f31017fa640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ec03d000 0x7f30ec03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.115+0000 7f31017fa640 1 -- 172.21.15.102:0/2511778058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f321405b030 con 0x561a5430bbf0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.115+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ec03d000 0x7f30ec03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.116+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ec03d000 0x7f30ec03f4c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f320c051990 tx=0x7f320c06d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.116+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.116+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a5431e610 0x561a54320ad0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.116+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a54321220 con 0x561a5431e610 2024-09-19T11:13:57.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.116+0000 7f32241f7640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a5431e610 0x561a54320ad0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.116+0000 7f32241f7640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a5431e610 0x561a54320ad0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.116+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 realm 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a54321630 con 0x561a5431e610 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a54321f00 con 0x561a5431e610 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a54323000 0x561a543253f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a543259b0 con 0x561a54323000 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.117+0000 7f32239f6640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a54323000 0x561a543253f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.118+0000 7f32239f6640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a54323000 0x561a543253f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.118+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.118+0000 7f3225f0c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.118+0000 7f3225f0c800 20 searching for the correct realm 2024-09-19T11:13:57.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.118+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a54327960 0x561a54329e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.118+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a5432a4f0 con 0x561a54327960 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.118+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a54327960 0x561a54329e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.118+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a54327960 0x561a54329e20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f321b1f5640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f320c069040 0x7f320c06a430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a5432a4f0 con 0x7f320c069040 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f32241f7640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f320c069040 0x7f320c06a430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f32241f7640 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f320c069040 0x7f320c06a430 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.119+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.120+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.120+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.120+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.120+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.120+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.120+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.120+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.120+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x7f320c069040 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.121+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.121+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54327960 2024-09-19T11:13:57.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.121+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.121+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.121+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.121+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.121+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.121+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.122+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.122+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x7f320c069040 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.122+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.122+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54327960 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.122+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.122+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54327960 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.122+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.122+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54327960 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54327960 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.123+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.124+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.124+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54327960 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.124+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.124+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x7f320c069040 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.124+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.124+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.124+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.124+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.125+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.125+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54327960 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.125+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.125+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.125+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.125+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x7f320c069040 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.125+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.125+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54327960 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a54323000 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x561a5431e610 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x561a543222a0 con 0x7f320c069040 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f3225f0c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f3225f0c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f3225f0c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:57.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f3225f0c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f3225f0c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f3225f0c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.126+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a54326270 con 0x561a5431e610 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a54326270 con 0x561a5431e610 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a54326270 con 0x561a54327960 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 zone default found 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 4 Realm: () 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 zonegroup default 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a54326b60 con 0x561a54323000 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.127+0000 7f3225f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a5432c460 con 0x561a54327960 2024-09-19T11:13:57.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a5432c870 con 0x561a54327960 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 20 started sync module instance, tier type = 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.128+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432b800 con 0x7f320c069040 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.129+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.129+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94671081749808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432b800 con 0x7f320c069040 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.129+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432d390 con 0x561a5431e610 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.130+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94671081749808] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.130+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.130+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94671081754224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432b800 con 0x561a5431e610 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.130+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432de30 con 0x561a54327960 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.131+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94671081754224] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.131+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.131+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94671081747280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432b770 con 0x561a54327960 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.131+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432ecf0 con 0x7f320c069040 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.132+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94671081747280] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.133+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.133+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94671081760832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432f110 con 0x7f320c069040 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.133+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432fad0 con 0x561a5431e610 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.134+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.134+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94671081764384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432fef0 con 0x561a5431e610 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.134+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94671081760832] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.134+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54330970 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.135+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.135+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94671081768032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54330d90 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.135+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54331750 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.135+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94671081764384] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.136+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94671081768032] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.136+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.136+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94671081771680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54331af0 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.136+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54332340 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94671081771680] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'126 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94671081773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a543323c0 con 0x561a54323000 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f3225f0c800 20 add_watcher() i=0 2024-09-19T11:13:57.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f3225f0c800 20 add_watcher() i=1 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f3225f0c800 20 add_watcher() i=2 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f3225f0c800 20 add_watcher() i=3 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f3225f0c800 20 add_watcher() i=4 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f3225f0c800 20 add_watcher() i=5 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.137+0000 7f3225f0c800 20 add_watcher() i=6 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.138+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94671081773808] v35'127 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.138+0000 7f3225f0c800 20 add_watcher() i=7 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.138+0000 7f3225f0c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.138+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a543356d0 con 0x561a5431e610 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.138+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.138+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94671081775232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54332950 con 0x561a5431e610 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.139+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94671081775232] v35'121 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.139+0000 7f30d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.139+0000 7f3225f0c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:57.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.139+0000 7f3225f0c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:57.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.139+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433df80 con 0x561a5431e610 2024-09-19T11:13:57.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.140+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.140+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433e5d0 con 0x561a54323000 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.141+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'15 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.141+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433e5b0 con 0x561a54327960 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.142+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.142+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433f0b0 con 0x561a5431e610 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.143+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'122 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.143+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433bde0 con 0x7f320c069040 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.144+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'35 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.144+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433bde0 con 0x561a54327960 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.145+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'24 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.145+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433fde0 con 0x561a5431e610 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.146+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.146+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340290 con 0x561a54323000 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.147+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'23 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.147+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340290 con 0x7f320c069040 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.148+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.148+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340290 con 0x561a54327960 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.149+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.149+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340800 con 0x7f320c069040 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.150+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.150+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340800 con 0x561a54323000 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.151+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.151+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340800 con 0x7f320c069040 2024-09-19T11:13:57.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.152+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.152+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340800 con 0x561a54323000 2024-09-19T11:13:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.153+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'29 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.153+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340890 con 0x561a5431e610 2024-09-19T11:13:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.154+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'123 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.154+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340890 con 0x561a54327960 2024-09-19T11:13:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.155+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.155+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340920 con 0x7f320c069040 2024-09-19T11:13:57.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.156+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'37 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.156+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340920 con 0x561a54327960 2024-09-19T11:13:57.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.157+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.157+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340a10 con 0x561a5431e610 2024-09-19T11:13:57.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.159+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.159+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340a10 con 0x561a5431e610 2024-09-19T11:13:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.160+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'124 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.160+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340a10 con 0x561a54327960 2024-09-19T11:13:57.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.161+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'30 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.161+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340aa0 con 0x7f320c069040 2024-09-19T11:13:57.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.162+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'25 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.162+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340aa0 con 0x561a54327960 2024-09-19T11:13:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.163+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.163+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340aa0 con 0x561a54327960 2024-09-19T11:13:57.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.163+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.163+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340ae0 con 0x561a54327960 2024-09-19T11:13:57.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.164+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'11 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.164+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340ae0 con 0x561a54327960 2024-09-19T11:13:57.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.165+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'25 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.165+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340ae0 con 0x561a54323000 2024-09-19T11:13:57.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.166+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'17 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.167+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340cb0 con 0x561a54327960 2024-09-19T11:13:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.167+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'15 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.168+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340cb0 con 0x561a54323000 2024-09-19T11:13:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.168+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'24 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.169+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a54340cb0 con 0x561a54327960 2024-09-19T11:13:57.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.169+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'31 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.169+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433ffb0 con 0x561a54323000 2024-09-19T11:13:57.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.171+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'30 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.171+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5433fff0 con 0x7f320c069040 2024-09-19T11:13:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.172+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.172+0000 7f30d8fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.172+0000 7f3225f0c800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.172+0000 7f3225f0c800 20 Filter name: none 2024-09-19T11:13:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.172+0000 7f30527fc640 20 reqs_thread_entry: start 2024-09-19T11:13:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.172+0000 7f3225f0c800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:13:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.172+0000 7f3225f0c800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.172+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a5436b680 con 0x561a54323000 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f3225f0c800 20 rados_obj.operate() r=0 bl.length=380 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f3225f0c800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f3225f0c800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f3225f0c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a5436dfb0 con 0x561a54323000 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(95 fud.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 155+0+15 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f3225f0c800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-19T11:13:57.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.173+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5436bf90 con 0x561a54323000 2024-09-19T11:13:57.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v35'4 uv4 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f3225f0c800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-19T11:13:57.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94671082015392 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a5436e4e0 con 0x561a54327960 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== watch-notify(notify (1) cookie 94671081747280 notify 150323855363 ret 0) ==== 212+0+0 (crc 0 0 0) 0x561a54340600 con 0x561a54327960 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f3102ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855363 cookie 94671081747280 notifier 4540 bl.length()=170 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(97 notify.2 [notify cookie 94671082015392 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f3102ffd640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f30e8003d60 con 0x561a54327960 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== watch-notify(notify_complete (2) cookie 94671082015392 notify 150323855363 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a5433b930 con 0x561a54327960 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f3225f0c800 10 removing email index: 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f3225f0c800 10 removing user buckets index 2024-09-19T11:13:57.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.175+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:99 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5436e460 con 0x561a54323000 2024-09-19T11:13:57.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(99 fud.buckets [delete] v35'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f3225f0c800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94671082021984 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a5436dab0 con 0x561a54323000 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== watch-notify(notify (1) cookie 94671081771680 notify 150323855369 ret 0) ==== 202+0+0 (crc 0 0 0) 0x561a5433fde0 con 0x561a54323000 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f31027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855369 cookie 94671081771680 notifier 4540 bl.length()=160 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(100 notify.6 [notify cookie 94671082021984 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f31027fc640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f30580032c0 con 0x561a54323000 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== watch-notify(notify_complete (2) cookie 94671082021984 notify 150323855369 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a542ffe40 con 0x561a54323000 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(101 notify.6 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f3225f0c800 10 removing user index: fud 2024-09-19T11:13:57.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.177+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5436e460 con 0x561a54323000 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.178+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(102 fud [call,call,delete] v35'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.178+0000 7f3225f0c800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.178+0000 7f3225f0c800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.178+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 7.3 7:c609908c:::notify.5:head [notify cookie 94671082021984 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x561a5436caa0 con 0x561a54323000 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.178+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== watch-notify(notify (1) cookie 94671081768032 notify 150323855370 ret 0) ==== 194+0+0 (crc 0 0 0) 0x561a542ffe40 con 0x561a54323000 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.178+0000 7f31027fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855370 cookie 94671081768032 notifier 4540 bl.length()=152 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.178+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(103 notify.5 [notify cookie 94671082021984 out=8b] v0'0 uv126 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.178+0000 7f31027fc640 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:104 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f3058003260 con 0x561a54323000 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.179+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(104 notify.5 [notify-ack] v0'0 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.179+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== watch-notify(notify_complete (2) cookie 94671082021984 notify 150323855370 ret 0) ==== 42+0+48 (crc 0 0 0) 0x561a542e2410 con 0x561a54323000 2024-09-19T11:13:57.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.180+0000 7f30d9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.180+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94671081775232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5436e460 con 0x561a5431e610 2024-09-19T11:13:57.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.181+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94671081775232] v35'125 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.181+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94671081749808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5436e460 con 0x7f320c069040 2024-09-19T11:13:57.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.181+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94671081749808] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.181+0000 7f3225f0c800 20 remove_watcher() i=0 2024-09-19T11:13:57.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.181+0000 7f3225f0c800 2 removed watcher, disabling cache 2024-09-19T11:13:57.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.181+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94671081754224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432bd30 con 0x561a5431e610 2024-09-19T11:13:57.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.183+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94671081754224] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.183+0000 7f3225f0c800 20 remove_watcher() i=1 2024-09-19T11:13:57.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.183+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94671081747280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5436e460 con 0x561a54327960 2024-09-19T11:13:57.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.184+0000 7f321b1f5640 1 -- 172.21.15.102:0/2511778058 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94671081747280] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f320c057030 con 0x561a54327960 2024-09-19T11:13:57.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.184+0000 7f3225f0c800 20 remove_watcher() i=2 2024-09-19T11:13:57.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.184+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94671081760832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432ce70 con 0x7f320c069040 2024-09-19T11:13:57.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.184+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94671081760832] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x7f320c069040 2024-09-19T11:13:57.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.184+0000 7f3225f0c800 20 remove_watcher() i=3 2024-09-19T11:13:57.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.184+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94671081764384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432bd30 con 0x561a5431e610 2024-09-19T11:13:57.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.185+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94671081764384] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f321c00a4d0 con 0x561a5431e610 2024-09-19T11:13:57.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.185+0000 7f3225f0c800 20 remove_watcher() i=4 2024-09-19T11:13:57.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.186+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94671081768032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432b350 con 0x561a54323000 2024-09-19T11:13:57.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.187+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94671081768032] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.187+0000 7f3225f0c800 20 remove_watcher() i=5 2024-09-19T11:13:57.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.187+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94671081771680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432e840 con 0x561a54323000 2024-09-19T11:13:57.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.187+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94671081771680] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.187+0000 7f3225f0c800 20 remove_watcher() i=6 2024-09-19T11:13:57.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.187+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94671081773808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x561a5432ce70 con 0x561a54323000 2024-09-19T11:13:57.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.188+0000 7f32239f6640 1 -- 172.21.15.102:0/2511778058 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94671081773808] v35'128 uv126 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3214075070 con 0x561a54323000 2024-09-19T11:13:57.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.188+0000 7f3225f0c800 20 remove_watcher() i=7 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a54323000 msgr2=0x561a543253f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a54323000 0x561a543253f0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a5431e610 msgr2=0x561a54320ad0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a5431e610 0x561a54320ad0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f320c069040 msgr2=0x7f320c06a430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f320c069040 0x7f320c06a430 crc :-1 s=READY pgs=51 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a54327960 msgr2=0x561a54329e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a54327960 0x561a54329e20 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ec03d000 msgr2=0x7f30ec03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ec03d000 0x7f30ec03f4c0 secure :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0x7f320c051990 tx=0x7f320c06d040 comp rx=0 tx=0).stop 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 msgr2=0x561a54313020 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a54313020 secure :-1 s=READY pgs=450 cs=0 l=1 rev1=1 crypto rx=0x7f321401ded0 tx=0x7f3214015f50 comp rx=0 tx=0).stop 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f32241f7640 1 -- 172.21.15.102:0/2511778058 reap_dead start 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 shutdown_connections 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2511778058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a5430bbf0 0x561a54313020 unknown :-1 s=CLOSED pgs=450 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 >> 172.21.15.102:0/2511778058 conn(0x561a54307ff0 msgr2=0x561a54306200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 shutdown_connections 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/2511778058 wait complete. 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/3881689127 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30fc03d000 msgr2=0x7f30fc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/3881689127 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30fc03d000 0x7f30fc03f4c0 secure :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0x561a542eda90 tx=0x7f320c005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/3881689127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a542ff3e0 msgr2=0x561a542ff800 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/3881689127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a542ff3e0 0x561a542ff800 secure :-1 s=READY pgs=448 cs=0 l=1 rev1=1 crypto rx=0x7f32140017f0 tx=0x7f3214017f40 comp rx=0 tx=0).stop 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/3881689127 shutdown_connections 2024-09-19T11:13:57.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/3881689127 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30fc03d000 0x7f30fc03f4c0 unknown :-1 s=CLOSED pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 --2- 172.21.15.102:0/3881689127 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a542ff3e0 0x561a542ff800 unknown :-1 s=CLOSED pgs=448 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/3881689127 >> 172.21.15.102:0/3881689127 conn(0x561a542f3790 msgr2=0x561a542f3b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/3881689127 shutdown_connections 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.189+0000 7f3225f0c800 1 -- 172.21.15.102:0/3881689127 wait complete. 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a542eacb0 msgr2=0x561a542ed0a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561a542eacb0 0x561a542ed0a0 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a541eba90 msgr2=0x561a542e8660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561a541eba90 0x561a542e8660 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a542eeb50 msgr2=0x561a542f0f40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561a542eeb50 0x561a542f0f40 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f310c03d000 msgr2=0x7f310c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f310c03d000 0x7f310c03f4c0 secure :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0x7f320c057000 tx=0x7f320c052000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 msgr2=0x561a542e1010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 --2- 172.21.15.102:0/2330397952 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561a541e7f20 0x561a542e1010 secure :-1 s=READY pgs=447 cs=0 l=1 rev1=1 crypto rx=0x7f321400b700 tx=0x7f3214000bc0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f32241f7640 1 -- 172.21.15.102:0/2330397952 reap_dead start 2024-09-19T11:13:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 shutdown_connections 2024-09-19T11:13:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 >> 172.21.15.102:0/2330397952 conn(0x561a541e1a60 msgr2=0x561a542d27f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 shutdown_connections 2024-09-19T11:13:57.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.190+0000 7f3225f0c800 1 -- 172.21.15.102:0/2330397952 wait complete. 2024-09-19T11:13:57.199 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-19T11:13:57.199 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--tenant', 'testx', '--uid', 'tenanteduser', '--display-name', 'tenanted-user', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '1'] 2024-09-19T11:13:57.200 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --tenant testx --uid tenanteduser --display-name tenanted-user --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 1 2024-09-19T11:13:57.255 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:57.255 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:57.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.254+0000 7fc400b25800 1 Processor -- start 2024-09-19T11:13:57.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.254+0000 7fc400b25800 1 -- start start 2024-09-19T11:13:57.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.255+0000 7fc400b25800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55783b6368e0 0x55783b63f400 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.255+0000 7fc400b25800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55783b63f940 con 0x55783b634dc0 2024-09-19T11:13:57.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.255+0000 7fc400b25800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55783b4c17d0 con 0x55783b6368e0 2024-09-19T11:13:57.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.255+0000 7fc3fc0a1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55783b6368e0 0x55783b63f400 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.255+0000 7fc3fc8a2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55783b634dc0 0x55783b6351c0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52550/0 (socket says 172.21.15.102:52550) 2024-09-19T11:13:57.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.255+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3047832074 learned_addr learned my addr 172.21.15.102:0/3047832074 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:57.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.255+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3047832074 >> v1:172.21.15.37:6789/0 conn(0x55783b634dc0 legacy=0x55783b6351c0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.255+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3047832074 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783b640b20 con 0x55783b6368e0 2024-09-19T11:13:57.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.257+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3047832074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b6368e0 0x55783b63f400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000a470 tx=0x7fc3f0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9c1705dce6aa3489 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.257+0000 7fc3fb8a0640 1 -- 172.21.15.102:0/3047832074 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f0053570 con 0x55783b6368e0 2024-09-19T11:13:57.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.257+0000 7fc3fb8a0640 1 -- 172.21.15.102:0/3047832074 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3f0058070 con 0x55783b6368e0 2024-09-19T11:13:57.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.257+0000 7fc3fb8a0640 1 -- 172.21.15.102:0/3047832074 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3f0053880 con 0x55783b6368e0 2024-09-19T11:13:57.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.258+0000 7fc400b25800 1 -- 172.21.15.102:0/3047832074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b6368e0 msgr2=0x55783b63f400 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.258+0000 7fc400b25800 1 --2- 172.21.15.102:0/3047832074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b6368e0 0x55783b63f400 secure :-1 s=READY pgs=452 cs=0 l=1 rev1=1 crypto rx=0x7fc3f000a470 tx=0x7fc3f0045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:57.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.258+0000 7fc400b25800 1 -- 172.21.15.102:0/3047832074 shutdown_connections 2024-09-19T11:13:57.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.258+0000 7fc400b25800 1 --2- 172.21.15.102:0/3047832074 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b6368e0 0x55783b63f400 unknown :-1 s=CLOSED pgs=452 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.258+0000 7fc400b25800 1 -- 172.21.15.102:0/3047832074 >> 172.21.15.102:0/3047832074 conn(0x55783b630ab0 msgr2=0x55783b632f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.258+0000 7fc400b25800 1 -- 172.21.15.102:0/3047832074 shutdown_connections 2024-09-19T11:13:57.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.258+0000 7fc400b25800 1 -- 172.21.15.102:0/3047832074 wait complete. 2024-09-19T11:13:57.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.271+0000 7fc400b25800 1 Processor -- start 2024-09-19T11:13:57.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.271+0000 7fc400b25800 1 -- start start 2024-09-19T11:13:57.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.271+0000 7fc400b25800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b7285d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.271+0000 7fc400b25800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55783b4cedd0 con 0x55783b634dc0 2024-09-19T11:13:57.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.272+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b7285d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.272+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b7285d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44482/0 (socket says 172.21.15.102:44482) 2024-09-19T11:13:57.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.272+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/2060441437 learned_addr learned my addr 172.21.15.102:0/2060441437 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.272+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/2060441437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783b728bc0 con 0x55783b634dc0 2024-09-19T11:13:57.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.272+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/2060441437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b7285d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec001800 tx=0x7fc3ec001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fe2ee120f6c4cd67 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.272+0000 7fc2eae0d640 1 -- 172.21.15.102:0/2060441437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec004520 con 0x55783b634dc0 2024-09-19T11:13:57.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.272+0000 7fc2eae0d640 1 -- 172.21.15.102:0/2060441437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0046c0 con 0x55783b634dc0 2024-09-19T11:13:57.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.272+0000 7fc2eae0d640 1 -- 172.21.15.102:0/2060441437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0049e0 con 0x55783b634dc0 2024-09-19T11:13:57.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 -- 172.21.15.102:0/2060441437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 msgr2=0x55783b7285d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 --2- 172.21.15.102:0/2060441437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b7285d0 secure :-1 s=READY pgs=453 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec001800 tx=0x7fc3ec001cc0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 -- 172.21.15.102:0/2060441437 shutdown_connections 2024-09-19T11:13:57.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 --2- 172.21.15.102:0/2060441437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b7285d0 unknown :-1 s=CLOSED pgs=453 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 -- 172.21.15.102:0/2060441437 >> 172.21.15.102:0/2060441437 conn(0x55783b630ab0 msgr2=0x55783b723f50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 -- 172.21.15.102:0/2060441437 shutdown_connections 2024-09-19T11:13:57.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 -- 172.21.15.102:0/2060441437 wait complete. 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 Processor -- start 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 -- start start 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b730120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.273+0000 7fc400b25800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55783b63fe10 con 0x55783b634dc0 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b730120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b730120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44496/0 (socket says 172.21.15.102:44496) 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3391188075 learned_addr learned my addr 172.21.15.102:0/3391188075 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3391188075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783b730680 con 0x55783b634dc0 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b730120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000f80 tx=0x7fc3ec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc2e960a640 1 -- 172.21.15.102:0/3391188075 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec022020 con 0x55783b634dc0 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc2e960a640 1 -- 172.21.15.102:0/3391188075 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec014890 con 0x55783b634dc0 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc2e960a640 1 -- 172.21.15.102:0/3391188075 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec014bb0 con 0x55783b634dc0 2024-09-19T11:13:57.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55783b730910 con 0x55783b634dc0 2024-09-19T11:13:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.274+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783b731310 con 0x55783b634dc0 2024-09-19T11:13:57.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.275+0000 7fc2e960a640 1 -- 172.21.15.102:0/3391188075 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc3ec025020 con 0x55783b634dc0 2024-09-19T11:13:57.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.275+0000 7fc2e960a640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2e403d050 0x7fc2e403f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.275+0000 7fc2e960a640 1 -- 172.21.15.102:0/3391188075 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fc3ec018030 con 0x55783b634dc0 2024-09-19T11:13:57.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.276+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2e403d050 0x7fc2e403f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.276+0000 7fc400b25800 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b6368e0 0x55783b737770 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.276+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b737cb0 con 0x55783b6368e0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.276+0000 7fc3fd0a3640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b6368e0 0x55783b737770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.276+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2e403d050 0x7fc2e403f510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0057000 tx=0x7fc3f0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.276+0000 7fc3fd0a3640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b6368e0 0x55783b737770 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.276+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3391188075 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f40083e0 con 0x55783b6368e0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.276+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b738050 con 0x55783b6368e0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.277+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3391188075 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3f40083e0 con 0x55783b6368e0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.277+0000 7fc400b25800 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b739b50 0x55783b73bfd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.277+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b73c760 con 0x55783b739b50 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.277+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b739b50 0x55783b73bfd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.277+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b739b50 0x55783b73bfd0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.278+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3391188075 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc3ec01b070 con 0x55783b739b50 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.278+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b7388a0 con 0x55783b6368e0 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.278+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3391188075 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3f40083e0 con 0x55783b6368e0 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.278+0000 7fc400b25800 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b73dbc0 0x55783b73ffb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.278+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b740720 con 0x55783b73dbc0 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.278+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b73dbc0 0x55783b73ffb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.278+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b73dbc0 0x55783b73ffb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.279+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3391188075 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc3f0051070 con 0x55783b73dbc0 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.279+0000 7fc400b25800 1 Processor -- start 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.279+0000 7fc400b25800 1 -- start start 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.279+0000 7fc400b25800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b74e4a0 0x55783b74e8c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.279+0000 7fc400b25800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55783b52d4a0 con 0x55783b74e4a0 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.279+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b74e4a0 0x55783b74e8c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.279+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b74e4a0 0x55783b74e8c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44498/0 (socket says 172.21.15.102:44498) 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.279+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/2411967870 learned_addr learned my addr 172.21.15.102:0/2411967870 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.280+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/2411967870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783b74ef00 con 0x55783b74e4a0 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.280+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/2411967870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b74e4a0 0x55783b74e8c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec052ae0 tx=0x7fc3ec010e80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.280+0000 7fc2e2ffd640 1 -- 172.21.15.102:0/2411967870 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec051220 con 0x55783b74e4a0 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.280+0000 7fc2e2ffd640 1 -- 172.21.15.102:0/2411967870 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec034020 con 0x55783b74e4a0 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.280+0000 7fc400b25800 1 -- 172.21.15.102:0/2411967870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55783b74f730 con 0x55783b74e4a0 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.280+0000 7fc2e2ffd640 1 -- 172.21.15.102:0/2411967870 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec0514f0 con 0x55783b74e4a0 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.280+0000 7fc400b25800 1 -- 172.21.15.102:0/2411967870 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783b74fcd0 con 0x55783b74e4a0 2024-09-19T11:13:57.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc2e2ffd640 1 -- 172.21.15.102:0/2411967870 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc3ec010070 con 0x55783b74e4a0 2024-09-19T11:13:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc2e2ffd640 1 --2- 172.21.15.102:0/2411967870 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2d403d000 0x7fc2d403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc2e2ffd640 1 -- 172.21.15.102:0/2411967870 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fc3ec035030 con 0x55783b74e4a0 2024-09-19T11:13:57.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/2411967870 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2d403d000 0x7fc2d403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc400b25800 1 Processor -- start 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc400b25800 1 -- start start 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/2411967870 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2d403d000 0x7fc2d403f4c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55783b738c40 tx=0x7fc3f0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc400b25800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b75b0c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.281+0000 7fc400b25800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55783b728ff0 con 0x55783b75acc0 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.282+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b75b0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.282+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b75b0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44506/0 (socket says 172.21.15.102:44506) 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.282+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/51984940 learned_addr learned my addr 172.21.15.102:0/51984940 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.282+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/51984940 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783b75b6b0 con 0x55783b75acc0 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.282+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/51984940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b75b0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec053010 tx=0x7fc3ec054420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a202a915314d5271 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.282+0000 7fc2e0ff9640 1 -- 172.21.15.102:0/51984940 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec026d10 con 0x55783b75acc0 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.282+0000 7fc2e0ff9640 1 -- 172.21.15.102:0/51984940 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec04b280 con 0x55783b75acc0 2024-09-19T11:13:57.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.282+0000 7fc2e0ff9640 1 -- 172.21.15.102:0/51984940 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec012c50 con 0x55783b75acc0 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 -- 172.21.15.102:0/51984940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 msgr2=0x55783b75b0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 --2- 172.21.15.102:0/51984940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b75b0c0 secure :-1 s=READY pgs=456 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec053010 tx=0x7fc3ec054420 comp rx=0 tx=0).stop 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 -- 172.21.15.102:0/51984940 shutdown_connections 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 --2- 172.21.15.102:0/51984940 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b75b0c0 unknown :-1 s=CLOSED pgs=456 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 -- 172.21.15.102:0/51984940 >> 172.21.15.102:0/51984940 conn(0x55783b7570c0 msgr2=0x55783b755300 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 -- 172.21.15.102:0/51984940 shutdown_connections 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 -- 172.21.15.102:0/51984940 wait complete. 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 Processor -- start 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 -- start start 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b762080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc400b25800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55783b75bb20 con 0x55783b75acc0 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b762080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc3fc8a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b762080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44510/0 (socket says 172.21.15.102:44510) 2024-09-19T11:13:57.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.283+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 learned_addr learned my addr 172.21.15.102:0/3922977671 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.284+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55783b7625e0 con 0x55783b75acc0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.284+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b762080 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec030d60 tx=0x7fc3ec03ae00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.284+0000 7fc2da7fc640 1 -- 172.21.15.102:0/3922977671 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec059070 con 0x55783b75acc0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.284+0000 7fc2da7fc640 1 -- 172.21.15.102:0/3922977671 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc3ec0307c0 con 0x55783b75acc0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.284+0000 7fc2da7fc640 1 -- 172.21.15.102:0/3922977671 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc3ec044420 con 0x55783b75acc0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.284+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55783b7625e0 con 0x55783b75acc0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.284+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55783b762be0 con 0x55783b75acc0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.285+0000 7fc2da7fc640 1 -- 172.21.15.102:0/3922977671 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc3ec06b070 con 0x55783b75acc0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.285+0000 7fc2da7fc640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2c403cfb0 0x7fc2c403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.285+0000 7fc2da7fc640 1 -- 172.21.15.102:0/3922977671 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fc3ec05c070 con 0x55783b75acc0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.285+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2c403cfb0 0x7fc2c403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.285+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2c403cfb0 0x7fc2c403f470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0053fd0 tx=0x7fc3f0053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b76d6b0 0x55783b76fb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b7702c0 con 0x55783b76d6b0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc3fd0a3640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b76d6b0 0x55783b76fb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc3fd0a3640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b76d6b0 0x55783b76fb70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f40083e0 con 0x55783b76d6b0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 20 realm 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b7706d0 con 0x55783b76d6b0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f40083e0 con 0x55783b76d6b0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:57.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.286+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f40083e0 con 0x55783b76d6b0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b771340 con 0x55783b76d6b0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc3f40083e0 con 0x55783b76d6b0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc400b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b771d00 0x55783b7740f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b774740 con 0x55783b771d00 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.287+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b771d00 0x55783b7740f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.288+0000 7fc3fc8a2640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b771d00 0x55783b7740f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.288+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.288+0000 7fc400b25800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.288+0000 7fc400b25800 20 searching for the correct realm 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.288+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b7766d0 0x55783b778b90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.288+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b779210 con 0x55783b7766d0 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.288+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b7766d0 0x55783b778b90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.288+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b7766d0 0x55783b778b90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.289+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.289+0000 7fc3fc0a1640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc3f005f040 0x7fc3f005f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.289+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b779210 con 0x7fc3f005f040 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.289+0000 7fc3fd0a3640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc3f005f040 0x7fc3f005f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.289+0000 7fc3fd0a3640 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc3f005f040 0x7fc3f005f930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.289+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f40083e0 con 0x7fc3f005f040 2024-09-19T11:13:57.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.289+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.290+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.290+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.290+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f40083e0 con 0x55783b76d6b0 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.290+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.290+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.290+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.290+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.290+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.291+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.291+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x7fc3f005f040 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.291+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x7fc3f005f040 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.291+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b7766d0 2024-09-19T11:13:57.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.291+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.291+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.291+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.291+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.292+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.292+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.292+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.292+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x7fc3f005f040 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.292+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc3f4026040 con 0x7fc3f005f040 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.292+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b7766d0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.292+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.292+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b7766d0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b7766d0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b7766d0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.293+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.294+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.294+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.294+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.294+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b7766d0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.294+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.294+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x7fc3f005f040 2024-09-19T11:13:57.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.295+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x7fc3f005f040 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.295+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.295+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.295+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.295+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.295+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b7766d0 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.295+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.295+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.296+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.296+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x7fc3f005f040 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.296+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x7fc3f005f040 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.296+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b7766d0 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.296+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.296+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b771d00 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x55783b76d6b0 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55783b770fa0 con 0x7fc3f005f040 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc3f4026040 con 0x7fc3f005f040 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b774ae0 con 0x55783b76d6b0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.297+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b774ae0 con 0x55783b76d6b0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc3f4026040 con 0x55783b76d6b0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b774ae0 con 0x55783b7766d0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 20 zone default found 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 4 Realm: () 2024-09-19T11:13:57.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 20 zonegroup default 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b7753a0 con 0x55783b771d00 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.298+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b77b180 con 0x55783b7766d0 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b77b570 con 0x55783b7766d0 2024-09-19T11:13:57.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc400b25800 20 started sync module instance, tier type = 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc400b25800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.299+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77a520 con 0x7fc3f005f040 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.300+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4026040 con 0x7fc3f005f040 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.300+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93974882134560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77a520 con 0x7fc3f005f040 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.300+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77c090 con 0x55783b76d6b0 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.301+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93974882134560] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x7fc3f005f040 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.301+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.301+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93974882139040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77a520 con 0x55783b76d6b0 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.301+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77cb50 con 0x55783b7766d0 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.302+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93974882139040] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.302+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.303+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93974882132080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77a490 con 0x55783b7766d0 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.303+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77da10 con 0x7fc3f005f040 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.303+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93974882132080] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.304+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x7fc3f005f040 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.304+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93974882144064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77da10 con 0x7fc3f005f040 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.304+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77e420 con 0x55783b76d6b0 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.305+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.305+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93974882144064] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x7fc3f005f040 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.305+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93974882148208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77e390 con 0x55783b76d6b0 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.305+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77ee30 con 0x55783b771d00 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.306+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.306+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93974882145632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77f6d0 con 0x55783b771d00 2024-09-19T11:13:57.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.306+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7800d0 con 0x55783b771d00 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.306+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93974882148208] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.306+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93974882145632] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.307+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.307+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93974882152992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b77fc80 con 0x55783b771d00 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.307+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b780980 con 0x55783b771d00 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'129 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93974882152992] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93974882157648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b780df0 con 0x55783b771d00 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc400b25800 20 add_watcher() i=0 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc400b25800 20 add_watcher() i=1 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc400b25800 20 add_watcher() i=2 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc400b25800 20 add_watcher() i=3 2024-09-19T11:13:57.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc400b25800 20 add_watcher() i=4 2024-09-19T11:13:57.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc400b25800 20 add_watcher() i=5 2024-09-19T11:13:57.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.308+0000 7fc400b25800 20 add_watcher() i=6 2024-09-19T11:13:57.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.309+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93974882157648] v35'130 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.309+0000 7fc400b25800 20 add_watcher() i=7 2024-09-19T11:13:57.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.309+0000 7fc400b25800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:57.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.309+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b780df0 con 0x55783b76d6b0 2024-09-19T11:13:57.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.309+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.309+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93974882158912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b781690 con 0x55783b76d6b0 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.310+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93974882158912] v35'126 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.310+0000 7fc2b37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.310+0000 7fc400b25800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.310+0000 7fc400b25800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.310+0000 7fc400b25800 5 note: GC not initialized 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc2b27dc640 20 reqs_thread_entry: start 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 20 Filter name: none 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc223fff640 20 reqs_thread_entry: start 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b6ea0 con 0x55783b771d00 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(62 testx$tenanteduser [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 246+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x0 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b5490 con 0x55783b771d00 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.311+0000 7fc400b25800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:57.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.312+0000 7fc400b25800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.312+0000 7fc400b25800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.312+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [delete,create,call version.set in=58b,writefull 0~419 in=419b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b5d10 con 0x55783b771d00 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(64 testx$tenanteduser [delete,create,call,writefull 0~419] v35'5 uv5 ondisk = 0) ==== 288+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc400b25800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc400b25800 10 moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc400b25800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.e 7:7759931f:::notify.3:head [notify cookie 93974882375776 in=622b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b7ba330 con 0x7fc3f005f040 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== watch-notify(notify (1) cookie 93974882144064 notify 150323855372 ret 0) ==== 652+0+0 (crc 0 0 0) 0x7fc3f4010040 con 0x7fc3f005f040 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc2e0ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 93974882144064 notifier 4547 bl.length()=610 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc2e0ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x17 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc2e0ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 notify.3 [notify cookie 93974882375776 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3f4036040 con 0x7fc3f005f040 2024-09-19T11:13:57.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc2e0ff9640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc2c8003ea0 con 0x7fc3f005f040 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(66 notify.3 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x7fc3f005f040 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.313+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== watch-notify(notify_complete (2) cookie 93974882375776 notify 150323855372 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc3f400a9a0 con 0x7fc3f005f040 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.314+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~22 in=22b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b5830 con 0x55783b771d00 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.314+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~22] v35'6 uv6 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc400b25800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc400b25800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc400b25800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 93974882375728 in=204b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55783b7ba330 con 0x55783b7766d0 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== watch-notify(notify (1) cookie 93974882132080 notify 150323855364 ret 0) ==== 234+0+0 (crc 0 0 0) 0x55783b640b20 con 0x55783b7766d0 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc2db7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855364 cookie 93974882132080 notifier 4547 bl.length()=192 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc2db7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-19T11:13:57.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc2db7fe640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:13:57.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 notify.2 [notify cookie 93974882375728 out=8b] v0'0 uv129 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc2db7fe640 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fc230003400 con 0x55783b7766d0 2024-09-19T11:13:57.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.315+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== watch-notify(notify_complete (2) cookie 93974882375728 notify 150323855364 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc3f00808a0 con 0x55783b7766d0 2024-09-19T11:13:57.327 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"testx$tenanteduser","display_name":"tenanted-user","email":"","suspended":0,"max_buckets":1,"subusers":[],"keys":[{"user":"testx$tenanteduser","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-19T11:13:57.312830Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:57.312813Z","tags":[],"group_ids":[]} 2024-09-19T11:13:57.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.316+0000 7fc2b37de640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.316+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93974882158912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x55783b76d6b0 2024-09-19T11:13:57.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.317+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93974882158912] v35'127 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.317+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93974882134560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x7fc3f005f040 2024-09-19T11:13:57.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.318+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93974882134560] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x7fc3f005f040 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.318+0000 7fc400b25800 20 remove_watcher() i=0 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.318+0000 7fc400b25800 2 removed watcher, disabling cache 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.318+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93974882139040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x55783b76d6b0 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.319+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93974882139040] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.319+0000 7fc400b25800 20 remove_watcher() i=1 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.319+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93974882132080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x55783b7766d0 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.320+0000 7fc3fc0a1640 1 -- 172.21.15.102:0/3922977671 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93974882132080] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f007c040 con 0x55783b7766d0 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.320+0000 7fc400b25800 20 remove_watcher() i=2 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.320+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93974882144064] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x7fc3f005f040 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.321+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93974882144064] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x7fc3f005f040 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.321+0000 7fc400b25800 20 remove_watcher() i=3 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.321+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93974882148208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x55783b76d6b0 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.322+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93974882148208] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3f4036040 con 0x55783b76d6b0 2024-09-19T11:13:57.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.322+0000 7fc400b25800 20 remove_watcher() i=4 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.322+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93974882145632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x55783b771d00 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.324+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93974882145632] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.324+0000 7fc400b25800 20 remove_watcher() i=5 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.324+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93974882152992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x55783b771d00 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.325+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93974882152992] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.325+0000 7fc400b25800 20 remove_watcher() i=6 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.325+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93974882157648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55783b7b4b00 con 0x55783b771d00 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc3fc8a2640 1 -- 172.21.15.102:0/3922977671 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93974882157648] v35'131 uv129 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc3ec074020 con 0x55783b771d00 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 20 remove_watcher() i=7 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b771d00 msgr2=0x55783b7740f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b771d00 0x55783b7740f0 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b76d6b0 msgr2=0x55783b76fb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b76d6b0 0x55783b76fb70 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc3f005f040 msgr2=0x7fc3f005f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc3f005f040 0x7fc3f005f930 crc :-1 s=READY pgs=52 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b7766d0 msgr2=0x55783b778b90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b7766d0 0x55783b778b90 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2c403cfb0 msgr2=0x7fc2c403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2c403cfb0 0x7fc2c403f470 secure :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0053fd0 tx=0x7fc3f0053000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 msgr2=0x55783b762080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/3922977671 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b75acc0 0x55783b762080 secure :-1 s=READY pgs=457 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec030d60 tx=0x7fc3ec03ae00 comp rx=0 tx=0).stop 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 reap_dead start 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3922977671 reap_dead start 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 shutdown_connections 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 >> 172.21.15.102:0/3922977671 conn(0x55783b7570c0 msgr2=0x55783b7552d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 shutdown_connections 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/3922977671 wait complete. 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/2411967870 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2d403d000 msgr2=0x7fc2d403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/2411967870 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2d403d000 0x7fc2d403f4c0 secure :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0x55783b738c40 tx=0x7fc3f0005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/2411967870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b74e4a0 msgr2=0x55783b74e8c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/2411967870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b74e4a0 0x55783b74e8c0 secure :-1 s=READY pgs=455 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec052ae0 tx=0x7fc3ec010e80 comp rx=0 tx=0).stop 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/2411967870 shutdown_connections 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/2411967870 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2d403d000 0x7fc2d403f4c0 unknown :-1 s=CLOSED pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 --2- 172.21.15.102:0/2411967870 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b74e4a0 0x55783b74e8c0 unknown :-1 s=CLOSED pgs=455 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/2411967870 >> 172.21.15.102:0/2411967870 conn(0x55783b742850 msgr2=0x55783b742c30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/2411967870 shutdown_connections 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.326+0000 7fc400b25800 1 -- 172.21.15.102:0/2411967870 wait complete. 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b739b50 msgr2=0x55783b73bfd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55783b739b50 0x55783b73bfd0 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b6368e0 msgr2=0x55783b737770 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55783b6368e0 0x55783b737770 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b73dbc0 msgr2=0x55783b73ffb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55783b73dbc0 0x55783b73ffb0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2e403d050 msgr2=0x7fc2e403f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc2e403d050 0x7fc2e403f510 secure :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0x7fc3f0057000 tx=0x7fc3f0052000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 msgr2=0x55783b730120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 --2- 172.21.15.102:0/3391188075 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55783b634dc0 0x55783b730120 secure :-1 s=READY pgs=454 cs=0 l=1 rev1=1 crypto rx=0x7fc3ec000f80 tx=0x7fc3ec001250 comp rx=0 tx=0).stop 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc3fd0a3640 1 -- 172.21.15.102:0/3391188075 reap_dead start 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 shutdown_connections 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 >> 172.21.15.102:0/3391188075 conn(0x55783b630ab0 msgr2=0x55783b729ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 shutdown_connections 2024-09-19T11:13:57.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.327+0000 7fc400b25800 1 -- 172.21.15.102:0/3391188075 wait complete. 2024-09-19T11:13:57.338 DEBUG:tasks.util.rgw: json result: {'user_id': 'testx$tenanteduser', 'display_name': 'tenanted-user', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'testx$tenanteduser', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-19T11:13:57.312830Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:57.312813Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:57.339 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-19T11:13:57.339 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', '/myfoo', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-19T11:13:57.339 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket /myfoo --tenant testx --uid tenanteduser 2024-09-19T11:13:57.390 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:57.390 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:57.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.389+0000 7f5c87813800 1 Processor -- start 2024-09-19T11:13:57.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.389+0000 7f5c87813800 1 -- start start 2024-09-19T11:13:57.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c87813800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564d1ff01ac0 0x564d1ff07660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c87813800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564d1ff00d60 con 0x564d1ff006b0 2024-09-19T11:13:57.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c87813800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x564d1fd8c7d0 con 0x564d1ff01ac0 2024-09-19T11:13:57.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c82747640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564d1ff01ac0 0x564d1ff07660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c82f48640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x564d1ff006b0 0x564d1ff013b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52562/0 (socket says 172.21.15.102:52562) 2024-09-19T11:13:57.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c82747640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564d1ff01ac0 0x564d1ff07660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44520/0 (socket says 172.21.15.102:44520) 2024-09-19T11:13:57.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c82f48640 1 -- 172.21.15.102:0/422634577 learned_addr learned my addr 172.21.15.102:0/422634577 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:57.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c82747640 1 -- 172.21.15.102:0/422634577 >> v1:172.21.15.37:6789/0 conn(0x564d1ff006b0 legacy=0x564d1ff013b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.393 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.390+0000 7f5c82747640 1 -- 172.21.15.102:0/422634577 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1ff01f70 con 0x564d1ff01ac0 2024-09-19T11:13:57.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.392+0000 7f5c82747640 1 --2- 172.21.15.102:0/422634577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff01ac0 0x564d1ff07660 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800a470 tx=0x7f5c78045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d03d14ecf360b999 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.394 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.392+0000 7f5c81f46640 1 -- 172.21.15.102:0/422634577 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78053570 con 0x564d1ff01ac0 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.392+0000 7f5c81f46640 1 -- 172.21.15.102:0/422634577 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c78058070 con 0x564d1ff01ac0 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.392+0000 7f5c81f46640 1 -- 172.21.15.102:0/422634577 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c78053880 con 0x564d1ff01ac0 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.393+0000 7f5c87813800 1 -- 172.21.15.102:0/422634577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff01ac0 msgr2=0x564d1ff07660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.393+0000 7f5c87813800 1 --2- 172.21.15.102:0/422634577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff01ac0 0x564d1ff07660 secure :-1 s=READY pgs=459 cs=0 l=1 rev1=1 crypto rx=0x7f5c7800a470 tx=0x7f5c78045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.393+0000 7f5c87813800 1 -- 172.21.15.102:0/422634577 shutdown_connections 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.393+0000 7f5c87813800 1 --2- 172.21.15.102:0/422634577 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff01ac0 0x564d1ff07660 unknown :-1 s=CLOSED pgs=459 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.393+0000 7f5c87813800 1 -- 172.21.15.102:0/422634577 >> 172.21.15.102:0/422634577 conn(0x564d1fefba80 msgr2=0x564d1fefdee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.393+0000 7f5c87813800 1 -- 172.21.15.102:0/422634577 shutdown_connections 2024-09-19T11:13:57.395 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.393+0000 7f5c87813800 1 -- 172.21.15.102:0/422634577 wait complete. 2024-09-19T11:13:57.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.407+0000 7f5c87813800 1 Processor -- start 2024-09-19T11:13:57.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.407+0000 7f5c87813800 1 -- start start 2024-09-19T11:13:57.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.407+0000 7f5c87813800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fe74820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.407+0000 7f5c87813800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d1fd99dd0 con 0x564d1ff006b0 2024-09-19T11:13:57.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.407+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fe74820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.407+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fe74820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44530/0 (socket says 172.21.15.102:44530) 2024-09-19T11:13:57.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.407+0000 7f5c82f48640 1 -- 172.21.15.102:0/67951018 learned_addr learned my addr 172.21.15.102:0/67951018 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.408+0000 7f5c82f48640 1 -- 172.21.15.102:0/67951018 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1fe74e10 con 0x564d1ff006b0 2024-09-19T11:13:57.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.408+0000 7f5c82f48640 1 --2- 172.21.15.102:0/67951018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fe74820 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5c74001df0 tx=0x7f5c7400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2d142fa0dc35d914 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.408+0000 7f5b70e09640 1 -- 172.21.15.102:0/67951018 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c74012020 con 0x564d1ff006b0 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.408+0000 7f5b70e09640 1 -- 172.21.15.102:0/67951018 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7400e470 con 0x564d1ff006b0 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.408+0000 7f5b70e09640 1 -- 172.21.15.102:0/67951018 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7400e7f0 con 0x564d1ff006b0 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 -- 172.21.15.102:0/67951018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 msgr2=0x564d1fe74820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 --2- 172.21.15.102:0/67951018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fe74820 secure :-1 s=READY pgs=460 cs=0 l=1 rev1=1 crypto rx=0x7f5c74001df0 tx=0x7f5c7400b6c0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 -- 172.21.15.102:0/67951018 shutdown_connections 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 --2- 172.21.15.102:0/67951018 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fe74820 unknown :-1 s=CLOSED pgs=460 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 -- 172.21.15.102:0/67951018 >> 172.21.15.102:0/67951018 conn(0x564d1fefba80 msgr2=0x564d1ffebbc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 -- 172.21.15.102:0/67951018 shutdown_connections 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 -- 172.21.15.102:0/67951018 wait complete. 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 Processor -- start 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 -- start start 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fff8e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c87813800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d1ff07db0 con 0x564d1ff006b0 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.409+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fff8e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fff8e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44532/0 (socket says 172.21.15.102:44532) 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5c82f48640 1 -- 172.21.15.102:0/581744723 learned_addr learned my addr 172.21.15.102:0/581744723 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5c82f48640 1 -- 172.21.15.102:0/581744723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1fff93c0 con 0x564d1ff006b0 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5c82f48640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fff8e60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x564d1fe74350 tx=0x7f5c74000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5b6f606640 1 -- 172.21.15.102:0/581744723 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c74012030 con 0x564d1ff006b0 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5b6f606640 1 -- 172.21.15.102:0/581744723 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7401a6d0 con 0x564d1ff006b0 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d1fff9650 con 0x564d1ff006b0 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5b6f606640 1 -- 172.21.15.102:0/581744723 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7401a9d0 con 0x564d1ff006b0 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.410+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d1fffa050 con 0x564d1ff006b0 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.411+0000 7f5b6f606640 1 -- 172.21.15.102:0/581744723 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5c74015020 con 0x564d1ff006b0 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.411+0000 7f5b6f606640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b6803cfb0 0x7f5b6803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.411+0000 7f5b6f606640 1 -- 172.21.15.102:0/581744723 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5c74020030 con 0x564d1ff006b0 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.411+0000 7f5c82747640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b6803cfb0 0x7f5b6803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.411+0000 7f5c87813800 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d1ff01ac0 0x564d200004b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.411+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d200009f0 con 0x564d1ff01ac0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.412+0000 7f5c83749640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d1ff01ac0 0x564d200004b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.412+0000 7f5c82747640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b6803cfb0 0x7f5b6803f470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5c78057000 tx=0x7f5c78052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.412+0000 7f5c83749640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d1ff01ac0 0x564d200004b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.412+0000 7f5c83749640 1 -- 172.21.15.102:0/581744723 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d1ff01ac0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.412+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d20000d90 con 0x564d1ff01ac0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.412+0000 7f5c83749640 1 -- 172.21.15.102:0/581744723 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d1ff01ac0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.412+0000 7f5c87813800 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d200028d0 0x564d20004d40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.412+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d200054d0 con 0x564d200028d0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.413+0000 7f5c82f48640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d200028d0 0x564d20004d40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.413+0000 7f5c82f48640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d200028d0 0x564d20004d40 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.413+0000 7f5c82f48640 1 -- 172.21.15.102:0/581744723 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d200028d0 2024-09-19T11:13:57.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.413+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d200015e0 con 0x564d1ff01ac0 2024-09-19T11:13:57.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.413+0000 7f5c83749640 1 -- 172.21.15.102:0/581744723 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d1ff01ac0 2024-09-19T11:13:57.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.413+0000 7f5c87813800 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20006930 0x564d20008d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.413+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d20009460 con 0x564d20006930 2024-09-19T11:13:57.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.414+0000 7f5c82747640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20006930 0x564d20008d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.414+0000 7f5c82747640 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20006930 0x564d20008d20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.414+0000 7f5c82747640 1 -- 172.21.15.102:0/581744723 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5c78051070 con 0x564d20006930 2024-09-19T11:13:57.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.414+0000 7f5c87813800 1 Processor -- start 2024-09-19T11:13:57.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c87813800 1 -- start start 2024-09-19T11:13:57.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c87813800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1fff16f0 0x564d1ffeff60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c87813800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d1fdf84a0 con 0x564d1fff16f0 2024-09-19T11:13:57.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1fff16f0 0x564d1ffeff60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1fff16f0 0x564d1ffeff60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44546/0 (socket says 172.21.15.102:44546) 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c82f48640 1 -- 172.21.15.102:0/1172562181 learned_addr learned my addr 172.21.15.102:0/1172562181 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c82f48640 1 -- 172.21.15.102:0/1172562181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d1fff1c10 con 0x564d1fff16f0 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c82f48640 1 --2- 172.21.15.102:0/1172562181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1fff16f0 0x564d1ffeff60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5c74052b00 tx=0x7f5c7403ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5b6ce01640 1 -- 172.21.15.102:0/1172562181 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7404e070 con 0x564d1fff16f0 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5b6ce01640 1 -- 172.21.15.102:0/1172562181 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c74051570 con 0x564d1fff16f0 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5c87813800 1 -- 172.21.15.102:0/1172562181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d1fff04a0 con 0x564d1fff16f0 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.415+0000 7f5b6ce01640 1 -- 172.21.15.102:0/1172562181 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c740540e0 con 0x564d1fff16f0 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.416+0000 7f5c87813800 1 -- 172.21.15.102:0/1172562181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d1fff09f0 con 0x564d1fff16f0 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.416+0000 7f5b6ce01640 1 -- 172.21.15.102:0/1172562181 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5c74054280 con 0x564d1fff16f0 2024-09-19T11:13:57.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.416+0000 7f5b6ce01640 1 --2- 172.21.15.102:0/1172562181 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b5c03d000 0x7f5b5c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.416+0000 7f5b6ce01640 1 -- 172.21.15.102:0/1172562181 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5c7403d000 con 0x564d1fff16f0 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.416+0000 7f5c82747640 1 --2- 172.21.15.102:0/1172562181 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b5c03d000 0x7f5b5c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c82747640 1 --2- 172.21.15.102:0/1172562181 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b5c03d000 0x7f5b5c03f4c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x564d20005870 tx=0x7f5c78005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c87813800 1 Processor -- start 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c87813800 1 -- start start 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c87813800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d20025ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c87813800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d1fff41c0 con 0x564d20025bf0 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d20025ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d20025ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44552/0 (socket says 172.21.15.102:44552) 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c82f48640 1 -- 172.21.15.102:0/1696918519 learned_addr learned my addr 172.21.15.102:0/1696918519 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.417+0000 7f5c82f48640 1 -- 172.21.15.102:0/1696918519 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d200265e0 con 0x564d20025bf0 2024-09-19T11:13:57.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c82f48640 1 --2- 172.21.15.102:0/1696918519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d20025ff0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5c74018740 tx=0x7f5c7402ad30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=396fdaa75739a922 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5b667fc640 1 -- 172.21.15.102:0/1696918519 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7402d3f0 con 0x564d20025bf0 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5b667fc640 1 -- 172.21.15.102:0/1696918519 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7403b4d0 con 0x564d20025bf0 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5b667fc640 1 -- 172.21.15.102:0/1696918519 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c74022e90 con 0x564d20025bf0 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c87813800 1 -- 172.21.15.102:0/1696918519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 msgr2=0x564d20025ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c87813800 1 --2- 172.21.15.102:0/1696918519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d20025ff0 secure :-1 s=READY pgs=463 cs=0 l=1 rev1=1 crypto rx=0x7f5c74018740 tx=0x7f5c7402ad30 comp rx=0 tx=0).stop 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c87813800 1 -- 172.21.15.102:0/1696918519 shutdown_connections 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c87813800 1 --2- 172.21.15.102:0/1696918519 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d20025ff0 unknown :-1 s=CLOSED pgs=463 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c87813800 1 -- 172.21.15.102:0/1696918519 >> 172.21.15.102:0/1696918519 conn(0x564d20021ff0 msgr2=0x564d20020230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c87813800 1 -- 172.21.15.102:0/1696918519 shutdown_connections 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c87813800 1 -- 172.21.15.102:0/1696918519 wait complete. 2024-09-19T11:13:57.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.418+0000 7f5c87813800 1 Processor -- start 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5c87813800 1 -- start start 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5c87813800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d2002cff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5c87813800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564d20026a50 con 0x564d20025bf0 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d2002cff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5c82f48640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d2002cff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44562/0 (socket says 172.21.15.102:44562) 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 learned_addr learned my addr 172.21.15.102:0/4200732301 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564d2002d550 con 0x564d20025bf0 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5c82f48640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d2002cff0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5c740518b0 tx=0x7f5c7403b320 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5b64ff9640 1 -- 172.21.15.102:0/4200732301 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c740427b0 con 0x564d20025bf0 2024-09-19T11:13:57.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5b64ff9640 1 -- 172.21.15.102:0/4200732301 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5c7402a2a0 con 0x564d20025bf0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.419+0000 7f5b64ff9640 1 -- 172.21.15.102:0/4200732301 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5c7402d3f0 con 0x564d20025bf0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.420+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564d2002d550 con 0x564d20025bf0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.420+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564d2002d550 con 0x564d20025bf0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5b64ff9640 1 -- 172.21.15.102:0/4200732301 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5c7402a580 con 0x564d20025bf0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5b64ff9640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b4c03d000 0x7f5b4c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5b64ff9640 1 -- 172.21.15.102:0/4200732301 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f5c7406aca0 con 0x564d20025bf0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5c82747640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b4c03d000 0x7f5b4c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d200385f0 0x564d2003aa40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2003b190 con 0x564d200385f0 2024-09-19T11:13:57.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5c83749640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d200385f0 0x564d2003aa40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.421+0000 7f5c82747640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b4c03d000 0x7f5b4c03f4c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c780539f0 tx=0x7f5c78053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c83749640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d200385f0 0x564d2003aa40 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 realm 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2003b5a0 con 0x564d200385f0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:57.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2003be70 con 0x564d200385f0 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.422+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d2003cf70 0x564d2003f360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2003f970 con 0x564d2003cf70 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c82f48640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d2003cf70 0x564d2003f360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c82f48640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d2003cf70 0x564d2003f360 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c87813800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c87813800 20 searching for the correct realm 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20041900 0x564d20043dc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d20044440 con 0x564d20041900 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.423+0000 7f5c82747640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20041900 0x564d20043dc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.424+0000 7f5c82747640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20041900 0x564d20043dc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.424+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.424+0000 7f5c82747640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5c7806c040 0x7f5c7805f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.424+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d20044440 con 0x7f5c7806c040 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.424+0000 7f5c83749640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5c7806c040 0x7f5c7805f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.424+0000 7f5c83749640 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5c7806c040 0x7f5c7805f420 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.425+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.425+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.425+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.425+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.425+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.425+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.425+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.425+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x7f5c7806c040 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d20041900 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.426+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.427+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.427+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.427+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.427+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x7f5c7806c040 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.427+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.427+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d20041900 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.427+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.427+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d20041900 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d20041900 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d20041900 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.428+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d20041900 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x7f5c7806c040 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.429+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.430+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.430+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.430+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.430+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d20041900 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.430+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.430+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.430+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.430+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x7f5c7806c040 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.431+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.431+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d20041900 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.431+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.431+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d2003cf70 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.431+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.431+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x564d200385f0 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.431+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.431+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x564d2003c210 con 0x7f5c7806c040 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:57.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2003fd10 con 0x564d200385f0 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2003fd10 con 0x564d200385f0 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2003fd10 con 0x564d20041900 2024-09-19T11:13:57.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.432+0000 7f5c87813800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 zone default found 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 4 Realm: () 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 zonegroup default 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d20040690 con 0x564d2003cf70 2024-09-19T11:13:57.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d20046410 con 0x564d20041900 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d20046850 con 0x564d20041900 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 started sync module instance, tier type = 2024-09-19T11:13:57.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.433+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20045750 con 0x7f5c7806c040 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.434+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.434+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94889249627248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20045750 con 0x7f5c7806c040 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.434+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20047340 con 0x564d200385f0 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.435+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94889249627248] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.435+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.435+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94889249631824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20045750 con 0x564d200385f0 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.435+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20047dc0 con 0x564d20041900 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.436+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.437+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94889249634512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20048670 con 0x564d20041900 2024-09-19T11:13:57.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.437+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20049190 con 0x7f5c7806c040 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.437+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94889249631824] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.438+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.438+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94889249639520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20049580 con 0x7f5c7806c040 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.438+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20049f80 con 0x564d200385f0 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.438+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94889249634512] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.439+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94889249639520] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.439+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.439+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94889249624736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20049a90 con 0x564d200385f0 2024-09-19T11:13:57.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.439+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2004a850 con 0x564d2003cf70 2024-09-19T11:13:57.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.440+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.440+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94889249624736] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.440+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94889249645472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20049a90 con 0x564d2003cf70 2024-09-19T11:13:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.440+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d200481a0 con 0x564d2003cf70 2024-09-19T11:13:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.441+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.441+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94889249649440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2004bd70 con 0x564d2003cf70 2024-09-19T11:13:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.441+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94889249645472] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.441+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2004ac30 con 0x564d2003cf70 2024-09-19T11:13:57.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94889249649440] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'132 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94889249647664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2004c360 con 0x564d2003cf70 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c87813800 20 add_watcher() i=0 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c87813800 20 add_watcher() i=1 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c87813800 20 add_watcher() i=2 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c87813800 20 add_watcher() i=3 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c87813800 20 add_watcher() i=4 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c87813800 20 add_watcher() i=5 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.442+0000 7f5c87813800 20 add_watcher() i=6 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.443+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94889249647664] v35'133 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.443+0000 7f5c87813800 20 add_watcher() i=7 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.443+0000 7f5c87813800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.443+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2004f790 con 0x564d200385f0 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.443+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.443+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94889249650624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2004cce0 con 0x564d200385f0 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.444+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94889249650624] v35'128 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.444+0000 7f5b397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.444+0000 7f5c87813800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.444+0000 7f5c87813800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:57.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.444+0000 7f5c87813800 5 note: GC not initialized 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.445+0000 7f5ab3fff640 20 reqs_thread_entry: start 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.445+0000 7f5c87813800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.445+0000 7f5c87813800 20 Filter name: none 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.445+0000 7f5ab1ffb640 20 reqs_thread_entry: start 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.445+0000 7f5c87813800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.445+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.445+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d200827f0 con 0x564d2003cf70 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(62 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-19T11:13:57.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d20082180 con 0x7f5c7806c040 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv23 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:57.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.446+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d20085f10 con 0x564d2003cf70 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(64 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv3 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c87813800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c87813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c87813800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c87813800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c87813800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c87813800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c87813800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : hit (requested=0x13, cached=0x13) 2024-09-19T11:13:57.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.447+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2008a090 con 0x7f5c7806c040 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.448+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 foo.buckets [call] v35'24 uv24 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.448+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 8.16 8:6abc90e2:root::.bucket.meta.testx%3amyfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [create,call version.inc in=38b,writefull 0~420 in=420b,setxattr user.rgw.acl (203) in=215b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2008d9a0 con 0x564d20041900 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.449+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 .bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [create,call,writefull 0~420,setxattr (203)] v35'1 uv1 ondisk = 0) ==== 338+0+0 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.449+0000 7f5c87813800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x7 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.449+0000 7f5c87813800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.449+0000 7f5c87813800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.449+0000 7f5c87813800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1, ofs0, ns] 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.449+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 7.3 7:c609908c:::notify.5:head [notify cookie 94889249912784 in=867b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2008d4b0 con 0x564d2003cf70 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.449+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== watch-notify(notify (1) cookie 94889249645472 notify 150323855371 ret 0) ==== 897+0+0 (crc 0 0 0) 0x564d20084430 con 0x564d2003cf70 2024-09-19T11:13:57.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5b667fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855371 cookie 94889249645472 notifier 4554 bl.length()=855 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5b667fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x7 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5b667fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5b667fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(67 notify.5 [notify cookie 94889249912784 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5b667fc640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f5b48003ea0 con 0x564d2003cf70 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(68 notify.5 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== watch-notify(notify_complete (2) cookie 94889249912784 notify 150323855371 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564d1fff1c10 con 0x564d2003cf70 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5c87813800 20 handle_bi_update(): bucket=testx:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_sources= new_sources= 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5c87813800 20 handle_bi_update(): bucket=testx:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential sources added=[] removed=[] 2024-09-19T11:13:57.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5c87813800 20 handle_bi_update(): bucket=testx:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_dests= new_dests= 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5c87813800 20 handle_bi_update(): bucket=testx:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential dests added=[] removed=[] 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.450+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2008d590 con 0x564d200385f0 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.451+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(69 testx$tenanteduser.buckets [call] v35'1 uv1 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.451+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [delete,create,call version.inc in=38b,writefull 0~193 in=193b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2008d590 con 0x564d200385f0 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.452+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(70 testx/myfoo [delete,create,call,writefull 0~193] v35'3 uv3 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.452+0000 7f5c87813800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.452+0000 7f5c87813800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.452+0000 7f5c87813800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-19T11:13:57.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.452+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify cookie 94889249919200 in=360b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2008d500 con 0x564d200385f0 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94889249624736 notify 150323855377 ret 0) ==== 390+0+0 (crc 0 0 0) 0x7f5c7c040040 con 0x564d200385f0 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5b65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94889249624736 notifier 4554 bl.length()=348 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5b65ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x7 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5b65ffb640 10 rgw watcher librados: moving default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(71 notify.4 [notify cookie 94889249919200 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5b65ffb640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f5ab8003400 con 0x564d200385f0 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== watch-notify(notify_complete (2) cookie 94889249919200 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564d2008d930 con 0x564d200385f0 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(72 notify.4 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.453+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:73 8.9 8:91b71841:root::myfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2008d590 con 0x7f5c7806c040 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.454+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(73 myfoo [call,delete] v35'25 uv25 ondisk = 0) ==== 191+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.454+0000 7f5c87813800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.454+0000 7f5c87813800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.454+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94889249917360 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d2008d590 con 0x564d2003cf70 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.455+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== watch-notify(notify (1) cookie 94889249649440 notify 150323855372 ret 0) ==== 191+0+0 (crc 0 0 0) 0x564d1fff1c10 con 0x564d2003cf70 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.455+0000 7f5b65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855372 cookie 94889249649440 notifier 4554 bl.length()=149 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.455+0000 7f5b65ffb640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f5ab80033e0 con 0x564d2003cf70 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.455+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(74 notify.6 [notify cookie 94889249917360 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.455+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== watch-notify(notify_complete (2) cookie 94889249917360 notify 150323855372 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564d1fffa050 con 0x564d2003cf70 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.455+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(75 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.455+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d2008c9b0 con 0x564d2003cf70 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.456+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(76 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call,delete] v35'4 uv4 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.456+0000 7f5c87813800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 from cache 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.456+0000 7f5c87813800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1, ofs0, ns] 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.456+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94889249917360 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x564d20085e80 con 0x564d2003cf70 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.456+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== watch-notify(notify (1) cookie 94889249649440 notify 150323855373 ret 0) ==== 248+0+0 (crc 0 0 0) 0x564d1fffa050 con 0x564d2003cf70 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.456+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(77 notify.6 [notify cookie 94889249917360 out=8b] v0'0 uv132 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.456+0000 7f5b65ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94889249649440 notifier 4554 bl.length()=206 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.456+0000 7f5b65ffb640 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f5ab80033e0 con 0x564d2003cf70 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.457+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(78 notify.6 [notify-ack] v0'0 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.457+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== watch-notify(notify_complete (2) cookie 94889249917360 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564d1fff9650 con 0x564d2003cf70 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.458+0000 7f5b397e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.458+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94889249650624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x564d200385f0 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.458+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 94889249650624] v35'129 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.458+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94889249627248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x7f5c7806c040 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.459+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 94889249627248] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.459+0000 7f5c87813800 20 remove_watcher() i=0 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.459+0000 7f5c87813800 2 removed watcher, disabling cache 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.459+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94889249631824] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x564d200385f0 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.460+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 94889249631824] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.461+0000 7f5c87813800 20 remove_watcher() i=1 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.461+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94889249634512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x564d20041900 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.462+0000 7f5c82747640 1 -- 172.21.15.102:0/4200732301 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 94889249634512] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c78051070 con 0x564d20041900 2024-09-19T11:13:57.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.462+0000 7f5c87813800 20 remove_watcher() i=2 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.462+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94889249639520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x7f5c7806c040 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.463+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 94889249639520] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x7f5c7806c040 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.463+0000 7f5c87813800 20 remove_watcher() i=3 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.463+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94889249624736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x564d200385f0 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.464+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 94889249624736] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7c00a4d0 con 0x564d200385f0 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.464+0000 7f5c87813800 20 remove_watcher() i=4 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.464+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94889249645472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x564d2003cf70 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.465+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 94889249645472] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.465+0000 7f5c87813800 20 remove_watcher() i=5 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.465+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94889249649440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x564d2003cf70 2024-09-19T11:13:57.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.466+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 94889249649440] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.466+0000 7f5c87813800 20 remove_watcher() i=6 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.466+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94889249647664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x564d20080520 con 0x564d2003cf70 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c82f48640 1 -- 172.21.15.102:0/4200732301 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 94889249647664] v35'134 uv132 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5c7401ad50 con 0x564d2003cf70 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 20 remove_watcher() i=7 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d2003cf70 msgr2=0x564d2003f360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d2003cf70 0x564d2003f360 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d200385f0 msgr2=0x564d2003aa40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d200385f0 0x564d2003aa40 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5c7806c040 msgr2=0x7f5c7805f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5c7806c040 0x7f5c7805f420 crc :-1 s=READY pgs=53 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20041900 msgr2=0x564d20043dc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.467+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20041900 0x564d20043dc0 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b4c03d000 msgr2=0x7f5b4c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b4c03d000 0x7f5b4c03f4c0 secure :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0x7f5c780539f0 tx=0x7f5c78053000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 msgr2=0x564d2002cff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/4200732301 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d20025bf0 0x564d2002cff0 secure :-1 s=READY pgs=464 cs=0 l=1 rev1=1 crypto rx=0x7f5c740518b0 tx=0x7f5c7403b320 comp rx=0 tx=0).stop 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 reap_dead start 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c83749640 1 -- 172.21.15.102:0/4200732301 reap_dead start 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 shutdown_connections 2024-09-19T11:13:57.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 >> 172.21.15.102:0/4200732301 conn(0x564d20021ff0 msgr2=0x564d20020200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 shutdown_connections 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/4200732301 wait complete. 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/1172562181 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b5c03d000 msgr2=0x7f5b5c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/1172562181 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b5c03d000 0x7f5b5c03f4c0 secure :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0x564d20005870 tx=0x7f5c78005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/1172562181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1fff16f0 msgr2=0x564d1ffeff60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/1172562181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1fff16f0 0x564d1ffeff60 secure :-1 s=READY pgs=462 cs=0 l=1 rev1=1 crypto rx=0x7f5c74052b00 tx=0x7f5c7403ff80 comp rx=0 tx=0).stop 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/1172562181 shutdown_connections 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/1172562181 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b5c03d000 0x7f5b5c03f4c0 unknown :-1 s=CLOSED pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/1172562181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1fff16f0 0x564d1ffeff60 unknown :-1 s=CLOSED pgs=462 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/1172562181 >> 172.21.15.102:0/1172562181 conn(0x564d2000b550 msgr2=0x564d2000b930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/1172562181 shutdown_connections 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/1172562181 wait complete. 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d200028d0 msgr2=0x564d20004d40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564d200028d0 0x564d20004d40 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d1ff01ac0 msgr2=0x564d200004b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564d1ff01ac0 0x564d200004b0 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20006930 msgr2=0x564d20008d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564d20006930 0x564d20008d20 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.468+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b6803cfb0 msgr2=0x7f5b6803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.469+0000 7f5c87813800 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5b6803cfb0 0x7f5b6803f470 secure :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0x7f5c78057000 tx=0x7f5c78052000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.469+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 msgr2=0x564d1fff8e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.469+0000 7f5c87813800 1 --2- 172.21.15.102:0/581744723 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564d1ff006b0 0x564d1fff8e60 secure :-1 s=READY pgs=461 cs=0 l=1 rev1=1 crypto rx=0x564d1fe74350 tx=0x7f5c74000bc0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.469+0000 7f5c83749640 1 -- 172.21.15.102:0/581744723 reap_dead start 2024-09-19T11:13:57.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.469+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 shutdown_connections 2024-09-19T11:13:57.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.469+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 >> 172.21.15.102:0/581744723 conn(0x564d1fefba80 msgr2=0x564d1ffea3b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.469+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 shutdown_connections 2024-09-19T11:13:57.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.469+0000 7f5c87813800 1 -- 172.21.15.102:0/581744723 wait complete. 2024-09-19T11:13:57.495 INFO:tasks.util.rgw:rgwadmin: client.0 : ['metadata', 'get', 'bucket:testx/myfoo'] 2024-09-19T11:13:57.495 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'metadata', 'get', 'bucket:testx/myfoo'] 2024-09-19T11:13:57.495 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph metadata get bucket:testx/myfoo 2024-09-19T11:13:57.539 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:57.539 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feefb71f800 1 Processor -- start 2024-09-19T11:13:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feefb71f800 1 -- start start 2024-09-19T11:13:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feefb71f800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555e05a49690 0x555e05a4a390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feefb71f800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555e05a49d40 con 0x555e05a4a8d0 2024-09-19T11:13:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feefb71f800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x555e058d57d0 con 0x555e05a49690 2024-09-19T11:13:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feef738b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555e05a49690 0x555e05a4a390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feef738b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555e05a49690 0x555e05a4a390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44564/0 (socket says 172.21.15.102:44564) 2024-09-19T11:13:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feef6b8a640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x555e05a4a8d0 0x555e05a4f630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52568/0 (socket says 172.21.15.102:52568) 2024-09-19T11:13:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feef738b640 1 -- 172.21.15.102:0/1474285030 learned_addr learned my addr 172.21.15.102:0/1474285030 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feef738b640 1 -- 172.21.15.102:0/1474285030 >> v1:172.21.15.37:6789/0 conn(0x555e05a4a8d0 legacy=0x555e05a4f630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.539+0000 7feef738b640 1 -- 172.21.15.102:0/1474285030 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e05a4ad80 con 0x555e05a49690 2024-09-19T11:13:57.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.541+0000 7feef738b640 1 --2- 172.21.15.102:0/1474285030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e05a4a390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7feef000a520 tx=0x7feef0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f09ccb19c94b35b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.541+0000 7feef6389640 1 -- 172.21.15.102:0/1474285030 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0055070 con 0x555e05a49690 2024-09-19T11:13:57.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.541+0000 7feef6389640 1 -- 172.21.15.102:0/1474285030 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef00515b0 con 0x555e05a49690 2024-09-19T11:13:57.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.541+0000 7feef6389640 1 -- 172.21.15.102:0/1474285030 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef00518d0 con 0x555e05a49690 2024-09-19T11:13:57.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.542+0000 7feefb71f800 1 -- 172.21.15.102:0/1474285030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 msgr2=0x555e05a4a390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.542+0000 7feefb71f800 1 --2- 172.21.15.102:0/1474285030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e05a4a390 secure :-1 s=READY pgs=466 cs=0 l=1 rev1=1 crypto rx=0x7feef000a520 tx=0x7feef0045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.542+0000 7feefb71f800 1 -- 172.21.15.102:0/1474285030 shutdown_connections 2024-09-19T11:13:57.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.542+0000 7feefb71f800 1 --2- 172.21.15.102:0/1474285030 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e05a4a390 unknown :-1 s=CLOSED pgs=466 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.542+0000 7feefb71f800 1 -- 172.21.15.102:0/1474285030 >> 172.21.15.102:0/1474285030 conn(0x555e05a44a60 msgr2=0x555e05a46ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.542+0000 7feefb71f800 1 -- 172.21.15.102:0/1474285030 shutdown_connections 2024-09-19T11:13:57.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.542+0000 7feefb71f800 1 -- 172.21.15.102:0/1474285030 wait complete. 2024-09-19T11:13:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.556+0000 7feefb71f800 1 Processor -- start 2024-09-19T11:13:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.556+0000 7feefb71f800 1 -- start start 2024-09-19T11:13:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.556+0000 7feefb71f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e059bd820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.556+0000 7feefb71f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555e058e2dd0 con 0x555e05a49690 2024-09-19T11:13:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.556+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e059bd820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.556+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e059bd820 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44574/0 (socket says 172.21.15.102:44574) 2024-09-19T11:13:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.556+0000 7feef738b640 1 -- 172.21.15.102:0/3316597389 learned_addr learned my addr 172.21.15.102:0/3316597389 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.556+0000 7feef738b640 1 -- 172.21.15.102:0/3316597389 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e05b3cfa0 con 0x555e05a49690 2024-09-19T11:13:57.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.557+0000 7feef738b640 1 --2- 172.21.15.102:0/3316597389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e059bd820 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feef0025da0 tx=0x7feef0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=747396134f371bd5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.557+0000 7fede560a640 1 -- 172.21.15.102:0/3316597389 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0051950 con 0x555e05a49690 2024-09-19T11:13:57.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.557+0000 7fede560a640 1 -- 172.21.15.102:0/3316597389 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef0051af0 con 0x555e05a49690 2024-09-19T11:13:57.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.557+0000 7fede560a640 1 -- 172.21.15.102:0/3316597389 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0051dd0 con 0x555e05a49690 2024-09-19T11:13:57.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 -- 172.21.15.102:0/3316597389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 msgr2=0x555e059bd820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 --2- 172.21.15.102:0/3316597389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e059bd820 secure :-1 s=READY pgs=467 cs=0 l=1 rev1=1 crypto rx=0x7feef0025da0 tx=0x7feef0051000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 -- 172.21.15.102:0/3316597389 shutdown_connections 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 --2- 172.21.15.102:0/3316597389 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e059bd820 unknown :-1 s=CLOSED pgs=467 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 -- 172.21.15.102:0/3316597389 >> 172.21.15.102:0/3316597389 conn(0x555e05a44a60 msgr2=0x555e05b34c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 -- 172.21.15.102:0/3316597389 shutdown_connections 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 -- 172.21.15.102:0/3316597389 wait complete. 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 Processor -- start 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 -- start start 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e05b41d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feefb71f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555e05a50d50 con 0x555e05a49690 2024-09-19T11:13:57.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e05b41d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e05b41d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44576/0 (socket says 172.21.15.102:44576) 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feef738b640 1 -- 172.21.15.102:0/2995508641 learned_addr learned my addr 172.21.15.102:0/2995508641 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.558+0000 7feef738b640 1 -- 172.21.15.102:0/2995508641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e05b42270 con 0x555e05a49690 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.559+0000 7feef738b640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e05b41d10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feef0067040 tx=0x7feef0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.559+0000 7fede3e07640 1 -- 172.21.15.102:0/2995508641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0073070 con 0x555e05a49690 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.559+0000 7fede3e07640 1 -- 172.21.15.102:0/2995508641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef005a450 con 0x555e05a49690 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.559+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e05b42500 con 0x555e05a49690 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.559+0000 7fede3e07640 1 -- 172.21.15.102:0/2995508641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef005a730 con 0x555e05a49690 2024-09-19T11:13:57.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.559+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e05b43110 con 0x555e05a49690 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.560+0000 7fede3e07640 1 -- 172.21.15.102:0/2995508641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feef0076070 con 0x555e05a49690 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.560+0000 7fede3e07640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7feddc03cfb0 0x7feddc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.560+0000 7fede3e07640 1 -- 172.21.15.102:0/2995508641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7feef0062070 con 0x555e05a49690 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.560+0000 7feef6b8a640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7feddc03cfb0 0x7feddc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.560+0000 7feefb71f800 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05a4a8d0 0x555e05b49360 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.560+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b498a0 con 0x555e05a4a8d0 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.560+0000 7feef7b8c640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05a4a8d0 0x555e05b49360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.560+0000 7feef6b8a640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7feddc03cfb0 0x7feddc03f470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feee0001e30 tx=0x7feee0001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.561+0000 7feef7b8c640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05a4a8d0 0x555e05b49360 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.561+0000 7feef7b8c640 1 -- 172.21.15.102:0/2995508641 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05a4a8d0 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.561+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b49c40 con 0x555e05a4a8d0 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.561+0000 7feef7b8c640 1 -- 172.21.15.102:0/2995508641 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05a4a8d0 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.561+0000 7feefb71f800 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b4b700 0x555e05b4dba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.561+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b4e330 con 0x555e05b4b700 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.561+0000 7feef738b640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b4b700 0x555e05b4dba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.562+0000 7feef738b640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b4b700 0x555e05b4dba0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.562+0000 7feef738b640 1 -- 172.21.15.102:0/2995508641 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7feef007f070 con 0x555e05b4b700 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.562+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b4a490 con 0x555e05a4a8d0 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.562+0000 7feef7b8c640 1 -- 172.21.15.102:0/2995508641 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05a4a8d0 2024-09-19T11:13:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.562+0000 7feefb71f800 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b4f790 0x555e05b51b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.562+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b522c0 con 0x555e05b4f790 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.563+0000 7feef6b8a640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b4f790 0x555e05b51b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.563+0000 7feef6b8a640 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b4f790 0x555e05b51b80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.563+0000 7feef6b8a640 1 -- 172.21.15.102:0/2995508641 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7feee000bd50 con 0x555e05b4f790 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.563+0000 7feefb71f800 1 Processor -- start 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.563+0000 7feefb71f800 1 -- start start 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7feefb71f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b60040 0x555e05b60460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7feefb71f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555e059414a0 con 0x555e05b60040 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b60040 0x555e05b60460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b60040 0x555e05b60460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44580/0 (socket says 172.21.15.102:44580) 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7feef738b640 1 -- 172.21.15.102:0/568563260 learned_addr learned my addr 172.21.15.102:0/568563260 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7feef738b640 1 -- 172.21.15.102:0/568563260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e05b60aa0 con 0x555e05b60040 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7feef738b640 1 --2- 172.21.15.102:0/568563260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b60040 0x555e05b60460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feef0050e30 tx=0x7feef00507b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7fede1602640 1 -- 172.21.15.102:0/568563260 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef007d040 con 0x555e05b60040 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7fede1602640 1 -- 172.21.15.102:0/568563260 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef0098af0 con 0x555e05b60040 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7feefb71f800 1 -- 172.21.15.102:0/568563260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e05b612d0 con 0x555e05b60040 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.564+0000 7fede1602640 1 -- 172.21.15.102:0/568563260 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0098dd0 con 0x555e05b60040 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.565+0000 7feefb71f800 1 -- 172.21.15.102:0/568563260 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e05b61870 con 0x555e05b60040 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.565+0000 7fede1602640 1 -- 172.21.15.102:0/568563260 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feef0058070 con 0x555e05b60040 2024-09-19T11:13:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.565+0000 7fede1602640 1 --2- 172.21.15.102:0/568563260 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003cfb0 0x7fedd003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.565+0000 7fede1602640 1 -- 172.21.15.102:0/568563260 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7feef00a2c50 con 0x555e05b60040 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.565+0000 7feef6b8a640 1 --2- 172.21.15.102:0/568563260 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003cfb0 0x7fedd003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feefb71f800 1 Processor -- start 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feefb71f800 1 -- start start 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feef6b8a640 1 --2- 172.21.15.102:0/568563260 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003cfb0 0x7fedd003f470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x555e05b4e700 tx=0x7feee000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feefb71f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b6cd60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feefb71f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555e05b3d170 con 0x555e05b6c960 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b6cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b6cd60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44582/0 (socket says 172.21.15.102:44582) 2024-09-19T11:13:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feef738b640 1 -- 172.21.15.102:0/3183712890 learned_addr learned my addr 172.21.15.102:0/3183712890 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feef738b640 1 -- 172.21.15.102:0/3183712890 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e05b6d350 con 0x555e05b6c960 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.566+0000 7feef738b640 1 --2- 172.21.15.102:0/3183712890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b6cd60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feef005a8f0 tx=0x7feef00981f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5cbdf7ac04a80172 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feddaffd640 1 -- 172.21.15.102:0/3183712890 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0070070 con 0x555e05b6c960 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feddaffd640 1 -- 172.21.15.102:0/3183712890 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef00af070 con 0x555e05b6c960 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feddaffd640 1 -- 172.21.15.102:0/3183712890 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef008f080 con 0x555e05b6c960 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 -- 172.21.15.102:0/3183712890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 msgr2=0x555e05b6cd60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 --2- 172.21.15.102:0/3183712890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b6cd60 secure :-1 s=READY pgs=470 cs=0 l=1 rev1=1 crypto rx=0x7feef005a8f0 tx=0x7feef00981f0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 -- 172.21.15.102:0/3183712890 shutdown_connections 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 --2- 172.21.15.102:0/3183712890 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b6cd60 unknown :-1 s=CLOSED pgs=470 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 -- 172.21.15.102:0/3183712890 >> 172.21.15.102:0/3183712890 conn(0x555e05b68d60 msgr2=0x555e05b66fa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 -- 172.21.15.102:0/3183712890 shutdown_connections 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 -- 172.21.15.102:0/3183712890 wait complete. 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 Processor -- start 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.567+0000 7feefb71f800 1 -- start start 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feefb71f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b73da0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feefb71f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555e05b6d7c0 con 0x555e05b6c960 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b73da0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feef738b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b73da0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44596/0 (socket says 172.21.15.102:44596) 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 learned_addr learned my addr 172.21.15.102:0/1483590262 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555e05b74300 con 0x555e05b6c960 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feef738b640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b73da0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feef005a910 tx=0x7feef0088f30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7fedd97fa640 1 -- 172.21.15.102:0/1483590262 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0066030 con 0x555e05b6c960 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7fedd97fa640 1 -- 172.21.15.102:0/1483590262 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7feef006eaa0 con 0x555e05b6c960 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555e05b74300 con 0x555e05b6c960 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7fedd97fa640 1 -- 172.21.15.102:0/1483590262 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7feef0070070 con 0x555e05b6c960 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.568+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555e05b74300 con 0x555e05b6c960 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.569+0000 7fedd97fa640 1 -- 172.21.15.102:0/1483590262 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7feef00c5060 con 0x555e05b6c960 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.569+0000 7fedd97fa640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedc003d000 0x7fedc003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.569+0000 7fedd97fa640 1 -- 172.21.15.102:0/1483590262 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7feef00a7040 con 0x555e05b6c960 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feef6b8a640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedc003d000 0x7fedc003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05b7f220 0x555e05b816b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b81e00 con 0x555e05b7f220 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feef7b8c640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05b7f220 0x555e05b816b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feef6b8a640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedc003d000 0x7fedc003f4c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x555e05b526c0 tx=0x7feee0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feef7b8c640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05b7f220 0x555e05b816b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feefb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feefb71f800 20 realm 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.570+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82210 con 0x555e05b7f220 2024-09-19T11:13:57.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82ae0 con 0x555e05b7f220 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b83970 0x555e05b85d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b864a0 con 0x555e05b83970 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.571+0000 7feef738b640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b83970 0x555e05b85d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.572+0000 7feef738b640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b83970 0x555e05b85d60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.572+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.572+0000 7feefb71f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.572+0000 7feefb71f800 20 searching for the correct realm 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.572+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b88540 0x555e05b8aa00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.572+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8b0d0 con 0x555e05b88540 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.572+0000 7feef6b8a640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b88540 0x555e05b8aa00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.572+0000 7feef6b8a640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b88540 0x555e05b8aa00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0037040 con 0x555e05b88540 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef6b8a640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7feee000f070 0x7feee002e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8b0d0 con 0x7feee000f070 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef7b8c640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7feee000f070 0x7feee002e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef7b8c640 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7feee000f070 0x7feee002e910 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.573+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.574+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.574+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.574+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.574+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.574+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.574+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.574+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.574+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x7feee000f070 2024-09-19T11:13:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.575+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.575+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b88540 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.575+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0037040 con 0x555e05b88540 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.575+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.575+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.575+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.575+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.575+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.576+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.576+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x7feee000f070 2024-09-19T11:13:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.576+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.576+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b88540 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.576+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0037040 con 0x555e05b88540 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.576+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b88540 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.576+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7feee0037040 con 0x555e05b88540 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.576+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b88540 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0037040 con 0x555e05b88540 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b88540 2024-09-19T11:13:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0037040 con 0x555e05b88540 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.577+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.578+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.578+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b88540 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.578+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0037040 con 0x555e05b88540 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.578+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x7feee000f070 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.578+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.578+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.578+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.578+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.579+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.579+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b88540 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.579+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0037040 con 0x555e05b88540 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.579+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.579+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.579+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x7feee000f070 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.579+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.580+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b88540 2024-09-19T11:13:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.580+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee0049040 con 0x555e05b88540 2024-09-19T11:13:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.580+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b83970 2024-09-19T11:13:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.580+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.580+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x555e05b7f220 2024-09-19T11:13:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.580+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.580+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x555e05b82e80 con 0x7feee000f070 2024-09-19T11:13:57.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:57.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:57.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b86e40 con 0x555e05b7f220 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b86e40 con 0x555e05b7f220 2024-09-19T11:13:57.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b86df0 con 0x555e05b88540 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7feee0049040 con 0x555e05b88540 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 zone default found 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 4 Realm: () 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:57.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 zonegroup default 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.581+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b876e0 con 0x555e05b83970 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8cf40 con 0x555e05b88540 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feee0049040 con 0x555e05b88540 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8d2e0 con 0x555e05b88540 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7feee0049040 con 0x555e05b88540 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 20 started sync module instance, tier type = 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.582+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8c3e0 con 0x7feee000f070 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.583+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.583+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93862311282960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8c3e0 con 0x7feee000f070 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.583+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8de10 con 0x555e05b7f220 2024-09-19T11:13:57.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.584+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93862311282960] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.584+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.584+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93862311287008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8c3e0 con 0x555e05b7f220 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.584+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8e890 con 0x555e05b88540 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.585+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93862311287008] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.586+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee0049040 con 0x555e05b88540 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.586+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93862311280432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8c350 con 0x555e05b88540 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.586+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8f780 con 0x7feee000f070 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.587+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.587+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93862311294160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b90020 con 0x7feee000f070 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.587+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b90a70 con 0x555e05b7f220 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.587+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93862311280432] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee0049040 con 0x555e05b88540 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.588+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.588+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93862311294160] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.588+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93862311298400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b90a30 con 0x555e05b7f220 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.588+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8fb70 con 0x555e05b83970 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.589+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93862311298400] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.589+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.589+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93862311292080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b91480 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.589+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b91cd0 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.590+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93862311292080] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.590+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.590+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93862311301072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b92520 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.590+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b92ee0 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v35'135 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(57 notify.6 [watch watch cookie 93862311301072] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93862311308304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b93660 con 0x555e05b83970 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feefb71f800 20 add_watcher() i=0 2024-09-19T11:13:57.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feefb71f800 20 add_watcher() i=1 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feefb71f800 20 add_watcher() i=2 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feefb71f800 20 add_watcher() i=3 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feefb71f800 20 add_watcher() i=4 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feefb71f800 20 add_watcher() i=5 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.591+0000 7feefb71f800 20 add_watcher() i=6 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.592+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93862311308304] v35'136 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.592+0000 7feefb71f800 20 add_watcher() i=7 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.592+0000 7feefb71f800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:57.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.592+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05b92130 con 0x555e05b7f220 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.592+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.592+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93862311309552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b93f30 con 0x555e05b7f220 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.593+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93862311309552] v35'130 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.593+0000 7fedadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.593+0000 7feefb71f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.593+0000 7feefb71f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.593+0000 7feefb71f800 5 note: GC not initialized 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.594+0000 7fedacfe1640 20 reqs_thread_entry: start 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.594+0000 7feefb71f800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:57.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.594+0000 7feefb71f800 20 Filter name: none 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.594+0000 7fed267fc640 20 reqs_thread_entry: start 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.594+0000 7feefb71f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.594+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x555e05bc8fa0 con 0x555e05b7f220 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.594+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 testx/myfoo [call out=48b,stat out=16b,read 0~193 out=193b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 281+0+332 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.594+0000 7feefb71f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.595+0000 7fedadfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.595+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93862311309552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b93f30 con 0x555e05b7f220 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.596+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 93862311309552] v35'131 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.596+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93862311282960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05bc6f30 con 0x7feee000f070 2024-09-19T11:13:57.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.597+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 93862311282960] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.597+0000 7feefb71f800 20 remove_watcher() i=0 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.597+0000 7feefb71f800 2 removed watcher, disabling cache 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.597+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93862311287008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05bc6f30 con 0x555e05b7f220 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.598+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 93862311287008] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.599+0000 7feefb71f800 20 remove_watcher() i=1 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.599+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93862311280432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05bc6f30 con 0x555e05b88540 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.599+0000 7feef6b8a640 1 -- 172.21.15.102:0/1483590262 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 93862311280432] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee0049040 con 0x555e05b88540 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.600+0000 7feefb71f800 20 remove_watcher() i=2 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.600+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93862311294160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8d8e0 con 0x7feee000f070 2024-09-19T11:13:57.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.600+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 93862311294160] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x7feee000f070 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.600+0000 7feefb71f800 20 remove_watcher() i=3 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.600+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93862311298400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8bf30 con 0x555e05b7f220 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.602+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 93862311298400] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feee800a4d0 con 0x555e05b7f220 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.602+0000 7feefb71f800 20 remove_watcher() i=4 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.602+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93862311292080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8d8e0 con 0x555e05b83970 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.603+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 93862311292080] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.603+0000 7feefb71f800 20 remove_watcher() i=5 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.603+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93862311301072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8bf30 con 0x555e05b83970 2024-09-19T11:13:57.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.604+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 93862311301072] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.604+0000 7feefb71f800 20 remove_watcher() i=6 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.604+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93862311308304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x555e05b8ecb0 con 0x555e05b83970 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feef738b640 1 -- 172.21.15.102:0/1483590262 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 93862311308304] v35'137 uv135 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7feef009e020 con 0x555e05b83970 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 20 remove_watcher() i=7 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b83970 msgr2=0x555e05b85d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b83970 0x555e05b85d60 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05b7f220 msgr2=0x555e05b816b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05b7f220 0x555e05b816b0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7feee000f070 msgr2=0x7feee002e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7feee000f070 0x7feee002e910 crc :-1 s=READY pgs=54 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b88540 msgr2=0x555e05b8aa00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b88540 0x555e05b8aa00 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedc003d000 msgr2=0x7fedc003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedc003d000 0x7fedc003f4c0 secure :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0x555e05b526c0 tx=0x7feee0010000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 msgr2=0x555e05b73da0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 --2- 172.21.15.102:0/1483590262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b6c960 0x555e05b73da0 secure :-1 s=READY pgs=471 cs=0 l=1 rev1=1 crypto rx=0x7feef005a910 tx=0x7feef0088f30 comp rx=0 tx=0).stop 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 reap_dead start 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feef7b8c640 1 -- 172.21.15.102:0/1483590262 reap_dead start 2024-09-19T11:13:57.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 shutdown_connections 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 >> 172.21.15.102:0/1483590262 conn(0x555e05b68d60 msgr2=0x555e05b66f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 shutdown_connections 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.605+0000 7feefb71f800 1 -- 172.21.15.102:0/1483590262 wait complete. 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/568563260 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003cfb0 msgr2=0x7fedd003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/568563260 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003cfb0 0x7fedd003f470 secure :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0x555e05b4e700 tx=0x7feee000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/568563260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b60040 msgr2=0x555e05b60460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/568563260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b60040 0x555e05b60460 secure :-1 s=READY pgs=469 cs=0 l=1 rev1=1 crypto rx=0x7feef0050e30 tx=0x7feef00507b0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/568563260 shutdown_connections 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/568563260 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fedd003cfb0 0x7fedd003f470 unknown :-1 s=CLOSED pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/568563260 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05b60040 0x555e05b60460 unknown :-1 s=CLOSED pgs=469 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/568563260 >> 172.21.15.102:0/568563260 conn(0x555e05b543f0 msgr2=0x555e05b547d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/568563260 shutdown_connections 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/568563260 wait complete. 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b4b700 msgr2=0x555e05b4dba0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555e05b4b700 0x555e05b4dba0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05a4a8d0 msgr2=0x555e05b49360 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555e05a4a8d0 0x555e05b49360 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b4f790 msgr2=0x555e05b51b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555e05b4f790 0x555e05b51b80 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7feddc03cfb0 msgr2=0x7feddc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7feddc03cfb0 0x7feddc03f470 secure :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0x7feee0001e30 tx=0x7feee0001390 comp rx=0 tx=0).stop 2024-09-19T11:13:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 msgr2=0x555e05b41d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 --2- 172.21.15.102:0/2995508641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555e05a49690 0x555e05b41d10 secure :-1 s=READY pgs=468 cs=0 l=1 rev1=1 crypto rx=0x7feef0067040 tx=0x7feef0002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feef7b8c640 1 -- 172.21.15.102:0/2995508641 reap_dead start 2024-09-19T11:13:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 shutdown_connections 2024-09-19T11:13:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 >> 172.21.15.102:0/2995508641 conn(0x555e05a44a60 msgr2=0x555e05b33410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 shutdown_connections 2024-09-19T11:13:57.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.606+0000 7feefb71f800 1 -- 172.21.15.102:0/2995508641 wait complete. 2024-09-19T11:13:57.633 INFO:teuthology.orchestra.run.smithi102.stdout:{"key":"bucket:testx/myfoo","ver":{"tag":"9uKroedKm/uz6QqGdNCwIW5E","ver":2},"mtime":"2024-09-19T11:13:57.452470Z","data":{"bucket":{"name":"myfoo","marker":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","bucket_id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","tenant":"testx","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""}},"owner":"testx$tenanteduser","creation_time":"2024-09-19T11:13:54.975364Z","linked":true,"has_bucket_info":false}} 2024-09-19T11:13:57.634 DEBUG:tasks.util.rgw: json result: {'key': 'bucket:testx/myfoo', 'ver': {'tag': '9uKroedKm/uz6QqGdNCwIW5E', 'ver': 2}, 'mtime': '2024-09-19T11:13:57.452470Z', 'data': {'bucket': {'name': 'myfoo', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'bucket_id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'tenant': 'testx', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}}, 'owner': 'testx$tenanteduser', 'creation_time': '2024-09-19T11:13:54.975364Z', 'linked': True, 'has_bucket_info': False}} 2024-09-19T11:13:57.634 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-19T11:13:57.634 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'link', '--bucket', 'testx/myfoo', '--uid', 'foo'] 2024-09-19T11:13:57.634 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket link --bucket testx/myfoo --uid foo 2024-09-19T11:13:57.720 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:57.720 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:57.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04e0b1f800 1 Processor -- start 2024-09-19T11:13:57.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04e0b1f800 1 -- start start 2024-09-19T11:13:57.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04e0b1f800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55699a0a3860 0x55699a0ac380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04e0b1f800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55699a0ac8c0 con 0x55699a0a1d40 2024-09-19T11:13:57.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04e0b1f800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x556999f2e7d0 con 0x55699a0a3860 2024-09-19T11:13:57.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04dbf8a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55699a0a3860 0x55699a0ac380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04dbf8a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55699a0a3860 0x55699a0ac380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44610/0 (socket says 172.21.15.102:44610) 2024-09-19T11:13:57.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04dbf8a640 1 -- 172.21.15.102:0/3820322834 learned_addr learned my addr 172.21.15.102:0/3820322834 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.720+0000 7f04dc78b640 1 --1- 172.21.15.102:0/3820322834 >> v1:172.21.15.37:6789/0 conn(0x55699a0a1d40 0x55699a0a2140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52584/0 (socket says 172.21.15.102:52584) 2024-09-19T11:13:57.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.721+0000 7f04dbf8a640 1 -- 172.21.15.102:0/3820322834 >> v1:172.21.15.37:6789/0 conn(0x55699a0a1d40 legacy=0x55699a0a2140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.721+0000 7f04dbf8a640 1 -- 172.21.15.102:0/3820322834 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a0adaa0 con 0x55699a0a3860 2024-09-19T11:13:57.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.722+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/3820322834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a3860 0x55699a0ac380 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f04c400a520 tx=0x7f04c4045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1d71be8bb7631853 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04db789640 1 -- 172.21.15.102:0/3820322834 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c4055070 con 0x55699a0a3860 2024-09-19T11:13:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04db789640 1 -- 172.21.15.102:0/3820322834 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04c40515b0 con 0x55699a0a3860 2024-09-19T11:13:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04db789640 1 -- 172.21.15.102:0/3820322834 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04c40518d0 con 0x55699a0a3860 2024-09-19T11:13:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3820322834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a3860 msgr2=0x55699a0ac380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/3820322834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a3860 0x55699a0ac380 secure :-1 s=READY pgs=473 cs=0 l=1 rev1=1 crypto rx=0x7f04c400a520 tx=0x7f04c4045ba0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3820322834 shutdown_connections 2024-09-19T11:13:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/3820322834 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a3860 0x55699a0ac380 unknown :-1 s=CLOSED pgs=473 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3820322834 >> 172.21.15.102:0/3820322834 conn(0x55699a09da70 msgr2=0x55699a09fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3820322834 shutdown_connections 2024-09-19T11:13:57.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.723+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3820322834 wait complete. 2024-09-19T11:13:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04e0b1f800 1 Processor -- start 2024-09-19T11:13:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04e0b1f800 1 -- start start 2024-09-19T11:13:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04e0b1f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a195530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04e0b1f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556999f3bdd0 con 0x55699a0a1d40 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a195530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a195530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44616/0 (socket says 172.21.15.102:44616) 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04dc78b640 1 -- 172.21.15.102:0/3075990159 learned_addr learned my addr 172.21.15.102:0/3075990159 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04dc78b640 1 -- 172.21.15.102:0/3075990159 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a195b20 con 0x55699a0a1d40 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.737+0000 7f04dc78b640 1 --2- 172.21.15.102:0/3075990159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a195530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00b260 tx=0x7f04cc00b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=32927704913e6bf9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f03ca60c640 1 -- 172.21.15.102:0/3075990159 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc00be60 con 0x55699a0a1d40 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f03ca60c640 1 -- 172.21.15.102:0/3075990159 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc006070 con 0x55699a0a1d40 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f03ca60c640 1 -- 172.21.15.102:0/3075990159 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc00e710 con 0x55699a0a1d40 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3075990159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 msgr2=0x55699a195530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/3075990159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a195530 secure :-1 s=READY pgs=474 cs=0 l=1 rev1=1 crypto rx=0x7f04cc00b260 tx=0x7f04cc00b660 comp rx=0 tx=0).stop 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3075990159 shutdown_connections 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/3075990159 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a195530 unknown :-1 s=CLOSED pgs=474 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3075990159 >> 172.21.15.102:0/3075990159 conn(0x55699a09da70 msgr2=0x55699a190eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3075990159 shutdown_connections 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.738+0000 7f04e0b1f800 1 -- 172.21.15.102:0/3075990159 wait complete. 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.739+0000 7f04e0b1f800 1 Processor -- start 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.739+0000 7f04e0b1f800 1 -- start start 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.739+0000 7f04e0b1f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a19d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.739+0000 7f04e0b1f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55699a0acd60 con 0x55699a0a1d40 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.739+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a19d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.739+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a19d080 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44632/0 (socket says 172.21.15.102:44632) 2024-09-19T11:13:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.739+0000 7f04dc78b640 1 -- 172.21.15.102:0/1844061016 learned_addr learned my addr 172.21.15.102:0/1844061016 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.739+0000 7f04dc78b640 1 -- 172.21.15.102:0/1844061016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a19d5e0 con 0x55699a0a1d40 2024-09-19T11:13:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.740+0000 7f04dc78b640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a19d080 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55699a1964c0 tx=0x7f04cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.740+0000 7f03c8e09640 1 -- 172.21.15.102:0/1844061016 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc00ee10 con 0x55699a0a1d40 2024-09-19T11:13:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.740+0000 7f03c8e09640 1 -- 172.21.15.102:0/1844061016 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc00fa30 con 0x55699a0a1d40 2024-09-19T11:13:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.740+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55699a19d870 con 0x55699a0a1d40 2024-09-19T11:13:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.740+0000 7f03c8e09640 1 -- 172.21.15.102:0/1844061016 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc00fd30 con 0x55699a0a1d40 2024-09-19T11:13:57.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.740+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55699a19e270 con 0x55699a0a1d40 2024-09-19T11:13:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.741+0000 7f03c8e09640 1 -- 172.21.15.102:0/1844061016 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f04cc017070 con 0x55699a0a1d40 2024-09-19T11:13:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.741+0000 7f03c8e09640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03c403cfb0 0x7f03c403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.741+0000 7f03c8e09640 1 -- 172.21.15.102:0/1844061016 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f04cc015020 con 0x55699a0a1d40 2024-09-19T11:13:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.741+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03c403cfb0 0x7f03c403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.741+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a0a3860 0x55699a1a46d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.741+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1a4c10 con 0x55699a0a3860 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.741+0000 7f04dcf8c640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a0a3860 0x55699a1a46d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.741+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03c403cfb0 0x7f03c403f470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04c4057000 tx=0x7f04c4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.742+0000 7f04dcf8c640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a0a3860 0x55699a1a46d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.742+0000 7f04dcf8c640 1 -- 172.21.15.102:0/1844061016 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a0a3860 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.742+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1a4fb0 con 0x55699a0a3860 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.742+0000 7f04dcf8c640 1 -- 172.21.15.102:0/1844061016 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a0a3860 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.742+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1a6ab0 0x55699a1a8f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.742+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1a96c0 con 0x55699a1a6ab0 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.742+0000 7f04dc78b640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1a6ab0 0x55699a1a8f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.743+0000 7f04dc78b640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1a6ab0 0x55699a1a8f30 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.743+0000 7f04dc78b640 1 -- 172.21.15.102:0/1844061016 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f04cc02e070 con 0x55699a1a6ab0 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.743+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1a5800 con 0x55699a0a3860 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.743+0000 7f04dcf8c640 1 -- 172.21.15.102:0/1844061016 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a0a3860 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.743+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1aab20 0x55699a1acf10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.743+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1ad650 con 0x55699a1aab20 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.743+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1aab20 0x55699a1acf10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.744+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1aab20 0x55699a1acf10 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.744+0000 7f04dbf8a640 1 -- 172.21.15.102:0/1844061016 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1aab20 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.744+0000 7f04e0b1f800 1 Processor -- start 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.744+0000 7f04e0b1f800 1 -- start start 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.744+0000 7f04e0b1f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1bb390 0x55699a1bb7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.744+0000 7f04e0b1f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556999f9a4a0 con 0x55699a1bb390 2024-09-19T11:13:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1bb390 0x55699a1bb7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1bb390 0x55699a1bb7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44634/0 (socket says 172.21.15.102:44634) 2024-09-19T11:13:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f04dc78b640 1 -- 172.21.15.102:0/4026884806 learned_addr learned my addr 172.21.15.102:0/4026884806 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f04dc78b640 1 -- 172.21.15.102:0/4026884806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a1bbdf0 con 0x55699a1bb390 2024-09-19T11:13:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f04dc78b640 1 --2- 172.21.15.102:0/4026884806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1bb390 0x55699a1bb7b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0176b0 tx=0x7f04cc0197b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f03c1ffb640 1 -- 172.21.15.102:0/4026884806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc01a9f0 con 0x55699a1bb390 2024-09-19T11:13:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f03c1ffb640 1 -- 172.21.15.102:0/4026884806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc0450d0 con 0x55699a1bb390 2024-09-19T11:13:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f03c1ffb640 1 -- 172.21.15.102:0/4026884806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc04c030 con 0x55699a1bb390 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f04e0b1f800 1 -- 172.21.15.102:0/4026884806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55699a1bc620 con 0x55699a1bb390 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.745+0000 7f04e0b1f800 1 -- 172.21.15.102:0/4026884806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55699a1bcbc0 con 0x55699a1bb390 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.746+0000 7f03c1ffb640 1 -- 172.21.15.102:0/4026884806 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f04cc04c1d0 con 0x55699a1bb390 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.746+0000 7f03c1ffb640 1 --2- 172.21.15.102:0/4026884806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03b403d050 0x7f03b403f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.746+0000 7f03c1ffb640 1 -- 172.21.15.102:0/4026884806 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f04cc03bda0 con 0x55699a1bb390 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.746+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/4026884806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03b403d050 0x7f03b403f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04e0b1f800 1 Processor -- start 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04e0b1f800 1 -- start start 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/4026884806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03b403d050 0x7f03b403f510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f04c4000c00 tx=0x7f04c4005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04e0b1f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1c8090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04e0b1f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55699a195f50 con 0x55699a1c7cb0 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1c8090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1c8090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44646/0 (socket says 172.21.15.102:44646) 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04dc78b640 1 -- 172.21.15.102:0/2031163133 learned_addr learned my addr 172.21.15.102:0/2031163133 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04dc78b640 1 -- 172.21.15.102:0/2031163133 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a1c8660 con 0x55699a1c7cb0 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f04dc78b640 1 --2- 172.21.15.102:0/2031163133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1c8090 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f04cc01bfd0 tx=0x7f04cc01db00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=18e26fbc90a21d2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f03b37fe640 1 -- 172.21.15.102:0/2031163133 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc04c5f0 con 0x55699a1c7cb0 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f03b37fe640 1 -- 172.21.15.102:0/2031163133 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc04c800 con 0x55699a1c7cb0 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.747+0000 7f03b37fe640 1 -- 172.21.15.102:0/2031163133 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc032ca0 con 0x55699a1c7cb0 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2031163133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 msgr2=0x55699a1c8090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2031163133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1c8090 secure :-1 s=READY pgs=477 cs=0 l=1 rev1=1 crypto rx=0x7f04cc01bfd0 tx=0x7f04cc01db00 comp rx=0 tx=0).stop 2024-09-19T11:13:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2031163133 shutdown_connections 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2031163133 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1c8090 unknown :-1 s=CLOSED pgs=477 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2031163133 >> 172.21.15.102:0/2031163133 conn(0x55699a1c40b0 msgr2=0x55699a1c22f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2031163133 shutdown_connections 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2031163133 wait complete. 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 Processor -- start 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 -- start start 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1cf110 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.748+0000 7f04e0b1f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55699a1c8b10 con 0x55699a1c7cb0 2024-09-19T11:13:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1cf110 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f04dc78b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1cf110 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44654/0 (socket says 172.21.15.102:44654) 2024-09-19T11:13:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 learned_addr learned my addr 172.21.15.102:0/2736586003 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55699a1cf670 con 0x55699a1c7cb0 2024-09-19T11:13:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f04dc78b640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1cf110 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f04cc057010 tx=0x7f04cc017f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f03b1ffb640 1 -- 172.21.15.102:0/2736586003 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc04c9b0 con 0x55699a1c7cb0 2024-09-19T11:13:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f03b1ffb640 1 -- 172.21.15.102:0/2736586003 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f04cc069070 con 0x55699a1c7cb0 2024-09-19T11:13:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55699a1cf670 con 0x55699a1c7cb0 2024-09-19T11:13:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f03b1ffb640 1 -- 172.21.15.102:0/2736586003 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04cc0456e0 con 0x55699a1c7cb0 2024-09-19T11:13:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.749+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55699a1cf670 con 0x55699a1c7cb0 2024-09-19T11:13:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.750+0000 7f03b1ffb640 1 -- 172.21.15.102:0/2736586003 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f04cc06b030 con 0x55699a1c7cb0 2024-09-19T11:13:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.750+0000 7f03b1ffb640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03a403cf60 0x7f03a403f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.750+0000 7f03b1ffb640 1 -- 172.21.15.102:0/2736586003 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7f04cc06ec70 con 0x55699a1c7cb0 2024-09-19T11:13:57.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.750+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03a403cf60 0x7f03a403f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03a403cf60 0x7f03a403f420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55699a1ada50 tx=0x7f04c406d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a1da740 0x55699a1dcc00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1dd350 con 0x55699a1da740 2024-09-19T11:13:57.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04dcf8c640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a1da740 0x55699a1dcc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04dcf8c640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a1da740 0x55699a1dcc00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04e0b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.751+0000 7f04e0b1f800 20 realm 2024-09-19T11:13:57.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1dd760 con 0x55699a1da740 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de030 con 0x55699a1da740 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1df130 0x55699a1e1520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.752+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e1ae0 con 0x55699a1df130 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.753+0000 7f04dc78b640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1df130 0x55699a1e1520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.753+0000 7f04dc78b640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1df130 0x55699a1e1520 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.753+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.753+0000 7f04e0b1f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.753+0000 7f04e0b1f800 20 searching for the correct realm 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.753+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1e3a90 0x55699a1e5f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.753+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e6620 con 0x55699a1e3a90 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.753+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1e3a90 0x55699a1e5f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.754+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1e3a90 0x55699a1e5f50 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.754+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.754+0000 7f04dbf8a640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f04c4069040 0x7f04c406a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.754+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e6620 con 0x7f04c4069040 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.754+0000 7f04dcf8c640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f04c4069040 0x7f04c406a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.754+0000 7f04dcf8c640 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f04c4069040 0x7f04c406a940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.754+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.754+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.755+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.755+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.755+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.755+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.755+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.755+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x7f04c4069040 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1e3a90 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.756+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.757+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.757+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.757+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.757+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x7f04c4069040 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.757+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.757+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1e3a90 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.757+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.757+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1e3a90 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1e3a90 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1e3a90 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.789 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.758+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.759+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.759+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.759+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.759+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1e3a90 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.759+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.759+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x7f04c4069040 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.759+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.759+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.760+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.760+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.790 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.760+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.760+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1e3a90 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.760+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.760+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.761+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.761+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x7f04c4069040 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.761+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.761+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1e3a90 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.761+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.761+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1df130 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.761+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.761+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x55699a1da740 2024-09-19T11:13:57.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55699a1de3d0 con 0x7f04c4069040 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e23a0 con 0x55699a1da740 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e23a0 con 0x55699a1da740 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.762+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e23a0 con 0x55699a1e3a90 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 zone default found 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 4 Realm: () 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:57.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 zonegroup default 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e2ca0 con 0x55699a1df130 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e85c0 con 0x55699a1e3a90 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e8a30 con 0x55699a1e3a90 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.763+0000 7f04e0b1f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.764+0000 7f04e0b1f800 20 started sync module instance, tier type = 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.764+0000 7f04e0b1f800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.764+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e7930 con 0x7f04c4069040 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.765+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.765+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93912045616720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e7930 con 0x7f04c4069040 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.765+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e94f0 con 0x55699a1da740 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.766+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 93912045616720] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.766+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.766+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93912045614208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e94b0 con 0x55699a1da740 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.766+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e9f90 con 0x55699a1e3a90 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.767+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93912045614208] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.767+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.767+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93912045621248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1e9420 con 0x55699a1e3a90 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.767+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1eae50 con 0x7f04c4069040 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.768+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93912045621248] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.768+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.768+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93912045627808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1eadc0 con 0x7f04c4069040 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.768+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1ebbe0 con 0x55699a1da740 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.769+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.769+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93912045631216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1ebbe0 con 0x55699a1da740 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.769+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1ecb10 con 0x55699a1df130 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.769+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 93912045627808] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.770+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93912045631216] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.770+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.770+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93912045633488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1eb240 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.770+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1ed3e0 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.771+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.771+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93912045639552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1ee050 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.771+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1eea50 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.772+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 93912045633488] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.772+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93912045639552] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'138 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93912045640608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1ee560 con 0x55699a1df130 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04e0b1f800 20 add_watcher() i=0 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04e0b1f800 20 add_watcher() i=1 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04e0b1f800 20 add_watcher() i=2 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04e0b1f800 20 add_watcher() i=3 2024-09-19T11:13:57.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04e0b1f800 20 add_watcher() i=4 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04e0b1f800 20 add_watcher() i=5 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.774+0000 7f04e0b1f800 20 add_watcher() i=6 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.775+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 93912045640608] v35'139 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.775+0000 7f04e0b1f800 20 add_watcher() i=7 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.775+0000 7f04e0b1f800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.775+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a1f1ce0 con 0x55699a1da740 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.775+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.775+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93912045635104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a1ef1d0 con 0x55699a1da740 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93912045635104] v35'132 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f03927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04e0b1f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04e0b1f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:57.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04e0b1f800 5 note: GC not initialized 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f03917e2640 20 reqs_thread_entry: start 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04e0b1f800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04e0b1f800 20 Filter name: none 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f0302ffd640 20 reqs_thread_entry: start 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04e0b1f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.777+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a224b50 con 0x55699a1da740 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:57.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 10 cache get: name=default.rgw.meta+root+testx/myfoo : miss 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a226ae0 con 0x55699a1da740 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 testx/myfoo [call out=48b,read 0~193 out=193b] v0'0 uv3 ondisk = 0) ==== 197+0+241 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 20 rados_obj.operate() r=0 bl.length=193 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 10 cache put: name=default.rgw.meta+root+testx/myfoo info.flags=0x11 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 10 adding default.rgw.meta+root+testx/myfoo to cache LRU end 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.778+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 8.16 8:6abc90e2:root::.bucket.meta.testx%3amyfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a228350 con 0x55699a1e3a90 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 .bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~420 out=420b,getxattrs out=298b] v0'0 uv1 ondisk = 0) ==== 338+0+782 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04e0b1f800 20 rados_obj.operate() r=0 bl.length=420 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04e0b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04e0b1f800 10 adding default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04e0b1f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04e0b1f800 10 updating xattr: name=user.rgw.acl bl.length()=203 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04e0b1f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04e0b1f800 10 cache get: name=default.rgw.meta+users.uid+foo : hit (requested=0x13, cached=0x13) 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.779+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a22ce50 con 0x55699a1da740 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.780+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 testx$tenanteduser.buckets [call] v35'2 uv2 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.780+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [create,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a230760 con 0x55699a1df130 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(66 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [create,call,writefull 0~387,setxattr (123)] v35'5 uv5 ondisk = 0) ==== 332+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f04e0b1f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x7 2024-09-19T11:13:57.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f04e0b1f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f04e0b1f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f04e0b1f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1, ofs0, ns] 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93912045904736 in=748b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a230020 con 0x55699a1df130 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== watch-notify(notify (1) cookie 93912045639552 notify 150323855374 ret 0) ==== 778+0+0 (crc 0 0 0) 0x55699a1bc620 con 0x55699a1df130 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f03b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855374 cookie 93912045639552 notifier 4568 bl.length()=736 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f03b37fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x7 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f03b37fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f03b37fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f03b37fe640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f03a0003ea0 con 0x55699a1df130 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.781+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(67 notify.6 [notify cookie 93912045904736 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.782+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.782+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== watch-notify(notify_complete (2) cookie 93912045904736 notify 150323855374 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55699a1bbdf0 con 0x55699a1df130 2024-09-19T11:13:57.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.782+0000 7f04e0b1f800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_sources= new_sources= 2024-09-19T11:13:57.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.782+0000 7f04e0b1f800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential sources added=[] removed=[] 2024-09-19T11:13:57.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.782+0000 7f04e0b1f800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_dests= new_dests= 2024-09-19T11:13:57.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.782+0000 7f04e0b1f800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential dests added=[] removed=[] 2024-09-19T11:13:57.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.782+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a22bf30 con 0x7f04c4069040 2024-09-19T11:13:57.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.783+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(69 foo.buckets [call] v35'26 uv26 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.783+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 8.9 8:91b71841:root::myfoo:head [delete,create,call version.inc in=38b,writefull 0~165 in=165b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a22bf30 con 0x7f04c4069040 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 myfoo [delete,create,call,writefull 0~165] v35'27 uv27 ondisk = 0) ==== 275+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f04e0b1f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f04e0b1f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f04e0b1f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93912045894272 in=326b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a22bea0 con 0x55699a1df130 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== watch-notify(notify (1) cookie 93912045639552 notify 150323855375 ret 0) ==== 356+0+0 (crc 0 0 0) 0x55699a19e270 con 0x55699a1df130 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f03b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855375 cookie 93912045639552 notifier 4568 bl.length()=314 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f03b2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo info.flags=0x7 2024-09-19T11:13:57.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f03b2ffd640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(71 notify.6 [notify cookie 93912045894272 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.784+0000 7f03b2ffd640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0310003400 con 0x55699a1df130 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.785+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(72 notify.6 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.785+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== watch-notify(notify_complete (2) cookie 93912045894272 notify 150323855375 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55699a19d870 con 0x55699a1df130 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.785+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:73 8.5 8:a7a6c9d8:root::testx%2fmyfoo:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a22bf30 con 0x55699a1da740 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(73 testx/myfoo [call,delete] v35'4 uv4 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04e0b1f800 10 removing default.rgw.meta+root+testx/myfoo from cache 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04e0b1f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:testx/myfoo, ofs0, ns] 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:74 7.d 7:b4812045:::notify.4:head [notify cookie 93912045894272 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a22bea0 con 0x55699a1da740 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== watch-notify(notify (1) cookie 93912045631216 notify 150323855378 ret 0) ==== 197+0+0 (crc 0 0 0) 0x55699a22c2d0 con 0x55699a1da740 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f03b37fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 93912045631216 notifier 4568 bl.length()=155 2024-09-19T11:13:57.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f03b37fe640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f03a0003ea0 con 0x55699a1da740 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(74 notify.4 [notify cookie 93912045894272 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== watch-notify(notify_complete (2) cookie 93912045894272 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55699a22f370 con 0x55699a1da740 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(75 notify.4 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.786+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:76 8.16 8:6abc90e2:root::.bucket.meta.testx%3amyfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a22bef0 con 0x55699a1e3a90 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.787+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(76 .bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call,delete] v35'2 uv2 ondisk = 0) ==== 254+0+0 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.787+0000 7f04e0b1f800 10 removing default.rgw.meta+root+.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 from cache 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.787+0000 7f04e0b1f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.testx:myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1, ofs0, ns] 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.787+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.3 7:c609908c:::notify.5:head [notify cookie 93912045881840 in=224b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55699a22bef0 con 0x55699a1df130 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.788+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== watch-notify(notify (1) cookie 93912045633488 notify 150323855376 ret 0) ==== 254+0+0 (crc 0 0 0) 0x55699a19d870 con 0x55699a1df130 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.788+0000 7f03b2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855376 cookie 93912045633488 notifier 4568 bl.length()=212 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.788+0000 7f03b2ffd640 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7f0310003470 con 0x55699a1df130 2024-09-19T11:13:57.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.788+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(77 notify.5 [notify cookie 93912045881840 out=8b] v0'0 uv138 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.788+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(78 notify.5 [notify-ack] v0'0 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.788+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== watch-notify(notify_complete (2) cookie 93912045881840 notify 150323855376 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55699a19d5e0 con 0x55699a1df130 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.789+0000 7f03927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.789+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:79 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93912045635104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x55699a1da740 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.790+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(79 data_loggenerations_metadata [watch unwatch cookie 93912045635104] v35'133 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.790+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:80 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93912045616720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x7f04c4069040 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.791+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(80 notify.0 [watch unwatch cookie 93912045616720] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.791+0000 7f04e0b1f800 20 remove_watcher() i=0 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.791+0000 7f04e0b1f800 2 removed watcher, disabling cache 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.791+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93912045614208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x55699a1da740 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.792+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(81 notify.1 [watch unwatch cookie 93912045614208] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.792+0000 7f04e0b1f800 20 remove_watcher() i=1 2024-09-19T11:13:57.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.792+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93912045621248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x55699a1e3a90 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.793+0000 7f04dbf8a640 1 -- 172.21.15.102:0/2736586003 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(82 notify.2 [watch unwatch cookie 93912045621248] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04c4057030 con 0x55699a1e3a90 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.793+0000 7f04e0b1f800 20 remove_watcher() i=2 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.793+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93912045627808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x7f04c4069040 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.794+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(83 notify.3 [watch unwatch cookie 93912045627808] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x7f04c4069040 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.794+0000 7f04e0b1f800 20 remove_watcher() i=3 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.794+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:84 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93912045631216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x55699a1da740 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.795+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(84 notify.4 [watch unwatch cookie 93912045631216] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04d400a4d0 con 0x55699a1da740 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.795+0000 7f04e0b1f800 20 remove_watcher() i=4 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.795+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93912045633488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x55699a1df130 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.796+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(85 notify.5 [watch unwatch cookie 93912045633488] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.796+0000 7f04e0b1f800 20 remove_watcher() i=5 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.796+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:86 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93912045639552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x55699a1df130 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.797+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(86 notify.6 [watch unwatch cookie 93912045639552] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.797+0000 7f04e0b1f800 20 remove_watcher() i=6 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.797+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:87 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93912045640608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55699a2229f0 con 0x55699a1df130 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04dc78b640 1 -- 172.21.15.102:0/2736586003 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(87 notify.7 [watch unwatch cookie 93912045640608] v35'140 uv138 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f04cc038070 con 0x55699a1df130 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 20 remove_watcher() i=7 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1df130 msgr2=0x55699a1e1520 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1df130 0x55699a1e1520 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a1da740 msgr2=0x55699a1dcc00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a1da740 0x55699a1dcc00 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f04c4069040 msgr2=0x7f04c406a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f04c4069040 0x7f04c406a940 crc :-1 s=READY pgs=55 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1e3a90 msgr2=0x55699a1e5f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.798+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1e3a90 0x55699a1e5f50 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03a403cf60 msgr2=0x7f03a403f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03a403cf60 0x7f03a403f420 secure :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0x55699a1ada50 tx=0x7f04c406d040 comp rx=0 tx=0).stop 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 msgr2=0x55699a1cf110 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04dcf8c640 1 -- 172.21.15.102:0/2736586003 reap_dead start 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1cf110 secure :-1 s=READY pgs=478 cs=0 l=1 rev1=1 crypto rx=0x7f04cc057010 tx=0x7f04cc017f50 comp rx=0 tx=0).stop 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 shutdown_connections 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/2736586003 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1c7cb0 0x55699a1cf110 unknown :-1 s=CLOSED pgs=478 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 >> 172.21.15.102:0/2736586003 conn(0x55699a1c40b0 msgr2=0x55699a1c22c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 shutdown_connections 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/2736586003 wait complete. 2024-09-19T11:13:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/4026884806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03b403d050 msgr2=0x7f03b403f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/4026884806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03b403d050 0x7f03b403f510 secure :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0x7f04c4000c00 tx=0x7f04c4005ac0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/4026884806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1bb390 msgr2=0x55699a1bb7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/4026884806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1bb390 0x55699a1bb7b0 secure :-1 s=READY pgs=476 cs=0 l=1 rev1=1 crypto rx=0x7f04cc0176b0 tx=0x7f04cc0197b0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/4026884806 shutdown_connections 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/4026884806 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03b403d050 0x7f03b403f510 unknown :-1 s=CLOSED pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/4026884806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a1bb390 0x55699a1bb7b0 unknown :-1 s=CLOSED pgs=476 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/4026884806 >> 172.21.15.102:0/4026884806 conn(0x55699a1af740 msgr2=0x55699a1afb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/4026884806 shutdown_connections 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/4026884806 wait complete. 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1a6ab0 msgr2=0x55699a1a8f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55699a1a6ab0 0x55699a1a8f30 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a0a3860 msgr2=0x55699a1a46d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55699a0a3860 0x55699a1a46d0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1aab20 msgr2=0x55699a1acf10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55699a1aab20 0x55699a1acf10 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03c403cfb0 msgr2=0x7f03c403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.799+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f03c403cfb0 0x7f03c403f470 secure :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0x7f04c4057000 tx=0x7f04c4052000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.800+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 msgr2=0x55699a19d080 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.800+0000 7f04e0b1f800 1 --2- 172.21.15.102:0/1844061016 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55699a0a1d40 0x55699a19d080 secure :-1 s=READY pgs=475 cs=0 l=1 rev1=1 crypto rx=0x55699a1964c0 tx=0x7f04cc000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.800+0000 7f04dcf8c640 1 -- 172.21.15.102:0/1844061016 reap_dead start 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.800+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 shutdown_connections 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.800+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 >> 172.21.15.102:0/1844061016 conn(0x55699a09da70 msgr2=0x55699a196a20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.800+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 shutdown_connections 2024-09-19T11:13:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.800+0000 7f04e0b1f800 1 -- 172.21.15.102:0/1844061016 wait complete. 2024-09-19T11:13:57.820 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-19T11:13:57.821 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--tenant', 'testx', '--uid', 'tenanteduser'] 2024-09-19T11:13:57.821 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --tenant testx --uid tenanteduser 2024-09-19T11:13:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:57.868 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:57.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.867+0000 7fb2cca0e800 1 Processor -- start 2024-09-19T11:13:57.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.867+0000 7fb2cca0e800 1 -- start start 2024-09-19T11:13:57.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.867+0000 7fb2cca0e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557fd6af3d60 0x557fd6af4160 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.867+0000 7fb2cca0e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557fd6af5260 con 0x557fd6af46a0 2024-09-19T11:13:57.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.867+0000 7fb2cca0e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x557fd69807d0 con 0x557fd6af3d60 2024-09-19T11:13:57.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.868+0000 7fb2c81bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557fd6af3d60 0x557fd6af4160 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.868+0000 7fb2c81bc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557fd6af3d60 0x557fd6af4160 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44664/0 (socket says 172.21.15.102:44664) 2024-09-19T11:13:57.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.868+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1511340696 learned_addr learned my addr 172.21.15.102:0/1511340696 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.868+0000 7fb2c79bb640 1 --1- 172.21.15.102:0/1511340696 >> v1:172.21.15.37:6789/0 conn(0x557fd6af46a0 0x557fd6af4b50 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52596/0 (socket says 172.21.15.102:52596) 2024-09-19T11:13:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.868+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1511340696 >> v1:172.21.15.37:6789/0 conn(0x557fd6af46a0 legacy=0x557fd6af4b50 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.868+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1511340696 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd6af5430 con 0x557fd6af3d60 2024-09-19T11:13:57.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/1511340696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6af4160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8005fd0 tx=0x7fb2b8045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1834cedc051eba13 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2c71ba640 1 -- 172.21.15.102:0/1511340696 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b804e600 con 0x557fd6af3d60 2024-09-19T11:13:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2c71ba640 1 -- 172.21.15.102:0/1511340696 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b804e7a0 con 0x557fd6af3d60 2024-09-19T11:13:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2c71ba640 1 -- 172.21.15.102:0/1511340696 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b804eaa0 con 0x557fd6af3d60 2024-09-19T11:13:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1511340696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 msgr2=0x557fd6af4160 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1511340696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6af4160 secure :-1 s=READY pgs=480 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8005fd0 tx=0x7fb2b8045cf0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1511340696 shutdown_connections 2024-09-19T11:13:57.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1511340696 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6af4160 unknown :-1 s=CLOSED pgs=480 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1511340696 >> 172.21.15.102:0/1511340696 conn(0x557fd6aefa70 msgr2=0x557fd6af1ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1511340696 shutdown_connections 2024-09-19T11:13:57.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.870+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1511340696 wait complete. 2024-09-19T11:13:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.884+0000 7fb2cca0e800 1 Processor -- start 2024-09-19T11:13:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.884+0000 7fb2cca0e800 1 -- start start 2024-09-19T11:13:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.884+0000 7fb2cca0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6be7540 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.884+0000 7fb2cca0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fd698ddd0 con 0x557fd6af3d60 2024-09-19T11:13:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.884+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6be7540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.884+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6be7540 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44680/0 (socket says 172.21.15.102:44680) 2024-09-19T11:13:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.884+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1556231101 learned_addr learned my addr 172.21.15.102:0/1556231101 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.885+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1556231101 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd6be7b30 con 0x557fd6af3d60 2024-09-19T11:13:57.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.885+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/1556231101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6be7540 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8045d30 tx=0x7fb2b8050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=367fc71ba3d35ba6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.885+0000 7fb1b660c640 1 -- 172.21.15.102:0/1556231101 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b804eb40 con 0x557fd6af3d60 2024-09-19T11:13:57.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.885+0000 7fb1b660c640 1 -- 172.21.15.102:0/1556231101 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b805c040 con 0x557fd6af3d60 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.885+0000 7fb1b660c640 1 -- 172.21.15.102:0/1556231101 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b804ee10 con 0x557fd6af3d60 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1556231101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 msgr2=0x557fd6be7540 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1556231101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6be7540 secure :-1 s=READY pgs=481 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8045d30 tx=0x7fb2b8050000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1556231101 shutdown_connections 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1556231101 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6be7540 unknown :-1 s=CLOSED pgs=481 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1556231101 >> 172.21.15.102:0/1556231101 conn(0x557fd6aefa70 msgr2=0x557fd6be2ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1556231101 shutdown_connections 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1556231101 wait complete. 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 Processor -- start 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 -- start start 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6beefe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.886+0000 7fb2cca0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fd6af5960 con 0x557fd6af3d60 2024-09-19T11:13:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6beefe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6beefe0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44692/0 (socket says 172.21.15.102:44692) 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb2c81bc640 1 -- 172.21.15.102:0/460034659 learned_addr learned my addr 172.21.15.102:0/460034659 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb2c81bc640 1 -- 172.21.15.102:0/460034659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd6bef540 con 0x557fd6af3d60 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6beefe0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8045d30 tx=0x7fb2b8003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb1b4e09640 1 -- 172.21.15.102:0/460034659 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b8061420 con 0x557fd6af3d60 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb1b4e09640 1 -- 172.21.15.102:0/460034659 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b8070070 con 0x557fd6af3d60 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fd6bef7d0 con 0x557fd6af3d60 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb1b4e09640 1 -- 172.21.15.102:0/460034659 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b80616f0 con 0x557fd6af3d60 2024-09-19T11:13:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.887+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd6bf0150 con 0x557fd6af3d60 2024-09-19T11:13:57.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.888+0000 7fb1b4e09640 1 -- 172.21.15.102:0/460034659 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb2b8061890 con 0x557fd6af3d60 2024-09-19T11:13:57.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.888+0000 7fb1b4e09640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1b003d000 0x7fb1b003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.888+0000 7fb1b4e09640 1 -- 172.21.15.102:0/460034659 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb2b8066070 con 0x557fd6af3d60 2024-09-19T11:13:57.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.888+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1b003d000 0x7fb1b003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.889+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6af46a0 0x557fd6bf6630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.889+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6bf0d80 con 0x557fd6af46a0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.889+0000 7fb2c89bd640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6af46a0 0x557fd6bf6630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.889+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1b003d000 0x7fb1b003f4c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0001e30 tx=0x7fb2b0001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.889+0000 7fb2c89bd640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6af46a0 0x557fd6bf6630 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.889+0000 7fb2c89bd640 1 -- 172.21.15.102:0/460034659 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2c00083e0 con 0x557fd6af46a0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.889+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6bf0600 con 0x557fd6af46a0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.889+0000 7fb2c89bd640 1 -- 172.21.15.102:0/460034659 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2c00083e0 con 0x557fd6af46a0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.890+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6bf8ac0 0x557fd6bfaeb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.890+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6bfb580 con 0x557fd6bf8ac0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.890+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6bf8ac0 0x557fd6bfaeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.890+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6bf8ac0 0x557fd6bfaeb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.890+0000 7fb2c81bc640 1 -- 172.21.15.102:0/460034659 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb2b807c070 con 0x557fd6bf8ac0 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.890+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6bf7960 con 0x557fd6af46a0 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.891+0000 7fb2c89bd640 1 -- 172.21.15.102:0/460034659 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2c00083e0 con 0x557fd6af46a0 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.891+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6bfc9c0 0x557fd6bfedb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.891+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6bff520 con 0x557fd6bfc9c0 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.891+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6bfc9c0 0x557fd6bfedb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.891+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6bfc9c0 0x557fd6bfedb0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.891+0000 7fb2c79bb640 1 -- 172.21.15.102:0/460034659 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb2b000bd50 con 0x557fd6bfc9c0 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2cca0e800 1 Processor -- start 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2cca0e800 1 -- start start 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2cca0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c0d260 0x557fd6c0d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2cca0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fd69ec4a0 con 0x557fd6c0d260 2024-09-19T11:13:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c0d260 0x557fd6c0d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c0d260 0x557fd6c0d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44698/0 (socket says 172.21.15.102:44698) 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2c81bc640 1 -- 172.21.15.102:0/4201660492 learned_addr learned my addr 172.21.15.102:0/4201660492 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2c81bc640 1 -- 172.21.15.102:0/4201660492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd6c0dcc0 con 0x557fd6c0d260 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.892+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/4201660492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c0d260 0x557fd6c0d680 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb2b806a510 tx=0x7fb2b8007fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.893+0000 7fb1adffb640 1 -- 172.21.15.102:0/4201660492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b808f070 con 0x557fd6c0d260 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.893+0000 7fb1adffb640 1 -- 172.21.15.102:0/4201660492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b8093260 con 0x557fd6c0d260 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.893+0000 7fb2cca0e800 1 -- 172.21.15.102:0/4201660492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fd6c0e4f0 con 0x557fd6c0d260 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.893+0000 7fb1adffb640 1 -- 172.21.15.102:0/4201660492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b8061cb0 con 0x557fd6c0d260 2024-09-19T11:13:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.893+0000 7fb2cca0e800 1 -- 172.21.15.102:0/4201660492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd6c0ea90 con 0x557fd6c0d260 2024-09-19T11:13:57.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.893+0000 7fb1adffb640 1 -- 172.21.15.102:0/4201660492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb2b8068700 con 0x557fd6c0d260 2024-09-19T11:13:57.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb1adffb640 1 --2- 172.21.15.102:0/4201660492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1a003cfb0 0x7fb1a003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb1adffb640 1 -- 172.21.15.102:0/4201660492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb2b8080040 con 0x557fd6c0d260 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/4201660492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1a003cfb0 0x7fb1a003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2cca0e800 1 Processor -- start 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2cca0e800 1 -- start start 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/4201660492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1a003cfb0 0x7fb1a003f470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x557fd6bff920 tx=0x7fb2b000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2cca0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c19fa0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2cca0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fd6be7ea0 con 0x557fd6c19ba0 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c19fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c19fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44710/0 (socket says 172.21.15.102:44710) 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.894+0000 7fb2c81bc640 1 -- 172.21.15.102:0/294903357 learned_addr learned my addr 172.21.15.102:0/294903357 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2c81bc640 1 -- 172.21.15.102:0/294903357 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd6c1a590 con 0x557fd6c19ba0 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/294903357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c19fa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8007ba0 tx=0x7fb2b8098f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b2349294ea37620e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb1a77fe640 1 -- 172.21.15.102:0/294903357 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b80b1070 con 0x557fd6c19ba0 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb1a77fe640 1 -- 172.21.15.102:0/294903357 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b806ae30 con 0x557fd6c19ba0 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb1a77fe640 1 -- 172.21.15.102:0/294903357 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b80070a0 con 0x557fd6c19ba0 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2cca0e800 1 -- 172.21.15.102:0/294903357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 msgr2=0x557fd6c19fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/294903357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c19fa0 secure :-1 s=READY pgs=484 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8007ba0 tx=0x7fb2b8098f20 comp rx=0 tx=0).stop 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2cca0e800 1 -- 172.21.15.102:0/294903357 shutdown_connections 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/294903357 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c19fa0 unknown :-1 s=CLOSED pgs=484 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2cca0e800 1 -- 172.21.15.102:0/294903357 >> 172.21.15.102:0/294903357 conn(0x557fd6c15fa0 msgr2=0x557fd6c141e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2cca0e800 1 -- 172.21.15.102:0/294903357 shutdown_connections 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.895+0000 7fb2cca0e800 1 -- 172.21.15.102:0/294903357 wait complete. 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2cca0e800 1 Processor -- start 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2cca0e800 1 -- start start 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2cca0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c21000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2cca0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557fd6c1aa00 con 0x557fd6c19ba0 2024-09-19T11:13:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c21000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2c81bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c21000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44714/0 (socket says 172.21.15.102:44714) 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 learned_addr learned my addr 172.21.15.102:0/1130282256 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557fd6c21560 con 0x557fd6c19ba0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.896+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c21000 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8064000 tx=0x7fb2b8063f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.897+0000 7fb1a5ffb640 1 -- 172.21.15.102:0/1130282256 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b80ba070 con 0x557fd6c19ba0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.897+0000 7fb1a5ffb640 1 -- 172.21.15.102:0/1130282256 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb2b8007620 con 0x557fd6c19ba0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.897+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557fd6c21560 con 0x557fd6c19ba0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.897+0000 7fb1a5ffb640 1 -- 172.21.15.102:0/1130282256 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb2b80b1040 con 0x557fd6c19ba0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.897+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557fd6c21560 con 0x557fd6c19ba0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.898+0000 7fb1a5ffb640 1 -- 172.21.15.102:0/1130282256 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb2b80bd070 con 0x557fd6c19ba0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.898+0000 7fb1a5ffb640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb19803cfb0 0x7fb19803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.898+0000 7fb1a5ffb640 1 -- 172.21.15.102:0/1130282256 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb2b80a9070 con 0x557fd6c19ba0 2024-09-19T11:13:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.898+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb19803cfb0 0x7fb19803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.898+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb19803cfb0 0x7fb19803f470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000ffd0 tx=0x7fb2b0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.898+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.898+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6c2c5a0 0x557fd6c2ea60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.898+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2f1b0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2c89bd640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6c2c5a0 0x557fd6c2ea60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2c89bd640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6c2c5a0 0x557fd6c2ea60 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2c00083e0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2cca0e800 20 realm 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2f5c0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2c00083e0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2cca0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.899+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2c00083e0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c30230 con 0x557fd6c2c5a0 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb2c00083e0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2cca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6c30bf0 0x557fd6c32fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c33630 con 0x557fd6c30bf0 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6c30bf0 0x557fd6c32fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.900+0000 7fb2c81bc640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6c30bf0 0x557fd6c32fe0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2cca0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2cca0e800 20 searching for the correct realm 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6c355c0 0x557fd6c37a80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c38100 con 0x557fd6c355c0 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6c355c0 0x557fd6c37a80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6c355c0 0x557fd6c37a80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0037040 con 0x557fd6c355c0 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2c79bb640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb2b000f070 0x7fb2b003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c38100 con 0x7fb2b000f070 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.901+0000 7fb2c89bd640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb2b000f070 0x7fb2b003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.902+0000 7fb2c89bd640 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb2b000f070 0x7fb2b003a3c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.902+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c00083e0 con 0x7fb2b000f070 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.902+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.902+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.902+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.903+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c00083e0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.903+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.903+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.903+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.903+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.903+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.903+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.903+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x7fb2b000f070 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.904+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x7fb2b000f070 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.904+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c355c0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.904+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0037040 con 0x557fd6c355c0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.904+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.904+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.904+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.904+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.904+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.905+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.905+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x7fb2b000f070 2024-09-19T11:13:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.905+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb2c0026040 con 0x7fb2b000f070 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.905+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c355c0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.905+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0037040 con 0x557fd6c355c0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.905+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c355c0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.905+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb2b0037040 con 0x557fd6c355c0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.905+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.906+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.906+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c355c0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.906+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0037040 con 0x557fd6c355c0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.906+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c355c0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.906+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0037040 con 0x557fd6c355c0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.906+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.906+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.906+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.907+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.907+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.907+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.907+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c355c0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.907+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0037040 con 0x557fd6c355c0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.907+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x7fb2b000f070 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.908+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x7fb2b000f070 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.908+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.908+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.908+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.908+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.908+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c355c0 2024-09-19T11:13:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.908+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b0037040 con 0x557fd6c355c0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.908+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.909+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.909+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x7fb2b000f070 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.909+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x7fb2b000f070 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.909+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c355c0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.909+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.909+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c30bf0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c2fe90 con 0x7fb2b000f070 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb2c0026040 con 0x7fb2b000f070 2024-09-19T11:13:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c339d0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.910+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c339d0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb2c0026040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c339d0 con 0x557fd6c355c0 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 20 zone default found 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 4 Realm: () 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 20 zonegroup default 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c342c0 con 0x557fd6c30bf0 2024-09-19T11:13:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.911+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3a070 con 0x557fd6c355c0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3a480 con 0x557fd6c355c0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2cca0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2cca0e800 20 started sync module instance, tier type = 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2cca0e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.912+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c39410 con 0x7fb2b000f070 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.913+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0026040 con 0x7fb2b000f070 2024-09-19T11:13:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.913+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94007552350480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c39410 con 0x7fb2b000f070 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.913+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3af90 con 0x557fd6c2c5a0 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.914+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94007552350480] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.914+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.914+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94007552354944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c39410 con 0x557fd6c2c5a0 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.914+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3ba20 con 0x557fd6c355c0 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.915+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94007552354944] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.916+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.916+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94007552348000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c39380 con 0x557fd6c355c0 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.916+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3c8e0 con 0x7fb2b000f070 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.917+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94007552348000] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.917+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.917+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94007552361520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3c850 con 0x7fb2b000f070 2024-09-19T11:13:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.917+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3d670 con 0x557fd6c2c5a0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.918+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94007552361520] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.918+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.918+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94007552363584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3d670 con 0x557fd6c2c5a0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.918+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3e080 con 0x557fd6c30bf0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.919+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.919+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94007552367568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3dff0 con 0x557fd6c30bf0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.919+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3f000 con 0x557fd6c30bf0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.919+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94007552363584] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.920+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.920+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94007552371472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3f000 con 0x557fd6c30bf0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.920+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3fa70 con 0x557fd6c30bf0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.920+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(55 notify.5 [watch watch cookie 94007552367568] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94007552371472] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'141 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94007552364640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3e470 con 0x557fd6c30bf0 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2cca0e800 20 add_watcher() i=0 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2cca0e800 20 add_watcher() i=1 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2cca0e800 20 add_watcher() i=2 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2cca0e800 20 add_watcher() i=3 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2cca0e800 20 add_watcher() i=4 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2cca0e800 20 add_watcher() i=5 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.921+0000 7fb2cca0e800 20 add_watcher() i=6 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.922+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94007552364640] v35'142 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.922+0000 7fb2cca0e800 20 add_watcher() i=7 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.922+0000 7fb2cca0e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.922+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c42a60 con 0x557fd6c2c5a0 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.922+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.922+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94007552374080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c3fee0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.923+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94007552374080] v35'134 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.923+0000 7fb17e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.923+0000 7fb2cca0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.923+0000 7fb2cca0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.923+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4b2e0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.924+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.924+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4b2e0 con 0x557fd6c30bf0 2024-09-19T11:13:57.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.926+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'16 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.926+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4b2e0 con 0x557fd6c355c0 2024-09-19T11:13:57.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.927+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.927+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4aad0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.928+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'135 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.928+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4c8b0 con 0x7fb2b000f070 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.929+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'38 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.929+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4cd10 con 0x557fd6c355c0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.930+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'26 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.930+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4cee0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.931+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.931+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d010 con 0x557fd6c30bf0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.932+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'25 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.932+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d0a0 con 0x7fb2b000f070 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.933+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.933+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4ca60 con 0x557fd6c355c0 2024-09-19T11:13:57.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.934+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.934+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4ca30 con 0x7fb2b000f070 2024-09-19T11:13:57.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.935+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.935+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4ca30 con 0x557fd6c30bf0 2024-09-19T11:13:57.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.936+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.936+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d650 con 0x7fb2b000f070 2024-09-19T11:13:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.937+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'16 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.937+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d650 con 0x557fd6c30bf0 2024-09-19T11:13:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.939+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'31 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.939+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d650 con 0x557fd6c2c5a0 2024-09-19T11:13:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.939+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'136 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.939+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d650 con 0x557fd6c355c0 2024-09-19T11:13:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.941+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'32 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.941+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4da30 con 0x7fb2b000f070 2024-09-19T11:13:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.942+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'40 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.942+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d9a0 con 0x557fd6c355c0 2024-09-19T11:13:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.943+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.943+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d770 con 0x557fd6c2c5a0 2024-09-19T11:13:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.944+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.944+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d770 con 0x557fd6c2c5a0 2024-09-19T11:13:57.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.945+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'137 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.945+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d770 con 0x557fd6c355c0 2024-09-19T11:13:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.946+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'33 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.946+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d8a0 con 0x7fb2b000f070 2024-09-19T11:13:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.947+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'26 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.947+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d8a0 con 0x557fd6c355c0 2024-09-19T11:13:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.948+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.948+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d8a0 con 0x557fd6c355c0 2024-09-19T11:13:57.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.949+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.949+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d8a0 con 0x557fd6c355c0 2024-09-19T11:13:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.950+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'12 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.950+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d8a0 con 0x557fd6c355c0 2024-09-19T11:13:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.951+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'27 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.951+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d8e0 con 0x557fd6c30bf0 2024-09-19T11:13:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.952+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'18 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.952+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d920 con 0x557fd6c355c0 2024-09-19T11:13:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.953+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'16 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.953+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d950 con 0x557fd6c30bf0 2024-09-19T11:13:57.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.954+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'26 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.954+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d950 con 0x557fd6c355c0 2024-09-19T11:13:57.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.955+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'34 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.955+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d920 con 0x557fd6c30bf0 2024-09-19T11:13:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.956+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'32 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.956+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c4d960 con 0x7fb2b000f070 2024-09-19T11:13:57.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.957+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'22 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.958+0000 7fb17d7e2640 20 reqs_thread_entry: start 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.958+0000 7fb2cca0e800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.958+0000 7fb2cca0e800 20 Filter name: none 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.958+0000 7fb0eeffd640 20 reqs_thread_entry: start 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.958+0000 7fb2cca0e800 10 cache get: name=default.rgw.meta+users.uid+testx$tenanteduser : miss 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.958+0000 7fb2cca0e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.958+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:94 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c785e0 con 0x557fd6c30bf0 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(94 testx$tenanteduser [call out=48b,read 0~419 out=419b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 246+0+542 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2cca0e800 20 rados_obj.operate() r=0 bl.length=419 2024-09-19T11:13:57.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2cca0e800 10 cache put: name=default.rgw.meta+users.uid+testx$tenanteduser info.flags=0x13 2024-09-19T11:13:57.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2cca0e800 10 adding default.rgw.meta+users.uid+testx$tenanteduser to cache LRU end 2024-09-19T11:13:57.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2cca0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:57.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:95 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7af10 con 0x557fd6c2c5a0 2024-09-19T11:13:57.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(95 testx$tenanteduser.buckets [call out=15b] v0'0 uv2 ondisk = 0) ==== 170+0+15 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2cca0e800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-19T11:13:57.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.959+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:96 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c78ef0 con 0x557fd6c30bf0 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.960+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(96 p5YnriCv1nAtykxBrupQ [delete] v35'7 uv7 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.960+0000 7fb2cca0e800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.960+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [notify cookie 94007552612944 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7b330 con 0x557fd6c355c0 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== watch-notify(notify (1) cookie 94007552348000 notify 150323855365 ret 0) ==== 212+0+0 (crc 0 0 0) 0x557fd6c4c860 con 0x557fd6c355c0 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb1a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855365 cookie 94007552348000 notifier 4575 bl.length()=170 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(97 notify.2 [notify cookie 94007552612944 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb1a77fe640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:98 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb18c003d60 con 0x557fd6c355c0 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(98 notify.2 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== watch-notify(notify_complete (2) cookie 94007552612944 notify 150323855365 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557fd6c4a530 con 0x557fd6c355c0 2024-09-19T11:13:57.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb2cca0e800 10 removing email index: 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb2cca0e800 10 removing user buckets index 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.961+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:99 8.c 8:37c7a57e:users.uid::testx$tenanteduser.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c78ef0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.962+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(99 testx$tenanteduser.buckets [delete] v35'3 uv3 ondisk = 0) ==== 170+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.962+0000 7fb2cca0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser.buckets, ofs0, ns] 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.962+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:100 7.d 7:b4812045:::notify.4:head [notify cookie 94007552612944 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7b330 con 0x557fd6c2c5a0 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.962+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== watch-notify(notify (1) cookie 94007552363584 notify 150323855379 ret 0) ==== 217+0+0 (crc 0 0 0) 0x557fd6c4aca0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.962+0000 7fb1a6ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855379 cookie 94007552363584 notifier 4575 bl.length()=175 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.962+0000 7fb1a6ffd640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb0fc0032c0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.962+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(100 notify.4 [notify cookie 94007552612944 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.963+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(101 notify.4 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.963+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== watch-notify(notify_complete (2) cookie 94007552612944 notify 150323855379 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557fd6c4aad0 con 0x557fd6c2c5a0 2024-09-19T11:13:57.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.963+0000 7fb2cca0e800 10 removing user index: testx$tenanteduser 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.963+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 8.13 8:cdfb9947:users.uid::testx$tenanteduser:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x557fd6c30bf0 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(102 testx$tenanteduser [call,call,delete] v35'8 uv8 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb2cca0e800 10 removing default.rgw.meta+users.uid+testx$tenanteduser from cache 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb2cca0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.uid:testx$tenanteduser, ofs0, ns] 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:103 7.e 7:7759931f:::notify.3:head [notify cookie 94007552625632 in=179b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d000 con 0x7fb2b000f070 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== watch-notify(notify (1) cookie 94007552361520 notify 150323855373 ret 0) ==== 209+0+0 (crc 0 0 0) 0x557fd6c4aad0 con 0x7fb2b000f070 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb1a77fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855373 cookie 94007552361520 notifier 4575 bl.length()=167 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb1a77fe640 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fb18c003d60 con 0x7fb2b000f070 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(103 notify.3 [notify cookie 94007552625632 out=8b] v0'0 uv141 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(104 notify.3 [notify-ack] v0'0 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.964+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== watch-notify(notify_complete (2) cookie 94007552625632 notify 150323855373 ret 0) ==== 42+0+48 (crc 0 0 0) 0x557fd6c4ae70 con 0x7fb2b000f070 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.965+0000 7fb17e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.965+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94007552374080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x557fd6c2c5a0 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.966+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(105 data_loggenerations_metadata [watch unwatch cookie 94007552374080] v35'138 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.966+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:106 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94007552350480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x7fb2b000f070 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.967+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(106 notify.0 [watch unwatch cookie 94007552350480] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.967+0000 7fb2cca0e800 20 remove_watcher() i=0 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.967+0000 7fb2cca0e800 2 removed watcher, disabling cache 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.967+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:107 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94007552354944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x557fd6c2c5a0 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.968+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(107 notify.1 [watch unwatch cookie 94007552354944] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.968+0000 7fb2cca0e800 20 remove_watcher() i=1 2024-09-19T11:13:57.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.968+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:108 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94007552348000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x557fd6c355c0 2024-09-19T11:13:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.969+0000 7fb2c79bb640 1 -- 172.21.15.102:0/1130282256 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(108 notify.2 [watch unwatch cookie 94007552348000] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b004a040 con 0x557fd6c355c0 2024-09-19T11:13:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.969+0000 7fb2cca0e800 20 remove_watcher() i=2 2024-09-19T11:13:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.969+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:109 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94007552361520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x7fb2b000f070 2024-09-19T11:13:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.970+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(109 notify.3 [watch unwatch cookie 94007552361520] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x7fb2b000f070 2024-09-19T11:13:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.970+0000 7fb2cca0e800 20 remove_watcher() i=3 2024-09-19T11:13:57.973 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.970+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:110 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94007552363584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x557fd6c2c5a0 2024-09-19T11:13:57.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.971+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(110 notify.4 [watch unwatch cookie 94007552363584] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2c0036040 con 0x557fd6c2c5a0 2024-09-19T11:13:57.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.971+0000 7fb2cca0e800 20 remove_watcher() i=4 2024-09-19T11:13:57.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.971+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:111 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94007552367568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x557fd6c30bf0 2024-09-19T11:13:57.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.972+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(111 notify.5 [watch unwatch cookie 94007552367568] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.972+0000 7fb2cca0e800 20 remove_watcher() i=5 2024-09-19T11:13:57.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.972+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:112 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94007552371472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x557fd6c30bf0 2024-09-19T11:13:57.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.973+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(112 notify.6 [watch unwatch cookie 94007552371472] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.973+0000 7fb2cca0e800 20 remove_watcher() i=6 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.973+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:113 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94007552364640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x557fd6c7d090 con 0x557fd6c30bf0 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2c81bc640 1 -- 172.21.15.102:0/1130282256 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(113 notify.7 [watch unwatch cookie 94007552364640] v35'143 uv141 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb2b80c6070 con 0x557fd6c30bf0 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 20 remove_watcher() i=7 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6c30bf0 msgr2=0x557fd6c32fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6c30bf0 0x557fd6c32fe0 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6c2c5a0 msgr2=0x557fd6c2ea60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6c2c5a0 0x557fd6c2ea60 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb2b000f070 msgr2=0x7fb2b003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb2b000f070 0x7fb2b003a3c0 crc :-1 s=READY pgs=56 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6c355c0 msgr2=0x557fd6c37a80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6c355c0 0x557fd6c37a80 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb19803cfb0 msgr2=0x7fb19803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb19803cfb0 0x7fb19803f470 secure :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0x7fb2b000ffd0 tx=0x7fb2b0010000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 msgr2=0x557fd6c21000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/1130282256 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c19ba0 0x557fd6c21000 secure :-1 s=READY pgs=485 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8064000 tx=0x7fb2b8063f90 comp rx=0 tx=0).stop 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 reap_dead start 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2c89bd640 1 -- 172.21.15.102:0/1130282256 reap_dead start 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 shutdown_connections 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.974+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 >> 172.21.15.102:0/1130282256 conn(0x557fd6c15fa0 msgr2=0x557fd6c141b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 shutdown_connections 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/1130282256 wait complete. 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/4201660492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1a003cfb0 msgr2=0x7fb1a003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/4201660492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1a003cfb0 0x7fb1a003f470 secure :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0x557fd6bff920 tx=0x7fb2b000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:57.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/4201660492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c0d260 msgr2=0x557fd6c0d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/4201660492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c0d260 0x557fd6c0d680 secure :-1 s=READY pgs=483 cs=0 l=1 rev1=1 crypto rx=0x7fb2b806a510 tx=0x7fb2b8007fe0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/4201660492 shutdown_connections 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/4201660492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1a003cfb0 0x7fb1a003f470 unknown :-1 s=CLOSED pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/4201660492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6c0d260 0x557fd6c0d680 unknown :-1 s=CLOSED pgs=483 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/4201660492 >> 172.21.15.102:0/4201660492 conn(0x557fd6c01610 msgr2=0x557fd6c019f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/4201660492 shutdown_connections 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/4201660492 wait complete. 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6bf8ac0 msgr2=0x557fd6bfaeb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557fd6bf8ac0 0x557fd6bfaeb0 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6af46a0 msgr2=0x557fd6bf6630 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557fd6af46a0 0x557fd6bf6630 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6bfc9c0 msgr2=0x557fd6bfedb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557fd6bfc9c0 0x557fd6bfedb0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:57.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1b003d000 msgr2=0x7fb1b003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb1b003d000 0x7fb1b003f4c0 secure :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0x7fb2b0001e30 tx=0x7fb2b0001390 comp rx=0 tx=0).stop 2024-09-19T11:13:57.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 msgr2=0x557fd6beefe0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:57.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 --2- 172.21.15.102:0/460034659 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557fd6af3d60 0x557fd6beefe0 secure :-1 s=READY pgs=482 cs=0 l=1 rev1=1 crypto rx=0x7fb2b8045d30 tx=0x7fb2b8003330 comp rx=0 tx=0).stop 2024-09-19T11:13:57.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2c89bd640 1 -- 172.21.15.102:0/460034659 reap_dead start 2024-09-19T11:13:57.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 shutdown_connections 2024-09-19T11:13:57.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 >> 172.21.15.102:0/460034659 conn(0x557fd6aefa70 msgr2=0x557fd6be8930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:57.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.975+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 shutdown_connections 2024-09-19T11:13:57.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:57.976+0000 7fb2cca0e800 1 -- 172.21.15.102:0/460034659 wait complete. 2024-09-19T11:13:57.993 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-19T11:13:57.997 INFO:tasks.radosgw_admin:RL: get_obj myfoo foo bytes_out=0 bytes_in=4 failed=False 2024-09-19T11:13:58.041 INFO:tasks.radosgw_admin:RL: list_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:13:58.042 INFO:tasks.util.rgw:rgwadmin: client.0 : ['object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-19T11:13:58.042 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'object', 'rm', '--bucket', 'myfoo', '--object', 'four'] 2024-09-19T11:13:58.042 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph object rm --bucket myfoo --object four 2024-09-19T11:13:58.089 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:58.089 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:58.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.088+0000 7fadfa726800 1 Processor -- start 2024-09-19T11:13:58.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.088+0000 7fadfa726800 1 -- start start 2024-09-19T11:13:58.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadfa726800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5584103f71f0 0x5584103f75f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadfa726800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5584103f7fe0 con 0x5584103f7b30 2024-09-19T11:13:58.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadfa726800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55841030e7d0 con 0x5584103f71f0 2024-09-19T11:13:58.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadf63d9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5584103f71f0 0x5584103f75f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadedbd8640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5584103f7b30 0x55841048b2d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52612/0 (socket says 172.21.15.102:52612) 2024-09-19T11:13:58.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadf63d9640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5584103f71f0 0x5584103f75f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44728/0 (socket says 172.21.15.102:44728) 2024-09-19T11:13:58.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadedbd8640 1 -- 172.21.15.102:0/1344145962 learned_addr learned my addr 172.21.15.102:0/1344145962 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:58.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadf63d9640 1 -- 172.21.15.102:0/1344145962 >> v1:172.21.15.37:6789/0 conn(0x5584103f7b30 legacy=0x55841048b2d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.089+0000 7fadf63d9640 1 -- 172.21.15.102:0/1344145962 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841048da00 con 0x5584103f71f0 2024-09-19T11:13:58.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.091+0000 7fadf63d9640 1 --2- 172.21.15.102:0/1344145962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x5584103f75f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fade800a470 tx=0x7fade8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=920796c4185a83b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.091+0000 7fadf5bd8640 1 -- 172.21.15.102:0/1344145962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade8053570 con 0x5584103f71f0 2024-09-19T11:13:58.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.091+0000 7fadf5bd8640 1 -- 172.21.15.102:0/1344145962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8058070 con 0x5584103f71f0 2024-09-19T11:13:58.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.091+0000 7fadf5bd8640 1 -- 172.21.15.102:0/1344145962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade8053880 con 0x5584103f71f0 2024-09-19T11:13:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.092+0000 7fadfa726800 1 -- 172.21.15.102:0/1344145962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 msgr2=0x5584103f75f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.092+0000 7fadfa726800 1 --2- 172.21.15.102:0/1344145962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x5584103f75f0 secure :-1 s=READY pgs=487 cs=0 l=1 rev1=1 crypto rx=0x7fade800a470 tx=0x7fade8045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.092+0000 7fadfa726800 1 -- 172.21.15.102:0/1344145962 shutdown_connections 2024-09-19T11:13:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.092+0000 7fadfa726800 1 --2- 172.21.15.102:0/1344145962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x5584103f75f0 unknown :-1 s=CLOSED pgs=487 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.092+0000 7fadfa726800 1 -- 172.21.15.102:0/1344145962 >> 172.21.15.102:0/1344145962 conn(0x55841047eb90 msgr2=0x558410480ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.092+0000 7fadfa726800 1 -- 172.21.15.102:0/1344145962 shutdown_connections 2024-09-19T11:13:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.092+0000 7fadfa726800 1 -- 172.21.15.102:0/1344145962 wait complete. 2024-09-19T11:13:58.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.105+0000 7fadfa726800 1 Processor -- start 2024-09-19T11:13:58.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.105+0000 7fadfa726800 1 -- start start 2024-09-19T11:13:58.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.105+0000 7fadfa726800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x558410575520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.105+0000 7fadfa726800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55841031bdd0 con 0x5584103f71f0 2024-09-19T11:13:58.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.106+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x558410575520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.106+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x558410575520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44734/0 (socket says 172.21.15.102:44734) 2024-09-19T11:13:58.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.106+0000 7fadf63d9640 1 -- 172.21.15.102:0/3558077973 learned_addr learned my addr 172.21.15.102:0/3558077973 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.108 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.106+0000 7fadf63d9640 1 -- 172.21.15.102:0/3558077973 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558410575b10 con 0x5584103f71f0 2024-09-19T11:13:58.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.106+0000 7fadf63d9640 1 --2- 172.21.15.102:0/3558077973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x558410575520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fade8025c20 tx=0x7fade8051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=42341a6d4c96b503 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.106+0000 7face4608640 1 -- 172.21.15.102:0/3558077973 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade805c580 con 0x5584103f71f0 2024-09-19T11:13:58.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.106+0000 7face4608640 1 -- 172.21.15.102:0/3558077973 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8063030 con 0x5584103f71f0 2024-09-19T11:13:58.109 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.106+0000 7face4608640 1 -- 172.21.15.102:0/3558077973 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade805c850 con 0x5584103f71f0 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.107+0000 7fadfa726800 1 -- 172.21.15.102:0/3558077973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 msgr2=0x558410575520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.107+0000 7fadfa726800 1 --2- 172.21.15.102:0/3558077973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x558410575520 secure :-1 s=READY pgs=488 cs=0 l=1 rev1=1 crypto rx=0x7fade8025c20 tx=0x7fade8051000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.107+0000 7fadfa726800 1 -- 172.21.15.102:0/3558077973 shutdown_connections 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.107+0000 7fadfa726800 1 --2- 172.21.15.102:0/3558077973 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x558410575520 unknown :-1 s=CLOSED pgs=488 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.107+0000 7fadfa726800 1 -- 172.21.15.102:0/3558077973 >> 172.21.15.102:0/3558077973 conn(0x55841047eb90 msgr2=0x558410570ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.107+0000 7fadfa726800 1 -- 172.21.15.102:0/3558077973 shutdown_connections 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.107+0000 7fadfa726800 1 -- 172.21.15.102:0/3558077973 wait complete. 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.107+0000 7fadfa726800 1 Processor -- start 2024-09-19T11:13:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.108+0000 7fadfa726800 1 -- start start 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.108+0000 7fadfa726800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x55841057cfa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.108+0000 7fadfa726800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55841048ccf0 con 0x5584103f71f0 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.108+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x55841057cfa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.108+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x55841057cfa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44750/0 (socket says 172.21.15.102:44750) 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.108+0000 7fadf63d9640 1 -- 172.21.15.102:0/1824579221 learned_addr learned my addr 172.21.15.102:0/1824579221 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.108+0000 7fadf63d9640 1 -- 172.21.15.102:0/1824579221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841057d500 con 0x5584103f71f0 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.109+0000 7fadf63d9640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x55841057cfa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fade8045f50 tx=0x7fade8002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.109+0000 7face2e05640 1 -- 172.21.15.102:0/1824579221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade8054ad0 con 0x5584103f71f0 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.109+0000 7face2e05640 1 -- 172.21.15.102:0/1824579221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8054c70 con 0x5584103f71f0 2024-09-19T11:13:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.109+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55841057d790 con 0x5584103f71f0 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.109+0000 7face2e05640 1 -- 172.21.15.102:0/1824579221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade8068420 con 0x5584103f71f0 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.109+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841057e190 con 0x5584103f71f0 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7face2e05640 1 -- 172.21.15.102:0/1824579221 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fade80685c0 con 0x5584103f71f0 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7face2e05640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facdc03cfb0 0x7facdc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7face2e05640 1 -- 172.21.15.102:0/1824579221 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fade8070030 con 0x5584103f71f0 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7fadedbd8640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facdc03cfb0 0x7facdc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7fadfa726800 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584103f7b30 0x5584105845f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558410584b30 con 0x5584103f7b30 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7fadf6bda640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584103f7b30 0x5584105845f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7fadedbd8640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facdc03cfb0 0x7facdc03f470 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fade0001d70 tx=0x7fade00012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.110+0000 7fadf6bda640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584103f7b30 0x5584105845f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.111+0000 7fadf6bda640 1 -- 172.21.15.102:0/1824579221 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584103f7b30 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.111+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558410584ed0 con 0x5584103f7b30 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.111+0000 7fadf6bda640 1 -- 172.21.15.102:0/1824579221 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584103f7b30 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.111+0000 7fadfa726800 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558410586a10 0x558410588e80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.111+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558410589610 con 0x558410586a10 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.111+0000 7fadf63d9640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558410586a10 0x558410588e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.112+0000 7fadf63d9640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558410586a10 0x558410588e80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.112+0000 7fadf63d9640 1 -- 172.21.15.102:0/1824579221 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fade8051070 con 0x558410586a10 2024-09-19T11:13:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.112+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558410585720 con 0x5584103f7b30 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.112+0000 7fadf6bda640 1 -- 172.21.15.102:0/1824579221 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584103f7b30 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.112+0000 7fadfa726800 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55841058aa70 0x55841058ce60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.112+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55841058d5a0 con 0x55841058aa70 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.112+0000 7fadedbd8640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55841058aa70 0x55841058ce60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.113+0000 7fadedbd8640 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55841058aa70 0x55841058ce60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.113+0000 7fadedbd8640 1 -- 172.21.15.102:0/1824579221 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fade0009050 con 0x55841058aa70 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.113+0000 7fadfa726800 1 Processor -- start 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.113+0000 7fadfa726800 1 -- start start 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.113+0000 7fadfa726800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55841059b2e0 0x55841059b700 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.113+0000 7fadfa726800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55841037a4a0 con 0x55841059b2e0 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55841059b2e0 0x55841059b700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55841059b2e0 0x55841059b700 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44764/0 (socket says 172.21.15.102:44764) 2024-09-19T11:13:58.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7fadf63d9640 1 -- 172.21.15.102:0/3335206291 learned_addr learned my addr 172.21.15.102:0/3335206291 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7fadf63d9640 1 -- 172.21.15.102:0/3335206291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55841059bd40 con 0x55841059b2e0 2024-09-19T11:13:58.120 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7fadf63d9640 1 --2- 172.21.15.102:0/3335206291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55841059b2e0 0x55841059b700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fade8096a30 tx=0x7fade807d550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7facdbfff640 1 -- 172.21.15.102:0/3335206291 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade8068a90 con 0x55841059b2e0 2024-09-19T11:13:58.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7facdbfff640 1 -- 172.21.15.102:0/3335206291 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade8068c30 con 0x55841059b2e0 2024-09-19T11:13:58.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7fadfa726800 1 -- 172.21.15.102:0/3335206291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55841059c570 con 0x55841059b2e0 2024-09-19T11:13:58.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7facdbfff640 1 -- 172.21.15.102:0/3335206291 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade8009870 con 0x55841059b2e0 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.114+0000 7fadfa726800 1 -- 172.21.15.102:0/3335206291 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55841059cb10 con 0x55841059b2e0 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.115+0000 7facdbfff640 1 -- 172.21.15.102:0/3335206291 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fade8009a10 con 0x55841059b2e0 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.115+0000 7facdbfff640 1 --2- 172.21.15.102:0/3335206291 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd003d000 0x7facd003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.115+0000 7facdbfff640 1 -- 172.21.15.102:0/3335206291 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fade808e070 con 0x55841059b2e0 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.115+0000 7fadedbd8640 1 --2- 172.21.15.102:0/3335206291 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd003d000 0x7facd003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.115+0000 7fadfa726800 1 Processor -- start 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadfa726800 1 -- start start 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadedbd8640 1 --2- 172.21.15.102:0/3335206291 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd003d000 0x7facd003f4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fade000bf40 tx=0x7fade000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadfa726800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105a7f30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadfa726800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558410575ee0 con 0x5584105a7b50 2024-09-19T11:13:58.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105a7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105a7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44768/0 (socket says 172.21.15.102:44768) 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadf63d9640 1 -- 172.21.15.102:0/3787896842 learned_addr learned my addr 172.21.15.102:0/3787896842 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadf63d9640 1 -- 172.21.15.102:0/3787896842 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584105a8520 con 0x5584105a7b50 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7fadf63d9640 1 --2- 172.21.15.102:0/3787896842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105a7f30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fade8068f70 tx=0x7fade80614b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bfa5ea24ccc96f78 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7facd9ffb640 1 -- 172.21.15.102:0/3787896842 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade809d040 con 0x5584105a7b50 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7facd9ffb640 1 -- 172.21.15.102:0/3787896842 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade80980b0 con 0x5584105a7b50 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.116+0000 7facd9ffb640 1 -- 172.21.15.102:0/3787896842 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade80952a0 con 0x5584105a7b50 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 -- 172.21.15.102:0/3787896842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 msgr2=0x5584105a7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 --2- 172.21.15.102:0/3787896842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105a7f30 secure :-1 s=READY pgs=491 cs=0 l=1 rev1=1 crypto rx=0x7fade8068f70 tx=0x7fade80614b0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 -- 172.21.15.102:0/3787896842 shutdown_connections 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 --2- 172.21.15.102:0/3787896842 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105a7f30 unknown :-1 s=CLOSED pgs=491 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.143 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 -- 172.21.15.102:0/3787896842 >> 172.21.15.102:0/3787896842 conn(0x5584105a3f50 msgr2=0x5584105a2190 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 -- 172.21.15.102:0/3787896842 shutdown_connections 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 -- 172.21.15.102:0/3787896842 wait complete. 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 Processor -- start 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 -- start start 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105aef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadfa726800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584105a89b0 con 0x5584105a7b50 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105aef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadf63d9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105aef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44780/0 (socket says 172.21.15.102:44780) 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.117+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 learned_addr learned my addr 172.21.15.102:0/921915437 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.118+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584105af460 con 0x5584105a7b50 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.118+0000 7fadf63d9640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105aef00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fade8068f70 tx=0x7fade8059f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.118+0000 7facc7fff640 1 -- 172.21.15.102:0/921915437 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade80b0040 con 0x5584105a7b50 2024-09-19T11:13:58.144 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.118+0000 7facc7fff640 1 -- 172.21.15.102:0/921915437 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fade806a240 con 0x5584105a7b50 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.118+0000 7facc7fff640 1 -- 172.21.15.102:0/921915437 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fade809d040 con 0x5584105a7b50 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.118+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584105af460 con 0x5584105a7b50 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.118+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584105af460 con 0x5584105a7b50 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.119+0000 7facc7fff640 1 -- 172.21.15.102:0/921915437 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fade80bd020 con 0x5584105a7b50 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.119+0000 7facc7fff640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facc003d000 0x7facc003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.119+0000 7facc7fff640 1 -- 172.21.15.102:0/921915437 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fade80bb020 con 0x5584105a7b50 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.119+0000 7fadedbd8640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facc003d000 0x7facc003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadedbd8640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facc003d000 0x7facc003f4c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fade000c010 tx=0x7fade0010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584105ba4d0 0x5584105bc990 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105bd0e0 con 0x5584105ba4d0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadf6bda640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584105ba4d0 0x5584105bc990 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadf6bda640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584105ba4d0 0x5584105bc990 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 20 realm 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105bd4f0 con 0x5584105ba4d0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.120+0000 7fadfa726800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:58.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105bddc0 con 0x5584105ba4d0 2024-09-19T11:13:58.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584105beec0 0x5584105c12b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105c1870 con 0x5584105beec0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadf63d9640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584105beec0 0x5584105c12b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.121+0000 7fadf63d9640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584105beec0 0x5584105c12b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadfa726800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadfa726800 20 searching for the correct realm 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584105c3820 0x5584105c5ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105c63b0 con 0x5584105c3820 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadedbd8640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584105c3820 0x5584105c5ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadedbd8640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584105c3820 0x5584105c5ce0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadedbd8640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fade0037040 0x7fade0036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.122+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105c63b0 con 0x7fade0037040 2024-09-19T11:13:58.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.123+0000 7fadf6bda640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fade0037040 0x7fade0036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.123+0000 7fadf6bda640 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fade0037040 0x7fade0036410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.123+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.123+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.124+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.124+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.124+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.124+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.124+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.124+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.150 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x7fade0037040 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105c3820 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.125+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.126+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.126+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.126+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.126+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x7fade0037040 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.126+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.126+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105c3820 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.126+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.126+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105c3820 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.127+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.127+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.127+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.127+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105c3820 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.127+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.127+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105c3820 2024-09-19T11:13:58.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.127+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.127+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.128+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.128+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.128+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.128+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.128+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.128+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105c3820 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.128+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.128+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x7fade0037040 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.129+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.129+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.129+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.129+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.129+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.129+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105c3820 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.129+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.129+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.130+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.130+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x7fade0037040 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.130+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.130+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105c3820 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.130+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.130+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105beec0 2024-09-19T11:13:58.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.130+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.130+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x5584105ba4d0 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5584105be160 con 0x7fade0037040 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105c2130 con 0x5584105ba4d0 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105c2130 con 0x5584105ba4d0 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.131+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105c2130 con 0x5584105c3820 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:58.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 20 zone default found 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 4 Realm: () 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 20 zonegroup default 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105c2a20 con 0x5584105beec0 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105c8320 con 0x5584105c3820 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.157 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105c87a0 con 0x5584105c3820 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.132+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.133+0000 7fadfa726800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.133+0000 7fadfa726800 20 started sync module instance, tier type = 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.133+0000 7fadfa726800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.133+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c76c0 con 0x7fade0037040 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.134+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.134+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94025698540480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c76c0 con 0x7fade0037040 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.134+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c92d0 con 0x5584105ba4d0 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.135+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94025698540480] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.135+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.135+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94025698545088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c9290 con 0x5584105ba4d0 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.135+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c9d70 con 0x5584105c3820 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.136+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.136+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94025698547840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105ca620 con 0x5584105c3820 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.136+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cb130 con 0x7fade0037040 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.136+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94025698545088] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.137+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.137+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94025698552800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cb520 con 0x7fade0037040 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.137+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cbee0 con 0x5584105ba4d0 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.138+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94025698552800] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.139+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94025698547840] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.139+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.139+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94025698550032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cba30 con 0x5584105ba4d0 2024-09-19T11:13:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.139+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cc780 con 0x5584105beec0 2024-09-19T11:13:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.140+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94025698550032] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.140+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.140+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94025698558672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cba30 con 0x5584105beec0 2024-09-19T11:13:58.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.140+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cba30 con 0x5584105beec0 2024-09-19T11:13:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.141+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94025698558672] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.141+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.141+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94025698561168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cd190 con 0x5584105beec0 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.141+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cdb50 con 0x5584105beec0 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94025698561168] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'144 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94025698538000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cdb50 con 0x5584105beec0 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadfa726800 20 add_watcher() i=0 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadfa726800 20 add_watcher() i=1 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadfa726800 20 add_watcher() i=2 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadfa726800 20 add_watcher() i=3 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadfa726800 20 add_watcher() i=4 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadfa726800 20 add_watcher() i=5 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.142+0000 7fadfa726800 20 add_watcher() i=6 2024-09-19T11:13:58.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.144+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94025698538000] v35'145 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.144+0000 7fadfa726800 20 add_watcher() i=7 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.144+0000 7fadfa726800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.144+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5584105d0f80 con 0x5584105ba4d0 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.144+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.144+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94025698564208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105ce4a0 con 0x5584105ba4d0 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.145+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94025698564208] v35'139 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.145+0000 7facacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.145+0000 7fadfa726800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.145+0000 7fadfa726800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.145+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105d97e0 con 0x5584105ba4d0 2024-09-19T11:13:58.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.146+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.146+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105d9e90 con 0x5584105beec0 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.148+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 gc.1 [create,call,call,call] v35'17 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.148+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105d9e90 con 0x5584105c3820 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.148+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.148+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105d00f0 con 0x5584105ba4d0 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.149+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v35'140 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.149+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cfc40 con 0x7fade0037040 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.150+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(66 gc.4 [create,call,call,call] v35'41 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.150+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cfc40 con 0x5584105c3820 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.151+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v35'28 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.151+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105db4c0 con 0x5584105ba4d0 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.152+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.152+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105db950 con 0x5584105beec0 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.153+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 gc.7 [create,call,call,call] v35'27 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.153+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105db950 con 0x7fade0037040 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.154+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(70 gc.8 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.154+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105db950 con 0x5584105c3820 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.155+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v35'23 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.155+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dbec0 con 0x7fade0037040 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.156+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 gc.10 [create,call,call,call] v35'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.156+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dbec0 con 0x5584105beec0 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.157+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 gc.11 [create,call,call,call] v35'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.157+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dbec0 con 0x7fade0037040 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.158+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 gc.12 [create,call,call,call] v35'17 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.158+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dbec0 con 0x5584105beec0 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.159+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(75 gc.13 [create,call,call,call] v35'33 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.159+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dbec0 con 0x5584105ba4d0 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.160+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v35'141 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.160+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dbec0 con 0x5584105c3820 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.162+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v35'35 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.162+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc470 con 0x7fade0037040 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.162+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(78 gc.16 [create,call,call,call] v35'43 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.162+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105c3820 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.163+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v35'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.164+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105ba4d0 2024-09-19T11:13:58.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.165+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v35'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.165+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105ba4d0 2024-09-19T11:13:58.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.165+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v35'142 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.165+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105c3820 2024-09-19T11:13:58.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.167+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v35'36 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.167+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x7fade0037040 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.168+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(83 gc.21 [create,call,call,call] v35'27 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.168+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.169+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v35'20 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.169+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.170+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.170+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.170+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v35'13 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.170+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.171+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v35'29 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.171+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105beec0 2024-09-19T11:13:58.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.173+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(88 gc.26 [create,call,call,call] v35'19 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.173+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc490 con 0x5584105c3820 2024-09-19T11:13:58.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.174+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v35'17 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.174+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105beec0 2024-09-19T11:13:58.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.175+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(90 gc.28 [create,call,call,call] v35'28 uv8 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.175+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105c3820 2024-09-19T11:13:58.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.176+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v35'37 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.176+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x5584105beec0 2024-09-19T11:13:58.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.177+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(92 gc.30 [create,call,call,call] v35'34 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.177+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105dc450 con 0x7fade0037040 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.178+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(93 gc.31 [create,call,call,call] v35'23 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fac277fe640 20 reqs_thread_entry: start 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 20 Filter name: none 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fac257fa640 20 reqs_thread_entry: start 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558410607330 con 0x7fade0037040 2024-09-19T11:13:58.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.179+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:95 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558410608c00 con 0x5584105beec0 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(95 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:58.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 20 get_obj_state: octx=0x7fadf000ab20 obj=myfoo:four state=0x558410609978 s->prefetch_data=0 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 3.37s0 3:efad1eb2:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1_four:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55841060bbe0 con 0x5584105ba4d0 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(96 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1_four [call out=24b,getxattrs out=851b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 276+0+891 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 10 manifest: total_size = 4 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 20 get_obj_state: setting s->obj_tag to 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.13488427372159336768 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 20 get_obj_state: octx=0x7fadf000ab20 obj=myfoo:four state=0x558410609978 s->prefetch_data=0 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 20 prepare_atomic_modification: state is not atomic. state=0x558410609978 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6 2024-09-19T11:13:58.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.180+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:97 4.2d 4:b7aa4218:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=182b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55841060f6f0 con 0x5584105beec0 2024-09-19T11:13:58.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.182+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(97 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6 [stat,call,call] v35'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.182+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:98 3.37s0 3:efad1eb2:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1_four:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55841060f6f0 con 0x5584105ba4d0 2024-09-19T11:13:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.183+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(98 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1_four [call] v35'2 uv2 ondisk = 0) ==== 192+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.183+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:99 4.2d 4:b7aa4218:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=259b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558410610180 con 0x5584105beec0 2024-09-19T11:13:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.184+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(99 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6 [stat,call,call] v35'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.184+0000 7facd9ffb640 20 handle_completion(): completion ok for obj=four 2024-09-19T11:13:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.184+0000 7facacfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.184+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:100 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94025698564208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55841060fcd0 con 0x5584105ba4d0 2024-09-19T11:13:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.185+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(100 data_loggenerations_metadata [watch unwatch cookie 94025698564208] v35'143 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.185+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94025698540480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cd840 con 0x7fade0037040 2024-09-19T11:13:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.186+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(101 notify.0 [watch unwatch cookie 94025698540480] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.186+0000 7fadfa726800 20 remove_watcher() i=0 2024-09-19T11:13:58.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.186+0000 7fadfa726800 2 removed watcher, disabling cache 2024-09-19T11:13:58.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.186+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:102 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94025698545088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c7bc0 con 0x5584105ba4d0 2024-09-19T11:13:58.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.188+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(102 notify.1 [watch unwatch cookie 94025698545088] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.188+0000 7fadfa726800 20 remove_watcher() i=1 2024-09-19T11:13:58.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.188+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:103 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94025698547840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c7bc0 con 0x5584105c3820 2024-09-19T11:13:58.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.189+0000 7fadedbd8640 1 -- 172.21.15.102:0/921915437 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(103 notify.2 [watch unwatch cookie 94025698547840] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade0009050 con 0x5584105c3820 2024-09-19T11:13:58.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.189+0000 7fadfa726800 20 remove_watcher() i=2 2024-09-19T11:13:58.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.189+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:104 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94025698552800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c7bc0 con 0x7fade0037040 2024-09-19T11:13:58.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.189+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(104 notify.3 [watch unwatch cookie 94025698552800] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x7fade0037040 2024-09-19T11:13:58.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.190+0000 7fadfa726800 20 remove_watcher() i=3 2024-09-19T11:13:58.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.190+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94025698550032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c7bc0 con 0x5584105ba4d0 2024-09-19T11:13:58.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.191+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(105 notify.4 [watch unwatch cookie 94025698550032] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fadf000a4d0 con 0x5584105ba4d0 2024-09-19T11:13:58.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.191+0000 7fadfa726800 20 remove_watcher() i=4 2024-09-19T11:13:58.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.191+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:106 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94025698558672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105ca110 con 0x5584105beec0 2024-09-19T11:13:58.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.192+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(106 notify.5 [watch unwatch cookie 94025698558672] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.192+0000 7fadfa726800 20 remove_watcher() i=5 2024-09-19T11:13:58.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.192+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:107 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94025698561168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105c7bc0 con 0x5584105beec0 2024-09-19T11:13:58.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.193+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(107 notify.6 [watch unwatch cookie 94025698561168] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.193+0000 7fadfa726800 20 remove_watcher() i=6 2024-09-19T11:13:58.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.193+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:108 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94025698538000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5584105cc2d0 con 0x5584105beec0 2024-09-19T11:13:58.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadf63d9640 1 -- 172.21.15.102:0/921915437 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(108 notify.7 [watch unwatch cookie 94025698538000] v35'146 uv144 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fade809f070 con 0x5584105beec0 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 20 remove_watcher() i=7 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584105beec0 msgr2=0x5584105c12b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584105beec0 0x5584105c12b0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584105ba4d0 msgr2=0x5584105bc990 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584105ba4d0 0x5584105bc990 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fade0037040 msgr2=0x7fade0036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fade0037040 0x7fade0036410 crc :-1 s=READY pgs=57 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584105c3820 msgr2=0x5584105c5ce0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584105c3820 0x5584105c5ce0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facc003d000 msgr2=0x7facc003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facc003d000 0x7facc003f4c0 secure :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0x7fade000c010 tx=0x7fade0010000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 msgr2=0x5584105aef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadf6bda640 1 -- 172.21.15.102:0/921915437 reap_dead start 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105aef00 secure :-1 s=READY pgs=492 cs=0 l=1 rev1=1 crypto rx=0x7fade8068f70 tx=0x7fade8059f20 comp rx=0 tx=0).stop 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 shutdown_connections 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 --2- 172.21.15.102:0/921915437 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584105a7b50 0x5584105aef00 unknown :-1 s=CLOSED pgs=492 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 >> 172.21.15.102:0/921915437 conn(0x5584105a3f50 msgr2=0x5584105a2160 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 shutdown_connections 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.194+0000 7fadfa726800 1 -- 172.21.15.102:0/921915437 wait complete. 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/3335206291 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd003d000 msgr2=0x7facd003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/3335206291 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd003d000 0x7facd003f4c0 secure :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0x7fade000bf40 tx=0x7fade000f000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/3335206291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55841059b2e0 msgr2=0x55841059b700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/3335206291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55841059b2e0 0x55841059b700 secure :-1 s=READY pgs=490 cs=0 l=1 rev1=1 crypto rx=0x7fade8096a30 tx=0x7fade807d550 comp rx=0 tx=0).stop 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/3335206291 shutdown_connections 2024-09-19T11:13:58.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/3335206291 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facd003d000 0x7facd003f4c0 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/3335206291 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55841059b2e0 0x55841059b700 unknown :-1 s=CLOSED pgs=490 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/3335206291 >> 172.21.15.102:0/3335206291 conn(0x55841058f690 msgr2=0x55841058fa70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/3335206291 shutdown_connections 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/3335206291 wait complete. 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558410586a10 msgr2=0x558410588e80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558410586a10 0x558410588e80 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584103f7b30 msgr2=0x5584105845f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584103f7b30 0x5584105845f0 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55841058aa70 msgr2=0x55841058ce60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55841058aa70 0x55841058ce60 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facdc03cfb0 msgr2=0x7facdc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7facdc03cfb0 0x7facdc03f470 secure :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0x7fade0001d70 tx=0x7fade00012d0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 msgr2=0x55841057cfa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 --2- 172.21.15.102:0/1824579221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584103f71f0 0x55841057cfa0 secure :-1 s=READY pgs=489 cs=0 l=1 rev1=1 crypto rx=0x7fade8045f50 tx=0x7fade8002fb0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadf6bda640 1 -- 172.21.15.102:0/1824579221 reap_dead start 2024-09-19T11:13:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 shutdown_connections 2024-09-19T11:13:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 >> 172.21.15.102:0/1824579221 conn(0x55841047eb90 msgr2=0x55841056f690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 shutdown_connections 2024-09-19T11:13:58.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.195+0000 7fadfa726800 1 -- 172.21.15.102:0/1824579221 wait complete. 2024-09-19T11:13:58.205 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'stats', '--bucket', 'myfoo'] 2024-09-19T11:13:58.205 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'stats', '--bucket', 'myfoo'] 2024-09-19T11:13:58.205 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket stats --bucket myfoo 2024-09-19T11:13:58.249 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:58.249 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.249+0000 7fb8f3f26800 1 Processor -- start 2024-09-19T11:13:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.249+0000 7fb8f3f26800 1 -- start start 2024-09-19T11:13:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.249+0000 7fb8f3f26800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x558920026a90 0x558920028f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.249+0000 7fb8f3f26800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5589200295d0 con 0x558920022f20 2024-09-19T11:13:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.249+0000 7fb8f3f26800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55891fead7d0 con 0x558920026a90 2024-09-19T11:13:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.250+0000 7fb8e73d8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x558920026a90 0x558920028f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.250+0000 7fb8efbd9640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x558920022f20 0x558920025310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52618/0 (socket says 172.21.15.102:52618) 2024-09-19T11:13:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.250+0000 7fb8efbd9640 1 -- 172.21.15.102:0/1399622545 learned_addr learned my addr 172.21.15.102:0/1399622545 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.250+0000 7fb8e73d8640 1 -- 172.21.15.102:0/1399622545 >> v1:172.21.15.37:6789/0 conn(0x558920022f20 legacy=0x558920025310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.250+0000 7fb8e73d8640 1 -- 172.21.15.102:0/1399622545 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892002a800 con 0x558920026a90 2024-09-19T11:13:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/1399622545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920026a90 0x558920028f50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800a470 tx=0x7fb8d8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d91d336ab3d997a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8ef3d8640 1 -- 172.21.15.102:0/1399622545 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d8053570 con 0x558920026a90 2024-09-19T11:13:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8ef3d8640 1 -- 172.21.15.102:0/1399622545 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8d8058070 con 0x558920026a90 2024-09-19T11:13:58.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8ef3d8640 1 -- 172.21.15.102:0/1399622545 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8d8053880 con 0x558920026a90 2024-09-19T11:13:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1399622545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920026a90 msgr2=0x558920028f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/1399622545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920026a90 0x558920028f50 secure :-1 s=READY pgs=494 cs=0 l=1 rev1=1 crypto rx=0x7fb8d800a470 tx=0x7fb8d8045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1399622545 shutdown_connections 2024-09-19T11:13:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/1399622545 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920026a90 0x558920028f50 unknown :-1 s=CLOSED pgs=494 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1399622545 >> 172.21.15.102:0/1399622545 conn(0x55892001ca60 msgr2=0x55892001eec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1399622545 shutdown_connections 2024-09-19T11:13:58.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.252+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1399622545 wait complete. 2024-09-19T11:13:58.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.266+0000 7fb8f3f26800 1 Processor -- start 2024-09-19T11:13:58.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.266+0000 7fb8f3f26800 1 -- start start 2024-09-19T11:13:58.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.266+0000 7fb8f3f26800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920112320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.266+0000 7fb8f3f26800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55891febadd0 con 0x558920022f20 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.266+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920112320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.266+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920112320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44806/0 (socket says 172.21.15.102:44806) 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.266+0000 7fb8efbd9640 1 -- 172.21.15.102:0/3815906942 learned_addr learned my addr 172.21.15.102:0/3815906942 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.267+0000 7fb8efbd9640 1 -- 172.21.15.102:0/3815906942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558920112910 con 0x558920022f20 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.267+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/3815906942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920112320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0001e40 tx=0x7fb8e0001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=543e095598b6d039 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.267+0000 7fb7dde0b640 1 -- 172.21.15.102:0/3815906942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e0012020 con 0x558920022f20 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.267+0000 7fb7dde0b640 1 -- 172.21.15.102:0/3815906942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e000e5a0 con 0x558920022f20 2024-09-19T11:13:58.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.267+0000 7fb7dde0b640 1 -- 172.21.15.102:0/3815906942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e000e8a0 con 0x558920022f20 2024-09-19T11:13:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 -- 172.21.15.102:0/3815906942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 msgr2=0x558920112320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/3815906942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920112320 secure :-1 s=READY pgs=495 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0001e40 tx=0x7fb8e0001e70 comp rx=0 tx=0).stop 2024-09-19T11:13:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 -- 172.21.15.102:0/3815906942 shutdown_connections 2024-09-19T11:13:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/3815906942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920112320 unknown :-1 s=CLOSED pgs=495 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 -- 172.21.15.102:0/3815906942 >> 172.21.15.102:0/3815906942 conn(0x55892001ca60 msgr2=0x55892010dca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 -- 172.21.15.102:0/3815906942 shutdown_connections 2024-09-19T11:13:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 -- 172.21.15.102:0/3815906942 wait complete. 2024-09-19T11:13:58.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 Processor -- start 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 -- start start 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920119e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8f3f26800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558920029aa0 con 0x558920022f20 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920119e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.268+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920119e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44820/0 (socket says 172.21.15.102:44820) 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.269+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2334178833 learned_addr learned my addr 172.21.15.102:0/2334178833 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.269+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2334178833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892011a3f0 con 0x558920022f20 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.269+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920119e90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000c010 tx=0x7fb8e0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.269+0000 7fb7d7fff640 1 -- 172.21.15.102:0/2334178833 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e0012030 con 0x558920022f20 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.269+0000 7fb7d7fff640 1 -- 172.21.15.102:0/2334178833 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e00014a0 con 0x558920022f20 2024-09-19T11:13:58.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.269+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55892011a680 con 0x558920022f20 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.269+0000 7fb7d7fff640 1 -- 172.21.15.102:0/2334178833 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e001a7a0 con 0x558920022f20 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.269+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892011b080 con 0x558920022f20 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.270+0000 7fb7d7fff640 1 -- 172.21.15.102:0/2334178833 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb8e0015020 con 0x558920022f20 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.270+0000 7fb7d7fff640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7d803cfb0 0x7fb7d803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.270+0000 7fb7d7fff640 1 -- 172.21.15.102:0/2334178833 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb8e0020030 con 0x558920022f20 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.270+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7d803cfb0 0x7fb7d803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.270+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920026a90 0x5589201214e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.270+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920121a20 con 0x558920026a90 2024-09-19T11:13:58.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.270+0000 7fb8f03da640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920026a90 0x5589201214e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.271+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7d803cfb0 0x7fb7d803f470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8057000 tx=0x7fb8d8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.271+0000 7fb8f03da640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920026a90 0x5589201214e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.271+0000 7fb8f03da640 1 -- 172.21.15.102:0/2334178833 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920026a90 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.271+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920121dc0 con 0x558920026a90 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.271+0000 7fb8f03da640 1 -- 172.21.15.102:0/2334178833 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920026a90 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.271+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558920123880 0x558920125d20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.271+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201264b0 con 0x558920123880 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.272+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558920123880 0x558920125d20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.272+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558920123880 0x558920125d20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.272+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2334178833 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb8e001ab20 con 0x558920123880 2024-09-19T11:13:58.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.272+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920122610 con 0x558920026a90 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.273+0000 7fb8f03da640 1 -- 172.21.15.102:0/2334178833 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920026a90 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.273+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920127910 0x558920129d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.273+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55892012a440 con 0x558920127910 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.273+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920127910 0x558920129d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.273+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920127910 0x558920129d00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.273+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2334178833 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb8d8051070 con 0x558920127910 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8f3f26800 1 Processor -- start 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8f3f26800 1 -- start start 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8f3f26800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920138180 0x5589201385a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8f3f26800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55891ff194a0 con 0x558920138180 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920138180 0x5589201385a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920138180 0x5589201385a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44824/0 (socket says 172.21.15.102:44824) 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8efbd9640 1 -- 172.21.15.102:0/1269843907 learned_addr learned my addr 172.21.15.102:0/1269843907 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8efbd9640 1 -- 172.21.15.102:0/1269843907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558920138be0 con 0x558920138180 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.274+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/1269843907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920138180 0x5589201385a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0052a60 tx=0x7fb8e00423b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.275+0000 7fb7d57fa640 1 -- 172.21.15.102:0/1269843907 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e004f030 con 0x558920138180 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.275+0000 7fb7d57fa640 1 -- 172.21.15.102:0/1269843907 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e00542d0 con 0x558920138180 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.275+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1269843907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x558920139410 con 0x558920138180 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.275+0000 7fb7d57fa640 1 -- 172.21.15.102:0/1269843907 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e00512c0 con 0x558920138180 2024-09-19T11:13:58.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.275+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1269843907 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5589201399b0 con 0x558920138180 2024-09-19T11:13:58.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.275+0000 7fb7d57fa640 1 -- 172.21.15.102:0/1269843907 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb8e004b060 con 0x558920138180 2024-09-19T11:13:58.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb7d57fa640 1 --2- 172.21.15.102:0/1269843907 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7c803d000 0x7fb7c803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb7d57fa640 1 -- 172.21.15.102:0/1269843907 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb8e0050070 con 0x558920138180 2024-09-19T11:13:58.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/1269843907 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7c803d000 0x7fb7c803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8f3f26800 1 Processor -- start 2024-09-19T11:13:58.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8f3f26800 1 -- start start 2024-09-19T11:13:58.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/1269843907 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7c803d000 0x7fb7c803f4c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55892011bf90 tx=0x7fb8d8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8f3f26800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x5589200223d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8f3f26800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558920112d40 con 0x558920021fd0 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x5589200223d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x5589200223d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44826/0 (socket says 172.21.15.102:44826) 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2045484364 learned_addr learned my addr 172.21.15.102:0/2045484364 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.276+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2045484364 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558920022910 con 0x558920021fd0 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/2045484364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x5589200223d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb8e001a6f0 tx=0x7fb8e003aa90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4295af1657de2941 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb7ceffd640 1 -- 172.21.15.102:0/2045484364 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e0058020 con 0x558920021fd0 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb7ceffd640 1 -- 172.21.15.102:0/2045484364 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e0042d90 con 0x558920021fd0 2024-09-19T11:13:58.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb7ceffd640 1 -- 172.21.15.102:0/2045484364 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e000cdc0 con 0x558920021fd0 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2045484364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 msgr2=0x5589200223d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2045484364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x5589200223d0 secure :-1 s=READY pgs=498 cs=0 l=1 rev1=1 crypto rx=0x7fb8e001a6f0 tx=0x7fb8e003aa90 comp rx=0 tx=0).stop 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2045484364 shutdown_connections 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2045484364 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x5589200223d0 unknown :-1 s=CLOSED pgs=498 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2045484364 >> 172.21.15.102:0/2045484364 conn(0x558920140e40 msgr2=0x55892013f080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2045484364 shutdown_connections 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2045484364 wait complete. 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.277+0000 7fb8f3f26800 1 Processor -- start 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8f3f26800 1 -- start start 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8f3f26800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x55892014e090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8f3f26800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558920020d10 con 0x558920021fd0 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x55892014e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8efbd9640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x55892014e090 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44832/0 (socket says 172.21.15.102:44832) 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 learned_addr learned my addr 172.21.15.102:0/2848955140 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55892014e5f0 con 0x558920021fd0 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x55892014e090 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0044be0 tx=0x7fb8e003a8e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb7cd7fa640 1 -- 172.21.15.102:0/2848955140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e006c070 con 0x558920021fd0 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb7cd7fa640 1 -- 172.21.15.102:0/2848955140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8e00247e0 con 0x558920021fd0 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55892014e5f0 con 0x558920021fd0 2024-09-19T11:13:58.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb7cd7fa640 1 -- 172.21.15.102:0/2848955140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8e0044110 con 0x558920021fd0 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.278+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55892014e5f0 con 0x558920021fd0 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.279+0000 7fb7cd7fa640 1 -- 172.21.15.102:0/2848955140 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb8e006f070 con 0x558920021fd0 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb7cd7fa640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7b803cfb0 0x7fb7b803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb7cd7fa640 1 -- 172.21.15.102:0/2848955140 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fb8e0068c80 con 0x558920021fd0 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7b803cfb0 0x7fb7b803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920159670 0x55892015bb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55892015c250 con 0x558920159670 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb8f03da640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920159670 0x55892015bb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7b803cfb0 0x7fb7b803f470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8053570 tx=0x7fb8d8053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.280+0000 7fb8f03da640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920159670 0x55892015bb00 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 realm 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55892015c660 con 0x558920159670 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55892015cf30 con 0x558920159670 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55892015d2d0 con 0x558920159670 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55892015ddc0 0x5589201601b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201608f0 con 0x55892015ddc0 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.281+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55892015ddc0 0x5589201601b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.282+0000 7fb8efbd9640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55892015ddc0 0x5589201601b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.282+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.282+0000 7fb8f3f26800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:58.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.282+0000 7fb8f3f26800 20 searching for the correct realm 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.282+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920162990 0x558920164e50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.282+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558920165520 con 0x558920162990 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.282+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920162990 0x558920164e50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.282+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920162990 0x558920164e50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.283+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.283+0000 7fb8e73d8640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb8d805f040 0x7fb8d805f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.283+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x558920165520 con 0x7fb8d805f040 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.283+0000 7fb8f03da640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb8d805f040 0x7fb8d805f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.283+0000 7fb8f03da640 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb8d805f040 0x7fb8d805f930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.283+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.283+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55892015d2d0 con 0x55892015ddc0 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.284+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.284+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55892015d2d0 con 0x558920159670 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.284+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.284+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55892015d2d0 con 0x558920159670 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.284+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.284+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x55892015d2d0 con 0x55892015ddc0 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.284+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.284+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x55892015ddc0 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.285+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.285+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x7fb8d805f040 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.285+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.285+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920162990 2024-09-19T11:13:58.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.285+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.285+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920159670 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.285+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.285+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x55892015ddc0 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920159670 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x7fb8d805f040 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920162990 2024-09-19T11:13:58.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920162990 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.286+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x55892015ddc0 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.287+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.287+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920162990 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.287+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.287+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920162990 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.287+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.287+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920159670 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.287+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.287+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920159670 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.313 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x55892015ddc0 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920162990 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x7fb8d805f040 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920159670 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.288+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x55892015ddc0 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.289+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.289+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920162990 2024-09-19T11:13:58.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.289+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.289+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x55892015ddc0 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.289+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.289+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x7fb8d805f040 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.289+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.289+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920162990 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x55892015ddc0 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x558920159670 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7fb8e007a040 con 0x7fb8d805f040 2024-09-19T11:13:58.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f3f26800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f3f26800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f3f26800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f3f26800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f3f26800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f3f26800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.290+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920161290 con 0x558920159670 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920161290 con 0x558920159670 2024-09-19T11:13:58.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920161260 con 0x558920162990 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 20 zone default found 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 4 Realm: () 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:58.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 20 zonegroup default 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.291+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920161b30 con 0x55892015ddc0 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920167390 con 0x558920162990 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558920167730 con 0x558920162990 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 20 started sync module instance, tier type = 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.292+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558920166830 con 0x7fb8d805f040 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.293+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.293+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94047437221200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558920166830 con 0x7fb8d805f040 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.293+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201681b0 con 0x558920159670 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.294+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94047437221200] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.294+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.294+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94047437225120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558920166830 con 0x558920159670 2024-09-19T11:13:58.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.294+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558920168c40 con 0x558920162990 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.295+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.295+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94047437227792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201694e0 con 0x558920162990 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.295+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558920169fe0 con 0x7fb8d805f040 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.296+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94047437225120] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.296+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94047437227792] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.296+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.296+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94047437230128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558920166380 con 0x7fb8d805f040 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.296+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55892016a880 con 0x558920159670 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.297+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.297+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94047437235072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55892016a7a0 con 0x558920159670 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.297+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55892016b7c0 con 0x55892015ddc0 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.297+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94047437230128] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.298+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94047437235072] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.298+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.298+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94047437237360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x558920169ad0 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.298+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55892016c090 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.299+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94047437237360] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.299+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.299+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94047437238928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55892016c8e0 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.299+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55892016d170 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94047437238928] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'147 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94047437243440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55892016cd00 con 0x55892015ddc0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8f3f26800 20 add_watcher() i=0 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8f3f26800 20 add_watcher() i=1 2024-09-19T11:13:58.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8f3f26800 20 add_watcher() i=2 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8f3f26800 20 add_watcher() i=3 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8f3f26800 20 add_watcher() i=4 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8f3f26800 20 add_watcher() i=5 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.300+0000 7fb8f3f26800 20 add_watcher() i=6 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.302+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94047437243440] v35'148 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.302+0000 7fb8f3f26800 20 add_watcher() i=7 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.302+0000 7fb8f3f26800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.302+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201705c0 con 0x558920159670 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.302+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.302+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94047437244960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55892016dae0 con 0x558920159670 2024-09-19T11:13:58.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.303+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94047437244960] v35'144 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.303+0000 7fb7a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.303+0000 7fb8f3f26800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.303+0000 7fb8f3f26800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.303+0000 7fb8f3f26800 5 note: GC not initialized 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.303+0000 7fb7a4fe1640 20 reqs_thread_entry: start 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.303+0000 7fb8f3f26800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.303+0000 7fb8f3f26800 20 Filter name: none 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.304+0000 7fb71e7fc640 20 reqs_thread_entry: start 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.304+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.304+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201a3570 con 0x7fb8d805f040 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.304+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.304+0000 7fb8f3f26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.304+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.304+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201a3e00 con 0x55892015ddc0 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201a3fc0 con 0x7fb8d805f040 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(64 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201a5410 con 0x55892015ddc0 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(65 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 20 couldn't put binfo cache entry, might have raced with data changes 2024-09-19T11:13:58.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 4.e 4:735adac5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201a6d00 con 0x7fb8d805f040 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 4.15 4:a8990202:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201a9880 con 0x558920162990 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 4.0 4:015ead7d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201ac460 con 0x558920162990 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 4.2a 4:54dc5602:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201aedc0 con 0x558920159670 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.305+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 4.28 4:14a92d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201b1740 con 0x558920159670 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 4.4 4:22751d1b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201b41b0 con 0x55892015ddc0 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 4.2d 4:b7aa4218:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201b41b0 con 0x55892015ddc0 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 4.1f 4:f9ffeb7c:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201b9010 con 0x558920162990 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 4.e 4:72d65baa:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb10 con 0x7fb8d805f040 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:75 4.1 4:80601e6d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x7fb8d805f040 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:76 4.0 4:02fa5d61:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5589201c0f60 con 0x558920162990 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.1 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(73 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb8d8051070 con 0x558920162990 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(71 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.5 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(66 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.0 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.8 [call out=128b] v0'0 uv6 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(72 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(69 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(70 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.4 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(76 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.10 [call out=89b] v0'0 uv2 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7fb8d809d070 con 0x558920162990 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.306+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(75 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.307+0000 7fb7a5fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.307+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:77 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94047437244960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x558920159670 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.308+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(77 data_loggenerations_metadata [watch unwatch cookie 94047437244960] v35'145 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.308+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94047437221200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x7fb8d805f040 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.309+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 notify.0 [watch unwatch cookie 94047437221200] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.309+0000 7fb8f3f26800 20 remove_watcher() i=0 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.309+0000 7fb8f3f26800 2 removed watcher, disabling cache 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.309+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:79 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94047437225120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x558920159670 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.310+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(79 notify.1 [watch unwatch cookie 94047437225120] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.310+0000 7fb8f3f26800 20 remove_watcher() i=1 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.310+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:80 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94047437227792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x558920162990 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.311+0000 7fb8e73d8640 1 -- 172.21.15.102:0/2848955140 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(80 notify.2 [watch unwatch cookie 94047437227792] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8d809d070 con 0x558920162990 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.311+0000 7fb8f3f26800 20 remove_watcher() i=2 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.311+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:81 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94047437230128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x7fb8d805f040 2024-09-19T11:13:58.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.312+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(81 notify.3 [watch unwatch cookie 94047437230128] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x7fb8d805f040 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.312+0000 7fb8f3f26800 20 remove_watcher() i=3 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.312+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:82 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94047437235072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x558920159670 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.313+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(82 notify.4 [watch unwatch cookie 94047437235072] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e800a4d0 con 0x558920159670 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.313+0000 7fb8f3f26800 20 remove_watcher() i=4 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.313+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:83 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94047437237360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x55892015ddc0 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.314+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(83 notify.5 [watch unwatch cookie 94047437237360] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.314+0000 7fb8f3f26800 20 remove_watcher() i=5 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.314+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:84 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94047437238928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x55892015ddc0 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.315+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(84 notify.6 [watch unwatch cookie 94047437238928] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.315+0000 7fb8f3f26800 20 remove_watcher() i=6 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.315+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94047437243440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5589201bbb90 con 0x55892015ddc0 2024-09-19T11:13:58.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8efbd9640 1 -- 172.21.15.102:0/2848955140 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(85 notify.7 [watch unwatch cookie 94047437243440] v35'149 uv147 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb8e006e030 con 0x55892015ddc0 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 20 remove_watcher() i=7 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55892015ddc0 msgr2=0x5589201601b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55892015ddc0 0x5589201601b0 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920159670 msgr2=0x55892015bb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920159670 0x55892015bb00 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb8d805f040 msgr2=0x7fb8d805f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb8d805f040 0x7fb8d805f930 crc :-1 s=READY pgs=58 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920162990 msgr2=0x558920164e50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920162990 0x558920164e50 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7b803cfb0 msgr2=0x7fb7b803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7b803cfb0 0x7fb7b803f470 secure :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8053570 tx=0x7fb8d8053000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 msgr2=0x55892014e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f03da640 1 -- 172.21.15.102:0/2848955140 reap_dead start 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.316+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x55892014e090 secure :-1 s=READY pgs=499 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0044be0 tx=0x7fb8e003a8e0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 shutdown_connections 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2848955140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920021fd0 0x55892014e090 unknown :-1 s=CLOSED pgs=499 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 >> 172.21.15.102:0/2848955140 conn(0x558920140e40 msgr2=0x55892013f050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 shutdown_connections 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2848955140 wait complete. 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1269843907 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7c803d000 msgr2=0x7fb7c803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/1269843907 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7c803d000 0x7fb7c803f4c0 secure :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0x55892011bf90 tx=0x7fb8d8005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1269843907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920138180 msgr2=0x5589201385a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/1269843907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920138180 0x5589201385a0 secure :-1 s=READY pgs=497 cs=0 l=1 rev1=1 crypto rx=0x7fb8e0052a60 tx=0x7fb8e00423b0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1269843907 shutdown_connections 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/1269843907 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7c803d000 0x7fb7c803f4c0 unknown :-1 s=CLOSED pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/1269843907 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920138180 0x5589201385a0 unknown :-1 s=CLOSED pgs=497 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1269843907 >> 172.21.15.102:0/1269843907 conn(0x55892012c530 msgr2=0x55892012c910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1269843907 shutdown_connections 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/1269843907 wait complete. 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558920123880 msgr2=0x558920125d20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x558920123880 0x558920125d20 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920026a90 msgr2=0x5589201214e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x558920026a90 0x5589201214e0 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920127910 msgr2=0x558920129d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x558920127910 0x558920129d00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7d803cfb0 msgr2=0x7fb7d803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb7d803cfb0 0x7fb7d803f470 secure :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0x7fb8d8057000 tx=0x7fb8d8052000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 msgr2=0x558920119e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.317+0000 7fb8f3f26800 1 --2- 172.21.15.102:0/2334178833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x558920022f20 0x558920119e90 secure :-1 s=READY pgs=496 cs=0 l=1 rev1=1 crypto rx=0x7fb8e000c010 tx=0x7fb8e0000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.318+0000 7fb8f03da640 1 -- 172.21.15.102:0/2334178833 reap_dead start 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.318+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 shutdown_connections 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.318+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 >> 172.21.15.102:0/2334178833 conn(0x55892001ca60 msgr2=0x558920113810 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.318+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 shutdown_connections 2024-09-19T11:13:58.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.318+0000 7fb8f3f26800 1 -- 172.21.15.102:0/2334178833 wait complete. 2024-09-19T11:13:58.342 INFO:teuthology.orchestra.run.smithi102.stdout:{"bucket":"myfoo","tenant":"","versioning":"off","zonegroup":"68013f1d-b756-462e-83a9-97539995db13","placement_rule":"default-placement","explicit_placement":{"data_pool":"","data_extra_pool":"","index_pool":""},"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","marker":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1","index_type":"Normal","index_generation":0,"num_shards":11,"reshard_status":"None","judge_reshard_lock_time":"0.000000","object_lock_enabled":false,"mfa_enabled":false,"owner":"foo","ver":"0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1","master_ver":"0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0","mtime":"2024-09-19T11:13:57.781171Z","creation_time":"2024-09-19T11:13:54.975364Z","max_marker":"0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#","usage":{"rgw.main":{"size":0,"size_actual":0,"size_utilized":0,"size_kb":0,"size_kb_actual":0,"size_kb_utilized":0,"num_objects":0}},"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"read_tracker":2} 2024-09-19T11:13:58.342 DEBUG:tasks.util.rgw: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68013f1d-b756-462e-83a9-97539995db13', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-19T11:13:57.781171Z', 'creation_time': '2024-09-19T11:13:54.975364Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 2} 2024-09-19T11:13:58.343 INFO:tasks.util.rgw:rgwadmin: client.0 : ['log', 'list'] 2024-09-19T11:13:58.343 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'log', 'list'] 2024-09-19T11:13:58.343 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph log list 2024-09-19T11:13:58.385 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:58.385 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff4a120e800 1 Processor -- start 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff4a120e800 1 -- start start 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff4a120e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5629eeed0a90 0x5629eeed2f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff4a120e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5629eeed35d0 con 0x5629eeecce90 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff4a120e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5629eed577d0 con 0x5629eeed0a90 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff497fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5629eeed0a90 0x5629eeed2f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff49c9bc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5629eeecce90 0x5629eeecf280 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:52630/0 (socket says 172.21.15.102:52630) 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff497fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5629eeed0a90 0x5629eeed2f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44848/0 (socket says 172.21.15.102:44848) 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.385+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2309143005 learned_addr learned my addr 172.21.15.102:0/2309143005 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.386+0000 7ff497fff640 1 -- 172.21.15.102:0/2309143005 >> v1:172.21.15.37:6789/0 conn(0x5629eeecce90 legacy=0x5629eeecf280 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.386+0000 7ff497fff640 1 -- 172.21.15.102:0/2309143005 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629eeed4800 con 0x5629eeed0a90 2024-09-19T11:13:58.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.386+0000 7ff4977fe640 1 -- 172.21.15.102:0/2309143005 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2254793681 0 0) 0x5629eeed35d0 con 0x5629eeecce90 2024-09-19T11:13:58.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.387+0000 7ff497fff640 1 --2- 172.21.15.102:0/2309143005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeed0a90 0x5629eeed2f50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff48800a470 tx=0x7ff488045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd1834b00bf96245 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.387+0000 7ff4977fe640 1 -- 172.21.15.102:0/2309143005 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488053570 con 0x5629eeed0a90 2024-09-19T11:13:58.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.387+0000 7ff4977fe640 1 -- 172.21.15.102:0/2309143005 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff488058070 con 0x5629eeed0a90 2024-09-19T11:13:58.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.388+0000 7ff4977fe640 1 -- 172.21.15.102:0/2309143005 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff488053880 con 0x5629eeed0a90 2024-09-19T11:13:58.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.388+0000 7ff4a120e800 1 -- 172.21.15.102:0/2309143005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeed0a90 msgr2=0x5629eeed2f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.388+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2309143005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeed0a90 0x5629eeed2f50 secure :-1 s=READY pgs=501 cs=0 l=1 rev1=1 crypto rx=0x7ff48800a470 tx=0x7ff488045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:58.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.388+0000 7ff4a120e800 1 -- 172.21.15.102:0/2309143005 shutdown_connections 2024-09-19T11:13:58.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.388+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2309143005 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeed0a90 0x5629eeed2f50 unknown :-1 s=CLOSED pgs=501 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.388+0000 7ff4a120e800 1 -- 172.21.15.102:0/2309143005 >> 172.21.15.102:0/2309143005 conn(0x5629eeec6a50 msgr2=0x5629eeec8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.388+0000 7ff4a120e800 1 -- 172.21.15.102:0/2309143005 shutdown_connections 2024-09-19T11:13:58.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.388+0000 7ff4a120e800 1 -- 172.21.15.102:0/2309143005 wait complete. 2024-09-19T11:13:58.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.402+0000 7ff4a120e800 1 Processor -- start 2024-09-19T11:13:58.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.402+0000 7ff4a120e800 1 -- start start 2024-09-19T11:13:58.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.402+0000 7ff4a120e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eefbc170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.402+0000 7ff4a120e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5629eed64dd0 con 0x5629eeecce90 2024-09-19T11:13:58.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.402+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eefbc170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.402+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eefbc170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54210/0 (socket says 172.21.15.102:54210) 2024-09-19T11:13:58.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.402+0000 7ff49c9bc640 1 -- 172.21.15.102:0/1570624453 learned_addr learned my addr 172.21.15.102:0/1570624453 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.402+0000 7ff49c9bc640 1 -- 172.21.15.102:0/1570624453 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629eefbc760 con 0x5629eeecce90 2024-09-19T11:13:58.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/1570624453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eefbc170 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff490001ea0 tx=0x7ff49000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=afcabc370eed4e68 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff38ae05640 1 -- 172.21.15.102:0/1570624453 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490008070 con 0x5629eeecce90 2024-09-19T11:13:58.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff38ae05640 1 -- 172.21.15.102:0/1570624453 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49000d500 con 0x5629eeecce90 2024-09-19T11:13:58.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff38ae05640 1 -- 172.21.15.102:0/1570624453 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49000d880 con 0x5629eeecce90 2024-09-19T11:13:58.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff4a120e800 1 -- 172.21.15.102:0/1570624453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 msgr2=0x5629eefbc170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff4a120e800 1 --2- 172.21.15.102:0/1570624453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eefbc170 secure :-1 s=READY pgs=502 cs=0 l=1 rev1=1 crypto rx=0x7ff490001ea0 tx=0x7ff49000b6a0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff4a120e800 1 -- 172.21.15.102:0/1570624453 shutdown_connections 2024-09-19T11:13:58.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff4a120e800 1 --2- 172.21.15.102:0/1570624453 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eefbc170 unknown :-1 s=CLOSED pgs=502 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.403+0000 7ff4a120e800 1 -- 172.21.15.102:0/1570624453 >> 172.21.15.102:0/1570624453 conn(0x5629eeec6a50 msgr2=0x5629eefb7af0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff4a120e800 1 -- 172.21.15.102:0/1570624453 shutdown_connections 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff4a120e800 1 -- 172.21.15.102:0/1570624453 wait complete. 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff4a120e800 1 Processor -- start 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff4a120e800 1 -- start start 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff4a120e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eeecc5b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff4a120e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5629eeed3aa0 con 0x5629eeecce90 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eeecc5b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eeecc5b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54220/0 (socket says 172.21.15.102:54220) 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff49c9bc640 1 -- 172.21.15.102:0/645124712 learned_addr learned my addr 172.21.15.102:0/645124712 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.404+0000 7ff49c9bc640 1 -- 172.21.15.102:0/645124712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629eeeccb10 con 0x5629eeecce90 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.405+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eeecc5b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff4900012f0 tx=0x7ff490000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.405+0000 7ff389602640 1 -- 172.21.15.102:0/645124712 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49000f9d0 con 0x5629eeecce90 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.405+0000 7ff389602640 1 -- 172.21.15.102:0/645124712 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49000fb70 con 0x5629eeecce90 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.405+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629eeecaec0 con 0x5629eeecce90 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.405+0000 7ff389602640 1 -- 172.21.15.102:0/645124712 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49000fe50 con 0x5629eeecce90 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.405+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629eeecb480 con 0x5629eeecce90 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.406+0000 7ff389602640 1 -- 172.21.15.102:0/645124712 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff490017040 con 0x5629eeecce90 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.406+0000 7ff389602640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff38403d1a0 0x7ff38403f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.406+0000 7ff389602640 1 -- 172.21.15.102:0/645124712 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff490015020 con 0x5629eeecce90 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.406+0000 7ff497fff640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff38403d1a0 0x7ff38403f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.406+0000 7ff4a120e800 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629eeed0a90 0x5629eefcd180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.406+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629eefcd700 con 0x5629eeed0a90 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.406+0000 7ff49d1bd640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629eeed0a90 0x5629eefcd180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.406+0000 7ff497fff640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff38403d1a0 0x7ff38403f660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff488057000 tx=0x7ff488052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.407+0000 7ff49d1bd640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629eeed0a90 0x5629eefcd180 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.407+0000 7ff49d1bd640 1 -- 172.21.15.102:0/645124712 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629eeed0a90 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.407+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629eeecb980 con 0x5629eeed0a90 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.407+0000 7ff49d1bd640 1 -- 172.21.15.102:0/645124712 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629eeed0a90 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.407+0000 7ff4a120e800 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629eefcfa10 0x5629eefd1e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.407+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629eefd24d0 con 0x5629eefcfa10 2024-09-19T11:13:58.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.407+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629eefcfa10 0x5629eefd1e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.408+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629eefcfa10 0x5629eefd1e00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.408+0000 7ff49c9bc640 1 -- 172.21.15.102:0/645124712 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff49002d070 con 0x5629eefcfa10 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.408+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629eefce8b0 con 0x5629eeed0a90 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.408+0000 7ff49d1bd640 1 -- 172.21.15.102:0/645124712 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629eeed0a90 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.409+0000 7ff4a120e800 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629eefd3910 0x5629eefd5d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.409+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629eefd6440 con 0x5629eefd3910 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.409+0000 7ff497fff640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629eefd3910 0x5629eefd5d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.409+0000 7ff497fff640 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629eefd3910 0x5629eefd5d00 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.409+0000 7ff497fff640 1 -- 172.21.15.102:0/645124712 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff488051070 con 0x5629eefd3910 2024-09-19T11:13:58.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.409+0000 7ff4a120e800 1 Processor -- start 2024-09-19T11:13:58.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff4a120e800 1 -- start start 2024-09-19T11:13:58.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff4a120e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eefe41c0 0x5629eefe45e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff4a120e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5629eedc34a0 con 0x5629eefe41c0 2024-09-19T11:13:58.434 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eefe41c0 0x5629eefe45e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eefe41c0 0x5629eefe45e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54236/0 (socket says 172.21.15.102:54236) 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2289840596 learned_addr learned my addr 172.21.15.102:0/2289840596 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2289840596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629eefe4c20 con 0x5629eefe41c0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/2289840596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eefe41c0 0x5629eefe45e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c010 tx=0x7ff4900187a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff3827fc640 1 -- 172.21.15.102:0/2289840596 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49004bf80 con 0x5629eefe41c0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff3827fc640 1 -- 172.21.15.102:0/2289840596 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49004c120 con 0x5629eefe41c0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff4a120e800 1 -- 172.21.15.102:0/2289840596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629eefe5450 con 0x5629eefe41c0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.410+0000 7ff3827fc640 1 -- 172.21.15.102:0/2289840596 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49004c400 con 0x5629eefe41c0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.411+0000 7ff4a120e800 1 -- 172.21.15.102:0/2289840596 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629eefe59f0 con 0x5629eefe41c0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.411+0000 7ff3827fc640 1 -- 172.21.15.102:0/2289840596 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff49001c800 con 0x5629eefe41c0 2024-09-19T11:13:58.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.411+0000 7ff3827fc640 1 --2- 172.21.15.102:0/2289840596 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff37403d000 0x7ff37403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.411+0000 7ff3827fc640 1 -- 172.21.15.102:0/2289840596 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff49003dca0 con 0x5629eefe41c0 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.411+0000 7ff497fff640 1 --2- 172.21.15.102:0/2289840596 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff37403d000 0x7ff37403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff4a120e800 1 Processor -- start 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff4a120e800 1 -- start start 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff497fff640 1 --2- 172.21.15.102:0/2289840596 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff37403d000 0x7ff37403f4c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5629eefcdb90 tx=0x7ff488005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff4a120e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff0fc0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff4a120e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5629eefbcb90 con 0x5629eeff0bc0 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff0fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff0fc0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54244/0 (socket says 172.21.15.102:54244) 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2252776806 learned_addr learned my addr 172.21.15.102:0/2252776806 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.412+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2252776806 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629eeff15b0 con 0x5629eeff0bc0 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/2252776806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff0fc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff49000f690 tx=0x7ff490046650 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3af87c003348d96f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff373fff640 1 -- 172.21.15.102:0/2252776806 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490046dc0 con 0x5629eeff0bc0 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff373fff640 1 -- 172.21.15.102:0/2252776806 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff490039d10 con 0x5629eeff0bc0 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff373fff640 1 -- 172.21.15.102:0/2252776806 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49001ade0 con 0x5629eeff0bc0 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff4a120e800 1 -- 172.21.15.102:0/2252776806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 msgr2=0x5629eeff0fc0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2252776806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff0fc0 secure :-1 s=READY pgs=505 cs=0 l=1 rev1=1 crypto rx=0x7ff49000f690 tx=0x7ff490046650 comp rx=0 tx=0).stop 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff4a120e800 1 -- 172.21.15.102:0/2252776806 shutdown_connections 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2252776806 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff0fc0 unknown :-1 s=CLOSED pgs=505 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff4a120e800 1 -- 172.21.15.102:0/2252776806 >> 172.21.15.102:0/2252776806 conn(0x5629eefecfc0 msgr2=0x5629eefeb200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff4a120e800 1 -- 172.21.15.102:0/2252776806 shutdown_connections 2024-09-19T11:13:58.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff4a120e800 1 -- 172.21.15.102:0/2252776806 wait complete. 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.413+0000 7ff4a120e800 1 Processor -- start 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff4a120e800 1 -- start start 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff4a120e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff8000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff4a120e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5629eeff1a20 con 0x5629eeff0bc0 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff8000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff49c9bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff8000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54254/0 (socket says 172.21.15.102:54254) 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 learned_addr learned my addr 172.21.15.102:0/2285592403 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5629eeff8560 con 0x5629eeff0bc0 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff8000 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff49000f690 tx=0x7ff49003bfc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff3727fc640 1 -- 172.21.15.102:0/2285592403 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff49001a750 con 0x5629eeff0bc0 2024-09-19T11:13:58.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff3727fc640 1 -- 172.21.15.102:0/2285592403 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff49001a8f0 con 0x5629eeff0bc0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff3727fc640 1 -- 172.21.15.102:0/2285592403 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff490047ae0 con 0x5629eeff0bc0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.414+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5629eeff8560 con 0x5629eeff0bc0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.415+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5629eeff8560 con 0x5629eeff0bc0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.415+0000 7ff3727fc640 1 -- 172.21.15.102:0/2285592403 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff490047c80 con 0x5629eeff0bc0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff3727fc640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff36803cf60 0x7ff36803f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff3727fc640 1 -- 172.21.15.102:0/2285592403 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff490068070 con 0x5629eeff0bc0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff497fff640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff36803cf60 0x7ff36803f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629ef003590 0x5629ef005a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef006170 con 0x5629ef003590 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff49d1bd640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629ef003590 0x5629ef005a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff497fff640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff36803cf60 0x7ff36803f420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x5629eefd6840 tx=0x7ff488053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.416+0000 7ff49d1bd640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629ef003590 0x5629ef005a20 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 realm 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef006580 con 0x5629ef003590 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:58.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef006e50 con 0x5629ef003590 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629ef007ce0 0x5629ef00a0d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.417+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef00a810 con 0x5629ef007ce0 2024-09-19T11:13:58.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.418+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629ef007ce0 0x5629ef00a0d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.418+0000 7ff49c9bc640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629ef007ce0 0x5629ef00a0d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.418+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.418+0000 7ff4a120e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.418+0000 7ff4a120e800 20 searching for the correct realm 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.418+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629ef00c8b0 0x5629ef00ed70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.418+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef00f440 con 0x5629ef00c8b0 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.419+0000 7ff497fff640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629ef00c8b0 0x5629ef00ed70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.419+0000 7ff497fff640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629ef00c8b0 0x5629ef00ed70 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.419+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.419+0000 7ff497fff640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff48805f040 0x7ff48805f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.419+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef00f440 con 0x7ff48805f040 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.419+0000 7ff49d1bd640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff48805f040 0x7ff48805f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.419+0000 7ff49d1bd640 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff48805f040 0x7ff48805f930 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.420+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.420+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.420+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.420+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.420+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.420+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.420+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.420+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.421+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.421+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.421+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.421+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.421+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.421+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.421+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.421+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.422+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.422+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.422+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.422+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.422+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.422+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.422+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.422+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.423+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.424+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.424+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.424+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.424+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.424+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.424+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.425+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.425+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.425+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.425+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.425+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.425+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.426+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.426+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.426+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.426+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.426+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.426+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.426+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.426+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.427+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.427+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef007ce0 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.427+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.427+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.427+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.427+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.427+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef00b1b0 con 0x5629ef003590 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef00b1b0 con 0x5629ef003590 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef00b160 con 0x5629ef00c8b0 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 zone default found 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 4 Realm: () 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:58.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 zonegroup default 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.428+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef00ba50 con 0x5629ef007ce0 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0112b0 con 0x5629ef00c8b0 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef011650 con 0x5629ef00c8b0 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 20 started sync module instance, tier type = 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.429+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef010750 con 0x7ff48805f040 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.430+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.430+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94738103471216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef010750 con 0x7ff48805f040 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.430+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef012130 con 0x5629ef003590 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.431+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94738103471216] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.432+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.432+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94738103475232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef010750 con 0x5629ef003590 2024-09-19T11:13:58.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.432+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef012be0 con 0x5629ef00c8b0 2024-09-19T11:13:58.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.433+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.433+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94738103477952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef013480 con 0x5629ef00c8b0 2024-09-19T11:13:58.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.433+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef013f40 con 0x7ff48805f040 2024-09-19T11:13:58.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.433+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94738103475232] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.434+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.434+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94738103482896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef013f00 con 0x7ff48805f040 2024-09-19T11:13:58.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.434+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef014970 con 0x5629ef003590 2024-09-19T11:13:58.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.434+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94738103477952] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.435+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94738103482896] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.435+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.435+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94738103468704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef014970 con 0x5629ef003590 2024-09-19T11:13:58.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.435+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef014df0 con 0x5629ef007ce0 2024-09-19T11:13:58.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.436+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.436+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94738103480272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef015690 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.436+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0160e0 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.436+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94738103468704] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.437+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94738103480272] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.437+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.437+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94738103491536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef016480 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.437+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef016d30 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94738103491536] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'150 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94738103485600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef016f10 con 0x5629ef007ce0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff4a120e800 20 add_watcher() i=0 2024-09-19T11:13:58.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff4a120e800 20 add_watcher() i=1 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff4a120e800 20 add_watcher() i=2 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff4a120e800 20 add_watcher() i=3 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff4a120e800 20 add_watcher() i=4 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff4a120e800 20 add_watcher() i=5 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.438+0000 7ff4a120e800 20 add_watcher() i=6 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.439+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94738103485600] v35'151 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.439+0000 7ff4a120e800 20 add_watcher() i=7 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.439+0000 7ff4a120e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.439+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5629ef01a2e0 con 0x5629ef003590 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.440+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.440+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94738103496192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0176d0 con 0x5629ef003590 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.441+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94738103496192] v35'146 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.441+0000 7ff3537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.441+0000 7ff4a120e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.441+0000 7ff4a120e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.441+0000 7ff4a120e800 5 note: GC not initialized 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.441+0000 7ff3527e4640 20 reqs_thread_entry: start 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.441+0000 7ff4a120e800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.441+0000 7ff4a120e800 20 Filter name: none 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.442+0000 7ff34b7fe640 20 reqs_thread_entry: start 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.442+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 6.0 6:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04c720 con 0x5629ef007ce0 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.442+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(62 [pgnls start_epoch 35 out=254b] v35'34 uv18 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.442+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.10 6:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0160e0 con 0x5629ef007ce0 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.442+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(63 [pgnls start_epoch 35 out=131b] v35'4 uv4 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.442+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.8 6:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0160e0 con 0x5629ef00c8b0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.443+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.443+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 6.18 6:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef012be0 con 0x5629ef007ce0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.443+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(65 [pgnls start_epoch 35 out=172b] v35'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.443+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef012be0 con 0x5629ef003590 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.443+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(66 [pgnls start_epoch 35 out=335b] v35'146 uv23 ondisk = 1) ==== 144+0+335 (crc 0 0 0) 0x7ff49800a4d0 con 0x5629ef003590 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.443+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 6.14 6:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.444+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(67 [pgnls start_epoch 35 out=213b] v35'11 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.444+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 6.c 6:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.444+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 [pgnls start_epoch 35 out=254b] v35'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.444+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 6.1c 6:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.444+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(69 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.444+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:70 6.2 6:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.444+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(70 [pgnls start_epoch 35 out=213b] v35'10 uv10 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.444+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 6.12 6:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.445+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(71 [pgnls start_epoch 35 out=172b] v35'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.445+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.a 6:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.445+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(72 [pgnls start_epoch 35 out=336b] v35'27 uv19 ondisk = 1) ==== 144+0+336 (crc 0 0 0) 0x7ff49800a4d0 con 0x7ff48805f040 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.445+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 6.1a 6:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.445+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(73 [pgnls start_epoch 35 out=131b] v35'17 uv9 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.445+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:74 6.6 6:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.446+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(74 [pgnls start_epoch 35 out=254b] v35'12 uv12 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.446+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 6.16 6:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.446+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(75 [pgnls start_epoch 35 out=90b] v35'17 uv9 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.446+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.e 6:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.446+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(76 [pgnls start_epoch 35 out=213b] v35'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff4980400e0 con 0x5629ef003590 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.446+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.1e 6:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.446+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(77 [pgnls start_epoch 35 out=254b] v35'10 uv10 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.446+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:78 6.1 6:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.447+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(78 [pgnls start_epoch 35 out=254b] v35'14 uv14 ondisk = 1) ==== 144+0+254 (crc 0 0 0) 0x7ff4980400e0 con 0x5629ef003590 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.447+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.11 6:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.447+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(79 [pgnls start_epoch 35 out=213b] v35'20 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.447+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:80 6.9 6:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef00c8b0 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.447+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(80 [pgnls start_epoch 35 out=172b] v35'29 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.447+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.19 6:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x5629ef003590 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.447+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(81 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff498046040 con 0x5629ef003590 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.447+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:82 6.5 6:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.448+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(82 [pgnls start_epoch 35 out=276b] v35'15 uv15 ondisk = 1) ==== 144+0+276 (crc 0 0 0) 0x7ff498046040 con 0x7ff48805f040 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.448+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.15 6:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5629ef0071f0 con 0x7ff48805f040 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.448+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(83 [pgnls start_epoch 35 out=172b] v35'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff498046040 con 0x7ff48805f040 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.448+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:84 6.d 6:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x5629ef003590 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.448+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(84 [pgnls start_epoch 35 out=295b] v35'25 uv17 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff498046040 con 0x5629ef003590 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.448+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:85 6.1d 6:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x5629ef007ce0 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.449+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(85 [pgnls start_epoch 35 out=172b] v35'28 uv12 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.449+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:86 6.3 6:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x7ff48805f040 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.449+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(86 [pgnls start_epoch 35 out=213b] v35'43 uv19 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff498046040 con 0x7ff48805f040 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.449+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:87 6.13 6:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x5629ef007ce0 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.449+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(87 [pgnls start_epoch 35 out=172b] v35'19 uv11 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.449+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:88 6.b 6:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x5629ef00c8b0 2024-09-19T11:13:58.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.450+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(88 [pgnls start_epoch 35 out=172b] v35'17 uv9 ondisk = 1) ==== 144+0+172 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.450+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1b 6:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x5629ef00c8b0 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.450+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(89 [pgnls start_epoch 35 out=90b] v35'13 uv5 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.450+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:90 6.7 6:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x5629ef00c8b0 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.450+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(90 [pgnls start_epoch 35 out=90b] v35'37 uv13 ondisk = 1) ==== 144+0+90 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.450+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:91 6.17 6:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x5629ef003590 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.450+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(91 [pgnls start_epoch 35 out=131b] v35'6 uv6 ondisk = 1) ==== 144+0+131 (crc 0 0 0) 0x7ff498046040 con 0x5629ef003590 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.450+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:92 6.f 6:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x7ff48805f040 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.451+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(92 [pgnls start_epoch 35 out=295b] v35'23 uv15 ondisk = 1) ==== 144+0+295 (crc 0 0 0) 0x7ff498046040 con 0x7ff48805f040 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.451+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:93 6.1f 6:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x7ff49804b040 con 0x5629ef007ce0 2024-09-19T11:13:58.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.451+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(93 [pgnls start_epoch 35 out=213b] v35'19 uv11 ondisk = 1) ==== 144+0+213 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.472 INFO:teuthology.orchestra.run.smithi102.stdout:["obj_delete_at_hint.0000000078","obj_delete_at_hint.0000000070","obj_delete_at_hint.0000000104","obj_delete_at_hint.0000000026","obj_delete_at_hint.0000000028","obj_delete_at_hint.0000000040","obj_delete_at_hint.0000000015","obj_delete_at_hint.0000000069","obj_delete_at_hint.0000000095","obj_delete_at_hint.0000000003","obj_delete_at_hint.0000000047","obj_delete_at_hint.0000000035","obj_delete_at_hint.0000000037","obj_delete_at_hint.0000000024","obj_delete_at_hint.0000000000","obj_delete_at_hint.0000000031","data_loggenerations_metadata","obj_delete_at_hint.0000000076","obj_delete_at_hint.0000000113","obj_delete_at_hint.0000000005","obj_delete_at_hint.0000000011","obj_delete_at_hint.0000000058","obj_delete_at_hint.0000000052","obj_delete_at_hint.0000000088","obj_delete_at_hint.0000000080","obj_delete_at_hint.0000000090","obj_delete_at_hint.0000000110","obj_delete_at_hint.0000000096","obj_delete_at_hint.0000000087","obj_delete_at_hint.0000000008","obj_delete_at_hint.0000000006","obj_delete_at_hint.0000000029","obj_delete_at_hint.0000000089","obj_delete_at_hint.0000000022","obj_delete_at_hint.0000000016","obj_delete_at_hint.0000000041","obj_delete_at_hint.0000000018","obj_delete_at_hint.0000000092","obj_delete_at_hint.0000000014","obj_delete_at_hint.0000000112","obj_delete_at_hint.0000000007","obj_delete_at_hint.0000000021","obj_delete_at_hint.0000000064","obj_delete_at_hint.0000000071","obj_delete_at_hint.0000000074","obj_delete_at_hint.0000000081","obj_delete_at_hint.0000000009","obj_delete_at_hint.0000000121","obj_delete_at_hint.0000000125","obj_delete_at_hint.0000000082","obj_delete_at_hint.0000000105","obj_delete_at_hint.0000000059","obj_delete_at_hint.0000000077","obj_delete_at_hint.0000000032","obj_delete_at_hint.0000000053","obj_delete_at_hint.0000000091","obj_delete_at_hint.0000000065","obj_delete_at_hint.0000000083","obj_delete_at_hint.0000000010","obj_delete_at_hint.0000000045","obj_delete_at_hint.0000000002","obj_delete_at_hint.0000000116","obj_delete_at_hint.0000000034","obj_delete_at_hint.0000000101","obj_delete_at_hint.0000000079","obj_delete_at_hint.0000000049","obj_delete_at_hint.0000000117","obj_delete_at_hint.0000000044","obj_delete_at_hint.0000000066","obj_delete_at_hint.0000000068","obj_delete_at_hint.0000000085","obj_delete_at_hint.0000000073","obj_delete_at_hint.0000000038","obj_delete_at_hint.0000000118","obj_delete_at_hint.0000000036","obj_delete_at_hint.0000000103","obj_delete_at_hint.0000000119","obj_delete_at_hint.0000000098","obj_delete_at_hint.0000000027","obj_delete_at_hint.0000000019","obj_delete_at_hint.0000000039","obj_delete_at_hint.0000000100","obj_delete_at_hint.0000000093","obj_delete_at_hint.0000000004","obj_delete_at_hint.0000000063","obj_delete_at_hint.0000000122","obj_delete_at_hint.0000000057","obj_delete_at_hint.0000000054","obj_delete_at_hint.0000000114","data_log.0","obj_delete_at_hint.0000000012","obj_delete_at_hint.0000000084","obj_delete_at_hint.0000000043","obj_delete_at_hint.0000000111","obj_delete_at_hint.0000000048","obj_delete_at_hint.0000000020","obj_delete_at_hint.0000000099","obj_delete_at_hint.0000000056","obj_delete_at_hint.0000000072","obj_delete_at_hint.0000000062","obj_delete_at_hint.0000000115","obj_delete_at_hint.0000000033","obj_delete_at_hint.0000000025","obj_delete_at_hint.0000000123","obj_delete_at_hint.0000000108","obj_delete_at_hint.0000000094","obj_delete_at_hint.0000000060","obj_delete_at_hint.0000000109","obj_delete_at_hint.0000000013","obj_delete_at_hint.0000000051","obj_delete_at_hint.0000000106","obj_delete_at_hint.0000000017","obj_delete_at_hint.0000000023","obj_delete_at_hint.0000000107","obj_delete_at_hint.0000000046","obj_delete_at_hint.0000000067","obj_delete_at_hint.0000000086","obj_delete_at_hint.0000000050","obj_delete_at_hint.0000000102","obj_delete_at_hint.0000000124","obj_delete_at_hint.0000000001","obj_delete_at_hint.0000000126","obj_delete_at_hint.0000000055","obj_delete_at_hint.0000000061","obj_delete_at_hint.0000000097","obj_delete_at_hint.0000000042","obj_delete_at_hint.0000000075","obj_delete_at_hint.0000000120","obj_delete_at_hint.0000000030"] 2024-09-19T11:13:58.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.453+0000 7ff3537e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.453+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94738103496192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef012be0 con 0x5629ef003590 2024-09-19T11:13:58.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.454+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94738103496192] v35'147 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff498046040 con 0x5629ef003590 2024-09-19T11:13:58.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.454+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94738103471216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04cbf0 con 0x7ff48805f040 2024-09-19T11:13:58.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.455+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94738103471216] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff498046040 con 0x7ff48805f040 2024-09-19T11:13:58.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.455+0000 7ff4a120e800 20 remove_watcher() i=0 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.455+0000 7ff4a120e800 2 removed watcher, disabling cache 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.455+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94738103475232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04aab0 con 0x5629ef003590 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.456+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94738103475232] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff498046040 con 0x5629ef003590 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.456+0000 7ff4a120e800 20 remove_watcher() i=1 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.456+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94738103477952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04cbf0 con 0x5629ef00c8b0 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.457+0000 7ff497fff640 1 -- 172.21.15.102:0/2285592403 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94738103477952] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff48807c040 con 0x5629ef00c8b0 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.457+0000 7ff4a120e800 20 remove_watcher() i=2 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.457+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94738103482896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04aab0 con 0x7ff48805f040 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.458+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94738103482896] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff498046040 con 0x7ff48805f040 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.458+0000 7ff4a120e800 20 remove_watcher() i=3 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.458+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94738103468704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04aab0 con 0x5629ef003590 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.459+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94738103468704] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff498046040 con 0x5629ef003590 2024-09-19T11:13:58.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.459+0000 7ff4a120e800 20 remove_watcher() i=4 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.459+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94738103480272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04aab0 con 0x5629ef007ce0 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.460+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94738103480272] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.460+0000 7ff4a120e800 20 remove_watcher() i=5 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.460+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94738103491536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04aab0 con 0x5629ef007ce0 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.461+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94738103491536] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.461+0000 7ff4a120e800 20 remove_watcher() i=6 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.461+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94738103485600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5629ef04aab0 con 0x5629ef007ce0 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff49c9bc640 1 -- 172.21.15.102:0/2285592403 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94738103485600] v35'152 uv150 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff49007e040 con 0x5629ef007ce0 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 20 remove_watcher() i=7 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629ef007ce0 msgr2=0x5629ef00a0d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629ef007ce0 0x5629ef00a0d0 crc :-1 s=READY pgs=108 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629ef003590 msgr2=0x5629ef005a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629ef003590 0x5629ef005a20 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff48805f040 msgr2=0x7ff48805f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff48805f040 0x7ff48805f930 crc :-1 s=READY pgs=59 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629ef00c8b0 msgr2=0x5629ef00ed70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629ef00c8b0 0x5629ef00ed70 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff36803cf60 msgr2=0x7ff36803f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff36803cf60 0x7ff36803f420 secure :-1 s=READY pgs=208 cs=0 l=1 rev1=1 crypto rx=0x5629eefd6840 tx=0x7ff488053000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 msgr2=0x5629eeff8000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff49d1bd640 1 -- 172.21.15.102:0/2285592403 reap_dead start 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff8000 secure :-1 s=READY pgs=506 cs=0 l=1 rev1=1 crypto rx=0x7ff49000f690 tx=0x7ff49003bfc0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 shutdown_connections 2024-09-19T11:13:58.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2285592403 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeff0bc0 0x5629eeff8000 unknown :-1 s=CLOSED pgs=506 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.462+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 >> 172.21.15.102:0/2285592403 conn(0x5629eefecfc0 msgr2=0x5629eefeb1d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 shutdown_connections 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/2285592403 wait complete. 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/2289840596 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff37403d000 msgr2=0x7ff37403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2289840596 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff37403d000 0x7ff37403f4c0 secure :-1 s=READY pgs=207 cs=0 l=1 rev1=1 crypto rx=0x5629eefcdb90 tx=0x7ff488005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/2289840596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eefe41c0 msgr2=0x5629eefe45e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2289840596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eefe41c0 0x5629eefe45e0 secure :-1 s=READY pgs=504 cs=0 l=1 rev1=1 crypto rx=0x7ff49000c010 tx=0x7ff4900187a0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/2289840596 shutdown_connections 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2289840596 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff37403d000 0x7ff37403f4c0 unknown :-1 s=CLOSED pgs=207 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/2289840596 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eefe41c0 0x5629eefe45e0 unknown :-1 s=CLOSED pgs=504 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/2289840596 >> 172.21.15.102:0/2289840596 conn(0x5629eefd8570 msgr2=0x5629eefd8950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/2289840596 shutdown_connections 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/2289840596 wait complete. 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629eefcfa10 msgr2=0x5629eefd1e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5629eefcfa10 0x5629eefd1e00 crc :-1 s=READY pgs=107 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629eeed0a90 msgr2=0x5629eefcd180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5629eeed0a90 0x5629eefcd180 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629eefd3910 msgr2=0x5629eefd5d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5629eefd3910 0x5629eefd5d00 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff38403d1a0 msgr2=0x7ff38403f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff38403d1a0 0x7ff38403f660 secure :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0x7ff488057000 tx=0x7ff488052000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 msgr2=0x5629eeecc5b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 --2- 172.21.15.102:0/645124712 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5629eeecce90 0x5629eeecc5b0 secure :-1 s=READY pgs=503 cs=0 l=1 rev1=1 crypto rx=0x7ff4900012f0 tx=0x7ff490000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff49d1bd640 1 -- 172.21.15.102:0/645124712 reap_dead start 2024-09-19T11:13:58.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 shutdown_connections 2024-09-19T11:13:58.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 >> 172.21.15.102:0/645124712 conn(0x5629eeec6a50 msgr2=0x5629eefbd660 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 shutdown_connections 2024-09-19T11:13:58.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.463+0000 7ff4a120e800 1 -- 172.21.15.102:0/645124712 wait complete. 2024-09-19T11:13:58.483 DEBUG:tasks.util.rgw: json result: ['obj_delete_at_hint.0000000078', 'obj_delete_at_hint.0000000070', 'obj_delete_at_hint.0000000104', 'obj_delete_at_hint.0000000026', 'obj_delete_at_hint.0000000028', 'obj_delete_at_hint.0000000040', 'obj_delete_at_hint.0000000015', 'obj_delete_at_hint.0000000069', 'obj_delete_at_hint.0000000095', 'obj_delete_at_hint.0000000003', 'obj_delete_at_hint.0000000047', 'obj_delete_at_hint.0000000035', 'obj_delete_at_hint.0000000037', 'obj_delete_at_hint.0000000024', 'obj_delete_at_hint.0000000000', 'obj_delete_at_hint.0000000031', 'data_loggenerations_metadata', 'obj_delete_at_hint.0000000076', 'obj_delete_at_hint.0000000113', 'obj_delete_at_hint.0000000005', 'obj_delete_at_hint.0000000011', 'obj_delete_at_hint.0000000058', 'obj_delete_at_hint.0000000052', 'obj_delete_at_hint.0000000088', 'obj_delete_at_hint.0000000080', 'obj_delete_at_hint.0000000090', 'obj_delete_at_hint.0000000110', 'obj_delete_at_hint.0000000096', 'obj_delete_at_hint.0000000087', 'obj_delete_at_hint.0000000008', 'obj_delete_at_hint.0000000006', 'obj_delete_at_hint.0000000029', 'obj_delete_at_hint.0000000089', 'obj_delete_at_hint.0000000022', 'obj_delete_at_hint.0000000016', 'obj_delete_at_hint.0000000041', 'obj_delete_at_hint.0000000018', 'obj_delete_at_hint.0000000092', 'obj_delete_at_hint.0000000014', 'obj_delete_at_hint.0000000112', 'obj_delete_at_hint.0000000007', 'obj_delete_at_hint.0000000021', 'obj_delete_at_hint.0000000064', 'obj_delete_at_hint.0000000071', 'obj_delete_at_hint.0000000074', 'obj_delete_at_hint.0000000081', 'obj_delete_at_hint.0000000009', 'obj_delete_at_hint.0000000121', 'obj_delete_at_hint.0000000125', 'obj_delete_at_hint.0000000082', 'obj_delete_at_hint.0000000105', 'obj_delete_at_hint.0000000059', 'obj_delete_at_hint.0000000077', 'obj_delete_at_hint.0000000032', 'obj_delete_at_hint.0000000053', 'obj_delete_at_hint.0000000091', 'obj_delete_at_hint.0000000065', 'obj_delete_at_hint.0000000083', 'obj_delete_at_hint.0000000010', 'obj_delete_at_hint.0000000045', 'obj_delete_at_hint.0000000002', 'obj_delete_at_hint.0000000116', 'obj_delete_at_hint.0000000034', 'obj_delete_at_hint.0000000101', 'obj_delete_at_hint.0000000079', 'obj_delete_at_hint.0000000049', 'obj_delete_at_hint.0000000117', 'obj_delete_at_hint.0000000044', 'obj_delete_at_hint.0000000066', 'obj_delete_at_hint.0000000068', 'obj_delete_at_hint.0000000085', 'obj_delete_at_hint.0000000073', 'obj_delete_at_hint.0000000038', 'obj_delete_at_hint.0000000118', 'obj_delete_at_hint.0000000036', 'obj_delete_at_hint.0000000103', 'obj_delete_at_hint.0000000119', 'obj_delete_at_hint.0000000098', 'obj_delete_at_hint.0000000027', 'obj_delete_at_hint.0000000019', 'obj_delete_at_hint.0000000039', 'obj_delete_at_hint.0000000100', 'obj_delete_at_hint.0000000093', 'obj_delete_at_hint.0000000004', 'obj_delete_at_hint.0000000063', 'obj_delete_at_hint.0000000122', 'obj_delete_at_hint.0000000057', 'obj_delete_at_hint.0000000054', 'obj_delete_at_hint.0000000114', 'data_log.0', 'obj_delete_at_hint.0000000012', 'obj_delete_at_hint.0000000084', 'obj_delete_at_hint.0000000043', 'obj_delete_at_hint.0000000111', 'obj_delete_at_hint.0000000048', 'obj_delete_at_hint.0000000020', 'obj_delete_at_hint.0000000099', 'obj_delete_at_hint.0000000056', 'obj_delete_at_hint.0000000072', 'obj_delete_at_hint.0000000062', 'obj_delete_at_hint.0000000115', 'obj_delete_at_hint.0000000033', 'obj_delete_at_hint.0000000025', 'obj_delete_at_hint.0000000123', 'obj_delete_at_hint.0000000108', 'obj_delete_at_hint.0000000094', 'obj_delete_at_hint.0000000060', 'obj_delete_at_hint.0000000109', 'obj_delete_at_hint.0000000013', 'obj_delete_at_hint.0000000051', 'obj_delete_at_hint.0000000106', 'obj_delete_at_hint.0000000017', 'obj_delete_at_hint.0000000023', 'obj_delete_at_hint.0000000107', 'obj_delete_at_hint.0000000046', 'obj_delete_at_hint.0000000067', 'obj_delete_at_hint.0000000086', 'obj_delete_at_hint.0000000050', 'obj_delete_at_hint.0000000102', 'obj_delete_at_hint.0000000124', 'obj_delete_at_hint.0000000001', 'obj_delete_at_hint.0000000126', 'obj_delete_at_hint.0000000055', 'obj_delete_at_hint.0000000061', 'obj_delete_at_hint.0000000097', 'obj_delete_at_hint.0000000042', 'obj_delete_at_hint.0000000075', 'obj_delete_at_hint.0000000120', 'obj_delete_at_hint.0000000030'] 2024-09-19T11:13:58.483 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'suspend', '--uid', 'foo'] 2024-09-19T11:13:58.483 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'suspend', '--uid', 'foo'] 2024-09-19T11:13:58.483 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user suspend --uid foo 2024-09-19T11:13:58.563 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:58.563 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:58.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.562+0000 7fbcdebaf800 1 Processor -- start 2024-09-19T11:13:58.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.562+0000 7fbcdebaf800 1 -- start start 2024-09-19T11:13:58.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcdebaf800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559806e37aa0 0x559806e39f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcdebaf800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559806e3a5e0 con 0x559806e33ea0 2024-09-19T11:13:58.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcdebaf800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x559806cbe7d0 con 0x559806e37aa0 2024-09-19T11:13:58.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcd3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559806e37aa0 0x559806e39f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcdc699640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x559806e33ea0 0x559806e36290 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34398/0 (socket says 172.21.15.102:34398) 2024-09-19T11:13:58.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcd3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559806e37aa0 0x559806e39f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54270/0 (socket says 172.21.15.102:54270) 2024-09-19T11:13:58.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcdc699640 1 -- 172.21.15.102:0/3322617699 learned_addr learned my addr 172.21.15.102:0/3322617699 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:58.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcd3fff640 1 -- 172.21.15.102:0/3322617699 >> v1:172.21.15.37:6789/0 conn(0x559806e33ea0 legacy=0x559806e36290 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.563+0000 7fbcd3fff640 1 -- 172.21.15.102:0/3322617699 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559806e3b810 con 0x559806e37aa0 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.565+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/3322617699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e37aa0 0x559806e39f60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400a470 tx=0x7fbcc4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=483f33b139b9d4de server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.565+0000 7fbcdbe98640 1 -- 172.21.15.102:0/3322617699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc4053570 con 0x559806e37aa0 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.565+0000 7fbcdbe98640 1 -- 172.21.15.102:0/3322617699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbcc4058070 con 0x559806e37aa0 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.565+0000 7fbcdbe98640 1 -- 172.21.15.102:0/3322617699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbcc4053880 con 0x559806e37aa0 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.565+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3322617699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e37aa0 msgr2=0x559806e39f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.565+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3322617699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e37aa0 0x559806e39f60 secure :-1 s=READY pgs=508 cs=0 l=1 rev1=1 crypto rx=0x7fbcc400a470 tx=0x7fbcc4045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.566+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3322617699 shutdown_connections 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.566+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3322617699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e37aa0 0x559806e39f60 unknown :-1 s=CLOSED pgs=508 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.566+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3322617699 >> 172.21.15.102:0/3322617699 conn(0x559806e2da60 msgr2=0x559806e2fec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.566+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3322617699 shutdown_connections 2024-09-19T11:13:58.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.566+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3322617699 wait complete. 2024-09-19T11:13:58.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.579+0000 7fbcdebaf800 1 Processor -- start 2024-09-19T11:13:58.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.579+0000 7fbcdebaf800 1 -- start start 2024-09-19T11:13:58.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.579+0000 7fbcdebaf800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f23330 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.579+0000 7fbcdebaf800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559806ccbdd0 con 0x559806e33ea0 2024-09-19T11:13:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.580+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f23330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.580+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f23330 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54282/0 (socket says 172.21.15.102:54282) 2024-09-19T11:13:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.580+0000 7fbcdc699640 1 -- 172.21.15.102:0/3687227201 learned_addr learned my addr 172.21.15.102:0/3687227201 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.580+0000 7fbcdc699640 1 -- 172.21.15.102:0/3687227201 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559806f23920 con 0x559806e33ea0 2024-09-19T11:13:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.580+0000 7fbcdc699640 1 --2- 172.21.15.102:0/3687227201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f23330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbccc001e40 tx=0x7fbccc001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27794abcfa4efd6c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.580+0000 7fbbca60c640 1 -- 172.21.15.102:0/3687227201 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc012020 con 0x559806e33ea0 2024-09-19T11:13:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.580+0000 7fbbca60c640 1 -- 172.21.15.102:0/3687227201 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc00e5a0 con 0x559806e33ea0 2024-09-19T11:13:58.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.580+0000 7fbbca60c640 1 -- 172.21.15.102:0/3687227201 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc00e8a0 con 0x559806e33ea0 2024-09-19T11:13:58.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3687227201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 msgr2=0x559806f23330 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3687227201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f23330 secure :-1 s=READY pgs=509 cs=0 l=1 rev1=1 crypto rx=0x7fbccc001e40 tx=0x7fbccc001e70 comp rx=0 tx=0).stop 2024-09-19T11:13:58.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3687227201 shutdown_connections 2024-09-19T11:13:58.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3687227201 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f23330 unknown :-1 s=CLOSED pgs=509 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3687227201 >> 172.21.15.102:0/3687227201 conn(0x559806e2da60 msgr2=0x559806f1ecb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3687227201 shutdown_connections 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3687227201 wait complete. 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 Processor -- start 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.581+0000 7fbcdebaf800 1 -- start start 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.582+0000 7fbcdebaf800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f2ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.582+0000 7fbcdebaf800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559806e3aab0 con 0x559806e33ea0 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.582+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f2ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.582+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f2ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54296/0 (socket says 172.21.15.102:54296) 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.582+0000 7fbcdc699640 1 -- 172.21.15.102:0/3128252856 learned_addr learned my addr 172.21.15.102:0/3128252856 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.582+0000 7fbcdc699640 1 -- 172.21.15.102:0/3128252856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559806f2b390 con 0x559806e33ea0 2024-09-19T11:13:58.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.582+0000 7fbcdc699640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f2ae30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0012b0 tx=0x7fbccc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.583+0000 7fbbc8e09640 1 -- 172.21.15.102:0/3128252856 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc012030 con 0x559806e33ea0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.583+0000 7fbbc8e09640 1 -- 172.21.15.102:0/3128252856 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc01a750 con 0x559806e33ea0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.583+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559806f2b620 con 0x559806e33ea0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.583+0000 7fbbc8e09640 1 -- 172.21.15.102:0/3128252856 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc01aa70 con 0x559806e33ea0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.583+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559806f2c020 con 0x559806e33ea0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.583+0000 7fbbc8e09640 1 -- 172.21.15.102:0/3128252856 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbccc015020 con 0x559806e33ea0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.584+0000 7fbbc8e09640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbc403d000 0x7fbbc403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.584+0000 7fbbc8e09640 1 -- 172.21.15.102:0/3128252856 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fbccc020030 con 0x559806e33ea0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.584+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbc403d000 0x7fbbc403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.584+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806e37aa0 0x559806f32480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.584+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f2cc00 con 0x559806e37aa0 2024-09-19T11:13:58.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.584+0000 7fbcdce9a640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806e37aa0 0x559806f32480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.584+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbc403d000 0x7fbbc403f4c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4057000 tx=0x7fbcc4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.584+0000 7fbcdce9a640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806e37aa0 0x559806f32480 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.585+0000 7fbcdce9a640 1 -- 172.21.15.102:0/3128252856 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806e37aa0 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.585+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f2c4d0 con 0x559806e37aa0 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.585+0000 7fbcdce9a640 1 -- 172.21.15.102:0/3128252856 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806e37aa0 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.585+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f34970 0x559806f36d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.585+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f37430 con 0x559806f34970 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.585+0000 7fbcdc699640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f34970 0x559806f36d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.585+0000 7fbcdc699640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f34970 0x559806f36d60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.586+0000 7fbcdc699640 1 -- 172.21.15.102:0/3128252856 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fbccc018ce0 con 0x559806f34970 2024-09-19T11:13:58.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.586+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f33810 con 0x559806e37aa0 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.586+0000 7fbcdce9a640 1 -- 172.21.15.102:0/3128252856 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806e37aa0 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.586+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f38870 0x559806f3ac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.586+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f3b3a0 con 0x559806f38870 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.586+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f38870 0x559806f3ac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.586+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f38870 0x559806f3ac60 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.587+0000 7fbcd3fff640 1 -- 172.21.15.102:0/3128252856 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f38870 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.587+0000 7fbcdebaf800 1 Processor -- start 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.587+0000 7fbcdebaf800 1 -- start start 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.587+0000 7fbcdebaf800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33660 0x559806e31ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.587+0000 7fbcdebaf800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559806d2a4a0 con 0x559806e33660 2024-09-19T11:13:58.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.587+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33660 0x559806e31ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.587+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33660 0x559806e31ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54298/0 (socket says 172.21.15.102:54298) 2024-09-19T11:13:58.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.587+0000 7fbcdc699640 1 -- 172.21.15.102:0/258922762 learned_addr learned my addr 172.21.15.102:0/258922762 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.588+0000 7fbcdc699640 1 -- 172.21.15.102:0/258922762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559806e33b80 con 0x559806e33660 2024-09-19T11:13:58.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.588+0000 7fbcdc699640 1 --2- 172.21.15.102:0/258922762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33660 0x559806e31ed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbccc052af0 tx=0x7fbccc016f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.588+0000 7fbbc1ffb640 1 -- 172.21.15.102:0/258922762 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc052e60 con 0x559806e33660 2024-09-19T11:13:58.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.588+0000 7fbbc1ffb640 1 -- 172.21.15.102:0/258922762 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc00d590 con 0x559806e33660 2024-09-19T11:13:58.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.588+0000 7fbcdebaf800 1 -- 172.21.15.102:0/258922762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559806e32410 con 0x559806e33660 2024-09-19T11:13:58.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.588+0000 7fbbc1ffb640 1 -- 172.21.15.102:0/258922762 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc00d870 con 0x559806e33660 2024-09-19T11:13:58.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.588+0000 7fbcdebaf800 1 -- 172.21.15.102:0/258922762 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559806e329b0 con 0x559806e33660 2024-09-19T11:13:58.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.589+0000 7fbbc1ffb640 1 -- 172.21.15.102:0/258922762 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbccc043ad0 con 0x559806e33660 2024-09-19T11:13:58.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.589+0000 7fbbc1ffb640 1 --2- 172.21.15.102:0/258922762 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbb403d000 0x7fbbb403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.589+0000 7fbbc1ffb640 1 -- 172.21.15.102:0/258922762 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fbccc040c40 con 0x559806e33660 2024-09-19T11:13:58.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.589+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/258922762 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbb403d000 0x7fbbb403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.589+0000 7fbcdebaf800 1 Processor -- start 2024-09-19T11:13:58.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcdebaf800 1 -- start start 2024-09-19T11:13:58.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/258922762 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbb403d000 0x7fbbb403f4c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x559806f32af0 tx=0x7fbcc4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcdebaf800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f58010 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcdebaf800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559806f23d50 con 0x559806f57c30 2024-09-19T11:13:58.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f58010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f58010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54314/0 (socket says 172.21.15.102:54314) 2024-09-19T11:13:58.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcdc699640 1 -- 172.21.15.102:0/2634127703 learned_addr learned my addr 172.21.15.102:0/2634127703 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcdc699640 1 -- 172.21.15.102:0/2634127703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559806f58600 con 0x559806f57c30 2024-09-19T11:13:58.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbcdc699640 1 --2- 172.21.15.102:0/2634127703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f58010 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0442a0 tx=0x7fbccc02ddb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5d89e235189e2a83 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbbbb7fe640 1 -- 172.21.15.102:0/2634127703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc03b070 con 0x559806f57c30 2024-09-19T11:13:58.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbbbb7fe640 1 -- 172.21.15.102:0/2634127703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc024d20 con 0x559806f57c30 2024-09-19T11:13:58.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.590+0000 7fbbbb7fe640 1 -- 172.21.15.102:0/2634127703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc054050 con 0x559806f57c30 2024-09-19T11:13:58.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 -- 172.21.15.102:0/2634127703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 msgr2=0x559806f58010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/2634127703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f58010 secure :-1 s=READY pgs=512 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0442a0 tx=0x7fbccc02ddb0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 -- 172.21.15.102:0/2634127703 shutdown_connections 2024-09-19T11:13:58.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/2634127703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f58010 unknown :-1 s=CLOSED pgs=512 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 -- 172.21.15.102:0/2634127703 >> 172.21.15.102:0/2634127703 conn(0x559806f54030 msgr2=0x559806f52270 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 -- 172.21.15.102:0/2634127703 shutdown_connections 2024-09-19T11:13:58.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 -- 172.21.15.102:0/2634127703 wait complete. 2024-09-19T11:13:58.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 Processor -- start 2024-09-19T11:13:58.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 -- start start 2024-09-19T11:13:58.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f5f010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.591+0000 7fbcdebaf800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559806f58a90 con 0x559806f57c30 2024-09-19T11:13:58.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f5f010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbcdc699640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f5f010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54316/0 (socket says 172.21.15.102:54316) 2024-09-19T11:13:58.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 learned_addr learned my addr 172.21.15.102:0/417784058 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559806f5f570 con 0x559806f57c30 2024-09-19T11:13:58.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbcdc699640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f5f010 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbccc02dbb0 tx=0x7fbccc03df20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbbb9ffb640 1 -- 172.21.15.102:0/417784058 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc068070 con 0x559806f57c30 2024-09-19T11:13:58.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbbb9ffb640 1 -- 172.21.15.102:0/417784058 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fbccc045980 con 0x559806f57c30 2024-09-19T11:13:58.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559806f5f570 con 0x559806f57c30 2024-09-19T11:13:58.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbbb9ffb640 1 -- 172.21.15.102:0/417784058 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fbccc045c60 con 0x559806f57c30 2024-09-19T11:13:58.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.592+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559806f5f570 con 0x559806f57c30 2024-09-19T11:13:58.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.593+0000 7fbbb9ffb640 1 -- 172.21.15.102:0/417784058 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fbccc06b070 con 0x559806f57c30 2024-09-19T11:13:58.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.593+0000 7fbbb9ffb640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbac03cfb0 0x7fbbac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.593+0000 7fbbb9ffb640 1 -- 172.21.15.102:0/417784058 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7fbccc05a070 con 0x559806f57c30 2024-09-19T11:13:58.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.593+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbac03cfb0 0x7fbbac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.594+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbac03cfb0 0x7fbbac03f470 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4053570 tx=0x7fbcc4053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.594+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.594+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806f6a440 0x559806f6c900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.594+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f6d050 con 0x559806f6a440 2024-09-19T11:13:58.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.594+0000 7fbcdce9a640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806f6a440 0x559806f6c900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.594+0000 7fbcdce9a640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806f6a440 0x559806f6c900 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 realm 2024-09-19T11:13:58.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f6d460 con 0x559806f6a440 2024-09-19T11:13:58.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:58.640 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f6dd30 con 0x559806f6a440 2024-09-19T11:13:58.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f6e0d0 con 0x559806f6a440 2024-09-19T11:13:58.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f6ee30 0x559806f71220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.595+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f717e0 con 0x559806f6ee30 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.596+0000 7fbcdc699640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f6ee30 0x559806f71220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.596+0000 7fbcdc699640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f6ee30 0x559806f71220 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.596+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.596+0000 7fbcdebaf800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.596+0000 7fbcdebaf800 20 searching for the correct realm 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.596+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f73790 0x559806f75c50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.596+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.596+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f73790 0x559806f75c50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.597+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f73790 0x559806f75c50 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.597+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.597+0000 7fbcd3fff640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbcc406c040 0x7fbcc405f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.597+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x7fbcc406c040 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.597+0000 7fbcdce9a640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbcc406c040 0x7fbcc405f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.597+0000 7fbcdce9a640 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbcc406c040 0x7fbcc405f420 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.598+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.598+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.598+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.598+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6a440 2024-09-19T11:13:58.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.598+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.598+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6a440 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.598+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.598+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x7fbcc406c040 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6a440 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.599+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.600+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.600+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6a440 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.600+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.600+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x7fbcc406c040 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.600+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.600+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.601+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.601+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.601+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.601+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.601+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.601+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.601+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.601+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.602+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.602+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6a440 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.602+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.602+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6a440 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.602+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.602+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.602+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.602+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.603+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.646 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.603+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x7fbcc406c040 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.603+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.603+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6a440 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.603+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.603+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.603+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.603+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.604+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.604+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.604+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.604+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x7fbcc406c040 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.604+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.604+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f73790 2024-09-19T11:13:58.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.604+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.604+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6ee30 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x559806f6a440 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x559806f76320 con 0x7fbcc406c040 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:58.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f721a0 con 0x559806f6a440 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f72590 con 0x559806f6a440 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.605+0000 7fbcdebaf800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f72590 con 0x559806f73790 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 zone default found 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 4 Realm: () 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 zonegroup default 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f767a0 con 0x559806f6ee30 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f78630 con 0x559806f73790 2024-09-19T11:13:58.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.606+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f78a60 con 0x559806f73790 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.607+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.607+0000 7fbcdebaf800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.607+0000 7fbcdebaf800 20 started sync module instance, tier type = 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.607+0000 7fbcdebaf800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.607+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f779d0 con 0x7fbcc406c040 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.608+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.608+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94111440273136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f779d0 con 0x7fbcc406c040 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.608+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f79510 con 0x559806f6a440 2024-09-19T11:13:58.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.609+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94111440273136] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.609+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.609+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94111440277504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f779d0 con 0x559806f6a440 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.609+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f79fc0 con 0x559806f73790 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.610+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94111440277504] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.611+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.611+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94111440270624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f77940 con 0x559806f73790 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.611+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7ae80 con 0x7fbcc406c040 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.612+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94111440270624] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.612+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.612+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94111440284112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7adf0 con 0x7fbcc406c040 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.612+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7bd40 con 0x559806f6a440 2024-09-19T11:13:58.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.613+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94111440284112] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.613+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.613+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94111440286240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7bd40 con 0x559806f6a440 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.613+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7c700 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.614+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94111440286240] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.614+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.614+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94111440287888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7bcb0 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.614+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7d460 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.615+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94111440287888] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.615+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.615+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94111440293024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7dd30 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.615+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7e5e0 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94111440293024] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'153 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94111440298192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7e860 con 0x559806f6ee30 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdebaf800 20 add_watcher() i=0 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdebaf800 20 add_watcher() i=1 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdebaf800 20 add_watcher() i=2 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdebaf800 20 add_watcher() i=3 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdebaf800 20 add_watcher() i=4 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdebaf800 20 add_watcher() i=5 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.616+0000 7fbcdebaf800 20 add_watcher() i=6 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.617+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94111440298192] v35'154 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.617+0000 7fbcdebaf800 20 add_watcher() i=7 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.617+0000 7fbcdebaf800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:58.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.617+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806f81dd0 con 0x559806f6a440 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.618+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.618+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94111440296000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806f7f360 con 0x559806f6a440 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.619+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94111440296000] v35'148 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.619+0000 7fbb927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.619+0000 7fbcdebaf800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.619+0000 7fbcdebaf800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.619+0000 7fbcdebaf800 5 note: GC not initialized 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.619+0000 7fbb917e2640 20 reqs_thread_entry: start 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.619+0000 7fbcdebaf800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.619+0000 7fbcdebaf800 20 Filter name: none 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbb02ffd640 20 reqs_thread_entry: start 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:58.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806fb4cb0 con 0x559806f6a440 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806fb75e0 con 0x7fbcc406c040 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 20 disabling bucket name=myfoo 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.620+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806fb55c0 con 0x7fbcc406c040 2024-09-19T11:13:58.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806fb7eb0 con 0x559806f6ee30 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(65 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:58.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.621+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fbf350 con 0x559806f6ee30 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(66 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'6 uv6 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1, ofs0, ns] 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94111440535072 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806fb66c0 con 0x559806f6ee30 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== watch-notify(notify (1) cookie 94111440293024 notify 150323855377 ret 0) ==== 802+0+0 (crc 0 0 0) 0x559806fb73c0 con 0x559806f6ee30 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbbbb7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855377 cookie 94111440293024 notifier 4603 bl.length()=760 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbbbb7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:58.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbbbb7fe640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbbbb7fe640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(67 notify.6 [notify cookie 94111440535072 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbbbb7fe640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbba0003ea0 con 0x559806f6ee30 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== watch-notify(notify_complete (2) cookie 94111440535072 notify 150323855377 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559806e33b80 con 0x559806f6ee30 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_sources= new_sources= 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential sources added=[] removed=[] 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_dests= new_dests= 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential dests added=[] removed=[] 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.623+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb7da0 con 0x559806f6a440 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.624+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v35'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.624+0000 7fbcdebaf800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:58.659 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.624+0000 7fbcdebaf800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.624+0000 7fbcdebaf800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94111440534944 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x559806fbe010 con 0x559806f6a440 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94111440286240 notify 150323855380 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7fbcd4026410 con 0x559806f6a440 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbbbaffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855380 cookie 94111440286240 notifier 4603 bl.length()=567 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbbbaffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbbbaffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbbbaffd640 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7fbb10003430 con 0x559806f6a440 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(70 notify.4 [notify cookie 94111440534944 out=8b] v0'0 uv153 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== watch-notify(notify_complete (2) cookie 94111440534944 notify 150323855380 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fbcd40265e0 con 0x559806f6a440 2024-09-19T11:13:58.660 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.625+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.661 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":1,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.626+0000 7fbb927e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.626+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94111440296000] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x559806f6a440 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.627+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94111440296000] v35'149 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.627+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94111440273136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x7fbcc406c040 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.628+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94111440273136] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.628+0000 7fbcdebaf800 20 remove_watcher() i=0 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.628+0000 7fbcdebaf800 2 removed watcher, disabling cache 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.628+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94111440277504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x559806f6a440 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.629+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94111440277504] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.666 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.629+0000 7fbcdebaf800 20 remove_watcher() i=1 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.629+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94111440270624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x559806f73790 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.630+0000 7fbcd3fff640 1 -- 172.21.15.102:0/417784058 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94111440270624] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcc4051070 con 0x559806f73790 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.630+0000 7fbcdebaf800 20 remove_watcher() i=2 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.630+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94111440284112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x7fbcc406c040 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.631+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94111440284112] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x7fbcc406c040 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.631+0000 7fbcdebaf800 20 remove_watcher() i=3 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.631+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94111440286240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x559806f6a440 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.632+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94111440286240] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbcd400a4d0 con 0x559806f6a440 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.632+0000 7fbcdebaf800 20 remove_watcher() i=4 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.632+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94111440287888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x559806f6ee30 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.633+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94111440287888] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.633+0000 7fbcdebaf800 20 remove_watcher() i=5 2024-09-19T11:13:58.667 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.633+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94111440293024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x559806f6ee30 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.634+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94111440293024] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.634+0000 7fbcdebaf800 20 remove_watcher() i=6 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.634+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94111440298192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x559806fb2b50 con 0x559806f6ee30 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdc699640 1 -- 172.21.15.102:0/417784058 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94111440298192] v35'155 uv153 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fbccc074070 con 0x559806f6ee30 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 20 remove_watcher() i=7 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f6ee30 msgr2=0x559806f71220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f6ee30 0x559806f71220 crc :-1 s=READY pgs=110 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806f6a440 msgr2=0x559806f6c900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806f6a440 0x559806f6c900 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbcc406c040 msgr2=0x7fbcc405f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fbcc406c040 0x7fbcc405f420 crc :-1 s=READY pgs=60 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f73790 msgr2=0x559806f75c50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.668 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f73790 0x559806f75c50 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbac03cfb0 msgr2=0x7fbbac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbac03cfb0 0x7fbbac03f470 secure :-1 s=READY pgs=211 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4053570 tx=0x7fbcc4053000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 msgr2=0x559806f5f010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f5f010 secure :-1 s=READY pgs=513 cs=0 l=1 rev1=1 crypto rx=0x7fbccc02dbb0 tx=0x7fbccc03df20 comp rx=0 tx=0).stop 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdce9a640 1 -- 172.21.15.102:0/417784058 reap_dead start 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 shutdown_connections 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/417784058 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806f57c30 0x559806f5f010 unknown :-1 s=CLOSED pgs=513 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 >> 172.21.15.102:0/417784058 conn(0x559806f54030 msgr2=0x559806f52240 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 shutdown_connections 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.635+0000 7fbcdebaf800 1 -- 172.21.15.102:0/417784058 wait complete. 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/258922762 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbb403d000 msgr2=0x7fbbb403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.669 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/258922762 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbb403d000 0x7fbbb403f4c0 secure :-1 s=READY pgs=210 cs=0 l=1 rev1=1 crypto rx=0x559806f32af0 tx=0x7fbcc4005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/258922762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33660 msgr2=0x559806e31ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/258922762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33660 0x559806e31ed0 secure :-1 s=READY pgs=511 cs=0 l=1 rev1=1 crypto rx=0x7fbccc052af0 tx=0x7fbccc016f90 comp rx=0 tx=0).stop 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/258922762 shutdown_connections 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/258922762 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbb403d000 0x7fbbb403f4c0 unknown :-1 s=CLOSED pgs=210 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/258922762 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33660 0x559806e31ed0 unknown :-1 s=CLOSED pgs=511 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/258922762 >> 172.21.15.102:0/258922762 conn(0x559806f3d4d0 msgr2=0x559806f3d8b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/258922762 shutdown_connections 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/258922762 wait complete. 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f34970 msgr2=0x559806f36d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559806f34970 0x559806f36d60 crc :-1 s=READY pgs=109 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806e37aa0 msgr2=0x559806f32480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559806e37aa0 0x559806f32480 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f38870 msgr2=0x559806f3ac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559806f38870 0x559806f3ac60 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbc403d000 msgr2=0x7fbbc403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fbbc403d000 0x7fbbc403f4c0 secure :-1 s=READY pgs=209 cs=0 l=1 rev1=1 crypto rx=0x7fbcc4057000 tx=0x7fbcc4052000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 msgr2=0x559806f2ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 --2- 172.21.15.102:0/3128252856 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559806e33ea0 0x559806f2ae30 secure :-1 s=READY pgs=510 cs=0 l=1 rev1=1 crypto rx=0x7fbccc0012b0 tx=0x7fbccc000ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdce9a640 1 -- 172.21.15.102:0/3128252856 reap_dead start 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 shutdown_connections 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 >> 172.21.15.102:0/3128252856 conn(0x559806e2da60 msgr2=0x559806f24820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 shutdown_connections 2024-09-19T11:13:58.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.636+0000 7fbcdebaf800 1 -- 172.21.15.102:0/3128252856 wait complete. 2024-09-19T11:13:58.671 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:58.673 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'enable', '--uid', 'foo'] 2024-09-19T11:13:58.674 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'enable', '--uid', 'foo'] 2024-09-19T11:13:58.674 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user enable --uid foo 2024-09-19T11:13:58.718 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:13:58.718 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:13:58.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.717+0000 7ff22b31f800 1 Processor -- start 2024-09-19T11:13:58.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.717+0000 7ff22b31f800 1 -- start start 2024-09-19T11:13:58.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.718+0000 7ff22b31f800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5580860a0ab0 0x5580860a6650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.718+0000 7ff22b31f800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55808609fd50 con 0x55808609f6a0 2024-09-19T11:13:58.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.718+0000 7ff22b31f800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x558085f2b7d0 con 0x5580860a0ab0 2024-09-19T11:13:58.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.718+0000 7ff22678a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5580860a0ab0 0x5580860a6650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.718+0000 7ff226f8b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55808609f6a0 0x5580860a03a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34404/0 (socket says 172.21.15.102:34404) 2024-09-19T11:13:58.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.718+0000 7ff226f8b640 1 -- 172.21.15.102:0/4162572979 learned_addr learned my addr 172.21.15.102:0/4162572979 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:13:58.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.718+0000 7ff22678a640 1 -- 172.21.15.102:0/4162572979 >> v1:172.21.15.37:6789/0 conn(0x55808609f6a0 legacy=0x5580860a03a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.718+0000 7ff22678a640 1 -- 172.21.15.102:0/4162572979 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580860a0f60 con 0x5580860a0ab0 2024-09-19T11:13:58.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.720+0000 7ff22678a640 1 --2- 172.21.15.102:0/4162572979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 0x5580860a6650 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff21000a470 tx=0x7ff210045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be049612c621ea98 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.720+0000 7ff225f89640 1 -- 172.21.15.102:0/4162572979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff210053570 con 0x5580860a0ab0 2024-09-19T11:13:58.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.720+0000 7ff225f89640 1 -- 172.21.15.102:0/4162572979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff210058070 con 0x5580860a0ab0 2024-09-19T11:13:58.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.720+0000 7ff225f89640 1 -- 172.21.15.102:0/4162572979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff210053880 con 0x5580860a0ab0 2024-09-19T11:13:58.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.720+0000 7ff22b31f800 1 -- 172.21.15.102:0/4162572979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 msgr2=0x5580860a6650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.720+0000 7ff22b31f800 1 --2- 172.21.15.102:0/4162572979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 0x5580860a6650 secure :-1 s=READY pgs=515 cs=0 l=1 rev1=1 crypto rx=0x7ff21000a470 tx=0x7ff210045a20 comp rx=0 tx=0).stop 2024-09-19T11:13:58.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.721+0000 7ff22b31f800 1 -- 172.21.15.102:0/4162572979 shutdown_connections 2024-09-19T11:13:58.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.721+0000 7ff22b31f800 1 --2- 172.21.15.102:0/4162572979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 0x5580860a6650 unknown :-1 s=CLOSED pgs=515 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.721+0000 7ff22b31f800 1 -- 172.21.15.102:0/4162572979 >> 172.21.15.102:0/4162572979 conn(0x55808609aa90 msgr2=0x55808609ced0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.721+0000 7ff22b31f800 1 -- 172.21.15.102:0/4162572979 shutdown_connections 2024-09-19T11:13:58.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.721+0000 7ff22b31f800 1 -- 172.21.15.102:0/4162572979 wait complete. 2024-09-19T11:13:58.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.734+0000 7ff22b31f800 1 Processor -- start 2024-09-19T11:13:58.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.734+0000 7ff22b31f800 1 -- start start 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.734+0000 7ff22b31f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55808609f6a0 0x55808618f220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.734+0000 7ff22b31f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558085f38dd0 con 0x55808609f6a0 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.735+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55808609f6a0 0x55808618f220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.735+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55808609f6a0 0x55808618f220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54334/0 (socket says 172.21.15.102:54334) 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.735+0000 7ff226f8b640 1 -- 172.21.15.102:0/4059539557 learned_addr learned my addr 172.21.15.102:0/4059539557 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.735+0000 7ff226f8b640 1 -- 172.21.15.102:0/4059539557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55808618f810 con 0x55808609f6a0 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.735+0000 7ff226f8b640 1 --2- 172.21.15.102:0/4059539557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55808609f6a0 0x55808618f220 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff218001800 tx=0x7ff218001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8204e12394a08fac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.735+0000 7ff114e09640 1 -- 172.21.15.102:0/4059539557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218004520 con 0x55808609f6a0 2024-09-19T11:13:58.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.735+0000 7ff114e09640 1 -- 172.21.15.102:0/4059539557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180046c0 con 0x55808609f6a0 2024-09-19T11:13:58.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.735+0000 7ff114e09640 1 -- 172.21.15.102:0/4059539557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2180049e0 con 0x55808609f6a0 2024-09-19T11:13:58.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 -- 172.21.15.102:0/4059539557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55808609f6a0 msgr2=0x55808618f220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 --2- 172.21.15.102:0/4059539557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55808609f6a0 0x55808618f220 secure :-1 s=READY pgs=516 cs=0 l=1 rev1=1 crypto rx=0x7ff218001800 tx=0x7ff218001cc0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 -- 172.21.15.102:0/4059539557 shutdown_connections 2024-09-19T11:13:58.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 --2- 172.21.15.102:0/4059539557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55808609f6a0 0x55808618f220 unknown :-1 s=CLOSED pgs=516 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 -- 172.21.15.102:0/4059539557 >> 172.21.15.102:0/4059539557 conn(0x55808609aa90 msgr2=0x55808618aba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 -- 172.21.15.102:0/4059539557 shutdown_connections 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 -- 172.21.15.102:0/4059539557 wait complete. 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 Processor -- start 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.736+0000 7ff22b31f800 1 -- start start 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff22b31f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 0x558086014030 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff22b31f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5580860a6da0 con 0x5580860a0ab0 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 0x558086014030 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 0x558086014030 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54346/0 (socket says 172.21.15.102:54346) 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff226f8b640 1 -- 172.21.15.102:0/1901864943 learned_addr learned my addr 172.21.15.102:0/1901864943 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff226f8b640 1 -- 172.21.15.102:0/1901864943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x558086014590 con 0x5580860a0ab0 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff226f8b640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 0x558086014030 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff218000f80 tx=0x7ff218001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff113606640 1 -- 172.21.15.102:0/1901864943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218013760 con 0x5580860a0ab0 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff113606640 1 -- 172.21.15.102:0/1901864943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff218013920 con 0x5580860a0ab0 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55808619ad10 con 0x5580860a0ab0 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.737+0000 7ff113606640 1 -- 172.21.15.102:0/1901864943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218013c40 con 0x5580860a0ab0 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.738+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55808619b2d0 con 0x5580860a0ab0 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.738+0000 7ff113606640 1 -- 172.21.15.102:0/1901864943 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff218010070 con 0x5580860a0ab0 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.738+0000 7ff113606640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10c03cfb0 0x7ff10c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff113606640 1 -- 172.21.15.102:0/1901864943 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff218018070 con 0x5580860a0ab0 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff22678a640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10c03cfb0 0x7ff10c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff22b31f800 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55808619d230 0x55808619f6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55808619fd10 con 0x55808619d230 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff22778c640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55808619d230 0x55808619f6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff22678a640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10c03cfb0 0x7ff10c03f470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff210057000 tx=0x7ff210052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff22778c640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55808619d230 0x55808619f6a0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff22778c640 1 -- 172.21.15.102:0/1901864943 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2200083e0 con 0x55808619d230 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.739+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55808619c710 con 0x55808619d230 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.740+0000 7ff22778c640 1 -- 172.21.15.102:0/1901864943 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2200083e0 con 0x55808619d230 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.740+0000 7ff22b31f800 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861a2040 0x5580861a4430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.740+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861a4b00 con 0x5580861a2040 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.740+0000 7ff226f8b640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861a2040 0x5580861a4430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.740+0000 7ff226f8b640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861a2040 0x5580861a4430 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.740+0000 7ff226f8b640 1 -- 172.21.15.102:0/1901864943 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff21801b030 con 0x5580861a2040 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.740+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861a0ee0 con 0x55808619d230 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.741+0000 7ff22778c640 1 -- 172.21.15.102:0/1901864943 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff2200083e0 con 0x55808619d230 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.741+0000 7ff22b31f800 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861a5f40 0x5580861a8330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.741+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861a8ac0 con 0x5580861a5f40 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.741+0000 7ff22678a640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861a5f40 0x5580861a8330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.741+0000 7ff22678a640 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861a5f40 0x5580861a8330 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.741+0000 7ff22678a640 1 -- 172.21.15.102:0/1901864943 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff210051070 con 0x5580861a5f40 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff22b31f800 1 Processor -- start 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff22b31f800 1 -- start start 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff22b31f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861b89e0 0x5580861b8e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff22b31f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x558085f974a0 con 0x5580861b89e0 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861b89e0 0x5580861b8e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861b89e0 0x5580861b8e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54360/0 (socket says 172.21.15.102:54360) 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff226f8b640 1 -- 172.21.15.102:0/3255033014 learned_addr learned my addr 172.21.15.102:0/3255033014 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff226f8b640 1 -- 172.21.15.102:0/3255033014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580861b9440 con 0x5580861b89e0 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.742+0000 7ff226f8b640 1 --2- 172.21.15.102:0/3255033014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861b89e0 0x5580861b8e00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff21802d000 tx=0x7ff218045ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.743+0000 7ff110e01640 1 -- 172.21.15.102:0/3255033014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218051320 con 0x5580861b89e0 2024-09-19T11:13:58.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.743+0000 7ff110e01640 1 -- 172.21.15.102:0/3255033014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff2180514c0 con 0x5580861b89e0 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.743+0000 7ff110e01640 1 -- 172.21.15.102:0/3255033014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21804b2f0 con 0x5580861b89e0 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.743+0000 7ff22b31f800 1 -- 172.21.15.102:0/3255033014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580861b9c70 con 0x5580861b89e0 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.743+0000 7ff22b31f800 1 -- 172.21.15.102:0/3255033014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580861ba210 con 0x5580861b89e0 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.743+0000 7ff110e01640 1 -- 172.21.15.102:0/3255033014 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff2180123c0 con 0x5580861b89e0 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff110e01640 1 --2- 172.21.15.102:0/3255033014 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10003d000 0x7ff10003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff110e01640 1 -- 172.21.15.102:0/3255033014 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff218034c90 con 0x5580861b89e0 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff22678a640 1 --2- 172.21.15.102:0/3255033014 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10003d000 0x7ff10003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff22b31f800 1 Processor -- start 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff22b31f800 1 -- start start 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff22678a640 1 --2- 172.21.15.102:0/3255033014 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10003d000 0x7ff10003f4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff210053570 tx=0x7ff210005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff22b31f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861c5660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff22b31f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55808618fc40 con 0x5580861c5260 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861c5660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861c5660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54376/0 (socket says 172.21.15.102:54376) 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.744+0000 7ff226f8b640 1 -- 172.21.15.102:0/2120171014 learned_addr learned my addr 172.21.15.102:0/2120171014 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.745+0000 7ff226f8b640 1 -- 172.21.15.102:0/2120171014 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580861c5c50 con 0x5580861c5260 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.745+0000 7ff226f8b640 1 --2- 172.21.15.102:0/2120171014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861c5660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff218051690 tx=0x7ff218029770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e2164586c25263 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.745+0000 7ff10a7fc640 1 -- 172.21.15.102:0/2120171014 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21804b550 con 0x5580861c5260 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.745+0000 7ff10a7fc640 1 -- 172.21.15.102:0/2120171014 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21803c5d0 con 0x5580861c5260 2024-09-19T11:13:58.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.745+0000 7ff10a7fc640 1 -- 172.21.15.102:0/2120171014 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff2180540f0 con 0x5580861c5260 2024-09-19T11:13:58.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 -- 172.21.15.102:0/2120171014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 msgr2=0x5580861c5660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 --2- 172.21.15.102:0/2120171014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861c5660 secure :-1 s=READY pgs=519 cs=0 l=1 rev1=1 crypto rx=0x7ff218051690 tx=0x7ff218029770 comp rx=0 tx=0).stop 2024-09-19T11:13:58.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 -- 172.21.15.102:0/2120171014 shutdown_connections 2024-09-19T11:13:58.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 --2- 172.21.15.102:0/2120171014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861c5660 unknown :-1 s=CLOSED pgs=519 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 -- 172.21.15.102:0/2120171014 >> 172.21.15.102:0/2120171014 conn(0x5580861c1660 msgr2=0x5580861bf8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 -- 172.21.15.102:0/2120171014 shutdown_connections 2024-09-19T11:13:58.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 -- 172.21.15.102:0/2120171014 wait complete. 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 Processor -- start 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 -- start start 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861cc680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff22b31f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5580861c60c0 con 0x5580861c5260 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861cc680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff226f8b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861cc680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:54378/0 (socket says 172.21.15.102:54378) 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.746+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 learned_addr learned my addr 172.21.15.102:0/3882565551 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.747+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5580861ccbe0 con 0x5580861c5260 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.747+0000 7ff226f8b640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861cc680 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff218001220 tx=0x7ff218025ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.747+0000 7ff108ff9640 1 -- 172.21.15.102:0/3882565551 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff21803c780 con 0x5580861c5260 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.747+0000 7ff108ff9640 1 -- 172.21.15.102:0/3882565551 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff21803ce00 con 0x5580861c5260 2024-09-19T11:13:58.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.747+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5580861ccbe0 con 0x5580861c5260 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.747+0000 7ff108ff9640 1 -- 172.21.15.102:0/3882565551 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff218028500 con 0x5580861c5260 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.747+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5580861ccbe0 con 0x5580861c5260 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.748+0000 7ff108ff9640 1 -- 172.21.15.102:0/3882565551 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff21805e070 con 0x5580861c5260 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.748+0000 7ff108ff9640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0f003d000 0x7ff0f003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.748+0000 7ff108ff9640 1 -- 172.21.15.102:0/3882565551 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(35..35 src has 1..35) ==== 6133+0+0 (secure 0 0 0) 0x7ff218068030 con 0x5580861c5260 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.748+0000 7ff22678a640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0f003d000 0x7ff0f003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.749+0000 7ff22678a640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0f003d000 0x7ff0f003f4c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff210077040 tx=0x7ff210053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.749+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.749+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5580861d7c20 0x5580861da0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.749+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861da830 con 0x5580861d7c20 2024-09-19T11:13:58.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.749+0000 7ff22778c640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5580861d7c20 0x5580861da0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.749+0000 7ff22778c640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5580861d7c20 0x5580861da0e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2200083e0 con 0x5580861d7c20 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 realm 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861dac40 con 0x5580861d7c20 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2200083e0 con 0x5580861d7c20 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff2200083e0 con 0x5580861d7c20 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861db8b0 con 0x5580861d7c20 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff2200083e0 con 0x5580861d7c20 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861dc270 0x5580861de660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.750+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861decb0 con 0x5580861dc270 2024-09-19T11:13:58.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.751+0000 7ff226f8b640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861dc270 0x5580861de660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.751+0000 7ff226f8b640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861dc270 0x5580861de660 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.751+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.751+0000 7ff22b31f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.751+0000 7ff22b31f800 20 searching for the correct realm 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.751+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861e0c40 0x5580861e3100 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.751+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861e3780 con 0x5580861e0c40 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.752+0000 7ff22678a640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861e0c40 0x5580861e3100 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.752+0000 7ff22678a640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861e0c40 0x5580861e3100 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.752+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.752+0000 7ff22678a640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff21005f040 0x7ff21005f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.752+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861e3780 con 0x7ff21005f040 2024-09-19T11:13:58.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.752+0000 7ff22778c640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff21005f040 0x7ff21005f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.752+0000 7ff22778c640 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff21005f040 0x7ff21005f930 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.753+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2200083e0 con 0x7ff21005f040 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.753+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.753+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.753+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.753+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff2200083e0 con 0x5580861d7c20 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.753+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.753+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.753+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.754+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.754+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.754+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.754+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x7ff21005f040 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.754+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21005f040 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.754+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861e0c40 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.754+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.754+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x7ff21005f040 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 35 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff220026040 con 0x7ff21005f040 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861e0c40 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.755+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861e0c40 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 35 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861e0c40 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861e0c40 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.756+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.757+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.757+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.757+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 35 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.757+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.757+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 35 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.757+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861e0c40 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.758+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.758+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x7ff21005f040 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.758+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21005f040 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.758+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.758+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.758+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.758+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861e0c40 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x7ff21005f040 2024-09-19T11:13:58.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21005f040 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861e0c40 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.759+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861dc270 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(35 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x5580861d7c20 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 35 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 35 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e35) -- 0x5580861db510 con 0x7ff21005f040 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(37 [pgnls start_epoch 35 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff220026040 con 0x7ff21005f040 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:13:58.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861df050 con 0x5580861d7c20 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.760+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861df050 con 0x5580861d7c20 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff220026040 con 0x5580861d7c20 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861df050 con 0x5580861e0c40 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 20 zone default found 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 4 Realm: () 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 20 zonegroup default 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861df940 con 0x5580861dc270 2024-09-19T11:13:58.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.761+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861e56f0 con 0x5580861e0c40 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861e5ae0 con 0x5580861e0c40 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22b31f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22b31f800 20 started sync module instance, tier type = 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22b31f800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:13:58.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.762+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e4a90 con 0x7ff21005f040 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.763+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(44 notify.0 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220026040 con 0x7ff21005f040 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.763+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94010494308288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e4a90 con 0x7ff21005f040 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.763+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e6560 con 0x5580861d7c20 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.764+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(45 notify.0 [watch watch cookie 94010494308288] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x7ff21005f040 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.764+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.764+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94010494312560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e4a90 con 0x5580861d7c20 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.764+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e7000 con 0x5580861e0c40 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.766+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94010494312560] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.766+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.766+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94010494305760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e4a00 con 0x5580861e0c40 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.766+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e7ef0 con 0x7ff21005f040 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.767+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94010494305760] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.767+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(50 notify.3 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x7ff21005f040 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.767+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94010494319168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e8310 con 0x7ff21005f040 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.767+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e8cd0 con 0x5580861d7c20 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.768+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(51 notify.3 [watch watch cookie 94010494319168] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x7ff21005f040 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.768+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.768+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94010494320704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e8cd0 con 0x5580861d7c20 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.768+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e9690 con 0x5580861dc270 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.769+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(54 notify.5 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.769+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94010494320704] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.769+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94010494325216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e9f30 con 0x5580861dc270 2024-09-19T11:13:58.788 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.769+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e8860 con 0x5580861dc270 2024-09-19T11:13:58.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.771+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94010494325216] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.772+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(56 notify.6 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.772+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94010494327344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861e9e50 con 0x5580861dc270 2024-09-19T11:13:58.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.772+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861eaf10 con 0x5580861dc270 2024-09-19T11:13:58.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.772+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94010494327344] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(58 notify.7 [create] v35'156 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94010494329920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861eaf10 con 0x5580861dc270 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff22b31f800 20 add_watcher() i=0 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff22b31f800 20 add_watcher() i=1 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff22b31f800 20 add_watcher() i=2 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff22b31f800 20 add_watcher() i=3 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff22b31f800 20 add_watcher() i=4 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff22b31f800 20 add_watcher() i=5 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.773+0000 7ff22b31f800 20 add_watcher() i=6 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.774+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(59 notify.7 [watch watch cookie 94010494329920] v35'157 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.774+0000 7ff22b31f800 20 add_watcher() i=7 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.774+0000 7ff22b31f800 2 all 8 watchers are set, enabling cache 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.774+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x5580861ee260 con 0x5580861d7c20 2024-09-19T11:13:58.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.774+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.774+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94010494331856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x5580861eb4a0 con 0x5580861d7c20 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.775+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94010494331856] v35'150 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.775+0000 7ff0dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.775+0000 7ff22b31f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.775+0000 7ff22b31f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.775+0000 7ff22b31f800 5 note: GC not initialized 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.775+0000 7ff057fff640 20 reqs_thread_entry: start 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.775+0000 7ff22b31f800 20 init_complete bucket index max shards: 11 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.775+0000 7ff22b31f800 20 Filter name: none 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff055ffb640 20 reqs_thread_entry: start 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:13:58.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558086221160 con 0x5580861d7c20 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558086223a90 con 0x7ff21005f040 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(63 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7ff220036040 con 0x7ff21005f040 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 20 enabling bucket name=myfoo 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.776+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 8.9 8:91b71841:root::myfoo:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558086221a70 con 0x7ff21005f040 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(64 myfoo [read 0~165 out=165b] v0'0 uv27 ondisk = 0) ==== 149+0+165 (crc 0 0 0) 0x7ff220036040 con 0x7ff21005f040 2024-09-19T11:13:58.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x1 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 : miss 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 20 rados->read ofs=0 len=0 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558086224330 con 0x5580861dc270 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(65 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv6 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:58.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.777+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 8.6 8:60a4e75a:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~387 in=387b,setxattr user.rgw.acl (123) in=135b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808622b7d0 con 0x5580861dc270 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(66 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 [delete,create,call,call,writefull 0~387,setxattr (123)] v35'7 uv7 ondisk = 0) ==== 416+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff22b31f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff22b31f800 10 moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff22b31f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff22b31f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1, ofs0, ns] 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94010494567072 in=772b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x558086225e90 con 0x5580861dc270 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== watch-notify(notify (1) cookie 94010494327344 notify 150323855378 ret 0) ==== 802+0+0 (crc 0 0 0) 0x558086223870 con 0x5580861dc270 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff10a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855378 cookie 94010494327344 notifier 4610 bl.length()=760 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(67 notify.6 [notify cookie 94010494567072 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff10a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 info.flags=0x17 2024-09-19T11:13:58.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff10a7fc640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1 to cache LRU end 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff10a7fc640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff10a7fc640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff0ec003ea0 con 0x5580861dc270 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(68 notify.6 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.779+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== watch-notify(notify_complete (2) cookie 94010494567072 notify 150323855378 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5580861b9440 con 0x5580861dc270 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.780+0000 7ff22b31f800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_sources= new_sources= 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.780+0000 7ff22b31f800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential sources added=[] removed=[] 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.780+0000 7ff22b31f800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): orig_dests= new_dests= 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.780+0000 7ff22b31f800 20 handle_bi_update(): bucket=:myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1]): potential dests added=[] removed=[] 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.780+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808622b050 con 0x5580861d7c20 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(69 foo [delete,create,call,call,writefull 0~391] v35'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22b31f800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22b31f800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:58.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22b31f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [notify cookie 94010494566944 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x55808622a4f0 con 0x5580861d7c20 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94010494320704 notify 150323855381 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7ff220010040 con 0x5580861d7c20 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff10a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 150323855381 cookie 94010494320704 notifier 4610 bl.length()=567 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff10a7fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff10a7fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff10a7fc640 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e35) -- 0x7ff0ec003ea0 con 0x5580861d7c20 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(70 notify.4 [notify cookie 94010494566944 out=8b] v0'0 uv156 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(71 notify.4 [notify-ack] v0'0 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.781+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94010494566944 notify 150323855381 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff22000acb0 con 0x5580861d7c20 2024-09-19T11:13:58.803 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:13:58.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.782+0000 7ff0dd7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.782+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94010494331856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x5580861d7c20 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.783+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(72 data_loggenerations_metadata [watch unwatch cookie 94010494331856] v35'151 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.783+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:73 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94010494308288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x7ff21005f040 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.784+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(73 notify.0 [watch unwatch cookie 94010494308288] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x7ff21005f040 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.784+0000 7ff22b31f800 20 remove_watcher() i=0 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.784+0000 7ff22b31f800 2 removed watcher, disabling cache 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.784+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:74 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94010494312560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x5580861d7c20 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.785+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(74 notify.1 [watch unwatch cookie 94010494312560] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.785+0000 7ff22b31f800 20 remove_watcher() i=1 2024-09-19T11:13:58.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.785+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94010494305760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x5580861e0c40 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.786+0000 7ff22678a640 1 -- 172.21.15.102:0/3882565551 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(75 notify.2 [watch unwatch cookie 94010494305760] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff210051070 con 0x5580861e0c40 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.786+0000 7ff22b31f800 20 remove_watcher() i=2 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.786+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:76 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94010494319168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x7ff21005f040 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.787+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(76 notify.3 [watch unwatch cookie 94010494319168] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x7ff21005f040 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.787+0000 7ff22b31f800 20 remove_watcher() i=3 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.787+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:77 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94010494320704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x5580861d7c20 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.788+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(77 notify.4 [watch unwatch cookie 94010494320704] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff220036040 con 0x5580861d7c20 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.788+0000 7ff22b31f800 20 remove_watcher() i=4 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.788+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94010494325216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x5580861dc270 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.790+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(78 notify.5 [watch unwatch cookie 94010494325216] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.790+0000 7ff22b31f800 20 remove_watcher() i=5 2024-09-19T11:13:58.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.790+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:79 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94010494327344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x5580861dc270 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.791+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(79 notify.6 [watch unwatch cookie 94010494327344] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.791+0000 7ff22b31f800 20 remove_watcher() i=6 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.791+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:80 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94010494329920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e35) -- 0x55808621f000 con 0x5580861dc270 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff226f8b640 1 -- 172.21.15.102:0/3882565551 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(80 notify.7 [watch unwatch cookie 94010494329920] v35'158 uv156 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff21801b030 con 0x5580861dc270 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 20 remove_watcher() i=7 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861dc270 msgr2=0x5580861de660 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861dc270 0x5580861de660 crc :-1 s=READY pgs=112 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5580861d7c20 msgr2=0x5580861da0e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5580861d7c20 0x5580861da0e0 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff21005f040 msgr2=0x7ff21005f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff21005f040 0x7ff21005f930 crc :-1 s=READY pgs=61 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861e0c40 msgr2=0x5580861e3100 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861e0c40 0x5580861e3100 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0f003d000 msgr2=0x7ff0f003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff0f003d000 0x7ff0f003f4c0 secure :-1 s=READY pgs=214 cs=0 l=1 rev1=1 crypto rx=0x7ff210077040 tx=0x7ff210053000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 msgr2=0x5580861cc680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3882565551 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861c5260 0x5580861cc680 secure :-1 s=READY pgs=520 cs=0 l=1 rev1=1 crypto rx=0x7ff218001220 tx=0x7ff218025ee0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22778c640 1 -- 172.21.15.102:0/3882565551 reap_dead start 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 shutdown_connections 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 >> 172.21.15.102:0/3882565551 conn(0x5580861c1660 msgr2=0x5580861bf870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 shutdown_connections 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3882565551 wait complete. 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3255033014 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10003d000 msgr2=0x7ff10003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3255033014 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10003d000 0x7ff10003f4c0 secure :-1 s=READY pgs=213 cs=0 l=1 rev1=1 crypto rx=0x7ff210053570 tx=0x7ff210005a00 comp rx=0 tx=0).stop 2024-09-19T11:13:58.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3255033014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861b89e0 msgr2=0x5580861b8e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3255033014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861b89e0 0x5580861b8e00 secure :-1 s=READY pgs=518 cs=0 l=1 rev1=1 crypto rx=0x7ff21802d000 tx=0x7ff218045ed0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3255033014 shutdown_connections 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3255033014 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10003d000 0x7ff10003f4c0 unknown :-1 s=CLOSED pgs=213 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 --2- 172.21.15.102:0/3255033014 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580861b89e0 0x5580861b8e00 unknown :-1 s=CLOSED pgs=518 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3255033014 >> 172.21.15.102:0/3255033014 conn(0x558086196d30 msgr2=0x558086197110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3255033014 shutdown_connections 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.792+0000 7ff22b31f800 1 -- 172.21.15.102:0/3255033014 wait complete. 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861a2040 msgr2=0x5580861a4430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5580861a2040 0x5580861a4430 crc :-1 s=READY pgs=111 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55808619d230 msgr2=0x55808619f6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55808619d230 0x55808619f6a0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861a5f40 msgr2=0x5580861a8330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5580861a5f40 0x5580861a8330 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10c03cfb0 msgr2=0x7ff10c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff10c03cfb0 0x7ff10c03f470 secure :-1 s=READY pgs=212 cs=0 l=1 rev1=1 crypto rx=0x7ff210057000 tx=0x7ff210052000 comp rx=0 tx=0).stop 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 msgr2=0x558086014030 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 --2- 172.21.15.102:0/1901864943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5580860a0ab0 0x558086014030 secure :-1 s=READY pgs=517 cs=0 l=1 rev1=1 crypto rx=0x7ff218000f80 tx=0x7ff218001250 comp rx=0 tx=0).stop 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22778c640 1 -- 172.21.15.102:0/1901864943 reap_dead start 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 shutdown_connections 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 >> 172.21.15.102:0/1901864943 conn(0x55808609aa90 msgr2=0x558086190790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 shutdown_connections 2024-09-19T11:13:58.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:13:58.793+0000 7ff22b31f800 1 -- 172.21.15.102:0/1901864943 wait complete. 2024-09-19T11:13:58.815 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:13:58.830 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-19T11:13:59.096 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=30000000 bytes_in=0 failed=False 2024-09-19T11:13:59.107 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:14.108 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-19T11:14:14.108 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-19T11:14:14.109 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-19T11:14:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:14.159 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.158+0000 7fda7912e800 1 Processor -- start 2024-09-19T11:14:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.158+0000 7fda7912e800 1 -- start start 2024-09-19T11:14:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda7912e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e3285a9aa0 0x55e3285af640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda7912e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55e3285a8d40 con 0x55e3285a8690 2024-09-19T11:14:14.160 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda7912e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55e3284347d0 con 0x55e3285a9aa0 2024-09-19T11:14:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda7456a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e3285a9aa0 0x55e3285af640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda74d6b640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55e3285a8690 0x55e3285a9390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36776/0 (socket says 172.21.15.102:36776) 2024-09-19T11:14:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda7456a640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55e3285a9aa0 0x55e3285af640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37848/0 (socket says 172.21.15.102:37848) 2024-09-19T11:14:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda74d6b640 1 -- 172.21.15.102:0/3041056779 learned_addr learned my addr 172.21.15.102:0/3041056779 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda7456a640 1 -- 172.21.15.102:0/3041056779 >> v1:172.21.15.37:6789/0 conn(0x55e3285a8690 legacy=0x55e3285a9390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.161 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.159+0000 7fda7456a640 1 -- 172.21.15.102:0/3041056779 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3285a9f50 con 0x55e3285a9aa0 2024-09-19T11:14:14.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.161+0000 7fda7456a640 1 --2- 172.21.15.102:0/3041056779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 0x55e3285af640 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00a470 tx=0x7fda5c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f2345dc8cf24c1ae server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.161+0000 7fda73d69640 1 -- 172.21.15.102:0/3041056779 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5c053570 con 0x55e3285a9aa0 2024-09-19T11:14:14.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.161+0000 7fda73d69640 1 -- 172.21.15.102:0/3041056779 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda5c058070 con 0x55e3285a9aa0 2024-09-19T11:14:14.163 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.161+0000 7fda73d69640 1 -- 172.21.15.102:0/3041056779 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda5c053880 con 0x55e3285a9aa0 2024-09-19T11:14:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.162+0000 7fda7912e800 1 -- 172.21.15.102:0/3041056779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 msgr2=0x55e3285af640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.162+0000 7fda7912e800 1 --2- 172.21.15.102:0/3041056779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 0x55e3285af640 secure :-1 s=READY pgs=522 cs=0 l=1 rev1=1 crypto rx=0x7fda5c00a470 tx=0x7fda5c045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.162+0000 7fda7912e800 1 -- 172.21.15.102:0/3041056779 shutdown_connections 2024-09-19T11:14:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.162+0000 7fda7912e800 1 --2- 172.21.15.102:0/3041056779 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 0x55e3285af640 unknown :-1 s=CLOSED pgs=522 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.162+0000 7fda7912e800 1 -- 172.21.15.102:0/3041056779 >> 172.21.15.102:0/3041056779 conn(0x55e3285a3a60 msgr2=0x55e3285a5ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.162+0000 7fda7912e800 1 -- 172.21.15.102:0/3041056779 shutdown_connections 2024-09-19T11:14:14.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.162+0000 7fda7912e800 1 -- 172.21.15.102:0/3041056779 wait complete. 2024-09-19T11:14:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.177+0000 7fda7912e800 1 Processor -- start 2024-09-19T11:14:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.177+0000 7fda7912e800 1 -- start start 2024-09-19T11:14:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.177+0000 7fda7912e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a8690 0x55e32851c860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.177+0000 7fda7912e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e328441dd0 con 0x55e3285a8690 2024-09-19T11:14:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.178+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a8690 0x55e32851c860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.178+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a8690 0x55e32851c860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37850/0 (socket says 172.21.15.102:37850) 2024-09-19T11:14:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.178+0000 7fda74d6b640 1 -- 172.21.15.102:0/2716228338 learned_addr learned my addr 172.21.15.102:0/2716228338 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.179 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.178+0000 7fda74d6b640 1 -- 172.21.15.102:0/2716228338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e32869bee0 con 0x55e3285a8690 2024-09-19T11:14:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.178+0000 7fda74d6b640 1 --2- 172.21.15.102:0/2716228338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a8690 0x55e32851c860 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fda64001df0 tx=0x7fda6400b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7b39f8ba490ca60 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.178+0000 7fd962e0d640 1 -- 172.21.15.102:0/2716228338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda64012020 con 0x55e3285a8690 2024-09-19T11:14:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.178+0000 7fd962e0d640 1 -- 172.21.15.102:0/2716228338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6400e470 con 0x55e3285a8690 2024-09-19T11:14:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.179+0000 7fd962e0d640 1 -- 172.21.15.102:0/2716228338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda6400e7f0 con 0x55e3285a8690 2024-09-19T11:14:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.179+0000 7fda7912e800 1 -- 172.21.15.102:0/2716228338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a8690 msgr2=0x55e32851c860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.179+0000 7fda7912e800 1 --2- 172.21.15.102:0/2716228338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a8690 0x55e32851c860 secure :-1 s=READY pgs=523 cs=0 l=1 rev1=1 crypto rx=0x7fda64001df0 tx=0x7fda6400b6c0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.179+0000 7fda7912e800 1 -- 172.21.15.102:0/2716228338 shutdown_connections 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.179+0000 7fda7912e800 1 --2- 172.21.15.102:0/2716228338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a8690 0x55e32851c860 unknown :-1 s=CLOSED pgs=523 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.179+0000 7fda7912e800 1 -- 172.21.15.102:0/2716228338 >> 172.21.15.102:0/2716228338 conn(0x55e3285a3a60 msgr2=0x55e328693ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.179+0000 7fda7912e800 1 -- 172.21.15.102:0/2716228338 shutdown_connections 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.179+0000 7fda7912e800 1 -- 172.21.15.102:0/2716228338 wait complete. 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.180+0000 7fda7912e800 1 Processor -- start 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.180+0000 7fda7912e800 1 -- start start 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.180+0000 7fda7912e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 0x55e3286a10c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.180+0000 7fda7912e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3285afd90 con 0x55e3285a9aa0 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.180+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 0x55e3286a10c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.180+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 0x55e3286a10c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37864/0 (socket says 172.21.15.102:37864) 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.180+0000 7fda74d6b640 1 -- 172.21.15.102:0/2481824921 learned_addr learned my addr 172.21.15.102:0/2481824921 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.180+0000 7fda74d6b640 1 -- 172.21.15.102:0/2481824921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3286a1620 con 0x55e3285a9aa0 2024-09-19T11:14:14.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.181+0000 7fda74d6b640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 0x55e3286a10c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55e32851c390 tx=0x7fda64000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.181+0000 7fd96160a640 1 -- 172.21.15.102:0/2481824921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda64012030 con 0x55e3285a9aa0 2024-09-19T11:14:14.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.181+0000 7fd96160a640 1 -- 172.21.15.102:0/2481824921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64001450 con 0x55e3285a9aa0 2024-09-19T11:14:14.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.181+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3286a18b0 con 0x55e3285a9aa0 2024-09-19T11:14:14.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.181+0000 7fd96160a640 1 -- 172.21.15.102:0/2481824921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda6401a700 con 0x55e3285a9aa0 2024-09-19T11:14:14.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.181+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3286a22b0 con 0x55e3285a9aa0 2024-09-19T11:14:14.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.182+0000 7fd96160a640 1 -- 172.21.15.102:0/2481824921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda64015020 con 0x55e3285a9aa0 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.182+0000 7fd96160a640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd95c03cfb0 0x7fd95c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.182+0000 7fd96160a640 1 -- 172.21.15.102:0/2481824921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fda64020030 con 0x55e3285a9aa0 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.182+0000 7fda7456a640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd95c03cfb0 0x7fd95c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.182+0000 7fda7912e800 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286a2e00 0x55e3286a8710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.182+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286a8d10 con 0x55e3286a2e00 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.182+0000 7fda7556c640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286a2e00 0x55e3286a8710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.183+0000 7fda7456a640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd95c03cfb0 0x7fd95c03f470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fda5c057000 tx=0x7fda5c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.183+0000 7fda7556c640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286a2e00 0x55e3286a8710 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.183+0000 7fda7556c640 1 -- 172.21.15.102:0/2481824921 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286a2e00 2024-09-19T11:14:14.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.183+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286a2790 con 0x55e3286a2e00 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.183+0000 7fda7556c640 1 -- 172.21.15.102:0/2481824921 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286a2e00 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.183+0000 7fda7912e800 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286ab040 0x55e3286ad430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.183+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286adb00 con 0x55e3286ab040 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.184+0000 7fda74d6b640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286ab040 0x55e3286ad430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.184+0000 7fda74d6b640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286ab040 0x55e3286ad430 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.185+0000 7fda74d6b640 1 -- 172.21.15.102:0/2481824921 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fda640187b0 con 0x55e3286ab040 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.185+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286a9ee0 con 0x55e3286a2e00 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.185+0000 7fda7556c640 1 -- 172.21.15.102:0/2481824921 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286a2e00 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.185+0000 7fda7912e800 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286aef40 0x55e3286b1330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.185+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286b1a70 con 0x55e3286aef40 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.185+0000 7fda7456a640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286aef40 0x55e3286b1330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.185+0000 7fda7456a640 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286aef40 0x55e3286b1330 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.186+0000 7fda7456a640 1 -- 172.21.15.102:0/2481824921 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286aef40 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.186+0000 7fda7912e800 1 Processor -- start 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.186+0000 7fda7912e800 1 -- start start 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.186+0000 7fda7912e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e328699670 0x55e328697ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.186+0000 7fda7912e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3284a04a0 con 0x55e328699670 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.186+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e328699670 0x55e328697ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.186+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e328699670 0x55e328697ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37870/0 (socket says 172.21.15.102:37870) 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.186+0000 7fda74d6b640 1 -- 172.21.15.102:0/1042374348 learned_addr learned my addr 172.21.15.102:0/1042374348 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.187+0000 7fda74d6b640 1 -- 172.21.15.102:0/1042374348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e328699b90 con 0x55e328699670 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.187+0000 7fda74d6b640 1 --2- 172.21.15.102:0/1042374348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e328699670 0x55e328697ee0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fda640528b0 tx=0x7fda6401bd60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.187+0000 7fd95a7fc640 1 -- 172.21.15.102:0/1042374348 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda6404b350 con 0x55e328699670 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.187+0000 7fd95a7fc640 1 -- 172.21.15.102:0/1042374348 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda64051130 con 0x55e328699670 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.187+0000 7fda7912e800 1 -- 172.21.15.102:0/1042374348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e328698420 con 0x55e328699670 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.187+0000 7fd95a7fc640 1 -- 172.21.15.102:0/1042374348 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda64051410 con 0x55e328699670 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.187+0000 7fda7912e800 1 -- 172.21.15.102:0/1042374348 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e328698970 con 0x55e328699670 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.188+0000 7fd95a7fc640 1 -- 172.21.15.102:0/1042374348 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda64044a70 con 0x55e328699670 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.188+0000 7fd95a7fc640 1 --2- 172.21.15.102:0/1042374348 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94c03cfb0 0x7fd94c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.188+0000 7fd95a7fc640 1 -- 172.21.15.102:0/1042374348 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fda6403cd50 con 0x55e328699670 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.188+0000 7fda7456a640 1 --2- 172.21.15.102:0/1042374348 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94c03cfb0 0x7fd94c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.188+0000 7fda7912e800 1 Processor -- start 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda7912e800 1 -- start start 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda7456a640 1 --2- 172.21.15.102:0/1042374348 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94c03cfb0 0x7fd94c03f470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55e3286a91c0 tx=0x7fda5c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda7912e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286ce6c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda7912e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e32869c1c0 con 0x55e3286ce2c0 2024-09-19T11:14:14.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286ce6c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286ce6c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37884/0 (socket says 172.21.15.102:37884) 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda74d6b640 1 -- 172.21.15.102:0/3881140790 learned_addr learned my addr 172.21.15.102:0/3881140790 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda74d6b640 1 -- 172.21.15.102:0/3881140790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3286cecb0 con 0x55e3286ce2c0 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.189+0000 7fda74d6b640 1 --2- 172.21.15.102:0/3881140790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286ce6c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fda6404cfd0 tx=0x7fda6404bb00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3563c75c7ddcb04d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fd94bfff640 1 -- 172.21.15.102:0/3881140790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda640440b0 con 0x55e3286ce2c0 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fd94bfff640 1 -- 172.21.15.102:0/3881140790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6400d5f0 con 0x55e3286ce2c0 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fd94bfff640 1 -- 172.21.15.102:0/3881140790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda64054180 con 0x55e3286ce2c0 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 -- 172.21.15.102:0/3881140790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 msgr2=0x55e3286ce6c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 --2- 172.21.15.102:0/3881140790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286ce6c0 secure :-1 s=READY pgs=526 cs=0 l=1 rev1=1 crypto rx=0x7fda6404cfd0 tx=0x7fda6404bb00 comp rx=0 tx=0).stop 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 -- 172.21.15.102:0/3881140790 shutdown_connections 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 --2- 172.21.15.102:0/3881140790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286ce6c0 unknown :-1 s=CLOSED pgs=526 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 -- 172.21.15.102:0/3881140790 >> 172.21.15.102:0/3881140790 conn(0x55e3286ca6c0 msgr2=0x55e3286c8900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 -- 172.21.15.102:0/3881140790 shutdown_connections 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 -- 172.21.15.102:0/3881140790 wait complete. 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 Processor -- start 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.190+0000 7fda7912e800 1 -- start start 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.191+0000 7fda7912e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286d5760 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.191+0000 7fda7912e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55e3286cf120 con 0x55e3286ce2c0 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.191+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286d5760 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.191+0000 7fda74d6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286d5760 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37888/0 (socket says 172.21.15.102:37888) 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.191+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 learned_addr learned my addr 172.21.15.102:0/3866710202 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.191+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55e3286d5cc0 con 0x55e3286ce2c0 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.191+0000 7fda74d6b640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286d5760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fda64022490 tx=0x7fda6403afb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.192+0000 7fd94a7fc640 1 -- 172.21.15.102:0/3866710202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda64054360 con 0x55e3286ce2c0 2024-09-19T11:14:14.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.192+0000 7fd94a7fc640 1 -- 172.21.15.102:0/3866710202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fda6401b040 con 0x55e3286ce2c0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.192+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55e3286d5cc0 con 0x55e3286ce2c0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.192+0000 7fd94a7fc640 1 -- 172.21.15.102:0/3866710202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fda64044510 con 0x55e3286ce2c0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.192+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55e3286d5cc0 con 0x55e3286ce2c0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.192+0000 7fd94a7fc640 1 -- 172.21.15.102:0/3866710202 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fda640446b0 con 0x55e3286ce2c0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fd94a7fc640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94003cfb0 0x7fd94003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fd94a7fc640 1 -- 172.21.15.102:0/3866710202 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fda6405a030 con 0x55e3286ce2c0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fda7456a640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94003cfb0 0x7fd94003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286e0ce0 0x55e3286e3170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e38c0 con 0x55e3286e0ce0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fda7556c640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286e0ce0 0x55e3286e3170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fda7456a640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94003cfb0 0x7fd94003f470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fda5c045a60 tx=0x7fda5c053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.193+0000 7fda7556c640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286e0ce0 0x55e3286e3170 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 realm 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e3cd0 con 0x55e3286e0ce0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e45a0 con 0x55e3286e0ce0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286e5430 0x55e3286e7820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.194+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e7f60 con 0x55e3286e5430 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.195+0000 7fda74d6b640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286e5430 0x55e3286e7820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.195+0000 7fda74d6b640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286e5430 0x55e3286e7820 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7912e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7912e800 20 searching for the correct realm 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286ea000 0x55e3286ec4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286ecb90 con 0x55e3286ea000 2024-09-19T11:14:14.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7456a640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286ea000 0x55e3286ec4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7456a640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286ea000 0x55e3286ec4c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7456a640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fda5c05f040 0x7fda5c05f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286ecb90 con 0x7fda5c05f040 2024-09-19T11:14:14.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.196+0000 7fda7556c640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fda5c05f040 0x7fda5c05f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.197+0000 7fda7556c640 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fda5c05f040 0x7fda5c05f930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.197+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.197+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e5430 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.197+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.197+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.198+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.198+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.198+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.198+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e5430 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.198+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.198+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e5430 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.198+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.198+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x7fda5c05f040 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.199+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.199+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286ea000 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.199+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.199+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.199+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.199+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e5430 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.200+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.200+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.200+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.200+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x7fda5c05f040 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.200+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.200+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286ea000 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.200+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.200+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286ea000 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.201+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.201+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e5430 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.201+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.201+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286ea000 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.201+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.201+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286ea000 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.201+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.201+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.202+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.202+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.202+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.202+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e5430 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.202+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.202+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286ea000 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.202+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.202+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x7fda5c05f040 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.203+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.203+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.203+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.203+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e5430 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.203+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.203+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286ea000 2024-09-19T11:14:14.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.203+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.203+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e5430 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.204+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.204+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x7fda5c05f040 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.204+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.204+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286ea000 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.204+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.204+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x7fda5c05f040 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x55e3286e0ce0 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e4940 con 0x7fda5c05f040 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:14.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e8900 con 0x55e3286e0ce0 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.205+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e8900 con 0x55e3286e0ce0 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e88b0 con 0x55e3286ea000 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 zone default found 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 4 Realm: () 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 zonegroup default 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286e91a0 con 0x55e3286e5430 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286eea00 con 0x55e3286ea000 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.206+0000 7fda7912e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.207+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286eeda0 con 0x55e3286ea000 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.207+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.207+0000 7fda7912e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.207+0000 7fda7912e800 20 started sync module instance, tier type = 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.207+0000 7fda7912e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.207+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286edea0 con 0x7fda5c05f040 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.208+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.208+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94434124293024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286edea0 con 0x7fda5c05f040 2024-09-19T11:14:14.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.208+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286ef830 con 0x55e3286e0ce0 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.209+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94434124293024] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.209+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.209+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94434124296960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286edea0 con 0x55e3286e0ce0 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.209+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f02e0 con 0x55e3286ea000 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.211+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.211+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94434124299712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f0b80 con 0x55e3286ea000 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.211+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f1600 con 0x7fda5c05f040 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.211+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94434124296960] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.212+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.212+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94434124304624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f1a20 con 0x7fda5c05f040 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.212+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f2420 con 0x55e3286e0ce0 2024-09-19T11:14:14.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.212+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94434124299712] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.213+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94434124304624] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.213+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.213+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94434124290544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f1f30 con 0x55e3286e0ce0 2024-09-19T11:14:14.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.213+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f2cc0 con 0x55e3286e5430 2024-09-19T11:14:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.214+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94434124290544] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.216+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.216+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94434124310544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f1f30 con 0x55e3286e5430 2024-09-19T11:14:14.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.216+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f3680 con 0x55e3286e5430 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.217+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94434124310544] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.217+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.217+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94434124302032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f3ed0 con 0x55e3286e5430 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.217+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f4890 con 0x55e3286e5430 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'159 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94434124302032] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94434124318144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f3b00 con 0x55e3286e5430 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda7912e800 20 add_watcher() i=0 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda7912e800 20 add_watcher() i=1 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda7912e800 20 add_watcher() i=2 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda7912e800 20 add_watcher() i=3 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda7912e800 20 add_watcher() i=4 2024-09-19T11:14:14.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda7912e800 20 add_watcher() i=5 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.220+0000 7fda7912e800 20 add_watcher() i=6 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.221+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94434124318144] v37'160 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.221+0000 7fda7912e800 20 add_watcher() i=7 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.221+0000 7fda7912e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.221+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f8000 con 0x55e3286e0ce0 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.221+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.221+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94434124319200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f54c0 con 0x55e3286e0ce0 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.222+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94434124319200] v37'152 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.222+0000 7fd92afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.223+0000 7fda7912e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.223+0000 7fda7912e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:14.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.223+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3287004d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.224+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.224+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328700ac0 con 0x55e3286e5430 2024-09-19T11:14:14.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.225+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'18 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.225+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328700a70 con 0x55e3286ea000 2024-09-19T11:14:14.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.226+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.226+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3287010d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.227+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'153 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.227+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328701580 con 0x7fda5c05f040 2024-09-19T11:14:14.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.228+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'44 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.228+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328701af0 con 0x55e3286ea000 2024-09-19T11:14:14.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.229+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.229+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328701fa0 con 0x55e3286e0ce0 2024-09-19T11:14:14.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.230+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.230+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286fe680 con 0x55e3286e5430 2024-09-19T11:14:14.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.231+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'30 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.231+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286fe680 con 0x7fda5c05f040 2024-09-19T11:14:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.232+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.232+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286ff690 con 0x55e3286ea000 2024-09-19T11:14:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.233+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'24 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.233+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x7fda5c05f040 2024-09-19T11:14:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.234+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'45 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.234+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286e5430 2024-09-19T11:14:14.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.236+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.236+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x7fda5c05f040 2024-09-19T11:14:14.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.237+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'18 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.237+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286e5430 2024-09-19T11:14:14.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.238+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'35 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.238+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286e0ce0 2024-09-19T11:14:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.239+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'154 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.239+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286ea000 2024-09-19T11:14:14.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.240+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'38 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.240+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x7fda5c05f040 2024-09-19T11:14:14.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.241+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'46 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.241+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286ea000 2024-09-19T11:14:14.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.242+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.242+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286e0ce0 2024-09-19T11:14:14.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.244+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'26 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.244+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286e0ce0 2024-09-19T11:14:14.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.245+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'155 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.245+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286ea000 2024-09-19T11:14:14.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.246+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'39 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.246+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x7fda5c05f040 2024-09-19T11:14:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.247+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'28 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.247+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286ea000 2024-09-19T11:14:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.248+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'21 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.248+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702b00 con 0x55e3286ea000 2024-09-19T11:14:14.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.249+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.249+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702cd0 con 0x55e3286ea000 2024-09-19T11:14:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.250+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'14 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.251 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.250+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328703180 con 0x55e3286ea000 2024-09-19T11:14:14.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.251+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'31 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.252 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.251+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702fb0 con 0x55e3286e5430 2024-09-19T11:14:14.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.252+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'20 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.253 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.252+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702fb0 con 0x55e3286ea000 2024-09-19T11:14:14.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.253+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'18 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.254 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.253+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702fb0 con 0x55e3286e5430 2024-09-19T11:14:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.254+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.255 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.254+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702fb0 con 0x55e3286ea000 2024-09-19T11:14:14.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.256+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'40 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.256+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702fb0 con 0x55e3286e5430 2024-09-19T11:14:14.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.257+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'36 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.257+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e328702fb0 con 0x7fda5c05f040 2024-09-19T11:14:14.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.258+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'24 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.258+0000 7fd929fe3640 20 reqs_thread_entry: start 2024-09-19T11:14:14.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.258+0000 7fda7912e800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:14.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.258+0000 7fda7912e800 20 Filter name: none 2024-09-19T11:14:14.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.258+0000 7fd89b7fe640 20 reqs_thread_entry: start 2024-09-19T11:14:14.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.259+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e0ce0 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.259+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.259+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.259+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.259+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e0ce0 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.259+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.259+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.260+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.260+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e5430 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.260+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv9 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.260+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e5430 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.261+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv9 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.261+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.261+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.261+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.261+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.261+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.261+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.261+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.262+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.262+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.262+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv7 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.262+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.262+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv7 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.262+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x7fda5c05f040 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.262+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.262+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x7fda5c05f040 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.263+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.263+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x7fda5c05f040 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.263+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.263+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.263+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.263+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.263+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.263+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.264+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.264+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.264+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.264+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.264+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv5 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.264+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.264+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv5 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.264+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e5430 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.265+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.265+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e5430 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.265+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv4 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.265+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.265+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv4 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x7fda5c05f040 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.266+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.267+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv3 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.267+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.267+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv3 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.267+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.267+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.267+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x7fda5c05f040 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.267+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.267+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.268+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.268+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.268+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.268+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e5430 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.268+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.268+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.269+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.269+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.269+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.269+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x7fda5c05f040 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.269+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.269+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.269+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.269+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.270+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.270+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e5430 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.270+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv6 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.270+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.271+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv6 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.271+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e0ce0 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.271+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.271+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.271+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.271+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e0ce0 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.271+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.271+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.272+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.272+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.272+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.272+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.272+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.272+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x7fda5c05f040 2024-09-19T11:14:14.282 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv13 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv13 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.273+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.274+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.274+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e0ce0 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.274+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.274+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.274+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.274+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e0ce0 2024-09-19T11:14:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.274+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.274+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e0ce0 2024-09-19T11:14:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.275+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.275+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e0ce0 2024-09-19T11:14:14.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.275+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv15 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.275+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e0ce0 2024-09-19T11:14:14.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.275+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv15 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.275+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.275+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.275+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.276+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv9 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.276+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.276+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv9 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.276+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.276+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.276+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x7fda5c05f040 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.276+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.276+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x7fda5c05f040 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.277+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv3 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.278+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.279+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv3 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.279+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.279+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.279+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.279+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv10 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.279+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.279+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv10 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.279+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.280+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.280+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e5430 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.280+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.280+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.281+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.281+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.281+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.281+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286ea000 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.281+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv7 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.281+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286ea000 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.281+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv7 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.281+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.282+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.282+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872cff0 con 0x55e3286e5430 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.282+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.282+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872e000 con 0x55e3286e5430 2024-09-19T11:14:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.282+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 41 ==== osd_op_reply(180 gc.28 [call out=1702b] v0'0 uv29 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.283+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872eda0 con 0x55e3286ea000 2024-09-19T11:14:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.283+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.283+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872dd90 con 0x55e3286ea000 2024-09-19T11:14:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.283+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv11 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.283+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872eda0 con 0x55e3286ea000 2024-09-19T11:14:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.283+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv11 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.300 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.283+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872eda0 con 0x55e3286e5430 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.284+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.284+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872dd90 con 0x55e3286e5430 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.284+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv12 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.284+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872eda0 con 0x55e3286e5430 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.284+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv12 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.284+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872eda0 con 0x7fda5c05f040 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.285+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.285+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872dd90 con 0x7fda5c05f040 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.285+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv5 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.285+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55e32872eda0 con 0x7fda5c05f040 2024-09-19T11:14:14.301 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.285+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv5 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.286+0000 7fd92afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.286+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94434124319200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286feb80 con 0x55e3286e0ce0 2024-09-19T11:14:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.287+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94434124319200] v37'156 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.287+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94434124293024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f49e0 con 0x7fda5c05f040 2024-09-19T11:14:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.288+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94434124293024] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.288+0000 7fda7912e800 20 remove_watcher() i=0 2024-09-19T11:14:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.288+0000 7fda7912e800 2 removed watcher, disabling cache 2024-09-19T11:14:14.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.288+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94434124296960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f49e0 con 0x55e3286e0ce0 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.289+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94434124296960] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.289+0000 7fda7912e800 20 remove_watcher() i=1 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.289+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94434124299712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f49e0 con 0x55e3286ea000 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.291+0000 7fda7456a640 1 -- 172.21.15.102:0/3866710202 <== osd.3 v2:172.21.15.102:6800/3957239017 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94434124299712] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda5c051070 con 0x55e3286ea000 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.291+0000 7fda7912e800 20 remove_watcher() i=2 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.291+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94434124304624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f49e0 con 0x7fda5c05f040 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.291+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.2 v2:172.21.15.102:6808/525557096 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94434124304624] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x7fda5c05f040 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.292+0000 7fda7912e800 20 remove_watcher() i=3 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.292+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94434124290544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f10f0 con 0x55e3286e0ce0 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.293+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 <== osd.1 v2:172.21.15.102:6816/3609322588 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94434124290544] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6c00a4d0 con 0x55e3286e0ce0 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.293+0000 7fda7912e800 20 remove_watcher() i=4 2024-09-19T11:14:14.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.293+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94434124310544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f49e0 con 0x55e3286e5430 2024-09-19T11:14:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.294+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94434124310544] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.294+0000 7fda7912e800 20 remove_watcher() i=5 2024-09-19T11:14:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.294+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94434124302032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f2810 con 0x55e3286e5430 2024-09-19T11:14:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.295+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94434124302032] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.295+0000 7fda7912e800 20 remove_watcher() i=6 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.295+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94434124318144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55e3286f49e0 con 0x55e3286e5430 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda74d6b640 1 -- 172.21.15.102:0/3866710202 <== osd.0 v2:172.21.15.37:6800/394652614 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94434124318144] v37'161 uv159 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fda6404a020 con 0x55e3286e5430 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 20 remove_watcher() i=7 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286e5430 msgr2=0x55e3286e7820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286e5430 0x55e3286e7820 crc :-1 s=READY pgs=114 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286e0ce0 msgr2=0x55e3286e3170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286e0ce0 0x55e3286e3170 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fda5c05f040 msgr2=0x7fda5c05f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fda5c05f040 0x7fda5c05f930 crc :-1 s=READY pgs=63 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286ea000 msgr2=0x55e3286ec4c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286ea000 0x55e3286ec4c0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94003cfb0 msgr2=0x7fd94003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.296+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94003cfb0 0x7fd94003f470 secure :-1 s=READY pgs=217 cs=0 l=1 rev1=1 crypto rx=0x7fda5c045a60 tx=0x7fda5c053000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 msgr2=0x55e3286d5760 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7556c640 1 -- 172.21.15.102:0/3866710202 reap_dead start 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286d5760 secure :-1 s=READY pgs=527 cs=0 l=1 rev1=1 crypto rx=0x7fda64022490 tx=0x7fda6403afb0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 shutdown_connections 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/3866710202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3286ce2c0 0x55e3286d5760 unknown :-1 s=CLOSED pgs=527 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 >> 172.21.15.102:0/3866710202 conn(0x55e3286ca6c0 msgr2=0x55e3286c88d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 shutdown_connections 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/3866710202 wait complete. 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/1042374348 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94c03cfb0 msgr2=0x7fd94c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/1042374348 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94c03cfb0 0x7fd94c03f470 secure :-1 s=READY pgs=216 cs=0 l=1 rev1=1 crypto rx=0x55e3286a91c0 tx=0x7fda5c005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/1042374348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e328699670 msgr2=0x55e328697ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/1042374348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e328699670 0x55e328697ee0 secure :-1 s=READY pgs=525 cs=0 l=1 rev1=1 crypto rx=0x7fda640528b0 tx=0x7fda6401bd60 comp rx=0 tx=0).stop 2024-09-19T11:14:14.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/1042374348 shutdown_connections 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/1042374348 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd94c03cfb0 0x7fd94c03f470 unknown :-1 s=CLOSED pgs=216 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/1042374348 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e328699670 0x55e328697ee0 unknown :-1 s=CLOSED pgs=525 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/1042374348 >> 172.21.15.102:0/1042374348 conn(0x55e3286b3b20 msgr2=0x55e3286b3f00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/1042374348 shutdown_connections 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/1042374348 wait complete. 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286ab040 msgr2=0x55e3286ad430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55e3286ab040 0x55e3286ad430 crc :-1 s=READY pgs=113 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286a2e00 msgr2=0x55e3286a8710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55e3286a2e00 0x55e3286a8710 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286aef40 msgr2=0x55e3286b1330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55e3286aef40 0x55e3286b1330 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd95c03cfb0 msgr2=0x7fd95c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd95c03cfb0 0x7fd95c03f470 secure :-1 s=READY pgs=215 cs=0 l=1 rev1=1 crypto rx=0x7fda5c057000 tx=0x7fda5c052000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 msgr2=0x55e3286a10c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7912e800 1 --2- 172.21.15.102:0/2481824921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55e3285a9aa0 0x55e3286a10c0 secure :-1 s=READY pgs=524 cs=0 l=1 rev1=1 crypto rx=0x55e32851c390 tx=0x7fda64000bc0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.297+0000 7fda7556c640 1 -- 172.21.15.102:0/2481824921 reap_dead start 2024-09-19T11:14:14.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.298+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 shutdown_connections 2024-09-19T11:14:14.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.298+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 >> 172.21.15.102:0/2481824921 conn(0x55e3285a3a60 msgr2=0x55e328692390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.298+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 shutdown_connections 2024-09-19T11:14:14.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.298+0000 7fda7912e800 1 -- 172.21.15.102:0/2481824921 wait complete. 2024-09-19T11:14:14.312 INFO:teuthology.orchestra.run.smithi102.stdout:[{"tag":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.17861135777741520214\u0000","time":"2024-09-19T11:14:14.102568+0000","objs":[{"pool":"default.rgw.buckets.data","oid":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_1","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_2","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_3","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_4","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_5","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_6","key":"","instance":""},{"pool":"default.rgw.buckets.data","oid":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_7","key":"","instance":""}]}] 2024-09-19T11:14:14.312 DEBUG:tasks.util.rgw: json result: [{'tag': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.17861135777741520214\x00', 'time': '2024-09-19T11:14:14.102568+0000', 'objs': [{'pool': 'default.rgw.buckets.data', 'oid': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_1', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_2', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_3', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_4', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_5', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_6', 'key': '', 'instance': ''}, {'pool': 'default.rgw.buckets.data', 'oid': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_7', 'key': '', 'instance': ''}]}] 2024-09-19T11:14:14.312 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process'] 2024-09-19T11:14:14.312 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process'] 2024-09-19T11:14:14.313 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process 2024-09-19T11:14:14.356 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:14.356 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:14.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.356+0000 7f54ff735800 1 Processor -- start 2024-09-19T11:14:14.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.356+0000 7f54ff735800 1 -- start start 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.356+0000 7f54ff735800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5562c6985b50 0x5562c698b6f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.356+0000 7f54ff735800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5562c6984f30 con 0x5562c6984880 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.356+0000 7f54ff735800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5562c680f7d0 con 0x5562c6985b50 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.356+0000 7f54f3fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5562c6985b50 0x5562c698b6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.357+0000 7f54fb47d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5562c6984880 0x5562c6985440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36780/0 (socket says 172.21.15.102:36780) 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.357+0000 7f54fb47d640 1 -- 172.21.15.102:0/937480425 learned_addr learned my addr 172.21.15.102:0/937480425 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.357+0000 7f54f3fff640 1 -- 172.21.15.102:0/937480425 >> v1:172.21.15.37:6789/0 conn(0x5562c6984880 legacy=0x5562c6985440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.357+0000 7f54f3fff640 1 -- 172.21.15.102:0/937480425 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c6986000 con 0x5562c6985b50 2024-09-19T11:14:14.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54f3fff640 1 --2- 172.21.15.102:0/937480425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6985b50 0x5562c698b6f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f54e400a470 tx=0x7f54e4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=264501d8dfe4fca2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54fac7c640 1 -- 172.21.15.102:0/937480425 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e4053570 con 0x5562c6985b50 2024-09-19T11:14:14.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54fac7c640 1 -- 172.21.15.102:0/937480425 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54e4058070 con 0x5562c6985b50 2024-09-19T11:14:14.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54fac7c640 1 -- 172.21.15.102:0/937480425 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54e4053880 con 0x5562c6985b50 2024-09-19T11:14:14.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54ff735800 1 -- 172.21.15.102:0/937480425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6985b50 msgr2=0x5562c698b6f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54ff735800 1 --2- 172.21.15.102:0/937480425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6985b50 0x5562c698b6f0 secure :-1 s=READY pgs=529 cs=0 l=1 rev1=1 crypto rx=0x7f54e400a470 tx=0x7f54e4045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:14.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54ff735800 1 -- 172.21.15.102:0/937480425 shutdown_connections 2024-09-19T11:14:14.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54ff735800 1 --2- 172.21.15.102:0/937480425 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6985b50 0x5562c698b6f0 unknown :-1 s=CLOSED pgs=529 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54ff735800 1 -- 172.21.15.102:0/937480425 >> 172.21.15.102:0/937480425 conn(0x5562c697fc50 msgr2=0x5562c69820b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54ff735800 1 -- 172.21.15.102:0/937480425 shutdown_connections 2024-09-19T11:14:14.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.359+0000 7f54ff735800 1 -- 172.21.15.102:0/937480425 wait complete. 2024-09-19T11:14:14.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.373+0000 7f54ff735800 1 Processor -- start 2024-09-19T11:14:14.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.373+0000 7f54ff735800 1 -- start start 2024-09-19T11:14:14.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.373+0000 7f54ff735800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a742d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.373+0000 7f54ff735800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c681cdd0 con 0x5562c6984880 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.374+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a742d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.374+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a742d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37902/0 (socket says 172.21.15.102:37902) 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.374+0000 7f54fb47d640 1 -- 172.21.15.102:0/584122298 learned_addr learned my addr 172.21.15.102:0/584122298 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.374+0000 7f54fb47d640 1 -- 172.21.15.102:0/584122298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c6a748c0 con 0x5562c6984880 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.374+0000 7f54fb47d640 1 --2- 172.21.15.102:0/584122298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a742d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f54ec001df0 tx=0x7f54ec00b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8acb2b3b15dc09f7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.374+0000 7f53e960a640 1 -- 172.21.15.102:0/584122298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec012020 con 0x5562c6984880 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.374+0000 7f53e960a640 1 -- 172.21.15.102:0/584122298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec00e470 con 0x5562c6984880 2024-09-19T11:14:14.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.374+0000 7f53e960a640 1 -- 172.21.15.102:0/584122298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec00e7f0 con 0x5562c6984880 2024-09-19T11:14:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 -- 172.21.15.102:0/584122298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 msgr2=0x5562c6a742d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 --2- 172.21.15.102:0/584122298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a742d0 secure :-1 s=READY pgs=530 cs=0 l=1 rev1=1 crypto rx=0x7f54ec001df0 tx=0x7f54ec00b6c0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 -- 172.21.15.102:0/584122298 shutdown_connections 2024-09-19T11:14:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 --2- 172.21.15.102:0/584122298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a742d0 unknown :-1 s=CLOSED pgs=530 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 -- 172.21.15.102:0/584122298 >> 172.21.15.102:0/584122298 conn(0x5562c697fc50 msgr2=0x5562c6a6fc50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 -- 172.21.15.102:0/584122298 shutdown_connections 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 -- 172.21.15.102:0/584122298 wait complete. 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 Processor -- start 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 -- start start 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a7bdf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.375+0000 7f54ff735800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c698be40 con 0x5562c6984880 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a7bdf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a7bdf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37912/0 (socket says 172.21.15.102:37912) 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f54fb47d640 1 -- 172.21.15.102:0/1760301869 learned_addr learned my addr 172.21.15.102:0/1760301869 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f54fb47d640 1 -- 172.21.15.102:0/1760301869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c6a7c350 con 0x5562c6984880 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f54fb47d640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a7bdf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x5562c6a75260 tx=0x7f54ec000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f53e7e07640 1 -- 172.21.15.102:0/1760301869 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec012030 con 0x5562c6984880 2024-09-19T11:14:14.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f53e7e07640 1 -- 172.21.15.102:0/1760301869 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec01a6d0 con 0x5562c6984880 2024-09-19T11:14:14.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562c6a7c5e0 con 0x5562c6984880 2024-09-19T11:14:14.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f53e7e07640 1 -- 172.21.15.102:0/1760301869 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec01a9d0 con 0x5562c6984880 2024-09-19T11:14:14.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.376+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c6a7cfe0 con 0x5562c6984880 2024-09-19T11:14:14.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.377+0000 7f53e7e07640 1 -- 172.21.15.102:0/1760301869 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f54ec015020 con 0x5562c6984880 2024-09-19T11:14:14.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.377+0000 7f53e7e07640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53e003cfb0 0x7f53e003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.377+0000 7f53e7e07640 1 -- 172.21.15.102:0/1760301869 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f54ec020030 con 0x5562c6984880 2024-09-19T11:14:14.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.378+0000 7f54f3fff640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53e003cfb0 0x7f53e003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.378+0000 7f54ff735800 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6985b50 0x5562c6a83440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.378+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6a83980 con 0x5562c6985b50 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.378+0000 7f54fbc7e640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6985b50 0x5562c6a83440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.378+0000 7f54f3fff640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53e003cfb0 0x7f53e003f470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f54e4057000 tx=0x7f54e4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.378+0000 7f54fbc7e640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6985b50 0x5562c6a83440 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.378+0000 7f54fbc7e640 1 -- 172.21.15.102:0/1760301869 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6985b50 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.378+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6a83d20 con 0x5562c6985b50 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.379+0000 7f54fbc7e640 1 -- 172.21.15.102:0/1760301869 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6985b50 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.379+0000 7f54ff735800 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6a85860 0x5562c6a87cd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.379+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6a88460 con 0x5562c6a85860 2024-09-19T11:14:14.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.379+0000 7f54fb47d640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6a85860 0x5562c6a87cd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.379+0000 7f54fb47d640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6a85860 0x5562c6a87cd0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.380+0000 7f54fb47d640 1 -- 172.21.15.102:0/1760301869 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6a85860 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.380+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6a84570 con 0x5562c6985b50 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.380+0000 7f54fbc7e640 1 -- 172.21.15.102:0/1760301869 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6985b50 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.380+0000 7f54ff735800 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6a898c0 0x5562c6a8bcb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.380+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6a8c3f0 con 0x5562c6a898c0 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.380+0000 7f54f3fff640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6a898c0 0x5562c6a8bcb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.381+0000 7f54f3fff640 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6a898c0 0x5562c6a8bcb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.381+0000 7f54f3fff640 1 -- 172.21.15.102:0/1760301869 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6a898c0 2024-09-19T11:14:14.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.381+0000 7f54ff735800 1 Processor -- start 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.381+0000 7f54ff735800 1 -- start start 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.381+0000 7f54ff735800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6a9a130 0x5562c6a9a550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.381+0000 7f54ff735800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c687b4a0 con 0x5562c6a9a130 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6a9a130 0x5562c6a9a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6a9a130 0x5562c6a9a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37928/0 (socket says 172.21.15.102:37928) 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f54fb47d640 1 -- 172.21.15.102:0/805421319 learned_addr learned my addr 172.21.15.102:0/805421319 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f54fb47d640 1 -- 172.21.15.102:0/805421319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c6a9ab90 con 0x5562c6a9a130 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f54fb47d640 1 --2- 172.21.15.102:0/805421319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6a9a130 0x5562c6a9a550 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f54ec052b00 tx=0x7f54ec03ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f53e5602640 1 -- 172.21.15.102:0/805421319 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec04e040 con 0x5562c6a9a130 2024-09-19T11:14:14.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f53e5602640 1 -- 172.21.15.102:0/805421319 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec051380 con 0x5562c6a9a130 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f54ff735800 1 -- 172.21.15.102:0/805421319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562c6a9b3c0 con 0x5562c6a9a130 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f53e5602640 1 -- 172.21.15.102:0/805421319 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec0516a0 con 0x5562c6a9a130 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.382+0000 7f54ff735800 1 -- 172.21.15.102:0/805421319 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c6a9b960 con 0x5562c6a9a130 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.383+0000 7f53e5602640 1 -- 172.21.15.102:0/805421319 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f54ec042aa0 con 0x5562c6a9a130 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.383+0000 7f53e5602640 1 --2- 172.21.15.102:0/805421319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53d403cf60 0x7f53d403f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.383+0000 7f53e5602640 1 -- 172.21.15.102:0/805421319 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f54ec03d050 con 0x5562c6a9a130 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.383+0000 7f54f3fff640 1 --2- 172.21.15.102:0/805421319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53d403cf60 0x7f53d403f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54ff735800 1 Processor -- start 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54ff735800 1 -- start start 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54f3fff640 1 --2- 172.21.15.102:0/805421319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53d403cf60 0x7f53d403f420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5562c6a88800 tx=0x7f54e4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54ff735800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aa6df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54ff735800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c6a74cf0 con 0x5562c6aa69f0 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aa6df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aa6df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37930/0 (socket says 172.21.15.102:37930) 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54fb47d640 1 -- 172.21.15.102:0/3200047670 learned_addr learned my addr 172.21.15.102:0/3200047670 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.384+0000 7f54fb47d640 1 -- 172.21.15.102:0/3200047670 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c6aa73e0 con 0x5562c6aa69f0 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54fb47d640 1 --2- 172.21.15.102:0/3200047670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aa6df0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f54ec01b220 tx=0x7f54ec00dd40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=caf57a4448898454 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f53deffd640 1 -- 172.21.15.102:0/3200047670 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec02d790 con 0x5562c6aa69f0 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f53deffd640 1 -- 172.21.15.102:0/3200047670 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec03b460 con 0x5562c6aa69f0 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f53deffd640 1 -- 172.21.15.102:0/3200047670 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec00b150 con 0x5562c6aa69f0 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54ff735800 1 -- 172.21.15.102:0/3200047670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 msgr2=0x5562c6aa6df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54ff735800 1 --2- 172.21.15.102:0/3200047670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aa6df0 secure :-1 s=READY pgs=533 cs=0 l=1 rev1=1 crypto rx=0x7f54ec01b220 tx=0x7f54ec00dd40 comp rx=0 tx=0).stop 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54ff735800 1 -- 172.21.15.102:0/3200047670 shutdown_connections 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54ff735800 1 --2- 172.21.15.102:0/3200047670 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aa6df0 unknown :-1 s=CLOSED pgs=533 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54ff735800 1 -- 172.21.15.102:0/3200047670 >> 172.21.15.102:0/3200047670 conn(0x5562c6aa2df0 msgr2=0x5562c6aa1030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54ff735800 1 -- 172.21.15.102:0/3200047670 shutdown_connections 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54ff735800 1 -- 172.21.15.102:0/3200047670 wait complete. 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.385+0000 7f54ff735800 1 Processor -- start 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f54ff735800 1 -- start start 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f54ff735800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aade00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f54ff735800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5562c6aa7850 con 0x5562c6aa69f0 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aade00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f54fb47d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aade00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37942/0 (socket says 172.21.15.102:37942) 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 learned_addr learned my addr 172.21.15.102:0/3093617942 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5562c6aae360 con 0x5562c6aa69f0 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f54fb47d640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aade00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f54ec01b220 tx=0x7f54ec041f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.386+0000 7f53dd7fa640 1 -- 172.21.15.102:0/3093617942 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec01be40 con 0x5562c6aa69f0 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.387+0000 7f53dd7fa640 1 -- 172.21.15.102:0/3093617942 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f54ec02dcf0 con 0x5562c6aa69f0 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.387+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5562c6aae360 con 0x5562c6aa69f0 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.387+0000 7f53dd7fa640 1 -- 172.21.15.102:0/3093617942 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f54ec02d3f0 con 0x5562c6aa69f0 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.387+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5562c6aae360 con 0x5562c6aa69f0 2024-09-19T11:14:14.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.387+0000 7f53dd7fa640 1 -- 172.21.15.102:0/3093617942 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f54ec044240 con 0x5562c6aa69f0 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.388+0000 7f53dd7fa640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53c403d000 0x7f53c403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.388+0000 7f53dd7fa640 1 -- 172.21.15.102:0/3093617942 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f54ec05b030 con 0x5562c6aa69f0 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.388+0000 7f54f3fff640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53c403d000 0x7f53c403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.388+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.388+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6ab9360 0x5562c6abb820 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.388+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abbf70 con 0x5562c6ab9360 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.388+0000 7f54f3fff640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53c403d000 0x7f53c403f4c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54e40539f0 tx=0x7f54e4053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.388+0000 7f54fbc7e640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6ab9360 0x5562c6abb820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54fbc7e640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6ab9360 0x5562c6abb820 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 realm 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abc380 con 0x5562c6ab9360 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcc50 con 0x5562c6ab9360 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:14.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6abdd50 0x5562c6ac0140 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.389+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac0700 con 0x5562c6abdd50 2024-09-19T11:14:14.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.390+0000 7f54fb47d640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6abdd50 0x5562c6ac0140 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.390+0000 7f54fb47d640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6abdd50 0x5562c6ac0140 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.390+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.390+0000 7f54ff735800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.390+0000 7f54ff735800 20 searching for the correct realm 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.390+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6ac26b0 0x5562c6ac4b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.390+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac5240 con 0x5562c6ac26b0 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.390+0000 7f54f3fff640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6ac26b0 0x5562c6ac4b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.391+0000 7f54f3fff640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6ac26b0 0x5562c6ac4b70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.391+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.391+0000 7f54f3fff640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f54e406c040 0x7f54e405f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.391+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac5240 con 0x7f54e406c040 2024-09-19T11:14:14.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.391+0000 7f54fbc7e640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f54e406c040 0x7f54e405f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.391+0000 7f54fbc7e640 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f54e406c040 0x7f54e405f420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.392+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.392+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6abdd50 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.392+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.392+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.392+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.392+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.392+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.392+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6abdd50 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.393+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.393+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6abdd50 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.393+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.393+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x7f54e406c040 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.393+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.393+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ac26b0 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.393+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.393+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.394+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.394+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6abdd50 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.394+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.394+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.394+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.394+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x7f54e406c040 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.394+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.394+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ac26b0 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.395+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.395+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ac26b0 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.395+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.395+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6abdd50 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.395+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.395+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ac26b0 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.395+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.395+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ac26b0 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.396+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.396+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.396+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.396+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.396+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.396+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6abdd50 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.396+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.396+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ac26b0 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.397+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.397+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x7f54e406c040 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.397+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.397+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.397+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.397+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6abdd50 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.397+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.397+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ac26b0 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.398+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.398+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6abdd50 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.398+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.398+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x7f54e406c040 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.398+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.398+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ac26b0 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.398+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.398+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x7f54e406c040 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x5562c6ab9360 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5562c6abcff0 con 0x7f54e406c040 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac0fc0 con 0x5562c6ab9360 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac0fc0 con 0x5562c6ab9360 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.399+0000 7f54ff735800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac0fc0 con 0x5562c6ac26b0 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 zone default found 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 4 Realm: () 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 zonegroup default 2024-09-19T11:14:14.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac1940 con 0x5562c6abdd50 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac7240 con 0x5562c6ac26b0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.400+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac7680 con 0x5562c6ac26b0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.401+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.401+0000 7f54ff735800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.401+0000 7f54ff735800 20 started sync module instance, tier type = 2024-09-19T11:14:14.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.401+0000 7f54ff735800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.401+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac6550 con 0x7f54e406c040 2024-09-19T11:14:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.402+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.402+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93882728344144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac6550 con 0x7f54e406c040 2024-09-19T11:14:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.402+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac81c0 con 0x5562c6ab9360 2024-09-19T11:14:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.403+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93882728344144] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.403+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.403+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93882728348816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac6550 con 0x5562c6ab9360 2024-09-19T11:14:14.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.403+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac8c30 con 0x5562c6ac26b0 2024-09-19T11:14:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.404+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93882728348816] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.404+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.404+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93882728341664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac64c0 con 0x5562c6ac26b0 2024-09-19T11:14:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.404+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac9b20 con 0x7f54e406c040 2024-09-19T11:14:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.405+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.405+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93882728341664] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.405+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93882728355920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac9110 con 0x7f54e406c040 2024-09-19T11:14:14.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.405+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6aca890 con 0x5562c6ab9360 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.406+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.407+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93882728358816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6aca800 con 0x5562c6ab9360 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.407+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acb820 con 0x5562c6abdd50 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.407+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93882728355920] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.408+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.408+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93882728362752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acbc40 con 0x5562c6abdd50 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.408+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acc600 con 0x5562c6abdd50 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.408+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93882728358816] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.409+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93882728362752] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.409+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.409+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93882728366416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acc9a0 con 0x5562c6abdd50 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.409+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acd230 con 0x5562c6abdd50 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'162 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93882728368544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acd8c0 con 0x5562c6abdd50 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54ff735800 20 add_watcher() i=0 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54ff735800 20 add_watcher() i=1 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54ff735800 20 add_watcher() i=2 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54ff735800 20 add_watcher() i=3 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54ff735800 20 add_watcher() i=4 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54ff735800 20 add_watcher() i=5 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93882728366416] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.410+0000 7f54ff735800 20 add_watcher() i=6 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.411+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93882728368544] v37'163 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.411+0000 7f54ff735800 20 add_watcher() i=7 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.411+0000 7f54ff735800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.411+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ad07e0 con 0x5562c6ab9360 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.411+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.411+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93882728370944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acdbd0 con 0x5562c6ab9360 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.412+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93882728370944] v37'157 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.413+0000 7f53b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.413+0000 7f54ff735800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.413+0000 7f54ff735800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.413+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ad8fb0 con 0x5562c6ab9360 2024-09-19T11:14:14.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.414+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.414+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ad8fb0 con 0x5562c6abdd50 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.415+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'19 uv9 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.415+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ad8fb0 con 0x5562c6ac26b0 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.416+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.416+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ad8fb0 con 0x5562c6ab9360 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.417+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'158 uv7 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.417+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ada050 con 0x7f54e406c040 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.418+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'47 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.418+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ad76a0 con 0x5562c6ac26b0 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.419+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.419+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ad76a0 con 0x5562c6ab9360 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.420+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.420+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adabb0 con 0x5562c6abdd50 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.421+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'32 uv4 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.421+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adabb0 con 0x7f54e406c040 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.422+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.422+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adabb0 con 0x5562c6ac26b0 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.423+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'25 uv3 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.423+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb200 con 0x7f54e406c040 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.424+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'48 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.424+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb1e0 con 0x5562c6abdd50 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.425+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.425+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb1b0 con 0x7f54e406c040 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.426+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'19 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.426+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb1b0 con 0x5562c6abdd50 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.427+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'37 uv6 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.428+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb1b0 con 0x5562c6ab9360 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.428+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'159 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.429+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb1f0 con 0x5562c6ac26b0 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.430+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'41 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.430+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb2d0 con 0x7f54e406c040 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.431+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'49 uv13 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.431+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb2d0 con 0x5562c6ac26b0 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.432+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.432+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb400 con 0x5562c6ab9360 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.433+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'27 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.433+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb400 con 0x5562c6ab9360 2024-09-19T11:14:14.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.433+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'160 uv15 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.434+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb400 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.435+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'42 uv9 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.435+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb400 con 0x7f54e406c040 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.436+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'29 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.436+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb440 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.436+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'22 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.437+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb4a0 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.438+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.438+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb4a0 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.438+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'15 uv3 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.438+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb4a0 con 0x5562c6ac26b0 2024-09-19T11:14:14.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.439+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'33 uv10 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.439+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb4e0 con 0x5562c6abdd50 2024-09-19T11:14:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.441+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'21 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.441+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb4e0 con 0x5562c6ac26b0 2024-09-19T11:14:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.442+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'19 uv7 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.442+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb4a0 con 0x5562c6abdd50 2024-09-19T11:14:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.443+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.443+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb4a0 con 0x5562c6ac26b0 2024-09-19T11:14:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.444+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'43 uv11 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.444+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb4e0 con 0x5562c6abdd50 2024-09-19T11:14:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.445+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'38 uv12 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.445+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6adb520 con 0x7f54e406c040 2024-09-19T11:14:14.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.446+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'25 uv5 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.446+0000 7f53b0fe1640 20 reqs_thread_entry: start 2024-09-19T11:14:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.446+0000 7f54ff735800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.447+0000 7f54ff735800 20 Filter name: none 2024-09-19T11:14:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.447+0000 7f532a7fc640 20 reqs_thread_entry: start 2024-09-19T11:14:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.447+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=1 2024-09-19T11:14:14.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.447+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:94 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(94 gc.4 [call] v37'50 uv50 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(95 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:96 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x7f54e406c040 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(96 gc.4 [call out=24b] v0'0 uv50 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:97 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(97 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.448+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.449+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(98 gc.4 [call out=15b] v0'0 uv50 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.449+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.449+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:99 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.450+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(99 gc.4 [call] v37'51 uv51 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.450+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=1 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.450+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:100 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(100 gc.5 [call] v37'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:101 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(101 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:102 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(102 gc.5 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:103 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(103 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:104 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(104 gc.5 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.451+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.452+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:105 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.452+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== osd_op_reply(105 gc.5 [call] v37'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.452+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=1 2024-09-19T11:14:14.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.452+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:106 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.453+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(106 gc.6 [call] v37'22 uv22 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.453+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:107 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(107 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:108 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(108 gc.6 [call out=24b] v0'0 uv22 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:109 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(109 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:110 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(110 gc.6 [call out=15b] v0'0 uv22 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.454+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:111 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.455+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(111 gc.6 [call] v37'23 uv23 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.455+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=1 2024-09-19T11:14:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.455+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:112 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.456+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(112 gc.7 [call] v37'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.456+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:113 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.457+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(113 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.457+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.457+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:114 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6abdd50 2024-09-19T11:14:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.457+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(114 gc.7 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.457+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.457+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.457+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.457+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.458+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(116 gc.7 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.458+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.458+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.459+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(117 gc.7 [call] v37'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.459+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=1 2024-09-19T11:14:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.459+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.460+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 25 ==== osd_op_reply(118 gc.8 [call] v37'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.460+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.460+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 26 ==== osd_op_reply(119 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.460+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.460+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x7f54e406c040 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.460+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 27 ==== osd_op_reply(120 gc.8 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.460+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:121 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.460+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 28 ==== osd_op_reply(121 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.461+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.461+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:122 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.461+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 29 ==== osd_op_reply(122 gc.8 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.461+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.461+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:123 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.462+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 30 ==== osd_op_reply(123 gc.8 [call] v37'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.462+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=1 2024-09-19T11:14:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.462+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:124 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.463+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(124 gc.9 [call] v37'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.463+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:125 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.463+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 34 ==== osd_op_reply(125 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.463+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.463+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:126 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.463+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 35 ==== osd_op_reply(126 gc.9 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.463+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:127 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.464+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 36 ==== osd_op_reply(127 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.464+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.464+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:128 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.464+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 37 ==== osd_op_reply(128 gc.9 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.464+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.464+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:129 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.465+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 38 ==== osd_op_reply(129 gc.9 [call] v37'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.465+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=1 2024-09-19T11:14:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.465+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:130 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 31 ==== osd_op_reply(130 gc.10 [call] v37'52 uv52 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:131 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 32 ==== osd_op_reply(131 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:132 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x7f54e406c040 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 33 ==== osd_op_reply(132 gc.10 [call out=24b] v0'0 uv52 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:133 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 34 ==== osd_op_reply(133 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.466+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:134 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.467+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 35 ==== osd_op_reply(134 gc.10 [call out=15b] v0'0 uv52 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.467+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.467+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:135 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.468+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 36 ==== osd_op_reply(135 gc.10 [call] v37'53 uv53 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.468+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=1 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.468+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:136 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.469+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(136 gc.11 [call] v37'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.469+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:137 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.469+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(137 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.469+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.469+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:138 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6abdd50 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.469+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(138 gc.11 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.469+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:139 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.470+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(139 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.470+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.473 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.470+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:140 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.470+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== osd_op_reply(140 gc.11 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.470+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.470+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:141 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.471+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(141 gc.11 [call] v37'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.471+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=1 2024-09-19T11:14:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.471+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:142 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.472+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 37 ==== osd_op_reply(142 gc.12 [call] v37'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.472+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:143 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.472+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 38 ==== osd_op_reply(143 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.472+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.472+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:144 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x7f54e406c040 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.472+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 39 ==== osd_op_reply(144 gc.12 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.472+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:145 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.472+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 40 ==== osd_op_reply(145 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.473+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.473+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:146 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.473+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 41 ==== osd_op_reply(146 gc.12 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.473+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.473+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:147 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.474+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 42 ==== osd_op_reply(147 gc.12 [call] v37'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.474+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=1 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.474+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:148 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.475+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(148 gc.13 [call] v37'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.475+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:149 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.475+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== osd_op_reply(149 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.475+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.475+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:150 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6abdd50 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.475+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(150 gc.13 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.475+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:151 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.476+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(151 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.476+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.476+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:152 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.476+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== osd_op_reply(152 gc.13 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.476+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.476+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:153 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.477+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 41 ==== osd_op_reply(153 gc.13 [call] v37'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.477+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=1 2024-09-19T11:14:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.477+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:154 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(154 gc.14 [call] v37'161 uv161 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:155 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(155 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:156 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(156 gc.14 [call out=24b] v0'0 uv161 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:157 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(157 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.478+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.479+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:158 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.479+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(158 gc.14 [call out=15b] v0'0 uv161 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.479+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.479+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:159 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.480+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(159 gc.14 [call] v37'162 uv162 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.480+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=1 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.480+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:160 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 39 ==== osd_op_reply(160 gc.15 [call] v37'44 uv44 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:161 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 40 ==== osd_op_reply(161 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:162 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 41 ==== osd_op_reply(162 gc.15 [call out=24b] v0'0 uv44 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:163 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 42 ==== osd_op_reply(163 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.481+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:164 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.482+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 43 ==== osd_op_reply(164 gc.15 [call out=15b] v0'0 uv44 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.482+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.482+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:165 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.483+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 44 ==== osd_op_reply(165 gc.15 [call] v37'45 uv45 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.483+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=1 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.483+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:166 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 43 ==== osd_op_reply(166 gc.16 [call] v37'54 uv54 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:167 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 44 ==== osd_op_reply(167 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:168 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x7f54e406c040 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 45 ==== osd_op_reply(168 gc.16 [call out=24b] v0'0 uv54 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:169 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 46 ==== osd_op_reply(169 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.484+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.485+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:170 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.485+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 47 ==== osd_op_reply(170 gc.16 [call out=15b] v0'0 uv54 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.485+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.485+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:171 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.486+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 48 ==== osd_op_reply(171 gc.16 [call] v37'55 uv55 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.486+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=1 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.486+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:172 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.487+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 45 ==== osd_op_reply(172 gc.17 [call] v37'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.487+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:173 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.487+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 46 ==== osd_op_reply(173 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.487+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.487+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:174 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.487+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 47 ==== osd_op_reply(174 gc.17 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.487+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:175 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.488+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 48 ==== osd_op_reply(175 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.488+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.488+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:176 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.488+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 49 ==== osd_op_reply(176 gc.17 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.488+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.488+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:177 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.489+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 50 ==== osd_op_reply(177 gc.17 [call] v37'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.489+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=1 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.489+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:178 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.490+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(178 gc.18 [call] v37'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.490+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:179 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.490+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== osd_op_reply(179 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.490+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.490+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:180 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.490+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(180 gc.18 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.490+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:181 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.491+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== osd_op_reply(181 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.491+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.491+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:182 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.491+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 43 ==== osd_op_reply(182 gc.18 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.494 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.491+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.491+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:183 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.492+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 44 ==== osd_op_reply(183 gc.18 [call] v37'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.492+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=1 2024-09-19T11:14:14.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.492+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:184 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.493+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 45 ==== osd_op_reply(184 gc.19 [call] v37'163 uv163 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.493+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:185 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.493+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 46 ==== osd_op_reply(185 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.493+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.493+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:186 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.494+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 47 ==== osd_op_reply(186 gc.19 [call out=24b] v0'0 uv163 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.494+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:187 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.494+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 48 ==== osd_op_reply(187 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.494+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.494+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:188 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.494+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 49 ==== osd_op_reply(188 gc.19 [call out=15b] v0'0 uv163 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.494+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.494+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:189 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ab9360 2024-09-19T11:14:14.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.495+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 50 ==== osd_op_reply(189 gc.19 [call] v37'164 uv164 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.495+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=1 2024-09-19T11:14:14.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.495+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:190 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.496+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 51 ==== osd_op_reply(190 gc.20 [call] v37'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.496+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:191 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 52 ==== osd_op_reply(191 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:192 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 53 ==== osd_op_reply(192 gc.20 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:193 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 54 ==== osd_op_reply(193 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:194 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 55 ==== osd_op_reply(194 gc.20 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.497+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:195 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.498+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 56 ==== osd_op_reply(195 gc.20 [call] v37'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.498+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=1 2024-09-19T11:14:14.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.498+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:196 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.499+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 49 ==== osd_op_reply(196 gc.21 [call] v37'30 uv30 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.499+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:197 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.499+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 50 ==== osd_op_reply(197 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.499+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.499+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:198 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x7f54e406c040 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.500+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 51 ==== osd_op_reply(198 gc.21 [call out=24b] v0'0 uv30 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.500+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:199 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.500+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 52 ==== osd_op_reply(199 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.504 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.500+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.500+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:200 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.500+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 53 ==== osd_op_reply(200 gc.21 [call out=15b] v0'0 uv30 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.500+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.500+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:201 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x7f54e406c040 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.501+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 54 ==== osd_op_reply(201 gc.21 [call] v37'31 uv31 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.501+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=1 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.501+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:202 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.502+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 57 ==== osd_op_reply(202 gc.22 [call] v37'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.502+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:203 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.502+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 58 ==== osd_op_reply(203 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.502+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.502+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:204 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.505 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.502+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 59 ==== osd_op_reply(204 gc.22 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.502+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:205 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.502+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 60 ==== osd_op_reply(205 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.503+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.503+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:206 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.503+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 61 ==== osd_op_reply(206 gc.22 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.503+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.506 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.503+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:207 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.504+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 62 ==== osd_op_reply(207 gc.22 [call] v37'24 uv24 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.504+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=1 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.504+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:208 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 63 ==== osd_op_reply(208 gc.23 [call] v37'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:209 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 64 ==== osd_op_reply(209 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:210 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 65 ==== osd_op_reply(210 gc.23 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:211 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 66 ==== osd_op_reply(211 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.505+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:212 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.506+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 67 ==== osd_op_reply(212 gc.23 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.506+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.506+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:213 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.506+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 68 ==== osd_op_reply(213 gc.23 [call] v37'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.507+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=1 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.507+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:214 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.507+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 69 ==== osd_op_reply(214 gc.24 [call] v37'16 uv16 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:215 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 70 ==== osd_op_reply(215 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:216 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 71 ==== osd_op_reply(216 gc.24 [call out=24b] v0'0 uv16 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:217 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 72 ==== osd_op_reply(217 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:218 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 73 ==== osd_op_reply(218 gc.24 [call out=15b] v0'0 uv16 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.508+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:219 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.509+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 74 ==== osd_op_reply(219 gc.24 [call] v37'17 uv17 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.509+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=1 2024-09-19T11:14:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.509+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:220 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.510+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 75 ==== osd_op_reply(220 gc.25 [call] v37'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.510+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:221 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.510+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 76 ==== osd_op_reply(221 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.510+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.510+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:222 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.511+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 77 ==== osd_op_reply(222 gc.25 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.511+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:223 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.511+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 78 ==== osd_op_reply(223 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.511+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.511+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:224 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.511+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 79 ==== osd_op_reply(224 gc.25 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.511+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.511+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:225 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.512+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 80 ==== osd_op_reply(225 gc.25 [call] v37'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.512+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=1 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.512+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:226 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.513+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 42 ==== osd_op_reply(226 gc.26 [call] v37'22 uv22 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.513+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:227 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.513+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 43 ==== osd_op_reply(227 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.513+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.513+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:228 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6abdd50 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.514+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 44 ==== osd_op_reply(228 gc.26 [call out=24b] v0'0 uv22 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.514+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:229 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.514+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 45 ==== osd_op_reply(229 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.514+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.514+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:230 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.514+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 46 ==== osd_op_reply(230 gc.26 [call out=15b] v0'0 uv22 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.514+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.514+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:231 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.515+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 47 ==== osd_op_reply(231 gc.26 [call] v37'23 uv23 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.515+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=1 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.515+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:232 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.516+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 81 ==== osd_op_reply(232 gc.27 [call] v37'20 uv20 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.516+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:233 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.516+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 82 ==== osd_op_reply(233 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.516+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.516+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:234 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.517+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 83 ==== osd_op_reply(234 gc.27 [call out=24b] v0'0 uv20 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.517+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:235 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.517+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 84 ==== osd_op_reply(235 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.517+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.517+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:236 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.517+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 85 ==== osd_op_reply(236 gc.27 [call out=15b] v0'0 uv20 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.517+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.517+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:237 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6ac26b0 2024-09-19T11:14:14.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.518+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 86 ==== osd_op_reply(237 gc.27 [call] v37'21 uv21 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.518+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=1 2024-09-19T11:14:14.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.518+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:238 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.519+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 48 ==== osd_op_reply(238 gc.28 [call] v37'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.519+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:239 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.519+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 49 ==== osd_op_reply(239 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.519+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.519+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:240 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b06480 con 0x5562c6abdd50 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.519+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 50 ==== osd_op_reply(240 gc.28 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.519+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:241 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 51 ==== osd_op_reply(241 gc.28 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:242 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b07490 con 0x5562c6abdd50 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 52 ==== osd_op_reply(242 gc.28 [call out=1702b] v0'0 uv36 ondisk = 0) ==== 149+0+1702 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 20 garbage collection: RGWGC::process iterating over entry tag='32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.17861135777741520214', time=2024-09-19T11:14:14.102568+0000, chain.objs.size()=7 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_1 2024-09-19T11:14:14.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:243 3.1as0 3:5a500c47:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05770 con 0x5562c6ab9360 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_2 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:244 3.4s0 3:20e7ea33:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0a6f0 con 0x5562c6abdd50 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_3 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:245 3.36s0 3:6f6048da:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0d030 con 0x7f54e406c040 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_4 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:246 3.33s0 3:cdde11e9:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_5 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:247 3.17s0 3:e8192370:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0a6f0 con 0x5562c6ab9360 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_6 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:248 3.1s0 3:83b870e1:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_7 2024-09-19T11:14:14.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.520+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:249 3.6s0 3:631951b5:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b16ef0 con 0x5562c6ab9360 2024-09-19T11:14:14.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.522+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 53 ==== osd_op_reply(244 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_2 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.523+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 51 ==== osd_op_reply(243 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_1 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.523+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 54 ==== osd_op_reply(248 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_6 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.524+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 55 ==== osd_op_reply(246 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_4 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.525+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 52 ==== osd_op_reply(249 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_7 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.525+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 53 ==== osd_op_reply(247 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_5 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.525+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 55 ==== osd_op_reply(245 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1__shadow_.w8tC6eiZwx21LrnRwxUacxCuCb5en-n_3 [call] v37'2 uv2 ondisk = 0) ==== 230+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.525+0000 7f54ff735800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T11:14:14.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.525+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:250 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.529+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 56 ==== osd_op_reply(250 gc.28 [call] v37'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.530 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.529+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:251 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.532+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 57 ==== osd_op_reply(251 gc.28 [call] v37'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.532+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=1 2024-09-19T11:14:14.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.532+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:252 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6ac26b0 2024-09-19T11:14:14.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.533+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 87 ==== osd_op_reply(252 gc.29 [call] v37'48 uv48 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.533+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:253 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6ac26b0 2024-09-19T11:14:14.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.533+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 88 ==== osd_op_reply(253 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.533+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.533+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:254 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6ac26b0 2024-09-19T11:14:14.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.534+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 89 ==== osd_op_reply(254 gc.29 [call out=24b] v0'0 uv48 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.534+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:255 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6ac26b0 2024-09-19T11:14:14.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.534+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 90 ==== osd_op_reply(255 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.534+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.534+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:256 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6ac26b0 2024-09-19T11:14:14.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.534+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 91 ==== osd_op_reply(256 gc.29 [call out=15b] v0'0 uv48 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.534+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.534+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:257 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6ac26b0 2024-09-19T11:14:14.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.535+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 92 ==== osd_op_reply(257 gc.29 [call] v37'49 uv49 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.535+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=1 2024-09-19T11:14:14.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.535+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:258 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.537+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 58 ==== osd_op_reply(258 gc.30 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.537+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:259 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.537+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 59 ==== osd_op_reply(259 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.537+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.537+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:260 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.537+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 60 ==== osd_op_reply(260 gc.30 [call out=24b] v0'0 uv41 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.537+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:261 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.538+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 61 ==== osd_op_reply(261 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.538+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.538+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:262 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0fa60 con 0x5562c6abdd50 2024-09-19T11:14:14.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.538+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 62 ==== osd_op_reply(262 gc.30 [call out=15b] v0'0 uv41 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.538+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.538+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:263 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6abdd50 2024-09-19T11:14:14.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.539+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 63 ==== osd_op_reply(263 gc.30 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.539+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=1 2024-09-19T11:14:14.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.539+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:264 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x7f54e406c040 2024-09-19T11:14:14.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.540+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 56 ==== osd_op_reply(264 gc.31 [call] v37'26 uv26 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.540+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:265 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b11a80 con 0x7f54e406c040 2024-09-19T11:14:14.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.540+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 57 ==== osd_op_reply(265 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.540+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.540+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:266 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b10a70 con 0x7f54e406c040 2024-09-19T11:14:14.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.541+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 58 ==== osd_op_reply(266 gc.31 [call out=24b] v0'0 uv26 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.541+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:267 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b11a80 con 0x7f54e406c040 2024-09-19T11:14:14.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.541+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 59 ==== osd_op_reply(267 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.541+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.541+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:268 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x7f54e406c040 2024-09-19T11:14:14.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.541+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 60 ==== osd_op_reply(268 gc.31 [call out=15b] v0'0 uv26 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.541+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.541+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:269 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x7f54e406c040 2024-09-19T11:14:14.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.543+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 61 ==== osd_op_reply(269 gc.31 [call] v37'27 uv27 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.543+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=1 2024-09-19T11:14:14.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.543+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:270 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6ab9360 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 54 ==== osd_op_reply(270 gc.0 [call] v37'26 uv26 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:271 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6ab9360 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 55 ==== osd_op_reply(271 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:272 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0bb20 con 0x5562c6ab9360 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 56 ==== osd_op_reply(272 gc.0 [call out=24b] v0'0 uv26 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:273 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6ab9360 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 57 ==== osd_op_reply(273 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.544+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.545+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:274 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6ab9360 2024-09-19T11:14:14.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.545+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 58 ==== osd_op_reply(274 gc.0 [call out=15b] v0'0 uv26 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.545+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.545+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:275 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6ab9360 2024-09-19T11:14:14.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.546+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 59 ==== osd_op_reply(275 gc.0 [call] v37'27 uv27 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.546+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=1 2024-09-19T11:14:14.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.546+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:276 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6abdd50 2024-09-19T11:14:14.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 64 ==== osd_op_reply(276 gc.1 [call] v37'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:277 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6abdd50 2024-09-19T11:14:14.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 65 ==== osd_op_reply(277 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:278 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0bb20 con 0x5562c6abdd50 2024-09-19T11:14:14.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 66 ==== osd_op_reply(278 gc.1 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:279 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6abdd50 2024-09-19T11:14:14.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 67 ==== osd_op_reply(279 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.547+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:280 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6abdd50 2024-09-19T11:14:14.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.548+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 68 ==== osd_op_reply(280 gc.1 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.548+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.548+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:281 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6abdd50 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.549+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 69 ==== osd_op_reply(281 gc.1 [call] v37'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.549+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=1 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.549+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:282 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b05160 con 0x5562c6ac26b0 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.550+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 93 ==== osd_op_reply(282 gc.2 [call] v37'20 uv20 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.550+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:283 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0ca20 con 0x5562c6ac26b0 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.550+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 94 ==== osd_op_reply(283 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.550+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.550+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:284 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0ba10 con 0x5562c6ac26b0 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.550+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 95 ==== osd_op_reply(284 gc.2 [call out=24b] v0'0 uv20 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.550+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:285 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0ba10 con 0x5562c6ac26b0 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.551+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 96 ==== osd_op_reply(285 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.551+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.551+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:286 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0ba10 con 0x5562c6ac26b0 2024-09-19T11:14:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.551+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 97 ==== osd_op_reply(286 gc.2 [call out=15b] v0'0 uv20 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.551+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.551+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:287 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0ba10 con 0x5562c6ac26b0 2024-09-19T11:14:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.552+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 98 ==== osd_op_reply(287 gc.2 [call] v37'21 uv21 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.552+0000 7f54ff735800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=1 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.552+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:288 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0ba10 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 60 ==== osd_op_reply(288 gc.3 [call] v37'165 uv165 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:289 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0ba10 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 61 ==== osd_op_reply(289 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:290 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0aa00 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 62 ==== osd_op_reply(290 gc.3 [call out=24b] v0'0 uv165 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:291 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0aa00 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 63 ==== osd_op_reply(291 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.553+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:292 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0aa00 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.554+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 64 ==== osd_op_reply(292 gc.3 [call out=15b] v0'0 uv165 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.554+0000 7f54ff735800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:14:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.554+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:293 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6b0ba10 con 0x5562c6ab9360 2024-09-19T11:14:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.554+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 65 ==== osd_op_reply(293 gc.3 [call] v37'166 uv166 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.555+0000 7f53b1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:14.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.555+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93882728370944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ad66b0 con 0x5562c6ab9360 2024-09-19T11:14:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.556+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 66 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 93882728370944] v37'167 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.556+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93882728344144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acd300 con 0x7f54e406c040 2024-09-19T11:14:14.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.557+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 93882728344144] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.557+0000 7f54ff735800 20 remove_watcher() i=0 2024-09-19T11:14:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.557+0000 7f54ff735800 2 removed watcher, disabling cache 2024-09-19T11:14:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.557+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93882728348816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acd300 con 0x5562c6ab9360 2024-09-19T11:14:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.558+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 67 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 93882728348816] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.558+0000 7f54ff735800 20 remove_watcher() i=1 2024-09-19T11:14:14.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.559+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93882728341664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acd300 con 0x5562c6ac26b0 2024-09-19T11:14:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.560+0000 7f54f3fff640 1 -- 172.21.15.102:0/3093617942 <== osd.3 v2:172.21.15.102:6800/3957239017 99 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 93882728341664] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54e4051070 con 0x5562c6ac26b0 2024-09-19T11:14:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.560+0000 7f54ff735800 20 remove_watcher() i=2 2024-09-19T11:14:14.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.560+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93882728355920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac60a0 con 0x7f54e406c040 2024-09-19T11:14:14.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.561+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.2 v2:172.21.15.102:6808/525557096 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 93882728355920] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x7f54e406c040 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.561+0000 7f54ff735800 20 remove_watcher() i=3 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.561+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93882728358816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acd300 con 0x5562c6ab9360 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.562+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 <== osd.1 v2:172.21.15.102:6816/3609322588 68 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 93882728358816] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54f400a4d0 con 0x5562c6ab9360 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.562+0000 7f54ff735800 20 remove_watcher() i=4 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.562+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93882728362752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac9850 con 0x5562c6abdd50 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.563+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 70 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 93882728362752] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.563+0000 7f54ff735800 20 remove_watcher() i=5 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.563+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93882728366416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6ac60a0 con 0x5562c6abdd50 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.564+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 71 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 93882728366416] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.564+0000 7f54ff735800 20 remove_watcher() i=6 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.564+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93882728368544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5562c6acd300 con 0x5562c6abdd50 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54fb47d640 1 -- 172.21.15.102:0/3093617942 <== osd.0 v2:172.21.15.37:6800/394652614 72 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 93882728368544] v37'164 uv162 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f54ec01ad50 con 0x5562c6abdd50 2024-09-19T11:14:14.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 20 remove_watcher() i=7 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6abdd50 msgr2=0x5562c6ac0140 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6abdd50 0x5562c6ac0140 crc :-1 s=READY pgs=116 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6ab9360 msgr2=0x5562c6abb820 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6ab9360 0x5562c6abb820 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f54e406c040 msgr2=0x7f54e405f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f54e406c040 0x7f54e405f420 crc :-1 s=READY pgs=64 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6ac26b0 msgr2=0x5562c6ac4b70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6ac26b0 0x5562c6ac4b70 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53c403d000 msgr2=0x7f53c403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53c403d000 0x7f53c403f4c0 secure :-1 s=READY pgs=220 cs=0 l=1 rev1=1 crypto rx=0x7f54e40539f0 tx=0x7f54e4053000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 msgr2=0x5562c6aade00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54fbc7e640 1 -- 172.21.15.102:0/3093617942 reap_dead start 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aade00 secure :-1 s=READY pgs=534 cs=0 l=1 rev1=1 crypto rx=0x7f54ec01b220 tx=0x7f54ec041f90 comp rx=0 tx=0).stop 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 shutdown_connections 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 --2- 172.21.15.102:0/3093617942 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6aa69f0 0x5562c6aade00 unknown :-1 s=CLOSED pgs=534 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 >> 172.21.15.102:0/3093617942 conn(0x5562c6aa2df0 msgr2=0x5562c6aa1000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 shutdown_connections 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.565+0000 7f54ff735800 1 -- 172.21.15.102:0/3093617942 wait complete. 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/805421319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53d403cf60 msgr2=0x7f53d403f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/805421319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53d403cf60 0x7f53d403f420 secure :-1 s=READY pgs=219 cs=0 l=1 rev1=1 crypto rx=0x5562c6a88800 tx=0x7f54e4005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/805421319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6a9a130 msgr2=0x5562c6a9a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/805421319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6a9a130 0x5562c6a9a550 secure :-1 s=READY pgs=532 cs=0 l=1 rev1=1 crypto rx=0x7f54ec052b00 tx=0x7f54ec03ff80 comp rx=0 tx=0).stop 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/805421319 shutdown_connections 2024-09-19T11:14:14.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/805421319 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53d403cf60 0x7f53d403f420 unknown :-1 s=CLOSED pgs=219 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/805421319 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6a9a130 0x5562c6a9a550 unknown :-1 s=CLOSED pgs=532 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/805421319 >> 172.21.15.102:0/805421319 conn(0x5562c6a8e4e0 msgr2=0x5562c6a8e8c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/805421319 shutdown_connections 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/805421319 wait complete. 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6a85860 msgr2=0x5562c6a87cd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5562c6a85860 0x5562c6a87cd0 crc :-1 s=READY pgs=115 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6985b50 msgr2=0x5562c6a83440 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5562c6985b50 0x5562c6a83440 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6a898c0 msgr2=0x5562c6a8bcb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5562c6a898c0 0x5562c6a8bcb0 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53e003cfb0 msgr2=0x7f53e003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f53e003cfb0 0x7f53e003f470 secure :-1 s=READY pgs=218 cs=0 l=1 rev1=1 crypto rx=0x7f54e4057000 tx=0x7f54e4052000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 msgr2=0x5562c6a7bdf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 --2- 172.21.15.102:0/1760301869 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5562c6984880 0x5562c6a7bdf0 secure :-1 s=READY pgs=531 cs=0 l=1 rev1=1 crypto rx=0x5562c6a75260 tx=0x7f54ec000bc0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54fbc7e640 1 -- 172.21.15.102:0/1760301869 reap_dead start 2024-09-19T11:14:14.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 shutdown_connections 2024-09-19T11:14:14.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 >> 172.21.15.102:0/1760301869 conn(0x5562c697fc50 msgr2=0x5562c6a757c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 shutdown_connections 2024-09-19T11:14:14.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.566+0000 7f54ff735800 1 -- 172.21.15.102:0/1760301869 wait complete. 2024-09-19T11:14:14.576 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'list', '--include-all'] 2024-09-19T11:14:14.576 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'list', '--include-all'] 2024-09-19T11:14:14.576 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc list --include-all 2024-09-19T11:14:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:14.659 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.659+0000 7f4be132e800 1 Processor -- start 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.659+0000 7f4be132e800 1 -- start start 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.659+0000 7f4be132e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559c7bf5ca20 0x559c7bf5ce20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.659+0000 7f4be132e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559c7bf5e7c0 con 0x559c7bf5d360 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.659+0000 7f4be132e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x559c7be737d0 con 0x559c7bf5ca20 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.659+0000 7f4bdd0dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559c7bf5ca20 0x559c7bf5ce20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.660+0000 7f4bdd0dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559c7bf5ca20 0x559c7bf5ce20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37944/0 (socket says 172.21.15.102:37944) 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.660+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/779203773 learned_addr learned my addr 172.21.15.102:0/779203773 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.661 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.660+0000 7f4bd7fff640 1 --1- 172.21.15.102:0/779203773 >> v1:172.21.15.37:6789/0 conn(0x559c7bf5d360 0x559c7bff0380 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36792/0 (socket says 172.21.15.102:36792) 2024-09-19T11:14:14.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.660+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/779203773 >> v1:172.21.15.37:6789/0 conn(0x559c7bf5d360 legacy=0x559c7bff0380 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.662 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.660+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/779203773 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7bff2ab0 con 0x559c7bf5ca20 2024-09-19T11:14:14.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/779203773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7bf5ce20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000a520 tx=0x7f4bd0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c764876d945f8b2b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4bdc8dc640 1 -- 172.21.15.102:0/779203773 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd0055070 con 0x559c7bf5ca20 2024-09-19T11:14:14.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4bdc8dc640 1 -- 172.21.15.102:0/779203773 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd00515b0 con 0x559c7bf5ca20 2024-09-19T11:14:14.663 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4bdc8dc640 1 -- 172.21.15.102:0/779203773 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd00518d0 con 0x559c7bf5ca20 2024-09-19T11:14:14.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4be132e800 1 -- 172.21.15.102:0/779203773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 msgr2=0x559c7bf5ce20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4be132e800 1 --2- 172.21.15.102:0/779203773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7bf5ce20 secure :-1 s=READY pgs=536 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000a520 tx=0x7f4bd0045ba0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4be132e800 1 -- 172.21.15.102:0/779203773 shutdown_connections 2024-09-19T11:14:14.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4be132e800 1 --2- 172.21.15.102:0/779203773 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7bf5ce20 unknown :-1 s=CLOSED pgs=536 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4be132e800 1 -- 172.21.15.102:0/779203773 >> 172.21.15.102:0/779203773 conn(0x559c7bfe3c60 msgr2=0x559c7bfe60c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4be132e800 1 -- 172.21.15.102:0/779203773 shutdown_connections 2024-09-19T11:14:14.664 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.662+0000 7f4be132e800 1 -- 172.21.15.102:0/779203773 wait complete. 2024-09-19T11:14:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.676+0000 7f4be132e800 1 Processor -- start 2024-09-19T11:14:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.676+0000 7f4be132e800 1 -- start start 2024-09-19T11:14:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.676+0000 7f4be132e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0da4c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.676+0000 7f4be132e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c7be80dd0 con 0x559c7bf5ca20 2024-09-19T11:14:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.677+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0da4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.677+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0da4c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37946/0 (socket says 172.21.15.102:37946) 2024-09-19T11:14:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.677+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/804825384 learned_addr learned my addr 172.21.15.102:0/804825384 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.677+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/804825384 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7c0daab0 con 0x559c7bf5ca20 2024-09-19T11:14:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.677+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/804825384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0da4c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000a4f0 tx=0x7f4bd0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc272c348ef50693 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.677+0000 7f4acb606640 1 -- 172.21.15.102:0/804825384 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd0051950 con 0x559c7bf5ca20 2024-09-19T11:14:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.677+0000 7f4acb606640 1 -- 172.21.15.102:0/804825384 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd0051af0 con 0x559c7bf5ca20 2024-09-19T11:14:14.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.677+0000 7f4acb606640 1 -- 172.21.15.102:0/804825384 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd0051dd0 con 0x559c7bf5ca20 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 -- 172.21.15.102:0/804825384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 msgr2=0x559c7c0da4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 --2- 172.21.15.102:0/804825384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0da4c0 secure :-1 s=READY pgs=537 cs=0 l=1 rev1=1 crypto rx=0x7f4bd000a4f0 tx=0x7f4bd0051000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 -- 172.21.15.102:0/804825384 shutdown_connections 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 --2- 172.21.15.102:0/804825384 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0da4c0 unknown :-1 s=CLOSED pgs=537 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 -- 172.21.15.102:0/804825384 >> 172.21.15.102:0/804825384 conn(0x559c7bfe3c60 msgr2=0x559c7c0d5e40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 -- 172.21.15.102:0/804825384 shutdown_connections 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 -- 172.21.15.102:0/804825384 wait complete. 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 Processor -- start 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.678+0000 7f4be132e800 1 -- start start 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4be132e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0e1eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4be132e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c7bff1da0 con 0x559c7bf5ca20 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0e1eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0e1eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37948/0 (socket says 172.21.15.102:37948) 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/2264369910 learned_addr learned my addr 172.21.15.102:0/2264369910 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/2264369910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7c0e2410 con 0x559c7bf5ca20 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0e1eb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0025da0 tx=0x7f4bd0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4ac9e03640 1 -- 172.21.15.102:0/2264369910 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd0073020 con 0x559c7bf5ca20 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4ac9e03640 1 -- 172.21.15.102:0/2264369910 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd006f580 con 0x559c7bf5ca20 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c7c0e26a0 con 0x559c7bf5ca20 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4ac9e03640 1 -- 172.21.15.102:0/2264369910 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd006f860 con 0x559c7bf5ca20 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.679+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7c0e32b0 con 0x559c7bf5ca20 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.680+0000 7f4ac9e03640 1 -- 172.21.15.102:0/2264369910 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4bd0076020 con 0x559c7bf5ca20 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.680+0000 7f4ac9e03640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac403d000 0x7f4ac403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.680+0000 7f4ac9e03640 1 -- 172.21.15.102:0/2264369910 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4bd006b040 con 0x559c7bf5ca20 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.680+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac403d000 0x7f4ac403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.681+0000 7f4be132e800 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7bf5d360 0x559c7c0e9500 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.681+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c0e9a40 con 0x559c7bf5d360 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.681+0000 7f4bdd8de640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7bf5d360 0x559c7c0e9500 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.681+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac403d000 0x7f4ac403f4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8001e30 tx=0x7f4bc8001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.681+0000 7f4bdd8de640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7bf5d360 0x559c7c0e9500 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.681+0000 7f4bdd8de640 1 -- 172.21.15.102:0/2264369910 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7bf5d360 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.681+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c0e9de0 con 0x559c7bf5d360 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.682+0000 7f4bdd8de640 1 -- 172.21.15.102:0/2264369910 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7bf5d360 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.682+0000 7f4be132e800 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c0eb920 0x559c7c0edda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.682+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c0ee530 con 0x559c7c0eb920 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.682+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c0eb920 0x559c7c0edda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.686 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.682+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c0eb920 0x559c7c0edda0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.682+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/2264369910 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4bd0057030 con 0x559c7c0eb920 2024-09-19T11:14:14.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.682+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c0ea630 con 0x559c7bf5d360 2024-09-19T11:14:14.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.683+0000 7f4bdd8de640 1 -- 172.21.15.102:0/2264369910 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7bf5d360 2024-09-19T11:14:14.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.683+0000 7f4be132e800 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c0ef990 0x559c7c0f1d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.683+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c0f24c0 con 0x559c7c0ef990 2024-09-19T11:14:14.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.683+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c0ef990 0x559c7c0f1d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.687 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.683+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c0ef990 0x559c7c0f1d80 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.683+0000 7f4bd7fff640 1 -- 172.21.15.102:0/2264369910 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4bc800bd50 con 0x559c7c0ef990 2024-09-19T11:14:14.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4be132e800 1 Processor -- start 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4be132e800 1 -- start start 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4be132e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c100200 0x559c7c100620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4be132e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c7bedf4a0 con 0x559c7c100200 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c100200 0x559c7c100620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c100200 0x559c7c100620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37954/0 (socket says 172.21.15.102:37954) 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/1939344703 learned_addr learned my addr 172.21.15.102:0/1939344703 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/1939344703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7c100c60 con 0x559c7c100200 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.684+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/1939344703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c100200 0x559c7c100620 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0096780 tx=0x7f4bd006fdd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.685+0000 7f4ac2ffd640 1 -- 172.21.15.102:0/1939344703 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd00644e0 con 0x559c7c100200 2024-09-19T11:14:14.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.685+0000 7f4ac2ffd640 1 -- 172.21.15.102:0/1939344703 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd0088070 con 0x559c7c100200 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.685+0000 7f4be132e800 1 -- 172.21.15.102:0/1939344703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c7c101490 con 0x559c7c100200 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.685+0000 7f4ac2ffd640 1 -- 172.21.15.102:0/1939344703 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd005a580 con 0x559c7c100200 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.685+0000 7f4be132e800 1 -- 172.21.15.102:0/1939344703 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7c101a30 con 0x559c7c100200 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.685+0000 7f4ac2ffd640 1 -- 172.21.15.102:0/1939344703 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4bd008a020 con 0x559c7c100200 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4ac2ffd640 1 --2- 172.21.15.102:0/1939344703 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ab403d000 0x7f4ab403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4ac2ffd640 1 -- 172.21.15.102:0/1939344703 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4bd0062070 con 0x559c7c100200 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/1939344703 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ab403d000 0x7f4ab403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4be132e800 1 Processor -- start 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4be132e800 1 -- start start 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/1939344703 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ab403d000 0x7f4ab403f4c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559c7c0ee8d0 tx=0x7f4bc800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4be132e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c10cea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4be132e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c7c0dae20 con 0x559c7c10caa0 2024-09-19T11:14:14.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c10cea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c10cea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37970/0 (socket says 172.21.15.102:37970) 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.686+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/1291695954 learned_addr learned my addr 172.21.15.102:0/1291695954 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/1291695954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7c10d490 con 0x559c7c10caa0 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/1291695954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c10cea0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0084f10 tx=0x7f4bd008f420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b00de371ff6add6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4ac0ff9640 1 -- 172.21.15.102:0/1291695954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd0097c70 con 0x559c7c10caa0 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4ac0ff9640 1 -- 172.21.15.102:0/1291695954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd00ac070 con 0x559c7c10caa0 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4ac0ff9640 1 -- 172.21.15.102:0/1291695954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd0077b30 con 0x559c7c10caa0 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4be132e800 1 -- 172.21.15.102:0/1291695954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 msgr2=0x559c7c10cea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4be132e800 1 --2- 172.21.15.102:0/1291695954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c10cea0 secure :-1 s=READY pgs=540 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0084f10 tx=0x7f4bd008f420 comp rx=0 tx=0).stop 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4be132e800 1 -- 172.21.15.102:0/1291695954 shutdown_connections 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4be132e800 1 --2- 172.21.15.102:0/1291695954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c10cea0 unknown :-1 s=CLOSED pgs=540 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4be132e800 1 -- 172.21.15.102:0/1291695954 >> 172.21.15.102:0/1291695954 conn(0x559c7c108ea0 msgr2=0x559c7c1070e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4be132e800 1 -- 172.21.15.102:0/1291695954 shutdown_connections 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.687+0000 7f4be132e800 1 -- 172.21.15.102:0/1291695954 wait complete. 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.688+0000 7f4be132e800 1 Processor -- start 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.688+0000 7f4be132e800 1 -- start start 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.688+0000 7f4be132e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c113ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.688+0000 7f4be132e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559c7c10d900 con 0x559c7c10caa0 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.688+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c113ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.688+0000 7f4bdd0dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c113ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37978/0 (socket says 172.21.15.102:37978) 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.688+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 learned_addr learned my addr 172.21.15.102:0/4271302409 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.688+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559c7c114400 con 0x559c7c10caa0 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.689+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c113ea0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0050710 tx=0x7f4bd0064680 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.689+0000 7f4ab2ffd640 1 -- 172.21.15.102:0/4271302409 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd005ddd0 con 0x559c7c10caa0 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.689+0000 7f4ab2ffd640 1 -- 172.21.15.102:0/4271302409 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4bd008f550 con 0x559c7c10caa0 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.689+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559c7c114400 con 0x559c7c10caa0 2024-09-19T11:14:14.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.689+0000 7f4ab2ffd640 1 -- 172.21.15.102:0/4271302409 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4bd008f830 con 0x559c7c10caa0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.689+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559c7c114400 con 0x559c7c10caa0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.690+0000 7f4ab2ffd640 1 -- 172.21.15.102:0/4271302409 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4bd0058070 con 0x559c7c10caa0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.690+0000 7f4ab2ffd640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4aa803d000 0x7f4aa803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.690+0000 7f4ab2ffd640 1 -- 172.21.15.102:0/4271302409 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4bd00bdd60 con 0x559c7c10caa0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.690+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.690+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4aa803d000 0x7f4aa803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.690+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7c11f300 0x559c7c121790 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.690+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c121ee0 con 0x559c7c11f300 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.690+0000 7f4bdd8de640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7c11f300 0x559c7c121790 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4aa803d000 0x7f4aa803f4c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x559c7c0f28a0 tx=0x7f4bc8010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4bdd8de640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7c11f300 0x559c7c121790 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 20 realm 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c1222f0 con 0x559c7c11f300 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122bc0 con 0x559c7c11f300 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.691+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4be132e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c123a50 0x559c7c125e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c126580 con 0x559c7c123a50 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c123a50 0x559c7c125e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4bdd0dd640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c123a50 0x559c7c125e40 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4be132e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4be132e800 20 searching for the correct realm 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c128620 0x559c7c12aae0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.692+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12b1b0 con 0x559c7c128620 2024-09-19T11:14:14.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.693+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c128620 0x559c7c12aae0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.693+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c128620 0x559c7c12aae0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.693+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bc8037040 con 0x559c7c128620 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.693+0000 7f4bd7fff640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4bc800f070 0x7f4bc802e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.693+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12b1b0 con 0x7f4bc800f070 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.693+0000 7f4bdd8de640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4bc800f070 0x7f4bc802e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.693+0000 7f4bdd8de640 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4bc800f070 0x7f4bc802e910 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.694+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.694+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c123a50 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.694+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.694+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.694+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.694+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.694+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.694+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c123a50 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.695+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.695+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c123a50 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.695+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.695+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x7f4bc800f070 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.695+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.695+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c128620 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.695+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bc8037040 con 0x559c7c128620 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.695+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.696+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.696+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c123a50 2024-09-19T11:14:14.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.696+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.696+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.696+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.696+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x7f4bc800f070 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.696+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.696+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c128620 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.697+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bc8037040 con 0x559c7c128620 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.697+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c128620 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.697+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4bc8037040 con 0x559c7c128620 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.697+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c123a50 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.697+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.697+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c128620 2024-09-19T11:14:14.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.697+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bc8037040 con 0x559c7c128620 2024-09-19T11:14:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.697+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c128620 2024-09-19T11:14:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.698+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bc8037040 con 0x559c7c128620 2024-09-19T11:14:14.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.698+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.698+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.698+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.698+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.698+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c123a50 2024-09-19T11:14:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.698+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.698+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c128620 2024-09-19T11:14:14.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.699+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bc8037040 con 0x559c7c128620 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.699+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x7f4bc800f070 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.699+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.699+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.699+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.699+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c123a50 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.699+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.699+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c128620 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.700+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bc8037040 con 0x559c7c128620 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.700+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c123a50 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.700+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.700+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x7f4bc800f070 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.700+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.700+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c128620 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.700+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.700+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x7f4bc800f070 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x559c7c11f300 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x559c7c122f60 con 0x7f4bc800f070 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:14.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c126f20 con 0x559c7c11f300 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.701+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c126f20 con 0x559c7c11f300 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c126ef0 con 0x559c7c128620 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:14.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 20 zone default found 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 4 Realm: () 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 20 zonegroup default 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c1277c0 con 0x559c7c123a50 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.702+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12d020 con 0x559c7c128620 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4be132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4be132e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12d420 con 0x559c7c128620 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4be132e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4be132e800 20 started sync module instance, tier type = 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4be132e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.703+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12c4c0 con 0x7f4bc800f070 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.704+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.704+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94130584865248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12c4c0 con 0x7f4bc800f070 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.704+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12dea0 con 0x559c7c11f300 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.705+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94130584865248] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.705+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.705+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94130584869840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12c4c0 con 0x559c7c11f300 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.705+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12e8f0 con 0x559c7c128620 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.706+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.706+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94130584871936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12f190 con 0x559c7c128620 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.706+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12fc30 con 0x7f4bc800f070 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.706+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94130584869840] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.707+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94130584871936] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.707+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.707+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94130584874208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12c010 con 0x7f4bc800f070 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.707+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c130500 con 0x559c7c11f300 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.708+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.708+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94130584879104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c130420 con 0x559c7c11f300 2024-09-19T11:14:14.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.708+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94130584874208] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.709+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12f720 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.710+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.710+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94130584882960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c1317e0 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.710+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c1321e0 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.710+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94130584879104] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.710+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94130584882960] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.711+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.711+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94130584881392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c132580 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.711+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c132e10 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94130584881392] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'165 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94130584886512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c132ff0 con 0x559c7c123a50 2024-09-19T11:14:14.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4be132e800 20 add_watcher() i=0 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4be132e800 20 add_watcher() i=1 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4be132e800 20 add_watcher() i=2 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4be132e800 20 add_watcher() i=3 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4be132e800 20 add_watcher() i=4 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4be132e800 20 add_watcher() i=5 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.712+0000 7f4be132e800 20 add_watcher() i=6 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.713+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94130584886512] v37'166 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.713+0000 7f4be132e800 20 add_watcher() i=7 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.713+0000 7f4be132e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.713+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c1363c0 con 0x559c7c11f300 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.714+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.714+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94130584891104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c1337b0 con 0x559c7c11f300 2024-09-19T11:14:14.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.715+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94130584891104] v37'168 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.715+0000 7f4a937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.715+0000 7f4be132e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.715+0000 7f4be132e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.715+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c138680 con 0x559c7c11f300 2024-09-19T11:14:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.716+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.716+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13ee00 con 0x559c7c123a50 2024-09-19T11:14:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.717+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.717+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13ee00 con 0x559c7c128620 2024-09-19T11:14:14.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.718+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.718+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13f650 con 0x559c7c11f300 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.719+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'169 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.719+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13fbc0 con 0x7f4bc800f070 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.720+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'56 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.720+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c140130 con 0x559c7c128620 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.721+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'38 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.721+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c1405e0 con 0x559c7c11f300 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.722+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.722+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x559c7c123a50 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.723+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'39 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.723+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x7f4bc800f070 2024-09-19T11:14:14.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.724+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.724+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x559c7c128620 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.725+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.725+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x7f4bc800f070 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.726+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'57 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.726+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x559c7c123a50 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.727+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.727+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x7f4bc800f070 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.728+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.728+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x559c7c123a50 2024-09-19T11:14:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.729+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'43 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.730+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x559c7c11f300 2024-09-19T11:14:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.731+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'170 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.731+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e2a0 con 0x559c7c128620 2024-09-19T11:14:14.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.732+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'50 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.732+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e390 con 0x7f4bc800f070 2024-09-19T11:14:14.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.733+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'58 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.733+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c13e390 con 0x559c7c128620 2024-09-19T11:14:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.734+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.734+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c11f300 2024-09-19T11:14:14.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.735+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'30 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.735+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c11f300 2024-09-19T11:14:14.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.736+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'171 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.736+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c128620 2024-09-19T11:14:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.737+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'51 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.737+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x7f4bc800f070 2024-09-19T11:14:14.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.738+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'32 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.738+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c128620 2024-09-19T11:14:14.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.739+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'25 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.739+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c128620 2024-09-19T11:14:14.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.740+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.740+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c128620 2024-09-19T11:14:14.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.741+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'18 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.741+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c128620 2024-09-19T11:14:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.742+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'39 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.742+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c123a50 2024-09-19T11:14:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.743+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'24 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.743+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c128620 2024-09-19T11:14:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.744+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'22 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.744+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c123a50 2024-09-19T11:14:14.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.745+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'40 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.745+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c128620 2024-09-19T11:14:14.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.747+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'52 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.747+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x559c7c123a50 2024-09-19T11:14:14.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.748+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'44 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.748+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c141140 con 0x7f4bc800f070 2024-09-19T11:14:14.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.749+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'28 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.749+0000 7f4a927e4640 20 reqs_thread_entry: start 2024-09-19T11:14:14.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.749+0000 7f4be132e800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:14.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.749+0000 7f4be132e800 20 Filter name: none 2024-09-19T11:14:14.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.749+0000 7f4a03fff640 20 reqs_thread_entry: start 2024-09-19T11:14:14.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.749+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.750+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(94 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.750+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:95 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c11f300 2024-09-19T11:14:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.750+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(95 gc.0 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.750+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c11f300 2024-09-19T11:14:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.750+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(96 gc.0 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.750+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:97 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.751+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(97 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.751+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:98 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.751+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(98 gc.1 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.751+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:99 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.751+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(99 gc.1 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.751+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:100 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.752+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(100 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.752+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:101 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.752+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(101 gc.2 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.752+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:102 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.752+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(102 gc.2 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.752+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:103 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c11f300 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.752+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(103 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.752+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:104 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c11f300 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.753+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(104 gc.3 [call out=24b] v0'0 uv166 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.753+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.753+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(105 gc.3 [call out=15b] v0'0 uv166 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.753+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:106 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.753+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(106 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.753+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:107 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x7f4bc800f070 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.753+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(107 gc.4 [call out=24b] v0'0 uv51 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.753+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:108 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.754+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(108 gc.4 [call out=15b] v0'0 uv51 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.754+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:109 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.754+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(109 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.754+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:110 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.754+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(110 gc.5 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.754+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:111 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.754+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== osd_op_reply(111 gc.5 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.754+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:112 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.755+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(112 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.755+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:113 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c11f300 2024-09-19T11:14:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.755+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(113 gc.6 [call out=24b] v0'0 uv23 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.755+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:114 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.755+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(114 gc.6 [call out=15b] v0'0 uv23 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.755+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:115 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.756+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(115 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.756+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:116 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.756+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(116 gc.7 [call out=24b] v0'0 uv35 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.757+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:117 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.757+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(117 gc.7 [call out=15b] v0'0 uv35 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.757+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:118 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.757+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(118 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.757+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:119 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x7f4bc800f070 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.757+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(119 gc.8 [call out=24b] v0'0 uv21 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.757+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:120 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.758+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(120 gc.8 [call out=15b] v0'0 uv21 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.758+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:121 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.758+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(121 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.758+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:122 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.758+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 34 ==== osd_op_reply(122 gc.9 [call out=24b] v0'0 uv27 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.758+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:123 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.758+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 35 ==== osd_op_reply(123 gc.9 [call out=15b] v0'0 uv27 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.758+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:124 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.759+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 25 ==== osd_op_reply(124 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.759+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:125 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x7f4bc800f070 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.759+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 26 ==== osd_op_reply(125 gc.10 [call out=24b] v0'0 uv53 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.759+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:126 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.759+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 27 ==== osd_op_reply(126 gc.10 [call out=15b] v0'0 uv53 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.759+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:127 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.760+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(127 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.760+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:128 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.760+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(128 gc.11 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.760+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:129 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.760+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(129 gc.11 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.761+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:130 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.761+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 28 ==== osd_op_reply(130 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.761+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:131 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x7f4bc800f070 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.761+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 29 ==== osd_op_reply(131 gc.12 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.761+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:132 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.761+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 30 ==== osd_op_reply(132 gc.12 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.761+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:133 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.762+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(133 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.762+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:134 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.762+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== osd_op_reply(134 gc.13 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.762+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:135 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.762+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(135 gc.13 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.762+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.762+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.762+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c11f300 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.763+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(137 gc.14 [call out=24b] v0'0 uv162 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.763+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:138 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.763+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(138 gc.14 [call out=15b] v0'0 uv162 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.763+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.763+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.763+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.763+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv45 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.763+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.764+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv45 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.764+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:142 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.764+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 31 ==== osd_op_reply(142 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.764+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:143 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x7f4bc800f070 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.764+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 32 ==== osd_op_reply(143 gc.16 [call out=24b] v0'0 uv55 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.764+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.764+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 33 ==== osd_op_reply(144 gc.16 [call out=15b] v0'0 uv55 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.764+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:145 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.765+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 39 ==== osd_op_reply(145 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.765+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:146 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.765+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 40 ==== osd_op_reply(146 gc.17 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.765+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:147 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.765+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 41 ==== osd_op_reply(147 gc.17 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.765+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:148 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(148 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:149 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== osd_op_reply(149 gc.18 [call out=24b] v0'0 uv29 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:150 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(150 gc.18 [call out=15b] v0'0 uv29 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:151 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== osd_op_reply(151 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:152 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 43 ==== osd_op_reply(152 gc.19 [call out=24b] v0'0 uv164 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.766+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:153 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.767+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 44 ==== osd_op_reply(153 gc.19 [call out=15b] v0'0 uv164 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.767+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:154 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.767+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 42 ==== osd_op_reply(154 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.767+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:155 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.767+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 43 ==== osd_op_reply(155 gc.20 [call out=24b] v0'0 uv47 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8049040 con 0x559c7c128620 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.767+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:156 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.767+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 44 ==== osd_op_reply(156 gc.20 [call out=15b] v0'0 uv47 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.767+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:157 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.768+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 34 ==== osd_op_reply(157 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.768+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:158 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x7f4bc800f070 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.768+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 35 ==== osd_op_reply(158 gc.21 [call out=24b] v0'0 uv31 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.768+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:159 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.768+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 36 ==== osd_op_reply(159 gc.21 [call out=15b] v0'0 uv31 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.768+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:160 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.768+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 45 ==== osd_op_reply(160 gc.22 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.768+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:161 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.769+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 46 ==== osd_op_reply(161 gc.22 [call out=24b] v0'0 uv24 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.769+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:162 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.769+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 47 ==== osd_op_reply(162 gc.22 [call out=15b] v0'0 uv24 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.769+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:163 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.769+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 48 ==== osd_op_reply(163 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.769+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:164 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.769+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 49 ==== osd_op_reply(164 gc.23 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.769+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:165 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.770+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 50 ==== osd_op_reply(165 gc.23 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.770+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:166 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.770+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 51 ==== osd_op_reply(166 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.770+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:167 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.770+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 52 ==== osd_op_reply(167 gc.24 [call out=24b] v0'0 uv17 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.770+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:168 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.770+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 53 ==== osd_op_reply(168 gc.24 [call out=15b] v0'0 uv17 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.770+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:169 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.771+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 54 ==== osd_op_reply(169 gc.25 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.771+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:170 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.771+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 55 ==== osd_op_reply(170 gc.25 [call out=24b] v0'0 uv37 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.771+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:171 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.771+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 56 ==== osd_op_reply(171 gc.25 [call out=15b] v0'0 uv37 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.771+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:172 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.772+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(172 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.772+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:173 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.772+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== osd_op_reply(173 gc.26 [call out=24b] v0'0 uv23 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.772+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:174 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.772+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(174 gc.26 [call out=15b] v0'0 uv23 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.772+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:175 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.773+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 57 ==== osd_op_reply(175 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.773+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:176 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.773+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 58 ==== osd_op_reply(176 gc.27 [call out=24b] v0'0 uv21 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.773+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:177 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.773+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 59 ==== osd_op_reply(177 gc.27 [call out=15b] v0'0 uv21 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.773+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:178 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.774+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(178 gc.28 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.774+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:179 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.774+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== osd_op_reply(179 gc.28 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.774+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:180 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.775+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 41 ==== osd_op_reply(180 gc.28 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.775+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:181 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.775+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 60 ==== osd_op_reply(181 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.775+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:182 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c128620 2024-09-19T11:14:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.775+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 61 ==== osd_op_reply(182 gc.29 [call out=24b] v0'0 uv49 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.775+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:183 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c128620 2024-09-19T11:14:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.775+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 62 ==== osd_op_reply(183 gc.29 [call out=15b] v0'0 uv49 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.775+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:184 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.776+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 42 ==== osd_op_reply(184 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.776+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:185 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x559c7c123a50 2024-09-19T11:14:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.776+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 43 ==== osd_op_reply(185 gc.30 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.776+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:186 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x559c7c123a50 2024-09-19T11:14:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.776+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 44 ==== osd_op_reply(186 gc.30 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.776+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:187 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.776+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 37 ==== osd_op_reply(187 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.776+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:188 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16b180 con 0x7f4bc800f070 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.777+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 38 ==== osd_op_reply(188 gc.31 [call out=24b] v0'0 uv27 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.777+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:189 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559c7c16c190 con 0x7f4bc800f070 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.777+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 39 ==== osd_op_reply(189 gc.31 [call out=15b] v0'0 uv27 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.778+0000 7f4a937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.778+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:190 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94130584891104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c138f90 con 0x559c7c11f300 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.779+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 45 ==== osd_op_reply(190 data_loggenerations_metadata [watch unwatch cookie 94130584891104] v37'172 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.779+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:191 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94130584865248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c138f90 con 0x7f4bc800f070 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.780+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 40 ==== osd_op_reply(191 notify.0 [watch unwatch cookie 94130584865248] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.780+0000 7f4be132e800 20 remove_watcher() i=0 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.780+0000 7f4be132e800 2 removed watcher, disabling cache 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.780+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:192 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94130584869840] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12c9e0 con 0x559c7c11f300 2024-09-19T11:14:14.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.781+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 46 ==== osd_op_reply(192 notify.1 [watch unwatch cookie 94130584869840] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.781+0000 7f4be132e800 20 remove_watcher() i=1 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.781+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:193 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94130584871936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12c9e0 con 0x559c7c128620 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.782+0000 7f4bd7fff640 1 -- 172.21.15.102:0/4271302409 <== osd.3 v2:172.21.15.102:6800/3957239017 63 ==== osd_op_reply(193 notify.2 [watch unwatch cookie 94130584871936] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bc8055040 con 0x559c7c128620 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.782+0000 7f4be132e800 20 remove_watcher() i=2 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.782+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:194 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94130584874208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12c9e0 con 0x7f4bc800f070 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.783+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.2 v2:172.21.15.102:6808/525557096 41 ==== osd_op_reply(194 notify.3 [watch unwatch cookie 94130584874208] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x7f4bc800f070 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.783+0000 7f4be132e800 20 remove_watcher() i=3 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.783+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:195 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94130584879104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12ece0 con 0x559c7c11f300 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.784+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 <== osd.1 v2:172.21.15.102:6816/3609322588 47 ==== osd_op_reply(195 notify.4 [watch unwatch cookie 94130584879104] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd800a4d0 con 0x559c7c11f300 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.784+0000 7f4be132e800 20 remove_watcher() i=4 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.784+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:196 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94130584882960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12c9e0 con 0x559c7c123a50 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.785+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 45 ==== osd_op_reply(196 notify.5 [watch unwatch cookie 94130584882960] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.785+0000 7f4be132e800 20 remove_watcher() i=5 2024-09-19T11:14:14.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.785+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:197 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94130584881392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c130000 con 0x559c7c123a50 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.786+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 46 ==== osd_op_reply(197 notify.6 [watch unwatch cookie 94130584881392] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.786+0000 7f4be132e800 20 remove_watcher() i=6 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.786+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:198 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94130584886512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559c7c12ece0 con 0x559c7c123a50 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.787+0000 7f4bdd0dd640 1 -- 172.21.15.102:0/4271302409 <== osd.0 v2:172.21.15.37:6800/394652614 47 ==== osd_op_reply(198 notify.7 [watch unwatch cookie 94130584886512] v37'167 uv165 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4bd00c2020 con 0x559c7c123a50 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.787+0000 7f4be132e800 20 remove_watcher() i=7 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c123a50 msgr2=0x559c7c125e40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c123a50 0x559c7c125e40 crc :-1 s=READY pgs=118 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7c11f300 msgr2=0x559c7c121790 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7c11f300 0x559c7c121790 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4bc800f070 msgr2=0x7f4bc802e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4bc800f070 0x7f4bc802e910 crc :-1 s=READY pgs=65 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c128620 msgr2=0x559c7c12aae0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c128620 0x559c7c12aae0 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4aa803d000 msgr2=0x7f4aa803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4aa803d000 0x7f4aa803f4c0 secure :-1 s=READY pgs=223 cs=0 l=1 rev1=1 crypto rx=0x559c7c0f28a0 tx=0x7f4bc8010000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 msgr2=0x559c7c113ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4bdd8de640 1 -- 172.21.15.102:0/4271302409 reap_dead start 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c113ea0 secure :-1 s=READY pgs=541 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0050710 tx=0x7f4bd0064680 comp rx=0 tx=0).stop 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 shutdown_connections 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/4271302409 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c10caa0 0x559c7c113ea0 unknown :-1 s=CLOSED pgs=541 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 >> 172.21.15.102:0/4271302409 conn(0x559c7c108ea0 msgr2=0x559c7c1070b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 shutdown_connections 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/4271302409 wait complete. 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/1939344703 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ab403d000 msgr2=0x7f4ab403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/1939344703 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ab403d000 0x7f4ab403f4c0 secure :-1 s=READY pgs=222 cs=0 l=1 rev1=1 crypto rx=0x559c7c0ee8d0 tx=0x7f4bc800f000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/1939344703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c100200 msgr2=0x559c7c100620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/1939344703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c100200 0x559c7c100620 secure :-1 s=READY pgs=539 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0096780 tx=0x7f4bd006fdd0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/1939344703 shutdown_connections 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/1939344703 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ab403d000 0x7f4ab403f4c0 unknown :-1 s=CLOSED pgs=222 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 --2- 172.21.15.102:0/1939344703 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7c100200 0x559c7c100620 unknown :-1 s=CLOSED pgs=539 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/1939344703 >> 172.21.15.102:0/1939344703 conn(0x559c7c0f45b0 msgr2=0x559c7c0f4990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/1939344703 shutdown_connections 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.788+0000 7f4be132e800 1 -- 172.21.15.102:0/1939344703 wait complete. 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c0eb920 msgr2=0x559c7c0edda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559c7c0eb920 0x559c7c0edda0 crc :-1 s=READY pgs=117 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7bf5d360 msgr2=0x559c7c0e9500 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559c7bf5d360 0x559c7c0e9500 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c0ef990 msgr2=0x559c7c0f1d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x559c7c0ef990 0x559c7c0f1d80 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac403d000 msgr2=0x7f4ac403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ac403d000 0x7f4ac403f4c0 secure :-1 s=READY pgs=221 cs=0 l=1 rev1=1 crypto rx=0x7f4bc8001e30 tx=0x7f4bc8001390 comp rx=0 tx=0).stop 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 msgr2=0x559c7c0e1eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 --2- 172.21.15.102:0/2264369910 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559c7bf5ca20 0x559c7c0e1eb0 secure :-1 s=READY pgs=538 cs=0 l=1 rev1=1 crypto rx=0x7f4bd0025da0 tx=0x7f4bd0002fb0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4bdd8de640 1 -- 172.21.15.102:0/2264369910 reap_dead start 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 shutdown_connections 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 >> 172.21.15.102:0/2264369910 conn(0x559c7bfe3c60 msgr2=0x559c7c0db7f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 shutdown_connections 2024-09-19T11:14:14.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.789+0000 7f4be132e800 1 -- 172.21.15.102:0/2264369910 wait complete. 2024-09-19T11:14:14.798 INFO:teuthology.orchestra.run.smithi102.stdout:[] 2024-09-19T11:14:14.798 DEBUG:tasks.util.rgw: json result: [] 2024-09-19T11:14:14.798 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-19T11:14:14.799 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-19T11:14:14.799 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-19T11:14:14.883 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:14.883 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.883+0000 7f46e1325800 1 Processor -- start 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.883+0000 7f46e1325800 1 -- start start 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.883+0000 7f46e1325800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55cd9525fa90 0x55cd95261f50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.883+0000 7f46e1325800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55cd952625d0 con 0x55cd9525bf20 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.883+0000 7f46e1325800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55cd950e67d0 con 0x55cd9525fa90 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.884+0000 7f46d4732640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55cd9525fa90 0x55cd95261f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.884+0000 7f46dcf33640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55cd9525bf20 0x55cd9525e310 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36794/0 (socket says 172.21.15.102:36794) 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.884+0000 7f46dcf33640 1 -- 172.21.15.102:0/2195651846 learned_addr learned my addr 172.21.15.102:0/2195651846 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.884+0000 7f46d4732640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55cd9525fa90 0x55cd95261f50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37982/0 (socket says 172.21.15.102:37982) 2024-09-19T11:14:14.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.884+0000 7f46d4732640 1 -- 172.21.15.102:0/2195651846 >> v1:172.21.15.37:6789/0 conn(0x55cd9525bf20 legacy=0x55cd9525e310 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.884+0000 7f46d7fff640 1 -- 172.21.15.102:0/2195651846 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3448853159 0 0) 0x55cd952625d0 con 0x55cd9525bf20 2024-09-19T11:14:14.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.884+0000 7f46d4732640 1 -- 172.21.15.102:0/2195651846 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd95263800 con 0x55cd9525fa90 2024-09-19T11:14:14.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46d4732640 1 --2- 172.21.15.102:0/2195651846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525fa90 0x55cd95261f50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f46c400a470 tx=0x7f46c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbbd060b1ebec1a7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46d7fff640 1 -- 172.21.15.102:0/2195651846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46c4053570 con 0x55cd9525fa90 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46d7fff640 1 -- 172.21.15.102:0/2195651846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46c4058070 con 0x55cd9525fa90 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46d7fff640 1 -- 172.21.15.102:0/2195651846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46c4053880 con 0x55cd9525fa90 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46e1325800 1 -- 172.21.15.102:0/2195651846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525fa90 msgr2=0x55cd95261f50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46e1325800 1 --2- 172.21.15.102:0/2195651846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525fa90 0x55cd95261f50 secure :-1 s=READY pgs=543 cs=0 l=1 rev1=1 crypto rx=0x7f46c400a470 tx=0x7f46c4045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46e1325800 1 -- 172.21.15.102:0/2195651846 shutdown_connections 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46e1325800 1 --2- 172.21.15.102:0/2195651846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525fa90 0x55cd95261f50 unknown :-1 s=CLOSED pgs=543 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46e1325800 1 -- 172.21.15.102:0/2195651846 >> 172.21.15.102:0/2195651846 conn(0x55cd95255a60 msgr2=0x55cd95257ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46e1325800 1 -- 172.21.15.102:0/2195651846 shutdown_connections 2024-09-19T11:14:14.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.886+0000 7f46e1325800 1 -- 172.21.15.102:0/2195651846 wait complete. 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.900+0000 7f46e1325800 1 Processor -- start 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.900+0000 7f46e1325800 1 -- start start 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.900+0000 7f46e1325800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9534b180 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.900+0000 7f46e1325800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd950f3dd0 con 0x55cd9525bf20 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.900+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9534b180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.900+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9534b180 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37990/0 (socket says 172.21.15.102:37990) 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.900+0000 7f46dcf33640 1 -- 172.21.15.102:0/2176987580 learned_addr learned my addr 172.21.15.102:0/2176987580 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.901+0000 7f46dcf33640 1 -- 172.21.15.102:0/2176987580 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd9534b770 con 0x55cd9525bf20 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.901+0000 7f46dcf33640 1 --2- 172.21.15.102:0/2176987580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9534b180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f46cc001ea0 tx=0x7f46cc00b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c640a5ede39bdaff server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.901+0000 7f45cae0d640 1 -- 172.21.15.102:0/2176987580 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc008070 con 0x55cd9525bf20 2024-09-19T11:14:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.901+0000 7f45cae0d640 1 -- 172.21.15.102:0/2176987580 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc00d500 con 0x55cd9525bf20 2024-09-19T11:14:14.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.901+0000 7f45cae0d640 1 -- 172.21.15.102:0/2176987580 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc00d880 con 0x55cd9525bf20 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 -- 172.21.15.102:0/2176987580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 msgr2=0x55cd9534b180 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 --2- 172.21.15.102:0/2176987580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9534b180 secure :-1 s=READY pgs=544 cs=0 l=1 rev1=1 crypto rx=0x7f46cc001ea0 tx=0x7f46cc00b6a0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 -- 172.21.15.102:0/2176987580 shutdown_connections 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 --2- 172.21.15.102:0/2176987580 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9534b180 unknown :-1 s=CLOSED pgs=544 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 -- 172.21.15.102:0/2176987580 >> 172.21.15.102:0/2176987580 conn(0x55cd95255a60 msgr2=0x55cd95346b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 -- 172.21.15.102:0/2176987580 shutdown_connections 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 -- 172.21.15.102:0/2176987580 wait complete. 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 Processor -- start 2024-09-19T11:14:14.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 -- start start 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9525b640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46e1325800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd95262aa0 con 0x55cd9525bf20 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9525b640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9525b640 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:37994/0 (socket says 172.21.15.102:37994) 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.902+0000 7f46dcf33640 1 -- 172.21.15.102:0/2624248998 learned_addr learned my addr 172.21.15.102:0/2624248998 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.903+0000 7f46dcf33640 1 -- 172.21.15.102:0/2624248998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd9525bba0 con 0x55cd9525bf20 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.903+0000 7f46dcf33640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9525b640 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f46cc000f60 tx=0x7f46cc000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.903+0000 7f45c960a640 1 -- 172.21.15.102:0/2624248998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc00f8d0 con 0x55cd9525bf20 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.903+0000 7f45c960a640 1 -- 172.21.15.102:0/2624248998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc00fa70 con 0x55cd9525bf20 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.903+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd95259f50 con 0x55cd9525bf20 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.903+0000 7f45c960a640 1 -- 172.21.15.102:0/2624248998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc00fd50 con 0x55cd9525bf20 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.903+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd9525a510 con 0x55cd9525bf20 2024-09-19T11:14:14.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.904+0000 7f45c960a640 1 -- 172.21.15.102:0/2624248998 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f46cc017040 con 0x55cd9525bf20 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.904+0000 7f45c960a640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45c403cfb0 0x7f45c403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.904+0000 7f45c960a640 1 -- 172.21.15.102:0/2624248998 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f46cc015020 con 0x55cd9525bf20 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.904+0000 7f46d4732640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45c403cfb0 0x7f45c403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.904+0000 7f46e1325800 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd9525fa90 0x55cd9535c190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.904+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd9535c6d0 con 0x55cd9525fa90 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.904+0000 7f46dd734640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd9525fa90 0x55cd9535c190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.905+0000 7f46d4732640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45c403cfb0 0x7f45c403f470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f46c4057000 tx=0x7f46c4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.905+0000 7f46dd734640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd9525fa90 0x55cd9535c190 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.905+0000 7f46dd734640 1 -- 172.21.15.102:0/2624248998 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd9525fa90 2024-09-19T11:14:14.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.905+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd9525aa10 con 0x55cd9525fa90 2024-09-19T11:14:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.905+0000 7f46dd734640 1 -- 172.21.15.102:0/2624248998 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd9525fa90 2024-09-19T11:14:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.905+0000 7f46e1325800 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd9535ea20 0x55cd95360e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.905+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd953614e0 con 0x55cd9535ea20 2024-09-19T11:14:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.906+0000 7f46dcf33640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd9535ea20 0x55cd95360e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.906+0000 7f46dcf33640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd9535ea20 0x55cd95360e10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.906+0000 7f46dcf33640 1 -- 172.21.15.102:0/2624248998 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f46cc02d070 con 0x55cd9535ea20 2024-09-19T11:14:14.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.906+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd9535d8c0 con 0x55cd9525fa90 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.907+0000 7f46dd734640 1 -- 172.21.15.102:0/2624248998 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd9525fa90 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.907+0000 7f46e1325800 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd95362920 0x55cd95364d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.907+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd95365450 con 0x55cd95362920 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.907+0000 7f46d4732640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd95362920 0x55cd95364d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.907+0000 7f46d4732640 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd95362920 0x55cd95364d10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.907+0000 7f46d4732640 1 -- 172.21.15.102:0/2624248998 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f46c4051070 con 0x55cd95362920 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46e1325800 1 Processor -- start 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46e1325800 1 -- start start 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46e1325800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd953731d0 0x55cd953735f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46e1325800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd951524a0 con 0x55cd953731d0 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd953731d0 0x55cd953735f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd953731d0 0x55cd953735f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38008/0 (socket says 172.21.15.102:38008) 2024-09-19T11:14:14.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46dcf33640 1 -- 172.21.15.102:0/2357356987 learned_addr learned my addr 172.21.15.102:0/2357356987 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46dcf33640 1 -- 172.21.15.102:0/2357356987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd95373c30 con 0x55cd953731d0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46dcf33640 1 --2- 172.21.15.102:0/2357356987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd953731d0 0x55cd953735f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00eb00 tx=0x7f46cc0187a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f45c27fc640 1 -- 172.21.15.102:0/2357356987 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc04bfd0 con 0x55cd953731d0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f45c27fc640 1 -- 172.21.15.102:0/2357356987 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc04c170 con 0x55cd953731d0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.908+0000 7f46e1325800 1 -- 172.21.15.102:0/2357356987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd95374460 con 0x55cd953731d0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.909+0000 7f45c27fc640 1 -- 172.21.15.102:0/2357356987 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc04c450 con 0x55cd953731d0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.909+0000 7f46e1325800 1 -- 172.21.15.102:0/2357356987 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd95374a00 con 0x55cd953731d0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.909+0000 7f45c27fc640 1 -- 172.21.15.102:0/2357356987 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f46cc01c7e0 con 0x55cd953731d0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.909+0000 7f45c27fc640 1 --2- 172.21.15.102:0/2357356987 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45b403d000 0x7f45b403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.909+0000 7f45c27fc640 1 -- 172.21.15.102:0/2357356987 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f46cc03daa0 con 0x55cd953731d0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46d4732640 1 --2- 172.21.15.102:0/2357356987 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45b403d000 0x7f45b403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46e1325800 1 Processor -- start 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46e1325800 1 -- start start 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46d4732640 1 --2- 172.21.15.102:0/2357356987 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45b403d000 0x7f45b403f4c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55cd9535cba0 tx=0x7f46c4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46e1325800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953800d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46e1325800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd9534bba0 con 0x55cd9537fcd0 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953800d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953800d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38014/0 (socket says 172.21.15.102:38014) 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46dcf33640 1 -- 172.21.15.102:0/289469065 learned_addr learned my addr 172.21.15.102:0/289469065 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.910+0000 7f46dcf33640 1 -- 172.21.15.102:0/289469065 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd953806c0 con 0x55cd9537fcd0 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46dcf33640 1 --2- 172.21.15.102:0/289469065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953800d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f46cc01af70 tx=0x7f46cc03f160 comp rx=0 tx=0).ready entity=mon.0 client_cookie=663193dde901093e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f45b3fff640 1 -- 172.21.15.102:0/289469065 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc02fad0 con 0x55cd9537fcd0 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f45b3fff640 1 -- 172.21.15.102:0/289469065 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc02fe70 con 0x55cd9537fcd0 2024-09-19T11:14:14.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f45b3fff640 1 -- 172.21.15.102:0/289469065 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc02f3e0 con 0x55cd9537fcd0 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46e1325800 1 -- 172.21.15.102:0/289469065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 msgr2=0x55cd953800d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46e1325800 1 --2- 172.21.15.102:0/289469065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953800d0 secure :-1 s=READY pgs=547 cs=0 l=1 rev1=1 crypto rx=0x7f46cc01af70 tx=0x7f46cc03f160 comp rx=0 tx=0).stop 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46e1325800 1 -- 172.21.15.102:0/289469065 shutdown_connections 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46e1325800 1 --2- 172.21.15.102:0/289469065 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953800d0 unknown :-1 s=CLOSED pgs=547 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46e1325800 1 -- 172.21.15.102:0/289469065 >> 172.21.15.102:0/289469065 conn(0x55cd9537c0d0 msgr2=0x55cd9537a310 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46e1325800 1 -- 172.21.15.102:0/289469065 shutdown_connections 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46e1325800 1 -- 172.21.15.102:0/289469065 wait complete. 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.911+0000 7f46e1325800 1 Processor -- start 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f46e1325800 1 -- start start 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f46e1325800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953870d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f46e1325800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55cd95380b30 con 0x55cd9537fcd0 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953870d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.918 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f46dcf33640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953870d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38026/0 (socket says 172.21.15.102:38026) 2024-09-19T11:14:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 learned_addr learned my addr 172.21.15.102:0/3368901044 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55cd95387630 con 0x55cd9537fcd0 2024-09-19T11:14:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f46dcf33640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953870d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f46cc01af70 tx=0x7f46cc03bdc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f45b27fc640 1 -- 172.21.15.102:0/3368901044 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc02fad0 con 0x55cd9537fcd0 2024-09-19T11:14:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.912+0000 7f45b27fc640 1 -- 172.21.15.102:0/3368901044 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f46cc04c7a0 con 0x55cd9537fcd0 2024-09-19T11:14:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.913+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55cd95387630 con 0x55cd9537fcd0 2024-09-19T11:14:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.913+0000 7f45b27fc640 1 -- 172.21.15.102:0/3368901044 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f46cc01cc00 con 0x55cd9537fcd0 2024-09-19T11:14:14.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.913+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55cd95387630 con 0x55cd9537fcd0 2024-09-19T11:14:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f45b27fc640 1 -- 172.21.15.102:0/3368901044 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f46cc026960 con 0x55cd9537fcd0 2024-09-19T11:14:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f45b27fc640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45a803d000 0x7f45a803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f45b27fc640 1 -- 172.21.15.102:0/3368901044 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f46cc067030 con 0x55cd9537fcd0 2024-09-19T11:14:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f46d4732640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45a803d000 0x7f45a803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd953926a0 0x55cd95394b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd953952b0 con 0x55cd953926a0 2024-09-19T11:14:14.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f46d4732640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45a803d000 0x7f45a803f4c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55cd95365850 tx=0x7f46c4053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.914+0000 7f46dd734640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd953926a0 0x55cd95394b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46dd734640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd953926a0 0x55cd95394b60 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 20 realm 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd953956c0 con 0x55cd953926a0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd95395f90 con 0x55cd953926a0 2024-09-19T11:14:14.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.915+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.916+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.916+0000 7f46e1325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.916+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.916+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd95397090 0x55cd95399480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.916+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd95399a40 con 0x55cd95397090 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.916+0000 7f46dcf33640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd95397090 0x55cd95399480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.916+0000 7f46dcf33640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd95397090 0x55cd95399480 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46e1325800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46e1325800 20 searching for the correct realm 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd9539b9f0 0x55cd9539deb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539e580 con 0x55cd9539b9f0 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46d4732640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd9539b9f0 0x55cd9539deb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46d4732640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd9539b9f0 0x55cd9539deb0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46d4732640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f46c405f040 0x7f46c405f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539e580 con 0x7f46c405f040 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.917+0000 7f46dd734640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f46c405f040 0x7f46c405f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.918+0000 7f46dd734640 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f46c405f040 0x7f46c405f930 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.918+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.918+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd95397090 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.918+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.918+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.919+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.919+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.919+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.919+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd95397090 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.919+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.919+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd95397090 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.919+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.919+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x7f46c405f040 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.920+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.936 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.920+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd9539b9f0 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.920+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.920+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.920+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.920+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd95397090 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.920+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.920+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.921+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.921+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x7f46c405f040 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.921+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.921+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd9539b9f0 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.921+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.921+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd9539b9f0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.921+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.921+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd95397090 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.922+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.922+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd9539b9f0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.922+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.922+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd9539b9f0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.922+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.922+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.922+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.922+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.923+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.923+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd95397090 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.923+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.923+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd9539b9f0 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.923+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.923+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x7f46c405f040 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.924+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.924+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.924+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.924+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd95397090 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.924+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.924+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd9539b9f0 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.924+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.924+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd95397090 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.925+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.925+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x7f46c405f040 2024-09-19T11:14:14.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.925+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.925+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd9539b9f0 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.925+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.925+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x7f46c405f040 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.925+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.925+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x55cd953926a0 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55cd95396330 con 0x7f46c405f040 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:14.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539a300 con 0x55cd953926a0 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539a300 con 0x55cd953926a0 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.926+0000 7f46e1325800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539a300 con 0x55cd9539b9f0 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 zone default found 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 4 Realm: () 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 zonegroup default 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539ac50 con 0x55cd95397090 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a0550 con 0x55cd9539b9f0 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.927+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a0990 con 0x55cd9539b9f0 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.928+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.928+0000 7f46e1325800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.928+0000 7f46e1325800 20 started sync module instance, tier type = 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.928+0000 7f46e1325800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.928+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539f890 con 0x7f46c405f040 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.929+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.929+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94341460262288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539f890 con 0x7f46c405f040 2024-09-19T11:14:14.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.929+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a14d0 con 0x55cd953926a0 2024-09-19T11:14:14.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.930+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94341460262288] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.930+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.930+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94341460266944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a1490 con 0x55cd953926a0 2024-09-19T11:14:14.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.930+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a1f40 con 0x55cd9539b9f0 2024-09-19T11:14:14.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.931+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94341460266944] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.931+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.931+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94341460259808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a2330 con 0x55cd9539b9f0 2024-09-19T11:14:14.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.931+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a2d30 con 0x7f46c405f040 2024-09-19T11:14:14.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.932+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.932+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94341460273216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a2ca0 con 0x7f46c405f040 2024-09-19T11:14:14.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.932+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a3d20 con 0x55cd953926a0 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.932+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94341460259808] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.933+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.933+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94341460273216] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.933+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94341460277232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a3ce0 con 0x55cd953926a0 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.933+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a4280 con 0x55cd95397090 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.934+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.934+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94341460275488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a4ad0 con 0x55cd95397090 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.934+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a5510 con 0x55cd95397090 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.935+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94341460277232] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.935+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94341460275488] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.936+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.936+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94341460283360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a58b0 con 0x55cd95397090 2024-09-19T11:14:14.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.936+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a6100 con 0x55cd95397090 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94341460283360] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'168 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94341460285616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a6180 con 0x55cd95397090 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46e1325800 20 add_watcher() i=0 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46e1325800 20 add_watcher() i=1 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46e1325800 20 add_watcher() i=2 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46e1325800 20 add_watcher() i=3 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46e1325800 20 add_watcher() i=4 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46e1325800 20 add_watcher() i=5 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.937+0000 7f46e1325800 20 add_watcher() i=6 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.938+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94341460285616] v37'169 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.938+0000 7f46e1325800 20 add_watcher() i=7 2024-09-19T11:14:14.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.938+0000 7f46e1325800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.938+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a9500 con 0x55cd953926a0 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.938+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.938+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94341460299488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a62f0 con 0x55cd953926a0 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.939+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94341460299488] v37'173 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.939+0000 7f45937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.939+0000 7f46e1325800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.939+0000 7f46e1325800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.939+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b1dd0 con 0x55cd953926a0 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.940+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.940+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b2400 con 0x55cd95397090 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.941+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.941+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b23c0 con 0x55cd9539b9f0 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.942+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.942+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b2a30 con 0x55cd953926a0 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.943+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'174 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.943+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b2ee0 con 0x7f46c405f040 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.944+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'59 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.944+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953afc10 con 0x55cd9539b9f0 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.945+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'40 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.945+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953afc10 con 0x55cd953926a0 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.946+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.946+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b3a40 con 0x55cd95397090 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.947+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'41 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.947+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b3a40 con 0x7f46c405f040 2024-09-19T11:14:14.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.948+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.948+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b3a40 con 0x55cd9539b9f0 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.949+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.949+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4070 con 0x7f46c405f040 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.950+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'60 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.950+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4470 con 0x55cd95397090 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.951+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.951+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4170 con 0x7f46c405f040 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.952+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.952+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4110 con 0x55cd95397090 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.953+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'45 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.953+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4110 con 0x55cd953926a0 2024-09-19T11:14:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.954+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'175 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.954+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4110 con 0x55cd9539b9f0 2024-09-19T11:14:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.955+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'53 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.955+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b41a0 con 0x7f46c405f040 2024-09-19T11:14:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.956+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'61 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.956+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b41a0 con 0x55cd9539b9f0 2024-09-19T11:14:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.957+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.957+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b41c0 con 0x55cd953926a0 2024-09-19T11:14:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.958+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'31 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.959+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b41c0 con 0x55cd953926a0 2024-09-19T11:14:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.959+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'176 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.959+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4200 con 0x55cd9539b9f0 2024-09-19T11:14:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.960+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'54 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.960+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4200 con 0x7f46c405f040 2024-09-19T11:14:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.961+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'33 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.962+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4260 con 0x55cd9539b9f0 2024-09-19T11:14:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.962+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'26 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.962+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4290 con 0x55cd9539b9f0 2024-09-19T11:14:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.963+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.963+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b42f0 con 0x55cd9539b9f0 2024-09-19T11:14:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.964+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'19 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.964+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b42b0 con 0x55cd9539b9f0 2024-09-19T11:14:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.965+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'41 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.965+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b42b0 con 0x55cd95397090 2024-09-19T11:14:14.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.967+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'25 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.967+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4310 con 0x55cd9539b9f0 2024-09-19T11:14:14.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.968+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'23 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.968+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4310 con 0x55cd95397090 2024-09-19T11:14:14.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.969+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'42 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.969+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4310 con 0x55cd9539b9f0 2024-09-19T11:14:14.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.970+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'55 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.970+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b42d0 con 0x55cd95397090 2024-09-19T11:14:14.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.971+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'46 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.971+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b4330 con 0x7f46c405f040 2024-09-19T11:14:14.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.972+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'29 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.972+0000 7f45927e4640 20 reqs_thread_entry: start 2024-09-19T11:14:14.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.972+0000 7f46e1325800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:14.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.972+0000 7f46e1325800 20 Filter name: none 2024-09-19T11:14:14.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.972+0000 7f458bfff640 20 reqs_thread_entry: start 2024-09-19T11:14:14.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.972+0000 7f46e1325800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.972+0000 7f46e1325800 20 rados->read ofs=0 len=0 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.972+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd953def30 con 0x55cd953926a0 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.973+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.973+0000 7f46e1325800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.973+0000 7f46e1325800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.973+0000 7f46e1325800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.973+0000 7f46e1325800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.973+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55cd953e1860 con 0x7f46c405f040 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.973+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv26 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.975 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-19T11:14:14.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.974+0000 7f45937e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:14.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.974+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94341460299488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953b2ee0 con 0x55cd953926a0 2024-09-19T11:14:14.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.975+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94341460299488] v37'177 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.975+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94341460262288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a8ee0 con 0x7f46c405f040 2024-09-19T11:14:14.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.976+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94341460262288] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.976+0000 7f46e1325800 20 remove_watcher() i=0 2024-09-19T11:14:14.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.976+0000 7f46e1325800 2 removed watcher, disabling cache 2024-09-19T11:14:14.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.976+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94341460266944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539fd90 con 0x55cd953926a0 2024-09-19T11:14:14.978 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.977+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94341460266944] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x55cd953926a0 2024-09-19T11:14:14.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.977+0000 7f46e1325800 20 remove_watcher() i=1 2024-09-19T11:14:14.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.977+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94341460259808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539fd90 con 0x55cd9539b9f0 2024-09-19T11:14:14.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.978+0000 7f46d4732640 1 -- 172.21.15.102:0/3368901044 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94341460259808] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46c407c040 con 0x55cd9539b9f0 2024-09-19T11:14:14.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.978+0000 7f46e1325800 20 remove_watcher() i=2 2024-09-19T11:14:14.979 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.978+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94341460273216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539f3e0 con 0x7f46c405f040 2024-09-19T11:14:14.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.979+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94341460273216] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d800a4d0 con 0x7f46c405f040 2024-09-19T11:14:14.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.979+0000 7f46e1325800 20 remove_watcher() i=3 2024-09-19T11:14:14.980 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.979+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94341460277232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539fd90 con 0x55cd953926a0 2024-09-19T11:14:14.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.980+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94341460277232] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46d8040040 con 0x55cd953926a0 2024-09-19T11:14:14.981 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.980+0000 7f46e1325800 20 remove_watcher() i=4 2024-09-19T11:14:14.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.980+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94341460275488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a2840 con 0x55cd95397090 2024-09-19T11:14:14.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.982+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94341460275488] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.982+0000 7f46e1325800 20 remove_watcher() i=5 2024-09-19T11:14:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.982+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94341460283360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd953a37f0 con 0x55cd95397090 2024-09-19T11:14:14.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.982+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94341460283360] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.983+0000 7f46e1325800 20 remove_watcher() i=6 2024-09-19T11:14:14.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.983+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94341460285616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55cd9539fd90 con 0x55cd95397090 2024-09-19T11:14:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.983+0000 7f46dcf33640 1 -- 172.21.15.102:0/3368901044 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94341460285616] v37'170 uv168 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f46cc037070 con 0x55cd95397090 2024-09-19T11:14:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.983+0000 7f46e1325800 20 remove_watcher() i=7 2024-09-19T11:14:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd95397090 msgr2=0x55cd95399480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd95397090 0x55cd95399480 crc :-1 s=READY pgs=120 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd953926a0 msgr2=0x55cd95394b60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd953926a0 0x55cd95394b60 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f46c405f040 msgr2=0x7f46c405f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f46c405f040 0x7f46c405f930 crc :-1 s=READY pgs=66 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd9539b9f0 msgr2=0x55cd9539deb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd9539b9f0 0x55cd9539deb0 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45a803d000 msgr2=0x7f45a803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45a803d000 0x7f45a803f4c0 secure :-1 s=READY pgs=226 cs=0 l=1 rev1=1 crypto rx=0x55cd95365850 tx=0x7f46c4053000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 msgr2=0x55cd953870d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/3368901044 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9537fcd0 0x55cd953870d0 secure :-1 s=READY pgs=548 cs=0 l=1 rev1=1 crypto rx=0x7f46cc01af70 tx=0x7f46cc03bdc0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 reap_dead start 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46dd734640 1 -- 172.21.15.102:0/3368901044 reap_dead start 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 shutdown_connections 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 >> 172.21.15.102:0/3368901044 conn(0x55cd9537c0d0 msgr2=0x55cd9537a2e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 shutdown_connections 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/3368901044 wait complete. 2024-09-19T11:14:14.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/2357356987 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45b403d000 msgr2=0x7f45b403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/2357356987 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45b403d000 0x7f45b403f4c0 secure :-1 s=READY pgs=225 cs=0 l=1 rev1=1 crypto rx=0x55cd9535cba0 tx=0x7f46c4005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/2357356987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd953731d0 msgr2=0x55cd953735f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/2357356987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd953731d0 0x55cd953735f0 secure :-1 s=READY pgs=546 cs=0 l=1 rev1=1 crypto rx=0x7f46cc00eb00 tx=0x7f46cc0187a0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/2357356987 shutdown_connections 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/2357356987 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45b403d000 0x7f45b403f4c0 unknown :-1 s=CLOSED pgs=225 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 --2- 172.21.15.102:0/2357356987 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd953731d0 0x55cd953735f0 unknown :-1 s=CLOSED pgs=546 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/2357356987 >> 172.21.15.102:0/2357356987 conn(0x55cd95367580 msgr2=0x55cd95367960 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/2357356987 shutdown_connections 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.984+0000 7f46e1325800 1 -- 172.21.15.102:0/2357356987 wait complete. 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd9535ea20 msgr2=0x55cd95360e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55cd9535ea20 0x55cd95360e10 crc :-1 s=READY pgs=119 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd9525fa90 msgr2=0x55cd9535c190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55cd9525fa90 0x55cd9535c190 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.989 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd95362920 msgr2=0x55cd95364d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55cd95362920 0x55cd95364d10 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45c403cfb0 msgr2=0x7f45c403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f45c403cfb0 0x7f45c403f470 secure :-1 s=READY pgs=224 cs=0 l=1 rev1=1 crypto rx=0x7f46c4057000 tx=0x7f46c4052000 comp rx=0 tx=0).stop 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 msgr2=0x55cd9525b640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 --2- 172.21.15.102:0/2624248998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55cd9525bf20 0x55cd9525b640 secure :-1 s=READY pgs=545 cs=0 l=1 rev1=1 crypto rx=0x7f46cc000f60 tx=0x7f46cc000ed0 comp rx=0 tx=0).stop 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46dd734640 1 -- 172.21.15.102:0/2624248998 reap_dead start 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 shutdown_connections 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 >> 172.21.15.102:0/2624248998 conn(0x55cd95255a60 msgr2=0x55cd9534c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 shutdown_connections 2024-09-19T11:14:14.990 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:14.985+0000 7f46e1325800 1 -- 172.21.15.102:0/2624248998 wait complete. 2024-09-19T11:14:14.994 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-19T11:14:15.003 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=236 failed=True 2024-09-19T11:14:15.008 INFO:tasks.radosgw_admin:RL: delete_obj myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:15.034 INFO:tasks.radosgw_admin:RL: delete_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:15.043 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:15.093 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-19T11:14:15.098 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:15.098 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-19T11:14:15.098 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-19T11:14:15.099 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-19T11:14:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:15.144 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.143+0000 7fe46ab32800 1 Processor -- start 2024-09-19T11:14:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.143+0000 7fe46ab32800 1 -- start start 2024-09-19T11:14:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.144+0000 7fe46ab32800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x563bfe160520 0x563bfe1f43c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.144+0000 7fe46ab32800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563bfe1f4900 con 0x563bfe15fa10 2024-09-19T11:14:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.144+0000 7fe46ab32800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x563bfe0767d0 con 0x563bfe160520 2024-09-19T11:14:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.144+0000 7fe45e0af640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x563bfe160520 0x563bfe1f43c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.144+0000 7fe4668b0640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x563bfe15fa10 0x563bfe15fe10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36798/0 (socket says 172.21.15.102:36798) 2024-09-19T11:14:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.144+0000 7fe4668b0640 1 -- 172.21.15.102:0/83939162 learned_addr learned my addr 172.21.15.102:0/83939162 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.144+0000 7fe45e0af640 1 -- 172.21.15.102:0/83939162 >> v1:172.21.15.37:6789/0 conn(0x563bfe15fa10 legacy=0x563bfe15fe10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.144+0000 7fe45e0af640 1 -- 172.21.15.102:0/83939162 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfe1f5ae0 con 0x563bfe160520 2024-09-19T11:14:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.146+0000 7fe45e0af640 1 --2- 172.21.15.102:0/83939162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe160520 0x563bfe1f43c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe45000a470 tx=0x7fe450045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8a0136c8036486ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.146+0000 7fe4660af640 1 -- 172.21.15.102:0/83939162 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe450053570 con 0x563bfe160520 2024-09-19T11:14:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.146+0000 7fe4660af640 1 -- 172.21.15.102:0/83939162 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe450058070 con 0x563bfe160520 2024-09-19T11:14:15.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.146+0000 7fe4660af640 1 -- 172.21.15.102:0/83939162 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe450053880 con 0x563bfe160520 2024-09-19T11:14:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.146+0000 7fe46ab32800 1 -- 172.21.15.102:0/83939162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe160520 msgr2=0x563bfe1f43c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.146+0000 7fe46ab32800 1 --2- 172.21.15.102:0/83939162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe160520 0x563bfe1f43c0 secure :-1 s=READY pgs=550 cs=0 l=1 rev1=1 crypto rx=0x7fe45000a470 tx=0x7fe450045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.147+0000 7fe46ab32800 1 -- 172.21.15.102:0/83939162 shutdown_connections 2024-09-19T11:14:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.147+0000 7fe46ab32800 1 --2- 172.21.15.102:0/83939162 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe160520 0x563bfe1f43c0 unknown :-1 s=CLOSED pgs=550 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.148 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.147+0000 7fe46ab32800 1 -- 172.21.15.102:0/83939162 >> 172.21.15.102:0/83939162 conn(0x563bfe1e6c70 msgr2=0x563bfe1e90d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.147+0000 7fe46ab32800 1 -- 172.21.15.102:0/83939162 shutdown_connections 2024-09-19T11:14:15.149 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.147+0000 7fe46ab32800 1 -- 172.21.15.102:0/83939162 wait complete. 2024-09-19T11:14:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.160+0000 7fe46ab32800 1 Processor -- start 2024-09-19T11:14:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.160+0000 7fe46ab32800 1 -- start start 2024-09-19T11:14:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.160+0000 7fe46ab32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2dd560 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.160+0000 7fe46ab32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563bfe083dd0 con 0x563bfe15fa10 2024-09-19T11:14:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.161+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2dd560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.161+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2dd560 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38052/0 (socket says 172.21.15.102:38052) 2024-09-19T11:14:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.161+0000 7fe4668b0640 1 -- 172.21.15.102:0/2226039565 learned_addr learned my addr 172.21.15.102:0/2226039565 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.162 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.161+0000 7fe4668b0640 1 -- 172.21.15.102:0/2226039565 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfe2ddb50 con 0x563bfe15fa10 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.161+0000 7fe4668b0640 1 --2- 172.21.15.102:0/2226039565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2dd560 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe458001e40 tx=0x7fe458001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cbe5bba97f74222 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.161+0000 7fe354e09640 1 -- 172.21.15.102:0/2226039565 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe458012020 con 0x563bfe15fa10 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.161+0000 7fe354e09640 1 -- 172.21.15.102:0/2226039565 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45800e5a0 con 0x563bfe15fa10 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.161+0000 7fe354e09640 1 -- 172.21.15.102:0/2226039565 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45800e8a0 con 0x563bfe15fa10 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 -- 172.21.15.102:0/2226039565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 msgr2=0x563bfe2dd560 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2226039565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2dd560 secure :-1 s=READY pgs=551 cs=0 l=1 rev1=1 crypto rx=0x7fe458001e40 tx=0x7fe458001e70 comp rx=0 tx=0).stop 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 -- 172.21.15.102:0/2226039565 shutdown_connections 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2226039565 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2dd560 unknown :-1 s=CLOSED pgs=551 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 -- 172.21.15.102:0/2226039565 >> 172.21.15.102:0/2226039565 conn(0x563bfe1e6c70 msgr2=0x563bfe2d8ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 -- 172.21.15.102:0/2226039565 shutdown_connections 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 -- 172.21.15.102:0/2226039565 wait complete. 2024-09-19T11:14:15.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 Processor -- start 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.162+0000 7fe46ab32800 1 -- start start 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.163+0000 7fe46ab32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2e50c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.163+0000 7fe46ab32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563bfe1f4dd0 con 0x563bfe15fa10 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.163+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2e50c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.163+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2e50c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38060/0 (socket says 172.21.15.102:38060) 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.163+0000 7fe4668b0640 1 -- 172.21.15.102:0/2522570419 learned_addr learned my addr 172.21.15.102:0/2522570419 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.163+0000 7fe4668b0640 1 -- 172.21.15.102:0/2522570419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfe2e5620 con 0x563bfe15fa10 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.163+0000 7fe4668b0640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2e50c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c010 tx=0x7fe458000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.163+0000 7fe353606640 1 -- 172.21.15.102:0/2522570419 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe458012030 con 0x563bfe15fa10 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.164+0000 7fe353606640 1 -- 172.21.15.102:0/2522570419 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe4580014a0 con 0x563bfe15fa10 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.164+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bfe2e58b0 con 0x563bfe15fa10 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.164+0000 7fe353606640 1 -- 172.21.15.102:0/2522570419 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45801a7a0 con 0x563bfe15fa10 2024-09-19T11:14:15.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.164+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bfe2e62b0 con 0x563bfe15fa10 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.164+0000 7fe353606640 1 -- 172.21.15.102:0/2522570419 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe458015020 con 0x563bfe15fa10 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.165+0000 7fe353606640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34c03d000 0x7fe34c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.165+0000 7fe353606640 1 -- 172.21.15.102:0/2522570419 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fe458020030 con 0x563bfe15fa10 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.165+0000 7fe45e0af640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34c03d000 0x7fe34c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.165+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe160520 0x563bfe2ec710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.165+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe2e6e20 con 0x563bfe160520 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.165+0000 7fe4670b1640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe160520 0x563bfe2ec710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.165+0000 7fe45e0af640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34c03d000 0x7fe34c03f4c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe450057000 tx=0x7fe450052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.165+0000 7fe4670b1640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe160520 0x563bfe2ec710 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.166+0000 7fe4670b1640 1 -- 172.21.15.102:0/2522570419 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe160520 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.166+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe2e6740 con 0x563bfe160520 2024-09-19T11:14:15.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.166+0000 7fe4670b1640 1 -- 172.21.15.102:0/2522570419 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe160520 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.166+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe2eeb80 0x563bfe2f0f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.166+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe2f1640 con 0x563bfe2eeb80 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.166+0000 7fe4668b0640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe2eeb80 0x563bfe2f0f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.166+0000 7fe4668b0640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe2eeb80 0x563bfe2f0f70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.167+0000 7fe4668b0640 1 -- 172.21.15.102:0/2522570419 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe4580187b0 con 0x563bfe2eeb80 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.167+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe2eda20 con 0x563bfe160520 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.167+0000 7fe4670b1640 1 -- 172.21.15.102:0/2522570419 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe160520 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.167+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe2f2a80 0x563bfe2f4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.167+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe2f55b0 con 0x563bfe2f2a80 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.167+0000 7fe45e0af640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe2f2a80 0x563bfe2f4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.167+0000 7fe45e0af640 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe2f2a80 0x563bfe2f4e70 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe45e0af640 1 -- 172.21.15.102:0/2522570419 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe450051070 con 0x563bfe2f2a80 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe46ab32800 1 Processor -- start 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe46ab32800 1 -- start start 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe46ab32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe303310 0x563bfe303730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe46ab32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563bfe0e24a0 con 0x563bfe303310 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe303310 0x563bfe303730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe303310 0x563bfe303730 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38066/0 (socket says 172.21.15.102:38066) 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe4668b0640 1 -- 172.21.15.102:0/1496676546 learned_addr learned my addr 172.21.15.102:0/1496676546 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.168+0000 7fe4668b0640 1 -- 172.21.15.102:0/1496676546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfe303d70 con 0x563bfe303310 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.169+0000 7fe4668b0640 1 --2- 172.21.15.102:0/1496676546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe303310 0x563bfe303730 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe458001250 tx=0x7fe458042da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.169+0000 7fe350e01640 1 -- 172.21.15.102:0/1496676546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45800d3d0 con 0x563bfe303310 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.169+0000 7fe350e01640 1 -- 172.21.15.102:0/1496676546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe458048070 con 0x563bfe303310 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.169+0000 7fe46ab32800 1 -- 172.21.15.102:0/1496676546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bfe3045a0 con 0x563bfe303310 2024-09-19T11:14:15.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.169+0000 7fe350e01640 1 -- 172.21.15.102:0/1496676546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe458051510 con 0x563bfe303310 2024-09-19T11:14:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.169+0000 7fe46ab32800 1 -- 172.21.15.102:0/1496676546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bfe3045a0 con 0x563bfe303310 2024-09-19T11:14:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe350e01640 1 -- 172.21.15.102:0/1496676546 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe45804b370 con 0x563bfe303310 2024-09-19T11:14:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe350e01640 1 --2- 172.21.15.102:0/1496676546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34003cfb0 0x7fe34003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe350e01640 1 -- 172.21.15.102:0/1496676546 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fe4580379b0 con 0x563bfe303310 2024-09-19T11:14:15.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe45e0af640 1 --2- 172.21.15.102:0/1496676546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34003cfb0 0x7fe34003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe46ab32800 1 Processor -- start 2024-09-19T11:14:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe45e0af640 1 --2- 172.21.15.102:0/1496676546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34003cfb0 0x7fe34003f470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x563bfe2ecd20 tx=0x7fe450005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe46ab32800 1 -- start start 2024-09-19T11:14:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe46ab32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe30fda0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe46ab32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563bfe2ddf80 con 0x563bfe30f9a0 2024-09-19T11:14:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.170+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe30fda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe30fda0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38078/0 (socket says 172.21.15.102:38078) 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe4668b0640 1 -- 172.21.15.102:0/4212571727 learned_addr learned my addr 172.21.15.102:0/4212571727 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe4668b0640 1 -- 172.21.15.102:0/4212571727 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfe310390 con 0x563bfe30f9a0 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe4668b0640 1 --2- 172.21.15.102:0/4212571727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe30fda0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe458044010 tx=0x7fe4580246c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7dabd70142ddc27 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe34a7fc640 1 -- 172.21.15.102:0/4212571727 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe458037420 con 0x563bfe30f9a0 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe34a7fc640 1 -- 172.21.15.102:0/4212571727 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe45804b860 con 0x563bfe30f9a0 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe34a7fc640 1 -- 172.21.15.102:0/4212571727 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe4580247e0 con 0x563bfe30f9a0 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe46ab32800 1 -- 172.21.15.102:0/4212571727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 msgr2=0x563bfe30fda0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe46ab32800 1 --2- 172.21.15.102:0/4212571727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe30fda0 secure :-1 s=READY pgs=554 cs=0 l=1 rev1=1 crypto rx=0x7fe458044010 tx=0x7fe4580246c0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe46ab32800 1 -- 172.21.15.102:0/4212571727 shutdown_connections 2024-09-19T11:14:15.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe46ab32800 1 --2- 172.21.15.102:0/4212571727 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe30fda0 unknown :-1 s=CLOSED pgs=554 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.171+0000 7fe46ab32800 1 -- 172.21.15.102:0/4212571727 >> 172.21.15.102:0/4212571727 conn(0x563bfe30bda0 msgr2=0x563bfe309fe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe46ab32800 1 -- 172.21.15.102:0/4212571727 shutdown_connections 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe46ab32800 1 -- 172.21.15.102:0/4212571727 wait complete. 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe46ab32800 1 Processor -- start 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe46ab32800 1 -- start start 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe46ab32800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe316e40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe46ab32800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563bfe310800 con 0x563bfe30f9a0 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe316e40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe4668b0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe316e40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38090/0 (socket says 172.21.15.102:38090) 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.172+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 learned_addr learned my addr 172.21.15.102:0/3732034547 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.173+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563bfe3173a0 con 0x563bfe30f9a0 2024-09-19T11:14:15.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.173+0000 7fe4668b0640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe316e40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe458037ca0 tx=0x7fe458037610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.173+0000 7fe348ff9640 1 -- 172.21.15.102:0/3732034547 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe45803e6a0 con 0x563bfe30f9a0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.173+0000 7fe348ff9640 1 -- 172.21.15.102:0/3732034547 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe458042130 con 0x563bfe30f9a0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.173+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563bfe3173a0 con 0x563bfe30f9a0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.173+0000 7fe348ff9640 1 -- 172.21.15.102:0/3732034547 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe458042410 con 0x563bfe30f9a0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.173+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563bfe3173a0 con 0x563bfe30f9a0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.174+0000 7fe348ff9640 1 -- 172.21.15.102:0/3732034547 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe45803e070 con 0x563bfe30f9a0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.174+0000 7fe348ff9640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe33003d000 0x7fe33003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.174+0000 7fe348ff9640 1 -- 172.21.15.102:0/3732034547 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fe458066070 con 0x563bfe30f9a0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.174+0000 7fe45e0af640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe33003d000 0x7fe33003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.174+0000 7fe45e0af640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe33003d000 0x7fe33003f4c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe450053570 tx=0x7fe450053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.174+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe322430 0x563bfe3248f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe325040 con 0x563bfe322430 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe4670b1640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe322430 0x563bfe3248f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe4670b1640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe322430 0x563bfe3248f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 20 realm 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe325450 con 0x563bfe322430 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.175+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe325d20 con 0x563bfe322430 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe46ab32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe46ab32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe326e20 0x563bfe329210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3297d0 con 0x563bfe326e20 2024-09-19T11:14:15.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.176+0000 7fe4668b0640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe326e20 0x563bfe329210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.177+0000 7fe4668b0640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe326e20 0x563bfe329210 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.177+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.177+0000 7fe46ab32800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.177+0000 7fe46ab32800 20 searching for the correct realm 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.177+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe32b780 0x563bfe32dc40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.177+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32e310 con 0x563bfe32b780 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.177+0000 7fe45e0af640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe32b780 0x563bfe32dc40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.177+0000 7fe45e0af640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe32b780 0x563bfe32dc40 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe45e0af640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe45005f040 0x7fe45005f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32e310 con 0x7fe45005f040 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe4670b1640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe45005f040 0x7fe45005f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe4670b1640 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe45005f040 0x7fe45005f930 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe326e20 2024-09-19T11:14:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.178+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.179+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.179+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.179+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.179+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe326e20 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.179+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.179+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe326e20 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.179+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.179+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x7fe45005f040 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.180+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.180+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe32b780 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.180+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.180+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.180+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.180+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe326e20 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.180+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.180+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.181+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.181+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x7fe45005f040 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.181+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.181+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe32b780 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.181+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.181+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe32b780 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.181+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.181+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe326e20 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe32b780 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe32b780 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.182+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe326e20 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.183+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.183+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe32b780 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.183+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.183+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x7fe45005f040 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.183+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.183+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.183+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.183+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe326e20 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.184+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.184+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe32b780 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.184+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.184+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe326e20 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.184+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.184+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x7fe45005f040 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.184+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.184+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe32b780 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x7fe45005f040 2024-09-19T11:14:15.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x563bfe322430 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3260c0 con 0x7fe45005f040 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe46ab32800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe46ab32800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe46ab32800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe46ab32800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe46ab32800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe46ab32800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.185+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32a090 con 0x563bfe322430 2024-09-19T11:14:15.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32a090 con 0x563bfe322430 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32a090 con 0x563bfe32b780 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 zone default found 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 4 Realm: () 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:15.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 zonegroup default 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32a9e0 con 0x563bfe326e20 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.186+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3302e0 con 0x563bfe32b780 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe46ab32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe330740 con 0x563bfe32b780 2024-09-19T11:14:15.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe46ab32800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe46ab32800 20 started sync module instance, tier type = 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe46ab32800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.187+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32f620 con 0x7fe45005f040 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.188+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.188+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94815667813152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32f620 con 0x7fe45005f040 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.188+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe331260 con 0x563bfe322430 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.189+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94815667813152] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.189+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.189+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94815667810672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe331220 con 0x563bfe322430 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.189+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe331d20 con 0x563bfe32b780 2024-09-19T11:14:15.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.190+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.190+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94815667820560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3325c0 con 0x563bfe32b780 2024-09-19T11:14:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.190+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94815667810672] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.190+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe330d90 con 0x7fe45005f040 2024-09-19T11:14:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.191+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94815667820560] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.191+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.191+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94815667822864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe333030 con 0x7fe45005f040 2024-09-19T11:14:15.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.191+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe333920 con 0x563bfe322430 2024-09-19T11:14:15.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.192+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94815667822864] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.193+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.193+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94815667825536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe333450 con 0x563bfe322430 2024-09-19T11:14:15.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.193+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe334370 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.194+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.194+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94815667830400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe334c10 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.194+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3356c0 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.194+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94815667825536] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.195+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94815667830400] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.195+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.195+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94815667826592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe335ab0 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.195+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe336300 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94815667826592] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'171 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94815667838544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe336720 con 0x563bfe326e20 2024-09-19T11:14:15.219 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe46ab32800 20 add_watcher() i=0 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe46ab32800 20 add_watcher() i=1 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe46ab32800 20 add_watcher() i=2 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe46ab32800 20 add_watcher() i=3 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe46ab32800 20 add_watcher() i=4 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe46ab32800 20 add_watcher() i=5 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.196+0000 7fe46ab32800 20 add_watcher() i=6 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.197+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94815667838544] v37'172 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.197+0000 7fe46ab32800 20 add_watcher() i=7 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.197+0000 7fe46ab32800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.197+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe339a80 con 0x563bfe322430 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.197+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.197+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94815667839968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe336cb0 con 0x563bfe322430 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.198+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94815667839968] v37'178 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.198+0000 7fe31d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.198+0000 7fe46ab32800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.198+0000 7fe46ab32800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.198+0000 7fe46ab32800 5 note: GC not initialized 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe297fff640 20 reqs_thread_entry: start 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 20 Filter name: none 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe295ffb640 20 reqs_thread_entry: start 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe36d0e0 con 0x7fe45005f040 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 : miss 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.199+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.1 8:86db33a5:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe36eb40 con 0x563bfe326e20 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe46ab32800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe46ab32800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 info.flags=0x17 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe46ab32800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 to cache LRU end 2024-09-19T11:14:15.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe46ab32800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe46ab32800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe46ab32800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe46ab32800 20 get_obj_state: octx=0x7fe46000ab20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x563bfe370d38 s->prefetch_data=0 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.200+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 3.27s0 3:e7d4631a:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563bfe3730a0 con 0x563bfe326e20 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.201+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=849b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 304+0+889 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.201+0000 7fe46ab32800 10 manifest: total_size = 5 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.201+0000 7fe46ab32800 20 get_obj_state: setting s->obj_tag to _qhSxPrwezXBMkRida_bMoj-7RMOEqSR 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.201+0000 7fe31d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.201+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94815667839968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe36a950 con 0x563bfe322430 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.203+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94815667839968] v37'179 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.203+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94815667813152] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe36a950 con 0x7fe45005f040 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.204+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94815667813152] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.223 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.204+0000 7fe46ab32800 20 remove_watcher() i=0 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.204+0000 7fe46ab32800 2 removed watcher, disabling cache 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.204+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94815667810672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe36a950 con 0x563bfe322430 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.205+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94815667810672] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.205+0000 7fe46ab32800 20 remove_watcher() i=1 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.205+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94815667820560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32f170 con 0x563bfe32b780 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.206+0000 7fe45e0af640 1 -- 172.21.15.102:0/3732034547 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94815667820560] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe450051070 con 0x563bfe32b780 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.206+0000 7fe46ab32800 20 remove_watcher() i=2 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.206+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94815667822864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe36a950 con 0x7fe45005f040 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.207+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94815667822864] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x7fe45005f040 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.207+0000 7fe46ab32800 20 remove_watcher() i=3 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.207+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94815667825536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32f170 con 0x563bfe322430 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.208+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94815667825536] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe46000a4d0 con 0x563bfe322430 2024-09-19T11:14:15.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.208+0000 7fe46ab32800 20 remove_watcher() i=4 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.208+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94815667830400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe36a950 con 0x563bfe326e20 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.209+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94815667830400] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.209+0000 7fe46ab32800 20 remove_watcher() i=5 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.209+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94815667826592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe332b80 con 0x563bfe326e20 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.210+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94815667826592] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.210+0000 7fe46ab32800 20 remove_watcher() i=6 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.210+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94815667838544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563bfe32f170 con 0x563bfe326e20 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe4668b0640 1 -- 172.21.15.102:0/3732034547 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94815667838544] v37'173 uv171 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe45806f020 con 0x563bfe326e20 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 20 remove_watcher() i=7 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe326e20 msgr2=0x563bfe329210 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe326e20 0x563bfe329210 crc :-1 s=READY pgs=122 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe322430 msgr2=0x563bfe3248f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe322430 0x563bfe3248f0 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe45005f040 msgr2=0x7fe45005f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe45005f040 0x7fe45005f930 crc :-1 s=READY pgs=67 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe32b780 msgr2=0x563bfe32dc40 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe32b780 0x563bfe32dc40 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe33003d000 msgr2=0x7fe33003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe33003d000 0x7fe33003f4c0 secure :-1 s=READY pgs=229 cs=0 l=1 rev1=1 crypto rx=0x7fe450053570 tx=0x7fe450053000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 msgr2=0x563bfe316e40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/3732034547 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe30f9a0 0x563bfe316e40 secure :-1 s=READY pgs=555 cs=0 l=1 rev1=1 crypto rx=0x7fe458037ca0 tx=0x7fe458037610 comp rx=0 tx=0).stop 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 reap_dead start 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe4670b1640 1 -- 172.21.15.102:0/3732034547 reap_dead start 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 shutdown_connections 2024-09-19T11:14:15.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 >> 172.21.15.102:0/3732034547 conn(0x563bfe30bda0 msgr2=0x563bfe309fb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 shutdown_connections 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/3732034547 wait complete. 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/1496676546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34003cfb0 msgr2=0x7fe34003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/1496676546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34003cfb0 0x7fe34003f470 secure :-1 s=READY pgs=228 cs=0 l=1 rev1=1 crypto rx=0x563bfe2ecd20 tx=0x7fe450005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/1496676546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe303310 msgr2=0x563bfe303730 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/1496676546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe303310 0x563bfe303730 secure :-1 s=READY pgs=553 cs=0 l=1 rev1=1 crypto rx=0x7fe458001250 tx=0x7fe458042da0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/1496676546 shutdown_connections 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/1496676546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34003cfb0 0x7fe34003f470 unknown :-1 s=CLOSED pgs=228 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 --2- 172.21.15.102:0/1496676546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe303310 0x563bfe303730 unknown :-1 s=CLOSED pgs=553 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/1496676546 >> 172.21.15.102:0/1496676546 conn(0x563bfe2f76c0 msgr2=0x563bfe2f7aa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/1496676546 shutdown_connections 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.211+0000 7fe46ab32800 1 -- 172.21.15.102:0/1496676546 wait complete. 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe2eeb80 msgr2=0x563bfe2f0f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563bfe2eeb80 0x563bfe2f0f70 crc :-1 s=READY pgs=121 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe160520 msgr2=0x563bfe2ec710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563bfe160520 0x563bfe2ec710 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe2f2a80 msgr2=0x563bfe2f4e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563bfe2f2a80 0x563bfe2f4e70 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34c03d000 msgr2=0x7fe34c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe34c03d000 0x7fe34c03f4c0 secure :-1 s=READY pgs=227 cs=0 l=1 rev1=1 crypto rx=0x7fe450057000 tx=0x7fe450052000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 msgr2=0x563bfe2e50c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 --2- 172.21.15.102:0/2522570419 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563bfe15fa10 0x563bfe2e50c0 secure :-1 s=READY pgs=552 cs=0 l=1 rev1=1 crypto rx=0x7fe45800c010 tx=0x7fe458000ed0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe4670b1640 1 -- 172.21.15.102:0/2522570419 reap_dead start 2024-09-19T11:14:15.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 shutdown_connections 2024-09-19T11:14:15.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 >> 172.21.15.102:0/2522570419 conn(0x563bfe1e6c70 msgr2=0x563bfe2dea50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 shutdown_connections 2024-09-19T11:14:15.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.212+0000 7fe46ab32800 1 -- 172.21.15.102:0/2522570419 wait complete. 2024-09-19T11:14:15.230 INFO:teuthology.orchestra.run.smithi102.stdout:fooFoofooFooFULL_CONTROL 2024-09-19T11:14:15.230 DEBUG:tasks.util.rgw: raw result: fooFoofooFooFULL_CONTROL 2024-09-19T11:14:15.233 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=417 failed=False 2024-09-19T11:14:15.238 INFO:tasks.radosgw_admin:RL: put_acls myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:15.238 INFO:tasks.util.rgw:rgwadmin: client.0 : ['policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-19T11:14:15.238 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'xml', '-n', 'client.0', '--cluster', 'ceph', 'policy', '--bucket', 'myfoo', '--object', 'bb3aec0fdcdbc2974890f805c585d432'] 2024-09-19T11:14:15.239 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format xml -n client.0 --cluster ceph policy --bucket myfoo --object bb3aec0fdcdbc2974890f805c585d432 2024-09-19T11:14:15.284 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:15.284 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:15.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc623935800 1 Processor -- start 2024-09-19T11:14:15.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc623935800 1 -- start start 2024-09-19T11:14:15.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc623935800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c31d9ad520 0x55c31da413c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc623935800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c31da41900 con 0x55c31d9aca10 2024-09-19T11:14:15.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc623935800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55c31d8c37d0 con 0x55c31d9ad520 2024-09-19T11:14:15.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc61eee3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c31d9ad520 0x55c31da413c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc61eee3640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c31d9ad520 0x55c31da413c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38094/0 (socket says 172.21.15.102:38094) 2024-09-19T11:14:15.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc61f6e4640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55c31d9aca10 0x55c31d9ace10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36800/0 (socket says 172.21.15.102:36800) 2024-09-19T11:14:15.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc61eee3640 1 -- 172.21.15.102:0/4250064027 learned_addr learned my addr 172.21.15.102:0/4250064027 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc61eee3640 1 -- 172.21.15.102:0/4250064027 >> v1:172.21.15.37:6789/0 conn(0x55c31d9aca10 legacy=0x55c31d9ace10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc61e6e2640 1 -- 172.21.15.102:0/4250064027 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 569140004 0 0) 0x55c31da41900 con 0x55c31d9aca10 2024-09-19T11:14:15.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.284+0000 7fc61eee3640 1 -- 172.21.15.102:0/4250064027 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31da42ae0 con 0x55c31d9ad520 2024-09-19T11:14:15.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.286+0000 7fc61eee3640 1 --2- 172.21.15.102:0/4250064027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9ad520 0x55c31da413c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a520 tx=0x7fc614045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14fbb6dedf5750a3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.286+0000 7fc61e6e2640 1 -- 172.21.15.102:0/4250064027 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc614055070 con 0x55c31d9ad520 2024-09-19T11:14:15.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.286+0000 7fc61e6e2640 1 -- 172.21.15.102:0/4250064027 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc6140515b0 con 0x55c31d9ad520 2024-09-19T11:14:15.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.286+0000 7fc61e6e2640 1 -- 172.21.15.102:0/4250064027 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc6140518d0 con 0x55c31d9ad520 2024-09-19T11:14:15.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.287+0000 7fc623935800 1 -- 172.21.15.102:0/4250064027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9ad520 msgr2=0x55c31da413c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.287+0000 7fc623935800 1 --2- 172.21.15.102:0/4250064027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9ad520 0x55c31da413c0 secure :-1 s=READY pgs=557 cs=0 l=1 rev1=1 crypto rx=0x7fc61400a520 tx=0x7fc614045ba0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.287+0000 7fc623935800 1 -- 172.21.15.102:0/4250064027 shutdown_connections 2024-09-19T11:14:15.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.287+0000 7fc623935800 1 --2- 172.21.15.102:0/4250064027 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9ad520 0x55c31da413c0 unknown :-1 s=CLOSED pgs=557 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.287+0000 7fc623935800 1 -- 172.21.15.102:0/4250064027 >> 172.21.15.102:0/4250064027 conn(0x55c31da33c70 msgr2=0x55c31da360d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.287+0000 7fc623935800 1 -- 172.21.15.102:0/4250064027 shutdown_connections 2024-09-19T11:14:15.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.287+0000 7fc623935800 1 -- 172.21.15.102:0/4250064027 wait complete. 2024-09-19T11:14:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.300+0000 7fc623935800 1 Processor -- start 2024-09-19T11:14:15.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.300+0000 7fc623935800 1 -- start start 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc623935800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db2a360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc623935800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c31d8d0dd0 con 0x55c31d9aca10 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db2a360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db2a360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38098/0 (socket says 172.21.15.102:38098) 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc61f6e4640 1 -- 172.21.15.102:0/818556876 learned_addr learned my addr 172.21.15.102:0/818556876 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc61f6e4640 1 -- 172.21.15.102:0/818556876 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31db2a950 con 0x55c31d9aca10 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/818556876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db2a360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc610001ea0 tx=0x7fc61000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14742d115ca55231 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc50d60a640 1 -- 172.21.15.102:0/818556876 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610008070 con 0x55c31d9aca10 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc50d60a640 1 -- 172.21.15.102:0/818556876 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61000d500 con 0x55c31d9aca10 2024-09-19T11:14:15.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.301+0000 7fc50d60a640 1 -- 172.21.15.102:0/818556876 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61000d880 con 0x55c31d9aca10 2024-09-19T11:14:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 -- 172.21.15.102:0/818556876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 msgr2=0x55c31db2a360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 --2- 172.21.15.102:0/818556876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db2a360 secure :-1 s=READY pgs=558 cs=0 l=1 rev1=1 crypto rx=0x7fc610001ea0 tx=0x7fc61000b6a0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 -- 172.21.15.102:0/818556876 shutdown_connections 2024-09-19T11:14:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 --2- 172.21.15.102:0/818556876 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db2a360 unknown :-1 s=CLOSED pgs=558 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 -- 172.21.15.102:0/818556876 >> 172.21.15.102:0/818556876 conn(0x55c31da33c70 msgr2=0x55c31db25ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 -- 172.21.15.102:0/818556876 shutdown_connections 2024-09-19T11:14:15.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 -- 172.21.15.102:0/818556876 wait complete. 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 Processor -- start 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.302+0000 7fc623935800 1 -- start start 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc623935800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db31ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc623935800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c31da41dd0 con 0x55c31d9aca10 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db31ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db31ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38112/0 (socket says 172.21.15.102:38112) 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc61f6e4640 1 -- 172.21.15.102:0/3631094262 learned_addr learned my addr 172.21.15.102:0/3631094262 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc61f6e4640 1 -- 172.21.15.102:0/3631094262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31db32400 con 0x55c31d9aca10 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db31ea0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc6100012f0 tx=0x7fc610000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc50be07640 1 -- 172.21.15.102:0/3631094262 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61000f9d0 con 0x55c31d9aca10 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc50be07640 1 -- 172.21.15.102:0/3631094262 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61000fb70 con 0x55c31d9aca10 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc50be07640 1 -- 172.21.15.102:0/3631094262 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61000fe50 con 0x55c31d9aca10 2024-09-19T11:14:15.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.303+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c31db32690 con 0x55c31d9aca10 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.304+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31db33090 con 0x55c31d9aca10 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.304+0000 7fc50be07640 1 -- 172.21.15.102:0/3631094262 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc610017040 con 0x55c31d9aca10 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc50be07640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc50403d1a0 0x7fc50403f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc50be07640 1 -- 172.21.15.102:0/3631094262 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc610015020 con 0x55c31d9aca10 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc61eee3640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc50403d1a0 0x7fc50403f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc623935800 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31d9ad520 0x55c31db394f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db39a30 con 0x55c31d9ad520 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc61fee5640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31d9ad520 0x55c31db394f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc61eee3640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc50403d1a0 0x7fc50403f660 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc614057000 tx=0x7fc614052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc61fee5640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31d9ad520 0x55c31db394f0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc61fee5640 1 -- 172.21.15.102:0/3631094262 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31d9ad520 2024-09-19T11:14:15.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.305+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db39dd0 con 0x55c31d9ad520 2024-09-19T11:14:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.306+0000 7fc61fee5640 1 -- 172.21.15.102:0/3631094262 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31d9ad520 2024-09-19T11:14:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.306+0000 7fc623935800 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db3b8d0 0x55c31db3dd50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.306+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db3e4e0 con 0x55c31db3b8d0 2024-09-19T11:14:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.306+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db3b8d0 0x55c31db3dd50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.306+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db3b8d0 0x55c31db3dd50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.306+0000 7fc61f6e4640 1 -- 172.21.15.102:0/3631094262 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc61002d070 con 0x55c31db3b8d0 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.307+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db3a620 con 0x55c31d9ad520 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.307+0000 7fc61fee5640 1 -- 172.21.15.102:0/3631094262 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31d9ad520 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.307+0000 7fc623935800 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db3f940 0x55c31db41d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.307+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db424a0 con 0x55c31db3f940 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.307+0000 7fc61eee3640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db3f940 0x55c31db41d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.307+0000 7fc61eee3640 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db3f940 0x55c31db41d30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.307+0000 7fc61eee3640 1 -- 172.21.15.102:0/3631094262 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc614057030 con 0x55c31db3f940 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.308+0000 7fc623935800 1 Processor -- start 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.308+0000 7fc623935800 1 -- start start 2024-09-19T11:14:15.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.308+0000 7fc623935800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db501e0 0x55c31db50600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.308+0000 7fc623935800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c31d92f4a0 con 0x55c31db501e0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.308+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db501e0 0x55c31db50600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.308+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db501e0 0x55c31db50600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38114/0 (socket says 172.21.15.102:38114) 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.308+0000 7fc61f6e4640 1 -- 172.21.15.102:0/532223231 learned_addr learned my addr 172.21.15.102:0/532223231 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.309+0000 7fc61f6e4640 1 -- 172.21.15.102:0/532223231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31db50c40 con 0x55c31db501e0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.309+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/532223231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db501e0 0x55c31db50600 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc61000e660 tx=0x7fc6100187a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.309+0000 7fc509602640 1 -- 172.21.15.102:0/532223231 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61004bf80 con 0x55c31db501e0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.309+0000 7fc509602640 1 -- 172.21.15.102:0/532223231 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61004c120 con 0x55c31db501e0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.309+0000 7fc509602640 1 -- 172.21.15.102:0/532223231 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61004c400 con 0x55c31db501e0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.309+0000 7fc623935800 1 -- 172.21.15.102:0/532223231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c31db51470 con 0x55c31db501e0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.309+0000 7fc623935800 1 -- 172.21.15.102:0/532223231 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31db51a10 con 0x55c31db501e0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc509602640 1 -- 172.21.15.102:0/532223231 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc61001c800 con 0x55c31db501e0 2024-09-19T11:14:15.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc509602640 1 --2- 172.21.15.102:0/532223231 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4f803d000 0x7fc4f803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc509602640 1 -- 172.21.15.102:0/532223231 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc61003acf0 con 0x55c31db501e0 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc61eee3640 1 --2- 172.21.15.102:0/532223231 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4f803d000 0x7fc4f803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc623935800 1 Processor -- start 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc61eee3640 1 --2- 172.21.15.102:0/532223231 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4f803d000 0x7fc4f803f4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc614045be0 tx=0x7fc614005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc623935800 1 -- start start 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc623935800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db5d0a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.310+0000 7fc623935800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c31db2ad80 con 0x55c31db5cca0 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db5d0a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db5d0a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38120/0 (socket says 172.21.15.102:38120) 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc61f6e4640 1 -- 172.21.15.102:0/3730346867 learned_addr learned my addr 172.21.15.102:0/3730346867 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc61f6e4640 1 -- 172.21.15.102:0/3730346867 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31db5d690 con 0x55c31db5cca0 2024-09-19T11:14:15.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/3730346867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db5d0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc61003a950 tx=0x7fc6100463b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3a26f879406abe92 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc502ffd640 1 -- 172.21.15.102:0/3730346867 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61002f3e0 con 0x55c31db5cca0 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc502ffd640 1 -- 172.21.15.102:0/3730346867 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61002fe70 con 0x55c31db5cca0 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc502ffd640 1 -- 172.21.15.102:0/3730346867 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610027070 con 0x55c31db5cca0 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc623935800 1 -- 172.21.15.102:0/3730346867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 msgr2=0x55c31db5d0a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.311+0000 7fc623935800 1 --2- 172.21.15.102:0/3730346867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db5d0a0 secure :-1 s=READY pgs=561 cs=0 l=1 rev1=1 crypto rx=0x7fc61003a950 tx=0x7fc6100463b0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 -- 172.21.15.102:0/3730346867 shutdown_connections 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 --2- 172.21.15.102:0/3730346867 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db5d0a0 unknown :-1 s=CLOSED pgs=561 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 -- 172.21.15.102:0/3730346867 >> 172.21.15.102:0/3730346867 conn(0x55c31db590a0 msgr2=0x55c31db572e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 -- 172.21.15.102:0/3730346867 shutdown_connections 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 -- 172.21.15.102:0/3730346867 wait complete. 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 Processor -- start 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 -- start start 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db640e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc623935800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c31db5db00 con 0x55c31db5cca0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db640e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc61f6e4640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db640e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38122/0 (socket says 172.21.15.102:38122) 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 learned_addr learned my addr 172.21.15.102:0/2730533833 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.312+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c31db64640 con 0x55c31db5cca0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.313+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db640e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc61000bbf0 tx=0x7fc61003a8b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.313+0000 7fc5017fa640 1 -- 172.21.15.102:0/2730533833 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc61006d020 con 0x55c31db5cca0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.313+0000 7fc5017fa640 1 -- 172.21.15.102:0/2730533833 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc61004cc70 con 0x55c31db5cca0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.313+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c31db64640 con 0x55c31db5cca0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.313+0000 7fc5017fa640 1 -- 172.21.15.102:0/2730533833 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc610064040 con 0x55c31db5cca0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.313+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c31db64640 con 0x55c31db5cca0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.314+0000 7fc5017fa640 1 -- 172.21.15.102:0/2730533833 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc610070020 con 0x55c31db5cca0 2024-09-19T11:14:15.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.314+0000 7fc5017fa640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4e803d000 0x7fc4e803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.314+0000 7fc5017fa640 1 -- 172.21.15.102:0/2730533833 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc61005b070 con 0x55c31db5cca0 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.314+0000 7fc61eee3640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4e803d000 0x7fc4e803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31db6f690 0x55c31db71b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db722a0 con 0x55c31db6f690 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc61eee3640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4e803d000 0x7fc4e803f4c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55c31db428a0 tx=0x7fc614053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc61fee5640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31db6f690 0x55c31db71b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc61fee5640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31db6f690 0x55c31db71b50 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 20 realm 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db726b0 con 0x55c31db6f690 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.315+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db72f80 con 0x55c31db6f690 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc623935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc623935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db74080 0x55c31db76470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db76a30 con 0x55c31db74080 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.316+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db74080 0x55c31db76470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc61f6e4640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db74080 0x55c31db76470 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc623935800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc623935800 20 searching for the correct realm 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db789e0 0x55c31db7aea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7b570 con 0x55c31db789e0 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc61eee3640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db789e0 0x55c31db7aea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc61eee3640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db789e0 0x55c31db7aea0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.317+0000 7fc61eee3640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc614069040 0x7fc6140769a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.318+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7b570 con 0x7fc614069040 2024-09-19T11:14:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.318+0000 7fc61fee5640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc614069040 0x7fc6140769a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.318+0000 7fc61fee5640 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc614069040 0x7fc6140769a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.318+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.318+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db74080 2024-09-19T11:14:15.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.318+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.318+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.319+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.319+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.319+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.319+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db74080 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.319+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.319+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db74080 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.319+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.319+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x7fc614069040 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.320+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.320+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db789e0 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.320+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.320+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.320+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.320+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db74080 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.320+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.320+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.321+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.321+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x7fc614069040 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.321+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.321+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db789e0 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.321+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.321+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db789e0 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.321+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.321+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db74080 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.322+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.322+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db789e0 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.322+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.322+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db789e0 2024-09-19T11:14:15.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.322+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.322+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.322+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.322+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db74080 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db789e0 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x7fc614069040 2024-09-19T11:14:15.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.323+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db74080 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.324+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.324+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db789e0 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.324+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.324+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db74080 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.324+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.324+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x7fc614069040 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.324+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.324+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db789e0 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x7fc614069040 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x55c31db6f690 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c31db73320 con 0x7fc614069040 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc623935800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc623935800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc623935800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc623935800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc623935800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc623935800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.325+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db772f0 con 0x55c31db6f690 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db772f0 con 0x55c31db6f690 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db772f0 con 0x55c31db789e0 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 zone default found 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 4 Realm: () 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:15.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 zonegroup default 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db77c40 con 0x55c31db74080 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.326+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7d570 con 0x55c31db789e0 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc623935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7d9e0 con 0x55c31db789e0 2024-09-19T11:14:15.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc623935800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc623935800 20 started sync module instance, tier type = 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc623935800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.327+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7c880 con 0x7fc614069040 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.328+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.328+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94296505568672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7c880 con 0x7fc614069040 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.328+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7e4c0 con 0x55c31db6f690 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.329+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94296505568672] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.329+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.329+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94296505573296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7c880 con 0x55c31db6f690 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.329+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7ef50 con 0x55c31db789e0 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.330+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94296505573296] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.330+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.330+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94296505566160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7c7f0 con 0x55c31db789e0 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.330+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7fd10 con 0x7fc614069040 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.331+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94296505566160] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.331+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.331+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94296505578304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db80100 con 0x7fc614069040 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.331+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db80b00 con 0x55c31db6f690 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.332+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.332+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94296505578304] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.332+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94296505583120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db80a70 con 0x55c31db6f690 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.332+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db815c0 con 0x55c31db74080 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.333+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.333+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94296505579360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db81e60 con 0x55c31db74080 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.333+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db828d0 con 0x55c31db74080 2024-09-19T11:14:15.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.333+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94296505583120] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.334+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94296505579360] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.335+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.335+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94296505588144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db80f30 con 0x55c31db74080 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.335+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db83130 con 0x55c31db74080 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'174 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94296505588144] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94296505592864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db830f0 con 0x55c31db74080 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc623935800 20 add_watcher() i=0 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc623935800 20 add_watcher() i=1 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc623935800 20 add_watcher() i=2 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc623935800 20 add_watcher() i=3 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc623935800 20 add_watcher() i=4 2024-09-19T11:14:15.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc623935800 20 add_watcher() i=5 2024-09-19T11:14:15.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.336+0000 7fc623935800 20 add_watcher() i=6 2024-09-19T11:14:15.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.337+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94296505592864] v37'175 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.337+0000 7fc623935800 20 add_watcher() i=7 2024-09-19T11:14:15.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.337+0000 7fc623935800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:15.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.337+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31db865e0 con 0x55c31db6f690 2024-09-19T11:14:15.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.337+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.337+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94296505590688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db83aa0 con 0x55c31db6f690 2024-09-19T11:14:15.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.338+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94296505590688] v37'180 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.338+0000 7fc4d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.338+0000 7fc623935800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:15.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.338+0000 7fc623935800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.338+0000 7fc623935800 5 note: GC not initialized 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc4d57e2640 20 reqs_thread_entry: start 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 20 Filter name: none 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc4ce7fc640 20 reqs_thread_entry: start 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:62 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31dbb9a50 con 0x7fc614069040 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(62 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:14:15.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 : miss 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.339+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.1 8:86db33a5:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31dbbb480 con 0x55c31db74080 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 info.flags=0x17 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 to cache LRU end 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 20 get_obj_state: octx=0x7fc61800ab20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x55c31dbbd648 s->prefetch_data=0 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 3.27s0 3:e7d4631a:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c31dbbf8f0 con 0x55c31db74080 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+951 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 10 manifest: total_size = 5 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.340+0000 7fc623935800 20 get_obj_state: setting s->obj_tag to _aUs949oVNU8PpHbKp3pPZKh92K2PCME 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.341+0000 7fc4d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.341+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94296505590688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31dbb72e0 con 0x55c31db6f690 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.342+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94296505590688] v37'181 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.342+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94296505568672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31dbb72e0 con 0x7fc614069040 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.343+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94296505568672] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.343+0000 7fc623935800 20 remove_watcher() i=0 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.343+0000 7fc623935800 2 removed watcher, disabling cache 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.343+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94296505573296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31dbb72e0 con 0x55c31db6f690 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.344+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94296505573296] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.344+0000 7fc623935800 20 remove_watcher() i=1 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.344+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94296505566160] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7dfb0 con 0x55c31db789e0 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.345+0000 7fc61eee3640 1 -- 172.21.15.102:0/2730533833 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94296505566160] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc614057030 con 0x55c31db789e0 2024-09-19T11:14:15.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.345+0000 7fc623935800 20 remove_watcher() i=2 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.345+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94296505578304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31dbb72e0 con 0x7fc614069040 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.346+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94296505578304] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x7fc614069040 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.346+0000 7fc623935800 20 remove_watcher() i=3 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.346+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94296505583120] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7c3d0 con 0x55c31db6f690 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.347+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94296505583120] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc61800a4d0 con 0x55c31db6f690 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.347+0000 7fc623935800 20 remove_watcher() i=4 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.347+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94296505579360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7dfb0 con 0x55c31db74080 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.348+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94296505579360] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.348+0000 7fc623935800 20 remove_watcher() i=5 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.348+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94296505588144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31dbb72e0 con 0x55c31db74080 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.349+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94296505588144] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.349+0000 7fc623935800 20 remove_watcher() i=6 2024-09-19T11:14:15.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.349+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94296505592864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c31db7c3d0 con 0x55c31db74080 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc61f6e4640 1 -- 172.21.15.102:0/2730533833 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94296505592864] v37'176 uv174 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc610067040 con 0x55c31db74080 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 20 remove_watcher() i=7 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db74080 msgr2=0x55c31db76470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db74080 0x55c31db76470 crc :-1 s=READY pgs=124 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31db6f690 msgr2=0x55c31db71b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31db6f690 0x55c31db71b50 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc614069040 msgr2=0x7fc6140769a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc614069040 0x7fc6140769a0 crc :-1 s=READY pgs=68 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db789e0 msgr2=0x55c31db7aea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db789e0 0x55c31db7aea0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4e803d000 msgr2=0x7fc4e803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4e803d000 0x7fc4e803f4c0 secure :-1 s=READY pgs=232 cs=0 l=1 rev1=1 crypto rx=0x55c31db428a0 tx=0x7fc614053000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc61fee5640 1 -- 172.21.15.102:0/2730533833 reap_dead start 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 msgr2=0x55c31db640e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db640e0 secure :-1 s=READY pgs=562 cs=0 l=1 rev1=1 crypto rx=0x7fc61000bbf0 tx=0x7fc61003a8b0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 shutdown_connections 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 --2- 172.21.15.102:0/2730533833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db5cca0 0x55c31db640e0 unknown :-1 s=CLOSED pgs=562 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 >> 172.21.15.102:0/2730533833 conn(0x55c31db590a0 msgr2=0x55c31db572b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 shutdown_connections 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.350+0000 7fc623935800 1 -- 172.21.15.102:0/2730533833 wait complete. 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/532223231 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4f803d000 msgr2=0x7fc4f803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/532223231 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4f803d000 0x7fc4f803f4c0 secure :-1 s=READY pgs=231 cs=0 l=1 rev1=1 crypto rx=0x7fc614045be0 tx=0x7fc614005ac0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/532223231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db501e0 msgr2=0x55c31db50600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/532223231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db501e0 0x55c31db50600 secure :-1 s=READY pgs=560 cs=0 l=1 rev1=1 crypto rx=0x7fc61000e660 tx=0x7fc6100187a0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/532223231 shutdown_connections 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/532223231 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc4f803d000 0x7fc4f803f4c0 unknown :-1 s=CLOSED pgs=231 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/532223231 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31db501e0 0x55c31db50600 unknown :-1 s=CLOSED pgs=560 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/532223231 >> 172.21.15.102:0/532223231 conn(0x55c31db44590 msgr2=0x55c31db44970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/532223231 shutdown_connections 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/532223231 wait complete. 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db3b8d0 msgr2=0x55c31db3dd50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c31db3b8d0 0x55c31db3dd50 crc :-1 s=READY pgs=123 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31d9ad520 msgr2=0x55c31db394f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c31d9ad520 0x55c31db394f0 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db3f940 msgr2=0x55c31db41d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c31db3f940 0x55c31db41d30 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc50403d1a0 msgr2=0x7fc50403f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc50403d1a0 0x7fc50403f660 secure :-1 s=READY pgs=230 cs=0 l=1 rev1=1 crypto rx=0x7fc614057000 tx=0x7fc614052000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 msgr2=0x55c31db31ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 --2- 172.21.15.102:0/3631094262 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c31d9aca10 0x55c31db31ea0 secure :-1 s=READY pgs=559 cs=0 l=1 rev1=1 crypto rx=0x7fc6100012f0 tx=0x7fc610000ed0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc61fee5640 1 -- 172.21.15.102:0/3631094262 reap_dead start 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 shutdown_connections 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 >> 172.21.15.102:0/3631094262 conn(0x55c31da33c70 msgr2=0x55c31db2b850 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 shutdown_connections 2024-09-19T11:14:15.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.351+0000 7fc623935800 1 -- 172.21.15.102:0/3631094262 wait complete. 2024-09-19T11:14:15.365 INFO:teuthology.orchestra.run.smithi102.stdout:fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-19T11:14:15.365 DEBUG:tasks.util.rgw: raw result: fooFoohttp://acs.amazonaws.com/groups/global/AllUsersREADfooFooFULL_CONTROL 2024-09-19T11:14:15.368 INFO:tasks.radosgw_admin:RL: get_acls myfoo foo bytes_out=0 bytes_in=609 failed=False 2024-09-19T11:14:15.387 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:15.446 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=5 bytes_in=0 failed=False 2024-09-19T11:14:15.447 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=4 bytes_in=0 failed=False 2024-09-19T11:14:15.447 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=3 bytes_in=0 failed=False 2024-09-19T11:14:15.447 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-19T11:14:15.447 INFO:tasks.util.rgw:rgwadmin: client.0 : ['bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-19T11:14:15.447 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'bucket', 'rm', '--bucket', 'myfoo', '--purge-objects'] 2024-09-19T11:14:15.447 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph bucket rm --bucket myfoo --purge-objects 2024-09-19T11:14:15.553 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:15.553 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:15.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.492+0000 7f2538f2a800 1 Processor -- start 2024-09-19T11:14:15.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.492+0000 7f2538f2a800 1 -- start start 2024-09-19T11:14:15.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f2538f2a800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564791b386a0 0x564791b393a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f2538f2a800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564791b38d50 con 0x564791b398e0 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f2538f2a800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5647919c47d0 con 0x564791b386a0 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f2534c17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564791b386a0 0x564791b393a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f2534c17640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564791b386a0 0x564791b393a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38130/0 (socket says 172.21.15.102:38130) 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f2534c17640 1 -- 172.21.15.102:0/532691829 learned_addr learned my addr 172.21.15.102:0/532691829 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f252c416640 1 --1- 172.21.15.102:0/532691829 >> v1:172.21.15.37:6789/0 conn(0x564791b398e0 0x564791b3e640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36814/0 (socket says 172.21.15.102:36814) 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f2534c17640 1 -- 172.21.15.102:0/532691829 >> v1:172.21.15.37:6789/0 conn(0x564791b398e0 legacy=0x564791b3e640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.493+0000 7f2534c17640 1 -- 172.21.15.102:0/532691829 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564791b39d90 con 0x564791b386a0 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.495+0000 7f2534c17640 1 --2- 172.21.15.102:0/532691829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791b393a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f252400a6b0 tx=0x7f2524047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bb4aa3ced5691424 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.495+0000 7f252ffff640 1 -- 172.21.15.102:0/532691829 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f252400a200 con 0x564791b386a0 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.495+0000 7f252ffff640 1 -- 172.21.15.102:0/532691829 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252400a3a0 con 0x564791b386a0 2024-09-19T11:14:15.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.495+0000 7f252ffff640 1 -- 172.21.15.102:0/532691829 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2524008700 con 0x564791b386a0 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.496+0000 7f2538f2a800 1 -- 172.21.15.102:0/532691829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 msgr2=0x564791b393a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.496+0000 7f2538f2a800 1 --2- 172.21.15.102:0/532691829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791b393a0 secure :-1 s=READY pgs=564 cs=0 l=1 rev1=1 crypto rx=0x7f252400a6b0 tx=0x7f2524047e30 comp rx=0 tx=0).stop 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.496+0000 7f2538f2a800 1 -- 172.21.15.102:0/532691829 shutdown_connections 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.496+0000 7f2538f2a800 1 --2- 172.21.15.102:0/532691829 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791b393a0 unknown :-1 s=CLOSED pgs=564 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.496+0000 7f2538f2a800 1 -- 172.21.15.102:0/532691829 >> 172.21.15.102:0/532691829 conn(0x564791b33a70 msgr2=0x564791b35ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.496+0000 7f2538f2a800 1 -- 172.21.15.102:0/532691829 shutdown_connections 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.496+0000 7f2538f2a800 1 -- 172.21.15.102:0/532691829 wait complete. 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.509+0000 7f2538f2a800 1 Processor -- start 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.509+0000 7f2538f2a800 1 -- start start 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.509+0000 7f2538f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c270c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.509+0000 7f2538f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5647919d1dd0 con 0x564791b386a0 2024-09-19T11:14:15.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.510+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c270c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.510+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c270c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38132/0 (socket says 172.21.15.102:38132) 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.510+0000 7f2534c17640 1 -- 172.21.15.102:0/2704406388 learned_addr learned my addr 172.21.15.102:0/2704406388 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.510+0000 7f2534c17640 1 -- 172.21.15.102:0/2704406388 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564791c276b0 con 0x564791b386a0 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.510+0000 7f2534c17640 1 --2- 172.21.15.102:0/2704406388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c270c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2524048360 tx=0x7f2524051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0b53e8fb36a3604 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.510+0000 7f2422e0d640 1 -- 172.21.15.102:0/2704406388 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f252400a200 con 0x564791b386a0 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.510+0000 7f2422e0d640 1 -- 172.21.15.102:0/2704406388 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2524065070 con 0x564791b386a0 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.510+0000 7f2422e0d640 1 -- 172.21.15.102:0/2704406388 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25240086e0 con 0x564791b386a0 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 -- 172.21.15.102:0/2704406388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 msgr2=0x564791c270c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 --2- 172.21.15.102:0/2704406388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c270c0 secure :-1 s=READY pgs=565 cs=0 l=1 rev1=1 crypto rx=0x7f2524048360 tx=0x7f2524051000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 -- 172.21.15.102:0/2704406388 shutdown_connections 2024-09-19T11:14:15.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 --2- 172.21.15.102:0/2704406388 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c270c0 unknown :-1 s=CLOSED pgs=565 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 -- 172.21.15.102:0/2704406388 >> 172.21.15.102:0/2704406388 conn(0x564791b33a70 msgr2=0x564791c22a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 -- 172.21.15.102:0/2704406388 shutdown_connections 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 -- 172.21.15.102:0/2704406388 wait complete. 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 Processor -- start 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 -- start start 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c32f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.511+0000 7f2538f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564791aabec0 con 0x564791b386a0 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c32f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c32f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38138/0 (socket says 172.21.15.102:38138) 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f2534c17640 1 -- 172.21.15.102:0/3425221000 learned_addr learned my addr 172.21.15.102:0/3425221000 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f2534c17640 1 -- 172.21.15.102:0/3425221000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564791c334a0 con 0x564791b386a0 2024-09-19T11:14:15.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f2534c17640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c32f40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2524000c00 tx=0x7f2524002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f242160a640 1 -- 172.21.15.102:0/3425221000 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f252404fcc0 con 0x564791b386a0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f242160a640 1 -- 172.21.15.102:0/3425221000 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252406a400 con 0x564791b386a0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f242160a640 1 -- 172.21.15.102:0/3425221000 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f252404fe60 con 0x564791b386a0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564791c33730 con 0x564791b386a0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.512+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564791c34340 con 0x564791b386a0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.513+0000 7f242160a640 1 -- 172.21.15.102:0/3425221000 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f252406a720 con 0x564791b386a0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.513+0000 7f242160a640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f241c03d000 0x7f241c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.513+0000 7f242160a640 1 -- 172.21.15.102:0/3425221000 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f252405d040 con 0x564791b386a0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.513+0000 7f252c416640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f241c03d000 0x7f241c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f2538f2a800 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791b398e0 0x564791c3a590 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c3aad0 con 0x564791b398e0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f2535418640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791b398e0 0x564791c3a590 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f252c416640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f241c03d000 0x7f241c03f4c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f251c001e30 tx=0x7f251c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f2535418640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791b398e0 0x564791c3a590 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f2535418640 1 -- 172.21.15.102:0/3425221000 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791b398e0 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c3ae70 con 0x564791b398e0 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f2535418640 1 -- 172.21.15.102:0/3425221000 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f253000a4d0 con 0x564791b398e0 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.514+0000 7f2538f2a800 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c3c930 0x564791c3edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.515+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c3f540 con 0x564791c3c930 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.515+0000 7f2534c17640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c3c930 0x564791c3edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.515+0000 7f2534c17640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c3c930 0x564791c3edb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.515+0000 7f2534c17640 1 -- 172.21.15.102:0/3425221000 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f2524072920 con 0x564791c3c930 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.515+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c3b6c0 con 0x564791b398e0 2024-09-19T11:14:15.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.516+0000 7f2535418640 1 -- 172.21.15.102:0/3425221000 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f253000a4d0 con 0x564791b398e0 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.516+0000 7f2538f2a800 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c409a0 0x564791c42d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.516+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c434d0 con 0x564791c409a0 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.516+0000 7f252c416640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c409a0 0x564791c42d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.516+0000 7f252c416640 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c409a0 0x564791c42d90 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.516+0000 7f252c416640 1 -- 172.21.15.102:0/3425221000 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f251c00bd50 con 0x564791c409a0 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2538f2a800 1 Processor -- start 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2538f2a800 1 -- start start 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2538f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c51210 0x564791c51630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2538f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564791a304a0 con 0x564791c51210 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c51210 0x564791c51630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c51210 0x564791c51630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38146/0 (socket says 172.21.15.102:38146) 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2534c17640 1 -- 172.21.15.102:0/2206277330 learned_addr learned my addr 172.21.15.102:0/2206277330 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2534c17640 1 -- 172.21.15.102:0/2206277330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564791c51c70 con 0x564791c51210 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.517+0000 7f2534c17640 1 --2- 172.21.15.102:0/2206277330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c51210 0x564791c51630 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2524096dc0 tx=0x7f25240726f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.518+0000 7f241a7fc640 1 -- 172.21.15.102:0/2206277330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2524098040 con 0x564791c51210 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.518+0000 7f241a7fc640 1 -- 172.21.15.102:0/2206277330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f252407b890 con 0x564791c51210 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.518+0000 7f2538f2a800 1 -- 172.21.15.102:0/2206277330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564791c524a0 con 0x564791c51210 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.518+0000 7f241a7fc640 1 -- 172.21.15.102:0/2206277330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f252408fbc0 con 0x564791c51210 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.518+0000 7f2538f2a800 1 -- 172.21.15.102:0/2206277330 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564791c52a40 con 0x564791c51210 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.518+0000 7f241a7fc640 1 -- 172.21.15.102:0/2206277330 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2524098b70 con 0x564791c51210 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.518+0000 7f241a7fc640 1 --2- 172.21.15.102:0/2206277330 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240c03d000 0x7f240c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f241a7fc640 1 -- 172.21.15.102:0/2206277330 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f2524086070 con 0x564791c51210 2024-09-19T11:14:15.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f252c416640 1 --2- 172.21.15.102:0/2206277330 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240c03d000 0x7f240c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f2538f2a800 1 Processor -- start 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f252c416640 1 --2- 172.21.15.102:0/2206277330 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240c03d000 0x7f240c03f4c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x564791c35020 tx=0x7f251c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f2538f2a800 1 -- start start 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f2538f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c5de90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f2538f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564791c27a20 con 0x564791c5da90 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c5de90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c5de90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38156/0 (socket says 172.21.15.102:38156) 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.519+0000 7f2534c17640 1 -- 172.21.15.102:0/1067321699 learned_addr learned my addr 172.21.15.102:0/1067321699 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.562 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2534c17640 1 -- 172.21.15.102:0/1067321699 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564791c5e480 con 0x564791c5da90 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2534c17640 1 --2- 172.21.15.102:0/1067321699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c5de90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2524075ff0 tx=0x7f2524057c80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e7411d712ae7da0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f240bfff640 1 -- 172.21.15.102:0/1067321699 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2524007bd0 con 0x564791c5da90 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f240bfff640 1 -- 172.21.15.102:0/1067321699 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25240573f0 con 0x564791c5da90 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f240bfff640 1 -- 172.21.15.102:0/1067321699 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2524007d70 con 0x564791c5da90 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2538f2a800 1 -- 172.21.15.102:0/1067321699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 msgr2=0x564791c5de90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2538f2a800 1 --2- 172.21.15.102:0/1067321699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c5de90 secure :-1 s=READY pgs=568 cs=0 l=1 rev1=1 crypto rx=0x7f2524075ff0 tx=0x7f2524057c80 comp rx=0 tx=0).stop 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2538f2a800 1 -- 172.21.15.102:0/1067321699 shutdown_connections 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2538f2a800 1 --2- 172.21.15.102:0/1067321699 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c5de90 unknown :-1 s=CLOSED pgs=568 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2538f2a800 1 -- 172.21.15.102:0/1067321699 >> 172.21.15.102:0/1067321699 conn(0x564791c59e90 msgr2=0x564791c580d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2538f2a800 1 -- 172.21.15.102:0/1067321699 shutdown_connections 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.520+0000 7f2538f2a800 1 -- 172.21.15.102:0/1067321699 wait complete. 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2538f2a800 1 Processor -- start 2024-09-19T11:14:15.563 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2538f2a800 1 -- start start 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2538f2a800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c64ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2538f2a800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564791c5e8f0 con 0x564791c5da90 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c64ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2534c17640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c64ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38160/0 (socket says 172.21.15.102:38160) 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 learned_addr learned my addr 172.21.15.102:0/983971373 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564791c65430 con 0x564791c5da90 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.521+0000 7f2534c17640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c64ed0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2524074f90 tx=0x7f252409af00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.522+0000 7f240a7fc640 1 -- 172.21.15.102:0/983971373 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f25240b1040 con 0x564791c5da90 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.522+0000 7f240a7fc640 1 -- 172.21.15.102:0/983971373 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f25240578a0 con 0x564791c5da90 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.522+0000 7f240a7fc640 1 -- 172.21.15.102:0/983971373 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2524099ab0 con 0x564791c5da90 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.522+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564791c65430 con 0x564791c5da90 2024-09-19T11:14:15.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.522+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564791c65430 con 0x564791c5da90 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.523+0000 7f240a7fc640 1 -- 172.21.15.102:0/983971373 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f25240be020 con 0x564791c5da90 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.523+0000 7f240a7fc640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240003cfb0 0x7f240003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.523+0000 7f240a7fc640 1 -- 172.21.15.102:0/983971373 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f25240bc020 con 0x564791c5da90 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.523+0000 7f252c416640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240003cfb0 0x7f240003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.523+0000 7f252c416640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240003cfb0 0x7f240003f470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x564791c438b0 tx=0x7f251c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.523+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.523+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791c70460 0x564791c72920 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.523+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c73070 con 0x564791c70460 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2535418640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791c70460 0x564791c72920 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2535418640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791c70460 0x564791c72920 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 20 realm 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c73480 con 0x564791c70460 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c73d50 con 0x564791c70460 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.524+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.525+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.525+0000 7f2538f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.525+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.525+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c74e50 0x564791c77240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.525+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c77800 con 0x564791c74e50 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.525+0000 7f2534c17640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c74e50 0x564791c77240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.525+0000 7f2534c17640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c74e50 0x564791c77240 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f2538f2a800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f2538f2a800 20 searching for the correct realm 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c797b0 0x564791c7bc70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c7c340 con 0x564791c797b0 2024-09-19T11:14:15.567 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f252c416640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c797b0 0x564791c7bc70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f252c416640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c797b0 0x564791c7bc70 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251c037040 con 0x564791c797b0 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f252c416640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f251c00f070 0x7f251c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c7c340 con 0x7f251c00f070 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.526+0000 7f2535418640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f251c00f070 0x7f251c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.527+0000 7f2535418640 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f251c00f070 0x7f251c02e910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.527+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.527+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c74e50 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.527+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.527+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.528+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.528+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.528+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.528+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c74e50 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.528+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.528+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c74e50 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.528+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.528+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x7f251c00f070 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c797b0 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251c037040 con 0x564791c797b0 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c74e50 2024-09-19T11:14:15.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.529+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x7f251c00f070 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c797b0 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251c037040 con 0x564791c797b0 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c797b0 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f251c037040 con 0x564791c797b0 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c74e50 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.530+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c797b0 2024-09-19T11:14:15.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.531+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251c037040 con 0x564791c797b0 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.531+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c797b0 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.531+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251c037040 con 0x564791c797b0 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.531+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.531+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.531+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.531+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.531+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c74e50 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.532+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.532+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c797b0 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.532+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251c037040 con 0x564791c797b0 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.532+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x7f251c00f070 2024-09-19T11:14:15.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.532+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.532+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.532+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.532+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c74e50 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c797b0 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251c037040 con 0x564791c797b0 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c74e50 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x7f251c00f070 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c797b0 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.533+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x7f251c00f070 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x564791c70460 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564791c740f0 con 0x7f251c00f070 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:15.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c780c0 con 0x564791c70460 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.534+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c780c0 con 0x564791c70460 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c780c0 con 0x564791c797b0 2024-09-19T11:14:15.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 20 zone default found 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 4 Realm: () 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 20 zonegroup default 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c789f0 con 0x564791c74e50 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c7e2e0 con 0x564791c797b0 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.535+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.536+0000 7f2538f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.536+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.536+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c7e770 con 0x564791c797b0 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.536+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.536+0000 7f2538f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.536+0000 7f2538f2a800 20 started sync module instance, tier type = 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.536+0000 7f2538f2a800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.536+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c7d650 con 0x7f251c00f070 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.537+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.537+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94865388460880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c7d650 con 0x7f251c00f070 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.537+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c7f2c0 con 0x564791c70460 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.538+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94865388460880] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.538+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.538+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94865388465552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c7d650 con 0x564791c70460 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.538+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c7fd50 con 0x564791c797b0 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.539+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94865388465552] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.539+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.539+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94865388458400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c7d5c0 con 0x564791c797b0 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.539+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c80c10 con 0x7f251c00f070 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.540+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.540+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94865388472640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c814b0 con 0x7f251c00f070 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.540+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c81f60 con 0x564791c70460 2024-09-19T11:14:15.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.540+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94865388458400] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.541+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.541+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94865388470592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c81f20 con 0x564791c70460 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.541+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c82970 con 0x564791c74e50 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.541+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94865388472640] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.542+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.542+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94865388479680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c82d60 con 0x564791c74e50 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.542+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c83720 con 0x564791c74e50 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.542+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94865388470592] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.543+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94865388479680] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.543+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.543+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94865388477040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c83720 con 0x564791c74e50 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.543+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c83ff0 con 0x564791c74e50 2024-09-19T11:14:15.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.544+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'177 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.544+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94865388477040] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.544+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94865388485360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c843c0 con 0x564791c74e50 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.544+0000 7f2538f2a800 20 add_watcher() i=0 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.545+0000 7f2538f2a800 20 add_watcher() i=1 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.545+0000 7f2538f2a800 20 add_watcher() i=2 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.545+0000 7f2538f2a800 20 add_watcher() i=3 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.545+0000 7f2538f2a800 20 add_watcher() i=4 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.545+0000 7f2538f2a800 20 add_watcher() i=5 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.545+0000 7f2538f2a800 20 add_watcher() i=6 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.546+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94865388485360] v37'178 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.546+0000 7f2538f2a800 20 add_watcher() i=7 2024-09-19T11:14:15.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.546+0000 7f2538f2a800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.546+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791c843c0 con 0x564791c70460 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.547+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.547+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94865388486416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c84c90 con 0x564791c70460 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.548+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94865388486416] v37'182 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.548+0000 7f23eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.548+0000 7f2538f2a800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.548+0000 7f2538f2a800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.548+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c8fd80 con 0x564791c70460 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.549+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.549+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c8fd80 con 0x564791c74e50 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.550+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.550+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c8fd80 con 0x564791c797b0 2024-09-19T11:14:15.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.551+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.551+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c90e20 con 0x564791c70460 2024-09-19T11:14:15.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.552+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'183 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.552+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c8f3f0 con 0x7f251c00f070 2024-09-19T11:14:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.553+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'62 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.553+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c8f3f0 con 0x564791c797b0 2024-09-19T11:14:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.554+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'42 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.554+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91b50 con 0x564791c70460 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.555+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.555+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91be0 con 0x564791c74e50 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.556+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'43 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.556+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91c70 con 0x7f251c00f070 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.557+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.557+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91c70 con 0x564791c797b0 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.558+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.558+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91d60 con 0x7f251c00f070 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.559+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'63 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.559+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91d60 con 0x564791c74e50 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.560+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.560+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91d00 con 0x7f251c00f070 2024-09-19T11:14:15.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.561+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.561+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91d00 con 0x564791c74e50 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.562+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'47 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.562+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91d00 con 0x564791c70460 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.563+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'184 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.563+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c91d00 con 0x564791c797b0 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.564+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'56 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.564+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c924b0 con 0x7f251c00f070 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.565+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'64 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.565+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c924b0 con 0x564791c797b0 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.566+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.566+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92490 con 0x564791c70460 2024-09-19T11:14:15.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.567+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'32 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.567+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92490 con 0x564791c70460 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.568+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'185 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.568+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92490 con 0x564791c797b0 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.569+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'57 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.569+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92490 con 0x7f251c00f070 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.570+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'34 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.570+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92490 con 0x564791c797b0 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.571+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'27 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.571+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92490 con 0x564791c797b0 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.572+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.572+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92490 con 0x564791c797b0 2024-09-19T11:14:15.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.573+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'20 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.573+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92490 con 0x564791c797b0 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.574+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'43 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.574+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92450 con 0x564791c74e50 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.575+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'26 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.575+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92450 con 0x564791c797b0 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.576+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'24 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.576+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92450 con 0x564791c74e50 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.577+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'44 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.577+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92450 con 0x564791c797b0 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.578+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'58 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.578+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92450 con 0x564791c74e50 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.579+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'48 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.579+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791c92450 con 0x7f251c00f070 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.580+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'30 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.580+0000 7f23e9fe3640 20 reqs_thread_entry: start 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 20 Filter name: none 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f235b7fe640 20 reqs_thread_entry: start 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:94 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cbd3c0 con 0x7f251c00f070 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(94 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv33 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:14:15.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 : miss 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.581+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:95 8.1 8:86db33a5:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cbeb90 con 0x564791c74e50 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(95 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 info.flags=0x17 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 to cache LRU end 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 4.2a 4:576602d9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c0e0 con 0x564791c70460 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(96 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:97 4.3d 4:bfff10c6:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x7f251c00f070 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(97 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.582+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 4.18 4:186a7410:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x7f251c00f070 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.583+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(98 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2 [call out=430b] v0'0 uv5 ondisk = 0) ==== 194+0+430 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.583+0000 7f2538f2a800 10 cls_bucket_list_unordered: got 9c8454ddf7aa50116496bac348d7550d 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.583+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:99 4.38 4:1d621ce7:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x564791c70460 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.583+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(99 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.583+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:100 4.2a 4:5582eb59:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x564791c70460 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.583+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(100 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.4 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.583+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:101 4.20 4:069525a9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x564791c70460 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.583+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(101 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.584+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:102 4.f 4:f2e8a7cc:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x564791c70460 2024-09-19T11:14:15.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.584+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(102 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.584+0000 7f2538f2a800 10 cls_bucket_list_unordered: got b1b9a972ccd8c962a473909b97007eb4 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.584+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:103 4.25 4:a65568ec:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x564791c797b0 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.584+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(103 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.584+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:104 4.10 4:0a036afe:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x564791c797b0 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(104 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8 [call out=429b] v0'0 uv3 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f2538f2a800 10 cls_bucket_list_unordered: got c785e1ed2950e3e36b1e2ca01f299a54 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:105 4.16 4:6bde935e:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c0e0 con 0x564791c797b0 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(105 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:106 4.3d 4:bc0a8537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3c120 con 0x7f251c00f070 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(106 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 [call out=701b] v0'0 uv14 ondisk = 0) ==== 195+0+701 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f2538f2a800 10 cls_bucket_list_unordered: got 24d27c169c2c881eb09a065116f2aa5c 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f2538f2a800 10 cls_bucket_list_unordered: got bb3aec0fdcdbc2974890f805c585d432 2024-09-19T11:14:15.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.585+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:107 3.20s0 3:07ccf30f:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_9c8454ddf7aa50116496bac348d7550d:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d39a70 con 0x7f251c00f070 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.586+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(107 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_9c8454ddf7aa50116496bac348d7550d [call out=24b,getxattrs out=879b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+919 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.586+0000 7f2538f2a800 10 manifest: total_size = 6 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.586+0000 7f2538f2a800 20 get_obj_state: setting s->obj_tag to 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10565663394008973398 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.586+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:9c8454ddf7aa50116496bac348d7550d state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.586+0000 7f2538f2a800 20 prepare_atomic_modification: state is not atomic. state=0x564791d3b578 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.586+0000 7f2538f2a800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.586+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:108 4.18 4:186a7410:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc0060 con 0x7f251c00f070 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.587+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(108 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2 [stat,call,call] v37'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.587+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:109 3.20s0 3:07ccf30f:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_9c8454ddf7aa50116496bac348d7550d:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc0060 con 0x7f251c00f070 2024-09-19T11:14:15.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.588+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 25 ==== osd_op_reply(109 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_9c8454ddf7aa50116496bac348d7550d [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.588+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:110 4.18 4:186a7410:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc4c00 con 0x7f251c00f070 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.588+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.588+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:111 3.26s0 3:6670632e:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_b1b9a972ccd8c962a473909b97007eb4:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f2530048000 con 0x7f251c00f070 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 26 ==== osd_op_reply(111 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_b1b9a972ccd8c962a473909b97007eb4 [call out=24b,getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+917 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f2538f2a800 10 manifest: total_size = 3 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f2538f2a800 20 get_obj_state: setting s->obj_tag to 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.1545945475933442941 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:b1b9a972ccd8c962a473909b97007eb4 state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f2538f2a800 20 prepare_atomic_modification: state is not atomic. state=0x564791d3b578 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f2538f2a800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:112 4.f 4:f2e8a7cc:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc9920 con 0x564791c70460 2024-09-19T11:14:15.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 27 ==== osd_op_reply(110 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2 [stat,call,call] v37'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.589+0000 7f240bfff640 20 handle_completion(): completion ok for obj=9c8454ddf7aa50116496bac348d7550d 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.590+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(112 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6 [stat,call,call] v37'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.590+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:113 3.26s0 3:6670632e:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_b1b9a972ccd8c962a473909b97007eb4:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc2be0 con 0x7f251c00f070 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.591+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 28 ==== osd_op_reply(113 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_b1b9a972ccd8c962a473909b97007eb4 [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.591+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:114 4.f 4:f2e8a7cc:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc58e0 con 0x564791c70460 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.591+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.591+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:115 3.as0 3:5130fe5f:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f253004a000 con 0x564791c797b0 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.592+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(115 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_c785e1ed2950e3e36b1e2ca01f299a54 [call out=24b,getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+917 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.592+0000 7f2538f2a800 10 manifest: total_size = 4 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.592+0000 7f2538f2a800 20 get_obj_state: setting s->obj_tag to 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7931131946624365820 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.592+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:c785e1ed2950e3e36b1e2ca01f299a54 state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.592+0000 7f2538f2a800 20 prepare_atomic_modification: state is not atomic. state=0x564791d3b578 2024-09-19T11:14:15.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.592+0000 7f2538f2a800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8 2024-09-19T11:14:15.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.592+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:116 4.10 4:0a036afe:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc58e0 con 0x564791c797b0 2024-09-19T11:14:15.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.593+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(114 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6 [stat,call,call] v37'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.593+0000 7f240b7fe640 20 handle_completion(): completion ok for obj=b1b9a972ccd8c962a473909b97007eb4 2024-09-19T11:14:15.615 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.593+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(116 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8 [stat,call,call] v37'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.593+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:117 3.as0 3:5130fe5f:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_c785e1ed2950e3e36b1e2ca01f299a54:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc9700 con 0x564791c797b0 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.594+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== osd_op_reply(117 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_c785e1ed2950e3e36b1e2ca01f299a54 [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.594+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:118 4.10 4:0a036afe:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc5430 con 0x564791c797b0 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:119 3.1fs0 3:f8eee721:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_24d27c169c2c881eb09a065116f2aa5c:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f251c03e000 con 0x564791c70460 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(119 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_24d27c169c2c881eb09a065116f2aa5c [call out=24b,getxattrs out=877b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 304+0+917 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2538f2a800 10 manifest: total_size = 5 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2538f2a800 20 get_obj_state: setting s->obj_tag to 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.2181690434180775490 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:24d27c169c2c881eb09a065116f2aa5c state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2538f2a800 20 prepare_atomic_modification: state is not atomic. state=0x564791d3b578 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2538f2a800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 2024-09-19T11:14:15.616 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.595+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:120 4.3d 4:bc0a8537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc53d0 con 0x7f251c00f070 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.596+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(118 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8 [stat,call,call] v37'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.596+0000 7f240bfff640 20 handle_completion(): completion ok for obj=c785e1ed2950e3e36b1e2ca01f299a54 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.597+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 29 ==== osd_op_reply(120 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 [stat,call,call] v37'15 uv15 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.597+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:121 3.1fs0 3:f8eee721:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_24d27c169c2c881eb09a065116f2aa5c:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc53d0 con 0x564791c70460 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.598+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(121 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_24d27c169c2c881eb09a065116f2aa5c [call] v37'2 uv2 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.598+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:122 4.3d 4:bc0a8537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc2880 con 0x7f251c00f070 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.598+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.598+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:123 3.27s0 3:e7d4631a:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_bb3aec0fdcdbc2974890f805c585d432:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f2530037000 con 0x564791c74e50 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.599+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(123 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_bb3aec0fdcdbc2974890f805c585d432 [call out=24b,getxattrs out=911b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+951 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.599+0000 7f2538f2a800 10 manifest: total_size = 5 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.599+0000 7f2538f2a800 20 get_obj_state: setting s->obj_tag to _aUs949oVNU8PpHbKp3pPZKh92K2PCME 2024-09-19T11:14:15.617 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.599+0000 7f2538f2a800 20 get_obj_state: octx=0x7f253000ab20 obj=myfoo:bb3aec0fdcdbc2974890f805c585d432 state=0x564791d3b578 s->prefetch_data=0 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.599+0000 7f2538f2a800 20 prepare_atomic_modification: state is not atomic. state=0x564791d3b578 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.599+0000 7f2538f2a800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.599+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:124 4.3d 4:bc0a8537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc29e0 con 0x7f251c00f070 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.600+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 30 ==== osd_op_reply(122 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 [stat,call,call] v37'16 uv16 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.600+0000 7f240b7fe640 20 handle_completion(): completion ok for obj=24d27c169c2c881eb09a065116f2aa5c 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.600+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 31 ==== osd_op_reply(124 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 [stat,call,call] v37'17 uv17 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.600+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:125 3.27s0 3:e7d4631a:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_bb3aec0fdcdbc2974890f805c585d432:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc29e0 con 0x564791c74e50 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(125 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5_bb3aec0fdcdbc2974890f805c585d432 [call] v37'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:126 4.3d 4:bc0a8537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d30 con 0x7f251c00f070 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2538f2a800 20 list_objects_ordered: starting attempt 1 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2538f2a800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T11:14:15.618 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:127 4.2a 4:576602d9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d30 con 0x564791c70460 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:128 4.3d 4:bfff10c6:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3b390 con 0x7f251c00f070 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:129 4.18 4:186a7410:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cce710 con 0x7f251c00f070 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:130 4.38 4:1d621ce7:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d30 con 0x564791c70460 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.603+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:131 4.2a 4:5582eb59:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3b390 con 0x564791c70460 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(127 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 32 ==== osd_op_reply(129 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:132 4.20 4:069525a9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3b390 con 0x564791c70460 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(131 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.4 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(130 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:133 4.f 4:f2e8a7cc:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d3b390 con 0x564791c70460 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:134 4.25 4:a65568ec:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cce710 con 0x564791c797b0 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:135 4.10 4:0a036afe:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd27d0 con 0x564791c797b0 2024-09-19T11:14:15.619 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:136 4.16 4:6bde935e:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd68c0 con 0x564791c797b0 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:137 4.3d 4:bc0a8537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd9670 con 0x7f251c00f070 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.604+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(132 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 33 ==== osd_op_reply(128 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 34 ==== osd_op_reply(134 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== osd_op_reply(133 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 35 ==== osd_op_reply(135 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 36 ==== osd_op_reply(136 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 34 ==== osd_op_reply(126 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 [stat,call,call] v37'18 uv18 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f240bfff640 20 handle_completion(): completion ok for obj=bb3aec0fdcdbc2974890f805c585d432 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 35 ==== osd_op_reply(137 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 [call out=128b] v0'0 uv18 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.620 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5])"; uploads.size()=0; is_truncated=0 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:138 4.2a 4:576602d9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd27d0 con 0x564791c70460 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:139 4.3d 4:bfff10c6:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd9670 con 0x7f251c00f070 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:140 4.18 4:186a7410:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x7f251c00f070 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:141 4.38 4:1d621ce7:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd8dd0 con 0x564791c70460 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:142 4.2a 4:5582eb59:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd27d0 con 0x564791c70460 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:143 4.20 4:069525a9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd9170 con 0x564791c70460 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:144 4.f 4:f2e8a7cc:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd8dd0 con 0x564791c70460 2024-09-19T11:14:15.621 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:145 4.25 4:a65568ec:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cccb40 con 0x564791c797b0 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:146 4.10 4:0a036afe:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd27d0 con 0x564791c797b0 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:147 4.16 4:6bde935e:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd9170 con 0x564791c797b0 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.605+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:148 4.3d 4:bc0a8537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791cd9670 con 0x7f251c00f070 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 37 ==== osd_op_reply(145 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 38 ==== osd_op_reply(147 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.9 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(138 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.0 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== osd_op_reply(141 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 43 ==== osd_op_reply(144 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 44 ==== osd_op_reply(142 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.4 [call out=89b] v0'0 uv6 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 45 ==== osd_op_reply(143 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 39 ==== osd_op_reply(146 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8 [call out=128b] v0'0 uv5 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.622 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 36 ==== osd_op_reply(139 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 37 ==== osd_op_reply(140 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 38 ==== osd_op_reply(148 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 [call out=128b] v0'0 uv18 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.606+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:149 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x7f251c00f070 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.607+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 39 ==== osd_op_reply(149 foo.buckets [call] v37'37 uv37 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.607+0000 7f2538f2a800 10 cache get: name=default.rgw.meta+root+myfoo : hit (requested=0x11, cached=0x11) 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.607+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:150 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x7f251c00f070 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.608+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 40 ==== osd_op_reply(150 myfoo [call,call,delete] v37'38 uv38 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.608+0000 7f2538f2a800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.608+0000 7f2538f2a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.608+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:151 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94865388835040 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c74e50 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.609+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== watch-notify(notify (1) cookie 94865388477040 notify 158913789977 ret 0) ==== 191+0+0 (crc 0 0 0) 0x564791cbe0a0 con 0x564791c74e50 2024-09-19T11:14:15.623 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.609+0000 7f240bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789977 cookie 94865388477040 notifier 4659 bl.length()=149 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.609+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(151 notify.6 [notify cookie 94865388835040 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.609+0000 7f240bfff640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:152 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f23f8003d60 con 0x564791c74e50 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.609+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(152 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.609+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== watch-notify(notify_complete (2) cookie 94865388835040 notify 158913789977 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564791c51c70 con 0x564791c74e50 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.609+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:153 8.1 8:86db33a5:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c74e50 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.610+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(153 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 [call,call,delete] v37'6 uv6 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.610+0000 7f2538f2a800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 from cache 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.610+0000 7f2538f2a800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5, ofs0, ns] 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.610+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:154 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94865388835040 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c74e50 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== watch-notify(notify (1) cookie 94865388477040 notify 158913789978 ret 0) ==== 248+0+0 (crc 0 0 0) 0x564791c51c70 con 0x564791c74e50 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f240bfff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789978 cookie 94865388477040 notifier 4659 bl.length()=206 2024-09-19T11:14:15.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(154 notify.6 [notify cookie 94865388835040 out=8b] v0'0 uv177 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f240bfff640 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:155 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f23f8003d60 con 0x564791c74e50 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== osd_op_reply(155 notify.6 [notify-ack] v0'0 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== watch-notify(notify_complete (2) cookie 94865388835040 notify 158913789978 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564791c34340 con 0x564791c74e50 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:156 4.2a 4:576602d9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c70460 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:157 4.3d 4:bfff10c6:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x7f251c00f070 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:158 4.18 4:186a7410:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cd90e0 con 0x7f251c00f070 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:159 4.38 4:1d621ce7:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c70460 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:160 4.2a 4:5582eb59:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x564791c70460 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:161 4.20 4:069525a9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cd90e0 con 0x564791c70460 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:162 4.f 4:f2e8a7cc:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c70460 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:163 4.25 4:a65568ec:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x564791c797b0 2024-09-19T11:14:15.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.611+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:164 4.10 4:0a036afe:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cd90e0 con 0x564791c797b0 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.612+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:165 4.16 4:6bde935e:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c797b0 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.612+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:166 4.3d 4:bc0a8537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x7f251c00f070 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.613+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 46 ==== osd_op_reply(161 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.5 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.613+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 40 ==== osd_op_reply(163 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.7 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.613+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 41 ==== osd_op_reply(158 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.2 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.614+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 41 ==== osd_op_reply(165 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.9 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.614+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 42 ==== osd_op_reply(157 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.1 [delete] v37'19 uv19 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.614+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 47 ==== osd_op_reply(156 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.0 [delete] v37'7 uv7 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.614+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 48 ==== osd_op_reply(160 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.4 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.614+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 49 ==== osd_op_reply(159 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.3 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.614+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 50 ==== osd_op_reply(162 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.6 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.614+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 42 ==== osd_op_reply(164 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.8 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.616+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 43 ==== osd_op_reply(166 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5.10 [delete] v37'20 uv20 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.616+0000 7f2538f2a800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 : miss 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.616+0000 7f2538f2a800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.616+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:167 6.1a 6:588ef172:::pubsub..bucket.myfoo%2f32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c797b0 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.617+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 43 ==== osd_op_reply(167 pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.617+0000 7f2538f2a800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.617+0000 7f2538f2a800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 info.flags=0x0 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.617+0000 7f2538f2a800 10 adding default.rgw.log++pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 to cache LRU end 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.617+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:168 6.1a 6:588ef172:::pubsub..bucket.myfoo%2f32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cd90e0 con 0x564791c797b0 2024-09-19T11:14:15.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.618+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 44 ==== osd_op_reply(168 pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.5 [delete] v37'25 uv21 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.618+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:169 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x7f251c00f070 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.619+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 44 ==== osd_op_reply(169 foo.buckets [call] v37'39 uv39 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.620+0000 7f23eafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.620+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:170 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94865388486416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c70460 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.621+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 51 ==== osd_op_reply(170 data_loggenerations_metadata [watch unwatch cookie 94865388486416] v37'186 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.621+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:171 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94865388460880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x7f251c00f070 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.621+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 45 ==== osd_op_reply(171 notify.0 [watch unwatch cookie 94865388460880] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.621+0000 7f2538f2a800 20 remove_watcher() i=0 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.621+0000 7f2538f2a800 2 removed watcher, disabling cache 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.621+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:172 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94865388465552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c70460 2024-09-19T11:14:15.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.622+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 52 ==== osd_op_reply(172 notify.1 [watch unwatch cookie 94865388465552] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.622+0000 7f2538f2a800 20 remove_watcher() i=1 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.623+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:173 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94865388458400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x564791c797b0 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.623+0000 7f252c416640 1 -- 172.21.15.102:0/983971373 <== osd.3 v2:172.21.15.102:6800/3957239017 45 ==== osd_op_reply(173 notify.2 [watch unwatch cookie 94865388458400] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f251c04a040 con 0x564791c797b0 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.623+0000 7f2538f2a800 20 remove_watcher() i=2 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.624+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:174 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94865388472640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x7f251c00f070 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.624+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.2 v2:172.21.15.102:6808/525557096 46 ==== osd_op_reply(174 notify.3 [watch unwatch cookie 94865388472640] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x7f251c00f070 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.624+0000 7f2538f2a800 20 remove_watcher() i=3 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.624+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:175 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94865388470592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x564791c70460 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.625+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 <== osd.1 v2:172.21.15.102:6816/3609322588 53 ==== osd_op_reply(175 notify.4 [watch unwatch cookie 94865388470592] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f253000a4d0 con 0x564791c70460 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.626+0000 7f2538f2a800 20 remove_watcher() i=4 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.626+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:176 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94865388479680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c74e50 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.627+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(176 notify.5 [watch unwatch cookie 94865388479680] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.627+0000 7f2538f2a800 20 remove_watcher() i=5 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.627+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:177 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94865388477040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791cc8d10 con 0x564791c74e50 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.627+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== osd_op_reply(177 notify.6 [watch unwatch cookie 94865388477040] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.628+0000 7f2538f2a800 20 remove_watcher() i=6 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.628+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:178 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94865388485360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564791d39d30 con 0x564791c74e50 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2534c17640 1 -- 172.21.15.102:0/983971373 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(178 notify.7 [watch unwatch cookie 94865388485360] v37'179 uv177 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f2524072920 con 0x564791c74e50 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 20 remove_watcher() i=7 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c74e50 msgr2=0x564791c77240 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c74e50 0x564791c77240 crc :-1 s=READY pgs=126 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791c70460 msgr2=0x564791c72920 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791c70460 0x564791c72920 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f251c00f070 msgr2=0x7f251c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f251c00f070 0x7f251c02e910 crc :-1 s=READY pgs=69 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c797b0 msgr2=0x564791c7bc70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c797b0 0x564791c7bc70 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240003cfb0 msgr2=0x7f240003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240003cfb0 0x7f240003f470 secure :-1 s=READY pgs=235 cs=0 l=1 rev1=1 crypto rx=0x564791c438b0 tx=0x7f251c010000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 msgr2=0x564791c64ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2535418640 1 -- 172.21.15.102:0/983971373 reap_dead start 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c64ed0 secure :-1 s=READY pgs=569 cs=0 l=1 rev1=1 crypto rx=0x7f2524074f90 tx=0x7f252409af00 comp rx=0 tx=0).stop 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 shutdown_connections 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/983971373 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c5da90 0x564791c64ed0 unknown :-1 s=CLOSED pgs=569 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 >> 172.21.15.102:0/983971373 conn(0x564791c59e90 msgr2=0x564791c580a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 shutdown_connections 2024-09-19T11:14:15.637 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/983971373 wait complete. 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/2206277330 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240c03d000 msgr2=0x7f240c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/2206277330 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240c03d000 0x7f240c03f4c0 secure :-1 s=READY pgs=234 cs=0 l=1 rev1=1 crypto rx=0x564791c35020 tx=0x7f251c00f000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/2206277330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c51210 msgr2=0x564791c51630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/2206277330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c51210 0x564791c51630 secure :-1 s=READY pgs=567 cs=0 l=1 rev1=1 crypto rx=0x7f2524096dc0 tx=0x7f25240726f0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/2206277330 shutdown_connections 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/2206277330 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f240c03d000 0x7f240c03f4c0 unknown :-1 s=CLOSED pgs=234 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 --2- 172.21.15.102:0/2206277330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791c51210 0x564791c51630 unknown :-1 s=CLOSED pgs=567 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/2206277330 >> 172.21.15.102:0/2206277330 conn(0x564791c455c0 msgr2=0x564791c459a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/2206277330 shutdown_connections 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.629+0000 7f2538f2a800 1 -- 172.21.15.102:0/2206277330 wait complete. 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c3c930 msgr2=0x564791c3edb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.638 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564791c3c930 0x564791c3edb0 crc :-1 s=READY pgs=125 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791b398e0 msgr2=0x564791c3a590 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564791b398e0 0x564791c3a590 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c409a0 msgr2=0x564791c42d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564791c409a0 0x564791c42d90 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f241c03d000 msgr2=0x7f241c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f241c03d000 0x7f241c03f4c0 secure :-1 s=READY pgs=233 cs=0 l=1 rev1=1 crypto rx=0x7f251c001e30 tx=0x7f251c001390 comp rx=0 tx=0).stop 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 msgr2=0x564791c32f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 --2- 172.21.15.102:0/3425221000 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564791b386a0 0x564791c32f40 secure :-1 s=READY pgs=566 cs=0 l=1 rev1=1 crypto rx=0x7f2524000c00 tx=0x7f2524002fb0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2535418640 1 -- 172.21.15.102:0/3425221000 reap_dead start 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 shutdown_connections 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 >> 172.21.15.102:0/3425221000 conn(0x564791b33a70 msgr2=0x564791c284b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 shutdown_connections 2024-09-19T11:14:15.639 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.630+0000 7f2538f2a800 1 -- 172.21.15.102:0/3425221000 wait complete. 2024-09-19T11:14:15.641 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-19T11:14:15.641 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'foo', '--caps', 'user=read'] 2024-09-19T11:14:15.641 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid foo --caps user=read 2024-09-19T11:14:15.687 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:15.687 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:15.688 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca6c926800 1 Processor -- start 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca6c926800 1 -- start start 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca6c926800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564e0eb62290 0x564e0ebf63e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca6c926800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e0ebf6920 con 0x564e0eb63620 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca6c926800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x564e0ea787d0 con 0x564e0eb62290 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca5ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564e0eb62290 0x564e0ebf63e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca5ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564e0eb62290 0x564e0ebf63e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38162/0 (socket says 172.21.15.102:38162) 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca5ffff640 1 -- 172.21.15.102:0/1116587085 learned_addr learned my addr 172.21.15.102:0/1116587085 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.687+0000 7fca68509640 1 --1- 172.21.15.102:0/1116587085 >> v1:172.21.15.37:6789/0 conn(0x564e0eb63620 0x564e0eb61a10 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36816/0 (socket says 172.21.15.102:36816) 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.688+0000 7fca5ffff640 1 -- 172.21.15.102:0/1116587085 >> v1:172.21.15.37:6789/0 conn(0x564e0eb63620 legacy=0x564e0eb61a10 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.688+0000 7fca5ffff640 1 -- 172.21.15.102:0/1116587085 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0ebf7b00 con 0x564e0eb62290 2024-09-19T11:14:15.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.689+0000 7fca5ffff640 1 --2- 172.21.15.102:0/1116587085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ebf63e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca5000a520 tx=0x7fca50045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d62245b56f97731a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.689+0000 7fca67d08640 1 -- 172.21.15.102:0/1116587085 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca50055070 con 0x564e0eb62290 2024-09-19T11:14:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.689+0000 7fca67d08640 1 -- 172.21.15.102:0/1116587085 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca500515b0 con 0x564e0eb62290 2024-09-19T11:14:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.689+0000 7fca67d08640 1 -- 172.21.15.102:0/1116587085 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca500518d0 con 0x564e0eb62290 2024-09-19T11:14:15.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.690+0000 7fca6c926800 1 -- 172.21.15.102:0/1116587085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 msgr2=0x564e0ebf63e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.690+0000 7fca6c926800 1 --2- 172.21.15.102:0/1116587085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ebf63e0 secure :-1 s=READY pgs=571 cs=0 l=1 rev1=1 crypto rx=0x7fca5000a520 tx=0x7fca50045ba0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.690+0000 7fca6c926800 1 -- 172.21.15.102:0/1116587085 shutdown_connections 2024-09-19T11:14:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.690+0000 7fca6c926800 1 --2- 172.21.15.102:0/1116587085 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ebf63e0 unknown :-1 s=CLOSED pgs=571 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.690+0000 7fca6c926800 1 -- 172.21.15.102:0/1116587085 >> 172.21.15.102:0/1116587085 conn(0x564e0ebe8c70 msgr2=0x564e0ebeb0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.690+0000 7fca6c926800 1 -- 172.21.15.102:0/1116587085 shutdown_connections 2024-09-19T11:14:15.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.690+0000 7fca6c926800 1 -- 172.21.15.102:0/1116587085 wait complete. 2024-09-19T11:14:15.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca6c926800 1 Processor -- start 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca6c926800 1 -- start start 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca6c926800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ecdf4e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca6c926800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e0ea85dd0 con 0x564e0eb62290 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ecdf4e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ecdf4e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38170/0 (socket says 172.21.15.102:38170) 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca68509640 1 -- 172.21.15.102:0/3310911786 learned_addr learned my addr 172.21.15.102:0/3310911786 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca68509640 1 -- 172.21.15.102:0/3310911786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0ecdfad0 con 0x564e0eb62290 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.704+0000 7fca68509640 1 --2- 172.21.15.102:0/3310911786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ecdf4e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca58001eb0 tx=0x7fca5800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=58de514373da69c4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fc95660c640 1 -- 172.21.15.102:0/3310911786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5800e5c0 con 0x564e0eb62290 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fc95660c640 1 -- 172.21.15.102:0/3310911786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca58006070 con 0x564e0eb62290 2024-09-19T11:14:15.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fc95660c640 1 -- 172.21.15.102:0/3310911786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5800e8b0 con 0x564e0eb62290 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fca6c926800 1 -- 172.21.15.102:0/3310911786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 msgr2=0x564e0ecdf4e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fca6c926800 1 --2- 172.21.15.102:0/3310911786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ecdf4e0 secure :-1 s=READY pgs=572 cs=0 l=1 rev1=1 crypto rx=0x7fca58001eb0 tx=0x7fca5800b6c0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fca6c926800 1 -- 172.21.15.102:0/3310911786 shutdown_connections 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fca6c926800 1 --2- 172.21.15.102:0/3310911786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ecdf4e0 unknown :-1 s=CLOSED pgs=572 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fca6c926800 1 -- 172.21.15.102:0/3310911786 >> 172.21.15.102:0/3310911786 conn(0x564e0ebe8c70 msgr2=0x564e0ecdae60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fca6c926800 1 -- 172.21.15.102:0/3310911786 shutdown_connections 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.705+0000 7fca6c926800 1 -- 172.21.15.102:0/3310911786 wait complete. 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca6c926800 1 Processor -- start 2024-09-19T11:14:15.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca6c926800 1 -- start start 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca6c926800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ece7050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca6c926800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e0ebf6df0 con 0x564e0eb62290 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ece7050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ece7050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38186/0 (socket says 172.21.15.102:38186) 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca68509640 1 -- 172.21.15.102:0/3286993557 learned_addr learned my addr 172.21.15.102:0/3286993557 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca68509640 1 -- 172.21.15.102:0/3286993557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0ece75b0 con 0x564e0eb62290 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.706+0000 7fca68509640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ece7050 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b700 tx=0x7fca58000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.707+0000 7fc954e09640 1 -- 172.21.15.102:0/3286993557 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5801a7c0 con 0x564e0eb62290 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.707+0000 7fc954e09640 1 -- 172.21.15.102:0/3286993557 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5801a960 con 0x564e0eb62290 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.707+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e0ece7840 con 0x564e0eb62290 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.707+0000 7fc954e09640 1 -- 172.21.15.102:0/3286993557 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5801acc0 con 0x564e0eb62290 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.707+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0ece8240 con 0x564e0eb62290 2024-09-19T11:14:15.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fc954e09640 1 -- 172.21.15.102:0/3286993557 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fca58017070 con 0x564e0eb62290 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fc954e09640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc95003d050 0x7fc95003f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fc954e09640 1 -- 172.21.15.102:0/3286993557 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fca58015020 con 0x564e0eb62290 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fca5ffff640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc95003d050 0x7fc95003f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fca6c926800 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0eb63620 0x564e0ecee6a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0eceebe0 con 0x564e0eb63620 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fca68d0a640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0eb63620 0x564e0ecee6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fca5ffff640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc95003d050 0x7fc95003f510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca50057000 tx=0x7fca50052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.708+0000 7fca68d0a640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0eb63620 0x564e0ecee6a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.709+0000 7fca68d0a640 1 -- 172.21.15.102:0/3286993557 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0eb63620 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.709+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0eceef80 con 0x564e0eb63620 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.709+0000 7fca68d0a640 1 -- 172.21.15.102:0/3286993557 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0eb63620 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.709+0000 7fca6c926800 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ecf0a80 0x564e0ecf2f00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.709+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ecf3690 con 0x564e0ecf0a80 2024-09-19T11:14:15.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.709+0000 7fca68509640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ecf0a80 0x564e0ecf2f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.710+0000 7fca68509640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ecf0a80 0x564e0ecf2f00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.710+0000 7fca68509640 1 -- 172.21.15.102:0/3286993557 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fca5802e070 con 0x564e0ecf0a80 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.710+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ecef7d0 con 0x564e0eb63620 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.710+0000 7fca68d0a640 1 -- 172.21.15.102:0/3286993557 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0eb63620 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.710+0000 7fca6c926800 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ecf4af0 0x564e0ecf6ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.710+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ecf7650 con 0x564e0ecf4af0 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.710+0000 7fca5ffff640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ecf4af0 0x564e0ecf6ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.710+0000 7fca5ffff640 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ecf4af0 0x564e0ecf6ee0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.711+0000 7fca5ffff640 1 -- 172.21.15.102:0/3286993557 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fca50057030 con 0x564e0ecf4af0 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.711+0000 7fca6c926800 1 Processor -- start 2024-09-19T11:14:15.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.711+0000 7fca6c926800 1 -- start start 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.711+0000 7fca6c926800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed05390 0x564e0ed057b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.711+0000 7fca6c926800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e0eae44a0 con 0x564e0ed05390 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.711+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed05390 0x564e0ed057b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.711+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed05390 0x564e0ed057b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38188/0 (socket says 172.21.15.102:38188) 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.711+0000 7fca68509640 1 -- 172.21.15.102:0/2435096335 learned_addr learned my addr 172.21.15.102:0/2435096335 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.712+0000 7fca68509640 1 -- 172.21.15.102:0/2435096335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0ed05df0 con 0x564e0ed05390 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.712+0000 7fca68509640 1 --2- 172.21.15.102:0/2435096335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed05390 0x564e0ed057b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fca5801be20 tx=0x7fca5801b960 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.712+0000 7fc94dffb640 1 -- 172.21.15.102:0/2435096335 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5804c7e0 con 0x564e0ed05390 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.712+0000 7fc94dffb640 1 -- 172.21.15.102:0/2435096335 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca5804c980 con 0x564e0ed05390 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.712+0000 7fc94dffb640 1 -- 172.21.15.102:0/2435096335 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca5804cca0 con 0x564e0ed05390 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.712+0000 7fca6c926800 1 -- 172.21.15.102:0/2435096335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e0ed06620 con 0x564e0ed05390 2024-09-19T11:14:15.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.712+0000 7fca6c926800 1 -- 172.21.15.102:0/2435096335 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0ed06bc0 con 0x564e0ed05390 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.713+0000 7fc94dffb640 1 -- 172.21.15.102:0/2435096335 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fca58054390 con 0x564e0ed05390 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.713+0000 7fc94dffb640 1 --2- 172.21.15.102:0/2435096335 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc94003d000 0x7fc94003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.713+0000 7fc94dffb640 1 -- 172.21.15.102:0/2435096335 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fca5803bf90 con 0x564e0ed05390 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.713+0000 7fca5ffff640 1 --2- 172.21.15.102:0/2435096335 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc94003d000 0x7fc94003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.713+0000 7fca6c926800 1 Processor -- start 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca5ffff640 1 --2- 172.21.15.102:0/2435096335 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc94003d000 0x7fc94003f4c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca50005930 tx=0x7fca50005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca6c926800 1 -- start start 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca6c926800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed11ff0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca6c926800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e0ecdff00 con 0x564e0ed11bf0 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed11ff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed11ff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38200/0 (socket says 172.21.15.102:38200) 2024-09-19T11:14:15.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca68509640 1 -- 172.21.15.102:0/3257310943 learned_addr learned my addr 172.21.15.102:0/3257310943 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca68509640 1 -- 172.21.15.102:0/3257310943 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0ed125e0 con 0x564e0ed11bf0 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fca68509640 1 --2- 172.21.15.102:0/3257310943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed11ff0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fca5800bfc0 tx=0x7fca58043580 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d3b02936d6067887 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fc93f7fe640 1 -- 172.21.15.102:0/3257310943 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca58036070 con 0x564e0ed11bf0 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fc93f7fe640 1 -- 172.21.15.102:0/3257310943 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca580419b0 con 0x564e0ed11bf0 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.714+0000 7fc93f7fe640 1 -- 172.21.15.102:0/3257310943 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca58054680 con 0x564e0ed11bf0 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 -- 172.21.15.102:0/3257310943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 msgr2=0x564e0ed11ff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 --2- 172.21.15.102:0/3257310943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed11ff0 secure :-1 s=READY pgs=575 cs=0 l=1 rev1=1 crypto rx=0x7fca5800bfc0 tx=0x7fca58043580 comp rx=0 tx=0).stop 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 -- 172.21.15.102:0/3257310943 shutdown_connections 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 --2- 172.21.15.102:0/3257310943 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed11ff0 unknown :-1 s=CLOSED pgs=575 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 -- 172.21.15.102:0/3257310943 >> 172.21.15.102:0/3257310943 conn(0x564e0ed0dff0 msgr2=0x564e0ed0c230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 -- 172.21.15.102:0/3257310943 shutdown_connections 2024-09-19T11:14:15.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 -- 172.21.15.102:0/3257310943 wait complete. 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 Processor -- start 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 -- start start 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed19010 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca6c926800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e0ed12a50 con 0x564e0ed11bf0 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.715+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed19010 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fca68509640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed19010 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38208/0 (socket says 172.21.15.102:38208) 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 learned_addr learned my addr 172.21.15.102:0/4231105440 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e0ed19570 con 0x564e0ed11bf0 2024-09-19T11:14:15.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fca68509640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed19010 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fca58001000 tx=0x7fca58028f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fc93dffb640 1 -- 172.21.15.102:0/4231105440 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca580193e0 con 0x564e0ed11bf0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fc93dffb640 1 -- 172.21.15.102:0/4231105440 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fca58041e40 con 0x564e0ed11bf0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e0ed19570 con 0x564e0ed11bf0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fc93dffb640 1 -- 172.21.15.102:0/4231105440 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fca58032da0 con 0x564e0ed11bf0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.716+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e0ed19b70 con 0x564e0ed11bf0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.717+0000 7fc93dffb640 1 -- 172.21.15.102:0/4231105440 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fca5805c020 con 0x564e0ed11bf0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.717+0000 7fc93dffb640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc93003d000 0x7fc93003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.717+0000 7fc93dffb640 1 -- 172.21.15.102:0/4231105440 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fca58067070 con 0x564e0ed11bf0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.717+0000 7fca5ffff640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc93003d000 0x7fc93003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.717+0000 7fca5ffff640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc93003d000 0x7fc93003f4c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fca50051990 tx=0x7fca5006d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0ed245a0 0x564e0ed26a60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed271b0 con 0x564e0ed245a0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca68d0a640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0ed245a0 0x564e0ed26a60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca68d0a640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0ed245a0 0x564e0ed26a60 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca6c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca6c926800 20 realm 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.718+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed275c0 con 0x564e0ed245a0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed27e90 con 0x564e0ed245a0 2024-09-19T11:14:15.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ed28f90 0x564e0ed2b380 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed2b940 con 0x564e0ed28f90 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.719+0000 7fca68509640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ed28f90 0x564e0ed2b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.720+0000 7fca68509640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ed28f90 0x564e0ed2b380 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.720+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.720+0000 7fca6c926800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.720+0000 7fca6c926800 20 searching for the correct realm 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.720+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ed2d8f0 0x564e0ed2fdb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.720+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed30480 con 0x564e0ed2d8f0 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.720+0000 7fca5ffff640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ed2d8f0 0x564e0ed2fdb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.720+0000 7fca5ffff640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ed2d8f0 0x564e0ed2fdb0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.721+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.721+0000 7fca5ffff640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fca50069040 0x7fca5008b940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.721+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed30480 con 0x7fca50069040 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.721+0000 7fca68d0a640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fca50069040 0x7fca5008b940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.721+0000 7fca68d0a640 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fca50069040 0x7fca5008b940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.721+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.721+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed28f90 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.722+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.722+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.722+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.722+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.722+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.722+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed28f90 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.722+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.722+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed28f90 2024-09-19T11:14:15.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.723+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.723+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x7fca50069040 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.723+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.723+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed2d8f0 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.723+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.723+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.723+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.723+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed28f90 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x7fca50069040 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed2d8f0 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed2d8f0 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.724+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed28f90 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.725+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.725+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed2d8f0 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.725+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.725+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed2d8f0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.726+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.726+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.726+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.726+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.726+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.726+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed28f90 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.726+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.726+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed2d8f0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x7fca50069040 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed28f90 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed2d8f0 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.727+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed28f90 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x7fca50069040 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed2d8f0 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x7fca50069040 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.728+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x564e0ed245a0 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed28230 con 0x7fca50069040 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed2c200 con 0x564e0ed245a0 2024-09-19T11:14:15.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed2c200 con 0x564e0ed245a0 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.729+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed2c200 con 0x564e0ed2d8f0 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 20 zone default found 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 4 Realm: () 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:15.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 20 zonegroup default 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed2caa0 con 0x564e0ed28f90 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed323f0 con 0x564e0ed2d8f0 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.730+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed327e0 con 0x564e0ed2d8f0 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.731+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.731+0000 7fca6c926800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.731+0000 7fca6c926800 20 started sync module instance, tier type = 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.731+0000 7fca6c926800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.731+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed31790 con 0x7fca50069040 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.732+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.732+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94893256154336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed31790 con 0x7fca50069040 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.732+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed332f0 con 0x564e0ed245a0 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.733+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94893256154336] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.733+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.733+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94893256158688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed332b0 con 0x564e0ed245a0 2024-09-19T11:14:15.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.733+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed33d70 con 0x564e0ed2d8f0 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.734+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94893256158688] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.734+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.734+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94893256161440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed34190 con 0x564e0ed2d8f0 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.734+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed34b50 con 0x7fca50069040 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.735+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94893256161440] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.735+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.735+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94893256165024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed34ac0 con 0x7fca50069040 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.735+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed35910 con 0x564e0ed245a0 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.736+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.736+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94893256168480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed35910 con 0x564e0ed245a0 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.736+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed36860 con 0x564e0ed28f90 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.739+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94893256165024] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x7fca50069040 2024-09-19T11:14:15.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.739+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94893256168480] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.739+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.739+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94893256170800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed34f70 con 0x564e0ed28f90 2024-09-19T11:14:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.739+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed37130 con 0x564e0ed28f90 2024-09-19T11:14:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.740+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(56 notify.6 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.740+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94893256176848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed37da0 con 0x564e0ed28f90 2024-09-19T11:14:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.740+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed387f0 con 0x564e0ed28f90 2024-09-19T11:14:15.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.740+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94893256170800] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'180 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94893256176848] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94893256180448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed36350 con 0x564e0ed28f90 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca6c926800 20 add_watcher() i=0 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca6c926800 20 add_watcher() i=1 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca6c926800 20 add_watcher() i=2 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca6c926800 20 add_watcher() i=3 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca6c926800 20 add_watcher() i=4 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca6c926800 20 add_watcher() i=5 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.741+0000 7fca6c926800 20 add_watcher() i=6 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.742+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94893256180448] v37'181 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.742+0000 7fca6c926800 20 add_watcher() i=7 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.742+0000 7fca6c926800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.742+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed3b7e0 con 0x564e0ed245a0 2024-09-19T11:14:15.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.743+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.743+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94893256177904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed38c60 con 0x564e0ed245a0 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94893256177904] v37'187 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fc91e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fca6c926800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fca6c926800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fca6c926800 5 note: GC not initialized 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fc91d7e2640 20 reqs_thread_entry: start 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fca6c926800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fca6c926800 20 Filter name: none 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.744+0000 7fc88effd640 20 reqs_thread_entry: start 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca6c926800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:14:15.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca6c926800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed6e550 con 0x564e0ed245a0 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv13 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca6c926800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca6c926800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca6c926800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca6c926800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.745+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~403 in=403b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed74570 con 0x564e0ed245a0 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~403] v37'14 uv14 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fca6000a4d0 con 0x564e0ed245a0 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fca6c926800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fca6c926800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fca6c926800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94893256425296 in=591b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed6fe70 con 0x564e0ed245a0 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94893256168480 notify 158913789974 ret 0) ==== 621+0+0 (crc 0 0 0) 0x7fca60018cd0 con 0x564e0ed245a0 2024-09-19T11:14:15.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fc93f7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789974 cookie 94893256168480 notifier 4666 bl.length()=579 2024-09-19T11:14:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(64 notify.4 [notify cookie 94893256425296 out=8b] v0'0 uv180 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fca60040040 con 0x564e0ed245a0 2024-09-19T11:14:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fc93f7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:14:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.746+0000 7fc93f7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:14:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.747+0000 7fc93f7fe640 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc92c003ea0 con 0x564e0ed245a0 2024-09-19T11:14:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.747+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca60040040 con 0x564e0ed245a0 2024-09-19T11:14:15.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.747+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94893256425296 notify 158913789974 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fca60026410 con 0x564e0ed245a0 2024-09-19T11:14:15.759 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[{"type":"user","perm":"read"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.748+0000 7fc91e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.748+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94893256177904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed6c410 con 0x564e0ed245a0 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.749+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94893256177904] v37'188 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fca60040040 con 0x564e0ed245a0 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.749+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94893256154336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed6c410 con 0x7fca50069040 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.750+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94893256154336] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca60040040 con 0x7fca50069040 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.750+0000 7fca6c926800 20 remove_watcher() i=0 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.750+0000 7fca6c926800 2 removed watcher, disabling cache 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.750+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94893256158688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed6c410 con 0x564e0ed245a0 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.751+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94893256158688] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca60040040 con 0x564e0ed245a0 2024-09-19T11:14:15.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.751+0000 7fca6c926800 20 remove_watcher() i=1 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.751+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94893256161440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed6c410 con 0x564e0ed2d8f0 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.752+0000 7fca5ffff640 1 -- 172.21.15.102:0/4231105440 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94893256161440] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca50057030 con 0x564e0ed2d8f0 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.752+0000 7fca6c926800 20 remove_watcher() i=2 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.752+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94893256165024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed338a0 con 0x7fca50069040 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.753+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94893256165024] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca60040040 con 0x7fca50069040 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.753+0000 7fca6c926800 20 remove_watcher() i=3 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.753+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94893256168480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed346a0 con 0x564e0ed245a0 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.754+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94893256168480] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca60040040 con 0x564e0ed245a0 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.754+0000 7fca6c926800 20 remove_watcher() i=4 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.754+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94893256170800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed346a0 con 0x564e0ed28f90 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.755+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94893256170800] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.755+0000 7fca6c926800 20 remove_watcher() i=5 2024-09-19T11:14:15.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.755+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94893256176848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed35d30 con 0x564e0ed28f90 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.756+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94893256176848] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.756+0000 7fca6c926800 20 remove_watcher() i=6 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.756+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94893256180448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e0ed346a0 con 0x564e0ed28f90 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca68509640 1 -- 172.21.15.102:0/4231105440 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94893256180448] v37'182 uv180 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fca58038070 con 0x564e0ed28f90 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 20 remove_watcher() i=7 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ed28f90 msgr2=0x564e0ed2b380 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ed28f90 0x564e0ed2b380 crc :-1 s=READY pgs=128 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0ed245a0 msgr2=0x564e0ed26a60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0ed245a0 0x564e0ed26a60 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fca50069040 msgr2=0x7fca5008b940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fca50069040 0x7fca5008b940 crc :-1 s=READY pgs=70 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ed2d8f0 msgr2=0x564e0ed2fdb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ed2d8f0 0x564e0ed2fdb0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc93003d000 msgr2=0x7fc93003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc93003d000 0x7fc93003f4c0 secure :-1 s=READY pgs=238 cs=0 l=1 rev1=1 crypto rx=0x7fca50051990 tx=0x7fca5006d040 comp rx=0 tx=0).stop 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 msgr2=0x564e0ed19010 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca6c926800 1 --2- 172.21.15.102:0/4231105440 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed11bf0 0x564e0ed19010 secure :-1 s=READY pgs=576 cs=0 l=1 rev1=1 crypto rx=0x7fca58001000 tx=0x7fca58028f50 comp rx=0 tx=0).stop 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.757+0000 7fca68d0a640 1 -- 172.21.15.102:0/4231105440 reap_dead start 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 shutdown_connections 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 >> 172.21.15.102:0/4231105440 conn(0x564e0ed0dff0 msgr2=0x564e0ed0c200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 shutdown_connections 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/4231105440 wait complete. 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/2435096335 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc94003d000 msgr2=0x7fc94003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/2435096335 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc94003d000 0x7fc94003f4c0 secure :-1 s=READY pgs=237 cs=0 l=1 rev1=1 crypto rx=0x7fca50005930 tx=0x7fca50005ac0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/2435096335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed05390 msgr2=0x564e0ed057b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/2435096335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed05390 0x564e0ed057b0 secure :-1 s=READY pgs=574 cs=0 l=1 rev1=1 crypto rx=0x7fca5801be20 tx=0x7fca5801b960 comp rx=0 tx=0).stop 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/2435096335 shutdown_connections 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/2435096335 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc94003d000 0x7fc94003f4c0 unknown :-1 s=CLOSED pgs=237 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/2435096335 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0ed05390 0x564e0ed057b0 unknown :-1 s=CLOSED pgs=574 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/2435096335 >> 172.21.15.102:0/2435096335 conn(0x564e0ecf9740 msgr2=0x564e0ecf9b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/2435096335 shutdown_connections 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/2435096335 wait complete. 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ecf0a80 msgr2=0x564e0ecf2f00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e0ecf0a80 0x564e0ecf2f00 crc :-1 s=READY pgs=127 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0eb63620 msgr2=0x564e0ecee6a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e0eb63620 0x564e0ecee6a0 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ecf4af0 msgr2=0x564e0ecf6ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e0ecf4af0 0x564e0ecf6ee0 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc95003d050 msgr2=0x7fc95003f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc95003d050 0x7fc95003f510 secure :-1 s=READY pgs=236 cs=0 l=1 rev1=1 crypto rx=0x7fca50057000 tx=0x7fca50052000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 msgr2=0x564e0ece7050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 --2- 172.21.15.102:0/3286993557 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e0eb62290 0x564e0ece7050 secure :-1 s=READY pgs=573 cs=0 l=1 rev1=1 crypto rx=0x7fca5800b700 tx=0x7fca58000bc0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca68d0a640 1 -- 172.21.15.102:0/3286993557 reap_dead start 2024-09-19T11:14:15.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 shutdown_connections 2024-09-19T11:14:15.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.758+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 >> 172.21.15.102:0/3286993557 conn(0x564e0ebe8c70 msgr2=0x564e0ece09d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.759+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 shutdown_connections 2024-09-19T11:14:15.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.759+0000 7fca6c926800 1 -- 172.21.15.102:0/3286993557 wait complete. 2024-09-19T11:14:15.771 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [{'type': 'user', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:14:15.771 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-19T11:14:15.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'foo', '--caps', 'user=read'] 2024-09-19T11:14:15.772 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid foo --caps user=read 2024-09-19T11:14:15.818 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:15.818 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:15.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.817+0000 7f59b1922800 1 Processor -- start 2024-09-19T11:14:15.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.817+0000 7f59b1922800 1 -- start start 2024-09-19T11:14:15.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f59b1922800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ba6531bab0 0x55ba6531df70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f59b1922800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ba6531e5f0 con 0x55ba65317eb0 2024-09-19T11:14:15.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f59b1922800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55ba651a27d0 con 0x55ba6531bab0 2024-09-19T11:14:15.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f59acdd1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ba6531bab0 0x55ba6531df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f59ad5d2640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55ba65317eb0 0x55ba6531a2a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36830/0 (socket says 172.21.15.102:36830) 2024-09-19T11:14:15.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3930046947 learned_addr learned my addr 172.21.15.102:0/3930046947 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:15.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f59acdd1640 1 -- 172.21.15.102:0/3930046947 >> v1:172.21.15.37:6789/0 conn(0x55ba65317eb0 legacy=0x55ba6531a2a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f59acdd1640 1 -- 172.21.15.102:0/3930046947 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba6531f820 con 0x55ba6531bab0 2024-09-19T11:14:15.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.818+0000 7f599ffff640 1 -- 172.21.15.102:0/3930046947 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3107178112 0 0) 0x55ba6531e5f0 con 0x55ba65317eb0 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.820+0000 7f59acdd1640 1 --2- 172.21.15.102:0/3930046947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 0x55ba6531df70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f59a400a470 tx=0x7f59a4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9bf2d05d54d27f09 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.820+0000 7f599ffff640 1 -- 172.21.15.102:0/3930046947 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a4053570 con 0x55ba6531bab0 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.820+0000 7f599ffff640 1 -- 172.21.15.102:0/3930046947 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a4058070 con 0x55ba6531bab0 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.820+0000 7f599ffff640 1 -- 172.21.15.102:0/3930046947 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a4053880 con 0x55ba6531bab0 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.820+0000 7f59b1922800 1 -- 172.21.15.102:0/3930046947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 msgr2=0x55ba6531df70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.821+0000 7f59b1922800 1 --2- 172.21.15.102:0/3930046947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 0x55ba6531df70 secure :-1 s=READY pgs=578 cs=0 l=1 rev1=1 crypto rx=0x7f59a400a470 tx=0x7f59a4045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.821+0000 7f59b1922800 1 -- 172.21.15.102:0/3930046947 shutdown_connections 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.821+0000 7f59b1922800 1 --2- 172.21.15.102:0/3930046947 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 0x55ba6531df70 unknown :-1 s=CLOSED pgs=578 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.821+0000 7f59b1922800 1 -- 172.21.15.102:0/3930046947 >> 172.21.15.102:0/3930046947 conn(0x55ba65311a70 msgr2=0x55ba65313ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.821+0000 7f59b1922800 1 -- 172.21.15.102:0/3930046947 shutdown_connections 2024-09-19T11:14:15.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.821+0000 7f59b1922800 1 -- 172.21.15.102:0/3930046947 wait complete. 2024-09-19T11:14:15.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.834+0000 7f59b1922800 1 Processor -- start 2024-09-19T11:14:15.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.834+0000 7f59b1922800 1 -- start start 2024-09-19T11:14:15.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.834+0000 7f59b1922800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65317eb0 0x55ba65407190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.834+0000 7f59b1922800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ba651afdd0 con 0x55ba65317eb0 2024-09-19T11:14:15.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.835+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65317eb0 0x55ba65407190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.835+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65317eb0 0x55ba65407190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38228/0 (socket says 172.21.15.102:38228) 2024-09-19T11:14:15.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.835+0000 7f59ad5d2640 1 -- 172.21.15.102:0/2926431181 learned_addr learned my addr 172.21.15.102:0/2926431181 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.835+0000 7f59ad5d2640 1 -- 172.21.15.102:0/2926431181 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba65407780 con 0x55ba65317eb0 2024-09-19T11:14:15.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.835+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/2926431181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65317eb0 0x55ba65407190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f59a0001ea0 tx=0x7f59a000b6a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63e210028d8b96ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.835+0000 7f589b606640 1 -- 172.21.15.102:0/2926431181 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a0008070 con 0x55ba65317eb0 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.835+0000 7f589b606640 1 -- 172.21.15.102:0/2926431181 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a000d500 con 0x55ba65317eb0 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.835+0000 7f589b606640 1 -- 172.21.15.102:0/2926431181 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a000d880 con 0x55ba65317eb0 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 -- 172.21.15.102:0/2926431181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65317eb0 msgr2=0x55ba65407190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 --2- 172.21.15.102:0/2926431181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65317eb0 0x55ba65407190 secure :-1 s=READY pgs=579 cs=0 l=1 rev1=1 crypto rx=0x7f59a0001ea0 tx=0x7f59a000b6a0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 -- 172.21.15.102:0/2926431181 shutdown_connections 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 --2- 172.21.15.102:0/2926431181 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65317eb0 0x55ba65407190 unknown :-1 s=CLOSED pgs=579 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 -- 172.21.15.102:0/2926431181 >> 172.21.15.102:0/2926431181 conn(0x55ba65311a70 msgr2=0x55ba65402b10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 -- 172.21.15.102:0/2926431181 shutdown_connections 2024-09-19T11:14:15.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 -- 172.21.15.102:0/2926431181 wait complete. 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 Processor -- start 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.836+0000 7f59b1922800 1 -- start start 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f59b1922800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 0x55ba6540ef00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f59b1922800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ba6531eac0 con 0x55ba6531bab0 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 0x55ba6540ef00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 0x55ba6540ef00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38236/0 (socket says 172.21.15.102:38236) 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f59ad5d2640 1 -- 172.21.15.102:0/2339550418 learned_addr learned my addr 172.21.15.102:0/2339550418 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f59ad5d2640 1 -- 172.21.15.102:0/2339550418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba6540f460 con 0x55ba6531bab0 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 0x55ba6540ef00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x55ba65408120 tx=0x7f59a0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f5899e03640 1 -- 172.21.15.102:0/2339550418 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a000de50 con 0x55ba6531bab0 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f5899e03640 1 -- 172.21.15.102:0/2339550418 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a000f830 con 0x55ba6531bab0 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba6540f6f0 con 0x55ba6531bab0 2024-09-19T11:14:15.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.837+0000 7f5899e03640 1 -- 172.21.15.102:0/2339550418 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a000fb10 con 0x55ba6531bab0 2024-09-19T11:14:15.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.838+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba654100f0 con 0x55ba6531bab0 2024-09-19T11:14:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.838+0000 7f5899e03640 1 -- 172.21.15.102:0/2339550418 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f59a0017040 con 0x55ba6531bab0 2024-09-19T11:14:15.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.838+0000 7f5899e03640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f589403d1a0 0x7f589403f660 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f5899e03640 1 -- 172.21.15.102:0/2339550418 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f59a0015020 con 0x55ba6531bab0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f59acdd1640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f589403d1a0 0x7f589403f660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f59b1922800 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba65410bf0 0x55ba65416550 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65416ae0 con 0x55ba65410bf0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f59addd3640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba65410bf0 0x55ba65416550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f59acdd1640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f589403d1a0 0x7f589403f660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59a4057000 tx=0x7f59a4052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f59addd3640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba65410bf0 0x55ba65416550 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f59addd3640 1 -- 172.21.15.102:0/2339550418 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba65410bf0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.839+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba654105a0 con 0x55ba65410bf0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.840+0000 7f59addd3640 1 -- 172.21.15.102:0/2339550418 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba65410bf0 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.840+0000 7f59b1922800 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65418e30 0x55ba6541b220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.840+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba6541b8f0 con 0x55ba65418e30 2024-09-19T11:14:15.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.840+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65418e30 0x55ba6541b220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.840+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65418e30 0x55ba6541b220 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.841+0000 7f59ad5d2640 1 -- 172.21.15.102:0/2339550418 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f59a002d070 con 0x55ba65418e30 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.841+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65417cd0 con 0x55ba65410bf0 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.841+0000 7f59addd3640 1 -- 172.21.15.102:0/2339550418 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba65410bf0 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.841+0000 7f59b1922800 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba6541cd30 0x55ba6541f120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.841+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba6541f890 con 0x55ba6541cd30 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.841+0000 7f59acdd1640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba6541cd30 0x55ba6541f120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.841+0000 7f59acdd1640 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba6541cd30 0x55ba6541f120 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.841+0000 7f59acdd1640 1 -- 172.21.15.102:0/2339550418 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f59a4051070 con 0x55ba6541cd30 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.842+0000 7f59b1922800 1 Processor -- start 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.842+0000 7f59b1922800 1 -- start start 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.842+0000 7f59b1922800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6542d5d0 0x55ba6542d9f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.842+0000 7f59b1922800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ba6520e4a0 con 0x55ba6542d5d0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.842+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6542d5d0 0x55ba6542d9f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.842+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6542d5d0 0x55ba6542d9f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38244/0 (socket says 172.21.15.102:38244) 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.842+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3926376310 learned_addr learned my addr 172.21.15.102:0/3926376310 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.842+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3926376310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba6542e030 con 0x55ba6542d5d0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.843+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/3926376310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6542d5d0 0x55ba6542d9f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f59a0019ca0 tx=0x7f59a000ef40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.843+0000 7f5892ffd640 1 -- 172.21.15.102:0/3926376310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a0041030 con 0x55ba6542d5d0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.843+0000 7f5892ffd640 1 -- 172.21.15.102:0/3926376310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a0042040 con 0x55ba6542d5d0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.843+0000 7f59b1922800 1 -- 172.21.15.102:0/3926376310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba6542e860 con 0x55ba6542d5d0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.843+0000 7f5892ffd640 1 -- 172.21.15.102:0/3926376310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a0018980 con 0x55ba6542d5d0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.843+0000 7f59b1922800 1 -- 172.21.15.102:0/3926376310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba6542ee00 con 0x55ba6542d5d0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.843+0000 7f5892ffd640 1 -- 172.21.15.102:0/3926376310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f59a0018b20 con 0x55ba6542d5d0 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f5892ffd640 1 --2- 172.21.15.102:0/3926376310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f588403d000 0x7f588403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f5892ffd640 1 -- 172.21.15.102:0/3926376310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f59a003e410 con 0x55ba6542d5d0 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59acdd1640 1 --2- 172.21.15.102:0/3926376310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f588403d000 0x7f588403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59b1922800 1 Processor -- start 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59b1922800 1 -- start start 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59acdd1640 1 --2- 172.21.15.102:0/3926376310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f588403d000 0x7f588403f4c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55ba6541fc90 tx=0x7f59a4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59b1922800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba6543a270 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59b1922800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ba65407bb0 con 0x55ba65439e70 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba6543a270 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba6543a270 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38260/0 (socket says 172.21.15.102:38260) 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.844+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3670547347 learned_addr learned my addr 172.21.15.102:0/3670547347 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3670547347 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba6543a860 con 0x55ba65439e70 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/3670547347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba6543a270 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f59a000efd0 tx=0x7f59a00266d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=261dfffedeabe576 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f5890ff9640 1 -- 172.21.15.102:0/3670547347 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a0026e40 con 0x55ba65439e70 2024-09-19T11:14:15.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f5890ff9640 1 -- 172.21.15.102:0/3670547347 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a00269b0 con 0x55ba65439e70 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f5890ff9640 1 -- 172.21.15.102:0/3670547347 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a0054530 con 0x55ba65439e70 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59b1922800 1 -- 172.21.15.102:0/3670547347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 msgr2=0x55ba6543a270 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59b1922800 1 --2- 172.21.15.102:0/3670547347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba6543a270 secure :-1 s=READY pgs=582 cs=0 l=1 rev1=1 crypto rx=0x7f59a000efd0 tx=0x7f59a00266d0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59b1922800 1 -- 172.21.15.102:0/3670547347 shutdown_connections 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59b1922800 1 --2- 172.21.15.102:0/3670547347 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba6543a270 unknown :-1 s=CLOSED pgs=582 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59b1922800 1 -- 172.21.15.102:0/3670547347 >> 172.21.15.102:0/3670547347 conn(0x55ba65436270 msgr2=0x55ba654344b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59b1922800 1 -- 172.21.15.102:0/3670547347 shutdown_connections 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.845+0000 7f59b1922800 1 -- 172.21.15.102:0/3670547347 wait complete. 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.846+0000 7f59b1922800 1 Processor -- start 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.846+0000 7f59b1922800 1 -- start start 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.846+0000 7f59b1922800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba65441280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.846+0000 7f59b1922800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ba6543acd0 con 0x55ba65439e70 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.846+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba65441280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.846+0000 7f59ad5d2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba65441280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38272/0 (socket says 172.21.15.102:38272) 2024-09-19T11:14:15.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.846+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 learned_addr learned my addr 172.21.15.102:0/3066562833 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.846+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ba654417e0 con 0x55ba65439e70 2024-09-19T11:14:15.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.847+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba65441280 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f59a000efd0 tx=0x7f59a003c6b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.847+0000 7f5882ffd640 1 -- 172.21.15.102:0/3066562833 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a0066020 con 0x55ba65439e70 2024-09-19T11:14:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.847+0000 7f5882ffd640 1 -- 172.21.15.102:0/3066562833 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f59a003e1a0 con 0x55ba65439e70 2024-09-19T11:14:15.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.847+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ba654417e0 con 0x55ba65439e70 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.847+0000 7f5882ffd640 1 -- 172.21.15.102:0/3066562833 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f59a003b1e0 con 0x55ba65439e70 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.847+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ba654417e0 con 0x55ba65439e70 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.848+0000 7f5882ffd640 1 -- 172.21.15.102:0/3066562833 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f59a0069020 con 0x55ba65439e70 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.848+0000 7f5882ffd640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f587803d000 0x7f587803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.848+0000 7f5882ffd640 1 -- 172.21.15.102:0/3066562833 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f59a005c070 con 0x55ba65439e70 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.848+0000 7f59acdd1640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f587803d000 0x7f587803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.848+0000 7f59acdd1640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f587803d000 0x7f587803f4c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f59a4077040 tx=0x7f59a4053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.848+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba6544c8a0 0x55ba6544ed60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba6544f4b0 con 0x55ba6544c8a0 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59addd3640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba6544c8a0 0x55ba6544ed60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59addd3640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba6544c8a0 0x55ba6544ed60 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 20 realm 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba6544f8c0 con 0x55ba6544c8a0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.849+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450190 con 0x55ba6544c8a0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59b1922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59b1922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65451290 0x55ba65453680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65453c40 con 0x55ba65451290 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65451290 0x55ba65453680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.850+0000 7f59ad5d2640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65451290 0x55ba65453680 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59b1922800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:15.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59b1922800 20 searching for the correct realm 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba65455bf0 0x55ba654580b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65458780 con 0x55ba65455bf0 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59acdd1640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba65455bf0 0x55ba654580b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59acdd1640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba65455bf0 0x55ba654580b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59acdd1640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f59a405f040 0x7f59a405f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65458780 con 0x7f59a405f040 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.851+0000 7f59addd3640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f59a405f040 0x7f59a405f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.852+0000 7f59addd3640 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f59a405f040 0x7f59a405f930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.852+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.852+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65451290 2024-09-19T11:14:15.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.852+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.852+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.852+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.852+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.853+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.853+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65451290 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.853+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.853+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65451290 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.853+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.853+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x7f59a405f040 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.853+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.853+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65455bf0 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.854+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.854+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.854+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.854+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65451290 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.854+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.854+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.854+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.854+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x7f59a405f040 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.855+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.855+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65455bf0 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.855+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.855+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65455bf0 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.855+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.855+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65451290 2024-09-19T11:14:15.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.855+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.855+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65455bf0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65455bf0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65451290 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.856+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65455bf0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.857+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.857+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x7f59a405f040 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.857+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.857+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.857+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.857+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65451290 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.857+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65455bf0 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65451290 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x7f59a405f040 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba65455bf0 2024-09-19T11:14:15.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.858+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x7f59a405f040 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x55ba6544c8a0 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ba65450530 con 0x7f59a405f040 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65454500 con 0x55ba6544c8a0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.859+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65454500 con 0x55ba6544c8a0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65454500 con 0x55ba65455bf0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 20 zone default found 2024-09-19T11:14:15.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 4 Realm: () 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 20 zonegroup default 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65454e10 con 0x55ba65451290 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.860+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545a6f0 con 0x55ba65455bf0 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59b1922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545ab80 con 0x55ba65455bf0 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59b1922800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59b1922800 20 started sync module instance, tier type = 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59b1922800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.861+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba65459a90 con 0x7f59a405f040 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.862+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.862+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94259051339744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba65459a90 con 0x7f59a405f040 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.862+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545b660 con 0x55ba6544c8a0 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.863+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.863+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94259051339744] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.863+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94259051344208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545b660 con 0x55ba6544c8a0 2024-09-19T11:14:15.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.863+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba65459640 con 0x55ba65455bf0 2024-09-19T11:14:15.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.864+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94259051344208] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.864+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.864+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94259051346560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545c5d0 con 0x55ba65455bf0 2024-09-19T11:14:15.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.864+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545cf90 con 0x7f59a405f040 2024-09-19T11:14:15.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.865+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94259051346560] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.865+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.865+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94259051350752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545d3b0 con 0x7f59a405f040 2024-09-19T11:14:15.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.865+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545dd70 con 0x55ba6544c8a0 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.866+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94259051350752] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x7f59a405f040 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.867+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.867+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94259051352288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545dd70 con 0x55ba6544c8a0 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.867+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545e730 con 0x55ba65451290 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.868+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.868+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94259051356800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545ef80 con 0x55ba65451290 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.868+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545f9e0 con 0x55ba65451290 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.868+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94259051352288] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.869+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94259051356800] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.869+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.869+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94259051354304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6545fd80 con 0x55ba65451290 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.869+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba65460610 con 0x55ba65451290 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94259051354304] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'183 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94259051363712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba65460650 con 0x55ba65451290 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59b1922800 20 add_watcher() i=0 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59b1922800 20 add_watcher() i=1 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59b1922800 20 add_watcher() i=2 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59b1922800 20 add_watcher() i=3 2024-09-19T11:14:15.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59b1922800 20 add_watcher() i=4 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59b1922800 20 add_watcher() i=5 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.870+0000 7f59b1922800 20 add_watcher() i=6 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.871+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94259051363712] v37'184 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.871+0000 7f59b1922800 20 add_watcher() i=7 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.871+0000 7f59b1922800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.871+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba654639d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.871+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.871+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94259051377584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654607c0 con 0x55ba6544c8a0 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.872+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94259051377584] v37'189 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.872+0000 7f5863fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.872+0000 7f59b1922800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.872+0000 7f59b1922800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:15.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.873+0000 7f59b1922800 5 note: GC not initialized 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.873+0000 7f5862fe5640 20 reqs_thread_entry: start 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.873+0000 7f59b1922800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.873+0000 7f59b1922800 20 Filter name: none 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.873+0000 7f5860fe1640 20 reqs_thread_entry: start 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.873+0000 7f59b1922800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.873+0000 7f59b1922800 20 rados->read ofs=0 len=0 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.873+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba654968e0 con 0x55ba6544c8a0 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.874+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~403 out=403b,getxattrs out=75b] v0'0 uv14 ondisk = 0) ==== 231+0+526 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.874+0000 7f59b1922800 20 rados_obj.operate() r=0 bl.length=403 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.874+0000 7f59b1922800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.874+0000 7f59b1922800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:14:15.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.874+0000 7f59b1922800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.874+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1e6ca5ed:users.uid::foo:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~391 in=391b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba6549c970 con 0x55ba6544c8a0 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 foo [delete,create,call,call,writefull 0~391] v37'15 uv15 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f59a800a4d0 con 0x55ba6544c8a0 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59b1922800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59b1922800 10 moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59b1922800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94259051610992 in=579b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ba65498200 con 0x55ba6544c8a0 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify (1) cookie 94259051352288 notify 158913789975 ret 0) ==== 609+0+0 (crc 0 0 0) 0x7f59a8018ce0 con 0x55ba6544c8a0 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f5890ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789975 cookie 94259051352288 notifier 4673 bl.length()=567 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f5890ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+foo info.flags=0x17 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f5890ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f5890ff9640 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5870003ea0 con 0x55ba6544c8a0 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(64 notify.4 [notify cookie 94259051610992 out=8b] v0'0 uv183 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f59a8040040 con 0x55ba6544c8a0 2024-09-19T11:14:15.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a8040040 con 0x55ba6544c8a0 2024-09-19T11:14:15.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.875+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== watch-notify(notify_complete (2) cookie 94259051610992 notify 158913789975 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f59a8026410 con 0x55ba6544c8a0 2024-09-19T11:14:15.889 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"foo","display_name":"Foo","email":"foo@foo.com","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"foo","access_key":"9te6NH5mcdcq0Tc5i8i1","secret_key":"Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu","active":true,"create_date":"2024-09-19T11:13:52.068303Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:13:52.068288Z","tags":[],"group_ids":[]} 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.876+0000 7f5863fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.876+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94259051377584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x55ba6544c8a0 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.877+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94259051377584] v37'190 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f59a8040040 con 0x55ba6544c8a0 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.877+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94259051339744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x7f59a405f040 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.878+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94259051339744] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a8040040 con 0x7f59a405f040 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.878+0000 7f59b1922800 20 remove_watcher() i=0 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.878+0000 7f59b1922800 2 removed watcher, disabling cache 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.878+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94259051344208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x55ba6544c8a0 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.879+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94259051344208] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a8040040 con 0x55ba6544c8a0 2024-09-19T11:14:15.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.879+0000 7f59b1922800 20 remove_watcher() i=1 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.879+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94259051346560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x55ba65455bf0 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.880+0000 7f59acdd1640 1 -- 172.21.15.102:0/3066562833 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94259051346560] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a4051070 con 0x55ba65455bf0 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.880+0000 7f59b1922800 20 remove_watcher() i=2 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.880+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94259051350752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x7f59a405f040 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.881+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94259051350752] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a8040040 con 0x7f59a405f040 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.881+0000 7f59b1922800 20 remove_watcher() i=3 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.881+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94259051352288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x55ba6544c8a0 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.882+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94259051352288] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a8040040 con 0x55ba6544c8a0 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.882+0000 7f59b1922800 20 remove_watcher() i=4 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.882+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94259051356800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x55ba65451290 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.883+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94259051356800] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.883+0000 7f59b1922800 20 remove_watcher() i=5 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.883+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94259051354304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x55ba65451290 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.884+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94259051354304] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.884+0000 7f59b1922800 20 remove_watcher() i=6 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.884+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94259051363712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ba654947a0 con 0x55ba65451290 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.885+0000 7f59ad5d2640 1 -- 172.21.15.102:0/3066562833 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94259051363712] v37'185 uv183 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f59a0036020 con 0x55ba65451290 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.885+0000 7f59b1922800 20 remove_watcher() i=7 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.885+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65451290 msgr2=0x55ba65453680 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.885+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65451290 0x55ba65453680 crc :-1 s=READY pgs=130 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba6544c8a0 msgr2=0x55ba6544ed60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba6544c8a0 0x55ba6544ed60 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f59a405f040 msgr2=0x7f59a405f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f59a405f040 0x7f59a405f930 crc :-1 s=READY pgs=71 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba65455bf0 msgr2=0x55ba654580b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba65455bf0 0x55ba654580b0 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f587803d000 msgr2=0x7f587803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f587803d000 0x7f587803f4c0 secure :-1 s=READY pgs=241 cs=0 l=1 rev1=1 crypto rx=0x7f59a4077040 tx=0x7f59a4053000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 msgr2=0x55ba65441280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59addd3640 1 -- 172.21.15.102:0/3066562833 reap_dead start 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba65441280 secure :-1 s=READY pgs=583 cs=0 l=1 rev1=1 crypto rx=0x7f59a000efd0 tx=0x7f59a003c6b0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 shutdown_connections 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3066562833 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba65439e70 0x55ba65441280 unknown :-1 s=CLOSED pgs=583 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 >> 172.21.15.102:0/3066562833 conn(0x55ba65436270 msgr2=0x55ba65434480 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 shutdown_connections 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3066562833 wait complete. 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3926376310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f588403d000 msgr2=0x7f588403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3926376310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f588403d000 0x7f588403f4c0 secure :-1 s=READY pgs=240 cs=0 l=1 rev1=1 crypto rx=0x55ba6541fc90 tx=0x7f59a4005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3926376310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6542d5d0 msgr2=0x55ba6542d9f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3926376310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6542d5d0 0x55ba6542d9f0 secure :-1 s=READY pgs=581 cs=0 l=1 rev1=1 crypto rx=0x7f59a0019ca0 tx=0x7f59a000ef40 comp rx=0 tx=0).stop 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3926376310 shutdown_connections 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3926376310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f588403d000 0x7f588403f4c0 unknown :-1 s=CLOSED pgs=240 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/3926376310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6542d5d0 0x55ba6542d9f0 unknown :-1 s=CLOSED pgs=581 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3926376310 >> 172.21.15.102:0/3926376310 conn(0x55ba65421980 msgr2=0x55ba65421d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3926376310 shutdown_connections 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/3926376310 wait complete. 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65418e30 msgr2=0x55ba6541b220 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ba65418e30 0x55ba6541b220 crc :-1 s=READY pgs=129 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba65410bf0 msgr2=0x55ba65416550 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ba65410bf0 0x55ba65416550 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba6541cd30 msgr2=0x55ba6541f120 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.886+0000 7f59b1922800 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ba6541cd30 0x55ba6541f120 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f589403d1a0 msgr2=0x7f589403f660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59b1922800 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f589403d1a0 0x7f589403f660 secure :-1 s=READY pgs=239 cs=0 l=1 rev1=1 crypto rx=0x7f59a4057000 tx=0x7f59a4052000 comp rx=0 tx=0).stop 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 msgr2=0x55ba6540ef00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59b1922800 1 --2- 172.21.15.102:0/2339550418 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ba6531bab0 0x55ba6540ef00 secure :-1 s=READY pgs=580 cs=0 l=1 rev1=1 crypto rx=0x55ba65408120 tx=0x7f59a0000ed0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59addd3640 1 -- 172.21.15.102:0/2339550418 reap_dead start 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 shutdown_connections 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 >> 172.21.15.102:0/2339550418 conn(0x55ba65311a70 msgr2=0x55ba65408700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 shutdown_connections 2024-09-19T11:14:15.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.887+0000 7f59b1922800 1 -- 172.21.15.102:0/2339550418 wait complete. 2024-09-19T11:14:15.900 DEBUG:tasks.util.rgw: json result: {'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True, 'create_date': '2024-09-19T11:13:52.068303Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:13:52.068288Z', 'tags': [], 'group_ids': []} 2024-09-19T11:14:15.910 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:15.910 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo'] 2024-09-19T11:14:15.911 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo'] 2024-09-19T11:14:15.911 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo 2024-09-19T11:14:15.954 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:15.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.954+0000 7f34f3946800 1 Processor -- start 2024-09-19T11:14:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f3946800 1 -- start start 2024-09-19T11:14:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f3946800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5583e1eb0850 0x5583e1eb9370 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f3946800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5583e1eb98b0 con 0x5583e1eaed30 2024-09-19T11:14:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f3946800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5583e1d3b7d0 con 0x5583e1eb0850 2024-09-19T11:14:15.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f0c2f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5583e1eb0850 0x5583e1eb9370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f1430640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5583e1eaed30 0x5583e1eaf130 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:36836/0 (socket says 172.21.15.102:36836) 2024-09-19T11:14:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f0c2f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5583e1eb0850 0x5583e1eb9370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38286/0 (socket says 172.21.15.102:38286) 2024-09-19T11:14:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f1430640 1 -- 172.21.15.102:0/2188166902 learned_addr learned my addr 172.21.15.102:0/2188166902 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f0c2f640 1 -- 172.21.15.102:0/2188166902 >> v1:172.21.15.37:6789/0 conn(0x5583e1eaed30 legacy=0x5583e1eaf130 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.957 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.955+0000 7f34f0c2f640 1 -- 172.21.15.102:0/2188166902 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e1ebaa90 con 0x5583e1eb0850 2024-09-19T11:14:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.957+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/2188166902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eb0850 0x5583e1eb9370 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f34e800a470 tx=0x7f34e8045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e98e6d87e53c0305 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.957+0000 7f34e3fff640 1 -- 172.21.15.102:0/2188166902 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e8053570 con 0x5583e1eb0850 2024-09-19T11:14:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.957+0000 7f34e3fff640 1 -- 172.21.15.102:0/2188166902 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e8058070 con 0x5583e1eb0850 2024-09-19T11:14:15.958 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.957+0000 7f34e3fff640 1 -- 172.21.15.102:0/2188166902 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e8053880 con 0x5583e1eb0850 2024-09-19T11:14:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.958+0000 7f34f3946800 1 -- 172.21.15.102:0/2188166902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eb0850 msgr2=0x5583e1eb9370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.958+0000 7f34f3946800 1 --2- 172.21.15.102:0/2188166902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eb0850 0x5583e1eb9370 secure :-1 s=READY pgs=585 cs=0 l=1 rev1=1 crypto rx=0x7f34e800a470 tx=0x7f34e8045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.958+0000 7f34f3946800 1 -- 172.21.15.102:0/2188166902 shutdown_connections 2024-09-19T11:14:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.958+0000 7f34f3946800 1 --2- 172.21.15.102:0/2188166902 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eb0850 0x5583e1eb9370 unknown :-1 s=CLOSED pgs=585 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.959 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.958+0000 7f34f3946800 1 -- 172.21.15.102:0/2188166902 >> 172.21.15.102:0/2188166902 conn(0x5583e1eaaa60 msgr2=0x5583e1eacec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.958+0000 7f34f3946800 1 -- 172.21.15.102:0/2188166902 shutdown_connections 2024-09-19T11:14:15.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.958+0000 7f34f3946800 1 -- 172.21.15.102:0/2188166902 wait complete. 2024-09-19T11:14:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.971+0000 7f34f3946800 1 Processor -- start 2024-09-19T11:14:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.971+0000 7f34f3946800 1 -- start start 2024-09-19T11:14:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.971+0000 7f34f3946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1fa2520 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.972 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.971+0000 7f34f3946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5583e1d48dd0 con 0x5583e1eaed30 2024-09-19T11:14:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.972+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1fa2520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.972+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1fa2520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38294/0 (socket says 172.21.15.102:38294) 2024-09-19T11:14:15.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.972+0000 7f34f1430640 1 -- 172.21.15.102:0/1579263196 learned_addr learned my addr 172.21.15.102:0/1579263196 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.972+0000 7f34f1430640 1 -- 172.21.15.102:0/1579263196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e1fa2b10 con 0x5583e1eaed30 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.972+0000 7f34f1430640 1 --2- 172.21.15.102:0/1579263196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1fa2520 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f34e4001e40 tx=0x7f34e4001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=69372752231207df server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.972+0000 7f33df606640 1 -- 172.21.15.102:0/1579263196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4012020 con 0x5583e1eaed30 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.972+0000 7f33df606640 1 -- 172.21.15.102:0/1579263196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e400e5a0 con 0x5583e1eaed30 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.972+0000 7f33df606640 1 -- 172.21.15.102:0/1579263196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e400e8a0 con 0x5583e1eaed30 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 -- 172.21.15.102:0/1579263196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 msgr2=0x5583e1fa2520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 --2- 172.21.15.102:0/1579263196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1fa2520 secure :-1 s=READY pgs=586 cs=0 l=1 rev1=1 crypto rx=0x7f34e4001e40 tx=0x7f34e4001e70 comp rx=0 tx=0).stop 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 -- 172.21.15.102:0/1579263196 shutdown_connections 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 --2- 172.21.15.102:0/1579263196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1fa2520 unknown :-1 s=CLOSED pgs=586 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 -- 172.21.15.102:0/1579263196 >> 172.21.15.102:0/1579263196 conn(0x5583e1eaaa60 msgr2=0x5583e1f9dea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 -- 172.21.15.102:0/1579263196 shutdown_connections 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 -- 172.21.15.102:0/1579263196 wait complete. 2024-09-19T11:14:15.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 Processor -- start 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.973+0000 7f34f3946800 1 -- start start 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f3946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1faa070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f3946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5583e1eb9d50 con 0x5583e1eaed30 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1faa070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1faa070 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38298/0 (socket says 172.21.15.102:38298) 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f1430640 1 -- 172.21.15.102:0/1621566310 learned_addr learned my addr 172.21.15.102:0/1621566310 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f1430640 1 -- 172.21.15.102:0/1621566310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e1faa5d0 con 0x5583e1eaed30 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f1430640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1faa070 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c010 tx=0x7f34e4000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f33dde03640 1 -- 172.21.15.102:0/1621566310 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4012030 con 0x5583e1eaed30 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f33dde03640 1 -- 172.21.15.102:0/1621566310 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e40014a0 con 0x5583e1eaed30 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583e1faa860 con 0x5583e1eaed30 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f33dde03640 1 -- 172.21.15.102:0/1621566310 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e401a7a0 con 0x5583e1eaed30 2024-09-19T11:14:15.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.974+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583e1fab260 con 0x5583e1eaed30 2024-09-19T11:14:15.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.975+0000 7f33dde03640 1 -- 172.21.15.102:0/1621566310 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f34e4015020 con 0x5583e1eaed30 2024-09-19T11:14:15.982 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.975+0000 7f33dde03640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33d803d000 0x7f33d803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.975+0000 7f33dde03640 1 -- 172.21.15.102:0/1621566310 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f34e4020030 con 0x5583e1eaed30 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.975+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33d803d000 0x7f33d803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.976+0000 7f34f3946800 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1eb0850 0x5583e1fb16c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.976+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fabdf0 con 0x5583e1eb0850 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.976+0000 7f34f1c31640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1eb0850 0x5583e1fb16c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.976+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33d803d000 0x7f33d803f4c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f34e8057000 tx=0x7f34e8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.976+0000 7f34f1c31640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1eb0850 0x5583e1fb16c0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.976+0000 7f34f1c31640 1 -- 172.21.15.102:0/1621566310 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1eb0850 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.976+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fab6f0 con 0x5583e1eb0850 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.977+0000 7f34f1c31640 1 -- 172.21.15.102:0/1621566310 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1eb0850 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.977+0000 7f34f3946800 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1fb3b30 0x5583e1fb5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.977+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fb65f0 con 0x5583e1fb3b30 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.977+0000 7f34f1430640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1fb3b30 0x5583e1fb5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.977+0000 7f34f1430640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1fb3b30 0x5583e1fb5f20 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.977+0000 7f34f1430640 1 -- 172.21.15.102:0/1621566310 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f34e40187b0 con 0x5583e1fb3b30 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.977+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fb29d0 con 0x5583e1eb0850 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.978+0000 7f34f1c31640 1 -- 172.21.15.102:0/1621566310 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1eb0850 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.978+0000 7f34f3946800 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1fb7a30 0x5583e1fb9e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.978+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fba560 con 0x5583e1fb7a30 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.978+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1fb7a30 0x5583e1fb9e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.978+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1fb7a30 0x5583e1fb9e20 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.978+0000 7f34f0c2f640 1 -- 172.21.15.102:0/1621566310 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1fb7a30 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.979+0000 7f34f3946800 1 Processor -- start 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.979+0000 7f34f3946800 1 -- start start 2024-09-19T11:14:15.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.979+0000 7f34f3946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fc82c0 0x5583e1fc86e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.979+0000 7f34f3946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5583e1da74a0 con 0x5583e1fc82c0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.979+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fc82c0 0x5583e1fc86e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.979+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fc82c0 0x5583e1fc86e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38306/0 (socket says 172.21.15.102:38306) 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.979+0000 7f34f1430640 1 -- 172.21.15.102:0/3997208305 learned_addr learned my addr 172.21.15.102:0/3997208305 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.979+0000 7f34f1430640 1 -- 172.21.15.102:0/3997208305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e1fc8d20 con 0x5583e1fc82c0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.980+0000 7f34f1430640 1 --2- 172.21.15.102:0/3997208305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fc82c0 0x5583e1fc86e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f34e4001250 tx=0x7f34e4042da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.980+0000 7f33d6ffd640 1 -- 172.21.15.102:0/3997208305 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e400d3d0 con 0x5583e1fc82c0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.980+0000 7f33d6ffd640 1 -- 172.21.15.102:0/3997208305 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e4048070 con 0x5583e1fc82c0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.980+0000 7f33d6ffd640 1 -- 172.21.15.102:0/3997208305 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4051510 con 0x5583e1fc82c0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.980+0000 7f34f3946800 1 -- 172.21.15.102:0/3997208305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583e1fc9550 con 0x5583e1fc82c0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.980+0000 7f34f3946800 1 -- 172.21.15.102:0/3997208305 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583e1fc9550 con 0x5583e1fc82c0 2024-09-19T11:14:15.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.980+0000 7f33d6ffd640 1 -- 172.21.15.102:0/3997208305 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f34e404b370 con 0x5583e1fc82c0 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.981+0000 7f33d6ffd640 1 --2- 172.21.15.102:0/3997208305 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33c803d000 0x7f33c803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.981+0000 7f33d6ffd640 1 -- 172.21.15.102:0/3997208305 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f34e40379d0 con 0x5583e1fc82c0 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.981+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/3997208305 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33c803d000 0x7f33c803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.981+0000 7f34f3946800 1 Processor -- start 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.981+0000 7f34f3946800 1 -- start start 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.981+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/3997208305 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33c803d000 0x7f33c803f4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5583e1fb1cd0 tx=0x7f34e8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.981+0000 7f34f3946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fd4d50 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.981+0000 7f34f3946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5583e1fa2f40 con 0x5583e1fd4950 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.982+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fd4d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.982+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fd4d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38312/0 (socket says 172.21.15.102:38312) 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.982+0000 7f34f1430640 1 -- 172.21.15.102:0/338800684 learned_addr learned my addr 172.21.15.102:0/338800684 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:15.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.982+0000 7f34f1430640 1 -- 172.21.15.102:0/338800684 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e1fd5340 con 0x5583e1fd4950 2024-09-19T11:14:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.982+0000 7f34f1430640 1 --2- 172.21.15.102:0/338800684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fd4d50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f34e40517c0 tx=0x7f34e404b740 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e91c6c54edaa90d2 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.982+0000 7f33d4ff9640 1 -- 172.21.15.102:0/338800684 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4053e20 con 0x5583e1fd4950 2024-09-19T11:14:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.982+0000 7f33d4ff9640 1 -- 172.21.15.102:0/338800684 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e40247e0 con 0x5583e1fd4950 2024-09-19T11:14:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.982+0000 7f33d4ff9640 1 -- 172.21.15.102:0/338800684 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e4024e60 con 0x5583e1fd4950 2024-09-19T11:14:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 -- 172.21.15.102:0/338800684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 msgr2=0x5583e1fd4d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 --2- 172.21.15.102:0/338800684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fd4d50 secure :-1 s=READY pgs=589 cs=0 l=1 rev1=1 crypto rx=0x7f34e40517c0 tx=0x7f34e404b740 comp rx=0 tx=0).stop 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 -- 172.21.15.102:0/338800684 shutdown_connections 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 --2- 172.21.15.102:0/338800684 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fd4d50 unknown :-1 s=CLOSED pgs=589 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 -- 172.21.15.102:0/338800684 >> 172.21.15.102:0/338800684 conn(0x5583e1fd0d50 msgr2=0x5583e1fcef90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 -- 172.21.15.102:0/338800684 shutdown_connections 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 -- 172.21.15.102:0/338800684 wait complete. 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 Processor -- start 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 -- start start 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fdbd90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f3946800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5583e1fd57b0 con 0x5583e1fd4950 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fdbd90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f1430640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fdbd90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:38322/0 (socket says 172.21.15.102:38322) 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.983+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 learned_addr learned my addr 172.21.15.102:0/366894266 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:16.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.984+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5583e1fdc2f0 con 0x5583e1fd4950 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.984+0000 7f34f1430640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fdbd90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f34e4038c50 tx=0x7f34e4037660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.984+0000 7f33c6ffd640 1 -- 172.21.15.102:0/366894266 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e406e070 con 0x5583e1fd4950 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.984+0000 7f33c6ffd640 1 -- 172.21.15.102:0/366894266 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f34e40249d0 con 0x5583e1fd4950 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.984+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5583e1fdc2f0 con 0x5583e1fd4950 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.984+0000 7f33c6ffd640 1 -- 172.21.15.102:0/366894266 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f34e403e6a0 con 0x5583e1fd4950 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.984+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5583e1fdc2f0 con 0x5583e1fd4950 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.985+0000 7f33c6ffd640 1 -- 172.21.15.102:0/366894266 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f34e4071070 con 0x5583e1fd4950 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.985+0000 7f33c6ffd640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33bc03d000 0x7f33bc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.985+0000 7f33c6ffd640 1 -- 172.21.15.102:0/366894266 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f34e405a030 con 0x5583e1fd4950 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.985+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33bc03d000 0x7f33bc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.985+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33bc03d000 0x7f33bc03f4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34e8053570 tx=0x7f34e8053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.985+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.985+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1fe7310 0x5583e1fe97d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.985+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fe9f20 con 0x5583e1fe7310 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f1c31640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1fe7310 0x5583e1fe97d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f1c31640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1fe7310 0x5583e1fe97d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f3946800 20 realm 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fea330 con 0x5583e1fe7310 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f3946800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:16.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.986+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feac00 con 0x5583e1fe7310 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f3946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1febd00 0x5583e1fee0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fee6b0 con 0x5583e1febd00 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.987+0000 7f34f1430640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1febd00 0x5583e1fee0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.988+0000 7f34f1430640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1febd00 0x5583e1fee0f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:16.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.988+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.988+0000 7f34f3946800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.988+0000 7f34f3946800 20 searching for the correct realm 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.988+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1ff0660 0x5583e1ff2b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.988+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff31f0 con 0x5583e1ff0660 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.988+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1ff0660 0x5583e1ff2b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.988+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1ff0660 0x5583e1ff2b20 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f0c2f640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f34e805f040 0x7f34e805f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff31f0 con 0x7f34e805f040 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f1c31640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f34e805f040 0x7f34e805f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f1c31640 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f34e805f040 0x7f34e805f930 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1febd00 2024-09-19T11:14:16.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.989+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.990+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.990+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.990+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.990+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1febd00 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.990+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.990+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1febd00 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.990+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.990+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x7f34e805f040 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.991+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.991+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1ff0660 2024-09-19T11:14:16.012 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.991+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.991+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.991+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.991+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1febd00 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.991+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.991+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.992+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.992+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x7f34e805f040 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.992+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.992+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1ff0660 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.992+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.992+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1ff0660 2024-09-19T11:14:16.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.992+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.992+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1febd00 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.993+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.993+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1ff0660 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.993+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.993+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1ff0660 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.993+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.993+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.993+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.993+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.994+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.994+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1febd00 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.994+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.994+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1ff0660 2024-09-19T11:14:16.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.994+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.994+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x7f34e805f040 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.994+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.994+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.995+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.995+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1febd00 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.995+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.995+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1ff0660 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.995+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.995+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1febd00 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.995+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.995+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x7f34e805f040 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.996+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.996+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1ff0660 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.996+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.996+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x7f34e805f040 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.996+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.996+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x5583e1fe7310 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.996+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.996+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feafa0 con 0x7f34e805f040 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:16.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feef70 con 0x5583e1fe7310 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feef70 con 0x5583e1fe7310 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1feef70 con 0x5583e1ff0660 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 zone default found 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 4 Realm: () 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 zonegroup default 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.997+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fef860 con 0x5583e1febd00 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff5160 con 0x5583e1ff0660 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff55b0 con 0x5583e1ff0660 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 20 started sync module instance, tier type = 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.998+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff4500 con 0x7f34e805f040 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.999+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.999+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94024920680960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff4500 con 0x7f34e805f040 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:15.999+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff60b0 con 0x5583e1fe7310 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.000+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94024920680960] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.000+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.000+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94024920685440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff4500 con 0x5583e1fe7310 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.000+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff6b60 con 0x5583e1ff0660 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.001+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94024920685440] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.002+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.002+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94024920678480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff4470 con 0x5583e1ff0660 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.002+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff7a20 con 0x7f34e805f040 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.002+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94024920678480] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.003+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.003+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94024920692080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff7e40 con 0x7f34e805f040 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.003+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff8800 con 0x5583e1fe7310 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.004+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94024920692080] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.004+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.004+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94024920693616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff8800 con 0x5583e1fe7310 2024-09-19T11:14:16.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.004+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff91c0 con 0x5583e1febd00 2024-09-19T11:14:16.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.005+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.005+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94024920698128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff9a60 con 0x5583e1febd00 2024-09-19T11:14:16.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.005+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffa4e0 con 0x5583e1febd00 2024-09-19T11:14:16.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.005+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94024920693616] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.006+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94024920698128] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.006+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.006+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94024920702928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffa900 con 0x5583e1febd00 2024-09-19T11:14:16.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.006+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffb150 con 0x5583e1febd00 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94024920702928] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'186 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94024920706208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffb570 con 0x5583e1febd00 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f3946800 20 add_watcher() i=0 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f3946800 20 add_watcher() i=1 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f3946800 20 add_watcher() i=2 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f3946800 20 add_watcher() i=3 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f3946800 20 add_watcher() i=4 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f3946800 20 add_watcher() i=5 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.007+0000 7f34f3946800 20 add_watcher() i=6 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.008+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94024920706208] v37'187 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.008+0000 7f34f3946800 20 add_watcher() i=7 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.008+0000 7f34f3946800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.008+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffe880 con 0x5583e1fe7310 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.009+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.009+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94024920707632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffbb00 con 0x5583e1fe7310 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.010+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94024920707632] v37'191 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.010+0000 7f33a7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.010+0000 7f34f3946800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.010+0000 7f34f3946800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.010+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2007120 con 0x5583e1fe7310 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.011+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.011+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2007770 con 0x5583e1febd00 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.012+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.012+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2007bd0 con 0x5583e1ff0660 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.013+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.013+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2007f60 con 0x5583e1fe7310 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.014+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'192 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.014+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2008380 con 0x7f34e805f040 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.015+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'65 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.015+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20088f0 con 0x5583e1ff0660 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.016+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'44 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.016+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2008da0 con 0x5583e1fe7310 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.017+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.017+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2008e30 con 0x5583e1febd00 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.018+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'45 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.018+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2008ec0 con 0x7f34e805f040 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.019+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.019+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2008f50 con 0x5583e1ff0660 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.020+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.020+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2009500 con 0x7f34e805f040 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.021+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'66 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.021+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20094c0 con 0x5583e1febd00 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.023+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.023+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20094c0 con 0x7f34e805f040 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.024+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.024+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20094c0 con 0x5583e1febd00 2024-09-19T11:14:16.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.025+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'49 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.025+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20094c0 con 0x5583e1fe7310 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.026+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'193 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.026+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20094c0 con 0x5583e1ff0660 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.027+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'59 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.027+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2009a50 con 0x7f34e805f040 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.028+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'67 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.028+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2009710 con 0x5583e1ff0660 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.029+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'25 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.029+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096f0 con 0x5583e1fe7310 2024-09-19T11:14:16.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.030+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'33 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.030+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096b0 con 0x5583e1fe7310 2024-09-19T11:14:16.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.031+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'194 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.031+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096b0 con 0x5583e1ff0660 2024-09-19T11:14:16.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.033+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'60 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.033+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096b0 con 0x7f34e805f040 2024-09-19T11:14:16.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.033+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'35 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.034+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096b0 con 0x5583e1ff0660 2024-09-19T11:14:16.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.034+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'28 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.034+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096b0 con 0x5583e1ff0660 2024-09-19T11:14:16.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.036+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.036+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096b0 con 0x5583e1ff0660 2024-09-19T11:14:16.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.037+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'21 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.037+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096b0 con 0x5583e1ff0660 2024-09-19T11:14:16.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.038+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'45 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.038+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e20096f0 con 0x5583e1febd00 2024-09-19T11:14:16.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.039+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'27 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.039+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2009730 con 0x5583e1ff0660 2024-09-19T11:14:16.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.040+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.040+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2009730 con 0x5583e1febd00 2024-09-19T11:14:16.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.041+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'46 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.041+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2009730 con 0x5583e1ff0660 2024-09-19T11:14:16.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.042+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'61 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.042+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2009730 con 0x5583e1febd00 2024-09-19T11:14:16.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.044+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'50 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.044+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e2009750 con 0x7f34e805f040 2024-09-19T11:14:16.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.045+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'31 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.045+0000 7f33a6fe5640 20 reqs_thread_entry: start 2024-09-19T11:14:16.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.045+0000 7f34f3946800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:16.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.045+0000 7f34f3946800 20 Filter name: none 2024-09-19T11:14:16.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.045+0000 7f33a4fe1640 20 reqs_thread_entry: start 2024-09-19T11:14:16.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.045+0000 7f34f3946800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:14:16.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.045+0000 7f34f3946800 20 rados->read ofs=0 len=0 2024-09-19T11:14:16.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.045+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e20342c0 con 0x5583e1fe7310 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.046+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.046+0000 7f34f3946800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.046+0000 7f34f3946800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.046+0000 7f34f3946800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.046+0000 7f34f3946800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.046+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5583e2036bf0 con 0x7f34e805f040 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.046+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv41 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:could not remove user: unable to remove user, must specify purge data to remove user with buckets 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.047+0000 7f33a7fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:16.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.047+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94024920707632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1fe4400 con 0x5583e1fe7310 2024-09-19T11:14:16.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.048+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(96 data_loggenerations_metadata [watch unwatch cookie 94024920707632] v37'195 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.048+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:97 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94024920680960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffb230 con 0x7f34e805f040 2024-09-19T11:14:16.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.049+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(97 notify.0 [watch unwatch cookie 94024920680960] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.049+0000 7f34f3946800 20 remove_watcher() i=0 2024-09-19T11:14:16.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.049+0000 7f34f3946800 2 removed watcher, disabling cache 2024-09-19T11:14:16.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.049+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94024920685440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffb230 con 0x5583e1fe7310 2024-09-19T11:14:16.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.050+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(98 notify.1 [watch unwatch cookie 94024920685440] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.050+0000 7f34f3946800 20 remove_watcher() i=1 2024-09-19T11:14:16.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.050+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:99 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94024920678480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff5b80 con 0x5583e1ff0660 2024-09-19T11:14:16.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.051+0000 7f34f0c2f640 1 -- 172.21.15.102:0/366894266 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(99 notify.2 [watch unwatch cookie 94024920678480] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e8051070 con 0x5583e1ff0660 2024-09-19T11:14:16.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.051+0000 7f34f3946800 20 remove_watcher() i=2 2024-09-19T11:14:16.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.051+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:100 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94024920692080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ffb230 con 0x7f34e805f040 2024-09-19T11:14:16.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.052+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(100 notify.3 [watch unwatch cookie 94024920692080] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x7f34e805f040 2024-09-19T11:14:16.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.052+0000 7f34f3946800 20 remove_watcher() i=3 2024-09-19T11:14:16.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.052+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:101 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94024920693616] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff4050 con 0x5583e1fe7310 2024-09-19T11:14:16.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.053+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(101 notify.4 [watch unwatch cookie 94024920693616] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34ec00a4d0 con 0x5583e1fe7310 2024-09-19T11:14:16.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.053+0000 7f34f3946800 20 remove_watcher() i=4 2024-09-19T11:14:16.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.053+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94024920698128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff5b80 con 0x5583e1febd00 2024-09-19T11:14:16.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.054+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(102 notify.5 [watch unwatch cookie 94024920698128] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.054+0000 7f34f3946800 20 remove_watcher() i=5 2024-09-19T11:14:16.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.054+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94024920702928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff7570 con 0x5583e1febd00 2024-09-19T11:14:16.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.055+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(103 notify.6 [watch unwatch cookie 94024920702928] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.055+0000 7f34f3946800 20 remove_watcher() i=6 2024-09-19T11:14:16.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.055+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:104 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94024920706208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5583e1ff7b70 con 0x5583e1febd00 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f1430640 1 -- 172.21.15.102:0/366894266 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(104 notify.7 [watch unwatch cookie 94024920706208] v37'188 uv186 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f34e4070030 con 0x5583e1febd00 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 20 remove_watcher() i=7 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1febd00 msgr2=0x5583e1fee0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1febd00 0x5583e1fee0f0 crc :-1 s=READY pgs=132 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1fe7310 msgr2=0x5583e1fe97d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1fe7310 0x5583e1fe97d0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f34e805f040 msgr2=0x7f34e805f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f34e805f040 0x7f34e805f930 crc :-1 s=READY pgs=72 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1ff0660 msgr2=0x5583e1ff2b20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1ff0660 0x5583e1ff2b20 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33bc03d000 msgr2=0x7f33bc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33bc03d000 0x7f33bc03f4c0 secure :-1 s=READY pgs=244 cs=0 l=1 rev1=1 crypto rx=0x7f34e8053570 tx=0x7f34e8053000 comp rx=0 tx=0).stop 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 msgr2=0x5583e1fdbd90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f1c31640 1 -- 172.21.15.102:0/366894266 reap_dead start 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fdbd90 secure :-1 s=READY pgs=590 cs=0 l=1 rev1=1 crypto rx=0x7f34e4038c50 tx=0x7f34e4037660 comp rx=0 tx=0).stop 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 shutdown_connections 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/366894266 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fd4950 0x5583e1fdbd90 unknown :-1 s=CLOSED pgs=590 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 >> 172.21.15.102:0/366894266 conn(0x5583e1fd0d50 msgr2=0x5583e1fcef60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 shutdown_connections 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/366894266 wait complete. 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/3997208305 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33c803d000 msgr2=0x7f33c803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/3997208305 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33c803d000 0x7f33c803f4c0 secure :-1 s=READY pgs=243 cs=0 l=1 rev1=1 crypto rx=0x5583e1fb1cd0 tx=0x7f34e8005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/3997208305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fc82c0 msgr2=0x5583e1fc86e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/3997208305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fc82c0 0x5583e1fc86e0 secure :-1 s=READY pgs=588 cs=0 l=1 rev1=1 crypto rx=0x7f34e4001250 tx=0x7f34e4042da0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/3997208305 shutdown_connections 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/3997208305 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33c803d000 0x7f33c803f4c0 unknown :-1 s=CLOSED pgs=243 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 --2- 172.21.15.102:0/3997208305 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1fc82c0 0x5583e1fc86e0 unknown :-1 s=CLOSED pgs=588 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.057+0000 7f34f3946800 1 -- 172.21.15.102:0/3997208305 >> 172.21.15.102:0/3997208305 conn(0x5583e1fbc670 msgr2=0x5583e1fbca50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/3997208305 shutdown_connections 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/3997208305 wait complete. 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1fb3b30 msgr2=0x5583e1fb5f20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5583e1fb3b30 0x5583e1fb5f20 crc :-1 s=READY pgs=131 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1eb0850 msgr2=0x5583e1fb16c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5583e1eb0850 0x5583e1fb16c0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1fb7a30 msgr2=0x5583e1fb9e20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5583e1fb7a30 0x5583e1fb9e20 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33d803d000 msgr2=0x7f33d803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f33d803d000 0x7f33d803f4c0 secure :-1 s=READY pgs=242 cs=0 l=1 rev1=1 crypto rx=0x7f34e8057000 tx=0x7f34e8052000 comp rx=0 tx=0).stop 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 msgr2=0x5583e1faa070 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 --2- 172.21.15.102:0/1621566310 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5583e1eaed30 0x5583e1faa070 secure :-1 s=READY pgs=587 cs=0 l=1 rev1=1 crypto rx=0x7f34e400c010 tx=0x7f34e4000ed0 comp rx=0 tx=0).stop 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f1c31640 1 -- 172.21.15.102:0/1621566310 reap_dead start 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 shutdown_connections 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 >> 172.21.15.102:0/1621566310 conn(0x5583e1eaaa60 msgr2=0x5583e1fa3a10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 shutdown_connections 2024-09-19T11:14:16.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:16.058+0000 7f34f3946800 1 -- 172.21.15.102:0/1621566310 wait complete. 2024-09-19T11:14:16.067 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-19T11:14:16.082 INFO:tasks.radosgw_admin:RL: create_bucket myfoo foo bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:16.125 INFO:tasks.radosgw_admin:RL: put_obj myfoo foo bytes_out=6 bytes_in=0 failed=False 2024-09-19T11:14:51.126 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--categories', 'delete_obj'] 2024-09-19T11:14:51.127 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--categories', 'delete_obj'] 2024-09-19T11:14:51.127 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --categories delete_obj 2024-09-19T11:14:51.180 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:51.180 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:51.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867d50c800 1 Processor -- start 2024-09-19T11:14:51.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867d50c800 1 -- start start 2024-09-19T11:14:51.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867d50c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56143ddfed50 0x56143ddff150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.181 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867d50c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56143de00250 con 0x56143ddff690 2024-09-19T11:14:51.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867d50c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x56143dc8b7d0 con 0x56143ddfed50 2024-09-19T11:14:51.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56143ddfed50 0x56143ddff150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867affd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56143ddfed50 0x56143ddff150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43496/0 (socket says 172.21.15.102:43496) 2024-09-19T11:14:51.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867affd640 1 -- 172.21.15.102:0/685320535 learned_addr learned my addr 172.21.15.102:0/685320535 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.180+0000 7f867a7fc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x56143ddff690 0x56143ddffb40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47848/0 (socket says 172.21.15.102:47848) 2024-09-19T11:14:51.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.181+0000 7f867affd640 1 -- 172.21.15.102:0/685320535 >> v1:172.21.15.37:6789/0 conn(0x56143ddff690 legacy=0x56143ddffb40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.181+0000 7f867affd640 1 -- 172.21.15.102:0/685320535 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143de00420 con 0x56143ddfed50 2024-09-19T11:14:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.183+0000 7f867affd640 1 --2- 172.21.15.102:0/685320535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143ddff150 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f866c00a520 tx=0x7f866c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e90a05bc7dd8df2a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.183+0000 7f8679ffb640 1 -- 172.21.15.102:0/685320535 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c055070 con 0x56143ddfed50 2024-09-19T11:14:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.183+0000 7f8679ffb640 1 -- 172.21.15.102:0/685320535 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c0515b0 con 0x56143ddfed50 2024-09-19T11:14:51.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.183+0000 7f8679ffb640 1 -- 172.21.15.102:0/685320535 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c0518d0 con 0x56143ddfed50 2024-09-19T11:14:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.183+0000 7f867d50c800 1 -- 172.21.15.102:0/685320535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 msgr2=0x56143ddff150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.183+0000 7f867d50c800 1 --2- 172.21.15.102:0/685320535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143ddff150 secure :-1 s=READY pgs=592 cs=0 l=1 rev1=1 crypto rx=0x7f866c00a520 tx=0x7f866c045ba0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.184+0000 7f867d50c800 1 -- 172.21.15.102:0/685320535 shutdown_connections 2024-09-19T11:14:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.184+0000 7f867d50c800 1 --2- 172.21.15.102:0/685320535 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143ddff150 unknown :-1 s=CLOSED pgs=592 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.184+0000 7f867d50c800 1 -- 172.21.15.102:0/685320535 >> 172.21.15.102:0/685320535 conn(0x56143ddfaa60 msgr2=0x56143ddfcec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.184+0000 7f867d50c800 1 -- 172.21.15.102:0/685320535 shutdown_connections 2024-09-19T11:14:51.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.184+0000 7f867d50c800 1 -- 172.21.15.102:0/685320535 wait complete. 2024-09-19T11:14:51.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.199+0000 7f867d50c800 1 Processor -- start 2024-09-19T11:14:51.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.199+0000 7f867d50c800 1 -- start start 2024-09-19T11:14:51.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.200+0000 7f867d50c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def2530 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.200+0000 7f867d50c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56143dc98dd0 con 0x56143ddfed50 2024-09-19T11:14:51.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.200+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def2530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.200+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def2530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43506/0 (socket says 172.21.15.102:43506) 2024-09-19T11:14:51.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.200+0000 7f867affd640 1 -- 172.21.15.102:0/2379938782 learned_addr learned my addr 172.21.15.102:0/2379938782 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.200+0000 7f867affd640 1 -- 172.21.15.102:0/2379938782 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143def2b20 con 0x56143ddfed50 2024-09-19T11:14:51.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.200+0000 7f867affd640 1 --2- 172.21.15.102:0/2379938782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def2530 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f866c025da0 tx=0x7f866c051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82e34276a0b62b8e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.201+0000 7f8568e09640 1 -- 172.21.15.102:0/2379938782 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c051890 con 0x56143ddfed50 2024-09-19T11:14:51.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.201+0000 7f8568e09640 1 -- 172.21.15.102:0/2379938782 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c051ac0 con 0x56143ddfed50 2024-09-19T11:14:51.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.201+0000 7f8568e09640 1 -- 172.21.15.102:0/2379938782 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c051da0 con 0x56143ddfed50 2024-09-19T11:14:51.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.201+0000 7f867d50c800 1 -- 172.21.15.102:0/2379938782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 msgr2=0x56143def2530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.201+0000 7f867d50c800 1 --2- 172.21.15.102:0/2379938782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def2530 secure :-1 s=READY pgs=593 cs=0 l=1 rev1=1 crypto rx=0x7f866c025da0 tx=0x7f866c051000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 -- 172.21.15.102:0/2379938782 shutdown_connections 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 --2- 172.21.15.102:0/2379938782 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def2530 unknown :-1 s=CLOSED pgs=593 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 -- 172.21.15.102:0/2379938782 >> 172.21.15.102:0/2379938782 conn(0x56143ddfaa60 msgr2=0x56143deedeb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 -- 172.21.15.102:0/2379938782 shutdown_connections 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 -- 172.21.15.102:0/2379938782 wait complete. 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 Processor -- start 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 -- start start 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867d50c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56143de00950 con 0x56143ddfed50 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def9e60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43520/0 (socket says 172.21.15.102:43520) 2024-09-19T11:14:51.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.202+0000 7f867affd640 1 -- 172.21.15.102:0/1286536917 learned_addr learned my addr 172.21.15.102:0/1286536917 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.203+0000 7f867affd640 1 -- 172.21.15.102:0/1286536917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143defa3c0 con 0x56143ddfed50 2024-09-19T11:14:51.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.203+0000 7f867affd640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def9e60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f866c000c00 tx=0x7f866c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.203+0000 7f8567606640 1 -- 172.21.15.102:0/1286536917 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c073070 con 0x56143ddfed50 2024-09-19T11:14:51.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.203+0000 7f8567606640 1 -- 172.21.15.102:0/1286536917 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c05a450 con 0x56143ddfed50 2024-09-19T11:14:51.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.203+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56143defa650 con 0x56143ddfed50 2024-09-19T11:14:51.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.203+0000 7f8567606640 1 -- 172.21.15.102:0/1286536917 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c05a730 con 0x56143ddfed50 2024-09-19T11:14:51.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.203+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143defb260 con 0x56143ddfed50 2024-09-19T11:14:51.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.204+0000 7f8567606640 1 -- 172.21.15.102:0/1286536917 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f866c076070 con 0x56143ddfed50 2024-09-19T11:14:51.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.204+0000 7f8567606640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f856003cfb0 0x7f856003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.204+0000 7f8567606640 1 -- 172.21.15.102:0/1286536917 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f866c062070 con 0x56143ddfed50 2024-09-19T11:14:51.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.205+0000 7f867a7fc640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f856003cfb0 0x7f856003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.205+0000 7f867d50c800 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143ddff690 0x56143df014b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.205+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df019f0 con 0x56143ddff690 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.205+0000 7f867b7fe640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143ddff690 0x56143df014b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.205+0000 7f867a7fc640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f856003cfb0 0x7f856003f470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8670001e80 tx=0x7f86700013e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.205+0000 7f867b7fe640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143ddff690 0x56143df014b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.205+0000 7f867b7fe640 1 -- 172.21.15.102:0/1286536917 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143ddff690 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.205+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df01d90 con 0x56143ddff690 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.206+0000 7f867b7fe640 1 -- 172.21.15.102:0/1286536917 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f867400a4d0 con 0x56143ddff690 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.206+0000 7f867d50c800 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df03890 0x56143df05d30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.206+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df064c0 con 0x56143df03890 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.206+0000 7f867affd640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df03890 0x56143df05d30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.206+0000 7f867affd640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df03890 0x56143df05d30 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.207+0000 7f867affd640 1 -- 172.21.15.102:0/1286536917 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f866c07f070 con 0x56143df03890 2024-09-19T11:14:51.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.207+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df025e0 con 0x56143ddff690 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.207+0000 7f867b7fe640 1 -- 172.21.15.102:0/1286536917 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f867400a4d0 con 0x56143ddff690 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.207+0000 7f867d50c800 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df07920 0x56143df09d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.207+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df0a480 con 0x56143df07920 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.207+0000 7f867a7fc640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df07920 0x56143df09d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.207+0000 7f867a7fc640 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df07920 0x56143df09d10 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.208+0000 7f867a7fc640 1 -- 172.21.15.102:0/1286536917 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f867000bda0 con 0x56143df07920 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.208+0000 7f867d50c800 1 Processor -- start 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.208+0000 7f867d50c800 1 -- start start 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.208+0000 7f867d50c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df181c0 0x56143df185e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.208+0000 7f867d50c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56143dcf74a0 con 0x56143df181c0 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df181c0 0x56143df185e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df181c0 0x56143df185e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43522/0 (socket says 172.21.15.102:43522) 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f867affd640 1 -- 172.21.15.102:0/1937579631 learned_addr learned my addr 172.21.15.102:0/1937579631 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f867affd640 1 -- 172.21.15.102:0/1937579631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143df18c20 con 0x56143df181c0 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f867affd640 1 --2- 172.21.15.102:0/1937579631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df181c0 0x56143df185e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f866c098010 tx=0x7f866c065eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f8564e01640 1 -- 172.21.15.102:0/1937579631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c064de0 con 0x56143df181c0 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f8564e01640 1 -- 172.21.15.102:0/1937579631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c0840b0 con 0x56143df181c0 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f867d50c800 1 -- 172.21.15.102:0/1937579631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56143df19450 con 0x56143df181c0 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f8564e01640 1 -- 172.21.15.102:0/1937579631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c076be0 con 0x56143df181c0 2024-09-19T11:14:51.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.209+0000 7f867d50c800 1 -- 172.21.15.102:0/1937579631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143df199f0 con 0x56143df181c0 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.210+0000 7f8564e01640 1 -- 172.21.15.102:0/1937579631 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f866c095060 con 0x56143df181c0 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f8564e01640 1 --2- 172.21.15.102:0/1937579631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f855403d000 0x7f855403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f8564e01640 1 -- 172.21.15.102:0/1937579631 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f866c08b070 con 0x56143df181c0 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f867a7fc640 1 --2- 172.21.15.102:0/1937579631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f855403d000 0x7f855403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f867d50c800 1 Processor -- start 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f867d50c800 1 -- start start 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f867a7fc640 1 --2- 172.21.15.102:0/1937579631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f855403d000 0x7f855403f4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x56143df0a880 tx=0x7f867000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f867d50c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df24dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f867d50c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56143def2e90 con 0x56143df249d0 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.211+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df24dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.212+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df24dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43538/0 (socket says 172.21.15.102:43538) 2024-09-19T11:14:51.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.212+0000 7f867affd640 1 -- 172.21.15.102:0/2313606140 learned_addr learned my addr 172.21.15.102:0/2313606140 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.212+0000 7f867affd640 1 -- 172.21.15.102:0/2313606140 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143df253c0 con 0x56143df249d0 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.212+0000 7f867affd640 1 --2- 172.21.15.102:0/2313606140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df24dd0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f866c05abd0 tx=0x7f866c064c20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae7d785aa4ddd9d5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.212+0000 7f855e7fc640 1 -- 172.21.15.102:0/2313606140 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c0a7020 con 0x56143df249d0 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.212+0000 7f855e7fc640 1 -- 172.21.15.102:0/2313606140 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c0644e0 con 0x56143df249d0 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.212+0000 7f855e7fc640 1 -- 172.21.15.102:0/2313606140 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c0845c0 con 0x56143df249d0 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 -- 172.21.15.102:0/2313606140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 msgr2=0x56143df24dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 --2- 172.21.15.102:0/2313606140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df24dd0 secure :-1 s=READY pgs=596 cs=0 l=1 rev1=1 crypto rx=0x7f866c05abd0 tx=0x7f866c064c20 comp rx=0 tx=0).stop 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 -- 172.21.15.102:0/2313606140 shutdown_connections 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 --2- 172.21.15.102:0/2313606140 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df24dd0 unknown :-1 s=CLOSED pgs=596 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 -- 172.21.15.102:0/2313606140 >> 172.21.15.102:0/2313606140 conn(0x56143df20dd0 msgr2=0x56143df1f010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 -- 172.21.15.102:0/2313606140 shutdown_connections 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 -- 172.21.15.102:0/2313606140 wait complete. 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 Processor -- start 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 -- start start 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df2be30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.213+0000 7f867d50c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56143df25830 con 0x56143df249d0 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.214+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df2be30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.214+0000 7f867affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df2be30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43540/0 (socket says 172.21.15.102:43540) 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.214+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 learned_addr learned my addr 172.21.15.102:0/3297350788 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.214+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56143df2c390 con 0x56143df249d0 2024-09-19T11:14:51.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.214+0000 7f867affd640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df2be30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f866c051780 tx=0x7f866c07ef50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.215+0000 7f855cff9640 1 -- 172.21.15.102:0/3297350788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c0b2070 con 0x56143df249d0 2024-09-19T11:14:51.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.215+0000 7f855cff9640 1 -- 172.21.15.102:0/3297350788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f866c082450 con 0x56143df249d0 2024-09-19T11:14:51.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.215+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56143df2c390 con 0x56143df249d0 2024-09-19T11:14:51.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.215+0000 7f855cff9640 1 -- 172.21.15.102:0/3297350788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f866c082730 con 0x56143df249d0 2024-09-19T11:14:51.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.215+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56143df2c390 con 0x56143df249d0 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.216+0000 7f855cff9640 1 -- 172.21.15.102:0/3297350788 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f866c0bd060 con 0x56143df249d0 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.216+0000 7f855cff9640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f854403d000 0x7f854403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.216+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.216+0000 7f855cff9640 1 -- 172.21.15.102:0/3297350788 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f866c0b7d20 con 0x56143df249d0 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.216+0000 7f867a7fc640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f854403d000 0x7f854403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.216+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143df37440 0x56143df398d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.216+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3a020 con 0x56143df37440 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.216+0000 7f867b7fe640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143df37440 0x56143df398d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867a7fc640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f854403d000 0x7f854403f4c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f867000ff20 tx=0x7f8670010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867b7fe640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143df37440 0x56143df398d0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 20 realm 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3a430 con 0x56143df37440 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3ad00 con 0x56143df37440 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.217+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.218+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.218+0000 7f867d50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.218+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.218+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df3bb90 0x56143df3df80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.218+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3e6c0 con 0x56143df3bb90 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.218+0000 7f867affd640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df3bb90 0x56143df3df80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.218+0000 7f867affd640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df3bb90 0x56143df3df80 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867d50c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867d50c800 20 searching for the correct realm 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df40760 0x56143df42c20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df432f0 con 0x56143df40760 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867a7fc640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df40760 0x56143df42c20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867a7fc640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df40760 0x56143df42c20 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8670037040 con 0x56143df40760 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867a7fc640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f867000f070 0x7f867003a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.219+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df432f0 con 0x7f867000f070 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.220+0000 7f867b7fe640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f867000f070 0x7f867003a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.220+0000 7f867b7fe640 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f867000f070 0x7f867003a3c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.220+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.220+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df3bb90 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.220+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.220+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.236 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.221+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.221+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.221+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.221+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df3bb90 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.221+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.221+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df3bb90 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.222+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.222+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x7f867000f070 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.222+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.222+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df40760 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.222+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8670037040 con 0x56143df40760 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.222+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.222+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.237 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.222+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df3bb90 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.223+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.223+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.223+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.223+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x7f867000f070 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.223+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.223+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df40760 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.224+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8670037040 con 0x56143df40760 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.224+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df40760 2024-09-19T11:14:51.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.224+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8670037040 con 0x56143df40760 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.224+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df3bb90 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.224+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.224+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df40760 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.224+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8670037040 con 0x56143df40760 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.224+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df40760 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.225+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8670037040 con 0x56143df40760 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.225+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.225+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.225+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.225+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.225+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df3bb90 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.226+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.226+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df40760 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.226+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8670037040 con 0x56143df40760 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.226+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x7f867000f070 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.226+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.226+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.226+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.226+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df3bb90 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.227+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.227+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df40760 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.227+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8670037040 con 0x56143df40760 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.227+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df3bb90 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.227+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.227+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x7f867000f070 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.228+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.228+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df40760 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.228+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.228+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x7f867000f070 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.228+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.228+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x56143df37440 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.228+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.228+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56143df3b0a0 con 0x7f867000f070 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:51.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3f060 con 0x56143df37440 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3f060 con 0x56143df37440 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3f030 con 0x56143df40760 2024-09-19T11:14:51.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:51.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 zone default found 2024-09-19T11:14:51.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 4 Realm: () 2024-09-19T11:14:51.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:51.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:51.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:51.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 zonegroup default 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.229+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df3f900 con 0x56143df3bb90 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df45160 con 0x56143df40760 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df45500 con 0x56143df40760 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 20 started sync module instance, tier type = 2024-09-19T11:14:51.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:51.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.230+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df44600 con 0x7f867000f070 2024-09-19T11:14:51.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.231+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.232+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94644938754816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df44600 con 0x7f867000f070 2024-09-19T11:14:51.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.232+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df45fb0 con 0x56143df37440 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.233+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94644938754816] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.233+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.233+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94644938759392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df44600 con 0x56143df37440 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.233+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df46a20 con 0x56143df40760 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.234+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94644938759392] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.235+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.235+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94644938752336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df44570 con 0x56143df40760 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.235+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df478e0 con 0x7f867000f070 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.236+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.236+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94644938765872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df48180 con 0x7f867000f070 2024-09-19T11:14:51.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.236+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df48c10 con 0x56143df37440 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.236+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94644938752336] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.237+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94644938765872] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.237+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.237+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94644938763792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df47bd0 con 0x56143df37440 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.237+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df49090 con 0x56143df3bb90 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.238+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.238+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94644938763792] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.238+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94644938773632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df47bd0 con 0x56143df3bb90 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.238+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df49ec0 con 0x56143df3bb90 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.239+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94644938773632] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.240+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.240+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94644938770192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4a710 con 0x56143df3bb90 2024-09-19T11:14:51.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.240+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4b0d0 con 0x56143df3bb90 2024-09-19T11:14:51.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94644938770192] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'189 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94644938779680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4b4f0 con 0x56143df3bb90 2024-09-19T11:14:51.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867d50c800 20 add_watcher() i=0 2024-09-19T11:14:51.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867d50c800 20 add_watcher() i=1 2024-09-19T11:14:51.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867d50c800 20 add_watcher() i=2 2024-09-19T11:14:51.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867d50c800 20 add_watcher() i=3 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867d50c800 20 add_watcher() i=4 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867d50c800 20 add_watcher() i=5 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.241+0000 7f867d50c800 20 add_watcher() i=6 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.242+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94644938779680] v37'190 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.242+0000 7f867d50c800 20 add_watcher() i=7 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.242+0000 7f867d50c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.242+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df4e740 con 0x56143df37440 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.242+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.242+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94644938781104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4ba80 con 0x56143df37440 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.243+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94644938781104] v37'196 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f8531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f867d50c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:51.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f867d50c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f867d50c800 5 note: GC not initialized 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f8530fe1640 20 reqs_thread_entry: start 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f867d50c800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f867d50c800 20 Filter name: none 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f8529ffb640 20 reqs_thread_entry: start 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81d10 con 0x56143df37440 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.244+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81d10 con 0x7f867000f070 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.245+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.245+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81cd0 con 0x56143df37440 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.245+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.245+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81cd0 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.245+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.245+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df821e0 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.245+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.245+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df825d0 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.246+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.246+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df825d0 con 0x56143df37440 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.246+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.246+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df825d0 con 0x56143df37440 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.246+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.246+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df825d0 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.246+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.246+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df82350 con 0x56143df40760 2024-09-19T11:14:51.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.247+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.247+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df82350 con 0x56143df3bb90 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.247+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.247+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df37440 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.247+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.247+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x7f867000f070 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.248+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.248+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df40760 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.248+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.248+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df3bb90 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.248+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.248+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df3bb90 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.249+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.249+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df40760 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.249+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.249+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df3bb90 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.249+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.249+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df37440 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.249+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.249+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df40760 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.250+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.250+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df3bb90 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.250+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.250+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x7f867000f070 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.250+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.264 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.250+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df3bb90 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.250+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.250+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df37440 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.251+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.251+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df37440 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.251+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.251+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df40760 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.251+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.251+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df37440 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.251+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.251+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df37440 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.252+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.252+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df40760 2024-09-19T11:14:51.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.252+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.252+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df40760 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.252+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.252+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df40760 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.252+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.252+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56143df81720 con 0x56143df3bb90 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.253+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.254+0000 7f8531fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.254+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94644938781104] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4d7f0 con 0x56143df37440 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.255+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94644938781104] v37'197 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.255+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94644938754816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4b1b0 con 0x7f867000f070 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.256+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94644938754816] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.256+0000 7f867d50c800 20 remove_watcher() i=0 2024-09-19T11:14:51.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.256+0000 7f867d50c800 2 removed watcher, disabling cache 2024-09-19T11:14:51.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.256+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94644938759392] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4b1b0 con 0x56143df37440 2024-09-19T11:14:51.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.257+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94644938759392] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.257+0000 7f867d50c800 20 remove_watcher() i=1 2024-09-19T11:14:51.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.257+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94644938752336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4b1b0 con 0x56143df40760 2024-09-19T11:14:51.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.258+0000 7f867a7fc640 1 -- 172.21.15.102:0/3297350788 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94644938752336] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8670049040 con 0x56143df40760 2024-09-19T11:14:51.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.258+0000 7f867d50c800 20 remove_watcher() i=2 2024-09-19T11:14:51.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.258+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94644938765872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df44150 con 0x7f867000f070 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.259+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94644938765872] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x7f867000f070 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.259+0000 7f867d50c800 20 remove_watcher() i=3 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.259+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94644938763792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df4b1b0 con 0x56143df37440 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.260+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94644938763792] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f867400a4d0 con 0x56143df37440 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.260+0000 7f867d50c800 20 remove_watcher() i=4 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.260+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94644938773632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df47630 con 0x56143df3bb90 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.262+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94644938773632] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.262+0000 7f867d50c800 20 remove_watcher() i=5 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.262+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94644938770192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df82310 con 0x56143df3bb90 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.263+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94644938770192] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.263+0000 7f867d50c800 20 remove_watcher() i=6 2024-09-19T11:14:51.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.263+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94644938779680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56143df82310 con 0x56143df3bb90 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867affd640 1 -- 172.21.15.102:0/3297350788 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94644938779680] v37'191 uv189 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f866c07f070 con 0x56143df3bb90 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 20 remove_watcher() i=7 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df3bb90 msgr2=0x56143df3df80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df3bb90 0x56143df3df80 crc :-1 s=READY pgs=134 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143df37440 msgr2=0x56143df398d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143df37440 0x56143df398d0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f867000f070 msgr2=0x7f867003a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f867000f070 0x7f867003a3c0 crc :-1 s=READY pgs=73 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df40760 msgr2=0x56143df42c20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df40760 0x56143df42c20 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f854403d000 msgr2=0x7f854403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f854403d000 0x7f854403f4c0 secure :-1 s=READY pgs=247 cs=0 l=1 rev1=1 crypto rx=0x7f867000ff20 tx=0x7f8670010000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 msgr2=0x56143df2be30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867b7fe640 1 -- 172.21.15.102:0/3297350788 reap_dead start 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df2be30 secure :-1 s=READY pgs=597 cs=0 l=1 rev1=1 crypto rx=0x7f866c051780 tx=0x7f866c07ef50 comp rx=0 tx=0).stop 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 shutdown_connections 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/3297350788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df249d0 0x56143df2be30 unknown :-1 s=CLOSED pgs=597 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 >> 172.21.15.102:0/3297350788 conn(0x56143df20dd0 msgr2=0x56143df1efe0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 shutdown_connections 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/3297350788 wait complete. 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/1937579631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f855403d000 msgr2=0x7f855403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/1937579631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f855403d000 0x7f855403f4c0 secure :-1 s=READY pgs=246 cs=0 l=1 rev1=1 crypto rx=0x56143df0a880 tx=0x7f867000f000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 -- 172.21.15.102:0/1937579631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df181c0 msgr2=0x56143df185e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.264+0000 7f867d50c800 1 --2- 172.21.15.102:0/1937579631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df181c0 0x56143df185e0 secure :-1 s=READY pgs=595 cs=0 l=1 rev1=1 crypto rx=0x7f866c098010 tx=0x7f866c065eb0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1937579631 shutdown_connections 2024-09-19T11:14:51.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 --2- 172.21.15.102:0/1937579631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f855403d000 0x7f855403f4c0 unknown :-1 s=CLOSED pgs=246 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 --2- 172.21.15.102:0/1937579631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143df181c0 0x56143df185e0 unknown :-1 s=CLOSED pgs=595 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1937579631 >> 172.21.15.102:0/1937579631 conn(0x56143df0c570 msgr2=0x56143df0c950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1937579631 shutdown_connections 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1937579631 wait complete. 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df03890 msgr2=0x56143df05d30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56143df03890 0x56143df05d30 crc :-1 s=READY pgs=133 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143ddff690 msgr2=0x56143df014b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56143ddff690 0x56143df014b0 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df07920 msgr2=0x56143df09d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56143df07920 0x56143df09d10 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f856003cfb0 msgr2=0x7f856003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f856003cfb0 0x7f856003f470 secure :-1 s=READY pgs=245 cs=0 l=1 rev1=1 crypto rx=0x7f8670001e80 tx=0x7f86700013e0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 msgr2=0x56143def9e60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 --2- 172.21.15.102:0/1286536917 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56143ddfed50 0x56143def9e60 secure :-1 s=READY pgs=594 cs=0 l=1 rev1=1 crypto rx=0x7f866c000c00 tx=0x7f866c002fb0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867b7fe640 1 -- 172.21.15.102:0/1286536917 reap_dead start 2024-09-19T11:14:51.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 shutdown_connections 2024-09-19T11:14:51.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 >> 172.21.15.102:0/1286536917 conn(0x56143ddfaa60 msgr2=0x56143deec6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 shutdown_connections 2024-09-19T11:14:51.276 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.265+0000 7f867d50c800 1 -- 172.21.15.102:0/1286536917 wait complete. 2024-09-19T11:14:51.277 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"anonymous","categories":[],"s3select":{}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"anonymous","categories":[],"total":{"bytes_sent":0,"bytes_received":0,"ops":0,"successful_ops":0,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-19T11:14:51.277 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:14:51.277 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show'] 2024-09-19T11:14:51.278 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show'] 2024-09-19T11:14:51.278 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show 2024-09-19T11:14:51.320 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:51.321 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:51.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.320+0000 7f94ec142800 1 Processor -- start 2024-09-19T11:14:51.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.320+0000 7f94ec142800 1 -- start start 2024-09-19T11:14:51.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.320+0000 7f94ec142800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56267d111a80 0x56267d113f40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.320+0000 7f94ec142800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56267d1145c0 con 0x56267d10df10 2024-09-19T11:14:51.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.320+0000 7f94ec142800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x56267cf987d0 con 0x56267d111a80 2024-09-19T11:14:51.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.321+0000 7f94e7685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56267d111a80 0x56267d113f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.321+0000 7f94e7e86640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x56267d10df10 0x56267d110300 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47860/0 (socket says 172.21.15.102:47860) 2024-09-19T11:14:51.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.321+0000 7f94e7e86640 1 -- 172.21.15.102:0/224545823 learned_addr learned my addr 172.21.15.102:0/224545823 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:51.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.321+0000 7f94e7685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56267d111a80 0x56267d113f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43544/0 (socket says 172.21.15.102:43544) 2024-09-19T11:14:51.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.321+0000 7f94e7685640 1 -- 172.21.15.102:0/224545823 >> v1:172.21.15.37:6789/0 conn(0x56267d10df10 legacy=0x56267d110300 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.321+0000 7f94e7685640 1 -- 172.21.15.102:0/224545823 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267d1157f0 con 0x56267d111a80 2024-09-19T11:14:51.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.323+0000 7f94e7685640 1 --2- 172.21.15.102:0/224545823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d111a80 0x56267d113f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00a470 tx=0x7f94dc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9d17d263998e6997 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.323+0000 7f94e6e84640 1 -- 172.21.15.102:0/224545823 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94dc053570 con 0x56267d111a80 2024-09-19T11:14:51.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.323+0000 7f94e6e84640 1 -- 172.21.15.102:0/224545823 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94dc058070 con 0x56267d111a80 2024-09-19T11:14:51.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.323+0000 7f94e6e84640 1 -- 172.21.15.102:0/224545823 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94dc053880 con 0x56267d111a80 2024-09-19T11:14:51.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.324+0000 7f94ec142800 1 -- 172.21.15.102:0/224545823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d111a80 msgr2=0x56267d113f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.324+0000 7f94ec142800 1 --2- 172.21.15.102:0/224545823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d111a80 0x56267d113f40 secure :-1 s=READY pgs=599 cs=0 l=1 rev1=1 crypto rx=0x7f94dc00a470 tx=0x7f94dc045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.324+0000 7f94ec142800 1 -- 172.21.15.102:0/224545823 shutdown_connections 2024-09-19T11:14:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.324+0000 7f94ec142800 1 --2- 172.21.15.102:0/224545823 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d111a80 0x56267d113f40 unknown :-1 s=CLOSED pgs=599 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.324+0000 7f94ec142800 1 -- 172.21.15.102:0/224545823 >> 172.21.15.102:0/224545823 conn(0x56267d107a50 msgr2=0x56267d109eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.324+0000 7f94ec142800 1 -- 172.21.15.102:0/224545823 shutdown_connections 2024-09-19T11:14:51.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.324+0000 7f94ec142800 1 -- 172.21.15.102:0/224545823 wait complete. 2024-09-19T11:14:51.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.337+0000 7f94ec142800 1 Processor -- start 2024-09-19T11:14:51.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.337+0000 7f94ec142800 1 -- start start 2024-09-19T11:14:51.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.337+0000 7f94ec142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d10d6a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.337+0000 7f94ec142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56267cfa5dd0 con 0x56267d10df10 2024-09-19T11:14:51.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.338+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d10d6a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.338+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d10d6a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43556/0 (socket says 172.21.15.102:43556) 2024-09-19T11:14:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.338+0000 7f94e7e86640 1 -- 172.21.15.102:0/766628887 learned_addr learned my addr 172.21.15.102:0/766628887 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.338+0000 7f94e7e86640 1 -- 172.21.15.102:0/766628887 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267d10dc90 con 0x56267d10df10 2024-09-19T11:14:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.338+0000 7f94e7e86640 1 --2- 172.21.15.102:0/766628887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d10d6a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f94d8001df0 tx=0x7f94d800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=823eb6583d720e94 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.338+0000 7f93d5e0b640 1 -- 172.21.15.102:0/766628887 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d8012020 con 0x56267d10df10 2024-09-19T11:14:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.338+0000 7f93d5e0b640 1 -- 172.21.15.102:0/766628887 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d800e470 con 0x56267d10df10 2024-09-19T11:14:51.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.338+0000 7f93d5e0b640 1 -- 172.21.15.102:0/766628887 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d800e7f0 con 0x56267d10df10 2024-09-19T11:14:51.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.339+0000 7f94ec142800 1 -- 172.21.15.102:0/766628887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 msgr2=0x56267d10d6a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.339+0000 7f94ec142800 1 --2- 172.21.15.102:0/766628887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d10d6a0 secure :-1 s=READY pgs=600 cs=0 l=1 rev1=1 crypto rx=0x7f94d8001df0 tx=0x7f94d800b6c0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.339+0000 7f94ec142800 1 -- 172.21.15.102:0/766628887 shutdown_connections 2024-09-19T11:14:51.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.339+0000 7f94ec142800 1 --2- 172.21.15.102:0/766628887 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d10d6a0 unknown :-1 s=CLOSED pgs=600 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.339+0000 7f94ec142800 1 -- 172.21.15.102:0/766628887 >> 172.21.15.102:0/766628887 conn(0x56267d107a50 msgr2=0x56267d1f8c90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.339+0000 7f94ec142800 1 -- 172.21.15.102:0/766628887 shutdown_connections 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.339+0000 7f94ec142800 1 -- 172.21.15.102:0/766628887 wait complete. 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.339+0000 7f94ec142800 1 Processor -- start 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94ec142800 1 -- start start 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94ec142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d207000 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94ec142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56267d114a90 con 0x56267d10df10 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d207000 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d207000 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43564/0 (socket says 172.21.15.102:43564) 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94e7e86640 1 -- 172.21.15.102:0/1357258604 learned_addr learned my addr 172.21.15.102:0/1357258604 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94e7e86640 1 -- 172.21.15.102:0/1357258604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267d207560 con 0x56267d10df10 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94e7e86640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d207000 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x56267d10d1d0 tx=0x7f94d8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f93cffff640 1 -- 172.21.15.102:0/1357258604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d8012030 con 0x56267d10df10 2024-09-19T11:14:51.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f93cffff640 1 -- 172.21.15.102:0/1357258604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d801a6d0 con 0x56267d10df10 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56267d2077f0 con 0x56267d10df10 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.340+0000 7f93cffff640 1 -- 172.21.15.102:0/1357258604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d801a9d0 con 0x56267d10df10 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.341+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56267d2081f0 con 0x56267d10df10 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.341+0000 7f93cffff640 1 -- 172.21.15.102:0/1357258604 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f94d8015020 con 0x56267d10df10 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.342+0000 7f93cffff640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93d003d000 0x7f93d003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.342+0000 7f93cffff640 1 -- 172.21.15.102:0/1357258604 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f94d8020030 con 0x56267d10df10 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.342+0000 7f94e7685640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93d003d000 0x7f93d003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.342+0000 7f94ec142800 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d111a80 0x56267d20e650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.342+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d20eb90 con 0x56267d111a80 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.342+0000 7f94e8687640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d111a80 0x56267d20e650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.342+0000 7f94e7685640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93d003d000 0x7f93d003f4c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94dc057000 tx=0x7f94dc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.342+0000 7f94e8687640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d111a80 0x56267d20e650 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.343+0000 7f94e8687640 1 -- 172.21.15.102:0/1357258604 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d111a80 2024-09-19T11:14:51.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.343+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d20ef30 con 0x56267d111a80 2024-09-19T11:14:51.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.343+0000 7f94e8687640 1 -- 172.21.15.102:0/1357258604 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d111a80 2024-09-19T11:14:51.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.343+0000 7f94ec142800 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d210a70 0x56267d212ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.343+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d213670 con 0x56267d210a70 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.343+0000 7f94e7e86640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d210a70 0x56267d212ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.344+0000 7f94e7e86640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d210a70 0x56267d212ee0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.344+0000 7f94e7e86640 1 -- 172.21.15.102:0/1357258604 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f94d801ad50 con 0x56267d210a70 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.344+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d20f780 con 0x56267d111a80 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.344+0000 7f94e8687640 1 -- 172.21.15.102:0/1357258604 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d111a80 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.344+0000 7f94ec142800 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d214ad0 0x56267d216ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.344+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2175b0 con 0x56267d214ad0 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.344+0000 7f94e7685640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d214ad0 0x56267d216ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.345+0000 7f94e7685640 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d214ad0 0x56267d216ec0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.345+0000 7f94e7685640 1 -- 172.21.15.102:0/1357258604 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f94dc051070 con 0x56267d214ad0 2024-09-19T11:14:51.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.345+0000 7f94ec142800 1 Processor -- start 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.345+0000 7f94ec142800 1 -- start start 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.345+0000 7f94ec142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d225330 0x56267d225750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.345+0000 7f94ec142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56267d0044a0 con 0x56267d225330 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d225330 0x56267d225750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d225330 0x56267d225750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43568/0 (socket says 172.21.15.102:43568) 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f94e7e86640 1 -- 172.21.15.102:0/4293623837 learned_addr learned my addr 172.21.15.102:0/4293623837 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f94e7e86640 1 -- 172.21.15.102:0/4293623837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267d225d90 con 0x56267d225330 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f94e7e86640 1 --2- 172.21.15.102:0/4293623837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d225330 0x56267d225750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f94d800dfd0 tx=0x7f94d800c420 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f93cd7fa640 1 -- 172.21.15.102:0/4293623837 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d8042ac0 con 0x56267d225330 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f93cd7fa640 1 -- 172.21.15.102:0/4293623837 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d8042c60 con 0x56267d225330 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f94ec142800 1 -- 172.21.15.102:0/4293623837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56267d2265c0 con 0x56267d225330 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f93cd7fa640 1 -- 172.21.15.102:0/4293623837 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d8022af0 con 0x56267d225330 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.346+0000 7f94ec142800 1 -- 172.21.15.102:0/4293623837 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56267d2265c0 con 0x56267d225330 2024-09-19T11:14:51.353 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.347+0000 7f93cd7fa640 1 -- 172.21.15.102:0/4293623837 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f94d8044d10 con 0x56267d225330 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.347+0000 7f93cd7fa640 1 --2- 172.21.15.102:0/4293623837 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93c003d000 0x7f93c003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.347+0000 7f93cd7fa640 1 -- 172.21.15.102:0/4293623837 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f94d803cd30 con 0x56267d225330 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.347+0000 7f94e7685640 1 --2- 172.21.15.102:0/4293623837 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93c003d000 0x7f93c003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94ec142800 1 Processor -- start 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94e7685640 1 --2- 172.21.15.102:0/4293623837 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93c003d000 0x7f93c003f4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x56267d213a10 tx=0x7f94dc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94ec142800 1 -- start start 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94ec142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d231e00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94ec142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56267d10c0f0 con 0x56267d231a00 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d231e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d231e00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43582/0 (socket says 172.21.15.102:43582) 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94e7e86640 1 -- 172.21.15.102:0/3165055604 learned_addr learned my addr 172.21.15.102:0/3165055604 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.348+0000 7f94e7e86640 1 -- 172.21.15.102:0/3165055604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267d2323f0 con 0x56267d231a00 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94e7e86640 1 --2- 172.21.15.102:0/3165055604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d231e00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94d803b060 tx=0x7f94d80547d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e088be86e1099ed4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f93c6ffd640 1 -- 172.21.15.102:0/3165055604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d8024420 con 0x56267d231a00 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f93c6ffd640 1 -- 172.21.15.102:0/3165055604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d8022e70 con 0x56267d231a00 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f93c6ffd640 1 -- 172.21.15.102:0/3165055604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d8042120 con 0x56267d231a00 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94ec142800 1 -- 172.21.15.102:0/3165055604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 msgr2=0x56267d231e00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94ec142800 1 --2- 172.21.15.102:0/3165055604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d231e00 secure :-1 s=READY pgs=603 cs=0 l=1 rev1=1 crypto rx=0x7f94d803b060 tx=0x7f94d80547d0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94ec142800 1 -- 172.21.15.102:0/3165055604 shutdown_connections 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94ec142800 1 --2- 172.21.15.102:0/3165055604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d231e00 unknown :-1 s=CLOSED pgs=603 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94ec142800 1 -- 172.21.15.102:0/3165055604 >> 172.21.15.102:0/3165055604 conn(0x56267d22de00 msgr2=0x56267d22c040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94ec142800 1 -- 172.21.15.102:0/3165055604 shutdown_connections 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94ec142800 1 -- 172.21.15.102:0/3165055604 wait complete. 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.349+0000 7f94ec142800 1 Processor -- start 2024-09-19T11:14:51.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.350+0000 7f94ec142800 1 -- start start 2024-09-19T11:14:51.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.350+0000 7f94ec142800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d238ea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.350+0000 7f94ec142800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56267d232860 con 0x56267d231a00 2024-09-19T11:14:51.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.350+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d238ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.350+0000 7f94e7e86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d238ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43588/0 (socket says 172.21.15.102:43588) 2024-09-19T11:14:51.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.350+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 learned_addr learned my addr 172.21.15.102:0/2344054999 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.350+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56267d239400 con 0x56267d231a00 2024-09-19T11:14:51.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.351+0000 7f94e7e86640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d238ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f94d80223d0 tx=0x7f94d803af90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.351+0000 7f93c57fa640 1 -- 172.21.15.102:0/2344054999 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d8037940 con 0x56267d231a00 2024-09-19T11:14:51.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.351+0000 7f93c57fa640 1 -- 172.21.15.102:0/2344054999 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f94d8037ce0 con 0x56267d231a00 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.351+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56267d239400 con 0x56267d231a00 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.351+0000 7f93c57fa640 1 -- 172.21.15.102:0/2344054999 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f94d8037b20 con 0x56267d231a00 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.351+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56267d239400 con 0x56267d231a00 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.352+0000 7f93c57fa640 1 -- 172.21.15.102:0/2344054999 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f94d8054970 con 0x56267d231a00 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.352+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.352+0000 7f93c57fa640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93b003cfb0 0x7f93b003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.352+0000 7f93c57fa640 1 -- 172.21.15.102:0/2344054999 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f94d8068070 con 0x56267d231a00 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.352+0000 7f94e7685640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93b003cfb0 0x7f93b003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.352+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d244360 0x56267d2467f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.352+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d246f40 con 0x56267d244360 2024-09-19T11:14:51.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94e8687640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d244360 0x56267d2467f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94e7685640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93b003cfb0 0x7f93b003f470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0539f0 tx=0x7f94dc053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94e8687640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d244360 0x56267d2467f0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94ec142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94ec142800 20 realm 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d247350 con 0x56267d244360 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94ec142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94ec142800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.353+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d247c20 con 0x56267d244360 2024-09-19T11:14:51.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94ec142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94ec142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d248af0 0x56267d24aee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d24b640 con 0x56267d248af0 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94e7e86640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d248af0 0x56267d24aee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.354+0000 7f94e7e86640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d248af0 0x56267d24aee0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.355+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.355+0000 7f94ec142800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:51.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.355+0000 7f94ec142800 20 searching for the correct realm 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.355+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d24d6f0 0x56267d24fbb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.355+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d250280 con 0x56267d24d6f0 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.355+0000 7f94e7685640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d24d6f0 0x56267d24fbb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.356+0000 7f94e7685640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d24d6f0 0x56267d24fbb0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.356+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.356+0000 7f94e7685640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f94dc06c040 0x7f94dc05f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.356+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d250280 con 0x7f94dc06c040 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.356+0000 7f94e8687640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f94dc06c040 0x7f94dc05f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.356+0000 7f94e8687640 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f94dc06c040 0x7f94dc05f420 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.357+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.357+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d248af0 2024-09-19T11:14:51.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.357+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.357+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.357+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.357+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.357+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.358+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d248af0 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.358+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.358+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d248af0 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.358+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.358+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x7f94dc06c040 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.358+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.358+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d24d6f0 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.359+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.359+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.359+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.359+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d248af0 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.359+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.359+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.359+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.359+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x7f94dc06c040 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.360+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.360+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d24d6f0 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.360+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.360+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d24d6f0 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.360+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.360+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d248af0 2024-09-19T11:14:51.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.360+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.360+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d24d6f0 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.361+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.361+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d24d6f0 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.361+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.361+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.361+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.361+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.361+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.361+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d248af0 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.362+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.362+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d24d6f0 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.362+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.362+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x7f94dc06c040 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.362+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.362+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.362+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.362+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d248af0 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.363+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.363+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d24d6f0 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.363+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.363+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d248af0 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.363+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.363+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x7f94dc06c040 2024-09-19T11:14:51.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.364+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.364+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d24d6f0 2024-09-19T11:14:51.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.364+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.364+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x7f94dc06c040 2024-09-19T11:14:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x56267d244360 2024-09-19T11:14:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56267d247fc0 con 0x7f94dc06c040 2024-09-19T11:14:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94ec142800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:51.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94ec142800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94ec142800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94ec142800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94ec142800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94ec142800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.365+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d24bff0 con 0x56267d244360 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.366+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.366+0000 7f94ec142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.366+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.366+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d24bff0 con 0x56267d244360 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.366+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.366+0000 7f94ec142800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.366+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.366+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d24bfc0 con 0x56267d24d6f0 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 zone default found 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 4 Realm: () 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 zonegroup default 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d24c890 con 0x56267d248af0 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2520f0 con 0x56267d24d6f0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d252490 con 0x56267d24d6f0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 started sync module instance, tier type = 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.367+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d251590 con 0x7f94dc06c040 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.369+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.369+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94723308329648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d251590 con 0x7f94dc06c040 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.369+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d252e90 con 0x56267d244360 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.370+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94723308329648] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.370+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.370+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94723308333472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d251590 con 0x56267d244360 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.370+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d253920 con 0x56267d24d6f0 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.371+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94723308333472] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.371+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.371+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94723308327136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d251500 con 0x56267d24d6f0 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.371+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2547e0 con 0x7f94dc06c040 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.373+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94723308327136] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.373+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.373+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94723308340016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d254c00 con 0x7f94dc06c040 2024-09-19T11:14:51.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.373+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2555c0 con 0x56267d244360 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.374+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.374+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94723308343568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2559e0 con 0x56267d244360 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.374+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2564e0 con 0x56267d248af0 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.374+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94723308340016] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.375+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.375+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94723308347344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2568d0 con 0x56267d248af0 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.376+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94723308343568] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.376+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d255530 con 0x56267d248af0 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.377+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94723308347344] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.377+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.377+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94723308350944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2576b0 con 0x56267d248af0 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.377+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d257f00 con 0x56267d248af0 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94723308350944] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'192 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94723308352480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d257df0 con 0x56267d248af0 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94ec142800 20 add_watcher() i=0 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94ec142800 20 add_watcher() i=1 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94ec142800 20 add_watcher() i=2 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94ec142800 20 add_watcher() i=3 2024-09-19T11:14:51.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94ec142800 20 add_watcher() i=4 2024-09-19T11:14:51.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94ec142800 20 add_watcher() i=5 2024-09-19T11:14:51.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.379+0000 7f94ec142800 20 add_watcher() i=6 2024-09-19T11:14:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.380+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94723308352480] v37'193 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.380+0000 7f94ec142800 20 add_watcher() i=7 2024-09-19T11:14:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.380+0000 7f94ec142800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.380+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d25b350 con 0x56267d244360 2024-09-19T11:14:51.396 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.381+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.381+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94723308353664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d258870 con 0x56267d244360 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.382+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94723308353664] v37'198 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.382+0000 7f939dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.382+0000 7f94ec142800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.382+0000 7f94ec142800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.382+0000 7f94ec142800 5 note: GC not initialized 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.382+0000 7f939cfe1640 20 reqs_thread_entry: start 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.382+0000 7f94ec142800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.382+0000 7f94ec142800 20 Filter name: none 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.383+0000 7f93167fc640 20 reqs_thread_entry: start 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.383+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.e 6:74cd889a:usage::usage.0:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e850 con 0x56267d244360 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.383+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 usage.0 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.383+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 6.3 6:c0e78a64:usage::usage.1:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e850 con 0x7f94dc06c040 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.383+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(63 usage.1 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.383+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.d 6:b564efa4:usage::usage.2:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e810 con 0x56267d244360 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.383+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 usage.2 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.383+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:65 6.2 6:42d64401:usage::usage.3:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e810 con 0x56267d24d6f0 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(65 usage.3 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 6.7 6:e09b6f01:usage::usage.4:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e850 con 0x56267d24d6f0 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(66 usage.4 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.6 6:672810f1:usage::usage.5:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e810 con 0x56267d24d6f0 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(67 usage.5 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.4 6:25a86931:usage::usage.6:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e810 con 0x56267d244360 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 usage.6 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 6.17 6:ebbe7322:usage::usage.7:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e810 con 0x56267d244360 2024-09-19T11:14:51.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 usage.7 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.384+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:70 6.6 6:607e1922:usage::usage.8:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e810 con 0x56267d24d6f0 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.385+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(70 usage.8 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.385+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.b 6:d7809252:usage::usage.9:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e810 con 0x56267d24d6f0 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.385+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(71 usage.9 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 151+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.385+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d28e810 con 0x56267d248af0 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.385+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(72 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.385+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:73 6.4 6:21f845ae:usage::usage.11:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290410 con 0x56267d244360 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.386+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(73 usage.11 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.386+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.f 6:f0386354:usage::usage.12:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290410 con 0x7f94dc06c040 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.386+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(74 usage.12 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.386+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:75 6.c 6:3735eec4:usage::usage.13:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903c0 con 0x56267d24d6f0 2024-09-19T11:14:51.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.386+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(75 usage.13 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.386+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 6.18 6:1f520d0a:usage::usage.14:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903a0 con 0x56267d248af0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.387+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(76 usage.14 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.387+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 6.0 6:029cee12:usage::usage.15:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903a0 con 0x56267d248af0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.387+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(77 usage.15 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.387+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:78 6.1e 6:7f3e030e:usage::usage.16:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903a0 con 0x56267d24d6f0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.387+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(78 usage.16 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.387+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:79 6.10 6:0fbdcb32:usage::usage.17:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903a0 con 0x56267d248af0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.387+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(79 usage.17 [call out=185b] v0'0 uv5 ondisk = 0) ==== 152+0+185 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.387+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.19 6:993b03e9:usage::usage.18:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903a0 con 0x56267d244360 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.388+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(80 usage.18 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.388+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:81 6.1a 6:58fcd270:usage::usage.19:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903a0 con 0x56267d24d6f0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.388+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(81 usage.19 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.388+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:82 6.1f 6:fcd63d49:usage::usage.20:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903a0 con 0x56267d248af0 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.388+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(82 usage.20 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.388+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.5 6:a2c1a412:usage::usage.21:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d2903a0 con 0x7f94dc06c040 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.388+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(83 usage.21 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.388+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:84 6.13 6:cdb71d68:usage::usage.22:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d248af0 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.389+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(84 usage.22 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.389+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:85 6.17 6:ef3bca03:usage::usage.23:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d244360 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.389+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(85 usage.23 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.389+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:86 6.e 6:7412960a:usage::usage.24:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d244360 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.389+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(86 usage.24 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.389+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.7 6:e62d1024:usage::usage.25:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d24d6f0 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.389+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(87 usage.25 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.389+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:88 6.d 6:b172cd59:usage::usage.26:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d244360 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(88 usage.26 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:89 6.1 6:83912023:usage::usage.27:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d244360 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(89 usage.27 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:90 6.1e 6:7c73bdb3:usage::usage.28:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d24d6f0 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(90 usage.28 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.16 6:6e59fa35:usage::usage.29:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d24d6f0 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(91 usage.29 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:92 6.1c 6:38fe6885:usage::usage.30:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d24d6f0 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(92 usage.30 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.390+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:93 6.1d 6:bb28dff0:usage::usage.31:head [call rgw.user_usage_log_read in=60b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56267d290330 con 0x56267d248af0 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.391+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(93 usage.31 [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.392+0000 7f939dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.392+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94723308353664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d259f10 con 0x56267d244360 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.393+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(94 data_loggenerations_metadata [watch unwatch cookie 94723308353664] v37'199 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.393+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94723308329648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d28ce00 con 0x7f94dc06c040 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.394+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(95 notify.0 [watch unwatch cookie 94723308329648] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.394+0000 7f94ec142800 20 remove_watcher() i=0 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.394+0000 7f94ec142800 2 removed watcher, disabling cache 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.394+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94723308333472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d251ab0 con 0x56267d244360 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.395+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(96 notify.1 [watch unwatch cookie 94723308333472] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.395+0000 7f94ec142800 20 remove_watcher() i=1 2024-09-19T11:14:51.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.395+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94723308327136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d251ab0 con 0x56267d24d6f0 2024-09-19T11:14:51.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.396+0000 7f94e7685640 1 -- 172.21.15.102:0/2344054999 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(97 notify.2 [watch unwatch cookie 94723308327136] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94dc051070 con 0x56267d24d6f0 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.396+0000 7f94ec142800 20 remove_watcher() i=2 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.396+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94723308340016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2510e0 con 0x7f94dc06c040 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.397+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(98 notify.3 [watch unwatch cookie 94723308340016] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x7f94dc06c040 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.397+0000 7f94ec142800 20 remove_watcher() i=3 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.397+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:99 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94723308343568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d254330 con 0x56267d244360 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.398+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(99 notify.4 [watch unwatch cookie 94723308343568] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94e000a4d0 con 0x56267d244360 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.398+0000 7f94ec142800 20 remove_watcher() i=4 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.398+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94723308347344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2510e0 con 0x56267d248af0 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.399+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(100 notify.5 [watch unwatch cookie 94723308347344] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.399+0000 7f94ec142800 20 remove_watcher() i=5 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.399+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94723308350944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d255110 con 0x56267d248af0 2024-09-19T11:14:51.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.400+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(101 notify.6 [watch unwatch cookie 94723308350944] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.400+0000 7f94ec142800 20 remove_watcher() i=6 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.400+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94723308352480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56267d2510e0 con 0x56267d248af0 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94e7e86640 1 -- 172.21.15.102:0/2344054999 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(102 notify.7 [watch unwatch cookie 94723308352480] v37'194 uv192 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f94d8072020 con 0x56267d248af0 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 20 remove_watcher() i=7 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d248af0 msgr2=0x56267d24aee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d248af0 0x56267d24aee0 crc :-1 s=READY pgs=136 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d244360 msgr2=0x56267d2467f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d244360 0x56267d2467f0 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f94dc06c040 msgr2=0x7f94dc05f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f94dc06c040 0x7f94dc05f420 crc :-1 s=READY pgs=74 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d24d6f0 msgr2=0x56267d24fbb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.401+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d24d6f0 0x56267d24fbb0 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93b003cfb0 msgr2=0x7f93b003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93b003cfb0 0x7f93b003f470 secure :-1 s=READY pgs=250 cs=0 l=1 rev1=1 crypto rx=0x7f94dc0539f0 tx=0x7f94dc053000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 msgr2=0x56267d238ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94e8687640 1 -- 172.21.15.102:0/2344054999 reap_dead start 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d238ea0 secure :-1 s=READY pgs=604 cs=0 l=1 rev1=1 crypto rx=0x7f94d80223d0 tx=0x7f94d803af90 comp rx=0 tx=0).stop 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 shutdown_connections 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/2344054999 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d231a00 0x56267d238ea0 unknown :-1 s=CLOSED pgs=604 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 >> 172.21.15.102:0/2344054999 conn(0x56267d22de00 msgr2=0x56267d22c010 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 shutdown_connections 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/2344054999 wait complete. 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/4293623837 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93c003d000 msgr2=0x7f93c003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/4293623837 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93c003d000 0x7f93c003f4c0 secure :-1 s=READY pgs=249 cs=0 l=1 rev1=1 crypto rx=0x56267d213a10 tx=0x7f94dc005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/4293623837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d225330 msgr2=0x56267d225750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/4293623837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d225330 0x56267d225750 secure :-1 s=READY pgs=602 cs=0 l=1 rev1=1 crypto rx=0x7f94d800dfd0 tx=0x7f94d800c420 comp rx=0 tx=0).stop 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/4293623837 shutdown_connections 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/4293623837 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93c003d000 0x7f93c003f4c0 unknown :-1 s=CLOSED pgs=249 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/4293623837 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d225330 0x56267d225750 unknown :-1 s=CLOSED pgs=602 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/4293623837 >> 172.21.15.102:0/4293623837 conn(0x56267d2196e0 msgr2=0x56267d219ac0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/4293623837 shutdown_connections 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/4293623837 wait complete. 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d210a70 msgr2=0x56267d212ee0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x56267d210a70 0x56267d212ee0 crc :-1 s=READY pgs=135 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d111a80 msgr2=0x56267d20e650 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56267d111a80 0x56267d20e650 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d214ad0 msgr2=0x56267d216ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56267d214ad0 0x56267d216ec0 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93d003d000 msgr2=0x7f93d003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.402+0000 7f94ec142800 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93d003d000 0x7f93d003f4c0 secure :-1 s=READY pgs=248 cs=0 l=1 rev1=1 crypto rx=0x7f94dc057000 tx=0x7f94dc052000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.403+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 msgr2=0x56267d207000 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.403+0000 7f94ec142800 1 --2- 172.21.15.102:0/1357258604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56267d10df10 0x56267d207000 secure :-1 s=READY pgs=601 cs=0 l=1 rev1=1 crypto rx=0x56267d10d1d0 tx=0x7f94d8000bc0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.403+0000 7f94e8687640 1 -- 172.21.15.102:0/1357258604 reap_dead start 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.403+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 shutdown_connections 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.403+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 >> 172.21.15.102:0/1357258604 conn(0x56267d107a50 msgr2=0x56267d1f87e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.403+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 shutdown_connections 2024-09-19T11:14:51.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.403+0000 7f94ec142800 1 -- 172.21.15.102:0/1357258604 wait complete. 2024-09-19T11:14:51.413 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"anonymous","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]},{"user":"foo","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"anonymous","categories":[{"category":"list_buckets","bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1}],"total":{"bytes_sent":204,"bytes_received":0,"ops":1,"successful_ops":1,"bytes_processed":0,"bytes_returned":0}},{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-19T11:14:51.414 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:14:51.414 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-19T11:14:51.414 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-19T11:14:51.414 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-19T11:14:51.498 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:51.498 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:51.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.498+0000 7f71aa52c800 1 Processor -- start 2024-09-19T11:14:51.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.498+0000 7f71aa52c800 1 -- start start 2024-09-19T11:14:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.498+0000 7f71aa52c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5568b7ddcaa0 0x5568b7ddef60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.498+0000 7f71aa52c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5568b7ddf5e0 con 0x5568b7dd8f30 2024-09-19T11:14:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.498+0000 7f71aa52c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5568b7c637d0 con 0x5568b7ddcaa0 2024-09-19T11:14:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.499+0000 7f71a5a4e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5568b7ddcaa0 0x5568b7ddef60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.499+0000 7f71a624f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5568b7dd8f30 0x5568b7ddb320 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47868/0 (socket says 172.21.15.102:47868) 2024-09-19T11:14:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.499+0000 7f71a624f640 1 -- 172.21.15.102:0/2668836070 learned_addr learned my addr 172.21.15.102:0/2668836070 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:51.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.499+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2668836070 >> v1:172.21.15.37:6789/0 conn(0x5568b7dd8f30 legacy=0x5568b7ddb320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.499+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2668836070 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b7de0810 con 0x5568b7ddcaa0 2024-09-19T11:14:51.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/2668836070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7ddcaa0 0x5568b7ddef60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f719c00a470 tx=0x7f719c045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=719226a61e07dab9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71a524d640 1 -- 172.21.15.102:0/2668836070 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f719c053570 con 0x5568b7ddcaa0 2024-09-19T11:14:51.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71a524d640 1 -- 172.21.15.102:0/2668836070 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719c058070 con 0x5568b7ddcaa0 2024-09-19T11:14:51.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71a524d640 1 -- 172.21.15.102:0/2668836070 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f719c053880 con 0x5568b7ddcaa0 2024-09-19T11:14:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71aa52c800 1 -- 172.21.15.102:0/2668836070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7ddcaa0 msgr2=0x5568b7ddef60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2668836070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7ddcaa0 0x5568b7ddef60 secure :-1 s=READY pgs=606 cs=0 l=1 rev1=1 crypto rx=0x7f719c00a470 tx=0x7f719c045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71aa52c800 1 -- 172.21.15.102:0/2668836070 shutdown_connections 2024-09-19T11:14:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2668836070 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7ddcaa0 0x5568b7ddef60 unknown :-1 s=CLOSED pgs=606 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71aa52c800 1 -- 172.21.15.102:0/2668836070 >> 172.21.15.102:0/2668836070 conn(0x5568b7dd2a90 msgr2=0x5568b7dd4ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.501+0000 7f71aa52c800 1 -- 172.21.15.102:0/2668836070 shutdown_connections 2024-09-19T11:14:51.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.502+0000 7f71aa52c800 1 -- 172.21.15.102:0/2668836070 wait complete. 2024-09-19T11:14:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.515+0000 7f71aa52c800 1 Processor -- start 2024-09-19T11:14:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.515+0000 7f71aa52c800 1 -- start start 2024-09-19T11:14:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.515+0000 7f71aa52c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ec8480 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.515+0000 7f71aa52c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5568b7c70dd0 con 0x5568b7dd8f30 2024-09-19T11:14:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.515+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ec8480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.516+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ec8480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43612/0 (socket says 172.21.15.102:43612) 2024-09-19T11:14:51.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.516+0000 7f71a624f640 1 -- 172.21.15.102:0/529177998 learned_addr learned my addr 172.21.15.102:0/529177998 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.516+0000 7f71a624f640 1 -- 172.21.15.102:0/529177998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b7ec8a70 con 0x5568b7dd8f30 2024-09-19T11:14:51.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.516+0000 7f71a624f640 1 --2- 172.21.15.102:0/529177998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ec8480 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7198001df0 tx=0x7f719800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b7d6f9f5260fab3b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.516+0000 7f7094608640 1 -- 172.21.15.102:0/529177998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7198012020 con 0x5568b7dd8f30 2024-09-19T11:14:51.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.516+0000 7f7094608640 1 -- 172.21.15.102:0/529177998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719800e470 con 0x5568b7dd8f30 2024-09-19T11:14:51.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.516+0000 7f7094608640 1 -- 172.21.15.102:0/529177998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f719800e7f0 con 0x5568b7dd8f30 2024-09-19T11:14:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 -- 172.21.15.102:0/529177998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 msgr2=0x5568b7ec8480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 --2- 172.21.15.102:0/529177998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ec8480 secure :-1 s=READY pgs=607 cs=0 l=1 rev1=1 crypto rx=0x7f7198001df0 tx=0x7f719800b6c0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 -- 172.21.15.102:0/529177998 shutdown_connections 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 --2- 172.21.15.102:0/529177998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ec8480 unknown :-1 s=CLOSED pgs=607 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 -- 172.21.15.102:0/529177998 >> 172.21.15.102:0/529177998 conn(0x5568b7dd2a90 msgr2=0x5568b7ec3d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 -- 172.21.15.102:0/529177998 shutdown_connections 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 -- 172.21.15.102:0/529177998 wait complete. 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 Processor -- start 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 -- start start 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ecff90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.517+0000 7f71aa52c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5568b7ddfab0 con 0x5568b7dd8f30 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ecff90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ecff90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43614/0 (socket says 172.21.15.102:43614) 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f71a624f640 1 -- 172.21.15.102:0/4126835062 learned_addr learned my addr 172.21.15.102:0/4126835062 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f71a624f640 1 -- 172.21.15.102:0/4126835062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b7ed04f0 con 0x5568b7dd8f30 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f71a624f640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ecff90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x5568b7ec9410 tx=0x7f7198000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f7092e05640 1 -- 172.21.15.102:0/4126835062 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7198012030 con 0x5568b7dd8f30 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f7092e05640 1 -- 172.21.15.102:0/4126835062 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719801a6d0 con 0x5568b7dd8f30 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568b7ed0780 con 0x5568b7dd8f30 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f7092e05640 1 -- 172.21.15.102:0/4126835062 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f719801a9d0 con 0x5568b7dd8f30 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.518+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b7ed1180 con 0x5568b7dd8f30 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.519+0000 7f7092e05640 1 -- 172.21.15.102:0/4126835062 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7198015020 con 0x5568b7dd8f30 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f7092e05640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708c03cfb0 0x7f708c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f7092e05640 1 -- 172.21.15.102:0/4126835062 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7198020030 con 0x5568b7dd8f30 2024-09-19T11:14:51.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708c03cfb0 0x7f708c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f71aa52c800 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7ed1cd0 0x5568b7ed75e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7ed7c30 con 0x5568b7ed1cd0 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f71a6a50640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7ed1cd0 0x5568b7ed75e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708c03cfb0 0x7f708c03f470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f719c057000 tx=0x7f719c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f71a6a50640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7ed1cd0 0x5568b7ed75e0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f71a6a50640 1 -- 172.21.15.102:0/4126835062 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7ed1cd0 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.520+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7ed1640 con 0x5568b7ed1cd0 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.521+0000 7f71a6a50640 1 -- 172.21.15.102:0/4126835062 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7ed1cd0 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.521+0000 7f71aa52c800 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7ed9f60 0x5568b7edc350 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.527 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.521+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7edca20 con 0x5568b7ed9f60 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.521+0000 7f71a624f640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7ed9f60 0x5568b7edc350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.521+0000 7f71a624f640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7ed9f60 0x5568b7edc350 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.522+0000 7f71a624f640 1 -- 172.21.15.102:0/4126835062 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f719801ad50 con 0x5568b7ed9f60 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.522+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7ed8e00 con 0x5568b7ed1cd0 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.522+0000 7f71a6a50640 1 -- 172.21.15.102:0/4126835062 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7ed1cd0 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.522+0000 7f71aa52c800 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7edde60 0x5568b7ee0250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.522+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7ee0990 con 0x5568b7edde60 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.522+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7edde60 0x5568b7ee0250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.528 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.522+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7edde60 0x5568b7ee0250 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.523+0000 7f71a5a4e640 1 -- 172.21.15.102:0/4126835062 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f719c051070 con 0x5568b7edde60 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.523+0000 7f71aa52c800 1 Processor -- start 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.523+0000 7f71aa52c800 1 -- start start 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.523+0000 7f71aa52c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd86d0 0x5568b7dd6f40 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.523+0000 7f71aa52c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5568b7ccf4a0 con 0x5568b7dd86d0 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.523+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd86d0 0x5568b7dd6f40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.523+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd86d0 0x5568b7dd6f40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43624/0 (socket says 172.21.15.102:43624) 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.523+0000 7f71a624f640 1 -- 172.21.15.102:0/3534433036 learned_addr learned my addr 172.21.15.102:0/3534433036 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.529 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.524+0000 7f71a624f640 1 -- 172.21.15.102:0/3534433036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b7dd8bf0 con 0x5568b7dd86d0 2024-09-19T11:14:51.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.524+0000 7f71a624f640 1 --2- 172.21.15.102:0/3534433036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd86d0 0x5568b7dd6f40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7198052b00 tx=0x7f719803ff80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.524+0000 7f708bfff640 1 -- 172.21.15.102:0/3534433036 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f719804e040 con 0x5568b7dd86d0 2024-09-19T11:14:51.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.524+0000 7f708bfff640 1 -- 172.21.15.102:0/3534433036 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7198051380 con 0x5568b7dd86d0 2024-09-19T11:14:51.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.524+0000 7f708bfff640 1 -- 172.21.15.102:0/3534433036 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f71980516a0 con 0x5568b7dd86d0 2024-09-19T11:14:51.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.524+0000 7f71aa52c800 1 -- 172.21.15.102:0/3534433036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568b7dd7480 con 0x5568b7dd86d0 2024-09-19T11:14:51.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.524+0000 7f71aa52c800 1 -- 172.21.15.102:0/3534433036 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b7dd79d0 con 0x5568b7dd86d0 2024-09-19T11:14:51.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f708bfff640 1 -- 172.21.15.102:0/3534433036 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7198042aa0 con 0x5568b7dd86d0 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f708bfff640 1 --2- 172.21.15.102:0/3534433036 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708003cfb0 0x7f708003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f708bfff640 1 -- 172.21.15.102:0/3534433036 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f719803d050 con 0x5568b7dd86d0 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/3534433036 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708003cfb0 0x7f708003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f71aa52c800 1 Processor -- start 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f71aa52c800 1 -- start start 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/3534433036 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708003cfb0 0x7f708003f470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5568b7ed8100 tx=0x7f719c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f71aa52c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7efd580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.525+0000 7f71aa52c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5568b7ec8ea0 con 0x5568b7efd180 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.526+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7efd580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.526+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7efd580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43632/0 (socket says 172.21.15.102:43632) 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.526+0000 7f71a624f640 1 -- 172.21.15.102:0/3027774868 learned_addr learned my addr 172.21.15.102:0/3027774868 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.526+0000 7f71a624f640 1 -- 172.21.15.102:0/3027774868 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b7efdb70 con 0x5568b7efd180 2024-09-19T11:14:51.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.526+0000 7f71a624f640 1 --2- 172.21.15.102:0/3027774868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7efd580 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f719803b350 tx=0x7f719804b6e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=744ec1a26bdbe005 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.526+0000 7f7089ffb640 1 -- 172.21.15.102:0/3027774868 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7198042d90 con 0x5568b7efd180 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.526+0000 7f7089ffb640 1 -- 172.21.15.102:0/3027774868 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719802dca0 con 0x5568b7efd180 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.526+0000 7f7089ffb640 1 -- 172.21.15.102:0/3027774868 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f719800b150 con 0x5568b7efd180 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 -- 172.21.15.102:0/3027774868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 msgr2=0x5568b7efd580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 --2- 172.21.15.102:0/3027774868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7efd580 secure :-1 s=READY pgs=610 cs=0 l=1 rev1=1 crypto rx=0x7f719803b350 tx=0x7f719804b6e0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 -- 172.21.15.102:0/3027774868 shutdown_connections 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 --2- 172.21.15.102:0/3027774868 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7efd580 unknown :-1 s=CLOSED pgs=610 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 -- 172.21.15.102:0/3027774868 >> 172.21.15.102:0/3027774868 conn(0x5568b7ef9580 msgr2=0x5568b7ef77c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 -- 172.21.15.102:0/3027774868 shutdown_connections 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 -- 172.21.15.102:0/3027774868 wait complete. 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 Processor -- start 2024-09-19T11:14:51.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 -- start start 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7f045c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71aa52c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5568b7efdfe0 con 0x5568b7efd180 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7f045c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71a624f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7f045c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43648/0 (socket says 172.21.15.102:43648) 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.527+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 learned_addr learned my addr 172.21.15.102:0/2963370553 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.528+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5568b7f04b20 con 0x5568b7efd180 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.528+0000 7f71a624f640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7f045c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f719802de90 tx=0x7f7198041f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.528+0000 7f7077fff640 1 -- 172.21.15.102:0/2963370553 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f719800d5f0 con 0x5568b7efd180 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.528+0000 7f7077fff640 1 -- 172.21.15.102:0/2963370553 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f719800d7b0 con 0x5568b7efd180 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.528+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5568b7f04b20 con 0x5568b7efd180 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.528+0000 7f7077fff640 1 -- 172.21.15.102:0/2963370553 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f719802d900 con 0x5568b7efd180 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.528+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5568b7f04b20 con 0x5568b7efd180 2024-09-19T11:14:51.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.529+0000 7f7077fff640 1 -- 172.21.15.102:0/2963370553 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f719801b7f0 con 0x5568b7efd180 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.529+0000 7f7077fff640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f707003cfb0 0x7f707003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.529+0000 7f7077fff640 1 -- 172.21.15.102:0/2963370553 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7198067070 con 0x5568b7efd180 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.529+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f707003cfb0 0x7f707003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.529+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.529+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7f0fa90 0x5568b7f11f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.529+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f126a0 con 0x5568b7f0fa90 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71a6a50640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7f0fa90 0x5568b7f11f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f707003cfb0 0x7f707003f470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f719c0539f0 tx=0x7f719c053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71a6a50640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7f0fa90 0x5568b7f11f50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71aa52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71aa52c800 20 realm 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f12ab0 con 0x5568b7f0fa90 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71aa52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71aa52c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.530+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13380 con 0x5568b7f0fa90 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71aa52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71aa52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7f14210 0x5568b7f16600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f16d40 con 0x5568b7f14210 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.531+0000 7f71a624f640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7f14210 0x5568b7f16600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71a624f640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7f14210 0x5568b7f16600 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71aa52c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71aa52c800 20 searching for the correct realm 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7f18de0 0x5568b7f1b2a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1b970 con 0x5568b7f18de0 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7f18de0 0x5568b7f1b2a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7f18de0 0x5568b7f1b2a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71a5a4e640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f719c06c040 0x7f719c082940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.532+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1b970 con 0x7f719c06c040 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.533+0000 7f71a6a50640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f719c06c040 0x7f719c082940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.533+0000 7f71a6a50640 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f719c06c040 0x7f719c082940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.533+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.533+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f14210 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.534+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.534+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.534+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.534+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.534+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.534+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f14210 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.534+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.534+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f14210 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.535+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.535+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x7f719c06c040 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.535+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.535+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f18de0 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.535+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.535+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.535+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.535+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f14210 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x7f719c06c040 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f18de0 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f18de0 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.536+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f14210 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.537+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.537+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f18de0 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.537+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.537+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f18de0 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.537+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.537+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.537+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.537+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f14210 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f18de0 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x7f719c06c040 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.538+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f14210 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.539+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.539+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f18de0 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.539+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.539+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f14210 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.539+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.539+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x7f719c06c040 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.540+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.540+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f18de0 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.540+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.540+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x7f719c06c040 2024-09-19T11:14:51.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.540+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.540+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x5568b7f0fa90 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.540+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.540+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f13720 con 0x7f719c06c040 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f176e0 con 0x5568b7f0fa90 2024-09-19T11:14:51.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f176e0 con 0x5568b7f0fa90 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f17690 con 0x5568b7f18de0 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 zone default found 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 4 Realm: () 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:51.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 zonegroup default 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.541+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f17f80 con 0x5568b7f14210 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1d7e0 con 0x5568b7f18de0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1db80 con 0x5568b7f18de0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 20 started sync module instance, tier type = 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.542+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1cc80 con 0x7f719c06c040 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.543+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.543+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93908251038080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1cc80 con 0x7f719c06c040 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.543+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1e610 con 0x5568b7f0fa90 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.544+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93908251038080] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.545+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.545+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93908251042048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1e5d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.545+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1f0b0 con 0x5568b7f18de0 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.546+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93908251042048] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.546+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.546+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93908251035600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1f4d0 con 0x5568b7f18de0 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.546+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1fe90 con 0x7f719c06c040 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.547+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.547+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93908251048960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f20730 con 0x7f719c06c040 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.547+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f211b0 con 0x5568b7f0fa90 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.547+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93908251035600] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.548+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.548+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93908251053248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f211b0 con 0x5568b7f0fa90 2024-09-19T11:14:51.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.548+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f21bd0 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.548+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93908251048960] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.549+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.549+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93908251055808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f21fc0 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.549+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f22980 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.549+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93908251053248] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.550+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(56 notify.6 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.550+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93908251044800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f231d0 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.550+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f23b90 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.550+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 93908251055808] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93908251044800] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'195 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93908251061536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f23140 con 0x5568b7f14210 2024-09-19T11:14:51.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71aa52c800 20 add_watcher() i=0 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71aa52c800 20 add_watcher() i=1 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71aa52c800 20 add_watcher() i=2 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71aa52c800 20 add_watcher() i=3 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71aa52c800 20 add_watcher() i=4 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71aa52c800 20 add_watcher() i=5 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.551+0000 7f71aa52c800 20 add_watcher() i=6 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.552+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93908251061536] v37'196 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.552+0000 7f71aa52c800 20 add_watcher() i=7 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.552+0000 7f71aa52c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.552+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f26bc0 con 0x5568b7f0fa90 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.553+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.553+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93908251064032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f23fb0 con 0x5568b7f0fa90 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93908251064032] v37'200 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f705cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f71aa52c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f71aa52c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f71aa52c800 5 note: GC not initialized 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f6fd77fe640 20 reqs_thread_entry: start 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f71aa52c800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f71aa52c800 20 Filter name: none 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.554+0000 7f6fd57fa640 20 reqs_thread_entry: start 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.555+0000 7f71aa52c800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.555+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f59510 con 0x5568b7f0fa90 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.555+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.555+0000 7f71aa52c800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.555+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f5a930 con 0x5568b7f14210 2024-09-19T11:14:51.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.555+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.556+0000 7f705cfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.556+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93908251064032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f58e30 con 0x5568b7f0fa90 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.557+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93908251064032] v37'201 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.557+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93908251038080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f236e0 con 0x7f719c06c040 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.558+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93908251038080] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.558+0000 7f71aa52c800 20 remove_watcher() i=0 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.558+0000 7f71aa52c800 2 removed watcher, disabling cache 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.558+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93908251042048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f236e0 con 0x5568b7f0fa90 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.559+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93908251042048] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.559+0000 7f71aa52c800 20 remove_watcher() i=1 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.559+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93908251035600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1e100 con 0x5568b7f18de0 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.560+0000 7f71a5a4e640 1 -- 172.21.15.102:0/2963370553 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93908251035600] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f719c051070 con 0x5568b7f18de0 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.560+0000 7f71aa52c800 20 remove_watcher() i=2 2024-09-19T11:14:51.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.560+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93908251048960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f236e0 con 0x7f719c06c040 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.561+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93908251048960] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x7f719c06c040 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.561+0000 7f71aa52c800 20 remove_watcher() i=3 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.561+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93908251053248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1e100 con 0x5568b7f0fa90 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.563+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93908251053248] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f71a000a4d0 con 0x5568b7f0fa90 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.563+0000 7f71aa52c800 20 remove_watcher() i=4 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.563+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93908251055808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f1fc00 con 0x5568b7f14210 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.564+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93908251055808] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.564+0000 7f71aa52c800 20 remove_watcher() i=5 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.564+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93908251044800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f236e0 con 0x5568b7f14210 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.565+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93908251044800] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.565+0000 7f71aa52c800 20 remove_watcher() i=6 2024-09-19T11:14:51.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.565+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93908251061536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5568b7f236e0 con 0x5568b7f14210 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71a624f640 1 -- 172.21.15.102:0/2963370553 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93908251061536] v37'197 uv195 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7198071020 con 0x5568b7f14210 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 20 remove_watcher() i=7 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7f14210 msgr2=0x5568b7f16600 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7f14210 0x5568b7f16600 crc :-1 s=READY pgs=138 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7f0fa90 msgr2=0x5568b7f11f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7f0fa90 0x5568b7f11f50 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f719c06c040 msgr2=0x7f719c082940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f719c06c040 0x7f719c082940 crc :-1 s=READY pgs=75 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7f18de0 msgr2=0x5568b7f1b2a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7f18de0 0x5568b7f1b2a0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f707003cfb0 msgr2=0x7f707003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f707003cfb0 0x7f707003f470 secure :-1 s=READY pgs=253 cs=0 l=1 rev1=1 crypto rx=0x7f719c0539f0 tx=0x7f719c053000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 msgr2=0x5568b7f045c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71a6a50640 1 -- 172.21.15.102:0/2963370553 reap_dead start 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7f045c0 secure :-1 s=READY pgs=611 cs=0 l=1 rev1=1 crypto rx=0x7f719802de90 tx=0x7f7198041f90 comp rx=0 tx=0).stop 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 shutdown_connections 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/2963370553 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7efd180 0x5568b7f045c0 unknown :-1 s=CLOSED pgs=611 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 >> 172.21.15.102:0/2963370553 conn(0x5568b7ef9580 msgr2=0x5568b7ef7790 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 shutdown_connections 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/2963370553 wait complete. 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/3534433036 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708003cfb0 msgr2=0x7f708003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/3534433036 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708003cfb0 0x7f708003f470 secure :-1 s=READY pgs=252 cs=0 l=1 rev1=1 crypto rx=0x5568b7ed8100 tx=0x7f719c005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:51.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/3534433036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd86d0 msgr2=0x5568b7dd6f40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/3534433036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd86d0 0x5568b7dd6f40 secure :-1 s=READY pgs=609 cs=0 l=1 rev1=1 crypto rx=0x7f7198052b00 tx=0x7f719803ff80 comp rx=0 tx=0).stop 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/3534433036 shutdown_connections 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/3534433036 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708003cfb0 0x7f708003f470 unknown :-1 s=CLOSED pgs=252 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 --2- 172.21.15.102:0/3534433036 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd86d0 0x5568b7dd6f40 unknown :-1 s=CLOSED pgs=609 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.566+0000 7f71aa52c800 1 -- 172.21.15.102:0/3534433036 >> 172.21.15.102:0/3534433036 conn(0x5568b7ee2ac0 msgr2=0x5568b7ee2ea0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/3534433036 shutdown_connections 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/3534433036 wait complete. 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7ed9f60 msgr2=0x5568b7edc350 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5568b7ed9f60 0x5568b7edc350 crc :-1 s=READY pgs=137 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7ed1cd0 msgr2=0x5568b7ed75e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5568b7ed1cd0 0x5568b7ed75e0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7edde60 msgr2=0x5568b7ee0250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5568b7edde60 0x5568b7ee0250 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708c03cfb0 msgr2=0x7f708c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f708c03cfb0 0x7f708c03f470 secure :-1 s=READY pgs=251 cs=0 l=1 rev1=1 crypto rx=0x7f719c057000 tx=0x7f719c052000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 msgr2=0x5568b7ecff90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 --2- 172.21.15.102:0/4126835062 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5568b7dd8f30 0x5568b7ecff90 secure :-1 s=READY pgs=608 cs=0 l=1 rev1=1 crypto rx=0x5568b7ec9410 tx=0x7f7198000bc0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71a6a50640 1 -- 172.21.15.102:0/4126835062 reap_dead start 2024-09-19T11:14:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 shutdown_connections 2024-09-19T11:14:51.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 >> 172.21.15.102:0/4126835062 conn(0x5568b7dd2a90 msgr2=0x5568b7ec9970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 shutdown_connections 2024-09-19T11:14:51.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.567+0000 7f71aa52c800 1 -- 172.21.15.102:0/4126835062 wait complete. 2024-09-19T11:14:51.582 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo2","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo3","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}},{"bucket":"myfoo4","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{"bytes_processed":0,"bytes_returned":0}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8},{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4},{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4},{"category":"get_acls","bytes_sent":1026,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"get_obj","bytes_sent":4,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_bucket","bytes_sent":515,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"list_buckets","bytes_sent":322,"bytes_received":0,"ops":1,"successful_ops":1},{"category":"put_acls","bytes_sent":0,"bytes_received":0,"ops":2,"successful_ops":2},{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":2103,"bytes_received":30000042,"ops":35,"successful_ops":34,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-19T11:14:51.582 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo2', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo3', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo4', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}, {'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}, {'category': 'get_acls', 'bytes_sent': 1026, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'get_obj', 'bytes_sent': 4, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_bucket', 'bytes_sent': 515, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'list_buckets', 'bytes_sent': 322, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_acls', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 2103, 'bytes_received': 30000042, 'ops': 35, 'successful_ops': 34, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:14:51.582 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-19T11:14:51.583 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'create_bucket'] 2024-09-19T11:14:51.583 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories create_bucket 2024-09-19T11:14:51.629 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:51.629 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:51.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.628+0000 7ff35c139800 1 Processor -- start 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.628+0000 7ff35c139800 1 -- start start 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff35c139800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ae8d4aff30 0x55ae8d4b2320 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff35c139800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ae8d4b65e0 con 0x55ae8d4b28c0 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff35c139800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55ae8d33a7d0 con 0x55ae8d4aff30 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff357dc7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ae8d4aff30 0x55ae8d4b2320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff357dc7640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ae8d4aff30 0x55ae8d4b2320 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43650/0 (socket says 172.21.15.102:43650) 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff3575c6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55ae8d4b28c0 0x55ae8d4b4d80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47870/0 (socket says 172.21.15.102:47870) 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff357dc7640 1 -- 172.21.15.102:0/4249031646 learned_addr learned my addr 172.21.15.102:0/4249031646 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff357dc7640 1 -- 172.21.15.102:0/4249031646 >> v1:172.21.15.37:6789/0 conn(0x55ae8d4b28c0 legacy=0x55ae8d4b4d80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.629+0000 7ff357dc7640 1 -- 172.21.15.102:0/4249031646 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8d4b7810 con 0x55ae8d4aff30 2024-09-19T11:14:51.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.631+0000 7ff357dc7640 1 --2- 172.21.15.102:0/4249031646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d4b2320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff34800a520 tx=0x7ff348045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=922f37c4eb324f70 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.631+0000 7ff356dc5640 1 -- 172.21.15.102:0/4249031646 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff348055070 con 0x55ae8d4aff30 2024-09-19T11:14:51.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.631+0000 7ff356dc5640 1 -- 172.21.15.102:0/4249031646 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3480515b0 con 0x55ae8d4aff30 2024-09-19T11:14:51.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.631+0000 7ff356dc5640 1 -- 172.21.15.102:0/4249031646 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3480518d0 con 0x55ae8d4aff30 2024-09-19T11:14:51.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.632+0000 7ff35c139800 1 -- 172.21.15.102:0/4249031646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 msgr2=0x55ae8d4b2320 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.632+0000 7ff35c139800 1 --2- 172.21.15.102:0/4249031646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d4b2320 secure :-1 s=READY pgs=613 cs=0 l=1 rev1=1 crypto rx=0x7ff34800a520 tx=0x7ff348045ba0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.632+0000 7ff35c139800 1 -- 172.21.15.102:0/4249031646 shutdown_connections 2024-09-19T11:14:51.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.632+0000 7ff35c139800 1 --2- 172.21.15.102:0/4249031646 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d4b2320 unknown :-1 s=CLOSED pgs=613 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.632+0000 7ff35c139800 1 -- 172.21.15.102:0/4249031646 >> 172.21.15.102:0/4249031646 conn(0x55ae8d4a9a70 msgr2=0x55ae8d4abed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.632+0000 7ff35c139800 1 -- 172.21.15.102:0/4249031646 shutdown_connections 2024-09-19T11:14:51.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.632+0000 7ff35c139800 1 -- 172.21.15.102:0/4249031646 wait complete. 2024-09-19T11:14:51.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.645+0000 7ff35c139800 1 Processor -- start 2024-09-19T11:14:51.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.645+0000 7ff35c139800 1 -- start start 2024-09-19T11:14:51.647 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.645+0000 7ff35c139800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d59f390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.645+0000 7ff35c139800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ae8d347dd0 con 0x55ae8d4aff30 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.646+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d59f390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.646+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d59f390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43664/0 (socket says 172.21.15.102:43664) 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.646+0000 7ff357dc7640 1 -- 172.21.15.102:0/1868957338 learned_addr learned my addr 172.21.15.102:0/1868957338 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.646+0000 7ff357dc7640 1 -- 172.21.15.102:0/1868957338 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8d59f980 con 0x55ae8d4aff30 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.646+0000 7ff357dc7640 1 --2- 172.21.15.102:0/1868957338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d59f390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff348025da0 tx=0x7ff348051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=586732cadcd3f0f5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.646+0000 7ff245e0b640 1 -- 172.21.15.102:0/1868957338 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff348051890 con 0x55ae8d4aff30 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.646+0000 7ff245e0b640 1 -- 172.21.15.102:0/1868957338 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff348051ac0 con 0x55ae8d4aff30 2024-09-19T11:14:51.648 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.646+0000 7ff245e0b640 1 -- 172.21.15.102:0/1868957338 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff348051da0 con 0x55ae8d4aff30 2024-09-19T11:14:51.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 -- 172.21.15.102:0/1868957338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 msgr2=0x55ae8d59f390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 --2- 172.21.15.102:0/1868957338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d59f390 secure :-1 s=READY pgs=614 cs=0 l=1 rev1=1 crypto rx=0x7ff348025da0 tx=0x7ff348051000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 -- 172.21.15.102:0/1868957338 shutdown_connections 2024-09-19T11:14:51.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 --2- 172.21.15.102:0/1868957338 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d59f390 unknown :-1 s=CLOSED pgs=614 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 -- 172.21.15.102:0/1868957338 >> 172.21.15.102:0/1868957338 conn(0x55ae8d4a9a70 msgr2=0x55ae8d59ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 -- 172.21.15.102:0/1868957338 shutdown_connections 2024-09-19T11:14:51.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 -- 172.21.15.102:0/1868957338 wait complete. 2024-09-19T11:14:51.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 Processor -- start 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.647+0000 7ff35c139800 1 -- start start 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.648+0000 7ff35c139800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d4af650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.648+0000 7ff35c139800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ae8d4b6ab0 con 0x55ae8d4aff30 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.648+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d4af650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.648+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d4af650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43682/0 (socket says 172.21.15.102:43682) 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.648+0000 7ff357dc7640 1 -- 172.21.15.102:0/2178900657 learned_addr learned my addr 172.21.15.102:0/2178900657 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.648+0000 7ff357dc7640 1 -- 172.21.15.102:0/2178900657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8d4afbb0 con 0x55ae8d4aff30 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.648+0000 7ff357dc7640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d4af650 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff348000c00 tx=0x7ff348002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.649+0000 7ff23ffff640 1 -- 172.21.15.102:0/2178900657 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff348073070 con 0x55ae8d4aff30 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.649+0000 7ff23ffff640 1 -- 172.21.15.102:0/2178900657 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff34805a450 con 0x55ae8d4aff30 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.649+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae8d4adf60 con 0x55ae8d4aff30 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.649+0000 7ff23ffff640 1 -- 172.21.15.102:0/2178900657 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff34805a730 con 0x55ae8d4aff30 2024-09-19T11:14:51.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.649+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae8d4ae580 con 0x55ae8d4aff30 2024-09-19T11:14:51.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.649+0000 7ff23ffff640 1 -- 172.21.15.102:0/2178900657 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff348076070 con 0x55ae8d4aff30 2024-09-19T11:14:51.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff23ffff640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff24003cfb0 0x7ff24003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff23ffff640 1 -- 172.21.15.102:0/2178900657 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff348062070 con 0x55ae8d4aff30 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff3575c6640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff24003cfb0 0x7ff24003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff35c139800 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d4b28c0 0x55ae8d5b02e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5b0820 con 0x55ae8d4b28c0 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff3585c8640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d4b28c0 0x55ae8d5b02e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff3575c6640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff24003cfb0 0x7ff24003f470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff34c001e30 tx=0x7ff34c001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff3585c8640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d4b28c0 0x55ae8d5b02e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.650+0000 7ff3585c8640 1 -- 172.21.15.102:0/2178900657 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d4b28c0 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.651+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5b0c70 con 0x55ae8d4b28c0 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.651+0000 7ff3585c8640 1 -- 172.21.15.102:0/2178900657 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d4b28c0 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.651+0000 7ff35c139800 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5b2a80 0x55ae8d5b4e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.651+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5b5540 con 0x55ae8d5b2a80 2024-09-19T11:14:51.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.651+0000 7ff357dc7640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5b2a80 0x55ae8d5b4e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.651+0000 7ff357dc7640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5b2a80 0x55ae8d5b4e70 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.652+0000 7ff357dc7640 1 -- 172.21.15.102:0/2178900657 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5b2a80 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.652+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5b1920 con 0x55ae8d4b28c0 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.652+0000 7ff3585c8640 1 -- 172.21.15.102:0/2178900657 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d4b28c0 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.652+0000 7ff35c139800 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5b6980 0x55ae8d5b8d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.652+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5b94b0 con 0x55ae8d5b6980 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.652+0000 7ff3575c6640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5b6980 0x55ae8d5b8d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.652+0000 7ff3575c6640 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5b6980 0x55ae8d5b8d70 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.653+0000 7ff3575c6640 1 -- 172.21.15.102:0/2178900657 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff34c00bd50 con 0x55ae8d5b6980 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.653+0000 7ff35c139800 1 Processor -- start 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.653+0000 7ff35c139800 1 -- start start 2024-09-19T11:14:51.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.653+0000 7ff35c139800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5c71f0 0x55ae8d5c7610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.653+0000 7ff35c139800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ae8d3a64a0 con 0x55ae8d5c71f0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.653+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5c71f0 0x55ae8d5c7610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.653+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5c71f0 0x55ae8d5c7610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43686/0 (socket says 172.21.15.102:43686) 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.653+0000 7ff357dc7640 1 -- 172.21.15.102:0/3643503690 learned_addr learned my addr 172.21.15.102:0/3643503690 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.654+0000 7ff357dc7640 1 -- 172.21.15.102:0/3643503690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8d5c7c50 con 0x55ae8d5c71f0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.654+0000 7ff357dc7640 1 --2- 172.21.15.102:0/3643503690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5c71f0 0x55ae8d5c7610 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff348096d60 tx=0x7ff348065eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.654+0000 7ff23d7fa640 1 -- 172.21.15.102:0/3643503690 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3480840b0 con 0x55ae8d5c71f0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.654+0000 7ff23d7fa640 1 -- 172.21.15.102:0/3643503690 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff348084250 con 0x55ae8d5c71f0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.654+0000 7ff35c139800 1 -- 172.21.15.102:0/3643503690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae8d5c8480 con 0x55ae8d5c71f0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.654+0000 7ff23d7fa640 1 -- 172.21.15.102:0/3643503690 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff348076d10 con 0x55ae8d5c71f0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.654+0000 7ff35c139800 1 -- 172.21.15.102:0/3643503690 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae8d5c8a20 con 0x55ae8d5c71f0 2024-09-19T11:14:51.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.655+0000 7ff23d7fa640 1 -- 172.21.15.102:0/3643503690 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff348058070 con 0x55ae8d5c71f0 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.655+0000 7ff23d7fa640 1 --2- 172.21.15.102:0/3643503690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff23003d000 0x7ff23003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.655+0000 7ff23d7fa640 1 -- 172.21.15.102:0/3643503690 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff34808b070 con 0x55ae8d5c71f0 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.655+0000 7ff3575c6640 1 --2- 172.21.15.102:0/3643503690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff23003d000 0x7ff23003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.655+0000 7ff35c139800 1 Processor -- start 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.655+0000 7ff35c139800 1 -- start start 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.655+0000 7ff3575c6640 1 --2- 172.21.15.102:0/3643503690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff23003d000 0x7ff23003f4c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55ae8d4aead0 tx=0x7ff34c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff35c139800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5d3ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff35c139800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ae8d59fcf0 con 0x55ae8d5d3af0 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5d3ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5d3ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43688/0 (socket says 172.21.15.102:43688) 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff357dc7640 1 -- 172.21.15.102:0/621876743 learned_addr learned my addr 172.21.15.102:0/621876743 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff357dc7640 1 -- 172.21.15.102:0/621876743 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8d5d44e0 con 0x55ae8d5d3af0 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff357dc7640 1 --2- 172.21.15.102:0/621876743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5d3ef0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff34809c000 tx=0x7ff3480826f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3485e1e5b14cb7a9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff236ffd640 1 -- 172.21.15.102:0/621876743 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff348082810 con 0x55ae8d5d3af0 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff236ffd640 1 -- 172.21.15.102:0/621876743 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff3480987c0 con 0x55ae8d5d3af0 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.656+0000 7ff236ffd640 1 -- 172.21.15.102:0/621876743 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3480980b0 con 0x55ae8d5d3af0 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 -- 172.21.15.102:0/621876743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 msgr2=0x55ae8d5d3ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 --2- 172.21.15.102:0/621876743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5d3ef0 secure :-1 s=READY pgs=617 cs=0 l=1 rev1=1 crypto rx=0x7ff34809c000 tx=0x7ff3480826f0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 -- 172.21.15.102:0/621876743 shutdown_connections 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 --2- 172.21.15.102:0/621876743 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5d3ef0 unknown :-1 s=CLOSED pgs=617 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 -- 172.21.15.102:0/621876743 >> 172.21.15.102:0/621876743 conn(0x55ae8d5cfef0 msgr2=0x55ae8d5ce130 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 -- 172.21.15.102:0/621876743 shutdown_connections 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 -- 172.21.15.102:0/621876743 wait complete. 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 Processor -- start 2024-09-19T11:14:51.671 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 -- start start 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5daf00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff35c139800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ae8d5d4950 con 0x55ae8d5d3af0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5daf00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff357dc7640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5daf00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43702/0 (socket says 172.21.15.102:43702) 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.657+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 learned_addr learned my addr 172.21.15.102:0/4160199147 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.658+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ae8d5db460 con 0x55ae8d5d3af0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.658+0000 7ff357dc7640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5daf00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff348007d10 tx=0x7ff34809deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.658+0000 7ff2357fa640 1 -- 172.21.15.102:0/4160199147 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3480ba020 con 0x55ae8d5d3af0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.658+0000 7ff2357fa640 1 -- 172.21.15.102:0/4160199147 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff348082810 con 0x55ae8d5d3af0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.658+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ae8d5db460 con 0x55ae8d5d3af0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.658+0000 7ff2357fa640 1 -- 172.21.15.102:0/4160199147 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff3480980b0 con 0x55ae8d5d3af0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.658+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ae8d5db460 con 0x55ae8d5d3af0 2024-09-19T11:14:51.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.659+0000 7ff2357fa640 1 -- 172.21.15.102:0/4160199147 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff3480bd020 con 0x55ae8d5d3af0 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.659+0000 7ff2357fa640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff22003cfb0 0x7ff22003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.659+0000 7ff2357fa640 1 -- 172.21.15.102:0/4160199147 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff3480c0d20 con 0x55ae8d5d3af0 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.659+0000 7ff3575c6640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff22003cfb0 0x7ff22003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.659+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.659+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d5e6500 0x55ae8d5e89c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.659+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5e9110 con 0x55ae8d5e6500 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.659+0000 7ff3585c8640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d5e6500 0x55ae8d5e89c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff3575c6640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff22003cfb0 0x7ff22003f470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ae8d5b9890 tx=0x7ff34c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff3585c8640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d5e6500 0x55ae8d5e89c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 20 realm 2024-09-19T11:14:51.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5e9520 con 0x55ae8d5e6500 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5e9df0 con 0x55ae8d5e6500 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.660+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff35c139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5eac80 0x55ae8d5ed070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ed7b0 con 0x55ae8d5eac80 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff357dc7640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5eac80 0x55ae8d5ed070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff357dc7640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5eac80 0x55ae8d5ed070 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.661+0000 7ff35c139800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff35c139800 20 searching for the correct realm 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5ef850 0x55ae8d5f1d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f23e0 con 0x55ae8d5ef850 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff3575c6640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5ef850 0x55ae8d5f1d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff3575c6640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5ef850 0x55ae8d5f1d10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c037040 con 0x55ae8d5ef850 2024-09-19T11:14:51.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff3575c6640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff34c00f070 0x7ff34c02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f23e0 con 0x7ff34c00f070 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.662+0000 7ff3585c8640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff34c00f070 0x7ff34c02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.663+0000 7ff3585c8640 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff34c00f070 0x7ff34c02e910 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.663+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.663+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5eac80 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.663+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.663+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.663+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.663+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.664+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.664+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5eac80 2024-09-19T11:14:51.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.664+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.664+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5eac80 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.664+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.664+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x7ff34c00f070 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.664+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.664+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5ef850 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.665+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c037040 con 0x55ae8d5ef850 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.665+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.665+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.665+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5eac80 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.665+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.665+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.665+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.677 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.665+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x7ff34c00f070 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.666+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.666+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5ef850 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.666+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c037040 con 0x55ae8d5ef850 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.666+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5ef850 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.666+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff34c037040 con 0x55ae8d5ef850 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.666+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5eac80 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5ef850 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c037040 con 0x55ae8d5ef850 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5ef850 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c037040 con 0x55ae8d5ef850 2024-09-19T11:14:51.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.667+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5eac80 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.668+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.668+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5ef850 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.668+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c037040 con 0x55ae8d5ef850 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.668+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x7ff34c00f070 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.668+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.668+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.668+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.669+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5eac80 2024-09-19T11:14:51.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.669+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.669+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5ef850 2024-09-19T11:14:51.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.669+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c037040 con 0x55ae8d5ef850 2024-09-19T11:14:51.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.669+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5eac80 2024-09-19T11:14:51.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.669+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.689 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.669+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x7ff34c00f070 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.670+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.670+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5ef850 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.670+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff34c049040 con 0x55ae8d5ef850 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.670+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x7ff34c00f070 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.670+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.670+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x55ae8d5e6500 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.670+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.670+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ea190 con 0x7ff34c00f070 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:51.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ee150 con 0x55ae8d5e6500 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ee150 con 0x55ae8d5e6500 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ee120 con 0x55ae8d5ef850 2024-09-19T11:14:51.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff34c049040 con 0x55ae8d5ef850 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 zone default found 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 4 Realm: () 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 zonegroup default 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.671+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5ee9f0 con 0x55ae8d5eac80 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f4250 con 0x55ae8d5ef850 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff34c049040 con 0x55ae8d5ef850 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f4620 con 0x55ae8d5ef850 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff34c049040 con 0x55ae8d5ef850 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 20 started sync module instance, tier type = 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.672+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f36f0 con 0x7ff34c00f070 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.673+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.673+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94208184499216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f36f0 con 0x7ff34c00f070 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.673+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f50e0 con 0x55ae8d5e6500 2024-09-19T11:14:51.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.674+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94208184499216] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.675+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.675+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94208184503248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f36f0 con 0x55ae8d5e6500 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.675+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f5b30 con 0x55ae8d5ef850 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.676+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94208184503248] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.676+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c049040 con 0x55ae8d5ef850 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.676+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94208184496704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f3660 con 0x55ae8d5ef850 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.676+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f69f0 con 0x7ff34c00f070 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.677+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.677+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94208184496704] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c049040 con 0x55ae8d5ef850 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.677+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94208184510272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f71b0 con 0x7ff34c00f070 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.677+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f5f60 con 0x55ae8d5e6500 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.678+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94208184510272] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x7ff34c00f070 2024-09-19T11:14:51.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.678+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.678+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94208184511488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f5f60 con 0x55ae8d5e6500 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.678+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f8270 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.679+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.679+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94208184516032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f8ac0 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.679+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f9500 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.680+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94208184511488] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.680+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94208184516032] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.681+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.681+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94208184520656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f98a0 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.681+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5fa130 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94208184520656] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'198 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94208184522912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5fa170 con 0x55ae8d5eac80 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 20 add_watcher() i=0 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 20 add_watcher() i=1 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 20 add_watcher() i=2 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 20 add_watcher() i=3 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 20 add_watcher() i=4 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 20 add_watcher() i=5 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 20 add_watcher() i=6 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94208184522912] v37'199 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 20 add_watcher() i=7 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.682+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5fd4f0 con 0x55ae8d5e6500 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.683+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.683+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94208184536784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5fa2e0 con 0x55ae8d5e6500 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.684+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94208184536784] v37'202 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.684+0000 7ff20e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.684+0000 7ff35c139800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.684+0000 7ff35c139800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.684+0000 7ff35c139800 5 note: GC not initialized 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.684+0000 7ff20d7e2640 20 reqs_thread_entry: start 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.684+0000 7ff35c139800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.684+0000 7ff35c139800 20 Filter name: none 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.685+0000 7ff2067fc640 20 reqs_thread_entry: start 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.685+0000 7ff35c139800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.685+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d62ffc0 con 0x55ae8d5e6500 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.685+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7ff35000a4d0 con 0x55ae8d5e6500 2024-09-19T11:14:51.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.685+0000 7ff35c139800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.685+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d6313e0 con 0x55ae8d5eac80 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.686+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.686+0000 7ff20e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.686+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94208184536784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d62f8e0 con 0x55ae8d5e6500 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.687+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94208184536784] v37'203 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff350040040 con 0x55ae8d5e6500 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.687+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94208184499216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d62f8e0 con 0x7ff34c00f070 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.688+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94208184499216] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff350040040 con 0x7ff34c00f070 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.688+0000 7ff35c139800 20 remove_watcher() i=0 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.688+0000 7ff35c139800 2 removed watcher, disabling cache 2024-09-19T11:14:51.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.688+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94208184503248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f3c10 con 0x55ae8d5e6500 2024-09-19T11:14:51.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.690+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94208184503248] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff350040040 con 0x55ae8d5e6500 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.690+0000 7ff35c139800 20 remove_watcher() i=1 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.690+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94208184496704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f3c10 con 0x55ae8d5ef850 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.691+0000 7ff3575c6640 1 -- 172.21.15.102:0/4160199147 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94208184496704] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34c049040 con 0x55ae8d5ef850 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.691+0000 7ff35c139800 20 remove_watcher() i=2 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.691+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94208184510272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f3240 con 0x7ff34c00f070 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.692+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94208184510272] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff350040040 con 0x7ff34c00f070 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.692+0000 7ff35c139800 20 remove_watcher() i=3 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.692+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94208184511488] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f3240 con 0x55ae8d5e6500 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.693+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94208184511488] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff350040040 con 0x55ae8d5e6500 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.693+0000 7ff35c139800 20 remove_watcher() i=4 2024-09-19T11:14:51.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.693+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94208184516032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f3240 con 0x55ae8d5eac80 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.694+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94208184516032] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.694+0000 7ff35c139800 20 remove_watcher() i=5 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.694+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94208184520656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f3240 con 0x55ae8d5eac80 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.695+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94208184520656] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.695+0000 7ff35c139800 20 remove_watcher() i=6 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.695+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94208184522912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ae8d5f8fd0 con 0x55ae8d5eac80 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff357dc7640 1 -- 172.21.15.102:0/4160199147 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94208184522912] v37'200 uv198 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff34807f070 con 0x55ae8d5eac80 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 20 remove_watcher() i=7 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5eac80 msgr2=0x55ae8d5ed070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5eac80 0x55ae8d5ed070 crc :-1 s=READY pgs=140 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d5e6500 msgr2=0x55ae8d5e89c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d5e6500 0x55ae8d5e89c0 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff34c00f070 msgr2=0x7ff34c02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff34c00f070 0x7ff34c02e910 crc :-1 s=READY pgs=76 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5ef850 msgr2=0x55ae8d5f1d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5ef850 0x55ae8d5f1d10 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.696+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff22003cfb0 msgr2=0x7ff22003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff22003cfb0 0x7ff22003f470 secure :-1 s=READY pgs=256 cs=0 l=1 rev1=1 crypto rx=0x55ae8d5b9890 tx=0x7ff34c010000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 msgr2=0x55ae8d5daf00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff3585c8640 1 -- 172.21.15.102:0/4160199147 reap_dead start 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5daf00 secure :-1 s=READY pgs=618 cs=0 l=1 rev1=1 crypto rx=0x7ff348007d10 tx=0x7ff34809deb0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 shutdown_connections 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/4160199147 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5d3af0 0x55ae8d5daf00 unknown :-1 s=CLOSED pgs=618 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 >> 172.21.15.102:0/4160199147 conn(0x55ae8d5cfef0 msgr2=0x55ae8d5ce100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 shutdown_connections 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/4160199147 wait complete. 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/3643503690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff23003d000 msgr2=0x7ff23003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/3643503690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff23003d000 0x7ff23003f4c0 secure :-1 s=READY pgs=255 cs=0 l=1 rev1=1 crypto rx=0x55ae8d4aead0 tx=0x7ff34c00f000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/3643503690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5c71f0 msgr2=0x55ae8d5c7610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/3643503690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5c71f0 0x55ae8d5c7610 secure :-1 s=READY pgs=616 cs=0 l=1 rev1=1 crypto rx=0x7ff348096d60 tx=0x7ff348065eb0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/3643503690 shutdown_connections 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/3643503690 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff23003d000 0x7ff23003f4c0 unknown :-1 s=CLOSED pgs=255 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/3643503690 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d5c71f0 0x55ae8d5c7610 unknown :-1 s=CLOSED pgs=616 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/3643503690 >> 172.21.15.102:0/3643503690 conn(0x55ae8d5bb5a0 msgr2=0x55ae8d5bb980 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/3643503690 shutdown_connections 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/3643503690 wait complete. 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5b2a80 msgr2=0x55ae8d5b4e70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.706 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ae8d5b2a80 0x55ae8d5b4e70 crc :-1 s=READY pgs=139 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d4b28c0 msgr2=0x55ae8d5b02e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ae8d4b28c0 0x55ae8d5b02e0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5b6980 msgr2=0x55ae8d5b8d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.697+0000 7ff35c139800 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ae8d5b6980 0x55ae8d5b8d70 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff24003cfb0 msgr2=0x7ff24003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff35c139800 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff24003cfb0 0x7ff24003f470 secure :-1 s=READY pgs=254 cs=0 l=1 rev1=1 crypto rx=0x7ff34c001e30 tx=0x7ff34c001390 comp rx=0 tx=0).stop 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 msgr2=0x55ae8d4af650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff35c139800 1 --2- 172.21.15.102:0/2178900657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ae8d4aff30 0x55ae8d4af650 secure :-1 s=READY pgs=615 cs=0 l=1 rev1=1 crypto rx=0x7ff348000c00 tx=0x7ff348002fb0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff3585c8640 1 -- 172.21.15.102:0/2178900657 reap_dead start 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 shutdown_connections 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 >> 172.21.15.102:0/2178900657 conn(0x55ae8d4a9a70 msgr2=0x55ae8d599500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 shutdown_connections 2024-09-19T11:14:51.707 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.698+0000 7ff35c139800 1 -- 172.21.15.102:0/2178900657 wait complete. 2024-09-19T11:14:51.708 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":5,"successful_ops":5}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"create_bucket","bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8}],"total":{"bytes_sent":0,"bytes_received":0,"ops":8,"successful_ops":8,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-19T11:14:51.709 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 5, 'successful_ops': 5}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 8, 'successful_ops': 8, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:14:51.709 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-19T11:14:51.709 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'put_obj'] 2024-09-19T11:14:51.709 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories put_obj 2024-09-19T11:14:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:51.755 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8abb932800 1 Processor -- start 2024-09-19T11:14:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8abb932800 1 -- start start 2024-09-19T11:14:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8abb932800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x556adde43ab0 0x556adde45f70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8abb932800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x556adde465f0 con 0x556adde3feb0 2024-09-19T11:14:51.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8abb932800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x556addcca7d0 con 0x556adde43ab0 2024-09-19T11:14:51.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8ab6dbb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x556adde43ab0 0x556adde45f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8ab75bc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x556adde3feb0 0x556adde422a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47872/0 (socket says 172.21.15.102:47872) 2024-09-19T11:14:51.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8ab75bc640 1 -- 172.21.15.102:0/191356761 learned_addr learned my addr 172.21.15.102:0/191356761 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:51.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.755+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/191356761 >> v2:172.21.15.37:3300/0 conn(0x556adde43ab0 0x556adde45f70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43712/0 (socket says 172.21.15.102:43712) 2024-09-19T11:14:51.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.756+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/191356761 >> v1:172.21.15.37:6789/0 conn(0x556adde3feb0 legacy=0x556adde422a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.756+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/191356761 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x556adde47820 con 0x556adde43ab0 2024-09-19T11:14:51.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.757+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/191356761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde43ab0 0x556adde45f70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00a470 tx=0x7f8aac045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=90b45c3f9f5988d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8ab65ba640 1 -- 172.21.15.102:0/191356761 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aac053570 con 0x556adde43ab0 2024-09-19T11:14:51.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8ab65ba640 1 -- 172.21.15.102:0/191356761 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aac058070 con 0x556adde43ab0 2024-09-19T11:14:51.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8ab65ba640 1 -- 172.21.15.102:0/191356761 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aac053880 con 0x556adde43ab0 2024-09-19T11:14:51.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8abb932800 1 -- 172.21.15.102:0/191356761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde43ab0 msgr2=0x556adde45f70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8abb932800 1 --2- 172.21.15.102:0/191356761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde43ab0 0x556adde45f70 secure :-1 s=READY pgs=620 cs=0 l=1 rev1=1 crypto rx=0x7f8aac00a470 tx=0x7f8aac045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8abb932800 1 -- 172.21.15.102:0/191356761 shutdown_connections 2024-09-19T11:14:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8abb932800 1 --2- 172.21.15.102:0/191356761 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde43ab0 0x556adde45f70 unknown :-1 s=CLOSED pgs=620 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8abb932800 1 -- 172.21.15.102:0/191356761 >> 172.21.15.102:0/191356761 conn(0x556adde39a70 msgr2=0x556adde3bed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8abb932800 1 -- 172.21.15.102:0/191356761 shutdown_connections 2024-09-19T11:14:51.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.758+0000 7f8abb932800 1 -- 172.21.15.102:0/191356761 wait complete. 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.772+0000 7f8abb932800 1 Processor -- start 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.772+0000 7f8abb932800 1 -- start start 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.772+0000 7f8abb932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556adde3f620 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.772+0000 7f8abb932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556addcd7dd0 con 0x556adde3feb0 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.772+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556adde3f620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.772+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556adde3f620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43724/0 (socket says 172.21.15.102:43724) 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.772+0000 7f8ab75bc640 1 -- 172.21.15.102:0/2975002486 learned_addr learned my addr 172.21.15.102:0/2975002486 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.772+0000 7f8ab75bc640 1 -- 172.21.15.102:0/2975002486 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556adde3fc10 con 0x556adde3feb0 2024-09-19T11:14:51.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/2975002486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556adde3f620 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8001e40 tx=0x7f8aa8001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dc88ff27da2eac44 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f89a560a640 1 -- 172.21.15.102:0/2975002486 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8012020 con 0x556adde3feb0 2024-09-19T11:14:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f89a560a640 1 -- 172.21.15.102:0/2975002486 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa800e5a0 con 0x556adde3feb0 2024-09-19T11:14:51.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f89a560a640 1 -- 172.21.15.102:0/2975002486 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa800e8a0 con 0x556adde3feb0 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f8abb932800 1 -- 172.21.15.102:0/2975002486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 msgr2=0x556adde3f620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f8abb932800 1 --2- 172.21.15.102:0/2975002486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556adde3f620 secure :-1 s=READY pgs=621 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8001e40 tx=0x7f8aa8001e70 comp rx=0 tx=0).stop 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f8abb932800 1 -- 172.21.15.102:0/2975002486 shutdown_connections 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f8abb932800 1 --2- 172.21.15.102:0/2975002486 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556adde3f620 unknown :-1 s=CLOSED pgs=621 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f8abb932800 1 -- 172.21.15.102:0/2975002486 >> 172.21.15.102:0/2975002486 conn(0x556adde39a70 msgr2=0x556addf2ad10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f8abb932800 1 -- 172.21.15.102:0/2975002486 shutdown_connections 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.773+0000 7f8abb932800 1 -- 172.21.15.102:0/2975002486 wait complete. 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.774+0000 7f8abb932800 1 Processor -- start 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.774+0000 7f8abb932800 1 -- start start 2024-09-19T11:14:51.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.774+0000 7f8abb932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556addf39040 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.774+0000 7f8abb932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556adde46ac0 con 0x556adde3feb0 2024-09-19T11:14:51.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.774+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556addf39040 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.774+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556addf39040 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43730/0 (socket says 172.21.15.102:43730) 2024-09-19T11:14:51.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.774+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1499456546 learned_addr learned my addr 172.21.15.102:0/1499456546 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.774+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1499456546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556addf395a0 con 0x556adde3feb0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.775+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556addf39040 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80012b0 tx=0x7f8aa8000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.775+0000 7f89a3e07640 1 -- 172.21.15.102:0/1499456546 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8012030 con 0x556adde3feb0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.775+0000 7f89a3e07640 1 -- 172.21.15.102:0/1499456546 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa801a750 con 0x556adde3feb0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.775+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556addf39890 con 0x556adde3feb0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.775+0000 7f89a3e07640 1 -- 172.21.15.102:0/1499456546 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa801aa70 con 0x556adde3feb0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.775+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556addf3a440 con 0x556adde3feb0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.776+0000 7f89a3e07640 1 -- 172.21.15.102:0/1499456546 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8aa8015020 con 0x556adde3feb0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.776+0000 7f89a3e07640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899c03cfb0 0x7f899c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.776+0000 7f89a3e07640 1 -- 172.21.15.102:0/1499456546 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8aa8020030 con 0x556adde3feb0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.776+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899c03cfb0 0x7f899c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.776+0000 7f8abb932800 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556adde43ab0 0x556addf40690 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.776+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf40bd0 con 0x556adde43ab0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.776+0000 7f8ab7dbd640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556adde43ab0 0x556addf40690 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.776+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899c03cfb0 0x7f899c03f470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8aac057000 tx=0x7f8aac052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.777+0000 7f8ab7dbd640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556adde43ab0 0x556addf40690 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.777+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1499456546 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556adde43ab0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.777+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf40f70 con 0x556adde43ab0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.777+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1499456546 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556adde43ab0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.777+0000 7f8abb932800 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf42ce0 0x556addf450d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.777+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf45720 con 0x556addf42ce0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.777+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf42ce0 0x556addf450d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.778+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf42ce0 0x556addf450d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.778+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1499456546 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f8aa8018ce0 con 0x556addf42ce0 2024-09-19T11:14:51.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.778+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf41b80 con 0x556adde43ab0 2024-09-19T11:14:51.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.778+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1499456546 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556adde43ab0 2024-09-19T11:14:51.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.778+0000 7f8abb932800 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf46b80 0x556addf48f70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.778+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf496e0 con 0x556addf46b80 2024-09-19T11:14:51.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.778+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf46b80 0x556addf48f70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.779+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf46b80 0x556addf48f70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.779+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1499456546 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8aac051070 con 0x556addf46b80 2024-09-19T11:14:51.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.779+0000 7f8abb932800 1 Processor -- start 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.779+0000 7f8abb932800 1 -- start start 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.779+0000 7f8abb932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf57420 0x556addf57840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.779+0000 7f8abb932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556addd364a0 con 0x556addf57420 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf57420 0x556addf57840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf57420 0x556addf57840 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43738/0 (socket says 172.21.15.102:43738) 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f8ab75bc640 1 -- 172.21.15.102:0/3711808 learned_addr learned my addr 172.21.15.102:0/3711808 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f8ab75bc640 1 -- 172.21.15.102:0/3711808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556addf57e80 con 0x556addf57420 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/3711808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf57420 0x556addf57840 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8052a40 tx=0x7f8aa8016f80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f89a1602640 1 -- 172.21.15.102:0/3711808 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa800d590 con 0x556addf57420 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f89a1602640 1 -- 172.21.15.102:0/3711808 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa800d730 con 0x556addf57420 2024-09-19T11:14:51.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f89a1602640 1 -- 172.21.15.102:0/3711808 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8051280 con 0x556addf57420 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f8abb932800 1 -- 172.21.15.102:0/3711808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556addf586b0 con 0x556addf57420 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.780+0000 7f8abb932800 1 -- 172.21.15.102:0/3711808 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556addf586b0 con 0x556addf57420 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.781+0000 7f89a1602640 1 -- 172.21.15.102:0/3711808 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8aa8051420 con 0x556addf57420 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.781+0000 7f89a1602640 1 --2- 172.21.15.102:0/3711808 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899003d000 0x7f899003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.781+0000 7f89a1602640 1 -- 172.21.15.102:0/3711808 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8aa8051a30 con 0x556addf57420 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.781+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/3711808 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899003d000 0x7f899003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8abb932800 1 Processor -- start 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/3711808 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899003d000 0x7f899003f4c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x556addf3a710 tx=0x7f8aac005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8abb932800 1 -- start start 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8abb932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf63e30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8abb932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556adde3e060 con 0x556addf63a50 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf63e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf63e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43750/0 (socket says 172.21.15.102:43750) 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8ab75bc640 1 -- 172.21.15.102:0/122185200 learned_addr learned my addr 172.21.15.102:0/122185200 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.782+0000 7f8ab75bc640 1 -- 172.21.15.102:0/122185200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556addf64420 con 0x556addf63a50 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/122185200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf63e30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8010fd0 tx=0x7f8aa80546e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fba3f627245f322d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f899affd640 1 -- 172.21.15.102:0/122185200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8048da0 con 0x556addf63a50 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f899affd640 1 -- 172.21.15.102:0/122185200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa8036d50 con 0x556addf63a50 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f899affd640 1 -- 172.21.15.102:0/122185200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa804b940 con 0x556addf63a50 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8abb932800 1 -- 172.21.15.102:0/122185200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 msgr2=0x556addf63e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8abb932800 1 --2- 172.21.15.102:0/122185200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf63e30 secure :-1 s=READY pgs=624 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8010fd0 tx=0x7f8aa80546e0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8abb932800 1 -- 172.21.15.102:0/122185200 shutdown_connections 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8abb932800 1 --2- 172.21.15.102:0/122185200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf63e30 unknown :-1 s=CLOSED pgs=624 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8abb932800 1 -- 172.21.15.102:0/122185200 >> 172.21.15.102:0/122185200 conn(0x556addf5fe50 msgr2=0x556addf5e090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8abb932800 1 -- 172.21.15.102:0/122185200 shutdown_connections 2024-09-19T11:14:51.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8abb932800 1 -- 172.21.15.102:0/122185200 wait complete. 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.783+0000 7f8abb932800 1 Processor -- start 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8abb932800 1 -- start start 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8abb932800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf6ade0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8abb932800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x556addf648b0 con 0x556addf63a50 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf6ade0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8ab75bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf6ade0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43756/0 (socket says 172.21.15.102:43756) 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 learned_addr learned my addr 172.21.15.102:0/1316443297 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x556addf6b340 con 0x556addf63a50 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf6ade0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800dab0 tx=0x7f8aa8005f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f89997fa640 1 -- 172.21.15.102:0/1316443297 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa802d8e0 con 0x556addf63a50 2024-09-19T11:14:51.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f89997fa640 1 -- 172.21.15.102:0/1316443297 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8aa80030d0 con 0x556addf63a50 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f89997fa640 1 -- 172.21.15.102:0/1316443297 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8aa8024420 con 0x556addf63a50 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.784+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x556addf6b340 con 0x556addf63a50 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.785+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x556addf6b340 con 0x556addf63a50 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.785+0000 7f89997fa640 1 -- 172.21.15.102:0/1316443297 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8aa80245c0 con 0x556addf63a50 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.785+0000 7f89997fa640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f898003d000 0x7f898003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f89997fa640 1 -- 172.21.15.102:0/1316443297 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8aa8071d40 con 0x556addf63a50 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f898003d000 0x7f898003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556addf761f0 0x556addf786b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf78e00 con 0x556addf761f0 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f8ab7dbd640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556addf761f0 0x556addf786b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f898003d000 0x7f898003f4c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8aac053570 tx=0x7f8aac053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f8ab7dbd640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556addf761f0 0x556addf786b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.786+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 realm 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf79210 con 0x556addf761f0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf79ae0 con 0x556addf761f0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf7a970 0x556addf7cd60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf7d4a0 con 0x556addf7a970 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.787+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf7a970 0x556addf7cd60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.788+0000 7f8ab75bc640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf7a970 0x556addf7cd60 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.788+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.788+0000 7f8abb932800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.788+0000 7f8abb932800 20 searching for the correct realm 2024-09-19T11:14:51.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.788+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf7f540 0x556addf81a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.788+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf820d0 con 0x556addf7f540 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.788+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf7f540 0x556addf81a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.788+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf7f540 0x556addf81a00 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.789+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.789+0000 7f8ab6dbb640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8aac06c040 0x7f8aac05f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.789+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf820d0 con 0x7f8aac06c040 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.789+0000 7f8ab7dbd640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8aac06c040 0x7f8aac05f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.789+0000 7f8ab7dbd640 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8aac06c040 0x7f8aac05f420 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.789+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.789+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7a970 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.790+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.790+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.790+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.790+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.790+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.790+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7a970 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.790+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.790+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7a970 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.791+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.791+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x7f8aac06c040 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.791+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.791+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7f540 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.791+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.791+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.791+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.791+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7a970 2024-09-19T11:14:51.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.792+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.792+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.792+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.792+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x7f8aac06c040 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.792+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.792+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7f540 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.792+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.792+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7f540 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.793+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.793+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7a970 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.793+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.793+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7f540 2024-09-19T11:14:51.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.793+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.793+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7f540 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.793+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.793+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.794+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.794+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.794+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.794+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7a970 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.794+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.794+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7f540 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.794+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.794+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x7f8aac06c040 2024-09-19T11:14:51.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.795+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.795+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.795+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.795+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7a970 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.795+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.795+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7f540 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.795+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.795+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7a970 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.796+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.796+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x7f8aac06c040 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.796+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.796+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf7f540 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.796+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.796+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x7f8aac06c040 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.796+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.796+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x556addf761f0 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x556addf79e80 con 0x7f8aac06c040 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf7de40 con 0x556addf761f0 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf7de40 con 0x556addf761f0 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf7de10 con 0x556addf7f540 2024-09-19T11:14:51.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.797+0000 7f8abb932800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 zone default found 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 4 Realm: () 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 zonegroup default 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf7e6e0 con 0x556addf7a970 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf83f40 con 0x556addf7f540 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf842e0 con 0x556addf7f540 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 started sync module instance, tier type = 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.798+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf833e0 con 0x7f8aac06c040 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.799+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.799+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93917478926592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf833e0 con 0x7f8aac06c040 2024-09-19T11:14:51.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.799+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf84dd0 con 0x556addf761f0 2024-09-19T11:14:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.800+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93917478926592] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.800+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.800+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93917478930624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf833e0 con 0x556addf761f0 2024-09-19T11:14:51.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.800+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf85890 con 0x556addf7f540 2024-09-19T11:14:51.830 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.803+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93917478930624] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.803+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.803+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93917478924080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf83350 con 0x556addf7f540 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.803+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf86750 con 0x7f8aac06c040 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.804+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93917478924080] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.804+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.804+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93917478937248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf86b70 con 0x7f8aac06c040 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.804+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf87530 con 0x556addf761f0 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.805+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.805+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93917478940800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf87950 con 0x556addf761f0 2024-09-19T11:14:51.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.805+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf883f0 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.805+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93917478937248] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.806+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.806+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93917478944448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf887e0 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.806+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf891e0 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.806+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93917478940800] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.807+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93917478944448] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.807+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.807+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93917478941856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf89580 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.807+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf89e10 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93917478941856] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'201 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93917478948080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf8a090 con 0x556addf7a970 2024-09-19T11:14:51.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8abb932800 20 add_watcher() i=0 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8abb932800 20 add_watcher() i=1 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8abb932800 20 add_watcher() i=2 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8abb932800 20 add_watcher() i=3 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8abb932800 20 add_watcher() i=4 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8abb932800 20 add_watcher() i=5 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.808+0000 7f8abb932800 20 add_watcher() i=6 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.809+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93917478948080] v37'202 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.809+0000 7f8abb932800 20 add_watcher() i=7 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.809+0000 7f8abb932800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.809+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addf8d600 con 0x556addf761f0 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.809+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.810+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93917478951264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf8ab20 con 0x556addf761f0 2024-09-19T11:14:51.833 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93917478951264] v37'204 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f896dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f8abb932800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f8abb932800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f8abb932800 5 note: GC not initialized 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f896cfe1640 20 reqs_thread_entry: start 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f8abb932800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f8abb932800 20 Filter name: none 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f88e67fc640 20 reqs_thread_entry: start 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f8abb932800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.811+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addfc0070 con 0x556addf761f0 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.812+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.812+0000 7f8abb932800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:14:51.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.812+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x556addfc1490 con 0x556addf7a970 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.812+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.813+0000 7f896dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.813+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93917478951264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addfbf990 con 0x556addf761f0 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.814+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 93917478951264] v37'205 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.814+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93917478926592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addfbf990 con 0x7f8aac06c040 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.815+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 93917478926592] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.815+0000 7f8abb932800 20 remove_watcher() i=0 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.815+0000 7f8abb932800 2 removed watcher, disabling cache 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.815+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93917478930624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf83900 con 0x556addf761f0 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.816+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 93917478930624] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.816+0000 7f8abb932800 20 remove_watcher() i=1 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.816+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93917478924080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf83900 con 0x556addf7f540 2024-09-19T11:14:51.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.817+0000 7f8ab6dbb640 1 -- 172.21.15.102:0/1316443297 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 93917478924080] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aac051070 con 0x556addf7f540 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.817+0000 7f8abb932800 20 remove_watcher() i=2 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.817+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93917478937248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf83900 con 0x7f8aac06c040 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.818+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 93917478937248] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x7f8aac06c040 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.818+0000 7f8abb932800 20 remove_watcher() i=3 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.818+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93917478940800] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf862a0 con 0x556addf761f0 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.819+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 93917478940800] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8ab000a4d0 con 0x556addf761f0 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.819+0000 7f8abb932800 20 remove_watcher() i=4 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.819+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93917478944448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf87080 con 0x556addf7a970 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.820+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 93917478944448] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.820+0000 7f8abb932800 20 remove_watcher() i=5 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.820+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93917478941856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf862a0 con 0x556addf7a970 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.821+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 93917478941856] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.821+0000 7f8abb932800 20 remove_watcher() i=6 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.821+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93917478948080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x556addf862a0 con 0x556addf7a970 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8ab75bc640 1 -- 172.21.15.102:0/1316443297 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 93917478948080] v37'203 uv201 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8aa8077070 con 0x556addf7a970 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 20 remove_watcher() i=7 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf7a970 msgr2=0x556addf7cd60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf7a970 0x556addf7cd60 crc :-1 s=READY pgs=142 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556addf761f0 msgr2=0x556addf786b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556addf761f0 0x556addf786b0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8aac06c040 msgr2=0x7f8aac05f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f8aac06c040 0x7f8aac05f420 crc :-1 s=READY pgs=77 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf7f540 msgr2=0x556addf81a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.822+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf7f540 0x556addf81a00 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f898003d000 msgr2=0x7f898003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f898003d000 0x7f898003f4c0 secure :-1 s=READY pgs=259 cs=0 l=1 rev1=1 crypto rx=0x7f8aac053570 tx=0x7f8aac053000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 msgr2=0x556addf6ade0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1316443297 reap_dead start 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf6ade0 secure :-1 s=READY pgs=625 cs=0 l=1 rev1=1 crypto rx=0x7f8aa800dab0 tx=0x7f8aa8005f50 comp rx=0 tx=0).stop 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 shutdown_connections 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/1316443297 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf63a50 0x556addf6ade0 unknown :-1 s=CLOSED pgs=625 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 >> 172.21.15.102:0/1316443297 conn(0x556addf5fe50 msgr2=0x556addf5e060 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 shutdown_connections 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1316443297 wait complete. 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/3711808 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899003d000 msgr2=0x7f899003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/3711808 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899003d000 0x7f899003f4c0 secure :-1 s=READY pgs=258 cs=0 l=1 rev1=1 crypto rx=0x556addf3a710 tx=0x7f8aac005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/3711808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf57420 msgr2=0x556addf57840 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/3711808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf57420 0x556addf57840 secure :-1 s=READY pgs=623 cs=0 l=1 rev1=1 crypto rx=0x7f8aa8052a40 tx=0x7f8aa8016f80 comp rx=0 tx=0).stop 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/3711808 shutdown_connections 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/3711808 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899003d000 0x7f899003f4c0 unknown :-1 s=CLOSED pgs=258 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/3711808 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556addf57420 0x556addf57840 unknown :-1 s=CLOSED pgs=623 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/3711808 >> 172.21.15.102:0/3711808 conn(0x556addf4b7d0 msgr2=0x556addf4bbb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/3711808 shutdown_connections 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/3711808 wait complete. 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf42ce0 msgr2=0x556addf450d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x556addf42ce0 0x556addf450d0 crc :-1 s=READY pgs=141 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556adde43ab0 msgr2=0x556addf40690 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x556adde43ab0 0x556addf40690 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf46b80 msgr2=0x556addf48f70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.823+0000 7f8abb932800 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x556addf46b80 0x556addf48f70 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899c03cfb0 msgr2=0x7f899c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8abb932800 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f899c03cfb0 0x7f899c03f470 secure :-1 s=READY pgs=257 cs=0 l=1 rev1=1 crypto rx=0x7f8aac057000 tx=0x7f8aac052000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 msgr2=0x556addf39040 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8abb932800 1 --2- 172.21.15.102:0/1499456546 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x556adde3feb0 0x556addf39040 secure :-1 s=READY pgs=622 cs=0 l=1 rev1=1 crypto rx=0x7f8aa80012b0 tx=0x7f8aa8000ed0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8ab7dbd640 1 -- 172.21.15.102:0/1499456546 reap_dead start 2024-09-19T11:14:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 shutdown_connections 2024-09-19T11:14:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 >> 172.21.15.102:0/1499456546 conn(0x556adde39a70 msgr2=0x556addf2a860 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 shutdown_connections 2024-09-19T11:14:51.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.824+0000 7f8abb932800 1 -- 172.21.15.102:0/1499456546 wait complete. 2024-09-19T11:14:51.841 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"put_obj","bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11}],"total":{"bytes_sent":0,"bytes_received":30000042,"ops":11,"successful_ops":11,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-19T11:14:51.841 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11}], 'total': {'bytes_sent': 0, 'bytes_received': 30000042, 'ops': 11, 'successful_ops': 11, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:14:51.842 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-19T11:14:51.842 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_obj'] 2024-09-19T11:14:51.842 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_obj 2024-09-19T11:14:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:51.888 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.888+0000 7f6b99887800 1 Processor -- start 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.888+0000 7f6b99887800 1 -- start start 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.888+0000 7f6b99887800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5627cf16ef60 0x5627cf171350 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.888+0000 7f6b99887800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5627cf1755f0 con 0x5627cf1718f0 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.888+0000 7f6b99887800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5627ceff97d0 con 0x5627cf16ef60 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.889+0000 7f6b97371640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5627cf16ef60 0x5627cf171350 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.889+0000 7f6b8eb70640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5627cf1718f0 0x5627cf173d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47876/0 (socket says 172.21.15.102:47876) 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.889+0000 7f6b97371640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5627cf16ef60 0x5627cf171350 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43760/0 (socket says 172.21.15.102:43760) 2024-09-19T11:14:51.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.889+0000 7f6b8eb70640 1 -- 172.21.15.102:0/1146686192 learned_addr learned my addr 172.21.15.102:0/1146686192 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:51.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.889+0000 7f6b97371640 1 -- 172.21.15.102:0/1146686192 >> v1:172.21.15.37:6789/0 conn(0x5627cf1718f0 legacy=0x5627cf173d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.889+0000 7f6b97371640 1 -- 172.21.15.102:0/1146686192 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627cf176820 con 0x5627cf16ef60 2024-09-19T11:14:51.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.891+0000 7f6b97371640 1 --2- 172.21.15.102:0/1146686192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf171350 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800a470 tx=0x7f6b88045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5380f966a2e8e761 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.891+0000 7f6b96b70640 1 -- 172.21.15.102:0/1146686192 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b88053570 con 0x5627cf16ef60 2024-09-19T11:14:51.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.891+0000 7f6b96b70640 1 -- 172.21.15.102:0/1146686192 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88058070 con 0x5627cf16ef60 2024-09-19T11:14:51.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.891+0000 7f6b96b70640 1 -- 172.21.15.102:0/1146686192 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b88053880 con 0x5627cf16ef60 2024-09-19T11:14:51.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.892+0000 7f6b99887800 1 -- 172.21.15.102:0/1146686192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 msgr2=0x5627cf171350 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.892+0000 7f6b99887800 1 --2- 172.21.15.102:0/1146686192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf171350 secure :-1 s=READY pgs=627 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800a470 tx=0x7f6b88045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:51.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.892+0000 7f6b99887800 1 -- 172.21.15.102:0/1146686192 shutdown_connections 2024-09-19T11:14:51.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.892+0000 7f6b99887800 1 --2- 172.21.15.102:0/1146686192 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf171350 unknown :-1 s=CLOSED pgs=627 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.892+0000 7f6b99887800 1 -- 172.21.15.102:0/1146686192 >> 172.21.15.102:0/1146686192 conn(0x5627cf168aa0 msgr2=0x5627cf16aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.892+0000 7f6b99887800 1 -- 172.21.15.102:0/1146686192 shutdown_connections 2024-09-19T11:14:51.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.892+0000 7f6b99887800 1 -- 172.21.15.102:0/1146686192 wait complete. 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.906+0000 7f6b99887800 1 Processor -- start 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.906+0000 7f6b99887800 1 -- start start 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.906+0000 7f6b99887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf25e360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.906+0000 7f6b99887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627cf006dd0 con 0x5627cf16ef60 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.906+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf25e360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.906+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf25e360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43768/0 (socket says 172.21.15.102:43768) 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.906+0000 7f6b97371640 1 -- 172.21.15.102:0/2258175891 learned_addr learned my addr 172.21.15.102:0/2258175891 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.906+0000 7f6b97371640 1 -- 172.21.15.102:0/2258175891 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627cf25e950 con 0x5627cf16ef60 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.907+0000 7f6b97371640 1 --2- 172.21.15.102:0/2258175891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf25e360 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6b88025c20 tx=0x7f6b88051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=29e185f782bf0e4d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.907+0000 7f6a8560a640 1 -- 172.21.15.102:0/2258175891 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b8805c580 con 0x5627cf16ef60 2024-09-19T11:14:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.907+0000 7f6a8560a640 1 -- 172.21.15.102:0/2258175891 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88063030 con 0x5627cf16ef60 2024-09-19T11:14:51.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.907+0000 7f6a8560a640 1 -- 172.21.15.102:0/2258175891 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b8805c850 con 0x5627cf16ef60 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 -- 172.21.15.102:0/2258175891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 msgr2=0x5627cf25e360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 --2- 172.21.15.102:0/2258175891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf25e360 secure :-1 s=READY pgs=628 cs=0 l=1 rev1=1 crypto rx=0x7f6b88025c20 tx=0x7f6b88051000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 -- 172.21.15.102:0/2258175891 shutdown_connections 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 --2- 172.21.15.102:0/2258175891 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf25e360 unknown :-1 s=CLOSED pgs=628 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 -- 172.21.15.102:0/2258175891 >> 172.21.15.102:0/2258175891 conn(0x5627cf168aa0 msgr2=0x5627cf259ce0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 -- 172.21.15.102:0/2258175891 shutdown_connections 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 -- 172.21.15.102:0/2258175891 wait complete. 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 Processor -- start 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 -- start start 2024-09-19T11:14:51.912 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf265d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b99887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627cf175ac0 con 0x5627cf16ef60 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf265d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf265d50 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43774/0 (socket says 172.21.15.102:43774) 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.908+0000 7f6b97371640 1 -- 172.21.15.102:0/2439666008 learned_addr learned my addr 172.21.15.102:0/2439666008 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.909+0000 7f6b97371640 1 -- 172.21.15.102:0/2439666008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627cf2662b0 con 0x5627cf16ef60 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.909+0000 7f6b97371640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf265d50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800a330 tx=0x7f6b88002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.909+0000 7f6a83e07640 1 -- 172.21.15.102:0/2439666008 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b8806c030 con 0x5627cf16ef60 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.909+0000 7f6a83e07640 1 -- 172.21.15.102:0/2439666008 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b8805c580 con 0x5627cf16ef60 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.909+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627cf266540 con 0x5627cf16ef60 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.909+0000 7f6a83e07640 1 -- 172.21.15.102:0/2439666008 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b8805c860 con 0x5627cf16ef60 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.909+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627cf267150 con 0x5627cf16ef60 2024-09-19T11:14:51.913 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.910+0000 7f6a83e07640 1 -- 172.21.15.102:0/2439666008 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6b88053440 con 0x5627cf16ef60 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.910+0000 7f6a83e07640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03cfb0 0x7f6a7c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.910+0000 7f6a83e07640 1 -- 172.21.15.102:0/2439666008 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f6b88070020 con 0x5627cf16ef60 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.910+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03cfb0 0x7f6a7c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.910+0000 7f6b99887800 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf1718f0 0x5627cf26d3a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.910+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf26d8e0 con 0x5627cf1718f0 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.910+0000 7f6b97b72640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf1718f0 0x5627cf26d3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.911+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03cfb0 0x7f6a7c03f470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6b80001d70 tx=0x7f6b800012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.911+0000 7f6b97b72640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf1718f0 0x5627cf26d3a0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.911+0000 7f6b97b72640 1 -- 172.21.15.102:0/2439666008 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf1718f0 2024-09-19T11:14:51.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.911+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf26dc80 con 0x5627cf1718f0 2024-09-19T11:14:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.911+0000 7f6b97b72640 1 -- 172.21.15.102:0/2439666008 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf1718f0 2024-09-19T11:14:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.911+0000 7f6b99887800 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf26f780 0x5627cf271bf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.911+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf272380 con 0x5627cf26f780 2024-09-19T11:14:51.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.911+0000 7f6b97371640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf26f780 0x5627cf271bf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.912+0000 7f6b97371640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf26f780 0x5627cf271bf0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.912+0000 7f6b97371640 1 -- 172.21.15.102:0/2439666008 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b8807b070 con 0x5627cf26f780 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.912+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf26e4d0 con 0x5627cf1718f0 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.912+0000 7f6b97b72640 1 -- 172.21.15.102:0/2439666008 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf1718f0 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.912+0000 7f6b99887800 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2737e0 0x5627cf275bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.912+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf276310 con 0x5627cf2737e0 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.912+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2737e0 0x5627cf275bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.913+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2737e0 0x5627cf275bd0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.913+0000 7f6b8eb70640 1 -- 172.21.15.102:0/2439666008 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2737e0 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.913+0000 7f6b99887800 1 Processor -- start 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.913+0000 7f6b99887800 1 -- start start 2024-09-19T11:14:51.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.913+0000 7f6b99887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf284050 0x5627cf284470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.913+0000 7f6b99887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627cf0654a0 con 0x5627cf284050 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.914+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf284050 0x5627cf284470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.914+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf284050 0x5627cf284470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43788/0 (socket says 172.21.15.102:43788) 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.914+0000 7f6b97371640 1 -- 172.21.15.102:0/201716821 learned_addr learned my addr 172.21.15.102:0/201716821 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.914+0000 7f6b97371640 1 -- 172.21.15.102:0/201716821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627cf284ab0 con 0x5627cf284050 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.914+0000 7f6b97371640 1 --2- 172.21.15.102:0/201716821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf284050 0x5627cf284470 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6b88045ed0 tx=0x7f6b880678f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.914+0000 7f6a81602640 1 -- 172.21.15.102:0/201716821 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b88079040 con 0x5627cf284050 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.914+0000 7f6a81602640 1 -- 172.21.15.102:0/201716821 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88084070 con 0x5627cf284050 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.914+0000 7f6a81602640 1 -- 172.21.15.102:0/201716821 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b8805fa70 con 0x5627cf284050 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.915+0000 7f6b99887800 1 -- 172.21.15.102:0/201716821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627cf2852e0 con 0x5627cf284050 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.915+0000 7f6b99887800 1 -- 172.21.15.102:0/201716821 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627cf285880 con 0x5627cf284050 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.915+0000 7f6a81602640 1 -- 172.21.15.102:0/201716821 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6b8805fc10 con 0x5627cf284050 2024-09-19T11:14:51.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.915+0000 7f6a81602640 1 --2- 172.21.15.102:0/201716821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7003d000 0x7f6a7003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.915+0000 7f6a81602640 1 -- 172.21.15.102:0/201716821 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f6b8806d070 con 0x5627cf284050 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/201716821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7003d000 0x7f6a7003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b99887800 1 Processor -- start 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b99887800 1 -- start start 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/201716821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7003d000 0x7f6a7003f4c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000bf40 tx=0x7f6b8000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b99887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf290d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b99887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627cf25ed20 con 0x5627cf290930 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf290d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf290d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43794/0 (socket says 172.21.15.102:43794) 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.916+0000 7f6b97371640 1 -- 172.21.15.102:0/1154832873 learned_addr learned my addr 172.21.15.102:0/1154832873 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b97371640 1 -- 172.21.15.102:0/1154832873 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627cf291300 con 0x5627cf290930 2024-09-19T11:14:51.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b97371640 1 --2- 172.21.15.102:0/1154832873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf290d10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6b880987b0 tx=0x7f6b8808dfa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b9023ccc9fc54539 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6a7affd640 1 -- 172.21.15.102:0/1154832873 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b880ab070 con 0x5627cf290930 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6a7affd640 1 -- 172.21.15.102:0/1154832873 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88053730 con 0x5627cf290930 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6a7affd640 1 -- 172.21.15.102:0/1154832873 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b88009740 con 0x5627cf290930 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b99887800 1 -- 172.21.15.102:0/1154832873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 msgr2=0x5627cf290d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b99887800 1 --2- 172.21.15.102:0/1154832873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf290d10 secure :-1 s=READY pgs=631 cs=0 l=1 rev1=1 crypto rx=0x7f6b880987b0 tx=0x7f6b8808dfa0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b99887800 1 -- 172.21.15.102:0/1154832873 shutdown_connections 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b99887800 1 --2- 172.21.15.102:0/1154832873 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf290d10 unknown :-1 s=CLOSED pgs=631 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b99887800 1 -- 172.21.15.102:0/1154832873 >> 172.21.15.102:0/1154832873 conn(0x5627cf28cd30 msgr2=0x5627cf28af70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b99887800 1 -- 172.21.15.102:0/1154832873 shutdown_connections 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.917+0000 7f6b99887800 1 -- 172.21.15.102:0/1154832873 wait complete. 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.918+0000 7f6b99887800 1 Processor -- start 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.918+0000 7f6b99887800 1 -- start start 2024-09-19T11:14:51.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.918+0000 7f6b99887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf297e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.918+0000 7f6b99887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5627cf291790 con 0x5627cf290930 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.918+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf297e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.918+0000 7f6b97371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf297e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43810/0 (socket says 172.21.15.102:43810) 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.918+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 learned_addr learned my addr 172.21.15.102:0/3759172392 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.918+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5627cf298370 con 0x5627cf290930 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.919+0000 7f6b97371640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf297e10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6b880a9040 tx=0x7f6b88071fe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.919+0000 7f6a797fa640 1 -- 172.21.15.102:0/3759172392 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b880b5070 con 0x5627cf290930 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.919+0000 7f6a797fa640 1 -- 172.21.15.102:0/3759172392 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b88096730 con 0x5627cf290930 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.919+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5627cf298370 con 0x5627cf290930 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.919+0000 7f6a797fa640 1 -- 172.21.15.102:0/3759172392 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b880ab040 con 0x5627cf290930 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.919+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5627cf298370 con 0x5627cf290930 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6a797fa640 1 -- 172.21.15.102:0/3759172392 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6b880b8070 con 0x5627cf290930 2024-09-19T11:14:51.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6a797fa640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a6003d000 0x7f6a6003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6a797fa640 1 -- 172.21.15.102:0/3759172392 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f6b880a3070 con 0x5627cf290930 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a6003d000 0x7f6a6003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf2a32f0 0x5627cf2a57b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a5f00 con 0x5627cf2a32f0 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6b97b72640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf2a32f0 0x5627cf2a57b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.920+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a6003d000 0x7f6a6003f4c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c010 tx=0x7f6b80010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b97b72640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf2a32f0 0x5627cf2a57b0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 20 realm 2024-09-19T11:14:51.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6310 con 0x5627cf2a32f0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6be0 con 0x5627cf2a32f0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.921+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b99887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf2a7a70 0x5627cf2a9e60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2aa5a0 con 0x5627cf2a7a70 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b97371640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf2a7a70 0x5627cf2a9e60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b97371640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf2a7a70 0x5627cf2a9e60 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b99887800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b99887800 20 searching for the correct realm 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2ac640 0x5627cf2aeb00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.922+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2af1d0 con 0x5627cf2ac640 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.923+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2ac640 0x5627cf2aeb00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.923+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2ac640 0x5627cf2aeb00 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.923+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.923+0000 7f6b8eb70640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b80037040 0x7f6b80036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:51.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.923+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2af1d0 con 0x7f6b80037040 2024-09-19T11:14:51.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.923+0000 7f6b97b72640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b80037040 0x7f6b80036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:51.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.923+0000 7f6b97b72640 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b80037040 0x7f6b80036410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.924+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.924+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a7a70 2024-09-19T11:14:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.924+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.924+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.924+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.924+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.924+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.924+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a7a70 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.925+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.925+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a7a70 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.925+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.925+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x7f6b80037040 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.925+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.925+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2ac640 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.925+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.925+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.926+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.926+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a7a70 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.926+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.926+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.926+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.926+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x7f6b80037040 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.926+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.926+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2ac640 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.927+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.927+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2ac640 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.927+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.927+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a7a70 2024-09-19T11:14:51.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.927+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.927+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2ac640 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.927+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.927+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2ac640 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.928+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.928+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.928+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.928+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.928+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.928+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a7a70 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.928+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.928+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2ac640 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.929+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.929+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x7f6b80037040 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.929+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.929+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.929+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.929+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a7a70 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.929+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.929+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2ac640 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.930+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.930+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a7a70 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.930+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.930+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x7f6b80037040 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.930+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.930+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2ac640 2024-09-19T11:14:51.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.930+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.930+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x7f6b80037040 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x5627cf2a32f0 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2a6f80 con 0x7f6b80037040 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:51.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2aaf40 con 0x5627cf2a32f0 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.931+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2aaf40 con 0x5627cf2a32f0 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2aaef0 con 0x5627cf2ac640 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:51.949 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 zone default found 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 4 Realm: () 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 zonegroup default 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2ab7e0 con 0x5627cf2a7a70 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b1040 con 0x5627cf2ac640 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.932+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b13e0 con 0x5627cf2ac640 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.933+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.933+0000 7f6b99887800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.933+0000 7f6b99887800 20 started sync module instance, tier type = 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.933+0000 7f6b99887800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.933+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b04e0 con 0x7f6b80037040 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.934+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.934+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94728979417568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b04e0 con 0x7f6b80037040 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.934+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b1eb0 con 0x5627cf2a32f0 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.935+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94728979417568] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.935+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.935+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94728979421600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b04e0 con 0x5627cf2a32f0 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.935+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b2960 con 0x5627cf2ac640 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.937+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.937+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94728979421600] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.937+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94728979415088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b2d50 con 0x5627cf2ac640 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.937+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b3710 con 0x7f6b80037040 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.938+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.938+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94728979428416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b3fb0 con 0x7f6b80037040 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.938+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b4aa0 con 0x5627cf2a32f0 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.938+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94728979415088] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.939+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.939+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94728979432816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b4a60 con 0x5627cf2a32f0 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.939+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b54e0 con 0x5627cf2a7a70 2024-09-19T11:14:51.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.939+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94728979428416] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x7f6b80037040 2024-09-19T11:14:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.940+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.940+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94728979435568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b58d0 con 0x5627cf2a7a70 2024-09-19T11:14:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.940+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b62f0 con 0x5627cf2a7a70 2024-09-19T11:14:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.941+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94728979432816] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.941+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94728979435568] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.942+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.942+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94728979430144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b2480 con 0x5627cf2a7a70 2024-09-19T11:14:51.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.942+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b6b50 con 0x5627cf2a7a70 2024-09-19T11:14:51.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94728979430144] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.960 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'204 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94728979441216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b6b10 con 0x5627cf2a7a70 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b99887800 20 add_watcher() i=0 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b99887800 20 add_watcher() i=1 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b99887800 20 add_watcher() i=2 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b99887800 20 add_watcher() i=3 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b99887800 20 add_watcher() i=4 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b99887800 20 add_watcher() i=5 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.943+0000 7f6b99887800 20 add_watcher() i=6 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.944+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94728979441216] v37'205 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.944+0000 7f6b99887800 20 add_watcher() i=7 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.944+0000 7f6b99887800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:51.961 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.944+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b9fa0 con 0x5627cf2a32f0 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.944+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.944+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94728979439072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b7530 con 0x5627cf2a32f0 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.945+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94728979439072] v37'206 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.945+0000 7f6a4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.945+0000 7f6b99887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.945+0000 7f6b99887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.945+0000 7f6b99887800 5 note: GC not initialized 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.945+0000 7f6a4cfe1640 20 reqs_thread_entry: start 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.946+0000 7f6b99887800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.946+0000 7f6b99887800 20 Filter name: none 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.946+0000 7f69c67fc640 20 reqs_thread_entry: start 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.946+0000 7f6b99887800 20 rados->read ofs=0 len=0 2024-09-19T11:14:51.962 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.946+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2eca60 con 0x5627cf2a32f0 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.946+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f6b9000a4d0 con 0x5627cf2a32f0 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.946+0000 7f6b99887800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.946+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2ede80 con 0x5627cf2a7a70 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.947+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.947+0000 7f6a4dfe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.947+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94728979439072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2ec380 con 0x5627cf2a32f0 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.948+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94728979439072] v37'207 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b90040040 con 0x5627cf2a32f0 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.948+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94728979417568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b5de0 con 0x7f6b80037040 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.949+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94728979417568] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b90040040 con 0x7f6b80037040 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.949+0000 7f6b99887800 20 remove_watcher() i=0 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.949+0000 7f6b99887800 2 removed watcher, disabling cache 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.949+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94728979421600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b5de0 con 0x5627cf2a32f0 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.950+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94728979421600] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b90040040 con 0x5627cf2a32f0 2024-09-19T11:14:51.963 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.950+0000 7f6b99887800 20 remove_watcher() i=1 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.950+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94728979415088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b5de0 con 0x5627cf2ac640 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.951+0000 7f6b8eb70640 1 -- 172.21.15.102:0/3759172392 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94728979415088] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b80009050 con 0x5627cf2ac640 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.951+0000 7f6b99887800 20 remove_watcher() i=2 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.951+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94728979428416] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b0030 con 0x7f6b80037040 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.952+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94728979428416] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b90040040 con 0x7f6b80037040 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.952+0000 7f6b99887800 20 remove_watcher() i=3 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.952+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94728979432816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b3440 con 0x5627cf2a32f0 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.953+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94728979432816] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b90040040 con 0x5627cf2a32f0 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.953+0000 7f6b99887800 20 remove_watcher() i=4 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.953+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94728979435568] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b0030 con 0x5627cf2a7a70 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.954+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94728979435568] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.964 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.954+0000 7f6b99887800 20 remove_watcher() i=5 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.954+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94728979430144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b3440 con 0x5627cf2a7a70 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.955+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94728979430144] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.955+0000 7f6b99887800 20 remove_watcher() i=6 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.955+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94728979441216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5627cf2b0030 con 0x5627cf2a7a70 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.956+0000 7f6b97371640 1 -- 172.21.15.102:0/3759172392 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94728979441216] v37'206 uv204 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b880b7030 con 0x5627cf2a7a70 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.956+0000 7f6b99887800 20 remove_watcher() i=7 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf2a7a70 msgr2=0x5627cf2a9e60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf2a7a70 0x5627cf2a9e60 crc :-1 s=READY pgs=144 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf2a32f0 msgr2=0x5627cf2a57b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf2a32f0 0x5627cf2a57b0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b80037040 msgr2=0x7f6b80036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b80037040 0x7f6b80036410 crc :-1 s=READY pgs=78 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.965 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2ac640 msgr2=0x5627cf2aeb00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2ac640 0x5627cf2aeb00 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a6003d000 msgr2=0x7f6a6003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a6003d000 0x7f6a6003f4c0 secure :-1 s=READY pgs=262 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000c010 tx=0x7f6b80010000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 msgr2=0x5627cf297e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b97b72640 1 -- 172.21.15.102:0/3759172392 reap_dead start 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf297e10 secure :-1 s=READY pgs=632 cs=0 l=1 rev1=1 crypto rx=0x7f6b880a9040 tx=0x7f6b88071fe0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 shutdown_connections 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/3759172392 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf290930 0x5627cf297e10 unknown :-1 s=CLOSED pgs=632 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 >> 172.21.15.102:0/3759172392 conn(0x5627cf28cd30 msgr2=0x5627cf28af40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 shutdown_connections 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/3759172392 wait complete. 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/201716821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7003d000 msgr2=0x7f6a7003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/201716821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7003d000 0x7f6a7003f4c0 secure :-1 s=READY pgs=261 cs=0 l=1 rev1=1 crypto rx=0x7f6b8000bf40 tx=0x7f6b8000f000 comp rx=0 tx=0).stop 2024-09-19T11:14:51.966 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/201716821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf284050 msgr2=0x5627cf284470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/201716821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf284050 0x5627cf284470 secure :-1 s=READY pgs=630 cs=0 l=1 rev1=1 crypto rx=0x7f6b88045ed0 tx=0x7f6b880678f0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/201716821 shutdown_connections 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/201716821 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7003d000 0x7f6a7003f4c0 unknown :-1 s=CLOSED pgs=261 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 --2- 172.21.15.102:0/201716821 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf284050 0x5627cf284470 unknown :-1 s=CLOSED pgs=630 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/201716821 >> 172.21.15.102:0/201716821 conn(0x5627cf278400 msgr2=0x5627cf2787e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/201716821 shutdown_connections 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.957+0000 7f6b99887800 1 -- 172.21.15.102:0/201716821 wait complete. 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf26f780 msgr2=0x5627cf271bf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5627cf26f780 0x5627cf271bf0 crc :-1 s=READY pgs=143 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf1718f0 msgr2=0x5627cf26d3a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5627cf1718f0 0x5627cf26d3a0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.967 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2737e0 msgr2=0x5627cf275bd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5627cf2737e0 0x5627cf275bd0 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03cfb0 msgr2=0x7f6a7c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a7c03cfb0 0x7f6a7c03f470 secure :-1 s=READY pgs=260 cs=0 l=1 rev1=1 crypto rx=0x7f6b80001d70 tx=0x7f6b800012d0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 msgr2=0x5627cf265d50 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 --2- 172.21.15.102:0/2439666008 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5627cf16ef60 0x5627cf265d50 secure :-1 s=READY pgs=629 cs=0 l=1 rev1=1 crypto rx=0x7f6b8800a330 tx=0x7f6b88002fb0 comp rx=0 tx=0).stop 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b97b72640 1 -- 172.21.15.102:0/2439666008 reap_dead start 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 shutdown_connections 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 >> 172.21.15.102:0/2439666008 conn(0x5627cf168aa0 msgr2=0x5627cf2584d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 shutdown_connections 2024-09-19T11:14:51.968 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:51.958+0000 7f6b99887800 1 -- 172.21.15.102:0/2439666008 wait complete. 2024-09-19T11:14:51.969 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_obj","bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4}],"total":{"bytes_sent":0,"bytes_received":0,"ops":4,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-19T11:14:51.969 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:14:51.970 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-19T11:14:51.970 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo', '--categories', 'delete_bucket'] 2024-09-19T11:14:51.970 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo --categories delete_bucket 2024-09-19T11:14:52.015 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:52.016 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:52.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.015+0000 7fb82262d800 1 Processor -- start 2024-09-19T11:14:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.015+0000 7fb82262d800 1 -- start start 2024-09-19T11:14:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.015+0000 7fb82262d800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55da2e3ee860 0x55da2e3f7380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.015+0000 7fb82262d800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55da2e3f78c0 con 0x55da2e3ecd40 2024-09-19T11:14:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.015+0000 7fb82262d800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55da2e2797d0 con 0x55da2e3ee860 2024-09-19T11:14:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.016+0000 7fb81f916640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55da2e3ee860 0x55da2e3f7380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.016+0000 7fb820117640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55da2e3ecd40 0x55da2e3ed140 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47882/0 (socket says 172.21.15.102:47882) 2024-09-19T11:14:52.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.016+0000 7fb820117640 1 -- 172.21.15.102:0/3859452343 learned_addr learned my addr 172.21.15.102:0/3859452343 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:52.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.016+0000 7fb81f916640 1 -- 172.21.15.102:0/3859452343 >> v1:172.21.15.37:6789/0 conn(0x55da2e3ecd40 legacy=0x55da2e3ed140 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.016+0000 7fb81f916640 1 -- 172.21.15.102:0/3859452343 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2e3f8aa0 con 0x55da2e3ee860 2024-09-19T11:14:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb81f916640 1 --2- 172.21.15.102:0/3859452343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ee860 0x55da2e3f7380 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb81400a470 tx=0x7fb814045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=70b672d5f1826fb8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb81f115640 1 -- 172.21.15.102:0/3859452343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb814053570 con 0x55da2e3ee860 2024-09-19T11:14:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb81f115640 1 -- 172.21.15.102:0/3859452343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb814058070 con 0x55da2e3ee860 2024-09-19T11:14:52.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb81f115640 1 -- 172.21.15.102:0/3859452343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb814053880 con 0x55da2e3ee860 2024-09-19T11:14:52.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb82262d800 1 -- 172.21.15.102:0/3859452343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ee860 msgr2=0x55da2e3f7380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb82262d800 1 --2- 172.21.15.102:0/3859452343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ee860 0x55da2e3f7380 secure :-1 s=READY pgs=634 cs=0 l=1 rev1=1 crypto rx=0x7fb81400a470 tx=0x7fb814045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:52.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb82262d800 1 -- 172.21.15.102:0/3859452343 shutdown_connections 2024-09-19T11:14:52.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb82262d800 1 --2- 172.21.15.102:0/3859452343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ee860 0x55da2e3f7380 unknown :-1 s=CLOSED pgs=634 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.020 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.018+0000 7fb82262d800 1 -- 172.21.15.102:0/3859452343 >> 172.21.15.102:0/3859452343 conn(0x55da2e3e8a70 msgr2=0x55da2e3eaed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.019+0000 7fb82262d800 1 -- 172.21.15.102:0/3859452343 shutdown_connections 2024-09-19T11:14:52.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.019+0000 7fb82262d800 1 -- 172.21.15.102:0/3859452343 wait complete. 2024-09-19T11:14:52.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.032+0000 7fb82262d800 1 Processor -- start 2024-09-19T11:14:52.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.032+0000 7fb82262d800 1 -- start start 2024-09-19T11:14:52.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.032+0000 7fb82262d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e0580 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.032+0000 7fb82262d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55da2e286dd0 con 0x55da2e3ecd40 2024-09-19T11:14:52.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.033+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e0580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.033+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e0580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43842/0 (socket says 172.21.15.102:43842) 2024-09-19T11:14:52.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.033+0000 7fb820117640 1 -- 172.21.15.102:0/1706843766 learned_addr learned my addr 172.21.15.102:0/1706843766 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.033+0000 7fb820117640 1 -- 172.21.15.102:0/1706843766 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2e4e0b70 con 0x55da2e3ecd40 2024-09-19T11:14:52.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.033+0000 7fb820117640 1 --2- 172.21.15.102:0/1706843766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e0580 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb810001800 tx=0x7fb810001cc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c891d7dd1ba1db1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.033+0000 7fb70e60c640 1 -- 172.21.15.102:0/1706843766 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb810004520 con 0x55da2e3ecd40 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.033+0000 7fb70e60c640 1 -- 172.21.15.102:0/1706843766 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8100046c0 con 0x55da2e3ecd40 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.033+0000 7fb70e60c640 1 -- 172.21.15.102:0/1706843766 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb8100049e0 con 0x55da2e3ecd40 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 -- 172.21.15.102:0/1706843766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 msgr2=0x55da2e4e0580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 --2- 172.21.15.102:0/1706843766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e0580 secure :-1 s=READY pgs=635 cs=0 l=1 rev1=1 crypto rx=0x7fb810001800 tx=0x7fb810001cc0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 -- 172.21.15.102:0/1706843766 shutdown_connections 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 --2- 172.21.15.102:0/1706843766 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e0580 unknown :-1 s=CLOSED pgs=635 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 -- 172.21.15.102:0/1706843766 >> 172.21.15.102:0/1706843766 conn(0x55da2e3e8a70 msgr2=0x55da2e4dbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 -- 172.21.15.102:0/1706843766 shutdown_connections 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 -- 172.21.15.102:0/1706843766 wait complete. 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 Processor -- start 2024-09-19T11:14:52.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 -- start start 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e80a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.034+0000 7fb82262d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55da2e3f7d60 con 0x55da2e3ecd40 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e80a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e80a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43846/0 (socket says 172.21.15.102:43846) 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb820117640 1 -- 172.21.15.102:0/882474200 learned_addr learned my addr 172.21.15.102:0/882474200 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb820117640 1 -- 172.21.15.102:0/882474200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2e4e8600 con 0x55da2e3ecd40 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb820117640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e80a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb8100066b0 tx=0x7fb810001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb70ce09640 1 -- 172.21.15.102:0/882474200 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb810022020 con 0x55da2e3ecd40 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb70ce09640 1 -- 172.21.15.102:0/882474200 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb8100148c0 con 0x55da2e3ecd40 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da2e4e8890 con 0x55da2e3ecd40 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.035+0000 7fb70ce09640 1 -- 172.21.15.102:0/882474200 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb810014be0 con 0x55da2e3ecd40 2024-09-19T11:14:52.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.036+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da2e4e9290 con 0x55da2e3ecd40 2024-09-19T11:14:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.036+0000 7fb70ce09640 1 -- 172.21.15.102:0/882474200 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb810025020 con 0x55da2e3ecd40 2024-09-19T11:14:52.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb70ce09640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb70803d000 0x7fb70803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb70ce09640 1 -- 172.21.15.102:0/882474200 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fb810018030 con 0x55da2e3ecd40 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb81f916640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb70803d000 0x7fb70803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb82262d800 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e3ee860 0x55da2e4ef6f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e4efc30 con 0x55da2e3ee860 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb820918640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e3ee860 0x55da2e4ef6f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb81f916640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb70803d000 0x7fb70803f4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb814057000 tx=0x7fb814052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb820918640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e3ee860 0x55da2e4ef6f0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.037+0000 7fb820918640 1 -- 172.21.15.102:0/882474200 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8180083e0 con 0x55da2e3ee860 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.038+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e4effd0 con 0x55da2e3ee860 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.038+0000 7fb820918640 1 -- 172.21.15.102:0/882474200 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8180083e0 con 0x55da2e3ee860 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.038+0000 7fb82262d800 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e4f1ad0 0x55da2e4f3f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.038+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e4f46e0 con 0x55da2e4f1ad0 2024-09-19T11:14:52.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.038+0000 7fb820117640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e4f1ad0 0x55da2e4f3f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.038+0000 7fb820117640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e4f1ad0 0x55da2e4f3f50 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.039+0000 7fb820117640 1 -- 172.21.15.102:0/882474200 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e4f1ad0 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.039+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e4f0820 con 0x55da2e3ee860 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.039+0000 7fb820918640 1 -- 172.21.15.102:0/882474200 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb8180083e0 con 0x55da2e3ee860 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.039+0000 7fb82262d800 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e4f5b40 0x55da2e4f7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.039+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e4f8670 con 0x55da2e4f5b40 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.039+0000 7fb81f916640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e4f5b40 0x55da2e4f7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.039+0000 7fb81f916640 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e4f5b40 0x55da2e4f7f30 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.040+0000 7fb81f916640 1 -- 172.21.15.102:0/882474200 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb814051070 con 0x55da2e4f5b40 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.040+0000 7fb82262d800 1 Processor -- start 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.040+0000 7fb82262d800 1 -- start start 2024-09-19T11:14:52.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.040+0000 7fb82262d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e5063f0 0x55da2e506810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.040+0000 7fb82262d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55da2e2e54a0 con 0x55da2e5063f0 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.040+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e5063f0 0x55da2e506810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.040+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e5063f0 0x55da2e506810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43848/0 (socket says 172.21.15.102:43848) 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.040+0000 7fb820117640 1 -- 172.21.15.102:0/1950227929 learned_addr learned my addr 172.21.15.102:0/1950227929 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.041+0000 7fb820117640 1 -- 172.21.15.102:0/1950227929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2e506e50 con 0x55da2e5063f0 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.041+0000 7fb820117640 1 --2- 172.21.15.102:0/1950227929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e5063f0 0x55da2e506810 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb810002250 tx=0x7fb81001df10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.041+0000 7fb705ffb640 1 -- 172.21.15.102:0/1950227929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb810010860 con 0x55da2e5063f0 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.041+0000 7fb705ffb640 1 -- 172.21.15.102:0/1950227929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81004b2d0 con 0x55da2e5063f0 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.041+0000 7fb82262d800 1 -- 172.21.15.102:0/1950227929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da2e507680 con 0x55da2e5063f0 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.041+0000 7fb705ffb640 1 -- 172.21.15.102:0/1950227929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb81004b5b0 con 0x55da2e5063f0 2024-09-19T11:14:52.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.041+0000 7fb82262d800 1 -- 172.21.15.102:0/1950227929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da2e507680 con 0x55da2e5063f0 2024-09-19T11:14:52.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb705ffb640 1 -- 172.21.15.102:0/1950227929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb810037060 con 0x55da2e5063f0 2024-09-19T11:14:52.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb705ffb640 1 --2- 172.21.15.102:0/1950227929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f803d000 0x7fb6f803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb705ffb640 1 -- 172.21.15.102:0/1950227929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fb81004a070 con 0x55da2e5063f0 2024-09-19T11:14:52.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb81f916640 1 --2- 172.21.15.102:0/1950227929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f803d000 0x7fb6f803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb82262d800 1 Processor -- start 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb82262d800 1 -- start start 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb81f916640 1 --2- 172.21.15.102:0/1950227929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f803d000 0x7fb6f803f4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55da2e4f0bc0 tx=0x7fb814005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb82262d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e512e80 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.042+0000 7fb82262d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55da2e4e0fa0 con 0x55da2e512aa0 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e512e80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e512e80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43854/0 (socket says 172.21.15.102:43854) 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb820117640 1 -- 172.21.15.102:0/3133359865 learned_addr learned my addr 172.21.15.102:0/3133359865 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb820117640 1 -- 172.21.15.102:0/3133359865 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2e513470 con 0x55da2e512aa0 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb820117640 1 --2- 172.21.15.102:0/3133359865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e512e80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb810012560 tx=0x7fb810012590 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ab852d9ebb0e18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb6ff7fe640 1 -- 172.21.15.102:0/3133359865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb810044ac0 con 0x55da2e512aa0 2024-09-19T11:14:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb6ff7fe640 1 -- 172.21.15.102:0/3133359865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81004b940 con 0x55da2e512aa0 2024-09-19T11:14:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb6ff7fe640 1 -- 172.21.15.102:0/3133359865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb81001e6d0 con 0x55da2e512aa0 2024-09-19T11:14:52.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb82262d800 1 -- 172.21.15.102:0/3133359865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 msgr2=0x55da2e512e80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.043+0000 7fb82262d800 1 --2- 172.21.15.102:0/3133359865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e512e80 secure :-1 s=READY pgs=638 cs=0 l=1 rev1=1 crypto rx=0x7fb810012560 tx=0x7fb810012590 comp rx=0 tx=0).stop 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 -- 172.21.15.102:0/3133359865 shutdown_connections 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 --2- 172.21.15.102:0/3133359865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e512e80 unknown :-1 s=CLOSED pgs=638 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 -- 172.21.15.102:0/3133359865 >> 172.21.15.102:0/3133359865 conn(0x55da2e50eea0 msgr2=0x55da2e50d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 -- 172.21.15.102:0/3133359865 shutdown_connections 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 -- 172.21.15.102:0/3133359865 wait complete. 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 Processor -- start 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 -- start start 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e519eb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb82262d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55da2e513900 con 0x55da2e512aa0 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e519eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb820117640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e519eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43862/0 (socket says 172.21.15.102:43862) 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 learned_addr learned my addr 172.21.15.102:0/3892698274 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.044+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55da2e51a410 con 0x55da2e512aa0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.045+0000 7fb820117640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e519eb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb81004be40 tx=0x7fb810048ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.045+0000 7fb6fdffb640 1 -- 172.21.15.102:0/3892698274 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb810012cd0 con 0x55da2e512aa0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.045+0000 7fb6fdffb640 1 -- 172.21.15.102:0/3892698274 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb81006d070 con 0x55da2e512aa0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.045+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55da2e51a410 con 0x55da2e512aa0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.045+0000 7fb6fdffb640 1 -- 172.21.15.102:0/3892698274 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb81002bd40 con 0x55da2e512aa0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.045+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55da2e51a410 con 0x55da2e512aa0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.045+0000 7fb6fdffb640 1 -- 172.21.15.102:0/3892698274 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb81005c030 con 0x55da2e512aa0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.046+0000 7fb6fdffb640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f003d000 0x7fb6f003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.046+0000 7fb6fdffb640 1 -- 172.21.15.102:0/3892698274 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fb81005a070 con 0x55da2e512aa0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.046+0000 7fb81f916640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f003d000 0x7fb6f003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.046+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.046+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e525390 0x55da2e527850 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.046+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e527fa0 con 0x55da2e525390 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.046+0000 7fb820918640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e525390 0x55da2e527850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.046+0000 7fb81f916640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f003d000 0x7fb6f003f4c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb814053570 tx=0x7fb814053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb820918640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e525390 0x55da2e527850 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8180083e0 con 0x55da2e525390 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 20 realm 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e5283b0 con 0x55da2e525390 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8180083e0 con 0x55da2e525390 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb8180083e0 con 0x55da2e525390 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.047+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e529020 con 0x55da2e525390 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb8180083e0 con 0x55da2e525390 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb82262d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e529770 0x55da2e52bb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e52c2d0 con 0x55da2e529770 2024-09-19T11:14:52.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb820117640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e529770 0x55da2e52bb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb820117640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e529770 0x55da2e52bb60 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb82262d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb82262d800 20 searching for the correct realm 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e52e3b0 0x55da2e530870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e530f40 con 0x55da2e52e3b0 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.048+0000 7fb81f916640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e52e3b0 0x55da2e530870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.049+0000 7fb81f916640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e52e3b0 0x55da2e530870 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.049+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.049+0000 7fb81f916640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb81406c040 0x7fb81405f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.049+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e530f40 con 0x7fb81406c040 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.049+0000 7fb820918640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb81406c040 0x7fb81405f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.049+0000 7fb820918640 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb81406c040 0x7fb81405f420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.050+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8180083e0 con 0x7fb81406c040 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.050+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e529770 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.050+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.050+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.050+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb8180083e0 con 0x55da2e525390 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.050+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.050+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.050+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e529770 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.051+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.051+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e529770 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.051+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.051+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x7fb81406c040 2024-09-19T11:14:52.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.051+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.051+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e52e3b0 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.051+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.051+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.052+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.052+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e529770 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.052+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.052+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.052+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.052+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x7fb81406c040 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.052+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.052+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e52e3b0 2024-09-19T11:14:52.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e52e3b0 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e529770 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e52e3b0 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e52e3b0 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.053+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.054+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.054+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.054+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.054+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e529770 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.054+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.054+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e52e3b0 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.054+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.054+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x7fb81406c040 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.055+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.055+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.055+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.055+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e529770 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.055+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.055+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e52e3b0 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.055+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.055+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e529770 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.056+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.056+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x7fb81406c040 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.056+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.056+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e52e3b0 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.056+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.056+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x7fb81406c040 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.056+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.056+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x55da2e525390 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55da2e528c80 con 0x7fb81406c040 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e52cc70 con 0x55da2e525390 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e52cc70 con 0x55da2e525390 2024-09-19T11:14:52.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.057+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e52cc20 con 0x55da2e52e3b0 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 20 zone default found 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 4 Realm: () 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 20 zonegroup default 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e52d510 con 0x55da2e529770 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e532db0 con 0x55da2e52e3b0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.058+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e533150 con 0x55da2e52e3b0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.059+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.059+0000 7fb82262d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.059+0000 7fb82262d800 20 started sync module instance, tier type = 2024-09-19T11:14:52.077 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.059+0000 7fb82262d800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.059+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e532250 con 0x7fb81406c040 2024-09-19T11:14:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.060+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.060+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94395568433008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e532250 con 0x7fb81406c040 2024-09-19T11:14:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.060+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e533c80 con 0x55da2e525390 2024-09-19T11:14:52.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.060+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94395568433008] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.061+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.061+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94395568437072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e532250 con 0x55da2e525390 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.061+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e534710 con 0x55da2e52e3b0 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.062+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.062+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94395568439776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e534fb0 con 0x55da2e52e3b0 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.062+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e535a50 con 0x7fb81406c040 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.062+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94395568437072] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.063+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94395568439776] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.063+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.063+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94395568442112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e531da0 con 0x7fb81406c040 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.063+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e536330 con 0x55da2e525390 2024-09-19T11:14:52.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.064+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94395568442112] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818026040 con 0x7fb81406c040 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.064+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.064+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94395568444704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e536270 con 0x55da2e525390 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.064+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e536d40 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.065+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.065+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94395568444704] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.065+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94395568446912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e5370e0 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.065+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e537aa0 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.066+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(56 notify.6 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.066+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94395568455232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e538710 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.066+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e539180 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.066+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94395568446912] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'207 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.089 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94395568455232] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94395568458832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e539140 con 0x55da2e529770 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb82262d800 20 add_watcher() i=0 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb82262d800 20 add_watcher() i=1 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb82262d800 20 add_watcher() i=2 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb82262d800 20 add_watcher() i=3 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb82262d800 20 add_watcher() i=4 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb82262d800 20 add_watcher() i=5 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.067+0000 7fb82262d800 20 add_watcher() i=6 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.068+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94395568458832] v37'208 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.068+0000 7fb82262d800 20 add_watcher() i=7 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.068+0000 7fb82262d800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.068+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e53c170 con 0x55da2e525390 2024-09-19T11:14:52.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.069+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb818026040 con 0x55da2e525390 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.069+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94395568449680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e5395f0 con 0x55da2e525390 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94395568449680] v37'208 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb818036040 con 0x55da2e525390 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb6d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb82262d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb82262d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb82262d800 5 note: GC not initialized 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb6d57e2640 20 reqs_thread_entry: start 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb82262d800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb82262d800 20 Filter name: none 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb646ffd640 20 reqs_thread_entry: start 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb82262d800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.070+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e56eb80 con 0x55da2e525390 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.071+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7fb818036040 con 0x55da2e525390 2024-09-19T11:14:52.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.071+0000 7fb82262d800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.071+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55da2e56ffa0 con 0x55da2e529770 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.071+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 usage.10 [call out=1378b] v0'0 uv30 ondisk = 0) ==== 152+0+1378 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.072+0000 7fb6d67e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.072+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94395568449680] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e56e4a0 con 0x55da2e525390 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.073+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94395568449680] v37'209 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb818036040 con 0x55da2e525390 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.073+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94395568433008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e536890 con 0x7fb81406c040 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.074+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94395568433008] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818036040 con 0x7fb81406c040 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.074+0000 7fb82262d800 20 remove_watcher() i=0 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.074+0000 7fb82262d800 2 removed watcher, disabling cache 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.074+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94395568437072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e532770 con 0x55da2e525390 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.076+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94395568437072] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818036040 con 0x55da2e525390 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.076+0000 7fb82262d800 20 remove_watcher() i=1 2024-09-19T11:14:52.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.076+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94395568439776] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e532770 con 0x55da2e52e3b0 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.077+0000 7fb81f916640 1 -- 172.21.15.102:0/3892698274 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94395568439776] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb814051070 con 0x55da2e52e3b0 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.077+0000 7fb82262d800 20 remove_watcher() i=2 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.077+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94395568442112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e5341e0 con 0x7fb81406c040 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.078+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94395568442112] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818036040 con 0x7fb81406c040 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.078+0000 7fb82262d800 20 remove_watcher() i=3 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.078+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94395568444704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e532770 con 0x55da2e525390 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.079+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94395568444704] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb818036040 con 0x55da2e525390 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.079+0000 7fb82262d800 20 remove_watcher() i=4 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.079+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94395568446912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e534b00 con 0x55da2e529770 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.080+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94395568446912] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.080+0000 7fb82262d800 20 remove_watcher() i=5 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.080+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94395568455232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e5341e0 con 0x55da2e529770 2024-09-19T11:14:52.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.080+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94395568455232] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.081+0000 7fb82262d800 20 remove_watcher() i=6 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.081+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94395568458832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55da2e532770 con 0x55da2e529770 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.081+0000 7fb820117640 1 -- 172.21.15.102:0/3892698274 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94395568458832] v37'209 uv207 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb81001b070 con 0x55da2e529770 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.081+0000 7fb82262d800 20 remove_watcher() i=7 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e529770 msgr2=0x55da2e52bb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e529770 0x55da2e52bb60 crc :-1 s=READY pgs=146 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e525390 msgr2=0x55da2e527850 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e525390 0x55da2e527850 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb81406c040 msgr2=0x7fb81405f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb81406c040 0x7fb81405f420 crc :-1 s=READY pgs=79 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e52e3b0 msgr2=0x55da2e530870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e52e3b0 0x55da2e530870 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f003d000 msgr2=0x7fb6f003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f003d000 0x7fb6f003f4c0 secure :-1 s=READY pgs=265 cs=0 l=1 rev1=1 crypto rx=0x7fb814053570 tx=0x7fb814053000 comp rx=0 tx=0).stop 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb820918640 1 -- 172.21.15.102:0/3892698274 reap_dead start 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 msgr2=0x55da2e519eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e519eb0 secure :-1 s=READY pgs=639 cs=0 l=1 rev1=1 crypto rx=0x7fb81004be40 tx=0x7fb810048ee0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 shutdown_connections 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/3892698274 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e512aa0 0x55da2e519eb0 unknown :-1 s=CLOSED pgs=639 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 >> 172.21.15.102:0/3892698274 conn(0x55da2e50eea0 msgr2=0x55da2e50d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 shutdown_connections 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/3892698274 wait complete. 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/1950227929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f803d000 msgr2=0x7fb6f803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/1950227929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f803d000 0x7fb6f803f4c0 secure :-1 s=READY pgs=264 cs=0 l=1 rev1=1 crypto rx=0x55da2e4f0bc0 tx=0x7fb814005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/1950227929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e5063f0 msgr2=0x55da2e506810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/1950227929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e5063f0 0x55da2e506810 secure :-1 s=READY pgs=637 cs=0 l=1 rev1=1 crypto rx=0x7fb810002250 tx=0x7fb81001df10 comp rx=0 tx=0).stop 2024-09-19T11:14:52.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/1950227929 shutdown_connections 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/1950227929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6f803d000 0x7fb6f803f4c0 unknown :-1 s=CLOSED pgs=264 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 --2- 172.21.15.102:0/1950227929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e5063f0 0x55da2e506810 unknown :-1 s=CLOSED pgs=637 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/1950227929 >> 172.21.15.102:0/1950227929 conn(0x55da2e4fa7a0 msgr2=0x55da2e4fab80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/1950227929 shutdown_connections 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.082+0000 7fb82262d800 1 -- 172.21.15.102:0/1950227929 wait complete. 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e4f1ad0 msgr2=0x55da2e4f3f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55da2e4f1ad0 0x55da2e4f3f50 crc :-1 s=READY pgs=145 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e3ee860 msgr2=0x55da2e4ef6f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55da2e3ee860 0x55da2e4ef6f0 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e4f5b40 msgr2=0x55da2e4f7f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55da2e4f5b40 0x55da2e4f7f30 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.096 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb70803d000 msgr2=0x7fb70803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb70803d000 0x7fb70803f4c0 secure :-1 s=READY pgs=263 cs=0 l=1 rev1=1 crypto rx=0x7fb814057000 tx=0x7fb814052000 comp rx=0 tx=0).stop 2024-09-19T11:14:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 msgr2=0x55da2e4e80a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 --2- 172.21.15.102:0/882474200 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55da2e3ecd40 0x55da2e4e80a0 secure :-1 s=READY pgs=636 cs=0 l=1 rev1=1 crypto rx=0x7fb8100066b0 tx=0x7fb810001250 comp rx=0 tx=0).stop 2024-09-19T11:14:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb820918640 1 -- 172.21.15.102:0/882474200 reap_dead start 2024-09-19T11:14:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 shutdown_connections 2024-09-19T11:14:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 >> 172.21.15.102:0/882474200 conn(0x55da2e3e8a70 msgr2=0x55da2e4e1a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 shutdown_connections 2024-09-19T11:14:52.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.083+0000 7fb82262d800 1 -- 172.21.15.102:0/882474200 wait complete. 2024-09-19T11:14:52.098 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[{"user":"foo","buckets":[{"bucket":"","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[],"s3select":{}},{"bucket":"myfoo","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":2,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo2","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo3","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}},{"bucket":"myfoo4","time":"2024-09-19T11:00:00.000000Z","epoch":1726743600,"owner":"foo","categories":[{"category":"delete_bucket","bytes_sent":0,"bytes_received":0,"ops":1,"successful_ops":1}],"s3select":{}}]}],"summary":[{"user":"foo","categories":[{"category":"delete_bucket","bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4}],"total":{"bytes_sent":236,"bytes_received":0,"ops":5,"successful_ops":4,"bytes_processed":0,"bytes_returned":0}}]} 2024-09-19T11:14:52.098 DEBUG:tasks.util.rgw: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 2, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo2', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo3', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'myfoo4', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4}], 'total': {'bytes_sent': 236, 'bytes_received': 0, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:14:52.098 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-19T11:14:52.099 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'bar', '--display-name', 'Bar', '--access-key', 'NX5QOQKC6BH2IDN8HC7A', '--secret', 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', '--max-buckets', '4'] 2024-09-19T11:14:52.099 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid bar --display-name Bar --access-key NX5QOQKC6BH2IDN8HC7A --secret LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn --max-buckets 4 2024-09-19T11:14:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:52.151 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.151+0000 7f6b6cc0e800 1 Processor -- start 2024-09-19T11:14:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.151+0000 7f6b6cc0e800 1 -- start start 2024-09-19T11:14:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.151+0000 7f6b6cc0e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5565a57df7f0 0x5565a57e8310 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.151+0000 7f6b6cc0e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5565a57e8850 con 0x5565a57ddcd0 2024-09-19T11:14:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.151+0000 7f6b6cc0e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5565a566a7d0 con 0x5565a57df7f0 2024-09-19T11:14:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.151+0000 7f6b5ffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5565a57df7f0 0x5565a57e8310 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.151+0000 7f6b68259640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5565a57ddcd0 0x5565a57de0d0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47884/0 (socket says 172.21.15.102:47884) 2024-09-19T11:14:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.152+0000 7f6b68259640 1 -- 172.21.15.102:0/3212233250 learned_addr learned my addr 172.21.15.102:0/3212233250 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.152+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3212233250 >> v1:172.21.15.37:6789/0 conn(0x5565a57ddcd0 legacy=0x5565a57de0d0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.154 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.152+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3212233250 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a57e9a60 con 0x5565a57df7f0 2024-09-19T11:14:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3212233250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57df7f0 0x5565a57e8310 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000a470 tx=0x7f6b50045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=db717bfe01444301 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b67a58640 1 -- 172.21.15.102:0/3212233250 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50053570 con 0x5565a57df7f0 2024-09-19T11:14:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b67a58640 1 -- 172.21.15.102:0/3212233250 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b50058070 con 0x5565a57df7f0 2024-09-19T11:14:52.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b67a58640 1 -- 172.21.15.102:0/3212233250 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b50053880 con 0x5565a57df7f0 2024-09-19T11:14:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3212233250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57df7f0 msgr2=0x5565a57e8310 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3212233250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57df7f0 0x5565a57e8310 secure :-1 s=READY pgs=641 cs=0 l=1 rev1=1 crypto rx=0x7f6b5000a470 tx=0x7f6b50045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3212233250 shutdown_connections 2024-09-19T11:14:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3212233250 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57df7f0 0x5565a57e8310 unknown :-1 s=CLOSED pgs=641 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3212233250 >> 172.21.15.102:0/3212233250 conn(0x5565a57d9aa0 msgr2=0x5565a57dbf00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3212233250 shutdown_connections 2024-09-19T11:14:52.156 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.154+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3212233250 wait complete. 2024-09-19T11:14:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.168+0000 7f6b6cc0e800 1 Processor -- start 2024-09-19T11:14:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.168+0000 7f6b6cc0e800 1 -- start start 2024-09-19T11:14:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.168+0000 7f6b6cc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d1650 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.168+0000 7f6b6cc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565a5677dd0 con 0x5565a57ddcd0 2024-09-19T11:14:52.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.168+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d1650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.168+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d1650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43894/0 (socket says 172.21.15.102:43894) 2024-09-19T11:14:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.168+0000 7f6b68259640 1 -- 172.21.15.102:0/1213398602 learned_addr learned my addr 172.21.15.102:0/1213398602 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.168+0000 7f6b68259640 1 -- 172.21.15.102:0/1213398602 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a58d1c40 con 0x5565a57ddcd0 2024-09-19T11:14:52.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6b68259640 1 --2- 172.21.15.102:0/1213398602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d1650 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b58001e40 tx=0x7f6b58001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9de2e4873e89d32a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6a5660c640 1 -- 172.21.15.102:0/1213398602 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58012020 con 0x5565a57ddcd0 2024-09-19T11:14:52.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6a5660c640 1 -- 172.21.15.102:0/1213398602 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5800e5a0 con 0x5565a57ddcd0 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6a5660c640 1 -- 172.21.15.102:0/1213398602 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5800e8a0 con 0x5565a57ddcd0 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/1213398602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 msgr2=0x5565a58d1650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/1213398602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d1650 secure :-1 s=READY pgs=642 cs=0 l=1 rev1=1 crypto rx=0x7f6b58001e40 tx=0x7f6b58001e70 comp rx=0 tx=0).stop 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/1213398602 shutdown_connections 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/1213398602 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d1650 unknown :-1 s=CLOSED pgs=642 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/1213398602 >> 172.21.15.102:0/1213398602 conn(0x5565a57d9aa0 msgr2=0x5565a58ccfd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/1213398602 shutdown_connections 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.169+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/1213398602 wait complete. 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.170+0000 7f6b6cc0e800 1 Processor -- start 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.170+0000 7f6b6cc0e800 1 -- start start 2024-09-19T11:14:52.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.170+0000 7f6b6cc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d9150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.170+0000 7f6b6cc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565a57e8d20 con 0x5565a57ddcd0 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.170+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d9150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.170+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d9150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43896/0 (socket says 172.21.15.102:43896) 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.170+0000 7f6b68259640 1 -- 172.21.15.102:0/3735882513 learned_addr learned my addr 172.21.15.102:0/3735882513 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.170+0000 7f6b68259640 1 -- 172.21.15.102:0/3735882513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a58d96b0 con 0x5565a57ddcd0 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.171+0000 7f6b68259640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d9150 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6b580012b0 tx=0x7f6b58000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.171+0000 7f6a54e09640 1 -- 172.21.15.102:0/3735882513 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58012030 con 0x5565a57ddcd0 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.171+0000 7f6a54e09640 1 -- 172.21.15.102:0/3735882513 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5801a750 con 0x5565a57ddcd0 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.171+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565a58d9940 con 0x5565a57ddcd0 2024-09-19T11:14:52.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.171+0000 7f6a54e09640 1 -- 172.21.15.102:0/3735882513 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b5801aa70 con 0x5565a57ddcd0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.171+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565a58da340 con 0x5565a57ddcd0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.172+0000 7f6a54e09640 1 -- 172.21.15.102:0/3735882513 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6b58015020 con 0x5565a57ddcd0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.172+0000 7f6a54e09640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a5003cfb0 0x7f6a5003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.172+0000 7f6a54e09640 1 -- 172.21.15.102:0/3735882513 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f6b58020030 con 0x5565a57ddcd0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.172+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a57df7f0 0x5565a58e07a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.172+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a5003cfb0 0x7f6a5003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.172+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a58e0ce0 con 0x5565a57df7f0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.172+0000 7f6b68a5a640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a57df7f0 0x5565a58e07a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.173+0000 7f6b68a5a640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a57df7f0 0x5565a58e07a0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.173+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a5003cfb0 0x7f6a5003f470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b50057000 tx=0x7f6b50052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.173+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3735882513 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a57df7f0 2024-09-19T11:14:52.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.173+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a58e1080 con 0x5565a57df7f0 2024-09-19T11:14:52.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.173+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3735882513 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a57df7f0 2024-09-19T11:14:52.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.173+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a58e2b40 0x5565a58e4fe0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.173+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a58e5770 con 0x5565a58e2b40 2024-09-19T11:14:52.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.173+0000 7f6b68259640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a58e2b40 0x5565a58e4fe0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.178 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.174+0000 7f6b68259640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a58e2b40 0x5565a58e4fe0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.174+0000 7f6b68259640 1 -- 172.21.15.102:0/3735882513 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f6b58018ce0 con 0x5565a58e2b40 2024-09-19T11:14:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.174+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a58e18d0 con 0x5565a57df7f0 2024-09-19T11:14:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.174+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3735882513 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a57df7f0 2024-09-19T11:14:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.174+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a58e6bd0 0x5565a58e8fc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.174+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a58e9700 con 0x5565a58e6bd0 2024-09-19T11:14:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.174+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a58e6bd0 0x5565a58e8fc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.175+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a58e6bd0 0x5565a58e8fc0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.175+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3735882513 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f6b50051070 con 0x5565a58e6bd0 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.175+0000 7f6b6cc0e800 1 Processor -- start 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.175+0000 7f6b6cc0e800 1 -- start start 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.175+0000 7f6b6cc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a58f7440 0x5565a58f7860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.175+0000 7f6b6cc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565a56d64a0 con 0x5565a58f7440 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a58f7440 0x5565a58f7860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a58f7440 0x5565a58f7860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43908/0 (socket says 172.21.15.102:43908) 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6b68259640 1 -- 172.21.15.102:0/3449925756 learned_addr learned my addr 172.21.15.102:0/3449925756 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6b68259640 1 -- 172.21.15.102:0/3449925756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a58f7ea0 con 0x5565a58f7440 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6b68259640 1 --2- 172.21.15.102:0/3449925756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a58f7440 0x5565a58f7860 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6b58052a10 tx=0x7f6b58044c00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6a4e7fc640 1 -- 172.21.15.102:0/3449925756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58048070 con 0x5565a58f7440 2024-09-19T11:14:52.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6a4e7fc640 1 -- 172.21.15.102:0/3449925756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5804b490 con 0x5565a58f7440 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3449925756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565a58f86d0 con 0x5565a58f7440 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6a4e7fc640 1 -- 172.21.15.102:0/3449925756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58042a80 con 0x5565a58f7440 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.176+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3449925756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565a58f86d0 con 0x5565a58f7440 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.177+0000 7f6a4e7fc640 1 -- 172.21.15.102:0/3449925756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6b58042c20 con 0x5565a58f7440 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.177+0000 7f6a4e7fc640 1 --2- 172.21.15.102:0/3449925756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a4003d000 0x7f6a4003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.177+0000 7f6a4e7fc640 1 -- 172.21.15.102:0/3449925756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f6b58050040 con 0x5565a58f7440 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.177+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3449925756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a4003d000 0x7f6a4003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b6cc0e800 1 Processor -- start 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b6cc0e800 1 -- start start 2024-09-19T11:14:52.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3449925756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a4003d000 0x7f6a4003f4c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5565a58db250 tx=0x7f6b50005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b6cc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a5903ef0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b6cc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565a58d2070 con 0x5565a5903b10 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a5903ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a5903ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43910/0 (socket says 172.21.15.102:43910) 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b68259640 1 -- 172.21.15.102:0/4238138459 learned_addr learned my addr 172.21.15.102:0/4238138459 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b68259640 1 -- 172.21.15.102:0/4238138459 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a59044e0 con 0x5565a5903b10 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6b68259640 1 --2- 172.21.15.102:0/4238138459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a5903ef0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6b5804b8a0 tx=0x7f6b58024b70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f53cb23072be2135 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6a477fe640 1 -- 172.21.15.102:0/4238138459 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b580363d0 con 0x5565a5903b10 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6a477fe640 1 -- 172.21.15.102:0/4238138459 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b58036590 con 0x5565a5903b10 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.178+0000 7f6a477fe640 1 -- 172.21.15.102:0/4238138459 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58016e60 con 0x5565a5903b10 2024-09-19T11:14:52.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/4238138459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 msgr2=0x5565a5903ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/4238138459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a5903ef0 secure :-1 s=READY pgs=645 cs=0 l=1 rev1=1 crypto rx=0x7f6b5804b8a0 tx=0x7f6b58024b70 comp rx=0 tx=0).stop 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/4238138459 shutdown_connections 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/4238138459 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a5903ef0 unknown :-1 s=CLOSED pgs=645 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/4238138459 >> 172.21.15.102:0/4238138459 conn(0x5565a58fff10 msgr2=0x5565a58fe150 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/4238138459 shutdown_connections 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/4238138459 wait complete. 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 Processor -- start 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 -- start start 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a590aec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.179+0000 7f6b6cc0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5565a5904970 con 0x5565a5903b10 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a590aec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6b68259640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a590aec0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43912/0 (socket says 172.21.15.102:43912) 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 learned_addr learned my addr 172.21.15.102:0/3811813631 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5565a590b420 con 0x5565a5903b10 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6b68259640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a590aec0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6b58024fd0 tx=0x7f6b5803b610 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6a45ffb640 1 -- 172.21.15.102:0/3811813631 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58068070 con 0x5565a5903b10 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6a45ffb640 1 -- 172.21.15.102:0/3811813631 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6b5804b910 con 0x5565a5903b10 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5565a590b420 con 0x5565a5903b10 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6a45ffb640 1 -- 172.21.15.102:0/3811813631 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6b58035380 con 0x5565a5903b10 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.180+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5565a590b420 con 0x5565a5903b10 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.181+0000 7f6a45ffb640 1 -- 172.21.15.102:0/3811813631 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6b5806b070 con 0x5565a5903b10 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.181+0000 7f6a45ffb640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a3003cfb0 0x7f6a3003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.181+0000 7f6a45ffb640 1 -- 172.21.15.102:0/3811813631 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f6b5805a030 con 0x5565a5903b10 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.182+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a3003cfb0 0x7f6a3003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.182+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.182+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a5916310 0x5565a59187d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.182+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a5918f20 con 0x5565a5916310 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.182+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a3003cfb0 0x7f6a3003f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b50053570 tx=0x7f6b50053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.182+0000 7f6b68a5a640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a5916310 0x5565a59187d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.182+0000 7f6b68a5a640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a5916310 0x5565a59187d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 realm 2024-09-19T11:14:52.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919330 con 0x5565a5916310 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919c00 con 0x5565a5916310 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a591ad00 0x5565a591d0f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a591d6b0 con 0x5565a591ad00 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.183+0000 7f6b68259640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a591ad00 0x5565a591d0f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.184+0000 7f6b68259640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a591ad00 0x5565a591d0f0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.184+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.184+0000 7f6b6cc0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.184+0000 7f6b6cc0e800 20 searching for the correct realm 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.184+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a591f690 0x5565a5921b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.184+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5922220 con 0x5565a591f690 2024-09-19T11:14:52.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.184+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a591f690 0x5565a5921b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.185+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a591f690 0x5565a5921b50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.185+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.185+0000 7f6b5ffff640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b5006c040 0x7f6b5005f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.185+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5922220 con 0x7f6b5006c040 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.185+0000 7f6b68a5a640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b5006c040 0x7f6b5005f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.185+0000 7f6b68a5a640 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b5006c040 0x7f6b5005f420 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.185+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.185+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591ad00 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.186+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.186+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.186+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.186+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.186+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.186+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591ad00 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.187+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.187+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591ad00 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.187+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.187+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x7f6b5006c040 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.187+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.187+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591f690 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.187+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.187+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.188+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.188+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591ad00 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.188+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.188+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.188+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.188+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x7f6b5006c040 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.188+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.188+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591f690 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.189+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.189+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591f690 2024-09-19T11:14:52.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.189+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.189+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591ad00 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.189+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.189+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591f690 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.189+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.189+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591f690 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.190+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.190+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.190+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.190+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.190+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.190+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591ad00 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.190+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.190+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591f690 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.191+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.191+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x7f6b5006c040 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.191+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.191+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.191+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.191+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591ad00 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.191+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.191+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591f690 2024-09-19T11:14:52.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.192+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.192+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591ad00 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.192+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.192+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x7f6b5006c040 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.192+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.192+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a591f690 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.192+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.192+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x7f6b5006c040 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x5565a5916310 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5565a5919fa0 con 0x7f6b5006c040 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a591dac0 con 0x5565a5916310 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.193+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a591dac0 con 0x5565a5916310 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a591dac0 con 0x5565a591f690 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 20 zone default found 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 4 Realm: () 2024-09-19T11:14:52.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 20 zonegroup default 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a591e3d0 con 0x5565a591ad00 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.194+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a5924190 con 0x5565a591f690 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a5924670 con 0x5565a591f690 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b6cc0e800 20 started sync module instance, tier type = 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b6cc0e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.195+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5923530 con 0x7f6b5006c040 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.196+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.196+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93895057881648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5923530 con 0x7f6b5006c040 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.196+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5925150 con 0x5565a5916310 2024-09-19T11:14:52.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.197+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93895057881648] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.197+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.224 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.197+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93895057886272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5923530 con 0x5565a5916310 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.197+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5925be0 con 0x5565a591f690 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.198+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93895057886272] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.199+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.199+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93895057879168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a59234a0 con 0x5565a591f690 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.199+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5926aa0 con 0x7f6b5006c040 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.200+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93895057879168] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.200+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.200+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93895057892848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5926ec0 con 0x7f6b5006c040 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.200+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5927880 con 0x5565a5916310 2024-09-19T11:14:52.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.201+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.201+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93895057896400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a59277f0 con 0x5565a5916310 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.201+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a59287f0 con 0x5565a591ad00 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.201+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93895057892848] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.202+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.202+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93895057893904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a5928be0 con 0x5565a591ad00 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.202+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a59295a0 con 0x5565a591ad00 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.202+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93895057896400] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.203+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93895057893904] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.203+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.203+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93895057903856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a59299c0 con 0x5565a591ad00 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.203+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a592a210 con 0x5565a591ad00 2024-09-19T11:14:52.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'210 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93895057907584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a592a9d0 con 0x5565a591ad00 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 93895057903856] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b6cc0e800 20 add_watcher() i=0 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b6cc0e800 20 add_watcher() i=1 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b6cc0e800 20 add_watcher() i=2 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b6cc0e800 20 add_watcher() i=3 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b6cc0e800 20 add_watcher() i=4 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b6cc0e800 20 add_watcher() i=5 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.204+0000 7f6b6cc0e800 20 add_watcher() i=6 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.205+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93895057907584] v37'211 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.205+0000 7f6b6cc0e800 20 add_watcher() i=7 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.205+0000 7f6b6cc0e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.205+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a5927d60 con 0x5565a5916310 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.205+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.205+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93895057908832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a592b2a0 con 0x5565a5916310 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.206+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93895057908832] v37'210 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.206+0000 7f6a1e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.206+0000 7f6b6cc0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.206+0000 7f6b6cc0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.206+0000 7f6b6cc0e800 5 note: GC not initialized 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.206+0000 7f6a1d7e2640 20 reqs_thread_entry: start 2024-09-19T11:14:52.228 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 20 Filter name: none 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f698effd640 20 reqs_thread_entry: start 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a59609a0 con 0x5565a591ad00 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 bar [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x0 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : miss 2024-09-19T11:14:52.229 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.207+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a595f040 con 0x5565a5916310 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.208+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(63 NX5QOQKC6BH2IDN8HC7A [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.208+0000 7f6b6cc0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.208+0000 7f6b6cc0e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x0 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.208+0000 7f6b6cc0e800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.208+0000 7f6b6cc0e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.208+0000 7f6b6cc0e800 10 cache get: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A : hit (negative entry) 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.208+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.e 8:718f6a54:users.uid::bar:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595f930 con 0x5565a591ad00 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 bar [delete,create,call,writefull 0~380] v37'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6b6cc0e800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6b6cc0e800 10 moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-19T11:14:52.230 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6b6cc0e800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 0, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 7.9 7:93e5b521:::notify.7:head [notify cookie 93895058125952 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a5963e70 con 0x5565a591ad00 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== watch-notify(notify (1) cookie 93895057907584 notify 158913789983 ret 0) ==== 598+0+0 (crc 0 0 0) 0x5565a59602f0 con 0x5565a591ad00 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6a477fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789983 cookie 93895057907584 notifier 4736 bl.length()=556 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6a477fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bar info.flags=0x17 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6a477fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bar to cache LRU end 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6a477fe640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f6a2c003ea0 con 0x5565a591ad00 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.209+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(65 notify.7 [notify cookie 93895058125952 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.210+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(66 notify.7 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.210+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== watch-notify(notify_complete (2) cookie 93895058125952 notify 158913789983 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5565a58f7ea0 con 0x5565a591ad00 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.210+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595f480 con 0x5565a5916310 2024-09-19T11:14:52.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(67 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v37'1 uv1 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b6cc0e800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b6cc0e800 10 moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b6cc0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 93895058125952 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5565a59642c0 con 0x5565a591ad00 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== watch-notify(notify (1) cookie 93895057893904 notify 158913789984 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5565a58f7ea0 con 0x5565a591ad00 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6a46ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789984 cookie 93895057893904 notifier 4736 bl.length()=177 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6a46ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(68 notify.5 [notify cookie 93895058125952 out=8b] v0'0 uv210 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6a46ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6a46ffd640 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f699c003400 con 0x5565a591ad00 2024-09-19T11:14:52.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.211+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== watch-notify(notify_complete (2) cookie 93895058125952 notify 158913789984 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5565a58da340 con 0x5565a591ad00 2024-09-19T11:14:52.233 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"bar","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bar","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-19T11:14:52.209063Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:14:52.209053Z","tags":[],"group_ids":[]} 2024-09-19T11:14:52.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.212+0000 7f6a1e7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:52.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.212+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93895057908832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x5565a5916310 2024-09-19T11:14:52.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.213+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 93895057908832] v37'211 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.238 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.213+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93895057881648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x7f6b5006c040 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.214+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 93895057881648] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.214+0000 7f6b6cc0e800 20 remove_watcher() i=0 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.214+0000 7f6b6cc0e800 2 removed watcher, disabling cache 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.214+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93895057886272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x5565a5916310 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.215+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 93895057886272] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.215+0000 7f6b6cc0e800 20 remove_watcher() i=1 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.215+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93895057879168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x5565a591f690 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.216+0000 7f6b5ffff640 1 -- 172.21.15.102:0/3811813631 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 93895057879168] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b50051070 con 0x5565a591f690 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.216+0000 7f6b6cc0e800 20 remove_watcher() i=2 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.216+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93895057892848] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x7f6b5006c040 2024-09-19T11:14:52.239 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.217+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 93895057892848] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x7f6b5006c040 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.217+0000 7f6b6cc0e800 20 remove_watcher() i=3 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.217+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93895057896400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x5565a5916310 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.218+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 93895057896400] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b6000a4d0 con 0x5565a5916310 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.218+0000 7f6b6cc0e800 20 remove_watcher() i=4 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.218+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93895057893904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x5565a591ad00 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.220+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 93895057893904] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.220+0000 7f6b6cc0e800 20 remove_watcher() i=5 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.220+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93895057903856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x5565a591ad00 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.221+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 93895057903856] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.221+0000 7f6b6cc0e800 20 remove_watcher() i=6 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.221+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93895057907584] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5565a595e770 con 0x5565a591ad00 2024-09-19T11:14:52.240 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b68259640 1 -- 172.21.15.102:0/3811813631 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 93895057907584] v37'212 uv210 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6b58074070 con 0x5565a591ad00 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 20 remove_watcher() i=7 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a591ad00 msgr2=0x5565a591d0f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a591ad00 0x5565a591d0f0 crc :-1 s=READY pgs=148 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a5916310 msgr2=0x5565a59187d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a5916310 0x5565a59187d0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b5006c040 msgr2=0x7f6b5005f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f6b5006c040 0x7f6b5005f420 crc :-1 s=READY pgs=80 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a591f690 msgr2=0x5565a5921b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a591f690 0x5565a5921b50 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a3003cfb0 msgr2=0x7f6a3003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.241 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a3003cfb0 0x7f6a3003f470 secure :-1 s=READY pgs=268 cs=0 l=1 rev1=1 crypto rx=0x7f6b50053570 tx=0x7f6b50053000 comp rx=0 tx=0).stop 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 msgr2=0x5565a590aec0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3811813631 reap_dead start 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a590aec0 secure :-1 s=READY pgs=646 cs=0 l=1 rev1=1 crypto rx=0x7f6b58024fd0 tx=0x7f6b5803b610 comp rx=0 tx=0).stop 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 shutdown_connections 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3811813631 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a5903b10 0x5565a590aec0 unknown :-1 s=CLOSED pgs=646 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 >> 172.21.15.102:0/3811813631 conn(0x5565a58fff10 msgr2=0x5565a58fe120 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 shutdown_connections 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3811813631 wait complete. 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3449925756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a4003d000 msgr2=0x7f6a4003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3449925756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a4003d000 0x7f6a4003f4c0 secure :-1 s=READY pgs=267 cs=0 l=1 rev1=1 crypto rx=0x5565a58db250 tx=0x7f6b50005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:52.242 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3449925756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a58f7440 msgr2=0x5565a58f7860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3449925756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a58f7440 0x5565a58f7860 secure :-1 s=READY pgs=644 cs=0 l=1 rev1=1 crypto rx=0x7f6b58052a10 tx=0x7f6b58044c00 comp rx=0 tx=0).stop 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3449925756 shutdown_connections 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3449925756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a4003d000 0x7f6a4003f4c0 unknown :-1 s=CLOSED pgs=267 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3449925756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a58f7440 0x5565a58f7860 unknown :-1 s=CLOSED pgs=644 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3449925756 >> 172.21.15.102:0/3449925756 conn(0x5565a58eb7f0 msgr2=0x5565a58ebbd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3449925756 shutdown_connections 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.222+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3449925756 wait complete. 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a58e2b40 msgr2=0x5565a58e4fe0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5565a58e2b40 0x5565a58e4fe0 crc :-1 s=READY pgs=147 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a57df7f0 msgr2=0x5565a58e07a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5565a57df7f0 0x5565a58e07a0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a58e6bd0 msgr2=0x5565a58e8fc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5565a58e6bd0 0x5565a58e8fc0 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a5003cfb0 msgr2=0x7f6a5003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f6a5003cfb0 0x7f6a5003f470 secure :-1 s=READY pgs=266 cs=0 l=1 rev1=1 crypto rx=0x7f6b50057000 tx=0x7f6b50052000 comp rx=0 tx=0).stop 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 msgr2=0x5565a58d9150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 --2- 172.21.15.102:0/3735882513 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5565a57ddcd0 0x5565a58d9150 secure :-1 s=READY pgs=643 cs=0 l=1 rev1=1 crypto rx=0x7f6b580012b0 tx=0x7f6b58000ed0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b68a5a640 1 -- 172.21.15.102:0/3735882513 reap_dead start 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 shutdown_connections 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 >> 172.21.15.102:0/3735882513 conn(0x5565a57d9aa0 msgr2=0x5565a58d2b40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 shutdown_connections 2024-09-19T11:14:52.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.223+0000 7f6b6cc0e800 1 -- 172.21.15.102:0/3735882513 wait complete. 2024-09-19T11:14:52.245 DEBUG:tasks.util.rgw: json result: {'user_id': 'bar', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bar', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-19T11:14:52.209063Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:14:52.209053Z', 'tags': [], 'group_ids': []} 2024-09-19T11:14:52.268 INFO:tasks.radosgw_admin:RL: create_bucket myfoo6 bar bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:52.273 INFO:tasks.radosgw_admin:RL: put_obj myfoo6 bar bytes_out=8 bytes_in=0 failed=False 2024-09-19T11:14:52.274 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-19T11:14:52.274 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bar', '--new-uid', 'bud'] 2024-09-19T11:14:52.274 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bar --new-uid bud 2024-09-19T11:14:52.320 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:52.320 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efd089af800 1 Processor -- start 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efd089af800 1 -- start start 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efd089af800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5624bc3ffac0 0x5624bc405660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efd089af800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5624bc3fed60 con 0x5624bc3fe6b0 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efd089af800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5624bc28a7d0 con 0x5624bc3ffac0 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efcfffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5624bc3ffac0 0x5624bc405660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efd06499640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5624bc3fe6b0 0x5624bc3ff3b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47896/0 (socket says 172.21.15.102:47896) 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efcfffff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5624bc3ffac0 0x5624bc405660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43918/0 (socket says 172.21.15.102:43918) 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.320+0000 7efd06499640 1 -- 172.21.15.102:0/1393647170 learned_addr learned my addr 172.21.15.102:0/1393647170 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:52.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.321+0000 7efcfffff640 1 -- 172.21.15.102:0/1393647170 >> v1:172.21.15.37:6789/0 conn(0x5624bc3fe6b0 legacy=0x5624bc3ff3b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.321+0000 7efcfffff640 1 -- 172.21.15.102:0/1393647170 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bc3fff70 con 0x5624bc3ffac0 2024-09-19T11:14:52.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.322+0000 7efcfffff640 1 --2- 172.21.15.102:0/1393647170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3ffac0 0x5624bc405660 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efcf000a470 tx=0x7efcf0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d11ac017220ab2a0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd05c98640 1 -- 172.21.15.102:0/1393647170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf0053570 con 0x5624bc3ffac0 2024-09-19T11:14:52.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd05c98640 1 -- 172.21.15.102:0/1393647170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf0058070 con 0x5624bc3ffac0 2024-09-19T11:14:52.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd05c98640 1 -- 172.21.15.102:0/1393647170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf0053880 con 0x5624bc3ffac0 2024-09-19T11:14:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd089af800 1 -- 172.21.15.102:0/1393647170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3ffac0 msgr2=0x5624bc405660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd089af800 1 --2- 172.21.15.102:0/1393647170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3ffac0 0x5624bc405660 secure :-1 s=READY pgs=648 cs=0 l=1 rev1=1 crypto rx=0x7efcf000a470 tx=0x7efcf0045a20 comp rx=0 tx=0).stop 2024-09-19T11:14:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd089af800 1 -- 172.21.15.102:0/1393647170 shutdown_connections 2024-09-19T11:14:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd089af800 1 --2- 172.21.15.102:0/1393647170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3ffac0 0x5624bc405660 unknown :-1 s=CLOSED pgs=648 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd089af800 1 -- 172.21.15.102:0/1393647170 >> 172.21.15.102:0/1393647170 conn(0x5624bc3f9aa0 msgr2=0x5624bc3fbee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd089af800 1 -- 172.21.15.102:0/1393647170 shutdown_connections 2024-09-19T11:14:52.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.323+0000 7efd089af800 1 -- 172.21.15.102:0/1393647170 wait complete. 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd089af800 1 Processor -- start 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd089af800 1 -- start start 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd089af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc373050 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd089af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624bc297dd0 con 0x5624bc3fe6b0 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc373050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc373050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43924/0 (socket says 172.21.15.102:43924) 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd06499640 1 -- 172.21.15.102:0/865082878 learned_addr learned my addr 172.21.15.102:0/865082878 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd06499640 1 -- 172.21.15.102:0/865082878 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bc4f1f30 con 0x5624bc3fe6b0 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.337+0000 7efd06499640 1 --2- 172.21.15.102:0/865082878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc373050 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efcf8001df0 tx=0x7efcf800b6c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=65cdb665b1ce5a82 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.338+0000 7efbf4608640 1 -- 172.21.15.102:0/865082878 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8012020 con 0x5624bc3fe6b0 2024-09-19T11:14:52.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.338+0000 7efbf4608640 1 -- 172.21.15.102:0/865082878 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf800e470 con 0x5624bc3fe6b0 2024-09-19T11:14:52.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.338+0000 7efbf4608640 1 -- 172.21.15.102:0/865082878 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf800e7f0 con 0x5624bc3fe6b0 2024-09-19T11:14:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.338+0000 7efd089af800 1 -- 172.21.15.102:0/865082878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 msgr2=0x5624bc373050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.338+0000 7efd089af800 1 --2- 172.21.15.102:0/865082878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc373050 secure :-1 s=READY pgs=649 cs=0 l=1 rev1=1 crypto rx=0x7efcf8001df0 tx=0x7efcf800b6c0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 -- 172.21.15.102:0/865082878 shutdown_connections 2024-09-19T11:14:52.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 --2- 172.21.15.102:0/865082878 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc373050 unknown :-1 s=CLOSED pgs=649 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 -- 172.21.15.102:0/865082878 >> 172.21.15.102:0/865082878 conn(0x5624bc3f9aa0 msgr2=0x5624bc4e9bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 -- 172.21.15.102:0/865082878 shutdown_connections 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 -- 172.21.15.102:0/865082878 wait complete. 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 Processor -- start 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 -- start start 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc4f6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd089af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624bc405db0 con 0x5624bc3fe6b0 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc4f6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc4f6e30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43934/0 (socket says 172.21.15.102:43934) 2024-09-19T11:14:52.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.339+0000 7efd06499640 1 -- 172.21.15.102:0/2005164399 learned_addr learned my addr 172.21.15.102:0/2005164399 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.340+0000 7efd06499640 1 -- 172.21.15.102:0/2005164399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bc4f7390 con 0x5624bc3fe6b0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.340+0000 7efd06499640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc4f6e30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x5624bc372b80 tx=0x7efcf8000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.340+0000 7efbf2e05640 1 -- 172.21.15.102:0/2005164399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8012030 con 0x5624bc3fe6b0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.340+0000 7efbf2e05640 1 -- 172.21.15.102:0/2005164399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf801a6d0 con 0x5624bc3fe6b0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.340+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624bc4f7620 con 0x5624bc3fe6b0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.340+0000 7efbf2e05640 1 -- 172.21.15.102:0/2005164399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf801a9d0 con 0x5624bc3fe6b0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.340+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bc4f8020 con 0x5624bc3fe6b0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.341+0000 7efbf2e05640 1 -- 172.21.15.102:0/2005164399 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efcf8015020 con 0x5624bc3fe6b0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.341+0000 7efbf2e05640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbec03cfb0 0x7efbec03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.341+0000 7efbf2e05640 1 -- 172.21.15.102:0/2005164399 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7efcf8020030 con 0x5624bc3fe6b0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.341+0000 7efcfffff640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbec03cfb0 0x7efbec03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.341+0000 7efd089af800 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc3ffac0 0x5624bc4fe480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.341+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc4fe9c0 con 0x5624bc3ffac0 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.341+0000 7efd06c9a640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc3ffac0 0x5624bc4fe480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.342+0000 7efcfffff640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbec03cfb0 0x7efbec03f470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efcf0057000 tx=0x7efcf0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.342+0000 7efd06c9a640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc3ffac0 0x5624bc4fe480 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.342+0000 7efd06c9a640 1 -- 172.21.15.102:0/2005164399 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc3ffac0 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.342+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc4fed60 con 0x5624bc3ffac0 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.342+0000 7efd06c9a640 1 -- 172.21.15.102:0/2005164399 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc3ffac0 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.342+0000 7efd089af800 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc5008a0 0x5624bc502d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.342+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5034a0 con 0x5624bc5008a0 2024-09-19T11:14:52.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.343+0000 7efd06499640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc5008a0 0x5624bc502d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.343+0000 7efd06499640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc5008a0 0x5624bc502d10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.343+0000 7efd06499640 1 -- 172.21.15.102:0/2005164399 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7efcf801ad50 con 0x5624bc5008a0 2024-09-19T11:14:52.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.343+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc4ff5b0 con 0x5624bc3ffac0 2024-09-19T11:14:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.344+0000 7efd06c9a640 1 -- 172.21.15.102:0/2005164399 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc3ffac0 2024-09-19T11:14:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.344+0000 7efd089af800 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc504900 0x5624bc506cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.344+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5073e0 con 0x5624bc504900 2024-09-19T11:14:52.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.344+0000 7efcfffff640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc504900 0x5624bc506cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.344+0000 7efcfffff640 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc504900 0x5624bc506cf0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efcfffff640 1 -- 172.21.15.102:0/2005164399 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc504900 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efd089af800 1 Processor -- start 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efd089af800 1 -- start start 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efd089af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc515160 0x5624bc515580 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efd089af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624bc2f64a0 con 0x5624bc515160 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc515160 0x5624bc515580 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc515160 0x5624bc515580 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43938/0 (socket says 172.21.15.102:43938) 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efd06499640 1 -- 172.21.15.102:0/2634475462 learned_addr learned my addr 172.21.15.102:0/2634475462 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.345+0000 7efd06499640 1 -- 172.21.15.102:0/2634475462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bc515bc0 con 0x5624bc515160 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.346+0000 7efd06499640 1 --2- 172.21.15.102:0/2634475462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc515160 0x5624bc515580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7efcf800dfd0 tx=0x7efcf8054550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.346+0000 7efbebfff640 1 -- 172.21.15.102:0/2634475462 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8048070 con 0x5624bc515160 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.346+0000 7efbebfff640 1 -- 172.21.15.102:0/2634475462 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf800d500 con 0x5624bc515160 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.346+0000 7efd089af800 1 -- 172.21.15.102:0/2634475462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624bc5163f0 con 0x5624bc515160 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.346+0000 7efbebfff640 1 -- 172.21.15.102:0/2634475462 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8016b00 con 0x5624bc515160 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.346+0000 7efd089af800 1 -- 172.21.15.102:0/2634475462 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bc5163f0 con 0x5624bc515160 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.346+0000 7efbebfff640 1 -- 172.21.15.102:0/2634475462 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efcf8044d10 con 0x5624bc515160 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.347+0000 7efbebfff640 1 --2- 172.21.15.102:0/2634475462 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbe003d000 0x7efbe003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.347+0000 7efbebfff640 1 -- 172.21.15.102:0/2634475462 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7efcf803cff0 con 0x5624bc515160 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.347+0000 7efcfffff640 1 --2- 172.21.15.102:0/2634475462 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbe003d000 0x7efbe003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.347+0000 7efd089af800 1 Processor -- start 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.347+0000 7efd089af800 1 -- start start 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.347+0000 7efcfffff640 1 --2- 172.21.15.102:0/2634475462 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbe003d000 0x7efbe003f4c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5624bc503840 tx=0x7efcf0005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.347+0000 7efd089af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc4ef3d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.347+0000 7efd089af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624bc4f21b0 con 0x5624bc4eefd0 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.348+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc4ef3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.348+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc4ef3d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43946/0 (socket says 172.21.15.102:43946) 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.348+0000 7efd06499640 1 -- 172.21.15.102:0/709961931 learned_addr learned my addr 172.21.15.102:0/709961931 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.348+0000 7efd06499640 1 -- 172.21.15.102:0/709961931 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bc4ef910 con 0x5624bc4eefd0 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.348+0000 7efd06499640 1 --2- 172.21.15.102:0/709961931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc4ef3d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7efcf803b2f0 tx=0x7efcf8016570 comp rx=0 tx=0).ready entity=mon.0 client_cookie=320b01f5992fe818 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.348+0000 7efbe9ffb640 1 -- 172.21.15.102:0/709961931 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8058070 con 0x5624bc4eefd0 2024-09-19T11:14:52.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.348+0000 7efbe9ffb640 1 -- 172.21.15.102:0/709961931 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf8022e70 con 0x5624bc4eefd0 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.348+0000 7efbe9ffb640 1 -- 172.21.15.102:0/709961931 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf80447c0 con 0x5624bc4eefd0 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 -- 172.21.15.102:0/709961931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 msgr2=0x5624bc4ef3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 --2- 172.21.15.102:0/709961931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc4ef3d0 secure :-1 s=READY pgs=652 cs=0 l=1 rev1=1 crypto rx=0x7efcf803b2f0 tx=0x7efcf8016570 comp rx=0 tx=0).stop 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 -- 172.21.15.102:0/709961931 shutdown_connections 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 --2- 172.21.15.102:0/709961931 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc4ef3d0 unknown :-1 s=CLOSED pgs=652 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 -- 172.21.15.102:0/709961931 >> 172.21.15.102:0/709961931 conn(0x5624bc51dc30 msgr2=0x5624bc51be70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 -- 172.21.15.102:0/709961931 shutdown_connections 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 -- 172.21.15.102:0/709961931 wait complete. 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 Processor -- start 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 -- start start 2024-09-19T11:14:52.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc52ae30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd089af800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624bc4edd10 con 0x5624bc4eefd0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc52ae30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd06499640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc52ae30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43960/0 (socket says 172.21.15.102:43960) 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 learned_addr learned my addr 172.21.15.102:0/1806970778 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.349+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624bc52b390 con 0x5624bc4eefd0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.350+0000 7efd06499640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc52ae30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7efcf80165b0 tx=0x7efcf803b250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.350+0000 7efbd7fff640 1 -- 172.21.15.102:0/1806970778 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8070070 con 0x5624bc4eefd0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.350+0000 7efbd7fff640 1 -- 172.21.15.102:0/1806970778 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7efcf80245e0 con 0x5624bc4eefd0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.350+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624bc52b390 con 0x5624bc4eefd0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.350+0000 7efbd7fff640 1 -- 172.21.15.102:0/1806970778 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7efcf8022af0 con 0x5624bc4eefd0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.350+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624bc52b390 con 0x5624bc4eefd0 2024-09-19T11:14:52.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.351+0000 7efbd7fff640 1 -- 172.21.15.102:0/1806970778 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7efcf8073070 con 0x5624bc4eefd0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.351+0000 7efbd7fff640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbd003cfb0 0x7efbd003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.351+0000 7efbd7fff640 1 -- 172.21.15.102:0/1806970778 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7efcf805c020 con 0x5624bc4eefd0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.351+0000 7efcfffff640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbd003cfb0 0x7efbd003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efcfffff640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbd003cfb0 0x7efbd003f470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efcf00539f0 tx=0x7efcf0053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc5363b0 0x5624bc538870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc538fc0 con 0x5624bc5363b0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd06c9a640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc5363b0 0x5624bc538870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd06c9a640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc5363b0 0x5624bc538870 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd089af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd089af800 20 realm 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.352+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5393d0 con 0x5624bc5363b0 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc539ca0 con 0x5624bc5363b0 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc53ada0 0x5624bc53d190 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53d7e0 con 0x5624bc53ada0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.353+0000 7efd06499640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc53ada0 0x5624bc53d190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.354+0000 7efd06499640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc53ada0 0x5624bc53d190 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.354+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.354+0000 7efd089af800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.354+0000 7efd089af800 20 searching for the correct realm 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.354+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc53f7b0 0x5624bc541c70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.354+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5422f0 con 0x5624bc53f7b0 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.354+0000 7efcfffff640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc53f7b0 0x5624bc541c70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.354+0000 7efcfffff640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc53f7b0 0x5624bc541c70 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.355+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.355+0000 7efcfffff640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efcf006c040 0x7efcf005f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.355+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5422f0 con 0x7efcf006c040 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.355+0000 7efd06c9a640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efcf006c040 0x7efcf005f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.355+0000 7efd06c9a640 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efcf006c040 0x7efcf005f420 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:52.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.355+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.355+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53ada0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.356+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.356+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.356+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.356+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.356+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.356+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53ada0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.357+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.357+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53ada0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.357+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.357+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x7efcf006c040 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.357+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.357+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53f7b0 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.357+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.357+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53ada0 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x7efcf006c040 2024-09-19T11:14:52.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53f7b0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.358+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53f7b0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.359+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.359+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53ada0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.359+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.359+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53f7b0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.359+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.359+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53f7b0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.359+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.359+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.360+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.360+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.360+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.360+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53ada0 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.360+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.360+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53f7b0 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.360+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.360+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x7efcf006c040 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.361+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.361+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.361+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.361+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53ada0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.361+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.361+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53f7b0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.361+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.361+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53ada0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.362+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.362+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x7efcf006c040 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.362+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.362+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc53f7b0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.362+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.362+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x7efcf006c040 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x5624bc5363b0 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53a040 con 0x7efcf006c040 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:52.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53e0a0 con 0x5624bc5363b0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.363+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53e0a0 con 0x5624bc5363b0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53e0a0 con 0x5624bc53f7b0 2024-09-19T11:14:52.383 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 zone default found 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 4 Realm: () 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 zonegroup default 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc53e9b0 con 0x5624bc53ada0 2024-09-19T11:14:52.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc544260 con 0x5624bc53f7b0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.364+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5446c0 con 0x5624bc53f7b0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.365+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.365+0000 7efd089af800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:52.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.365+0000 7efd089af800 20 started sync module instance, tier type = 2024-09-19T11:14:52.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.365+0000 7efd089af800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:52.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.365+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc543600 con 0x7efcf006c040 2024-09-19T11:14:52.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.366+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.366+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94715778448208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc543600 con 0x7efcf006c040 2024-09-19T11:14:52.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.366+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5451e0 con 0x5624bc5363b0 2024-09-19T11:14:52.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.367+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94715778448208] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.367+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.367+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94715778452672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc543600 con 0x5624bc5363b0 2024-09-19T11:14:52.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.367+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc545c80 con 0x5624bc53f7b0 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.368+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94715778452672] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.368+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.368+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94715778455408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc546020 con 0x5624bc53f7b0 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.368+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc546a60 con 0x7efcf006c040 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.369+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94715778455408] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.369+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.369+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94715778458928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc546e50 con 0x7efcf006c040 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.369+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc547850 con 0x5624bc5363b0 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.370+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.370+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94715778462560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5477c0 con 0x5624bc5363b0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.370+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc548820 con 0x5624bc53ada0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.370+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94715778458928] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.371+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.371+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94715778466576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc548c10 con 0x5624bc53ada0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.371+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc549610 con 0x5624bc53ada0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.371+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94715778462560] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.373+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(56 notify.6 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.373+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94715778464832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc549e60 con 0x5624bc53ada0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.373+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc54a820 con 0x5624bc53ada0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.373+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94715778466576] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94715778464832] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'213 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94715778472368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc549dd0 con 0x5624bc53ada0 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd089af800 20 add_watcher() i=0 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd089af800 20 add_watcher() i=1 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd089af800 20 add_watcher() i=2 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd089af800 20 add_watcher() i=3 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd089af800 20 add_watcher() i=4 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd089af800 20 add_watcher() i=5 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.374+0000 7efd089af800 20 add_watcher() i=6 2024-09-19T11:14:52.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.375+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94715778472368] v37'214 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.375+0000 7efd089af800 20 add_watcher() i=7 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.375+0000 7efd089af800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.375+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc54d850 con 0x5624bc5363b0 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.375+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.375+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94715778474864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc54ac40 con 0x5624bc5363b0 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.376+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94715778474864] v37'212 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.376+0000 7efbbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.376+0000 7efd089af800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:52.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.376+0000 7efd089af800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.377+0000 7efd089af800 5 note: GC not initialized 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.377+0000 7efb377fe640 20 reqs_thread_entry: start 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.377+0000 7efd089af800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.377+0000 7efd089af800 20 Filter name: none 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.377+0000 7efb357fa640 20 reqs_thread_entry: start 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.377+0000 7efd089af800 10 cache get: name=default.rgw.meta+users.uid+bar : miss 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.377+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.377+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.e 8:718f6a54:users.uid::bar:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc580520 con 0x5624bc53ada0 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.378+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 bar [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.378+0000 7efd089af800 20 rados_obj.operate() r=0 bl.length=380 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.378+0000 7efd089af800 10 cache put: name=default.rgw.meta+users.uid+bar info.flags=0x13 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.378+0000 7efd089af800 10 adding default.rgw.meta+users.uid+bar to cache LRU end 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.378+0000 7efd089af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.378+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:63 8.4 8:267425a8:users.uid::bud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5846b0 con 0x7efcf006c040 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.379+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(63 bud [create,call,writefull 0~206] v37'1 uv1 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7efd0000a4d0 con 0x7efcf006c040 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.379+0000 7efd089af800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.379+0000 7efd089af800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.379+0000 7efd089af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-19T11:14:52.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.379+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 7.3 7:c609908c:::notify.5:head [notify cookie 94715778707648 in=394b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc585320 con 0x5624bc53ada0 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== watch-notify(notify (1) cookie 94715778466576 notify 158913789985 ret 0) ==== 424+0+0 (crc 0 0 0) 0x5624bc515bc0 con 0x5624bc53ada0 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efbe9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789985 cookie 94715778466576 notifier 4743 bl.length()=382 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(64 notify.5 [notify cookie 94715778707648 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efbe9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efbe9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efbe9ffb640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7efbcc003ea0 con 0x5624bc53ada0 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(65 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== watch-notify(notify_complete (2) cookie 94715778707648 notify 158913789985 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efcf804f040 con 0x5624bc53ada0 2024-09-19T11:14:52.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 8.5 8:a00000ee:users.uid::bar.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc5851e0 con 0x5624bc5363b0 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(66 bar.buckets [call out=184b] v0'0 uv5 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7efd0000a4d0 con 0x5624bc5363b0 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efd089af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 : miss 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.380+0000 7efd089af800 20 rados->read ofs=0 len=0 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 8.11 8:88b9681c:root::.bucket.meta.myfoo6%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc582830 con 0x5624bc53f7b0 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 .bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 333+0+670 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efd089af800 20 rados_obj.operate() r=0 bl.length=388 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efd089af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 info.flags=0x17 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efd089af800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 to cache LRU end 2024-09-19T11:14:52.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efd089af800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efd089af800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efd089af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.381+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 8.11 8:88b9681c:root::.bucket.meta.myfoo6%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58c390 con 0x5624bc53f7b0 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 .bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v37'2 uv2 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efd089af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 info.flags=0x17 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efd089af800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 to cache LRU end 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efd089af800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efd089af800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9, ofs0, ns] 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify cookie 94715778707120 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc5363b0 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== watch-notify(notify (1) cookie 94715778452672 notify 158913789977 ret 0) ==== 798+0+0 (crc 0 0 0) 0x7efd00018990 con 0x5624bc5363b0 2024-09-19T11:14:52.411 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efbe9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789977 cookie 94715778452672 notifier 4743 bl.length()=756 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(69 notify.1 [notify cookie 94715778707120 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efbe9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 info.flags=0x17 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efbe9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 to cache LRU end 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efbe9ffb640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.382+0000 7efbe9ffb640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7efbcc003ea0 con 0x5624bc5363b0 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.383+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(70 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.383+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== watch-notify(notify_complete (2) cookie 94715778707120 notify 158913789977 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efd00018c30 con 0x5624bc5363b0 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.383+0000 7efd089af800 20 handle_bi_update(): bucket=:myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]): orig_sources= new_sources= 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.383+0000 7efd089af800 20 handle_bi_update(): bucket=:myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]): potential sources added=[] removed=[] 2024-09-19T11:14:52.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.383+0000 7efd089af800 20 handle_bi_update(): bucket=:myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]): orig_dests= new_dests= 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.383+0000 7efd089af800 20 handle_bi_update(): bucket=:myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]): potential dests added=[] removed=[] 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.383+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc582eb0 con 0x5624bc5363b0 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.384+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(71 bud.buckets [call] v37'3 uv0 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.384+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58ac20 con 0x5624bc5363b0 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.385+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(72 bud.buckets [call] v37'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.385+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:73 8.18 8:1944a257:root::myfoo6:head [delete,create,call version.inc in=38b,writefull 0~166 in=166b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc582eb0 con 0x5624bc5363b0 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(73 myfoo6 [delete,create,call,writefull 0~166] v37'17 uv17 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd089af800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-19T11:14:52.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd089af800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd089af800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 0, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [notify cookie 94715778707120 in=328b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc585970 con 0x7efcf006c040 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== watch-notify(notify (1) cookie 94715778458928 notify 158913789967 ret 0) ==== 358+0+0 (crc 0 0 0) 0x5624bc589790 con 0x7efcf006c040 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efbe9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789967 cookie 94715778458928 notifier 4743 bl.length()=316 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efbe9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x7 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efbe9ffb640 10 rgw watcher librados: moving default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(74 notify.3 [notify cookie 94715778707120 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd00040040 con 0x7efcf006c040 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efbe9ffb640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:75 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7efbcc003ea0 con 0x7efcf006c040 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(75 notify.3 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd00040040 con 0x7efcf006c040 2024-09-19T11:14:52.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.386+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== watch-notify(notify_complete (2) cookie 94715778707120 notify 158913789967 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efd00018c30 con 0x7efcf006c040 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.387+0000 7efd089af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 : hit (requested=0x17, cached=0x17) 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.387+0000 7efd089af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.387+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:76 8.11 8:88b9681c:root::.bucket.meta.myfoo6%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9:head [delete,create,call version.check_conds in=122b,call version.inc in=38b,writefull 0~388 in=388b,setxattr user.rgw.acl (117) in=129b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc588e50 con 0x5624bc53f7b0 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(76 .bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 [delete,create,call,call,writefull 0~388,setxattr (117)] v37'3 uv3 ondisk = 0) ==== 417+0+0 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 info.flags=0x17 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 10 moving default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 to cache LRU end 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:root:.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9, ofs0, ns] 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:77 7.0 7:05bf5b68:::notify.1:head [notify cookie 94715778739232 in=768b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc585e20 con 0x5624bc5363b0 2024-09-19T11:14:52.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== watch-notify(notify (1) cookie 94715778452672 notify 158913789978 ret 0) ==== 798+0+0 (crc 0 0 0) 0x7efd00018c30 con 0x5624bc5363b0 2024-09-19T11:14:52.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(77 notify.1 [notify cookie 94715778739232 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efbe97fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789978 cookie 94715778452672 notifier 4743 bl.length()=756 2024-09-19T11:14:52.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efbe97fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 info.flags=0x17 2024-09-19T11:14:52.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efbe97fa640 10 rgw watcher librados: moving default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 to cache LRU end 2024-09-19T11:14:52.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efbe97fa640 10 rgw watcher librados: updating xattr: name=user.rgw.acl bl.length()=117 2024-09-19T11:14:52.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efbe97fa640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:78 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7efb3c003470 con 0x5624bc5363b0 2024-09-19T11:14:52.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== watch-notify(notify_complete (2) cookie 94715778739232 notify 158913789978 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7efd000455e0 con 0x5624bc5363b0 2024-09-19T11:14:52.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(78 notify.1 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 20 handle_bi_update(): bucket=:myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]): orig_sources= new_sources= 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 20 handle_bi_update(): bucket=:myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]): potential sources added=[] removed=[] 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 20 handle_bi_update(): bucket=:myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]): orig_dests= new_dests= 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 20 handle_bi_update(): bucket=:myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]): potential dests added=[] removed=[] 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.388+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:79 4.2d 4:b6369089:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc53ada0 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.389+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(79 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.389+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 4.2 4:40af0dd5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc5363b0 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.389+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(80 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.389+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:81 4.3f 4:fd2c31d3:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x7efcf006c040 2024-09-19T11:14:52.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.390+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(81 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efd00040040 con 0x7efcf006c040 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.390+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:82 4.24 4:244b1786:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc53ada0 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.390+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(82 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.390+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:83 4.8 4:11528f1f:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc53f7b0 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.390+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(83 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.390+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:84 4.2c 4:35996e74:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc5363b0 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.391+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(84 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.391+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:85 4.b 4:d2b2f9ef:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x7efcf006c040 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.391+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(85 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efd00040040 con 0x7efcf006c040 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.391+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:86 4.36 4:6d3f32a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc5363b0 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.391+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(86 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.418 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.392+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:87 4.1 4:83d6e09b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x7efcf006c040 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.392+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(87 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7efd00040040 con 0x7efcf006c040 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.392+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:88 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc5363b0 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.392+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(88 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [call out=380b] v0'0 uv3 ondisk = 0) ==== 194+0+380 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.392+0000 7efd089af800 10 cls_bucket_list_unordered: got thirteen 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.392+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:89 4.21 4:85a49708:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58b0d0 con 0x5624bc53ada0 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.392+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(89 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 get_obj_state: octx=0x7efd0000ab40 obj=myfoo6:thirteen state=0x5624bc58b748 s->prefetch_data=0 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 3.38s0 3:1e16eee6:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc583360 con 0x5624bc53ada0 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(90 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9_thirteen [call out=24b,getxattrs out=852b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 280+0+892 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 10 manifest: total_size = 8 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 get_obj_state: setting s->obj_tag to 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.680553366957104967 2024-09-19T11:14:52.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 Read xattr rgw_rados: user.rgw.acl 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 Read xattr rgw_rados: user.rgw.content_type 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 Read xattr rgw_rados: user.rgw.etag 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 Read xattr rgw_rados: user.rgw.idtag 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 Read xattr rgw_rados: user.rgw.manifest 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 Read xattr rgw_rados: user.rgw.pg_ver 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 Read xattr rgw_rados: user.rgw.source_zone 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 Read xattr rgw_rados: user.rgw.tail_tag 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 get_obj_state: octx=0x7efd0000ab40 obj=myfoo6:thirteen state=0x5624bc58b748 s->prefetch_data=0 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 : hit (requested=0x17, cached=0x17) 2024-09-19T11:14:52.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.393+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:91 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58fa60 con 0x5624bc5363b0 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.394+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(91 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [stat,call,call] v37'4 uv4 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.394+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 3.38s0 3:1e16eee6:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9_thirteen:head [cmpxattr user.rgw.idtag (61) op 1 mode 1 in=75b,setxattr user.rgw.acl (117) in=129b,setxattr user.rgw.idtag (33) in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58def0 con 0x5624bc53ada0 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.397+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(92 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9_thirteen [cmpxattr (61) op 1 mode 1,setxattr (117),setxattr (33)] v37'2 uv2 ondisk = 0) ==== 280+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.397+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:93 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=323b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58de80 con 0x5624bc5363b0 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:1 objects processed in :myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9]). Next marker thirteen 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.397+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58de80 con 0x7efcf006c040 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.399+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(93 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [stat,call,call] v37'5 uv5 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.399+0000 7efbe97fa640 20 handle_completion(): completion ok for obj=thirteen 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(94 bud [delete,create,call,writefull 0~380] v37'2 uv2 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7efd00040040 con 0x7efcf006c040 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efd089af800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efd089af800 10 moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efd089af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:95 7.3 7:c609908c:::notify.5:head [notify cookie 94715778739232 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58de80 con 0x5624bc53ada0 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== watch-notify(notify (1) cookie 94715778466576 notify 158913789986 ret 0) ==== 598+0+0 (crc 0 0 0) 0x7efcf804f040 con 0x5624bc53ada0 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efbe9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789986 cookie 94715778466576 notifier 4743 bl.length()=556 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efbe9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+bud info.flags=0x17 2024-09-19T11:14:52.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(95 notify.5 [notify cookie 94715778739232 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efbe9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+bud to cache LRU end 2024-09-19T11:14:52.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.400+0000 7efbe9ffb640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:96 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7efbcc003ea0 con 0x5624bc53ada0 2024-09-19T11:14:52.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.401+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(96 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.401+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== watch-notify(notify_complete (2) cookie 94715778739232 notify 158913789986 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5624bc4f8020 con 0x5624bc53ada0 2024-09-19T11:14:52.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.401+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:97 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58de80 con 0x5624bc5363b0 2024-09-19T11:14:52.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(97 NX5QOQKC6BH2IDN8HC7A [delete,create,writefull 0~7] v37'2 uv2 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efd089af800 10 cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-19T11:14:52.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efd089af800 10 adding default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T11:14:52.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efd089af800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-19T11:14:52.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify cookie 94715778752128 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc584cc0 con 0x5624bc53ada0 2024-09-19T11:14:52.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== watch-notify(notify (1) cookie 94715778466576 notify 158913789987 ret 0) ==== 219+0+0 (crc 0 0 0) 0x5624bc4f8020 con 0x5624bc53ada0 2024-09-19T11:14:52.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efbe9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789987 cookie 94715778466576 notifier 4743 bl.length()=177 2024-09-19T11:14:52.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efbe9ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A info.flags=0x7 2024-09-19T11:14:52.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efbe9ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+NX5QOQKC6BH2IDN8HC7A to cache LRU end 2024-09-19T11:14:52.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(98 notify.5 [notify cookie 94715778752128 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efbe9ffb640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:99 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7efbcc003ea0 con 0x5624bc53ada0 2024-09-19T11:14:52.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.402+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(99 notify.5 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.403+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== watch-notify(notify_complete (2) cookie 94715778752128 notify 158913789987 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5624bc4f7620 con 0x5624bc53ada0 2024-09-19T11:14:52.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.403+0000 7efd089af800 10 removing user index: bar 2024-09-19T11:14:52.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.403+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 8.e 8:718f6a54:users.uid::bar:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc58de80 con 0x5624bc53ada0 2024-09-19T11:14:52.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.404+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(100 bar [delete] v37'4 uv4 ondisk = 0) ==== 147+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.404+0000 7efd089af800 10 removing default.rgw.meta+users.uid+bar from cache 2024-09-19T11:14:52.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.404+0000 7efd089af800 10 distributing notification oid=default.rgw.control:notify.7 cni=[op: 1, obj: default.rgw.meta:users.uid:bar, ofs0, ns] 2024-09-19T11:14:52.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.404+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:101 7.9 7:93e5b521:::notify.7:head [notify cookie 94715778752128 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624bc584cc0 con 0x5624bc53ada0 2024-09-19T11:14:52.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.404+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== watch-notify(notify (1) cookie 94715778472368 notify 158913789988 ret 0) ==== 194+0+0 (crc 0 0 0) 0x5624bc4f7620 con 0x5624bc53ada0 2024-09-19T11:14:52.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.404+0000 7efbe9ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789988 cookie 94715778472368 notifier 4743 bl.length()=152 2024-09-19T11:14:52.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.404+0000 7efbe9ffb640 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:102 7.9 7:93e5b521:::notify.7:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7efbcc003ea0 con 0x5624bc53ada0 2024-09-19T11:14:52.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.404+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== osd_op_reply(101 notify.7 [notify cookie 94715778752128 out=8b] v0'0 uv213 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.405+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== watch-notify(notify_complete (2) cookie 94715778752128 notify 158913789988 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5624bc4f7390 con 0x5624bc53ada0 2024-09-19T11:14:52.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.405+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(102 notify.7 [notify-ack] v0'0 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.429 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"bud","display_name":"Bar","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"bud","access_key":"NX5QOQKC6BH2IDN8HC7A","secret_key":"LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn","active":true,"create_date":"2024-09-19T11:14:52.209063Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:14:52.209053Z","tags":[],"group_ids":[]} 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.405+0000 7efbbcfe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.405+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94715778474864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x5624bc5363b0 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.406+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94715778474864] v37'213 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.406+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94715778448208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x7efcf006c040 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.407+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94715778448208] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd00040040 con 0x7efcf006c040 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.407+0000 7efd089af800 20 remove_watcher() i=0 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.407+0000 7efd089af800 2 removed watcher, disabling cache 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.407+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94715778452672] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x5624bc5363b0 2024-09-19T11:14:52.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.409+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94715778452672] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.409+0000 7efd089af800 20 remove_watcher() i=1 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.409+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94715778455408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x5624bc53f7b0 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.410+0000 7efcfffff640 1 -- 172.21.15.102:0/1806970778 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94715778455408] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf0051070 con 0x5624bc53f7b0 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.410+0000 7efd089af800 20 remove_watcher() i=2 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.410+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94715778458928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x7efcf006c040 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.411+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94715778458928] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd00040040 con 0x7efcf006c040 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.411+0000 7efd089af800 20 remove_watcher() i=3 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.411+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94715778462560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x5624bc5363b0 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.412+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94715778462560] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efd00040040 con 0x5624bc5363b0 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.412+0000 7efd089af800 20 remove_watcher() i=4 2024-09-19T11:14:52.436 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.412+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94715778466576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x5624bc53ada0 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.413+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94715778466576] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.413+0000 7efd089af800 20 remove_watcher() i=5 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.413+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94715778464832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x5624bc53ada0 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.414+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 41 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94715778464832] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.414+0000 7efd089af800 20 remove_watcher() i=6 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.414+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94715778472368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624bc57e380 con 0x5624bc53ada0 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd06499640 1 -- 172.21.15.102:0/1806970778 <== osd.0 v2:172.21.15.37:6800/394652614 42 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94715778472368] v37'215 uv213 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7efcf8072030 con 0x5624bc53ada0 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 20 remove_watcher() i=7 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc53ada0 msgr2=0x5624bc53d190 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc53ada0 0x5624bc53d190 crc :-1 s=READY pgs=150 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc5363b0 msgr2=0x5624bc538870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc5363b0 0x5624bc538870 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efcf006c040 msgr2=0x7efcf005f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7efcf006c040 0x7efcf005f420 crc :-1 s=READY pgs=81 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc53f7b0 msgr2=0x5624bc541c70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc53f7b0 0x5624bc541c70 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbd003cfb0 msgr2=0x7efbd003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbd003cfb0 0x7efbd003f470 secure :-1 s=READY pgs=271 cs=0 l=1 rev1=1 crypto rx=0x7efcf00539f0 tx=0x7efcf0053000 comp rx=0 tx=0).stop 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 msgr2=0x5624bc52ae30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/1806970778 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc4eefd0 0x5624bc52ae30 secure :-1 s=READY pgs=653 cs=0 l=1 rev1=1 crypto rx=0x7efcf80165b0 tx=0x7efcf803b250 comp rx=0 tx=0).stop 2024-09-19T11:14:52.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 reap_dead start 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd06c9a640 1 -- 172.21.15.102:0/1806970778 reap_dead start 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 shutdown_connections 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 >> 172.21.15.102:0/1806970778 conn(0x5624bc51dc30 msgr2=0x5624bc51be40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 shutdown_connections 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/1806970778 wait complete. 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/2634475462 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbe003d000 msgr2=0x7efbe003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/2634475462 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbe003d000 0x7efbe003f4c0 secure :-1 s=READY pgs=270 cs=0 l=1 rev1=1 crypto rx=0x5624bc503840 tx=0x7efcf0005a00 comp rx=0 tx=0).stop 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/2634475462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc515160 msgr2=0x5624bc515580 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/2634475462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc515160 0x5624bc515580 secure :-1 s=READY pgs=651 cs=0 l=1 rev1=1 crypto rx=0x7efcf800dfd0 tx=0x7efcf8054550 comp rx=0 tx=0).stop 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/2634475462 shutdown_connections 2024-09-19T11:14:52.439 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/2634475462 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbe003d000 0x7efbe003f4c0 unknown :-1 s=CLOSED pgs=270 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 --2- 172.21.15.102:0/2634475462 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc515160 0x5624bc515580 unknown :-1 s=CLOSED pgs=651 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.415+0000 7efd089af800 1 -- 172.21.15.102:0/2634475462 >> 172.21.15.102:0/2634475462 conn(0x5624bc509510 msgr2=0x5624bc5098f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2634475462 shutdown_connections 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2634475462 wait complete. 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc5008a0 msgr2=0x5624bc502d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624bc5008a0 0x5624bc502d10 crc :-1 s=READY pgs=149 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc3ffac0 msgr2=0x5624bc4fe480 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624bc3ffac0 0x5624bc4fe480 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc504900 msgr2=0x5624bc506cf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624bc504900 0x5624bc506cf0 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbec03cfb0 msgr2=0x7efbec03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7efbec03cfb0 0x7efbec03f470 secure :-1 s=READY pgs=269 cs=0 l=1 rev1=1 crypto rx=0x7efcf0057000 tx=0x7efcf0052000 comp rx=0 tx=0).stop 2024-09-19T11:14:52.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 msgr2=0x5624bc4f6e30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:52.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 --2- 172.21.15.102:0/2005164399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624bc3fe6b0 0x5624bc4f6e30 secure :-1 s=READY pgs=650 cs=0 l=1 rev1=1 crypto rx=0x5624bc372b80 tx=0x7efcf8000bc0 comp rx=0 tx=0).stop 2024-09-19T11:14:52.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd06c9a640 1 -- 172.21.15.102:0/2005164399 reap_dead start 2024-09-19T11:14:52.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 shutdown_connections 2024-09-19T11:14:52.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 >> 172.21.15.102:0/2005164399 conn(0x5624bc3f9aa0 msgr2=0x5624bc4e83a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:52.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 shutdown_connections 2024-09-19T11:14:52.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:52.416+0000 7efd089af800 1 -- 172.21.15.102:0/2005164399 wait complete. 2024-09-19T11:14:52.441 DEBUG:tasks.util.rgw: json result: {'user_id': 'bud', 'display_name': 'Bar', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'bud', 'access_key': 'NX5QOQKC6BH2IDN8HC7A', 'secret_key': 'LnEsqNNqZIpkzauboDcLXLcYaWwLQ3Kop0zAnKIn', 'active': True, 'create_date': '2024-09-19T11:14:52.209063Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:14:52.209053Z', 'tags': [], 'group_ids': []} 2024-09-19T11:14:57.451 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:57.452 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-19T11:14:57.452 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-19T11:14:57.452 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'fud', '--display-name', 'Fud', '--access-key', 'p5YnriCv1nAtykxBrupQ', '--secret', 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', '--max-buckets', '4'] 2024-09-19T11:14:57.452 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid fud --display-name Fud --access-key p5YnriCv1nAtykxBrupQ --secret Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh --max-buckets 4 2024-09-19T11:14:57.511 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:57.511 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:57.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff077731800 1 Processor -- start 2024-09-19T11:14:57.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff077731800 1 -- start start 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff077731800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ee66b1cba0 0x55ee66b22740 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff077731800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ee66b1bf80 con 0x55ee66b1b8d0 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff077731800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55ee669a67d0 con 0x55ee66b1cba0 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff072b98640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ee66b1cba0 0x55ee66b22740 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff072b98640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ee66b1cba0 0x55ee66b22740 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43962/0 (socket says 172.21.15.102:43962) 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff072b98640 1 -- 172.21.15.102:0/1466711693 learned_addr learned my addr 172.21.15.102:0/1466711693 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.511+0000 7ff073399640 1 --1- 172.21.15.102:0/1466711693 >> v1:172.21.15.37:6789/0 conn(0x55ee66b1b8d0 0x55ee66b1c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47906/0 (socket says 172.21.15.102:47906) 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.512+0000 7ff072b98640 1 -- 172.21.15.102:0/1466711693 >> v1:172.21.15.37:6789/0 conn(0x55ee66b1b8d0 legacy=0x55ee66b1c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.512+0000 7ff072b98640 1 -- 172.21.15.102:0/1466711693 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee66b1d050 con 0x55ee66b1cba0 2024-09-19T11:14:57.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff072b98640 1 --2- 172.21.15.102:0/1466711693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1cba0 0x55ee66b22740 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff06800a520 tx=0x7ff068045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0f0fb86d6613aa7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff072397640 1 -- 172.21.15.102:0/1466711693 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff068055070 con 0x55ee66b1cba0 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff072397640 1 -- 172.21.15.102:0/1466711693 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff0680515b0 con 0x55ee66b1cba0 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff072397640 1 -- 172.21.15.102:0/1466711693 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0680518d0 con 0x55ee66b1cba0 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff077731800 1 -- 172.21.15.102:0/1466711693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1cba0 msgr2=0x55ee66b22740 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff077731800 1 --2- 172.21.15.102:0/1466711693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1cba0 0x55ee66b22740 secure :-1 s=READY pgs=655 cs=0 l=1 rev1=1 crypto rx=0x7ff06800a520 tx=0x7ff068045ba0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff077731800 1 -- 172.21.15.102:0/1466711693 shutdown_connections 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff077731800 1 --2- 172.21.15.102:0/1466711693 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1cba0 0x55ee66b22740 unknown :-1 s=CLOSED pgs=655 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff077731800 1 -- 172.21.15.102:0/1466711693 >> 172.21.15.102:0/1466711693 conn(0x55ee66b16ca0 msgr2=0x55ee66b19100 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff077731800 1 -- 172.21.15.102:0/1466711693 shutdown_connections 2024-09-19T11:14:57.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.514+0000 7ff077731800 1 -- 172.21.15.102:0/1466711693 wait complete. 2024-09-19T11:14:57.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.530+0000 7ff077731800 1 Processor -- start 2024-09-19T11:14:57.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.530+0000 7ff077731800 1 -- start start 2024-09-19T11:14:57.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.530+0000 7ff077731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66c0b3e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.530+0000 7ff077731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee669b3dd0 con 0x55ee66b1b8d0 2024-09-19T11:14:57.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.530+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66c0b3e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.530+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66c0b3e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43964/0 (socket says 172.21.15.102:43964) 2024-09-19T11:14:57.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.530+0000 7ff073399640 1 -- 172.21.15.102:0/1790489343 learned_addr learned my addr 172.21.15.102:0/1790489343 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.530+0000 7ff073399640 1 -- 172.21.15.102:0/1790489343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee66c0b9d0 con 0x55ee66b1b8d0 2024-09-19T11:14:57.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.531+0000 7ff073399640 1 --2- 172.21.15.102:0/1790489343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66c0b3e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff06400b260 tx=0x7ff06400b660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ccead770e8247c59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.531+0000 7fef6160a640 1 -- 172.21.15.102:0/1790489343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06400be60 con 0x55ee66b1b8d0 2024-09-19T11:14:57.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.531+0000 7fef6160a640 1 -- 172.21.15.102:0/1790489343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff064006070 con 0x55ee66b1b8d0 2024-09-19T11:14:57.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.531+0000 7fef6160a640 1 -- 172.21.15.102:0/1790489343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06400e710 con 0x55ee66b1b8d0 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 -- 172.21.15.102:0/1790489343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 msgr2=0x55ee66c0b3e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 --2- 172.21.15.102:0/1790489343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66c0b3e0 secure :-1 s=READY pgs=656 cs=0 l=1 rev1=1 crypto rx=0x7ff06400b260 tx=0x7ff06400b660 comp rx=0 tx=0).stop 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 -- 172.21.15.102:0/1790489343 shutdown_connections 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 --2- 172.21.15.102:0/1790489343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66c0b3e0 unknown :-1 s=CLOSED pgs=656 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 -- 172.21.15.102:0/1790489343 >> 172.21.15.102:0/1790489343 conn(0x55ee66b16ca0 msgr2=0x55ee66c06d60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 -- 172.21.15.102:0/1790489343 shutdown_connections 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 -- 172.21.15.102:0/1790489343 wait complete. 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 Processor -- start 2024-09-19T11:14:57.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.532+0000 7ff077731800 1 -- start start 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.533+0000 7ff077731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66a91150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.533+0000 7ff077731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee66b22e90 con 0x55ee66b1b8d0 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.533+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66a91150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.533+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66a91150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43972/0 (socket says 172.21.15.102:43972) 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.533+0000 7ff073399640 1 -- 172.21.15.102:0/3628037185 learned_addr learned my addr 172.21.15.102:0/3628037185 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.533+0000 7ff073399640 1 -- 172.21.15.102:0/3628037185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee66a916b0 con 0x55ee66b1b8d0 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.533+0000 7ff073399640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66a91150 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x55ee66c0c370 tx=0x7ff064000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.533+0000 7fef5fe07640 1 -- 172.21.15.102:0/3628037185 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06400ee10 con 0x55ee66b1b8d0 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.534+0000 7fef5fe07640 1 -- 172.21.15.102:0/3628037185 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06400fa30 con 0x55ee66b1b8d0 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.534+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee66a8fa60 con 0x55ee66b1b8d0 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.534+0000 7fef5fe07640 1 -- 172.21.15.102:0/3628037185 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06400fd30 con 0x55ee66b1b8d0 2024-09-19T11:14:57.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.534+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee66a90020 con 0x55ee66b1b8d0 2024-09-19T11:14:57.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.535+0000 7fef5fe07640 1 -- 172.21.15.102:0/3628037185 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff064017070 con 0x55ee66b1b8d0 2024-09-19T11:14:57.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.535+0000 7fef5fe07640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803d000 0x7fef5803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.535+0000 7fef5fe07640 1 -- 172.21.15.102:0/3628037185 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff064015020 con 0x55ee66b1b8d0 2024-09-19T11:14:57.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.535+0000 7ff072b98640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803d000 0x7fef5803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.535+0000 7ff077731800 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66b1cba0 0x55ee66c1c450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.539 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.535+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c1c990 con 0x55ee66b1cba0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.535+0000 7ff073b9a640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66b1cba0 0x55ee66c1c450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.535+0000 7ff072b98640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803d000 0x7fef5803f4c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff068057000 tx=0x7ff068052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.536+0000 7ff073b9a640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66b1cba0 0x55ee66c1c450 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.536+0000 7ff073b9a640 1 -- 172.21.15.102:0/3628037185 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66b1cba0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.536+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66a90520 con 0x55ee66b1cba0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.536+0000 7ff073b9a640 1 -- 172.21.15.102:0/3628037185 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66b1cba0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.536+0000 7ff077731800 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c1ece0 0x55ee66c210d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.536+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c217a0 con 0x55ee66c1ece0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.536+0000 7ff073399640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c1ece0 0x55ee66c210d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.537+0000 7ff073399640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c1ece0 0x55ee66c210d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.537+0000 7ff073399640 1 -- 172.21.15.102:0/3628037185 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff06402e070 con 0x55ee66c1ece0 2024-09-19T11:14:57.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.537+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c1db80 con 0x55ee66b1cba0 2024-09-19T11:14:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.538+0000 7ff073b9a640 1 -- 172.21.15.102:0/3628037185 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66b1cba0 2024-09-19T11:14:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.538+0000 7ff077731800 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c22be0 0x55ee66c24fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.538+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c25710 con 0x55ee66c22be0 2024-09-19T11:14:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.538+0000 7ff072b98640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c22be0 0x55ee66c24fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.538+0000 7ff072b98640 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c22be0 0x55ee66c24fd0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.538+0000 7ff072b98640 1 -- 172.21.15.102:0/3628037185 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c22be0 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.539+0000 7ff077731800 1 Processor -- start 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.539+0000 7ff077731800 1 -- start start 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.539+0000 7ff077731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c33490 0x55ee66c338b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.539+0000 7ff077731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee66a124a0 con 0x55ee66c33490 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.539+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c33490 0x55ee66c338b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.539+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c33490 0x55ee66c338b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43974/0 (socket says 172.21.15.102:43974) 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.539+0000 7ff073399640 1 -- 172.21.15.102:0/3904660253 learned_addr learned my addr 172.21.15.102:0/3904660253 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.540+0000 7ff073399640 1 -- 172.21.15.102:0/3904660253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee66c33ef0 con 0x55ee66c33490 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.540+0000 7ff073399640 1 --2- 172.21.15.102:0/3904660253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c33490 0x55ee66c338b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff064017ca0 tx=0x7ff064017910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.540+0000 7fef5d602640 1 -- 172.21.15.102:0/3904660253 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff064035020 con 0x55ee66c33490 2024-09-19T11:14:57.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.540+0000 7fef5d602640 1 -- 172.21.15.102:0/3904660253 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06401b500 con 0x55ee66c33490 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.540+0000 7fef5d602640 1 -- 172.21.15.102:0/3904660253 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff06404a020 con 0x55ee66c33490 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.540+0000 7ff077731800 1 -- 172.21.15.102:0/3904660253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee66c34720 con 0x55ee66c33490 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.540+0000 7ff077731800 1 -- 172.21.15.102:0/3904660253 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee66c34cc0 con 0x55ee66c33490 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.541+0000 7fef5d602640 1 -- 172.21.15.102:0/3904660253 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff06401a480 con 0x55ee66c33490 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.541+0000 7fef5d602640 1 --2- 172.21.15.102:0/3904660253 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef4c03d000 0x7fef4c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.541+0000 7fef5d602640 1 -- 172.21.15.102:0/3904660253 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff064043880 con 0x55ee66c33490 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.541+0000 7ff072b98640 1 --2- 172.21.15.102:0/3904660253 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef4c03d000 0x7fef4c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.541+0000 7ff077731800 1 Processor -- start 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.541+0000 7ff072b98640 1 --2- 172.21.15.102:0/3904660253 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef4c03d000 0x7fef4c03f4c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55ee66c1ce60 tx=0x7ff068005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7ff077731800 1 -- start start 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7ff077731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c40150 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7ff077731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee66c0be00 con 0x55ee66c3fd50 2024-09-19T11:14:57.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c40150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c40150 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43986/0 (socket says 172.21.15.102:43986) 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7ff073399640 1 -- 172.21.15.102:0/994158422 learned_addr learned my addr 172.21.15.102:0/994158422 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7ff073399640 1 -- 172.21.15.102:0/994158422 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee66c40740 con 0x55ee66c3fd50 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7ff073399640 1 --2- 172.21.15.102:0/994158422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c40150 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff064041b50 tx=0x7ff064027d30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9281c50c415abcf0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7fef56ffd640 1 -- 172.21.15.102:0/994158422 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0640279b0 con 0x55ee66c3fd50 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7fef56ffd640 1 -- 172.21.15.102:0/994158422 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff06404c530 con 0x55ee66c3fd50 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.542+0000 7fef56ffd640 1 -- 172.21.15.102:0/994158422 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff064045070 con 0x55ee66c3fd50 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 -- 172.21.15.102:0/994158422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 msgr2=0x55ee66c40150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 --2- 172.21.15.102:0/994158422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c40150 secure :-1 s=READY pgs=659 cs=0 l=1 rev1=1 crypto rx=0x7ff064041b50 tx=0x7ff064027d30 comp rx=0 tx=0).stop 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 -- 172.21.15.102:0/994158422 shutdown_connections 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 --2- 172.21.15.102:0/994158422 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c40150 unknown :-1 s=CLOSED pgs=659 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 -- 172.21.15.102:0/994158422 >> 172.21.15.102:0/994158422 conn(0x55ee66c3c150 msgr2=0x55ee66c3a390 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 -- 172.21.15.102:0/994158422 shutdown_connections 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 -- 172.21.15.102:0/994158422 wait complete. 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 Processor -- start 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 -- start start 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c47170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.543+0000 7ff077731800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ee66c40bb0 con 0x55ee66c3fd50 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.544+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c47170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.544+0000 7ff073399640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c47170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:43994/0 (socket says 172.21.15.102:43994) 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.544+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 learned_addr learned my addr 172.21.15.102:0/551914399 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.544+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ee66c476d0 con 0x55ee66c3fd50 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.544+0000 7ff073399640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c47170 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff06401ab60 tx=0x7ff064041ae0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.544+0000 7fef557fa640 1 -- 172.21.15.102:0/551914399 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff0640279b0 con 0x55ee66c3fd50 2024-09-19T11:14:57.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.544+0000 7fef557fa640 1 -- 172.21.15.102:0/551914399 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff064043ad0 con 0x55ee66c3fd50 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.545+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ee66c476d0 con 0x55ee66c3fd50 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.545+0000 7fef557fa640 1 -- 172.21.15.102:0/551914399 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff064043df0 con 0x55ee66c3fd50 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.545+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ee66c476d0 con 0x55ee66c3fd50 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.545+0000 7fef557fa640 1 -- 172.21.15.102:0/551914399 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff06403aa90 con 0x55ee66c3fd50 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.546+0000 7fef557fa640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef3c03d000 0x7fef3c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.546+0000 7fef557fa640 1 -- 172.21.15.102:0/551914399 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff064068030 con 0x55ee66c3fd50 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.546+0000 7ff072b98640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef3c03d000 0x7fef3c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.546+0000 7ff072b98640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef3c03d000 0x7fef3c03f4c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff068000c00 tx=0x7ff06806d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.546+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.546+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66c52690 0x55ee66c54b50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.546+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c552a0 con 0x55ee66c52690 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.546+0000 7ff073b9a640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66c52690 0x55ee66c54b50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff073b9a640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66c52690 0x55ee66c54b50 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 20 realm 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c556b0 con 0x55ee66c52690 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c55f80 con 0x55ee66c52690 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.547+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.548+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.548+0000 7ff077731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.548+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.548+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c57080 0x55ee66c59470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.548+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c59a30 con 0x55ee66c57080 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.548+0000 7ff073399640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c57080 0x55ee66c59470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.548+0000 7ff073399640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c57080 0x55ee66c59470 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.549+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.549+0000 7ff077731800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:57.557 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.549+0000 7ff077731800 20 searching for the correct realm 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.549+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c5b9e0 0x55ee66c5dea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.549+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5e570 con 0x55ee66c5b9e0 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.549+0000 7ff072b98640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c5b9e0 0x55ee66c5dea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.549+0000 7ff072b98640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c5b9e0 0x55ee66c5dea0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.549+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.550+0000 7ff072b98640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff068069040 0x7ff06806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.550+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5e570 con 0x7ff068069040 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.550+0000 7ff073b9a640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff068069040 0x7ff06806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.558 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.550+0000 7ff073b9a640 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff068069040 0x7ff06806a940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.550+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.550+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c57080 2024-09-19T11:14:57.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.551+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.551+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.568 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.551+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.551+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.551+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.551+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c57080 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.551+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.551+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c57080 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.552+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.552+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x7ff068069040 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.552+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.552+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c5b9e0 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.552+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.569 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.552+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.552+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.552+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c57080 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.553+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.553+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.553+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.553+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x7ff068069040 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.553+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.553+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c5b9e0 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.554+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.554+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c5b9e0 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.554+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.570 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.554+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c57080 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.554+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.554+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c5b9e0 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.554+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.554+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c5b9e0 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.555+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.555+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.555+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.555+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.555+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.555+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c57080 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.555+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.555+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c5b9e0 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.556+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.556+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x7ff068069040 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.556+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.556+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.556+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.556+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c57080 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.557+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.557+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c5b9e0 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.557+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.557+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c57080 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.557+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.557+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x7ff068069040 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.557+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.557+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c5b9e0 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x7ff068069040 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x55ee66c52690 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c56320 con 0x7ff068069040 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff077731800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff077731800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:57.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff077731800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff077731800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff077731800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff077731800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.558+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5a2f0 con 0x55ee66c52690 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5a2f0 con 0x55ee66c52690 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5a2f0 con 0x55ee66c5b9e0 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 20 zone default found 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 4 Realm: () 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 20 zonegroup default 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.559+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5ac40 con 0x55ee66c57080 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c60570 con 0x55ee66c5b9e0 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c60a20 con 0x55ee66c5b9e0 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 20 started sync module instance, tier type = 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.560+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5f880 con 0x7ff068069040 2024-09-19T11:14:57.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.561+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.561+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94482414828960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5f880 con 0x7ff068069040 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.561+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c614a0 con 0x55ee66c52690 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.562+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94482414828960] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.563+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.563+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94482414834128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c5f880 con 0x55ee66c52690 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.563+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c61eb0 con 0x55ee66c5b9e0 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.564+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.564+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94482414836224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c62750 con 0x55ee66c5b9e0 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.564+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94482414834128] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.564+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c631c0 con 0x7ff068069040 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.565+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.566+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94482414836224] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.566+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94482414840976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c635e0 con 0x7ff068069040 2024-09-19T11:14:57.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.566+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c63fe0 con 0x55ee66c52690 2024-09-19T11:14:57.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.567+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94482414840976] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.567+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.567+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94482414826448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c63af0 con 0x55ee66c52690 2024-09-19T11:14:57.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.567+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c64880 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.568+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94482414826448] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.568+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.568+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94482414846928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c63af0 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.568+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c65240 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.569+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94482414846928] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.570+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.570+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94482414838432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c65b10 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.570+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c664d0 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94482414838432] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'216 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94482414854176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c668f0 con 0x55ee66c57080 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff077731800 20 add_watcher() i=0 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff077731800 20 add_watcher() i=1 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff077731800 20 add_watcher() i=2 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff077731800 20 add_watcher() i=3 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff077731800 20 add_watcher() i=4 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff077731800 20 add_watcher() i=5 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.571+0000 7ff077731800 20 add_watcher() i=6 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.572+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94482414854176] v37'217 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.572+0000 7ff077731800 20 add_watcher() i=7 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.572+0000 7ff077731800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.572+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c69b80 con 0x55ee66c52690 2024-09-19T11:14:57.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.572+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.572+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94482414855600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c66e80 con 0x55ee66c52690 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.573+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94482414855600] v37'214 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.573+0000 7fef29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.573+0000 7ff077731800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.573+0000 7ff077731800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.573+0000 7ff077731800 5 note: GC not initialized 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.574+0000 7fef28fe1640 20 reqs_thread_entry: start 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.574+0000 7ff077731800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.574+0000 7ff077731800 20 Filter name: none 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.574+0000 7feea27fc640 20 reqs_thread_entry: start 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.574+0000 7ff077731800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.574+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.586 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.574+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9cb30 con 0x55ee66c57080 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.574+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 fud [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x0 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : miss 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9b1d0 con 0x55ee66c57080 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 p5YnriCv1nAtykxBrupQ [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x0 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 10 adding default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-19T11:14:57.587 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 10 cache get: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ : hit (negative entry) 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.575+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.e 8:75f48285:users.uid::fud:head [delete,create,call version.set in=58b,writefull 0~380 in=380b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9bac0 con 0x55ee66c57080 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.576+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(64 fud [delete,create,call,writefull 0~380] v37'5 uv5 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.576+0000 7ff077731800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.576+0000 7ff077731800 10 moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.576+0000 7ff077731800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.576+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:65 7.3 7:c609908c:::notify.5:head [notify cookie 94482415072784 in=568b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9ffc0 con 0x55ee66c57080 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== watch-notify(notify (1) cookie 94482414846928 notify 158913789989 ret 0) ==== 598+0+0 (crc 0 0 0) 0x55ee66c9c480 con 0x55ee66c57080 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7fef56ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789989 cookie 94482414846928 notifier 4750 bl.length()=556 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7fef56ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+fud info.flags=0x17 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7fef56ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(65 notify.5 [notify cookie 94482415072784 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7fef56ffd640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:66 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fef38003ea0 con 0x55ee66c57080 2024-09-19T11:14:57.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(66 notify.5 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== watch-notify(notify_complete (2) cookie 94482415072784 notify 158913789989 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ee66c33ef0 con 0x55ee66c57080 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.577+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:67 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9ba50 con 0x55ee66c57080 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(67 p5YnriCv1nAtykxBrupQ [delete,create,writefull 0~7] v37'9 uv9 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff077731800 10 cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff077731800 10 moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff077731800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94482415072672 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9ffc0 con 0x55ee66c5b9e0 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== watch-notify(notify (1) cookie 94482414836224 notify 158913789958 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55ee66b1d050 con 0x55ee66c5b9e0 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7fef567fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789958 cookie 94482414836224 notifier 4750 bl.length()=177 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7fef567fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ info.flags=0x7 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7fef567fc640 10 rgw watcher librados: moving default.rgw.meta+users.keys+p5YnriCv1nAtykxBrupQ to cache LRU end 2024-09-19T11:14:57.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7fef567fc640 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7feea8003400 con 0x55ee66c5b9e0 2024-09-19T11:14:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 notify.2 [notify cookie 94482415072672 out=8b] v0'0 uv216 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.579+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== watch-notify(notify_complete (2) cookie 94482415072672 notify 158913789958 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ff06805bc50 con 0x55ee66c5b9e0 2024-09-19T11:14:57.590 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"fud","display_name":"Fud","email":"","suspended":0,"max_buckets":4,"subusers":[],"keys":[{"user":"fud","access_key":"p5YnriCv1nAtykxBrupQ","secret_key":"Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh","active":true,"create_date":"2024-09-19T11:14:57.576432Z"}],"swift_keys":[],"caps":[],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:14:57.576410Z","tags":[],"group_ids":[]} 2024-09-19T11:14:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.580+0000 7fef29fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.580+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94482414855600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x55ee66c52690 2024-09-19T11:14:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.581+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94482414855600] v37'215 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.581+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94482414828960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x7ff068069040 2024-09-19T11:14:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.582+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94482414828960] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.582+0000 7ff077731800 20 remove_watcher() i=0 2024-09-19T11:14:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.582+0000 7ff077731800 2 removed watcher, disabling cache 2024-09-19T11:14:57.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.582+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94482414834128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x55ee66c52690 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.583+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94482414834128] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.583+0000 7ff077731800 20 remove_watcher() i=1 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.583+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94482414836224] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x55ee66c5b9e0 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.584+0000 7ff072b98640 1 -- 172.21.15.102:0/551914399 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94482414836224] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff068057030 con 0x55ee66c5b9e0 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.584+0000 7ff077731800 20 remove_watcher() i=2 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.584+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94482414840976] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x7ff068069040 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.585+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94482414840976] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x7ff068069040 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.585+0000 7ff077731800 20 remove_watcher() i=3 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.585+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94482414826448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x55ee66c52690 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.587+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94482414826448] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff06c00a4d0 con 0x55ee66c52690 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.587+0000 7ff077731800 20 remove_watcher() i=4 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.587+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94482414846928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x55ee66c57080 2024-09-19T11:14:57.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.588+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94482414846928] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.588+0000 7ff077731800 20 remove_watcher() i=5 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.588+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94482414838432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x55ee66c57080 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.589+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94482414838432] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.589+0000 7ff077731800 20 remove_watcher() i=6 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.589+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94482414854176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ee66c9a920 con 0x55ee66c57080 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff073399640 1 -- 172.21.15.102:0/551914399 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94482414854176] v37'218 uv216 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ff064037020 con 0x55ee66c57080 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 20 remove_watcher() i=7 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c57080 msgr2=0x55ee66c59470 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c57080 0x55ee66c59470 crc :-1 s=READY pgs=152 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66c52690 msgr2=0x55ee66c54b50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66c52690 0x55ee66c54b50 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff068069040 msgr2=0x7ff06806a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ff068069040 0x7ff06806a940 crc :-1 s=READY pgs=82 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c5b9e0 msgr2=0x55ee66c5dea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c5b9e0 0x55ee66c5dea0 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef3c03d000 msgr2=0x7fef3c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef3c03d000 0x7fef3c03f4c0 secure :-1 s=READY pgs=274 cs=0 l=1 rev1=1 crypto rx=0x7ff068000c00 tx=0x7ff06806d040 comp rx=0 tx=0).stop 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 msgr2=0x55ee66c47170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/551914399 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c3fd50 0x55ee66c47170 secure :-1 s=READY pgs=660 cs=0 l=1 rev1=1 crypto rx=0x7ff06401ab60 tx=0x7ff064041ae0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 reap_dead start 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff073b9a640 1 -- 172.21.15.102:0/551914399 reap_dead start 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 shutdown_connections 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 >> 172.21.15.102:0/551914399 conn(0x55ee66c3c150 msgr2=0x55ee66c3a360 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 shutdown_connections 2024-09-19T11:14:57.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/551914399 wait complete. 2024-09-19T11:14:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/3904660253 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef4c03d000 msgr2=0x7fef4c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/3904660253 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef4c03d000 0x7fef4c03f4c0 secure :-1 s=READY pgs=273 cs=0 l=1 rev1=1 crypto rx=0x55ee66c1ce60 tx=0x7ff068005ac0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/3904660253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c33490 msgr2=0x55ee66c338b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/3904660253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c33490 0x55ee66c338b0 secure :-1 s=READY pgs=658 cs=0 l=1 rev1=1 crypto rx=0x7ff064017ca0 tx=0x7ff064017910 comp rx=0 tx=0).stop 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/3904660253 shutdown_connections 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/3904660253 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef4c03d000 0x7fef4c03f4c0 unknown :-1 s=CLOSED pgs=273 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 --2- 172.21.15.102:0/3904660253 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66c33490 0x55ee66c338b0 unknown :-1 s=CLOSED pgs=658 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.590+0000 7ff077731800 1 -- 172.21.15.102:0/3904660253 >> 172.21.15.102:0/3904660253 conn(0x55ee66c27840 msgr2=0x55ee66c27c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3904660253 shutdown_connections 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3904660253 wait complete. 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c1ece0 msgr2=0x55ee66c210d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ee66c1ece0 0x55ee66c210d0 crc :-1 s=READY pgs=151 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66b1cba0 msgr2=0x55ee66c1c450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ee66b1cba0 0x55ee66c1c450 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c22be0 msgr2=0x55ee66c24fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ee66c22be0 0x55ee66c24fd0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803d000 msgr2=0x7fef5803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fef5803d000 0x7fef5803f4c0 secure :-1 s=READY pgs=272 cs=0 l=1 rev1=1 crypto rx=0x7ff068057000 tx=0x7ff068052000 comp rx=0 tx=0).stop 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 msgr2=0x55ee66a91150 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 --2- 172.21.15.102:0/3628037185 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ee66b1b8d0 0x55ee66a91150 secure :-1 s=READY pgs=657 cs=0 l=1 rev1=1 crypto rx=0x55ee66c0c370 tx=0x7ff064000ed0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff073b9a640 1 -- 172.21.15.102:0/3628037185 reap_dead start 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 shutdown_connections 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 >> 172.21.15.102:0/3628037185 conn(0x55ee66b16ca0 msgr2=0x55ee66c0c8d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 shutdown_connections 2024-09-19T11:14:57.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.591+0000 7ff077731800 1 -- 172.21.15.102:0/3628037185 wait complete. 2024-09-19T11:14:57.602 DEBUG:tasks.util.rgw: json result: {'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True, 'create_date': '2024-09-19T11:14:57.576432Z'}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:14:57.576410Z', 'tags': [], 'group_ids': []} 2024-09-19T11:14:57.623 INFO:tasks.radosgw_admin:RL: create_bucket myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:57.629 INFO:tasks.radosgw_admin:RL: put_obj myfoo7 fud bytes_out=8 bytes_in=0 failed=False 2024-09-19T11:14:57.630 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-19T11:14:57.630 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rename', '--uid', 'bud', '--new-uid', 'fud'] 2024-09-19T11:14:57.630 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rename --uid bud --new-uid fud 2024-09-19T11:14:57.676 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:57.676 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48f9012800 1 Processor -- start 2024-09-19T11:14:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48f9012800 1 -- start start 2024-09-19T11:14:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48f9012800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55f9cb91d6a0 0x55f9cb91e3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48f9012800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55f9cb91dd50 con 0x55f9cb91e8e0 2024-09-19T11:14:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48f9012800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55f9cb7a97d0 con 0x55f9cb91d6a0 2024-09-19T11:14:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48f46cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55f9cb91d6a0 0x55f9cb91e3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48f46cb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55f9cb91d6a0 0x55f9cb91e3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44004/0 (socket says 172.21.15.102:44004) 2024-09-19T11:14:57.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48f46cb640 1 -- 172.21.15.102:0/3141779771 learned_addr learned my addr 172.21.15.102:0/3141779771 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.676+0000 7f48ebeca640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55f9cb91e8e0 0x55f9cb923640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47914/0 (socket says 172.21.15.102:47914) 2024-09-19T11:14:57.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.677+0000 7f48f46cb640 1 -- 172.21.15.102:0/3141779771 >> v1:172.21.15.37:6789/0 conn(0x55f9cb91e8e0 legacy=0x55f9cb923640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.677+0000 7f48f46cb640 1 -- 172.21.15.102:0/3141779771 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cb91ed90 con 0x55f9cb91d6a0 2024-09-19T11:14:57.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.678+0000 7f48f46cb640 1 --2- 172.21.15.102:0/3141779771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cb91e3a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f48e400a6b0 tx=0x7f48e4047e30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=779d39ba87fee259 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f3eca640 1 -- 172.21.15.102:0/3141779771 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e400a200 con 0x55f9cb91d6a0 2024-09-19T11:14:57.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f3eca640 1 -- 172.21.15.102:0/3141779771 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e400a3a0 con 0x55f9cb91d6a0 2024-09-19T11:14:57.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f3eca640 1 -- 172.21.15.102:0/3141779771 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e4008700 con 0x55f9cb91d6a0 2024-09-19T11:14:57.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f9012800 1 -- 172.21.15.102:0/3141779771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 msgr2=0x55f9cb91e3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f9012800 1 --2- 172.21.15.102:0/3141779771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cb91e3a0 secure :-1 s=READY pgs=662 cs=0 l=1 rev1=1 crypto rx=0x7f48e400a6b0 tx=0x7f48e4047e30 comp rx=0 tx=0).stop 2024-09-19T11:14:57.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f9012800 1 -- 172.21.15.102:0/3141779771 shutdown_connections 2024-09-19T11:14:57.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f9012800 1 --2- 172.21.15.102:0/3141779771 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cb91e3a0 unknown :-1 s=CLOSED pgs=662 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f9012800 1 -- 172.21.15.102:0/3141779771 >> 172.21.15.102:0/3141779771 conn(0x55f9cb918a70 msgr2=0x55f9cb91aed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f9012800 1 -- 172.21.15.102:0/3141779771 shutdown_connections 2024-09-19T11:14:57.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.679+0000 7f48f9012800 1 -- 172.21.15.102:0/3141779771 wait complete. 2024-09-19T11:14:57.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.693+0000 7f48f9012800 1 Processor -- start 2024-09-19T11:14:57.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.693+0000 7f48f9012800 1 -- start start 2024-09-19T11:14:57.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.693+0000 7f48f9012800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba104d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.693+0000 7f48f9012800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9cb7b6dd0 con 0x55f9cb91d6a0 2024-09-19T11:14:57.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.693+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba104d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.693+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba104d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44018/0 (socket says 172.21.15.102:44018) 2024-09-19T11:14:57.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.693+0000 7f48f46cb640 1 -- 172.21.15.102:0/2775983469 learned_addr learned my addr 172.21.15.102:0/2775983469 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.694+0000 7f48f46cb640 1 -- 172.21.15.102:0/2775983469 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cba10ac0 con 0x55f9cb91d6a0 2024-09-19T11:14:57.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.694+0000 7f48f46cb640 1 --2- 172.21.15.102:0/2775983469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba104d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f48e4048360 tx=0x7f48e4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b69eda159386d33a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.694+0000 7f47e260c640 1 -- 172.21.15.102:0/2775983469 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e4064070 con 0x55f9cb91d6a0 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.694+0000 7f47e260c640 1 -- 172.21.15.102:0/2775983469 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e404f4c0 con 0x55f9cb91d6a0 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.694+0000 7f47e260c640 1 -- 172.21.15.102:0/2775983469 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e400a200 con 0x55f9cb91d6a0 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 -- 172.21.15.102:0/2775983469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 msgr2=0x55f9cba104d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 --2- 172.21.15.102:0/2775983469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba104d0 secure :-1 s=READY pgs=663 cs=0 l=1 rev1=1 crypto rx=0x7f48e4048360 tx=0x7f48e4051000 comp rx=0 tx=0).stop 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 -- 172.21.15.102:0/2775983469 shutdown_connections 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 --2- 172.21.15.102:0/2775983469 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba104d0 unknown :-1 s=CLOSED pgs=663 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 -- 172.21.15.102:0/2775983469 >> 172.21.15.102:0/2775983469 conn(0x55f9cb918a70 msgr2=0x55f9cba07a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 -- 172.21.15.102:0/2775983469 shutdown_connections 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 -- 172.21.15.102:0/2775983469 wait complete. 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 Processor -- start 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 -- start start 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba17f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f9012800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9cb890ec0 con 0x55f9cb91d6a0 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.695+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba17f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba17f10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44028/0 (socket says 172.21.15.102:44028) 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f48f46cb640 1 -- 172.21.15.102:0/2652174665 learned_addr learned my addr 172.21.15.102:0/2652174665 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f48f46cb640 1 -- 172.21.15.102:0/2652174665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cba18470 con 0x55f9cb91d6a0 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f48f46cb640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba17f10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f48e40054e0 tx=0x7f48e4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f47e0e09640 1 -- 172.21.15.102:0/2652174665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e406c030 con 0x55f9cb91d6a0 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f47e0e09640 1 -- 172.21.15.102:0/2652174665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e404f940 con 0x55f9cb91d6a0 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9cba18700 con 0x55f9cb91d6a0 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f47e0e09640 1 -- 172.21.15.102:0/2652174665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e4064040 con 0x55f9cb91d6a0 2024-09-19T11:14:57.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.696+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cba19310 con 0x55f9cb91d6a0 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.697+0000 7f47e0e09640 1 -- 172.21.15.102:0/2652174665 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f48e406f070 con 0x55f9cb91d6a0 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.697+0000 7f47e0e09640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47dc03cfb0 0x7f47dc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.697+0000 7f47e0e09640 1 -- 172.21.15.102:0/2652174665 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f48e406d070 con 0x55f9cb91d6a0 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.697+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47dc03cfb0 0x7f47dc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.697+0000 7f48f9012800 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cb91e8e0 0x55f9cba1f560 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.697+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba1faa0 con 0x55f9cb91e8e0 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.698+0000 7f48f4ecc640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cb91e8e0 0x55f9cba1f560 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.698+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47dc03cfb0 0x7f47dc03f470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f48dc001e30 tx=0x7f48dc001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.708 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.698+0000 7f48f4ecc640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cb91e8e0 0x55f9cba1f560 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.698+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2652174665 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cb91e8e0 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.698+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba1fe40 con 0x55f9cb91e8e0 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.699+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2652174665 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cb91e8e0 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.699+0000 7f48f9012800 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba21900 0x55f9cba23d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.699+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba24510 con 0x55f9cba21900 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.699+0000 7f48f46cb640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba21900 0x55f9cba23d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.699+0000 7f48f46cb640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba21900 0x55f9cba23d80 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.699+0000 7f48f46cb640 1 -- 172.21.15.102:0/2652174665 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f48e4007b40 con 0x55f9cba21900 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.699+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba20690 con 0x55f9cb91e8e0 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.700+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2652174665 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cb91e8e0 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.700+0000 7f48f9012800 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba25970 0x55f9cba27d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.700+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba284a0 con 0x55f9cba25970 2024-09-19T11:14:57.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.700+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba25970 0x55f9cba27d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.700+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba25970 0x55f9cba27d60 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.700+0000 7f48ebeca640 1 -- 172.21.15.102:0/2652174665 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f48dc00bd50 con 0x55f9cba25970 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f9012800 1 Processor -- start 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f9012800 1 -- start start 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f9012800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba361e0 0x55f9cba36600 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f9012800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9cb8154a0 con 0x55f9cba361e0 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba361e0 0x55f9cba36600 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba361e0 0x55f9cba36600 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44030/0 (socket says 172.21.15.102:44030) 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f46cb640 1 -- 172.21.15.102:0/4242551643 learned_addr learned my addr 172.21.15.102:0/4242551643 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f46cb640 1 -- 172.21.15.102:0/4242551643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cba36c40 con 0x55f9cba361e0 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.701+0000 7f48f46cb640 1 --2- 172.21.15.102:0/4242551643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba361e0 0x55f9cba36600 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f48e40951d0 tx=0x7f48e40078a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.702+0000 7f47d9ffb640 1 -- 172.21.15.102:0/4242551643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e407f070 con 0x55f9cba361e0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.702+0000 7f47d9ffb640 1 -- 172.21.15.102:0/4242551643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e4056920 con 0x55f9cba361e0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.702+0000 7f48f9012800 1 -- 172.21.15.102:0/4242551643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9cba37470 con 0x55f9cba361e0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.702+0000 7f47d9ffb640 1 -- 172.21.15.102:0/4242551643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e40705c0 con 0x55f9cba361e0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.702+0000 7f48f9012800 1 -- 172.21.15.102:0/4242551643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cba37a10 con 0x55f9cba361e0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.702+0000 7f47d9ffb640 1 -- 172.21.15.102:0/4242551643 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f48e4082070 con 0x55f9cba361e0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f47d9ffb640 1 --2- 172.21.15.102:0/4242551643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47cc03cfb0 0x7f47cc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f47d9ffb640 1 -- 172.21.15.102:0/4242551643 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f48e4085d60 con 0x55f9cba361e0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48ebeca640 1 --2- 172.21.15.102:0/4242551643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47cc03cfb0 0x7f47cc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48f9012800 1 Processor -- start 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48f9012800 1 -- start start 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48ebeca640 1 --2- 172.21.15.102:0/4242551643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47cc03cfb0 0x7f47cc03f470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55f9cba19ff0 tx=0x7f48dc00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48f9012800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba42ea0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48f9012800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9cba10e90 con 0x55f9cba42aa0 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba42ea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba42ea0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44044/0 (socket says 172.21.15.102:44044) 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.703+0000 7f48f46cb640 1 -- 172.21.15.102:0/2395864391 learned_addr learned my addr 172.21.15.102:0/2395864391 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f46cb640 1 -- 172.21.15.102:0/2395864391 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cba43490 con 0x55f9cba42aa0 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f46cb640 1 --2- 172.21.15.102:0/2395864391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba42ea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f48e408e760 tx=0x7f48e4067ab0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4118cdf082b9b5b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f47d37fe640 1 -- 172.21.15.102:0/2395864391 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e4067ba0 con 0x55f9cba42aa0 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f47d37fe640 1 -- 172.21.15.102:0/2395864391 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e40a5070 con 0x55f9cba42aa0 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f47d37fe640 1 -- 172.21.15.102:0/2395864391 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e4087120 con 0x55f9cba42aa0 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f9012800 1 -- 172.21.15.102:0/2395864391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 msgr2=0x55f9cba42ea0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f9012800 1 --2- 172.21.15.102:0/2395864391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba42ea0 secure :-1 s=READY pgs=666 cs=0 l=1 rev1=1 crypto rx=0x7f48e408e760 tx=0x7f48e4067ab0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f9012800 1 -- 172.21.15.102:0/2395864391 shutdown_connections 2024-09-19T11:14:57.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f9012800 1 --2- 172.21.15.102:0/2395864391 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba42ea0 unknown :-1 s=CLOSED pgs=666 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f9012800 1 -- 172.21.15.102:0/2395864391 >> 172.21.15.102:0/2395864391 conn(0x55f9cba3eea0 msgr2=0x55f9cba3d0e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f9012800 1 -- 172.21.15.102:0/2395864391 shutdown_connections 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.704+0000 7f48f9012800 1 -- 172.21.15.102:0/2395864391 wait complete. 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.705+0000 7f48f9012800 1 Processor -- start 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.705+0000 7f48f9012800 1 -- start start 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.705+0000 7f48f9012800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba49ee0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.705+0000 7f48f9012800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55f9cba43900 con 0x55f9cba42aa0 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.705+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba49ee0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.705+0000 7f48f46cb640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba49ee0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44048/0 (socket says 172.21.15.102:44048) 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.705+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 learned_addr learned my addr 172.21.15.102:0/2596216492 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.705+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55f9cba4a440 con 0x55f9cba42aa0 2024-09-19T11:14:57.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.706+0000 7f48f46cb640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba49ee0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f48e4094020 tx=0x7f48e407c550 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.706+0000 7f47d1ffb640 1 -- 172.21.15.102:0/2596216492 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e4067ba0 con 0x55f9cba42aa0 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.706+0000 7f47d1ffb640 1 -- 172.21.15.102:0/2596216492 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f48e4067360 con 0x55f9cba42aa0 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.706+0000 7f47d1ffb640 1 -- 172.21.15.102:0/2596216492 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f48e4071410 con 0x55f9cba42aa0 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.706+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55f9cba4a440 con 0x55f9cba42aa0 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.706+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55f9cba4a440 con 0x55f9cba42aa0 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f47d1ffb640 1 -- 172.21.15.102:0/2596216492 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f48e4067070 con 0x55f9cba42aa0 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f47d1ffb640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47c403d000 0x7f47c403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f47d1ffb640 1 -- 172.21.15.102:0/2596216492 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f48e40b8120 con 0x55f9cba42aa0 2024-09-19T11:14:57.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47c403d000 0x7f47c403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47c403d000 0x7f47c403f4c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55f9cba28880 tx=0x7f48dc010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cba553e0 0x55f9cba578a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba57ff0 con 0x55f9cba553e0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.707+0000 7f48f4ecc640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cba553e0 0x55f9cba578a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f4ecc640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cba553e0 0x55f9cba578a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 20 realm 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba58400 con 0x55f9cba553e0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba58cd0 con 0x55f9cba553e0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.708+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.709+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.709+0000 7f48f9012800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.709+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.709+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba59dd0 0x55f9cba5c1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.709+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba5c780 con 0x55f9cba59dd0 2024-09-19T11:14:57.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.709+0000 7f48f46cb640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba59dd0 0x55f9cba5c1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.709+0000 7f48f46cb640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba59dd0 0x55f9cba5c1c0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48f9012800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48f9012800 20 searching for the correct realm 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba5e750 0x55f9cba60be0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba612b0 con 0x55f9cba5e750 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba5e750 0x55f9cba60be0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba5e750 0x55f9cba60be0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48dc037040 con 0x55f9cba5e750 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48ebeca640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f48dc00f070 0x7f48dc02e910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba612b0 con 0x7f48dc00f070 2024-09-19T11:14:57.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.710+0000 7f48f4ecc640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f48dc00f070 0x7f48dc02e910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.711+0000 7f48f4ecc640 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f48dc00f070 0x7f48dc02e910 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.711+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.711+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba59dd0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.711+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.711+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.711+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.711+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.712+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.712+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba59dd0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.712+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.712+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba59dd0 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.712+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.712+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x7f48dc00f070 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.712+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.712+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba5e750 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.713+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48dc037040 con 0x55f9cba5e750 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.713+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.713+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.713+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba59dd0 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.713+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.713+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.713+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.713+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x7f48dc00f070 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.714+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.714+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba5e750 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.714+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48dc037040 con 0x55f9cba5e750 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.714+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba5e750 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.714+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f48dc037040 con 0x55f9cba5e750 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.714+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba59dd0 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.714+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.714+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba5e750 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.715+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48dc037040 con 0x55f9cba5e750 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.715+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba5e750 2024-09-19T11:14:57.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.715+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48dc037040 con 0x55f9cba5e750 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.715+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.715+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.715+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.715+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.715+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba59dd0 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.716+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.716+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba5e750 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.716+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48dc037040 con 0x55f9cba5e750 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.716+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x7f48dc00f070 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.716+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.716+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.716+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.716+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba59dd0 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.717+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.717+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba5e750 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.717+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48dc037040 con 0x55f9cba5e750 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.717+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba59dd0 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.717+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.717+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x7f48dc00f070 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.717+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.717+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba5e750 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48dc04a040 con 0x55f9cba5e750 2024-09-19T11:14:57.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x7f48dc00f070 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x55f9cba553e0 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba59070 con 0x7f48dc00f070 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:57.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba5d040 con 0x55f9cba553e0 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.718+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba5d040 con 0x55f9cba553e0 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba5d040 con 0x55f9cba5e750 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f48dc04a040 con 0x55f9cba5e750 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 20 zone default found 2024-09-19T11:14:57.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 4 Realm: () 2024-09-19T11:14:57.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:57.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:57.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:57.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 20 zonegroup default 2024-09-19T11:14:57.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba5d970 con 0x55f9cba59dd0 2024-09-19T11:14:57.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.719+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba63250 con 0x55f9cba5e750 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48dc04a040 con 0x55f9cba5e750 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba636e0 con 0x55f9cba5e750 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f48dc04a040 con 0x55f9cba5e750 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 20 started sync module instance, tier type = 2024-09-19T11:14:57.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.720+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba625c0 con 0x7f48dc00f070 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.721+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.721+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94531351882432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba625c0 con 0x7f48dc00f070 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.721+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba641c0 con 0x55f9cba553e0 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.722+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94531351882432] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.722+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.722+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94531351887024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba625c0 con 0x55f9cba553e0 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.722+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba64c10 con 0x55f9cba5e750 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.723+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94531351887024] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.724+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48dc04a040 con 0x55f9cba5e750 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.724+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94531351879952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba62530 con 0x55f9cba5e750 2024-09-19T11:14:57.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.724+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba65ad0 con 0x7f48dc00f070 2024-09-19T11:14:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.725+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.725+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94531351879952] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48dc04a040 con 0x55f9cba5e750 2024-09-19T11:14:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.725+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94531351894048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba66370 con 0x7f48dc00f070 2024-09-19T11:14:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.725+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba65040 con 0x55f9cba553e0 2024-09-19T11:14:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.726+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94531351894048] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.726+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.726+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94531351895664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba66290 con 0x55f9cba553e0 2024-09-19T11:14:57.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.726+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba673a0 con 0x55f9cba59dd0 2024-09-19T11:14:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.727+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.727+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94531351899888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba67bf0 con 0x55f9cba59dd0 2024-09-19T11:14:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.727+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba68640 con 0x55f9cba59dd0 2024-09-19T11:14:57.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.727+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94531351895664] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.728+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94531351899888] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.729+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.729+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94531351904560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba689e0 con 0x55f9cba59dd0 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.729+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba69270 con 0x55f9cba59dd0 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94531351904560] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'219 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94531351906784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba692b0 con 0x55f9cba59dd0 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f9012800 20 add_watcher() i=0 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f9012800 20 add_watcher() i=1 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f9012800 20 add_watcher() i=2 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f9012800 20 add_watcher() i=3 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f9012800 20 add_watcher() i=4 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f9012800 20 add_watcher() i=5 2024-09-19T11:14:57.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.730+0000 7f48f9012800 20 add_watcher() i=6 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.731+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94531351906784] v37'220 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.731+0000 7f48f9012800 20 add_watcher() i=7 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.731+0000 7f48f9012800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.731+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba6c6b0 con 0x55f9cba553e0 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.731+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.731+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94531351908304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba69c00 con 0x55f9cba553e0 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.732+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94531351908304] v37'216 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.732+0000 7f47aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.732+0000 7f48f9012800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.732+0000 7f48f9012800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.732+0000 7f48f9012800 5 note: GC not initialized 2024-09-19T11:14:57.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.732+0000 7f47a9fe3640 20 reqs_thread_entry: start 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.732+0000 7f48f9012800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 20 Filter name: none 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f47a37fe640 20 reqs_thread_entry: start 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:62 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba9f540 con 0x7f48dc00f070 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(62 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 20 rados_obj.operate() r=0 bl.length=380 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.733+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.e 8:75f48285:users.uid::fud:head [create,call version.set in=58b,writefull 0~206 in=206b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cbaa36d0 con 0x55f9cba59dd0 2024-09-19T11:14:57.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.734+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 fud [create,call,writefull 0~206] v37'6 uv5 ondisk = -17 ((17) File exists)) ==== 231+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:could not rename user: unable to rename user, user name given by --new-uid already exists. to overwrite this user, add --yes-i-really-mean-it 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.735+0000 7f47aafe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.735+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94531351908304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba9d400 con 0x55f9cba553e0 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.736+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94531351908304] v37'217 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.736+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94531351882432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba9d400 con 0x7f48dc00f070 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.737+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94531351882432] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.737+0000 7f48f9012800 20 remove_watcher() i=0 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.737+0000 7f48f9012800 2 removed watcher, disabling cache 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.737+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94531351887024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba9d400 con 0x55f9cba553e0 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.738+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94531351887024] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.738+0000 7f48f9012800 20 remove_watcher() i=1 2024-09-19T11:14:57.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.738+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94531351879952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba9d400 con 0x55f9cba5e750 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.739+0000 7f48ebeca640 1 -- 172.21.15.102:0/2596216492 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94531351879952] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48dc04a040 con 0x55f9cba5e750 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.739+0000 7f48f9012800 20 remove_watcher() i=2 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.739+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94531351894048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba62110 con 0x7f48dc00f070 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.740+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94531351894048] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x7f48dc00f070 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.740+0000 7f48f9012800 20 remove_watcher() i=3 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.740+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94531351895664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba65820 con 0x55f9cba553e0 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.741+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94531351895664] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48ec00a4d0 con 0x55f9cba553e0 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.742+0000 7f48f9012800 20 remove_watcher() i=4 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.742+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94531351899888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba62110 con 0x55f9cba59dd0 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.743+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94531351899888] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.743+0000 7f48f9012800 20 remove_watcher() i=5 2024-09-19T11:14:57.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.743+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94531351904560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba65e70 con 0x55f9cba59dd0 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.744+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94531351904560] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.744+0000 7f48f9012800 20 remove_watcher() i=6 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.744+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94531351906784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55f9cba66ef0 con 0x55f9cba59dd0 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f46cb640 1 -- 172.21.15.102:0/2596216492 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94531351906784] v37'221 uv219 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f48e4081030 con 0x55f9cba59dd0 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 20 remove_watcher() i=7 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba59dd0 msgr2=0x55f9cba5c1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba59dd0 0x55f9cba5c1c0 crc :-1 s=READY pgs=154 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cba553e0 msgr2=0x55f9cba578a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cba553e0 0x55f9cba578a0 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f48dc00f070 msgr2=0x7f48dc02e910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f48dc00f070 0x7f48dc02e910 crc :-1 s=READY pgs=83 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba5e750 msgr2=0x55f9cba60be0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba5e750 0x55f9cba60be0 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47c403d000 msgr2=0x7f47c403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47c403d000 0x7f47c403f4c0 secure :-1 s=READY pgs=277 cs=0 l=1 rev1=1 crypto rx=0x55f9cba28880 tx=0x7f48dc010000 comp rx=0 tx=0).stop 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 msgr2=0x55f9cba49ee0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2596216492 reap_dead start 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba49ee0 secure :-1 s=READY pgs=667 cs=0 l=1 rev1=1 crypto rx=0x7f48e4094020 tx=0x7f48e407c550 comp rx=0 tx=0).stop 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 shutdown_connections 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/2596216492 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba42aa0 0x55f9cba49ee0 unknown :-1 s=CLOSED pgs=667 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 >> 172.21.15.102:0/2596216492 conn(0x55f9cba3eea0 msgr2=0x55f9cba3d0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 shutdown_connections 2024-09-19T11:14:57.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/2596216492 wait complete. 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/4242551643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47cc03cfb0 msgr2=0x7f47cc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/4242551643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47cc03cfb0 0x7f47cc03f470 secure :-1 s=READY pgs=276 cs=0 l=1 rev1=1 crypto rx=0x55f9cba19ff0 tx=0x7f48dc00f000 comp rx=0 tx=0).stop 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/4242551643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba361e0 msgr2=0x55f9cba36600 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/4242551643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba361e0 0x55f9cba36600 secure :-1 s=READY pgs=665 cs=0 l=1 rev1=1 crypto rx=0x7f48e40951d0 tx=0x7f48e40078a0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/4242551643 shutdown_connections 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/4242551643 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47cc03cfb0 0x7f47cc03f470 unknown :-1 s=CLOSED pgs=276 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 --2- 172.21.15.102:0/4242551643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cba361e0 0x55f9cba36600 unknown :-1 s=CLOSED pgs=665 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/4242551643 >> 172.21.15.102:0/4242551643 conn(0x55f9cba2a590 msgr2=0x55f9cba2a970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.745+0000 7f48f9012800 1 -- 172.21.15.102:0/4242551643 shutdown_connections 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/4242551643 wait complete. 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba21900 msgr2=0x55f9cba23d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.759 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55f9cba21900 0x55f9cba23d80 crc :-1 s=READY pgs=153 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cb91e8e0 msgr2=0x55f9cba1f560 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55f9cb91e8e0 0x55f9cba1f560 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba25970 msgr2=0x55f9cba27d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55f9cba25970 0x55f9cba27d60 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47dc03cfb0 msgr2=0x7f47dc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f47dc03cfb0 0x7f47dc03f470 secure :-1 s=READY pgs=275 cs=0 l=1 rev1=1 crypto rx=0x7f48dc001e30 tx=0x7f48dc001390 comp rx=0 tx=0).stop 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 msgr2=0x55f9cba17f10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 --2- 172.21.15.102:0/2652174665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55f9cb91d6a0 0x55f9cba17f10 secure :-1 s=READY pgs=664 cs=0 l=1 rev1=1 crypto rx=0x7f48e40054e0 tx=0x7f48e4002fb0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f4ecc640 1 -- 172.21.15.102:0/2652174665 reap_dead start 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 shutdown_connections 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 >> 172.21.15.102:0/2652174665 conn(0x55f9cb918a70 msgr2=0x55f9cba118c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 shutdown_connections 2024-09-19T11:14:57.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.746+0000 7f48f9012800 1 -- 172.21.15.102:0/2652174665 wait complete. 2024-09-19T11:14:57.761 DEBUG:teuthology.orchestra.run:got remote process result: 17 2024-09-19T11:14:57.766 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:57.767 INFO:tasks.radosgw_admin:RL: get_obj myfoo6 bud bytes_out=0 bytes_in=8 failed=False 2024-09-19T11:14:57.771 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=0 failed=False 2024-09-19T11:14:57.771 INFO:tasks.radosgw_admin:RL: get_obj myfoo7 fud bytes_out=0 bytes_in=8 failed=False 2024-09-19T11:14:57.771 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-19T11:14:57.771 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'bud', '--purge-data'] 2024-09-19T11:14:57.771 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid bud --purge-data 2024-09-19T11:14:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:57.816 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb82b42800 1 Processor -- start 2024-09-19T11:14:57.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb82b42800 1 -- start start 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb82b42800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559593f69bb0 0x559593f69fb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb82b42800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x559593f6b2c0 con 0x559593f6a5e0 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb82b42800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x559593df57d0 con 0x559593f69bb0 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb7e886640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559593f69bb0 0x559593f69fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb7e886640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x559593f69bb0 0x559593f69fb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44056/0 (socket says 172.21.15.102:44056) 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb7e085640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x559593f6a5e0 0x559593f6aa90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47918/0 (socket says 172.21.15.102:47918) 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.816+0000 7ffb7e886640 1 -- 172.21.15.102:0/4066088865 learned_addr learned my addr 172.21.15.102:0/4066088865 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.817+0000 7ffb7e886640 1 -- 172.21.15.102:0/4066088865 >> v1:172.21.15.37:6789/0 conn(0x559593f6a5e0 legacy=0x559593f6aa90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.817+0000 7ffb7e886640 1 -- 172.21.15.102:0/4066088865 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x559593f71760 con 0x559593f69bb0 2024-09-19T11:14:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.818+0000 7ffb7e886640 1 --2- 172.21.15.102:0/4066088865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559593f69fb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffb78005fd0 tx=0x7ffb78045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bdc410bb2f3f988b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.819 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.818+0000 7ffb7d884640 1 -- 172.21.15.102:0/4066088865 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb7804e600 con 0x559593f69bb0 2024-09-19T11:14:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb7d884640 1 -- 172.21.15.102:0/4066088865 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7804e7a0 con 0x559593f69bb0 2024-09-19T11:14:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb7d884640 1 -- 172.21.15.102:0/4066088865 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb7804eaa0 con 0x559593f69bb0 2024-09-19T11:14:57.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb82b42800 1 -- 172.21.15.102:0/4066088865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 msgr2=0x559593f69fb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb82b42800 1 --2- 172.21.15.102:0/4066088865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559593f69fb0 secure :-1 s=READY pgs=669 cs=0 l=1 rev1=1 crypto rx=0x7ffb78005fd0 tx=0x7ffb78045cf0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb82b42800 1 -- 172.21.15.102:0/4066088865 shutdown_connections 2024-09-19T11:14:57.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb82b42800 1 --2- 172.21.15.102:0/4066088865 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559593f69fb0 unknown :-1 s=CLOSED pgs=669 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb82b42800 1 -- 172.21.15.102:0/4066088865 >> 172.21.15.102:0/4066088865 conn(0x559593f641d0 msgr2=0x559593f66650 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb82b42800 1 -- 172.21.15.102:0/4066088865 shutdown_connections 2024-09-19T11:14:57.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.819+0000 7ffb82b42800 1 -- 172.21.15.102:0/4066088865 wait complete. 2024-09-19T11:14:57.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.832+0000 7ffb82b42800 1 Processor -- start 2024-09-19T11:14:57.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.833+0000 7ffb82b42800 1 -- start start 2024-09-19T11:14:57.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.833+0000 7ffb82b42800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594059260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.833+0000 7ffb82b42800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559593e02dd0 con 0x559593f69bb0 2024-09-19T11:14:57.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.833+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594059260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.833+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594059260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44058/0 (socket says 172.21.15.102:44058) 2024-09-19T11:14:57.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.833+0000 7ffb7e886640 1 -- 172.21.15.102:0/3484774788 learned_addr learned my addr 172.21.15.102:0/3484774788 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.833+0000 7ffb7e886640 1 -- 172.21.15.102:0/3484774788 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559594059850 con 0x559593f69bb0 2024-09-19T11:14:57.839 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.834+0000 7ffb7e886640 1 --2- 172.21.15.102:0/3484774788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594059260 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800a4b0 tx=0x7ffb78050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=94c978be1b088515 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.834+0000 7ffa6ce09640 1 -- 172.21.15.102:0/3484774788 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb7804ea80 con 0x559593f69bb0 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.834+0000 7ffa6ce09640 1 -- 172.21.15.102:0/3484774788 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb78066070 con 0x559593f69bb0 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.834+0000 7ffa6ce09640 1 -- 172.21.15.102:0/3484774788 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb7804edc0 con 0x559593f69bb0 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 -- 172.21.15.102:0/3484774788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 msgr2=0x559594059260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 --2- 172.21.15.102:0/3484774788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594059260 secure :-1 s=READY pgs=670 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800a4b0 tx=0x7ffb78050000 comp rx=0 tx=0).stop 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 -- 172.21.15.102:0/3484774788 shutdown_connections 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 --2- 172.21.15.102:0/3484774788 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594059260 unknown :-1 s=CLOSED pgs=670 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 -- 172.21.15.102:0/3484774788 >> 172.21.15.102:0/3484774788 conn(0x559593f641d0 msgr2=0x559594054be0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 -- 172.21.15.102:0/3484774788 shutdown_connections 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 -- 172.21.15.102:0/3484774788 wait complete. 2024-09-19T11:14:57.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 Processor -- start 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 -- start start 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594060c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb82b42800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559593f70a50 con 0x559593f69bb0 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.835+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594060c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594060c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44070/0 (socket says 172.21.15.102:44070) 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffb7e886640 1 -- 172.21.15.102:0/1901369349 learned_addr learned my addr 172.21.15.102:0/1901369349 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffb7e886640 1 -- 172.21.15.102:0/1901369349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x559594061170 con 0x559593f69bb0 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffb7e886640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594060c10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800a4b0 tx=0x7ffb78003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffa6b606640 1 -- 172.21.15.102:0/1901369349 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb7807a070 con 0x559593f69bb0 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffa6b606640 1 -- 172.21.15.102:0/1901369349 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7805c040 con 0x559593f69bb0 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x559594061400 con 0x559593f69bb0 2024-09-19T11:14:57.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffa6b606640 1 -- 172.21.15.102:0/1901369349 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb7806a650 con 0x559593f69bb0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.836+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x559594062010 con 0x559593f69bb0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.837+0000 7ffa6b606640 1 -- 172.21.15.102:0/1901369349 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffb7807d070 con 0x559593f69bb0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.837+0000 7ffa6b606640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa6403cfb0 0x7ffa6403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.837+0000 7ffa6b606640 1 -- 172.21.15.102:0/1901369349 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ffb78072070 con 0x559593f69bb0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.837+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa6403cfb0 0x7ffa6403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.838+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559593f6a5e0 0x559594067320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.838+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940628b0 con 0x559593f6a5e0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.838+0000 7ffb7f087640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559593f6a5e0 0x559594067320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.838+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa6403cfb0 0x7ffa6403f470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb68001e30 tx=0x7ffb68001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.838+0000 7ffb7f087640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559593f6a5e0 0x559594067320 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.838+0000 7ffb7f087640 1 -- 172.21.15.102:0/1901369349 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb700083e0 con 0x559593f6a5e0 2024-09-19T11:14:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.838+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594067880 con 0x559593f6a5e0 2024-09-19T11:14:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.838+0000 7ffb7f087640 1 -- 172.21.15.102:0/1901369349 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb700083e0 con 0x559593f6a5e0 2024-09-19T11:14:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.839+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559594069690 0x55959406ba80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.839+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959406c150 con 0x559594069690 2024-09-19T11:14:57.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.839+0000 7ffb7e886640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559594069690 0x55959406ba80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.839+0000 7ffb7e886640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559594069690 0x55959406ba80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.839+0000 7ffb7e886640 1 -- 172.21.15.102:0/1901369349 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ffb7807c030 con 0x559594069690 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.839+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594068500 con 0x559593f6a5e0 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.840+0000 7ffb7f087640 1 -- 172.21.15.102:0/1901369349 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb700083e0 con 0x559593f6a5e0 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.840+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55959406d590 0x55959406f980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.840+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940700f0 con 0x55959406d590 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.840+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55959406d590 0x55959406f980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.840+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55959406d590 0x55959406f980 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.840+0000 7ffb7e085640 1 -- 172.21.15.102:0/1901369349 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7ffb6800bd50 con 0x55959406d590 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb82b42800 1 Processor -- start 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb82b42800 1 -- start start 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb82b42800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959407ddf0 0x55959407e210 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb82b42800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559593e614a0 con 0x55959407ddf0 2024-09-19T11:14:57.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959407ddf0 0x55959407e210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959407ddf0 0x55959407e210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44088/0 (socket says 172.21.15.102:44088) 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb7e886640 1 -- 172.21.15.102:0/111014026 learned_addr learned my addr 172.21.15.102:0/111014026 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb7e886640 1 -- 172.21.15.102:0/111014026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959407e850 con 0x55959407ddf0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.841+0000 7ffb7e886640 1 --2- 172.21.15.102:0/111014026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959407ddf0 0x55959407e210 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffb78098000 tx=0x7ffb7806aa40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.842+0000 7ffa68e01640 1 -- 172.21.15.102:0/111014026 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb78055be0 con 0x55959407ddf0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.842+0000 7ffa68e01640 1 -- 172.21.15.102:0/111014026 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb78055d80 con 0x55959407ddf0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.842+0000 7ffb82b42800 1 -- 172.21.15.102:0/111014026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55959407f080 con 0x55959407ddf0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.842+0000 7ffa68e01640 1 -- 172.21.15.102:0/111014026 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb78056aa0 con 0x55959407ddf0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.842+0000 7ffb82b42800 1 -- 172.21.15.102:0/111014026 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55959407f080 con 0x55959407ddf0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.842+0000 7ffa68e01640 1 -- 172.21.15.102:0/111014026 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffb78056c40 con 0x55959407ddf0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffa68e01640 1 --2- 172.21.15.102:0/111014026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa5803d000 0x7ffa5803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffa68e01640 1 -- 172.21.15.102:0/111014026 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ffb7808a030 con 0x55959407ddf0 2024-09-19T11:14:57.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb7e085640 1 --2- 172.21.15.102:0/111014026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa5803d000 0x7ffa5803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb82b42800 1 Processor -- start 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb82b42800 1 -- start start 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb7e085640 1 --2- 172.21.15.102:0/111014026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa5803d000 0x7ffa5803f4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5595940704d0 tx=0x7ffb6800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb82b42800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x55959408ed20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb82b42800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x559594059bc0 con 0x55959408e920 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x55959408ed20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x55959408ed20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44094/0 (socket says 172.21.15.102:44094) 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.843+0000 7ffb7e886640 1 -- 172.21.15.102:0/275505998 learned_addr learned my addr 172.21.15.102:0/275505998 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb7e886640 1 -- 172.21.15.102:0/275505998 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55959408f310 con 0x55959408e920 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb7e886640 1 --2- 172.21.15.102:0/275505998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x55959408ed20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ffb78056fd0 tx=0x7ffb78080a00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8d34bdcd4e61624a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffa627fc640 1 -- 172.21.15.102:0/275505998 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb78080b40 con 0x55959408e920 2024-09-19T11:14:57.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffa627fc640 1 -- 172.21.15.102:0/275505998 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb78007990 con 0x55959408e920 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffa627fc640 1 -- 172.21.15.102:0/275505998 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb78080450 con 0x55959408e920 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb82b42800 1 -- 172.21.15.102:0/275505998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 msgr2=0x55959408ed20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb82b42800 1 --2- 172.21.15.102:0/275505998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x55959408ed20 secure :-1 s=READY pgs=673 cs=0 l=1 rev1=1 crypto rx=0x7ffb78056fd0 tx=0x7ffb78080a00 comp rx=0 tx=0).stop 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb82b42800 1 -- 172.21.15.102:0/275505998 shutdown_connections 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb82b42800 1 --2- 172.21.15.102:0/275505998 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x55959408ed20 unknown :-1 s=CLOSED pgs=673 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb82b42800 1 -- 172.21.15.102:0/275505998 >> 172.21.15.102:0/275505998 conn(0x559594086910 msgr2=0x559594084b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb82b42800 1 -- 172.21.15.102:0/275505998 shutdown_connections 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.844+0000 7ffb82b42800 1 -- 172.21.15.102:0/275505998 wait complete. 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.845+0000 7ffb82b42800 1 Processor -- start 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.845+0000 7ffb82b42800 1 -- start start 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.845+0000 7ffb82b42800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x559594095d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.845+0000 7ffb82b42800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55959408f780 con 0x55959408e920 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.845+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x559594095d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.845+0000 7ffb7e886640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x559594095d80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44104/0 (socket says 172.21.15.102:44104) 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.845+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 learned_addr learned my addr 172.21.15.102:0/1256291434 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.845+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5595940962e0 con 0x55959408e920 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.846+0000 7ffb7e886640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x559594095d80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffb7806a8c0 tx=0x7ffb78066f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.846+0000 7ffa60ff9640 1 -- 172.21.15.102:0/1256291434 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb78080450 con 0x55959408e920 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.846+0000 7ffa60ff9640 1 -- 172.21.15.102:0/1256291434 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ffb7807e3b0 con 0x55959408e920 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.846+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5595940962e0 con 0x55959408e920 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.846+0000 7ffa60ff9640 1 -- 172.21.15.102:0/1256291434 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ffb78080b40 con 0x55959408e920 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.846+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5595940962e0 con 0x55959408e920 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.846+0000 7ffa60ff9640 1 -- 172.21.15.102:0/1256291434 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ffb780556e0 con 0x55959408e920 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.847+0000 7ffa60ff9640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa4803d000 0x7ffa4803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.847+0000 7ffa60ff9640 1 -- 172.21.15.102:0/1256291434 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ffb7806e0c0 con 0x55959408e920 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.847+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa4803d000 0x7ffa4803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.847+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa4803d000 0x7ffa4803f4c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800ffd0 tx=0x7ffb68010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.847+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.847+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5595940a1320 0x5595940a37e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.847+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a3f30 con 0x5595940a1320 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb7f087640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5595940a1320 0x5595940a37e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb7f087640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5595940a1320 0x5595940a37e0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb700083e0 con 0x5595940a1320 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 20 realm 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4340 con 0x5595940a1320 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb700083e0 con 0x5595940a1320 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb700083e0 con 0x5595940a1320 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.848+0000 7ffb82b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4fb0 con 0x5595940a1320 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ffb700083e0 con 0x5595940a1320 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb82b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5595940a5970 0x5595940a7d60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a8330 con 0x5595940a5970 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb7e886640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5595940a5970 0x5595940a7d60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.849+0000 7ffb7e886640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5595940a5970 0x5595940a7d60 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb82b42800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb82b42800 20 searching for the correct realm 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5595940aa300 0x5595940ac7c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940ace40 con 0x5595940aa300 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5595940aa300 0x5595940ac7c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5595940aa300 0x5595940ac7c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68037040 con 0x5595940aa300 2024-09-19T11:14:57.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb7e085640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ffb6800f070 0x7ffb6803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940ace40 con 0x7ffb6800f070 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.850+0000 7ffb7f087640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ffb6800f070 0x7ffb6803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.851+0000 7ffb7f087640 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ffb6800f070 0x7ffb6803a3c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.851+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb700083e0 con 0x7ffb6800f070 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.851+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a5970 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.851+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.851+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.851+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb700083e0 con 0x5595940a1320 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.851+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.852+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.852+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a5970 2024-09-19T11:14:57.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.852+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.852+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a5970 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.852+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.852+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x7ffb6800f070 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.852+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.852+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940aa300 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.853+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68037040 con 0x5595940aa300 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.853+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.853+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.853+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a5970 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.853+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.853+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.853+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.853+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x7ffb6800f070 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.854+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.854+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940aa300 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.854+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68037040 con 0x5595940aa300 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.854+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940aa300 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.854+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7ffb68037040 con 0x5595940aa300 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.854+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a5970 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.854+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.854+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940aa300 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.855+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68037040 con 0x5595940aa300 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.855+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940aa300 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.855+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68037040 con 0x5595940aa300 2024-09-19T11:14:57.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.855+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.855+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.855+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.855+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.855+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a5970 2024-09-19T11:14:57.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.856+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.856+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940aa300 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.856+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68037040 con 0x5595940aa300 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.856+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x7ffb6800f070 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.856+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.856+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.856+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.856+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a5970 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.857+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.857+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940aa300 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.857+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb68037040 con 0x5595940aa300 2024-09-19T11:14:57.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.857+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a5970 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.857+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.857+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x7ffb6800f070 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.857+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.857+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940aa300 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x7ffb6800f070 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x5595940a1320 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5595940a4c10 con 0x7ffb6800f070 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a8bf0 con 0x5595940a1320 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.858+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a8bf0 con 0x5595940a1320 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a8bf0 con 0x5595940aa300 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 20 zone default found 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 4 Realm: () 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 20 zonegroup default 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940a94b0 con 0x5595940a5970 2024-09-19T11:14:57.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.859+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940aedb0 con 0x5595940aa300 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb82b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940af1f0 con 0x5595940aa300 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb82b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb82b42800 20 started sync module instance, tier type = 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb82b42800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.860+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940ae150 con 0x7ffb6800f070 2024-09-19T11:14:57.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.861+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.861+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94100922230352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940ae150 con 0x7ffb6800f070 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.861+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940afd40 con 0x5595940a1320 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.862+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94100922230352] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.862+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.862+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94100922234896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940ae150 con 0x5595940a1320 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.862+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b07f0 con 0x5595940aa300 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.863+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94100922234896] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.864+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.864+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94100922227872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940ae0c0 con 0x5595940aa300 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.864+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b16b0 con 0x7ffb6800f070 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.865+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.865+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94100922242016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b1e70 con 0x7ffb6800f070 2024-09-19T11:14:57.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.865+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b2990 con 0x5595940a1320 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.865+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94100922227872] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.866+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.866+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94100922242016] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x7ffb6800f070 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.866+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94100922246240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b2950 con 0x5595940a1320 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.866+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b2ef0 con 0x5595940a5970 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.867+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.867+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94100922243264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b3740 con 0x5595940a5970 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.867+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b4140 con 0x5595940a5970 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.867+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94100922246240] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.868+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94100922243264] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.868+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.868+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94100922239968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b4560 con 0x5595940a5970 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.868+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b4db0 con 0x5595940a5970 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94100922239968] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'222 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94100922254560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b4db0 con 0x5595940a5970 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb82b42800 20 add_watcher() i=0 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb82b42800 20 add_watcher() i=1 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb82b42800 20 add_watcher() i=2 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb82b42800 20 add_watcher() i=3 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb82b42800 20 add_watcher() i=4 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb82b42800 20 add_watcher() i=5 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.869+0000 7ffb82b42800 20 add_watcher() i=6 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.870+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94100922254560] v37'223 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.870+0000 7ffb82b42800 20 add_watcher() i=7 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.870+0000 7ffb82b42800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.870+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940b80b0 con 0x5595940a1320 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.870+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.870+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94100922255984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b5340 con 0x5595940a1320 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.872+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94100922255984] v37'218 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb70026040 con 0x5595940a1320 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.872+0000 7ffa357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.872+0000 7ffb82b42800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.872+0000 7ffb82b42800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.872+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c0a40 con 0x5595940a1320 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.873+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.873+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c1070 con 0x5595940a5970 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.875+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.875+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c1050 con 0x5595940aa300 2024-09-19T11:14:57.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.875+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.875+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c1b50 con 0x5595940a1320 2024-09-19T11:14:57.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.876+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'219 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.876+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940be850 con 0x7ffb6800f070 2024-09-19T11:14:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.878+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'68 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.878+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940be850 con 0x5595940aa300 2024-09-19T11:14:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.878+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'46 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.878+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c26b0 con 0x5595940a1320 2024-09-19T11:14:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.880+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.880+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c26b0 con 0x5595940a5970 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.881+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'47 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.881+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2740 con 0x7ffb6800f070 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.882+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.882+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2740 con 0x5595940aa300 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.883+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.883+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2780 con 0x7ffb6800f070 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.884+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'69 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.884+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2780 con 0x5595940a5970 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.885+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.885+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2dd0 con 0x7ffb6800f070 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.886+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.886+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940a5970 2024-09-19T11:14:57.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.887+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'51 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.888+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940a1320 2024-09-19T11:14:57.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.889+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'220 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.889+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940aa300 2024-09-19T11:14:57.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.890+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'62 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.890+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x7ffb6800f070 2024-09-19T11:14:57.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.891+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'70 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.891+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940aa300 2024-09-19T11:14:57.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.892+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'26 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.892+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940a1320 2024-09-19T11:14:57.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.893+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'34 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.893+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940a1320 2024-09-19T11:14:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.894+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'221 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.895 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.894+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940aa300 2024-09-19T11:14:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.895+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'63 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.895+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x7ffb6800f070 2024-09-19T11:14:57.896 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.896+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'36 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.896+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940aa300 2024-09-19T11:14:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.896+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'29 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.897 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.897+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940aa300 2024-09-19T11:14:57.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.897+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.898 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.897+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940aa300 2024-09-19T11:14:57.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.898+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'22 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.899 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.898+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940aa300 2024-09-19T11:14:57.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.899+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'47 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.899+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940a5970 2024-09-19T11:14:57.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.900+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'28 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.900+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2cc0 con 0x5595940aa300 2024-09-19T11:14:57.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.901+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.901+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2d20 con 0x5595940a5970 2024-09-19T11:14:57.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.903+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'48 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.903+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2ce0 con 0x5595940aa300 2024-09-19T11:14:57.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.904+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'64 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.904+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2ce0 con 0x5595940a5970 2024-09-19T11:14:57.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.905+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'52 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.905+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940c2d00 con 0x7ffb6800f070 2024-09-19T11:14:57.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.906+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'32 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.906+0000 7ff9affff640 20 reqs_thread_entry: start 2024-09-19T11:14:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.906+0000 7ffb82b42800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 20 Filter name: none 2024-09-19T11:14:57.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ff9adffb640 20 reqs_thread_entry: start 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 10 cache get: name=default.rgw.meta+users.uid+bud : miss 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:94 8.4 8:267425a8:users.uid::bud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940ed7b0 con 0x7ffb6800f070 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(94 bud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv2 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 20 rados_obj.operate() r=0 bl.length=380 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 10 cache put: name=default.rgw.meta+users.uid+bud info.flags=0x13 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 10 adding default.rgw.meta+users.uid+bud to cache LRU end 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:95 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f0070 con 0x5595940a1320 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(95 bud.buckets [call out=184b] v0'0 uv4 ondisk = 0) ==== 155+0+184 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 : miss 2024-09-19T11:14:57.910 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.907+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:96 8.11 8:88b9681c:root::.bucket.meta.myfoo6%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940efec0 con 0x5595940aa300 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.908+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(96 .bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 [call out=48b,stat out=16b,read 0~388 out=388b,getxattrs out=212b] v0'0 uv3 ondisk = 0) ==== 333+0+664 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.908+0000 7ffb82b42800 20 rados_obj.operate() r=0 bl.length=388 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.908+0000 7ffb82b42800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 info.flags=0x17 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.908+0000 7ffb82b42800 10 adding default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 to cache LRU end 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.908+0000 7ffb82b42800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.908+0000 7ffb82b42800 10 updating xattr: name=user.rgw.acl bl.length()=117 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.908+0000 7ffb82b42800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 2024-09-19T11:14:57.911 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.908+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:97 4.2d 4:b6369089:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d430 con 0x5595940a5970 2024-09-19T11:14:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.909+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(97 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.909+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:98 4.2 4:40af0dd5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d470 con 0x5595940a1320 2024-09-19T11:14:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.909+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(98 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.914 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.909+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:99 4.3f 4:fd2c31d3:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d470 con 0x7ffb6800f070 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.909+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(99 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.909+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 4.24 4:244b1786:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d470 con 0x5595940a5970 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.910+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(100 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.910+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:101 4.8 4:11528f1f:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d4b0 con 0x5595940aa300 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.910+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(101 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.910+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:102 4.2c 4:35996e74:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d4b0 con 0x5595940a1320 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.911+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(102 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.911+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:103 4.b 4:d2b2f9ef:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d4b0 con 0x7ffb6800f070 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.911+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(103 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.911+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:104 4.36 4:6d3f32a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d4b0 con 0x5595940a1320 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.911+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(104 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.911+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:105 4.1 4:83d6e09b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d470 con 0x7ffb6800f070 2024-09-19T11:14:57.915 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.911+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(105 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.911+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:106 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d470 con 0x5595940a1320 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.912+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(106 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [call out=349b] v0'0 uv5 ondisk = 0) ==== 194+0+349 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.912+0000 7ffb82b42800 10 cls_bucket_list_unordered: got thirteen 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.912+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:107 4.21 4:85a49708:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416d470 con 0x5595940a5970 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.912+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(107 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.912+0000 7ffb82b42800 20 get_obj_state: octx=0x7ffb68001e60 obj=myfoo6:thirteen state=0x55959416b4b8 s->prefetch_data=0 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.912+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:108 3.38s0 3:1e16eee6:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9_thirteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55959416ce40 con 0x5595940a5970 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.913+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(108 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9_thirteen [call out=24b,getxattrs out=818b,stat out=16b] v0'0 uv2 ondisk = 0) ==== 280+0+858 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.913+0000 7ffb82b42800 10 manifest: total_size = 8 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.913+0000 7ffb82b42800 20 get_obj_state: setting s->obj_tag to _hkDnUv17xlT3xkO9qZelE0XBttHBbkf 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.913+0000 7ffb82b42800 20 get_obj_state: octx=0x7ffb68001e60 obj=myfoo6:thirteen state=0x55959416b4b8 s->prefetch_data=0 2024-09-19T11:14:57.916 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.913+0000 7ffb82b42800 20 prepare_atomic_modification: state is not atomic. state=0x55959416b4b8 2024-09-19T11:14:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.913+0000 7ffb82b42800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 2024-09-19T11:14:57.917 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.913+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:109 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=187b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f41d0 con 0x5595940a1320 2024-09-19T11:14:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.914+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(109 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [stat,call,call] v37'6 uv6 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.914+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:110 3.38s0 3:1e16eee6:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9_thirteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f1be0 con 0x5595940a5970 2024-09-19T11:14:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.915+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(110 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9_thirteen [call] v37'3 uv3 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.915+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:111 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=264b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f4c60 con 0x5595940a1320 2024-09-19T11:14:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.915+0000 7ffb82b42800 20 list_objects_ordered: starting attempt 1 2024-09-19T11:14:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.915+0000 7ffb82b42800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T11:14:57.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.915+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:112 4.2d 4:b6369089:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f6630 con 0x5595940a5970 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.915+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:113 4.2 4:40af0dd5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f6630 con 0x5595940a1320 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.915+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:114 4.3f 4:fd2c31d3:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f6630 con 0x7ffb6800f070 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:115 4.24 4:244b1786:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f6630 con 0x5595940a5970 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(112 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(113 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:116 4.8 4:11528f1f:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f6630 con 0x5595940aa300 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(114 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:117 4.2c 4:35996e74:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940fdec0 con 0x5595940a1320 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:118 4.b 4:d2b2f9ef:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f6630 con 0x7ffb6800f070 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:119 4.36 4:6d3f32a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594100fd0 con 0x5595940a1320 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:120 4.1 4:83d6e09b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594103aa0 con 0x7ffb6800f070 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:121 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106900 con 0x5595940a1320 2024-09-19T11:14:57.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:122 4.21 4:85a49708:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594109780 con 0x5595940a5970 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(115 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(116 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.916+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(122 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(118 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 25 ==== osd_op_reply(120 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(117 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(119 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(111 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [stat,call,call] v37'7 uv7 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffa61ffb640 20 handle_completion(): completion ok for obj=thirteen 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(121 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:14:57.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo6[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9])"; uploads.size()=0; is_truncated=0 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:123 4.2d 4:b6369089:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106900 con 0x5595940a5970 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:124 4.2 4:40af0dd5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594109700 con 0x5595940a1320 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:125 4.3f 4:fd2c31d3:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106e20 con 0x7ffb6800f070 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:126 4.24 4:244b1786:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106900 con 0x5595940a5970 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:127 4.8 4:11528f1f:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594109700 con 0x5595940aa300 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:128 4.2c 4:35996e74:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106e20 con 0x5595940a1320 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:129 4.b 4:d2b2f9ef:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106900 con 0x7ffb6800f070 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:130 4.36 4:6d3f32a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106e20 con 0x5595940a1320 2024-09-19T11:14:57.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:131 4.1 4:83d6e09b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106900 con 0x7ffb6800f070 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:132 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106e20 con 0x5595940a1320 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:133 4.21 4:85a49708:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594100880 con 0x5595940a5970 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.917+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(126 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3 [call out=89b] v0'0 uv8 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(123 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== osd_op_reply(133 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 26 ==== osd_op_reply(125 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 27 ==== osd_op_reply(129 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(127 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(124 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(128 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== osd_op_reply(130 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(132 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [call out=128b] v0'0 uv7 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 28 ==== osd_op_reply(131 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.918+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:134 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.set_buckets_info in=208b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106dc0 con 0x5595940a1320 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== osd_op_reply(134 bud.buckets [call] v37'5 uv5 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb82b42800 10 cache get: name=default.rgw.meta+root+myfoo6 : miss 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:135 8.18 8:1944a257:root::myfoo6:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106dc0 con 0x5595940a1320 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 43 ==== osd_op_reply(135 myfoo6 [call out=48b,read 0~166 out=166b] v0'0 uv17 ondisk = 0) ==== 192+0+214 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb82b42800 20 rados_obj.operate() r=0 bl.length=166 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb82b42800 10 cache put: name=default.rgw.meta+root+myfoo6 info.flags=0x11 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb82b42800 10 adding default.rgw.meta+root+myfoo6 to cache LRU end 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.919+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:136 8.18 8:1944a257:root::myfoo6:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106dc0 con 0x5595940a1320 2024-09-19T11:14:57.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.920+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 44 ==== osd_op_reply(136 myfoo6 [call,call,delete] v37'18 uv18 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.920+0000 7ffb82b42800 10 removing default.rgw.meta+root+myfoo6 from cache 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.920+0000 7ffb82b42800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo6, ofs0, ns] 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.920+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 94100922592544 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f4680 con 0x7ffb6800f070 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.920+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 29 ==== watch-notify(notify (1) cookie 94100922242016 notify 158913789969 ret 0) ==== 192+0+0 (crc 0 0 0) 0x5595940be570 con 0x7ffb6800f070 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.920+0000 7ffa627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789969 cookie 94100922242016 notifier 4764 bl.length()=150 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.920+0000 7ffa627fc640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7ffa44003d60 con 0x7ffb6800f070 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.920+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 30 ==== osd_op_reply(137 notify.3 [notify cookie 94100922592544 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.921+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 31 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.921+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 32 ==== watch-notify(notify_complete (2) cookie 94100922592544 notify 158913789969 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5595940c0500 con 0x7ffb6800f070 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.921+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:139 8.11 8:88b9681c:root::.bucket.meta.myfoo6%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x5595940aa300 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(139 .bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 [call,call,delete] v37'4 uv4 ondisk = 0) ==== 291+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.932 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb82b42800 10 removing default.rgw.meta+root+.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 from cache 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb82b42800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo6:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9, ofs0, ns] 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:140 7.0 7:05bf5b68:::notify.1:head [notify cookie 94100922592544 in=219b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940efe30 con 0x5595940a1320 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 45 ==== watch-notify(notify (1) cookie 94100922234896 notify 158913789980 ret 0) ==== 249+0+0 (crc 0 0 0) 0x5595940c0500 con 0x5595940a1320 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffa61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789980 cookie 94100922234896 notifier 4764 bl.length()=207 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffa61ffb640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:141 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7ff9b40032c0 con 0x5595940a1320 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 46 ==== osd_op_reply(140 notify.1 [notify cookie 94100922592544 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 47 ==== watch-notify(notify_complete (2) cookie 94100922592544 notify 158913789980 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5595940c0330 con 0x5595940a1320 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 48 ==== osd_op_reply(141 notify.1 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.922+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:142 4.2d 4:b6369089:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x5595940a5970 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.923+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:143 4.2 4:40af0dd5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f4c60 con 0x5595940a1320 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.923+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:144 4.3f 4:fd2c31d3:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595941071e0 con 0x7ffb6800f070 2024-09-19T11:14:57.933 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.923+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:145 4.24 4:244b1786:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x5595940a5970 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.923+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:146 4.8 4:11528f1f:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594108fb0 con 0x5595940aa300 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.923+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:147 4.2c 4:35996e74:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595941071e0 con 0x5595940a1320 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.923+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:148 4.b 4:d2b2f9ef:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x7ffb6800f070 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.923+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:149 4.36 4:6d3f32a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595941071e0 con 0x5595940a1320 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.923+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:150 4.1 4:83d6e09b:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x7ffb6800f070 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.924+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:151 4.27 4:e5235c53:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595941071e0 con 0x5595940a1320 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.924+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:152 4.21 4:85a49708:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594108fb0 con 0x5595940a5970 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.924+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 33 ==== osd_op_reply(148 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.6 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.924+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(142 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.0 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.924+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 34 ==== osd_op_reply(144 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.2 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.925+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 49 ==== osd_op_reply(147 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.5 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.934 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.925+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 50 ==== osd_op_reply(143 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.1 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.925+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(145 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.3 [delete] v37'9 uv9 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.935 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.925+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 51 ==== osd_op_reply(149 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.7 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.927+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 35 ==== osd_op_reply(150 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.8 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.927+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== osd_op_reply(146 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.4 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.929+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 52 ==== osd_op_reply(151 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.9 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== osd_op_reply(152 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9.10 [delete] v37'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb82b42800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo6/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 : miss 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb82b42800 20 rados->read ofs=0 len=0 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:153 6.1d 6:bf798858:::pubsub..bucket.myfoo6%2f32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x5595940a5970 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(153 pubsub..bucket.myfoo6/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb82b42800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb82b42800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo6/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 info.flags=0x0 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb82b42800 10 adding default.rgw.log++pubsub..bucket.myfoo6/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 to cache LRU end 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.930+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:154 6.1d 6:bf798858:::pubsub..bucket.myfoo6%2f32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x5595940a5970 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.931+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(154 pubsub..bucket.myfoo6/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.9 [delete] v37'49 uv38 ondisk = -2 ((2) No such file or directory)) ==== 209+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.931+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:155 8.19 8:99adfd5d:users.uid::bud.buckets:head [call user.remove_bucket in=145b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x5595940a1320 2024-09-19T11:14:57.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.932+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 53 ==== osd_op_reply(155 bud.buckets [call] v37'6 uv6 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.932+0000 7ffb82b42800 10 removing key index: NX5QOQKC6BH2IDN8HC7A 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.932+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:156 8.a 8:50c8eddb:users.keys::NX5QOQKC6BH2IDN8HC7A:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x559594106d20 con 0x5595940a1320 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.933+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 54 ==== osd_op_reply(156 NX5QOQKC6BH2IDN8HC7A [delete] v37'3 uv3 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.933+0000 7ffb82b42800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:NX5QOQKC6BH2IDN8HC7A, ofs0, ns] 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.933+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:157 7.3 7:c609908c:::notify.5:head [notify cookie 94100922592544 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940f4c60 con 0x5595940a5970 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.933+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== watch-notify(notify (1) cookie 94100922243264 notify 158913789990 ret 0) ==== 212+0+0 (crc 0 0 0) 0x5595940beb30 con 0x5595940a5970 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.934+0000 7ffa61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789990 cookie 94100922243264 notifier 4764 bl.length()=170 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.934+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 41 ==== osd_op_reply(157 notify.5 [notify cookie 94100922592544 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.934+0000 7ffa61ffb640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:158 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7ff9b40032c0 con 0x5595940a5970 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.934+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 42 ==== osd_op_reply(158 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.934+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 43 ==== watch-notify(notify_complete (2) cookie 94100922592544 notify 158913789990 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7ffb78099e30 con 0x5595940a5970 2024-09-19T11:14:57.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.934+0000 7ffb82b42800 10 removing email index: 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.934+0000 7ffb82b42800 10 removing user buckets index 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.934+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:159 8.19 8:99adfd5d:users.uid::bud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f4c60 con 0x5595940a1320 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 55 ==== osd_op_reply(159 bud.buckets [delete] v37'7 uv7 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb82b42800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:bud.buckets, ofs0, ns] 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94100922517120 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5595940efe30 con 0x5595940a5970 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 44 ==== watch-notify(notify (1) cookie 94100922239968 notify 158913789991 ret 0) ==== 202+0+0 (crc 0 0 0) 0x7ffb78099e30 con 0x5595940a5970 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffa61ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789991 cookie 94100922239968 notifier 4764 bl.length()=160 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffa61ffb640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7ff9b40032c0 con 0x5595940a5970 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 45 ==== osd_op_reply(160 notify.6 [notify cookie 94100922517120 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 46 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 47 ==== watch-notify(notify_complete (2) cookie 94100922517120 notify 158913789991 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559594062010 con 0x5595940a5970 2024-09-19T11:14:57.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb82b42800 10 removing user index: bud 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.935+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:162 8.4 8:267425a8:users.uid::bud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f4c60 con 0x7ffb6800f070 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.936+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 36 ==== osd_op_reply(162 bud [call,call,delete] v37'3 uv3 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.936+0000 7ffb82b42800 10 removing default.rgw.meta+users.uid+bud from cache 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.936+0000 7ffb82b42800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:bud, ofs0, ns] 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.936+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94100922517120 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x559594106c10 con 0x5595940a5970 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.937+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 48 ==== watch-notify(notify (1) cookie 94100922243264 notify 158913789992 ret 0) ==== 194+0+0 (crc 0 0 0) 0x559594062010 con 0x5595940a5970 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.937+0000 7ffa627fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789992 cookie 94100922243264 notifier 4764 bl.length()=152 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.937+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 49 ==== osd_op_reply(163 notify.5 [notify cookie 94100922517120 out=8b] v0'0 uv222 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.937+0000 7ffa627fc640 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7ffa44003d60 con 0x5595940a5970 2024-09-19T11:14:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.937+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 50 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.937+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 51 ==== watch-notify(notify_complete (2) cookie 94100922517120 notify 158913789992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x559594061400 con 0x5595940a5970 2024-09-19T11:14:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.938+0000 7ffa357e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:57.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.938+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94100922255984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f0030 con 0x5595940a1320 2024-09-19T11:14:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.939+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 56 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 94100922255984] v37'222 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.946 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.939+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94100922230352] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f0030 con 0x7ffb6800f070 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.940+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 37 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 94100922230352] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.940+0000 7ffb82b42800 20 remove_watcher() i=0 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.940+0000 7ffb82b42800 2 removed watcher, disabling cache 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.940+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94100922234896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f0030 con 0x5595940a1320 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.941+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 57 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 94100922234896] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.941+0000 7ffb82b42800 20 remove_watcher() i=1 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.941+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94100922227872] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940af810 con 0x5595940aa300 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.942+0000 7ffb7e085640 1 -- 172.21.15.102:0/1256291434 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 94100922227872] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb6804a040 con 0x5595940aa300 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.942+0000 7ffb82b42800 20 remove_watcher() i=2 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.942+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94100922242016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f0030 con 0x7ffb6800f070 2024-09-19T11:14:57.947 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.943+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.2 v2:172.21.15.102:6808/525557096 38 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 94100922242016] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x7ffb6800f070 2024-09-19T11:14:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.943+0000 7ffb82b42800 20 remove_watcher() i=3 2024-09-19T11:14:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.943+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94100922246240] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940adca0 con 0x5595940a1320 2024-09-19T11:14:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.944+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 <== osd.1 v2:172.21.15.102:6816/3609322588 58 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 94100922246240] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb70036040 con 0x5595940a1320 2024-09-19T11:14:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.944+0000 7ffb82b42800 20 remove_watcher() i=4 2024-09-19T11:14:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.944+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94100922243264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940af810 con 0x5595940a5970 2024-09-19T11:14:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.945+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 52 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 94100922243264] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.945+0000 7ffb82b42800 20 remove_watcher() i=5 2024-09-19T11:14:57.948 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.945+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94100922239968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940f0030 con 0x5595940a5970 2024-09-19T11:14:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.946+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 53 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 94100922239968] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.946+0000 7ffb82b42800 20 remove_watcher() i=6 2024-09-19T11:14:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.946+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94100922254560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5595940b2460 con 0x5595940a5970 2024-09-19T11:14:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb7e886640 1 -- 172.21.15.102:0/1256291434 <== osd.0 v2:172.21.15.37:6800/394652614 54 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 94100922254560] v37'224 uv222 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7ffb78096070 con 0x5595940a5970 2024-09-19T11:14:57.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 20 remove_watcher() i=7 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5595940a5970 msgr2=0x5595940a7d60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5595940a5970 0x5595940a7d60 crc :-1 s=READY pgs=156 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5595940a1320 msgr2=0x5595940a37e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5595940a1320 0x5595940a37e0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ffb6800f070 msgr2=0x7ffb6803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7ffb6800f070 0x7ffb6803a3c0 crc :-1 s=READY pgs=84 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5595940aa300 msgr2=0x5595940ac7c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5595940aa300 0x5595940ac7c0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa4803d000 msgr2=0x7ffa4803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa4803d000 0x7ffa4803f4c0 secure :-1 s=READY pgs=280 cs=0 l=1 rev1=1 crypto rx=0x7ffb6800ffd0 tx=0x7ffb68010000 comp rx=0 tx=0).stop 2024-09-19T11:14:57.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 msgr2=0x559594095d80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1256291434 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959408e920 0x559594095d80 secure :-1 s=READY pgs=674 cs=0 l=1 rev1=1 crypto rx=0x7ffb7806a8c0 tx=0x7ffb78066f50 comp rx=0 tx=0).stop 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.947+0000 7ffb7f087640 1 -- 172.21.15.102:0/1256291434 reap_dead start 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 shutdown_connections 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 >> 172.21.15.102:0/1256291434 conn(0x559594086910 msgr2=0x559594084b20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 shutdown_connections 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1256291434 wait complete. 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/111014026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa5803d000 msgr2=0x7ffa5803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/111014026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa5803d000 0x7ffa5803f4c0 secure :-1 s=READY pgs=279 cs=0 l=1 rev1=1 crypto rx=0x5595940704d0 tx=0x7ffb6800f000 comp rx=0 tx=0).stop 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/111014026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959407ddf0 msgr2=0x55959407e210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/111014026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959407ddf0 0x55959407e210 secure :-1 s=READY pgs=672 cs=0 l=1 rev1=1 crypto rx=0x7ffb78098000 tx=0x7ffb7806aa40 comp rx=0 tx=0).stop 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/111014026 shutdown_connections 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/111014026 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa5803d000 0x7ffa5803f4c0 unknown :-1 s=CLOSED pgs=279 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/111014026 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55959407ddf0 0x55959407e210 unknown :-1 s=CLOSED pgs=672 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/111014026 >> 172.21.15.102:0/111014026 conn(0x5595940721a0 msgr2=0x559594072580 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/111014026 shutdown_connections 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/111014026 wait complete. 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559594069690 msgr2=0x55959406ba80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x559594069690 0x55959406ba80 crc :-1 s=READY pgs=155 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559593f6a5e0 msgr2=0x559594067320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x559593f6a5e0 0x559594067320 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55959406d590 msgr2=0x55959406f980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55959406d590 0x55959406f980 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa6403cfb0 msgr2=0x7ffa6403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ffa6403cfb0 0x7ffa6403f470 secure :-1 s=READY pgs=278 cs=0 l=1 rev1=1 crypto rx=0x7ffb68001e30 tx=0x7ffb68001390 comp rx=0 tx=0).stop 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 msgr2=0x559594060c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:57.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb82b42800 1 --2- 172.21.15.102:0/1901369349 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x559593f69bb0 0x559594060c10 secure :-1 s=READY pgs=671 cs=0 l=1 rev1=1 crypto rx=0x7ffb7800a4b0 tx=0x7ffb78003330 comp rx=0 tx=0).stop 2024-09-19T11:14:57.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.948+0000 7ffb7f087640 1 -- 172.21.15.102:0/1901369349 reap_dead start 2024-09-19T11:14:57.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.949+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 shutdown_connections 2024-09-19T11:14:57.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.949+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 >> 172.21.15.102:0/1901369349 conn(0x559593f641d0 msgr2=0x5595940533d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:57.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.949+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 shutdown_connections 2024-09-19T11:14:57.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:57.949+0000 7ffb82b42800 1 -- 172.21.15.102:0/1901369349 wait complete. 2024-09-19T11:14:57.958 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-19T11:14:57.958 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'fud', '--purge-data'] 2024-09-19T11:14:57.958 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid fud --purge-data 2024-09-19T11:14:58.003 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:14:58.004 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:14:58.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.003+0000 7f458942f800 1 Processor -- start 2024-09-19T11:14:58.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.003+0000 7f458942f800 1 -- start start 2024-09-19T11:14:58.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.003+0000 7f458942f800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555bbeec81d0 0x555bbeec85d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.003+0000 7f458942f800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x555bbef5d9d0 con 0x555bbeec8b10 2024-09-19T11:14:58.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.003+0000 7f458942f800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x555bbeddf7d0 con 0x555bbeec81d0 2024-09-19T11:14:58.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.004+0000 7f4586f20640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555bbeec81d0 0x555bbeec85d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.004+0000 7f458671f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x555bbeec8b10 0x555bbef5c2b0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:47924/0 (socket says 172.21.15.102:47924) 2024-09-19T11:14:58.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.004+0000 7f458671f640 1 -- 172.21.15.102:0/1811043165 learned_addr learned my addr 172.21.15.102:0/1811043165 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:14:58.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.004+0000 7f4586f20640 1 -- 172.21.15.102:0/1811043165 >> v1:172.21.15.37:6789/0 conn(0x555bbeec8b10 legacy=0x555bbef5c2b0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.004+0000 7f4586f20640 1 -- 172.21.15.102:0/1811043165 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bbef5ebb0 con 0x555bbeec81d0 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.006+0000 7f4586f20640 1 --2- 172.21.15.102:0/1811043165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbeec85d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4578005fd0 tx=0x7f4578045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=46a63141f7405225 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.006+0000 7f4585f1e640 1 -- 172.21.15.102:0/1811043165 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4578058530 con 0x555bbeec81d0 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.006+0000 7f4585f1e640 1 -- 172.21.15.102:0/1811043165 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f45780586d0 con 0x555bbeec81d0 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.006+0000 7f4585f1e640 1 -- 172.21.15.102:0/1811043165 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45780589d0 con 0x555bbeec81d0 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.006+0000 7f458942f800 1 -- 172.21.15.102:0/1811043165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 msgr2=0x555bbeec85d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.006+0000 7f458942f800 1 --2- 172.21.15.102:0/1811043165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbeec85d0 secure :-1 s=READY pgs=676 cs=0 l=1 rev1=1 crypto rx=0x7f4578005fd0 tx=0x7f4578045c30 comp rx=0 tx=0).stop 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.007+0000 7f458942f800 1 -- 172.21.15.102:0/1811043165 shutdown_connections 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.007+0000 7f458942f800 1 --2- 172.21.15.102:0/1811043165 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbeec85d0 unknown :-1 s=CLOSED pgs=676 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.007+0000 7f458942f800 1 -- 172.21.15.102:0/1811043165 >> 172.21.15.102:0/1811043165 conn(0x555bbef4fbb0 msgr2=0x555bbef51fd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.007+0000 7f458942f800 1 -- 172.21.15.102:0/1811043165 shutdown_connections 2024-09-19T11:14:58.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.007+0000 7f458942f800 1 -- 172.21.15.102:0/1811043165 wait complete. 2024-09-19T11:14:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.020+0000 7f458942f800 1 Processor -- start 2024-09-19T11:14:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.020+0000 7f458942f800 1 -- start start 2024-09-19T11:14:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f458942f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf0464f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f458942f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bbedecdd0 con 0x555bbeec81d0 2024-09-19T11:14:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf0464f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf0464f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44124/0 (socket says 172.21.15.102:44124) 2024-09-19T11:14:58.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f4586f20640 1 -- 172.21.15.102:0/3576216962 learned_addr learned my addr 172.21.15.102:0/3576216962 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:58.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f4586f20640 1 -- 172.21.15.102:0/3576216962 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bbf046ae0 con 0x555bbeec81d0 2024-09-19T11:14:58.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f4586f20640 1 --2- 172.21.15.102:0/3576216962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf0464f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f457800a3f0 tx=0x7f4578051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5eda886fbefe2845 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f4474e09640 1 -- 172.21.15.102:0/3576216962 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4578058a30 con 0x555bbeec81d0 2024-09-19T11:14:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f4474e09640 1 -- 172.21.15.102:0/3576216962 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4578068070 con 0x555bbeec81d0 2024-09-19T11:14:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.021+0000 7f4474e09640 1 -- 172.21.15.102:0/3576216962 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4578058d60 con 0x555bbeec81d0 2024-09-19T11:14:58.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.022+0000 7f458942f800 1 -- 172.21.15.102:0/3576216962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 msgr2=0x555bbf0464f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.022+0000 7f458942f800 1 --2- 172.21.15.102:0/3576216962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf0464f0 secure :-1 s=READY pgs=677 cs=0 l=1 rev1=1 crypto rx=0x7f457800a3f0 tx=0x7f4578051000 comp rx=0 tx=0).stop 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.022+0000 7f458942f800 1 -- 172.21.15.102:0/3576216962 shutdown_connections 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.022+0000 7f458942f800 1 --2- 172.21.15.102:0/3576216962 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf0464f0 unknown :-1 s=CLOSED pgs=677 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.022+0000 7f458942f800 1 -- 172.21.15.102:0/3576216962 >> 172.21.15.102:0/3576216962 conn(0x555bbef4fbb0 msgr2=0x555bbf041e70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.022+0000 7f458942f800 1 -- 172.21.15.102:0/3576216962 shutdown_connections 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.022+0000 7f458942f800 1 -- 172.21.15.102:0/3576216962 wait complete. 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.022+0000 7f458942f800 1 Processor -- start 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f458942f800 1 -- start start 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f458942f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf04de80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f458942f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bbef5dde0 con 0x555bbeec81d0 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf04de80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf04de80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44132/0 (socket says 172.21.15.102:44132) 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f4586f20640 1 -- 172.21.15.102:0/796374864 learned_addr learned my addr 172.21.15.102:0/796374864 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f4586f20640 1 -- 172.21.15.102:0/796374864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bbf04e3e0 con 0x555bbeec81d0 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f4586f20640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf04de80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4578065040 tx=0x7f4578003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f4473606640 1 -- 172.21.15.102:0/796374864 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4578063680 con 0x555bbeec81d0 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f4473606640 1 -- 172.21.15.102:0/796374864 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4578063820 con 0x555bbeec81d0 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bbf04e670 con 0x555bbeec81d0 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.023+0000 7f4473606640 1 -- 172.21.15.102:0/796374864 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4578063b00 con 0x555bbeec81d0 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.024+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bbf04f070 con 0x555bbeec81d0 2024-09-19T11:14:58.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.024+0000 7f4473606640 1 -- 172.21.15.102:0/796374864 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4578075020 con 0x555bbeec81d0 2024-09-19T11:14:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f4473606640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446c03cfb0 0x7f446c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f4473606640 1 -- 172.21.15.102:0/796374864 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4578098bf0 con 0x555bbeec81d0 2024-09-19T11:14:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f458671f640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446c03cfb0 0x7f446c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f458942f800 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbeec8b10 0x555bbf0554d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf055a10 con 0x555bbeec8b10 2024-09-19T11:14:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f4587721640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbeec8b10 0x555bbf0554d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f458671f640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446c03cfb0 0x7f446c03f470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f457c001d70 tx=0x7f457c0012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f4587721640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbeec8b10 0x555bbf0554d0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f4587721640 1 -- 172.21.15.102:0/796374864 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45800083e0 con 0x555bbeec8b10 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.025+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf055db0 con 0x555bbeec8b10 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.026+0000 7f4587721640 1 -- 172.21.15.102:0/796374864 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f45800083e0 con 0x555bbeec8b10 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.026+0000 7f458942f800 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf057870 0x555bbf059d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.026+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf05a4a0 con 0x555bbf057870 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.026+0000 7f4586f20640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf057870 0x555bbf059d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.026+0000 7f4586f20640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf057870 0x555bbf059d10 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.027+0000 7f4586f20640 1 -- 172.21.15.102:0/796374864 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf057870 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.027+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf056600 con 0x555bbeec8b10 2024-09-19T11:14:58.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.027+0000 7f4587721640 1 -- 172.21.15.102:0/796374864 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f45800083e0 con 0x555bbeec8b10 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.027+0000 7f458942f800 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf05b900 0x555bbf05dcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.027+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf05e480 con 0x555bbf05b900 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.027+0000 7f458671f640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf05b900 0x555bbf05dcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.027+0000 7f458671f640 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf05b900 0x555bbf05dcf0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.027+0000 7f458671f640 1 -- 172.21.15.102:0/796374864 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f457c009050 con 0x555bbf05b900 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.028+0000 7f458942f800 1 Processor -- start 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.028+0000 7f458942f800 1 -- start start 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.028+0000 7f458942f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf06c200 0x555bbf06c620 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.028+0000 7f458942f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bbee4b4a0 con 0x555bbf06c200 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.028+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf06c200 0x555bbf06c620 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.028+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf06c200 0x555bbf06c620 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44144/0 (socket says 172.21.15.102:44144) 2024-09-19T11:14:58.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.028+0000 7f4586f20640 1 -- 172.21.15.102:0/4080858604 learned_addr learned my addr 172.21.15.102:0/4080858604 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.028+0000 7f4586f20640 1 -- 172.21.15.102:0/4080858604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bbf06cc60 con 0x555bbf06c200 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.029+0000 7f4586f20640 1 --2- 172.21.15.102:0/4080858604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf06c200 0x555bbf06c620 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4578096ee0 tx=0x7f45780062f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.029+0000 7f4470e01640 1 -- 172.21.15.102:0/4080858604 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457806cae0 con 0x555bbf06c200 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.029+0000 7f4470e01640 1 -- 172.21.15.102:0/4080858604 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f457806cc80 con 0x555bbf06c200 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.029+0000 7f458942f800 1 -- 172.21.15.102:0/4080858604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bbf06d490 con 0x555bbf06c200 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.029+0000 7f4470e01640 1 -- 172.21.15.102:0/4080858604 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f457806c550 con 0x555bbf06c200 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.029+0000 7f458942f800 1 -- 172.21.15.102:0/4080858604 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bbf06da30 con 0x555bbf06c200 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.029+0000 7f4470e01640 1 -- 172.21.15.102:0/4080858604 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f457806c6f0 con 0x555bbf06c200 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f4470e01640 1 --2- 172.21.15.102:0/4080858604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446003d000 0x7f446003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f4470e01640 1 -- 172.21.15.102:0/4080858604 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4578089070 con 0x555bbf06c200 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f458671f640 1 --2- 172.21.15.102:0/4080858604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446003d000 0x7f446003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f458942f800 1 Processor -- start 2024-09-19T11:14:58.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f458671f640 1 --2- 172.21.15.102:0/4080858604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446003d000 0x7f446003f4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bf40 tx=0x7f457c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f458942f800 1 -- start start 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f458942f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf078e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f458942f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bbf046e50 con 0x555bbf078a40 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf078e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf078e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44160/0 (socket says 172.21.15.102:44160) 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.030+0000 7f4586f20640 1 -- 172.21.15.102:0/564682840 learned_addr learned my addr 172.21.15.102:0/564682840 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f4586f20640 1 -- 172.21.15.102:0/564682840 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bbf079410 con 0x555bbf078a40 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f4586f20640 1 --2- 172.21.15.102:0/564682840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf078e20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f457807cfd0 tx=0x7f4578090690 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b057a397d2214ac server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f446a7fc640 1 -- 172.21.15.102:0/564682840 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4578093e00 con 0x555bbf078a40 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f446a7fc640 1 -- 172.21.15.102:0/564682840 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f457807f7d0 con 0x555bbf078a40 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f446a7fc640 1 -- 172.21.15.102:0/564682840 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45780824b0 con 0x555bbf078a40 2024-09-19T11:14:58.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f458942f800 1 -- 172.21.15.102:0/564682840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 msgr2=0x555bbf078e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f458942f800 1 --2- 172.21.15.102:0/564682840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf078e20 secure :-1 s=READY pgs=680 cs=0 l=1 rev1=1 crypto rx=0x7f457807cfd0 tx=0x7f4578090690 comp rx=0 tx=0).stop 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f458942f800 1 -- 172.21.15.102:0/564682840 shutdown_connections 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f458942f800 1 --2- 172.21.15.102:0/564682840 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf078e20 unknown :-1 s=CLOSED pgs=680 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f458942f800 1 -- 172.21.15.102:0/564682840 >> 172.21.15.102:0/564682840 conn(0x555bbf074e40 msgr2=0x555bbf073080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f458942f800 1 -- 172.21.15.102:0/564682840 shutdown_connections 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.031+0000 7f458942f800 1 -- 172.21.15.102:0/564682840 wait complete. 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.032+0000 7f458942f800 1 Processor -- start 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.032+0000 7f458942f800 1 -- start start 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.032+0000 7f458942f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf07fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.032+0000 7f458942f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x555bbf0798a0 con 0x555bbf078a40 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.032+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf07fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.032+0000 7f4586f20640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf07fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:44170/0 (socket says 172.21.15.102:44170) 2024-09-19T11:14:58.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.032+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 learned_addr learned my addr 172.21.15.102:0/3651051151 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:14:58.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.032+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555bbf0803c0 con 0x555bbf078a40 2024-09-19T11:14:58.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.033+0000 7f4586f20640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf07fe60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f45780823f0 tx=0x7f4578073e90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.033+0000 7f4468ff9640 1 -- 172.21.15.102:0/3651051151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f45780ba020 con 0x555bbf078a40 2024-09-19T11:14:58.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.033+0000 7f4468ff9640 1 -- 172.21.15.102:0/3651051151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4578090e80 con 0x555bbf078a40 2024-09-19T11:14:58.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.033+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555bbf0803c0 con 0x555bbf078a40 2024-09-19T11:14:58.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.033+0000 7f4468ff9640 1 -- 172.21.15.102:0/3651051151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4578081d80 con 0x555bbf078a40 2024-09-19T11:14:58.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.033+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555bbf0803c0 con 0x555bbf078a40 2024-09-19T11:14:58.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.033+0000 7f4468ff9640 1 -- 172.21.15.102:0/3651051151 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f45780bd020 con 0x555bbf078a40 2024-09-19T11:14:58.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.034+0000 7f4468ff9640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f445003d000 0x7f445003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.034+0000 7f4468ff9640 1 -- 172.21.15.102:0/3651051151 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f45780a8050 con 0x555bbf078a40 2024-09-19T11:14:58.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.034+0000 7f458671f640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f445003d000 0x7f445003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.034+0000 7f458671f640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f445003d000 0x7f445003f4c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c010 tx=0x7f457c010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.034+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.034+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbf08b450 0x555bbf08d910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.034+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08e060 con 0x555bbf08b450 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.034+0000 7f4587721640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbf08b450 0x555bbf08d910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f4587721640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbf08b450 0x555bbf08d910 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45800083e0 con 0x555bbf08b450 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 20 realm 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08e470 con 0x555bbf08b450 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45800083e0 con 0x555bbf08b450 2024-09-19T11:14:58.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f45800083e0 con 0x555bbf08b450 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.035+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08f0e0 con 0x555bbf08b450 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.036+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f45800083e0 con 0x555bbf08b450 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.036+0000 7f458942f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.036+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.036+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf08faa0 0x555bbf091e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.036+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0924e0 con 0x555bbf08faa0 2024-09-19T11:14:58.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.036+0000 7f4586f20640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf08faa0 0x555bbf091e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.036+0000 7f4586f20640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf08faa0 0x555bbf091e90 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458942f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458942f800 20 searching for the correct realm 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf094470 0x555bbf096930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf096fb0 con 0x555bbf094470 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458671f640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf094470 0x555bbf096930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458671f640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf094470 0x555bbf096930 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458671f640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f457c037040 0x7f457c036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.037+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf096fb0 con 0x7f457c037040 2024-09-19T11:14:58.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.038+0000 7f4587721640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f457c037040 0x7f457c036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.038+0000 7f4587721640 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f457c037040 0x7f457c036410 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.038+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45800083e0 con 0x7f457c037040 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.038+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08faa0 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.038+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.038+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f45800083e0 con 0x555bbf08b450 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08faa0 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08faa0 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x7f457c037040 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.039+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf094470 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.040+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.040+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.040+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.040+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08faa0 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.040+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.040+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.040+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.040+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x7f457c037040 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.041+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.041+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf094470 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.041+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.041+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf094470 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.041+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.041+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08faa0 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.041+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.041+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf094470 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.042+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.042+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf094470 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.042+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.042+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.042+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.042+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.042+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.042+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08faa0 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.043+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.043+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf094470 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.043+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.043+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x7f457c037040 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.043+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.043+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.044+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.044+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08faa0 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.044+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.044+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf094470 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.044+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.044+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08faa0 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.044+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.044+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x7f457c037040 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf094470 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x7f457c037040 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x555bbf08b450 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555bbf08ed40 con 0x7f457c037040 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.045+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:14:58.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf092880 con 0x555bbf08b450 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf092880 con 0x555bbf08b450 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf092880 con 0x555bbf094470 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 zone default found 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 4 Realm: () 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 zonegroup default 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.046+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0931d0 con 0x555bbf08faa0 2024-09-19T11:14:58.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf098fb0 con 0x555bbf094470 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0994d0 con 0x555bbf094470 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 20 started sync module instance, tier type = 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.047+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0982c0 con 0x7f457c037040 2024-09-19T11:14:58.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.048+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.048+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93852535457728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0982c0 con 0x7f457c037040 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.048+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf099f50 con 0x555bbf08b450 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.049+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93852535457728] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.049+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.049+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93852535455248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf099f50 con 0x555bbf08b450 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.049+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09a9c0 con 0x555bbf094470 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.050+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93852535455248] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.051+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.051+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93852535462560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf099ec0 con 0x555bbf094470 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.051+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09b780 con 0x7f457c037040 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.052+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.052+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93852535468640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09c020 con 0x7f457c037040 2024-09-19T11:14:58.067 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.052+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09cac0 con 0x555bbf08b450 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.052+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93852535462560] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.053+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93852535468640] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4580026040 con 0x7f457c037040 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.053+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.053+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93852535473552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09bb20 con 0x555bbf08b450 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.053+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09d360 con 0x555bbf08faa0 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.054+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93852535473552] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.054+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.054+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93852535475888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09bad0 con 0x555bbf08faa0 2024-09-19T11:14:58.068 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.054+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09dd20 con 0x555bbf08faa0 2024-09-19T11:14:58.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.055+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93852535475888] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.055+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.055+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93852535467440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09e570 con 0x555bbf08faa0 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.055+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09ef30 con 0x555bbf08faa0 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93852535467440] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'225 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93852535480992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09ef30 con 0x555bbf08faa0 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f458942f800 20 add_watcher() i=0 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f458942f800 20 add_watcher() i=1 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f458942f800 20 add_watcher() i=2 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f458942f800 20 add_watcher() i=3 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f458942f800 20 add_watcher() i=4 2024-09-19T11:14:58.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f458942f800 20 add_watcher() i=5 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.056+0000 7f458942f800 20 add_watcher() i=6 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.057+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93852535480992] v37'226 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.057+0000 7f458942f800 20 add_watcher() i=7 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.057+0000 7f458942f800 2 all 8 watchers are set, enabling cache 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.057+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0a2330 con 0x555bbf08b450 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.057+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.057+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93852535483472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf09f880 con 0x555bbf08b450 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.058+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93852535483472] v37'223 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4580026040 con 0x555bbf08b450 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.058+0000 7f443d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.059+0000 7f458942f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.059+0000 7f458942f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.059+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aac60 con 0x555bbf08b450 2024-09-19T11:14:58.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.060+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.060+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aac60 con 0x555bbf08faa0 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.061+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.061+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aac60 con 0x555bbf094470 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.062+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.062+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aa3c0 con 0x555bbf08b450 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.063+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'224 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.063+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aa3c0 con 0x7f457c037040 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.064+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'71 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.064+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ac1e0 con 0x555bbf094470 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.065+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'48 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.065+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ac690 con 0x555bbf08b450 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.066+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.066+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ac690 con 0x555bbf08faa0 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.067+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'50 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.067+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ac690 con 0x7f457c037040 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.068+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.068+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ac690 con 0x555bbf094470 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.069+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.069+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0acce0 con 0x7f457c037040 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.070+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'72 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.070+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0acc30 con 0x555bbf08faa0 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.071+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.076 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.071+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0acbf0 con 0x7f457c037040 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.072+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.072+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca00 con 0x555bbf08faa0 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.073+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'53 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.073+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca00 con 0x555bbf08b450 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.074+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'225 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.074+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca00 con 0x555bbf094470 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.075+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'65 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.075+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0acaf0 con 0x7f457c037040 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.076+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'73 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.076+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0acaf0 con 0x555bbf094470 2024-09-19T11:14:58.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.077+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'27 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.077+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca90 con 0x555bbf08b450 2024-09-19T11:14:58.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.078+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'35 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.078+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca90 con 0x555bbf08b450 2024-09-19T11:14:58.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.079+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'226 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.079+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca90 con 0x555bbf094470 2024-09-19T11:14:58.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.080+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'66 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.081 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.080+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca90 con 0x7f457c037040 2024-09-19T11:14:58.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.081+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'37 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.082 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.081+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca90 con 0x555bbf094470 2024-09-19T11:14:58.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.082+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'30 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.083 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.082+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca90 con 0x555bbf094470 2024-09-19T11:14:58.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.083+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.084 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.083+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca90 con 0x555bbf094470 2024-09-19T11:14:58.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.084+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'23 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.085 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.084+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0aca90 con 0x555bbf094470 2024-09-19T11:14:58.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.085+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'49 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.086 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.085+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ad300 con 0x555bbf08faa0 2024-09-19T11:14:58.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.086+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'29 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.087 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.086+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ad300 con 0x555bbf094470 2024-09-19T11:14:58.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.087+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.088 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.087+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ad300 con 0x555bbf08faa0 2024-09-19T11:14:58.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.089+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'51 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.090 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.089+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ad300 con 0x555bbf094470 2024-09-19T11:14:58.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.090+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'67 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.091 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.090+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ad300 con 0x555bbf08faa0 2024-09-19T11:14:58.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.091+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'54 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.092 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.091+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ad300 con 0x7f457c037040 2024-09-19T11:14:58.093 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.093+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'33 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.093+0000 7f43b7fff640 20 reqs_thread_entry: start 2024-09-19T11:14:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.093+0000 7f458942f800 20 init_complete bucket index max shards: 11 2024-09-19T11:14:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.093+0000 7f458942f800 20 Filter name: none 2024-09-19T11:14:58.094 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.093+0000 7f43b5ffb640 20 reqs_thread_entry: start 2024-09-19T11:14:58.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.093+0000 7f458942f800 10 cache get: name=default.rgw.meta+users.uid+fud : miss 2024-09-19T11:14:58.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.093+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.095 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.093+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:94 8.e 8:75f48285:users.uid::fud:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0d7a80 con 0x555bbf08faa0 2024-09-19T11:14:58.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(94 fud [call out=48b,read 0~380 out=380b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+503 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f458942f800 20 rados_obj.operate() r=0 bl.length=380 2024-09-19T11:14:58.097 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f458942f800 10 cache put: name=default.rgw.meta+users.uid+fud info.flags=0x13 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f458942f800 10 adding default.rgw.meta+users.uid+fud to cache LRU end 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f458942f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:95 8.1 8:810902b1:users.uid::fud.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0da3b0 con 0x555bbf08faa0 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(95 fud.buckets [call out=186b] v0'0 uv7 ondisk = 0) ==== 155+0+186 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f458942f800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo7:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 : miss 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.094+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:96 8.17 8:ea0aa18e:root::.bucket.meta.myfoo7%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0da270 con 0x555bbf08b450 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(96 .bucket.meta.myfoo7:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 [call out=48b,stat out=16b,read 0~390 out=390b,getxattrs out=218b] v0'0 uv1 ondisk = 0) ==== 334+0+672 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f458942f800 20 rados_obj.operate() r=0 bl.length=390 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f458942f800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo7:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 info.flags=0x17 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f458942f800 10 adding default.rgw.meta+root+.bucket.meta.myfoo7:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 to cache LRU end 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f458942f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:14:58.098 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f458942f800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f458942f800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo7:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:97 4.1e 4:7bfa67a5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf1577e0 con 0x555bbf08faa0 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(97 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.095+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:98 4.2a 4:57eb39b6:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf1577e0 con 0x555bbf08b450 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.096+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(98 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.1 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.096+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:99 4.16 4:6b2dcd70:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf1577e0 con 0x555bbf094470 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.096+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(99 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.2 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.096+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 4.4 4:20567647:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf1577e0 con 0x555bbf08faa0 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.097+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(100 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.099 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.097+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:101 4.15 4:aafe5d79:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf1577e0 con 0x555bbf094470 2024-09-19T11:14:58.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.097+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(101 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.097+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:102 4.3e 4:7fcdce63:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf1577a0 con 0x7f457c037040 2024-09-19T11:14:58.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.097+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(102 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5 [call out=382b] v0'0 uv6 ondisk = 0) ==== 195+0+382 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.097+0000 7f458942f800 10 cls_bucket_list_unordered: got fourteen 2024-09-19T11:14:58.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.097+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:103 4.20 4:0774e674:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf157820 con 0x555bbf08b450 2024-09-19T11:14:58.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.098+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(103 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.098+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:104 4.1d 4:b842b94a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf157820 con 0x555bbf094470 2024-09-19T11:14:58.102 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.098+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(104 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.098+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:105 4.34 4:2e0578e0:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf157820 con 0x7f457c037040 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.098+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(105 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.098+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:106 4.38 4:1ce1ce2d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf157820 con 0x555bbf08b450 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(106 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:107 4.a 4:52b6a0cf:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf1577e0 con 0x7f457c037040 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(107 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 20 get_obj_state: octx=0x7f4580008c60 obj=myfoo7:fourteen state=0x555bbf155868 s->prefetch_data=0 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:108 3.35s0 3:aed7bab7:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10_fourteen:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf157270 con 0x555bbf08b450 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(108 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10_fourteen [call out=24b,getxattrs out=858b,stat out=16b] v0'0 uv1 ondisk = 0) ==== 281+0+898 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 10 manifest: total_size = 8 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 20 get_obj_state: setting s->obj_tag to 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.15881534643184952983 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 20 get_obj_state: octx=0x7f4580008c60 obj=myfoo7:fourteen state=0x555bbf155868 s->prefetch_data=0 2024-09-19T11:14:58.103 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 20 prepare_atomic_modification: state is not atomic. state=0x555bbf155868 2024-09-19T11:14:58.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5 2024-09-19T11:14:58.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.099+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:109 4.3e 4:7fcdce63:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=188b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0de5a0 con 0x7f457c037040 2024-09-19T11:14:58.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.100+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(109 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5 [stat,call,call] v37'7 uv7 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.104 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.100+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:110 3.35s0 3:aed7bab7:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10_fourteen:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0de5a0 con 0x555bbf08b450 2024-09-19T11:14:58.111 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(110 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10_fourteen [call] v37'2 uv2 ondisk = 0) ==== 197+0+0 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:111 4.3e 4:7fcdce63:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=265b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0df030 con 0x7f457c037040 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 20 list_objects_ordered: starting attempt 1 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:112 4.1e 4:7bfa67a5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0df030 con 0x555bbf08faa0 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:113 4.2a 4:57eb39b6:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0e3290 con 0x555bbf08b450 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:114 4.16 4:6b2dcd70:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0e5bf0 con 0x555bbf094470 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:115 4.4 4:20567647:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0e8660 con 0x555bbf08faa0 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:116 4.15 4:aafe5d79:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf094470 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:117 4.3e 4:7fcdce63:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ee1f0 con 0x7f457c037040 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:118 4.20 4:0774e674:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f0ff0 con 0x555bbf08b450 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:119 4.1d 4:b842b94a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f3e40 con 0x555bbf094470 2024-09-19T11:14:58.112 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:120 4.34 4:2e0578e0:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f6cc0 con 0x7f457c037040 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:121 4.38 4:1ce1ce2d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f9af0 con 0x555bbf08b450 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.102+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:122 4.a 4:52b6a0cf:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0fc920 con 0x7f457c037040 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(112 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(113 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.1 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(115 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457806dca0 con 0x555bbf08faa0 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(122 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(121 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(118 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(120 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(114 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.2 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(116 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== osd_op_reply(119 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.113 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 25 ==== osd_op_reply(111 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5 [stat,call,call] v37'8 uv8 ondisk = 0) ==== 279+0+0 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.103+0000 7f4469ffb640 20 handle_completion(): completion ok for obj=fourteen 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 26 ==== osd_op_reply(117 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5 [call out=128b] v0'0 uv8 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo7[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10])"; uploads.size()=0; is_truncated=0 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:123 4.1e 4:7bfa67a5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ee1f0 con 0x555bbf08faa0 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:124 4.2a 4:57eb39b6:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08b450 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:125 4.16 4:6b2dcd70:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f6cc0 con 0x555bbf094470 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:126 4.4 4:20567647:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ee1f0 con 0x555bbf08faa0 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:127 4.15 4:aafe5d79:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f6cc0 con 0x555bbf094470 2024-09-19T11:14:58.114 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:128 4.3e 4:7fcdce63:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x7f457c037040 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:129 4.20 4:0774e674:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f6cc0 con 0x555bbf08b450 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:130 4.1d 4:b842b94a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ee1f0 con 0x555bbf094470 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(130 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.7 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:131 4.34 4:2e0578e0:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0ee1f0 con 0x7f457c037040 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 34 ==== osd_op_reply(125 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.2 [call out=89b] v0'0 uv8 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 35 ==== osd_op_reply(127 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.4 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:132 4.38 4:1ce1ce2d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f6cc0 con 0x555bbf08b450 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(124 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.1 [call out=89b] v0'0 uv9 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:133 4.a 4:52b6a0cf:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x7f457c037040 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(126 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.3 [call out=89b] v0'0 uv7 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(129 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.6 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x555bbf08b450 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(123 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.115 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.104+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 27 ==== osd_op_reply(128 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5 [call out=128b] v0'0 uv8 ondisk = 0) ==== 195+0+128 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.105+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 28 ==== osd_op_reply(131 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.8 [call out=89b] v0'0 uv5 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4580036040 con 0x7f457c037040 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.105+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 29 ==== osd_op_reply(133 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 196+0+89 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.105+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(132 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.9 [call out=89b] v0'0 uv3 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.105+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:134 8.1 8:810902b1:users.uid::fud.buckets:head [call user.set_buckets_info in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f6cc0 con 0x555bbf08faa0 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(134 fud.buckets [call] v37'8 uv8 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f458942f800 10 cache get: name=default.rgw.meta+root+myfoo7 : miss 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:135 8.9 8:938c738d:root::myfoo7:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f6cc0 con 0x7f457c037040 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 30 ==== osd_op_reply(135 myfoo7 [call out=48b,read 0~168 out=168b] v0'0 uv44 ondisk = 0) ==== 192+0+216 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f458942f800 20 rados_obj.operate() r=0 bl.length=168 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f458942f800 10 cache put: name=default.rgw.meta+root+myfoo7 info.flags=0x11 2024-09-19T11:14:58.116 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f458942f800 10 adding default.rgw.meta+root+myfoo7 to cache LRU end 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.106+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:136 8.9 8:938c738d:root::myfoo7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x7f457c037040 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.107+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 31 ==== osd_op_reply(136 myfoo7 [call,call,delete] v37'45 uv45 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.107+0000 7f458942f800 10 removing default.rgw.meta+root+myfoo7 from cache 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.107+0000 7f458942f800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:root:myfoo7, ofs0, ns] 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.107+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:137 7.e 7:7759931f:::notify.3:head [notify cookie 93852535865792 in=162b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x7f457c037040 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.107+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 32 ==== watch-notify(notify (1) cookie 93852535468640 notify 158913789970 ret 0) ==== 192+0+0 (crc 0 0 0) 0x555bbf0d9750 con 0x7f457c037040 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.107+0000 7f446a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789970 cookie 93852535468640 notifier 4771 bl.length()=150 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.108+0000 7f446a7fc640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:138 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f444c003d60 con 0x7f457c037040 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.108+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 33 ==== osd_op_reply(137 notify.3 [notify cookie 93852535865792 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.108+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 34 ==== osd_op_reply(138 notify.3 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.108+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 35 ==== watch-notify(notify_complete (2) cookie 93852535865792 notify 158913789970 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555bbf0aa760 con 0x7f457c037040 2024-09-19T11:14:58.117 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.108+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:139 8.17 8:ea0aa18e:root::.bucket.meta.myfoo7%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(139 .bucket.meta.myfoo7:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 [call,call,delete] v37'2 uv2 ondisk = 0) ==== 292+0+0 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f458942f800 10 removing default.rgw.meta+root+.bucket.meta.myfoo7:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 from cache 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f458942f800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo7:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10, ofs0, ns] 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:140 7.d 7:b4812045:::notify.4:head [notify cookie 93852535726560 in=220b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== watch-notify(notify (1) cookie 93852535473552 notify 158913789981 ret 0) ==== 250+0+0 (crc 0 0 0) 0x555bbf0aa760 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f4469ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789981 cookie 93852535473552 notifier 4771 bl.length()=208 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f4469ffb640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:141 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f43bc0032c0 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(140 notify.4 [notify cookie 93852535726560 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.109+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== osd_op_reply(141 notify.4 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 43 ==== watch-notify(notify_complete (2) cookie 93852535726560 notify 158913789981 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555bbf0a9c50 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:142 4.1e 4:7bfa67a5:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:143 4.2a 4:57eb39b6:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f3c50 con 0x555bbf08b450 2024-09-19T11:14:58.118 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:144 4.16 4:6b2dcd70:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0deb40 con 0x555bbf094470 2024-09-19T11:14:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:145 4.4 4:20567647:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:146 4.15 4:aafe5d79:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f96c0 con 0x555bbf094470 2024-09-19T11:14:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:147 4.3e 4:7fcdce63:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f3c50 con 0x7f457c037040 2024-09-19T11:14:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:148 4.20 4:0774e674:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0fa470 con 0x555bbf08b450 2024-09-19T11:14:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:149 4.1d 4:b842b94a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf094470 2024-09-19T11:14:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:150 4.34 4:2e0578e0:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0deb40 con 0x7f457c037040 2024-09-19T11:14:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:151 4.38 4:1ce1ce2d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f96c0 con 0x555bbf08b450 2024-09-19T11:14:58.119 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.110+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:152 4.a 4:52b6a0cf:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x7f457c037040 2024-09-19T11:14:58.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.111+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 36 ==== osd_op_reply(146 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.4 [delete] v37'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.111+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 37 ==== osd_op_reply(144 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.2 [delete] v37'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.112+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 44 ==== osd_op_reply(143 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.1 [delete] v37'10 uv10 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.112+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(145 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.3 [delete] v37'8 uv8 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.113+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 45 ==== osd_op_reply(148 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.6 [delete] v37'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 36 ==== osd_op_reply(147 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.5 [delete] v37'9 uv9 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 46 ==== osd_op_reply(151 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.9 [delete] v37'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== osd_op_reply(142 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.0 [delete] v37'4 uv4 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 38 ==== osd_op_reply(149 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.7 [delete] v37'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 37 ==== osd_op_reply(152 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.10 [delete] v37'2 uv2 ondisk = 0) ==== 196+0+0 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 38 ==== osd_op_reply(150 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10.8 [delete] v37'6 uv6 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f458942f800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo7/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 : miss 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f458942f800 20 rados->read ofs=0 len=0 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:153 6.10 6:0b8dbe98:::pubsub..bucket.myfoo7%2f32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0fa470 con 0x555bbf08faa0 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(153 pubsub..bucket.myfoo7/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f458942f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f458942f800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo7/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 info.flags=0x0 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f458942f800 10 adding default.rgw.log++pubsub..bucket.myfoo7/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 to cache LRU end 2024-09-19T11:14:58.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.114+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:154 6.10 6:0b8dbe98:::pubsub..bucket.myfoo7%2f32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0f3c50 con 0x555bbf08faa0 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.115+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(154 pubsub..bucket.myfoo7/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.10 [delete] v37'6 uv5 ondisk = -2 ((2) No such file or directory)) ==== 210+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.115+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:155 8.1 8:810902b1:users.uid::fud.buckets:head [call user.remove_bucket in=147b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.116+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== osd_op_reply(155 fud.buckets [call] v37'9 uv9 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.116+0000 7f458942f800 10 removing key index: p5YnriCv1nAtykxBrupQ 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.116+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:156 8.13 8:cc695d75:users.keys::p5YnriCv1nAtykxBrupQ:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.117+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(156 p5YnriCv1nAtykxBrupQ [delete] v37'10 uv10 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.117+0000 7f458942f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.keys:p5YnriCv1nAtykxBrupQ, ofs0, ns] 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.117+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:157 7.15 7:a93a5511:::notify.2:head [notify cookie 93852535842144 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf094470 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.117+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 39 ==== watch-notify(notify (1) cookie 93852535462560 notify 158913789959 ret 0) ==== 212+0+0 (crc 0 0 0) 0x555bbf0a9e20 con 0x555bbf094470 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.117+0000 7f4469ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789959 cookie 93852535462560 notifier 4771 bl.length()=170 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.117+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 40 ==== osd_op_reply(157 notify.2 [notify cookie 93852535842144 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.117+0000 7f4469ffb640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:158 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f43bc0032c0 con 0x555bbf094470 2024-09-19T11:14:58.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.117+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 41 ==== osd_op_reply(158 notify.2 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.118+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 42 ==== watch-notify(notify_complete (2) cookie 93852535842144 notify 158913789959 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555bbf0aa530 con 0x555bbf094470 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.118+0000 7f458942f800 10 removing email index: 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.118+0000 7f458942f800 10 removing user buckets index 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.118+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:159 8.1 8:810902b1:users.uid::fud.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.118+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(159 fud.buckets [delete] v37'10 uv10 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.118+0000 7f458942f800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:users.uid:fud.buckets, ofs0, ns] 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.118+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:160 7.14 7:2b04a3e9:::notify.6:head [notify cookie 93852535842144 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.119+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== watch-notify(notify (1) cookie 93852535467440 notify 158913789993 ret 0) ==== 202+0+0 (crc 0 0 0) 0x555bbf0acad0 con 0x555bbf08faa0 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.119+0000 7f446a7fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789993 cookie 93852535467440 notifier 4771 bl.length()=160 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.119+0000 7f446a7fc640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:161 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f444c003d60 con 0x555bbf08faa0 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.119+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 41 ==== osd_op_reply(160 notify.6 [notify cookie 93852535842144 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.119+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 42 ==== osd_op_reply(161 notify.6 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.119+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 43 ==== watch-notify(notify_complete (2) cookie 93852535842144 notify 158913789993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555bbf06cc60 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.119+0000 7f458942f800 10 removing user index: fud 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.119+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:162 8.e 8:75f48285:users.uid::fud:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.120+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 44 ==== osd_op_reply(162 fud [call,call,delete] v37'7 uv7 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.120+0000 7f458942f800 10 removing default.rgw.meta+users.uid+fud from cache 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.120+0000 7f458942f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:fud, ofs0, ns] 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.120+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 93852535842144 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.120+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 45 ==== watch-notify(notify (1) cookie 93852535475888 notify 158913789994 ret 0) ==== 194+0+0 (crc 0 0 0) 0x555bbf06cc60 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.120+0000 7f4469ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789994 cookie 93852535475888 notifier 4771 bl.length()=152 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.120+0000 7f4469ffb640 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f43bc0032c0 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.120+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 46 ==== osd_op_reply(163 notify.5 [notify cookie 93852535842144 out=8b] v0'0 uv225 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.121+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 47 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.121+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 48 ==== watch-notify(notify_complete (2) cookie 93852535842144 notify 158913789994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x555bbf04f070 con 0x555bbf08faa0 2024-09-19T11:14:58.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.121+0000 7f443d7e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:14:58.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.122+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:165 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93852535483472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08b450 2024-09-19T11:14:58.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.122+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 47 ==== osd_op_reply(165 data_loggenerations_metadata [watch unwatch cookie 93852535483472] v37'227 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.122+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:166 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93852535457728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x7f457c037040 2024-09-19T11:14:58.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.123+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 39 ==== osd_op_reply(166 notify.0 [watch unwatch cookie 93852535457728] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.123+0000 7f458942f800 20 remove_watcher() i=0 2024-09-19T11:14:58.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.123+0000 7f458942f800 2 removed watcher, disabling cache 2024-09-19T11:14:58.130 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.123+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:167 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93852535455248] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08b450 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.124+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 48 ==== osd_op_reply(167 notify.1 [watch unwatch cookie 93852535455248] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.124+0000 7f458942f800 20 remove_watcher() i=1 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.124+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:168 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93852535462560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf094470 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.126+0000 7f458671f640 1 -- 172.21.15.102:0/3651051151 <== osd.3 v2:172.21.15.102:6800/3957239017 43 ==== osd_op_reply(168 notify.2 [watch unwatch cookie 93852535462560] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f457c009050 con 0x555bbf094470 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.126+0000 7f458942f800 20 remove_watcher() i=2 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.126+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:169 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93852535468640] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x7f457c037040 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.126+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.2 v2:172.21.15.102:6808/525557096 40 ==== osd_op_reply(169 notify.3 [watch unwatch cookie 93852535468640] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f458004d070 con 0x7f457c037040 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.127+0000 7f458942f800 20 remove_watcher() i=3 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.127+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:170 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93852535473552] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08b450 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.127+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 <== osd.1 v2:172.21.15.102:6816/3609322588 49 ==== osd_op_reply(170 notify.4 [watch unwatch cookie 93852535473552] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f458004d070 con 0x555bbf08b450 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.128+0000 7f458942f800 20 remove_watcher() i=4 2024-09-19T11:14:58.135 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.128+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:171 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93852535475888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.128+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 49 ==== osd_op_reply(171 notify.5 [watch unwatch cookie 93852535475888] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.129+0000 7f458942f800 20 remove_watcher() i=5 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.129+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:172 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93852535467440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.129+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 50 ==== osd_op_reply(172 notify.6 [watch unwatch cookie 93852535467440] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.129+0000 7f458942f800 20 remove_watcher() i=6 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.129+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:173 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93852535480992] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555bbf0eb420 con 0x555bbf08faa0 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.130+0000 7f4586f20640 1 -- 172.21.15.102:0/3651051151 <== osd.0 v2:172.21.15.37:6800/394652614 51 ==== osd_op_reply(173 notify.7 [watch unwatch cookie 93852535480992] v37'227 uv225 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f45780de040 con 0x555bbf08faa0 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.130+0000 7f458942f800 20 remove_watcher() i=7 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf08faa0 msgr2=0x555bbf091e90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf08faa0 0x555bbf091e90 crc :-1 s=READY pgs=158 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbf08b450 msgr2=0x555bbf08d910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.136 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbf08b450 0x555bbf08d910 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f457c037040 msgr2=0x7f457c036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f457c037040 0x7f457c036410 crc :-1 s=READY pgs=85 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf094470 msgr2=0x555bbf096930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf094470 0x555bbf096930 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f445003d000 msgr2=0x7f445003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f445003d000 0x7f445003f4c0 secure :-1 s=READY pgs=283 cs=0 l=1 rev1=1 crypto rx=0x7f457c00c010 tx=0x7f457c010000 comp rx=0 tx=0).stop 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 msgr2=0x555bbf07fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf07fe60 secure :-1 s=READY pgs=681 cs=0 l=1 rev1=1 crypto rx=0x7f45780823f0 tx=0x7f4578073e90 comp rx=0 tx=0).stop 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f4587721640 1 -- 172.21.15.102:0/3651051151 reap_dead start 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 shutdown_connections 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/3651051151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf078a40 0x555bbf07fe60 unknown :-1 s=CLOSED pgs=681 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 >> 172.21.15.102:0/3651051151 conn(0x555bbf074e40 msgr2=0x555bbf073050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:58.137 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 shutdown_connections 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/3651051151 wait complete. 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/4080858604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446003d000 msgr2=0x7f446003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/4080858604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446003d000 0x7f446003f4c0 secure :-1 s=READY pgs=282 cs=0 l=1 rev1=1 crypto rx=0x7f457c00bf40 tx=0x7f457c00f000 comp rx=0 tx=0).stop 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/4080858604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf06c200 msgr2=0x555bbf06c620 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/4080858604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf06c200 0x555bbf06c620 secure :-1 s=READY pgs=679 cs=0 l=1 rev1=1 crypto rx=0x7f4578096ee0 tx=0x7f45780062f0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/4080858604 shutdown_connections 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/4080858604 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446003d000 0x7f446003f4c0 unknown :-1 s=CLOSED pgs=282 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 --2- 172.21.15.102:0/4080858604 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbf06c200 0x555bbf06c620 unknown :-1 s=CLOSED pgs=679 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/4080858604 >> 172.21.15.102:0/4080858604 conn(0x555bbf0605b0 msgr2=0x555bbf060990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/4080858604 shutdown_connections 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.131+0000 7f458942f800 1 -- 172.21.15.102:0/4080858604 wait complete. 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf057870 msgr2=0x555bbf059d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555bbf057870 0x555bbf059d10 crc :-1 s=READY pgs=157 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbeec8b10 msgr2=0x555bbf0554d0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x555bbeec8b10 0x555bbf0554d0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf05b900 msgr2=0x555bbf05dcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555bbf05b900 0x555bbf05dcf0 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446c03cfb0 msgr2=0x7f446c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f446c03cfb0 0x7f446c03f470 secure :-1 s=READY pgs=281 cs=0 l=1 rev1=1 crypto rx=0x7f457c001d70 tx=0x7f457c0012d0 comp rx=0 tx=0).stop 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 msgr2=0x555bbf04de80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 --2- 172.21.15.102:0/796374864 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555bbeec81d0 0x555bbf04de80 secure :-1 s=READY pgs=678 cs=0 l=1 rev1=1 crypto rx=0x7f4578065040 tx=0x7f4578003330 comp rx=0 tx=0).stop 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f4587721640 1 -- 172.21.15.102:0/796374864 reap_dead start 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 shutdown_connections 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 >> 172.21.15.102:0/796374864 conn(0x555bbef4fbb0 msgr2=0x555bbf0478e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 shutdown_connections 2024-09-19T11:14:58.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:14:58.132+0000 7f458942f800 1 -- 172.21.15.102:0/796374864 wait complete. 2024-09-19T11:15:38.143 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'trim', '--uid', 'foo'] 2024-09-19T11:15:38.143 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'trim', '--uid', 'foo'] 2024-09-19T11:15:38.144 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage trim --uid foo 2024-09-19T11:15:38.196 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:38.196 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:38.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.196+0000 7f3994b75800 1 Processor -- start 2024-09-19T11:15:38.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.196+0000 7f3994b75800 1 -- start start 2024-09-19T11:15:38.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.196+0000 7f3994b75800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a3abaf7510 0x55a3abb8b3b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.196+0000 7f3994b75800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a3abb8b8f0 con 0x55a3abaf6a00 2024-09-19T11:15:38.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.196+0000 7f3994b75800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55a3aba0d7d0 con 0x55a3abaf7510 2024-09-19T11:15:38.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.197+0000 7f3991e5e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a3abaf7510 0x55a3abb8b3b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.197+0000 7f3991e5e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a3abaf7510 0x55a3abb8b3b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51660/0 (socket says 172.21.15.102:51660) 2024-09-19T11:15:38.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.197+0000 7f3991e5e640 1 -- 172.21.15.102:0/2922328669 learned_addr learned my addr 172.21.15.102:0/2922328669 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.197+0000 7f3991e5e640 1 -- 172.21.15.102:0/2922328669 >> v1:172.21.15.37:6789/0 conn(0x55a3abaf6a00 legacy=0x55a3abaf6e00 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.197+0000 7f3991e5e640 1 -- 172.21.15.102:0/2922328669 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3abb8cad0 con 0x55a3abaf7510 2024-09-19T11:15:38.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.199+0000 7f3991e5e640 1 --2- 172.21.15.102:0/2922328669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf7510 0x55a3abb8b3b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f398800a520 tx=0x7f3988045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=71eedc2729b55562 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.199+0000 7f399165d640 1 -- 172.21.15.102:0/2922328669 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3988055070 con 0x55a3abaf7510 2024-09-19T11:15:38.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.199+0000 7f399165d640 1 -- 172.21.15.102:0/2922328669 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f39880515b0 con 0x55a3abaf7510 2024-09-19T11:15:38.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.199+0000 7f399165d640 1 -- 172.21.15.102:0/2922328669 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f39880518d0 con 0x55a3abaf7510 2024-09-19T11:15:38.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.200+0000 7f3994b75800 1 -- 172.21.15.102:0/2922328669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf7510 msgr2=0x55a3abb8b3b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.200+0000 7f3994b75800 1 --2- 172.21.15.102:0/2922328669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf7510 0x55a3abb8b3b0 secure :-1 s=READY pgs=683 cs=0 l=1 rev1=1 crypto rx=0x7f398800a520 tx=0x7f3988045ba0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.200+0000 7f3994b75800 1 -- 172.21.15.102:0/2922328669 shutdown_connections 2024-09-19T11:15:38.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.200+0000 7f3994b75800 1 --2- 172.21.15.102:0/2922328669 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf7510 0x55a3abb8b3b0 unknown :-1 s=CLOSED pgs=683 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.200+0000 7f3994b75800 1 -- 172.21.15.102:0/2922328669 >> 172.21.15.102:0/2922328669 conn(0x55a3abb7dc60 msgr2=0x55a3abb800c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.200+0000 7f3994b75800 1 -- 172.21.15.102:0/2922328669 shutdown_connections 2024-09-19T11:15:38.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.200+0000 7f3994b75800 1 -- 172.21.15.102:0/2922328669 wait complete. 2024-09-19T11:15:38.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.215+0000 7f3994b75800 1 Processor -- start 2024-09-19T11:15:38.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.215+0000 7f3994b75800 1 -- start start 2024-09-19T11:15:38.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.215+0000 7f3994b75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc744f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.215+0000 7f3994b75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a3aba1add0 con 0x55a3abaf6a00 2024-09-19T11:15:38.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.216+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc744f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.216+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc744f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51662/0 (socket says 172.21.15.102:51662) 2024-09-19T11:15:38.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.216+0000 7f399265f640 1 -- 172.21.15.102:0/1977946478 learned_addr learned my addr 172.21.15.102:0/1977946478 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.216+0000 7f399265f640 1 -- 172.21.15.102:0/1977946478 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3abc74ae0 con 0x55a3abaf6a00 2024-09-19T11:15:38.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.216+0000 7f399265f640 1 --2- 172.21.15.102:0/1977946478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc744f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3984001d40 tx=0x7f398400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cd4e0f5bca6fa607 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.220 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.216+0000 7f3880608640 1 -- 172.21.15.102:0/1977946478 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398400f400 con 0x55a3abaf6a00 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3880608640 1 -- 172.21.15.102:0/1977946478 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398400f5a0 con 0x55a3abaf6a00 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3880608640 1 -- 172.21.15.102:0/1977946478 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398400f900 con 0x55a3abaf6a00 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3994b75800 1 -- 172.21.15.102:0/1977946478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 msgr2=0x55a3abc744f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3994b75800 1 --2- 172.21.15.102:0/1977946478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc744f0 secure :-1 s=READY pgs=684 cs=0 l=1 rev1=1 crypto rx=0x7f3984001d40 tx=0x7f398400b5b0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3994b75800 1 -- 172.21.15.102:0/1977946478 shutdown_connections 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3994b75800 1 --2- 172.21.15.102:0/1977946478 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc744f0 unknown :-1 s=CLOSED pgs=684 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3994b75800 1 -- 172.21.15.102:0/1977946478 >> 172.21.15.102:0/1977946478 conn(0x55a3abb7dc60 msgr2=0x55a3abc6fe70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3994b75800 1 -- 172.21.15.102:0/1977946478 shutdown_connections 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.217+0000 7f3994b75800 1 -- 172.21.15.102:0/1977946478 wait complete. 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.218+0000 7f3994b75800 1 Processor -- start 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.218+0000 7f3994b75800 1 -- start start 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.218+0000 7f3994b75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc7bff0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.221 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.218+0000 7f3994b75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a3abb8bdc0 con 0x55a3abaf6a00 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.218+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc7bff0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.218+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc7bff0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51668/0 (socket says 172.21.15.102:51668) 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.218+0000 7f399265f640 1 -- 172.21.15.102:0/3182705327 learned_addr learned my addr 172.21.15.102:0/3182705327 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.219+0000 7f399265f640 1 -- 172.21.15.102:0/3182705327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3abc7c550 con 0x55a3abaf6a00 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.219+0000 7f399265f640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc7bff0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55a3abc75480 tx=0x7f3984000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.219+0000 7f387ee05640 1 -- 172.21.15.102:0/3182705327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398401a7c0 con 0x55a3abaf6a00 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.219+0000 7f387ee05640 1 -- 172.21.15.102:0/3182705327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398401a980 con 0x55a3abaf6a00 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.219+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3abc7c7e0 con 0x55a3abaf6a00 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.219+0000 7f387ee05640 1 -- 172.21.15.102:0/3182705327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398401aca0 con 0x55a3abaf6a00 2024-09-19T11:15:38.222 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.219+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3abc7d3f0 con 0x55a3abaf6a00 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.220+0000 7f387ee05640 1 -- 172.21.15.102:0/3182705327 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3984017070 con 0x55a3abaf6a00 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.220+0000 7f387ee05640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f387803cfb0 0x7f387803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.220+0000 7f387ee05640 1 -- 172.21.15.102:0/3182705327 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f3984015020 con 0x55a3abaf6a00 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.221+0000 7f3991e5e640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f387803cfb0 0x7f387803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.221+0000 7f3994b75800 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abaf7510 0x55a3abc83640 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.221+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abc83b80 con 0x55a3abaf7510 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.221+0000 7f3992e60640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abaf7510 0x55a3abc83640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.221+0000 7f3991e5e640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f387803cfb0 0x7f387803f470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3988057000 tx=0x7f3988052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.225 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.221+0000 7f3992e60640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abaf7510 0x55a3abc83640 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.221+0000 7f3992e60640 1 -- 172.21.15.102:0/3182705327 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abaf7510 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.221+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abc83f20 con 0x55a3abaf7510 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.222+0000 7f3992e60640 1 -- 172.21.15.102:0/3182705327 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abaf7510 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.222+0000 7f3994b75800 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abc85a20 0x55a3abc87ec0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.222+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abc88650 con 0x55a3abc85a20 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.222+0000 7f399265f640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abc85a20 0x55a3abc87ec0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.222+0000 7f399265f640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abc85a20 0x55a3abc87ec0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.223+0000 7f399265f640 1 -- 172.21.15.102:0/3182705327 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f398402e070 con 0x55a3abc85a20 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.223+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abc84770 con 0x55a3abaf7510 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.223+0000 7f3992e60640 1 -- 172.21.15.102:0/3182705327 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abaf7510 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.223+0000 7f3994b75800 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abc89ab0 0x55a3abc8bea0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.223+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abc8c610 con 0x55a3abc89ab0 2024-09-19T11:15:38.226 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.223+0000 7f3991e5e640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abc89ab0 0x55a3abc8bea0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.224+0000 7f3991e5e640 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abc89ab0 0x55a3abc8bea0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.227 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.224+0000 7f3991e5e640 1 -- 172.21.15.102:0/3182705327 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3988057030 con 0x55a3abc89ab0 2024-09-19T11:15:38.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.224+0000 7f3994b75800 1 Processor -- start 2024-09-19T11:15:38.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.224+0000 7f3994b75800 1 -- start start 2024-09-19T11:15:38.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f3994b75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abc9a390 0x55a3abc9a7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.231 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f3994b75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a3aba794a0 con 0x55a3abc9a390 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abc9a390 0x55a3abc9a7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abc9a390 0x55a3abc9a7b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51670/0 (socket says 172.21.15.102:51670) 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f399265f640 1 -- 172.21.15.102:0/31870822 learned_addr learned my addr 172.21.15.102:0/31870822 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f399265f640 1 -- 172.21.15.102:0/31870822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3abc9adf0 con 0x55a3abc9a390 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f399265f640 1 --2- 172.21.15.102:0/31870822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abc9a390 0x55a3abc9a7b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f398400ead0 tx=0x7f398401cdb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f3877fff640 1 -- 172.21.15.102:0/31870822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3984036030 con 0x55a3abc9a390 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.225+0000 7f3877fff640 1 -- 172.21.15.102:0/31870822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3984017c80 con 0x55a3abc9a390 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.226+0000 7f3877fff640 1 -- 172.21.15.102:0/31870822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398401b3d0 con 0x55a3abc9a390 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.226+0000 7f3994b75800 1 -- 172.21.15.102:0/31870822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3abc9b620 con 0x55a3abc9a390 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.226+0000 7f3994b75800 1 -- 172.21.15.102:0/31870822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3abc9b620 con 0x55a3abc9a390 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.226+0000 7f3877fff640 1 -- 172.21.15.102:0/31870822 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3984039070 con 0x55a3abc9a390 2024-09-19T11:15:38.232 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f3877fff640 1 --2- 172.21.15.102:0/31870822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f386c03d000 0x7f386c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f3877fff640 1 -- 172.21.15.102:0/31870822 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f3984037070 con 0x55a3abc9a390 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f3991e5e640 1 --2- 172.21.15.102:0/31870822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f386c03d000 0x7f386c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f3994b75800 1 Processor -- start 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f3994b75800 1 -- start start 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f3991e5e640 1 --2- 172.21.15.102:0/31870822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f386c03d000 0x7f386c03f4c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55a3abc889f0 tx=0x7f3988005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f3994b75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abca6eb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f3994b75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a3abc74f10 con 0x55a3abca6ad0 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abca6eb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abca6eb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51674/0 (socket says 172.21.15.102:51674) 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.227+0000 7f399265f640 1 -- 172.21.15.102:0/4231241221 learned_addr learned my addr 172.21.15.102:0/4231241221 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.228+0000 7f399265f640 1 -- 172.21.15.102:0/4231241221 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3abca74a0 con 0x55a3abca6ad0 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.228+0000 7f399265f640 1 --2- 172.21.15.102:0/4231241221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abca6eb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3984019fd0 tx=0x7f398404bea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f47a82f75c724ef4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.233 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.228+0000 7f3875ffb640 1 -- 172.21.15.102:0/4231241221 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3984031af0 con 0x55a3abca6ad0 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.228+0000 7f3875ffb640 1 -- 172.21.15.102:0/4231241221 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398401c450 con 0x55a3abca6ad0 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.228+0000 7f3875ffb640 1 -- 172.21.15.102:0/4231241221 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3984010070 con 0x55a3abca6ad0 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.228+0000 7f3994b75800 1 -- 172.21.15.102:0/4231241221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 msgr2=0x55a3abca6eb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.228+0000 7f3994b75800 1 --2- 172.21.15.102:0/4231241221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abca6eb0 secure :-1 s=READY pgs=687 cs=0 l=1 rev1=1 crypto rx=0x7f3984019fd0 tx=0x7f398404bea0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 -- 172.21.15.102:0/4231241221 shutdown_connections 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 --2- 172.21.15.102:0/4231241221 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abca6eb0 unknown :-1 s=CLOSED pgs=687 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 -- 172.21.15.102:0/4231241221 >> 172.21.15.102:0/4231241221 conn(0x55a3abca2ed0 msgr2=0x55a3abca1110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 -- 172.21.15.102:0/4231241221 shutdown_connections 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 -- 172.21.15.102:0/4231241221 wait complete. 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 Processor -- start 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 -- start start 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abcade80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.234 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f3994b75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a3abca7930 con 0x55a3abca6ad0 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abcade80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f399265f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abcade80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51678/0 (socket says 172.21.15.102:51678) 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.229+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 learned_addr learned my addr 172.21.15.102:0/2220000343 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.230+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a3abcae3e0 con 0x55a3abca6ad0 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.230+0000 7f399265f640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abcade80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f39840275f0 tx=0x7f3984029ef0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.230+0000 7f3863fff640 1 -- 172.21.15.102:0/2220000343 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3984031450 con 0x55a3abca6ad0 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.230+0000 7f3863fff640 1 -- 172.21.15.102:0/2220000343 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f398401b870 con 0x55a3abca6ad0 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.230+0000 7f3863fff640 1 -- 172.21.15.102:0/2220000343 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f398401c600 con 0x55a3abca6ad0 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.230+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a3abcae3e0 con 0x55a3abca6ad0 2024-09-19T11:15:38.235 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.230+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a3abcae3e0 con 0x55a3abca6ad0 2024-09-19T11:15:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.231+0000 7f3863fff640 1 -- 172.21.15.102:0/2220000343 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f398400e070 con 0x55a3abca6ad0 2024-09-19T11:15:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.232+0000 7f3863fff640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f385c03cf60 0x7f385c03f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.243 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.232+0000 7f3863fff640 1 -- 172.21.15.102:0/2220000343 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f398405c070 con 0x55a3abca6ad0 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.232+0000 7f3991e5e640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f385c03cf60 0x7f385c03f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.232+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.232+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abcb9290 0x55a3abcbb750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.232+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbbea0 con 0x55a3abcb9290 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.232+0000 7f3992e60640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abcb9290 0x55a3abcbb750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.232+0000 7f3991e5e640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f385c03cf60 0x7f385c03f420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3988051580 tx=0x7f398806d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3992e60640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abcb9290 0x55a3abcbb750 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 20 realm 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.244 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbc2b0 con 0x55a3abcb9290 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcb80 con 0x55a3abcb9290 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.233+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.234+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.234+0000 7f3994b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.234+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.245 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.234+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abcbdc80 0x55a3abcc0070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.234+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc0630 con 0x55a3abcbdc80 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.234+0000 7f399265f640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abcbdc80 0x55a3abcc0070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.234+0000 7f399265f640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abcbdc80 0x55a3abcc0070 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3994b75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3994b75800 20 searching for the correct realm 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abcc25e0 0x55a3abcc4aa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc5170 con 0x55a3abcc25e0 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3991e5e640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abcc25e0 0x55a3abcc4aa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3991e5e640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abcc25e0 0x55a3abcc4aa0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3991e5e640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3988069040 0x7f398808b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.235+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc5170 con 0x7f3988069040 2024-09-19T11:15:38.246 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.236+0000 7f3992e60640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3988069040 0x7f398808b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.236+0000 7f3992e60640 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3988069040 0x7f398808b430 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.236+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.236+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcbdc80 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.237+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.237+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.237+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.237+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.237+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.237+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcbdc80 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.238+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.238+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcbdc80 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.238+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.247 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.238+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x7f3988069040 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.238+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.238+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcc25e0 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.238+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.238+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.239+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.239+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcbdc80 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.239+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.239+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.239+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.239+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x7f3988069040 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.239+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.239+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcc25e0 2024-09-19T11:15:38.248 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.240+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.240+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcc25e0 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.240+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.240+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcbdc80 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.240+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.240+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcc25e0 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.241+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.241+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcc25e0 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.241+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.241+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.241+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.241+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.241+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.249 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.241+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcbdc80 2024-09-19T11:15:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.242+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.242+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcc25e0 2024-09-19T11:15:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.242+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.242+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x7f3988069040 2024-09-19T11:15:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.242+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.242+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.242+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.250 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.242+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcbdc80 2024-09-19T11:15:38.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.243+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.256 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.243+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcc25e0 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.243+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.243+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcbdc80 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.244+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.244+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x7f3988069040 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.244+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.244+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcc25e0 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.244+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.244+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x7f3988069040 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.244+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.244+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x55a3abcb9290 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.257 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcbcf20 con 0x7f3988069040 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc0ef0 con 0x55a3abcb9290 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc0ef0 con 0x55a3abcb9290 2024-09-19T11:15:38.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.245+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc0ef0 con 0x55a3abcc25e0 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 20 zone default found 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 4 Realm: () 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 20 zonegroup default 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc17e0 con 0x55a3abcbdc80 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc70e0 con 0x55a3abcc25e0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.246+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc7530 con 0x55a3abcc25e0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.247+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.247+0000 7f3994b75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.247+0000 7f3994b75800 20 started sync module instance, tier type = 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.247+0000 7f3994b75800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:38.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.247+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc6480 con 0x7f3988069040 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.248+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.248+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94161450330496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc6480 con 0x7f3988069040 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.248+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc7ff0 con 0x55a3abcb9290 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.249+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94161450330496] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.249+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.249+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94161450334944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc6480 con 0x55a3abcb9290 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.249+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc8aa0 con 0x55a3abcc25e0 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.250+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94161450334944] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.251+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.251+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94161450328016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc63f0 con 0x55a3abcc25e0 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.251+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc9960 con 0x7f3988069040 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.252+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.252+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94161450342032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcca120 con 0x7f3988069040 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.252+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccac20 con 0x55a3abcb9290 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.252+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94161450328016] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.253+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.253+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94161450346256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccabe0 con 0x55a3abcb9290 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.253+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94161450342032] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x7f3988069040 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.253+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccb1b0 con 0x55a3abcbdc80 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.254+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94161450346256] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.254+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.254+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94161450339984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccb550 con 0x55a3abcbdc80 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.254+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccbf10 con 0x55a3abcbdc80 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.255+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94161450339984] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.255+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.262 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.256+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94161450343280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccc760 con 0x55a3abcbdc80 2024-09-19T11:15:38.263 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.256+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccd010 con 0x55a3abcbdc80 2024-09-19T11:15:38.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94161450343280] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'228 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.265 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94161450355456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccd270 con 0x55a3abcbdc80 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f3994b75800 20 add_watcher() i=0 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f3994b75800 20 add_watcher() i=1 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f3994b75800 20 add_watcher() i=2 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f3994b75800 20 add_watcher() i=3 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f3994b75800 20 add_watcher() i=4 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f3994b75800 20 add_watcher() i=5 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.257+0000 7f3994b75800 20 add_watcher() i=6 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.258+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94161450355456] v37'229 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.258+0000 7f3994b75800 20 add_watcher() i=7 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.258+0000 7f3994b75800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.258+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcd07b0 con 0x55a3abcb9290 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.258+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.258+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94161450353328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abccdd00 con 0x55a3abcb9290 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.259+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94161450353328] v37'228 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.259+0000 7f3848fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.259+0000 7f3994b75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.259+0000 7f3994b75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 5 note: GC not initialized 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f37c37fe640 20 reqs_thread_entry: start 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 20 Filter name: none 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f37c17fa640 20 reqs_thread_entry: start 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a3abd036b0 con 0x55a3abcb9290 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.260+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abd05fe0 con 0x55a3abcbdc80 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.262+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 usage.10 [call] v37'33 uv33 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.262+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_trim in=55b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abd05fe0 con 0x55a3abcbdc80 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.263+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 usage.10 [call] v37'34 uv33 ondisk = -61 ((61) No data available)) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.264+0000 7f3848fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:38.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.264+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94161450353328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcb2070 con 0x55a3abcb9290 2024-09-19T11:15:38.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.265+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 data_loggenerations_metadata [watch unwatch cookie 94161450353328] v37'229 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f398c00a4d0 con 0x55a3abcb9290 2024-09-19T11:15:38.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.265+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94161450330496] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcb2070 con 0x7f3988069040 2024-09-19T11:15:38.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.266+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 notify.0 [watch unwatch cookie 94161450330496] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c040040 con 0x7f3988069040 2024-09-19T11:15:38.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.266+0000 7f3994b75800 20 remove_watcher() i=0 2024-09-19T11:15:38.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.266+0000 7f3994b75800 2 removed watcher, disabling cache 2024-09-19T11:15:38.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.266+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94161450334944] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc6980 con 0x55a3abcb9290 2024-09-19T11:15:38.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.268+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(67 notify.1 [watch unwatch cookie 94161450334944] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c040040 con 0x55a3abcb9290 2024-09-19T11:15:38.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.268+0000 7f3994b75800 20 remove_watcher() i=1 2024-09-19T11:15:38.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.268+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94161450328016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcb2070 con 0x55a3abcc25e0 2024-09-19T11:15:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.269+0000 7f3991e5e640 1 -- 172.21.15.102:0/2220000343 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(68 notify.2 [watch unwatch cookie 94161450328016] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3988057030 con 0x55a3abcc25e0 2024-09-19T11:15:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.269+0000 7f3994b75800 20 remove_watcher() i=2 2024-09-19T11:15:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.269+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:69 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94161450342032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc7ae0 con 0x7f3988069040 2024-09-19T11:15:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.270+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(69 notify.3 [watch unwatch cookie 94161450342032] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c040040 con 0x7f3988069040 2024-09-19T11:15:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.270+0000 7f3994b75800 20 remove_watcher() i=3 2024-09-19T11:15:38.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.270+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94161450346256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc6980 con 0x55a3abcb9290 2024-09-19T11:15:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.271+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(70 notify.4 [watch unwatch cookie 94161450346256] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f398c040040 con 0x55a3abcb9290 2024-09-19T11:15:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.271+0000 7f3994b75800 20 remove_watcher() i=4 2024-09-19T11:15:38.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.271+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94161450339984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc5fd0 con 0x55a3abcbdc80 2024-09-19T11:15:38.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.273+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.5 [watch unwatch cookie 94161450339984] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.273+0000 7f3994b75800 20 remove_watcher() i=5 2024-09-19T11:15:38.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.273+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94161450343280] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc9690 con 0x55a3abcbdc80 2024-09-19T11:15:38.280 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.280+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.6 [watch unwatch cookie 94161450343280] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.280+0000 7f3994b75800 20 remove_watcher() i=6 2024-09-19T11:15:38.281 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.280+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94161450355456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55a3abcc7ae0 con 0x55a3abcbdc80 2024-09-19T11:15:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f399265f640 1 -- 172.21.15.102:0/2220000343 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(73 notify.7 [watch unwatch cookie 94161450355456] v37'230 uv228 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3984078070 con 0x55a3abcbdc80 2024-09-19T11:15:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 20 remove_watcher() i=7 2024-09-19T11:15:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abcbdc80 msgr2=0x55a3abcc0070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abcbdc80 0x55a3abcc0070 crc :-1 s=READY pgs=160 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abcb9290 msgr2=0x55a3abcbb750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abcb9290 0x55a3abcbb750 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3988069040 msgr2=0x7f398808b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3988069040 0x7f398808b430 crc :-1 s=READY pgs=86 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abcc25e0 msgr2=0x55a3abcc4aa0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abcc25e0 0x55a3abcc4aa0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f385c03cf60 msgr2=0x7f385c03f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f385c03cf60 0x7f385c03f420 secure :-1 s=READY pgs=286 cs=0 l=1 rev1=1 crypto rx=0x7f3988051580 tx=0x7f398806d040 comp rx=0 tx=0).stop 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 msgr2=0x55a3abcade80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3992e60640 1 -- 172.21.15.102:0/2220000343 reap_dead start 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abcade80 secure :-1 s=READY pgs=688 cs=0 l=1 rev1=1 crypto rx=0x7f39840275f0 tx=0x7f3984029ef0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 shutdown_connections 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 --2- 172.21.15.102:0/2220000343 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abca6ad0 0x55a3abcade80 unknown :-1 s=CLOSED pgs=688 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 >> 172.21.15.102:0/2220000343 conn(0x55a3abca2ed0 msgr2=0x55a3abca10e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 shutdown_connections 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.281+0000 7f3994b75800 1 -- 172.21.15.102:0/2220000343 wait complete. 2024-09-19T11:15:38.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/31870822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f386c03d000 msgr2=0x7f386c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/31870822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f386c03d000 0x7f386c03f4c0 secure :-1 s=READY pgs=285 cs=0 l=1 rev1=1 crypto rx=0x55a3abc889f0 tx=0x7f3988005ac0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/31870822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abc9a390 msgr2=0x55a3abc9a7b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/31870822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abc9a390 0x55a3abc9a7b0 secure :-1 s=READY pgs=686 cs=0 l=1 rev1=1 crypto rx=0x7f398400ead0 tx=0x7f398401cdb0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/31870822 shutdown_connections 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/31870822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f386c03d000 0x7f386c03f4c0 unknown :-1 s=CLOSED pgs=285 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/31870822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abc9a390 0x55a3abc9a7b0 unknown :-1 s=CLOSED pgs=686 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/31870822 >> 172.21.15.102:0/31870822 conn(0x55a3abc8e740 msgr2=0x55a3abc8eb20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/31870822 shutdown_connections 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/31870822 wait complete. 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abc85a20 msgr2=0x55a3abc87ec0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a3abc85a20 0x55a3abc87ec0 crc :-1 s=READY pgs=159 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abaf7510 msgr2=0x55a3abc83640 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a3abaf7510 0x55a3abc83640 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abc89ab0 msgr2=0x55a3abc8bea0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55a3abc89ab0 0x55a3abc8bea0 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f387803cfb0 msgr2=0x7f387803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f387803cfb0 0x7f387803f470 secure :-1 s=READY pgs=284 cs=0 l=1 rev1=1 crypto rx=0x7f3988057000 tx=0x7f3988052000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 msgr2=0x55a3abc7bff0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 --2- 172.21.15.102:0/3182705327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a3abaf6a00 0x55a3abc7bff0 secure :-1 s=READY pgs=685 cs=0 l=1 rev1=1 crypto rx=0x55a3abc75480 tx=0x7f3984000bc0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3992e60640 1 -- 172.21.15.102:0/3182705327 reap_dead start 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 shutdown_connections 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 >> 172.21.15.102:0/3182705327 conn(0x55a3abb7dc60 msgr2=0x55a3abc759e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 shutdown_connections 2024-09-19T11:15:38.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.282+0000 7f3994b75800 1 -- 172.21.15.102:0/3182705327 wait complete. 2024-09-19T11:15:38.292 INFO:tasks.util.rgw:rgwadmin: client.0 : ['usage', 'show', '--uid', 'foo'] 2024-09-19T11:15:38.292 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'usage', 'show', '--uid', 'foo'] 2024-09-19T11:15:38.292 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph usage show --uid foo 2024-09-19T11:15:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:38.336 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66def22800 1 Processor -- start 2024-09-19T11:15:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66def22800 1 -- start start 2024-09-19T11:15:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66def22800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c395833690 0x55c395834390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66def22800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55c395833d40 con 0x55c3958348d0 2024-09-19T11:15:38.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66def22800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55c3956bf7d0 con 0x55c395833690 2024-09-19T11:15:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66dabae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c395833690 0x55c395834390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66dabae640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55c395833690 0x55c395834390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51686/0 (socket says 172.21.15.102:51686) 2024-09-19T11:15:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66dabae640 1 -- 172.21.15.102:0/379727826 learned_addr learned my addr 172.21.15.102:0/379727826 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66da3ad640 1 --1- 172.21.15.102:0/379727826 >> v1:172.21.15.37:6789/0 conn(0x55c3958348d0 0x55c395839630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:33400/0 (socket says 172.21.15.102:33400) 2024-09-19T11:15:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66dabae640 1 -- 172.21.15.102:0/379727826 >> v1:172.21.15.37:6789/0 conn(0x55c3958348d0 legacy=0x55c395839630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.336+0000 7f66dabae640 1 -- 172.21.15.102:0/379727826 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c395834d80 con 0x55c395833690 2024-09-19T11:15:38.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.338+0000 7f66dabae640 1 --2- 172.21.15.102:0/379727826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c395834390 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00a520 tx=0x7f66cc045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c09d5bc1b373e07f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.338+0000 7f66d9bac640 1 -- 172.21.15.102:0/379727826 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc055070 con 0x55c395833690 2024-09-19T11:15:38.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.338+0000 7f66d9bac640 1 -- 172.21.15.102:0/379727826 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc0515b0 con 0x55c395833690 2024-09-19T11:15:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.338+0000 7f66d9bac640 1 -- 172.21.15.102:0/379727826 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc0518d0 con 0x55c395833690 2024-09-19T11:15:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.339+0000 7f66def22800 1 -- 172.21.15.102:0/379727826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 msgr2=0x55c395834390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.339+0000 7f66def22800 1 --2- 172.21.15.102:0/379727826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c395834390 secure :-1 s=READY pgs=690 cs=0 l=1 rev1=1 crypto rx=0x7f66cc00a520 tx=0x7f66cc045ba0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.339+0000 7f66def22800 1 -- 172.21.15.102:0/379727826 shutdown_connections 2024-09-19T11:15:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.339+0000 7f66def22800 1 --2- 172.21.15.102:0/379727826 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c395834390 unknown :-1 s=CLOSED pgs=690 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.339+0000 7f66def22800 1 -- 172.21.15.102:0/379727826 >> 172.21.15.102:0/379727826 conn(0x55c39582ea60 msgr2=0x55c395830ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.339+0000 7f66def22800 1 -- 172.21.15.102:0/379727826 shutdown_connections 2024-09-19T11:15:38.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.339+0000 7f66def22800 1 -- 172.21.15.102:0/379727826 wait complete. 2024-09-19T11:15:38.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.353+0000 7f66def22800 1 Processor -- start 2024-09-19T11:15:38.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.353+0000 7f66def22800 1 -- start start 2024-09-19T11:15:38.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.353+0000 7f66def22800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c3959231d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.353+0000 7f66def22800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c3956ccdd0 con 0x55c395833690 2024-09-19T11:15:38.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.353+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c3959231d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.353+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c3959231d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51698/0 (socket says 172.21.15.102:51698) 2024-09-19T11:15:38.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.353+0000 7f66dabae640 1 -- 172.21.15.102:0/3865339306 learned_addr learned my addr 172.21.15.102:0/3865339306 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.354+0000 7f66dabae640 1 -- 172.21.15.102:0/3865339306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3959237c0 con 0x55c395833690 2024-09-19T11:15:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.354+0000 7f66dabae640 1 --2- 172.21.15.102:0/3865339306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c3959231d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f66cc025da0 tx=0x7f66cc051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2eadebab7ddf9541 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.354+0000 7f65c8e09640 1 -- 172.21.15.102:0/3865339306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc051890 con 0x55c395833690 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.354+0000 7f65c8e09640 1 -- 172.21.15.102:0/3865339306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc051ac0 con 0x55c395833690 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.354+0000 7f65c8e09640 1 -- 172.21.15.102:0/3865339306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc051da0 con 0x55c395833690 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 -- 172.21.15.102:0/3865339306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 msgr2=0x55c3959231d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 --2- 172.21.15.102:0/3865339306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c3959231d0 secure :-1 s=READY pgs=691 cs=0 l=1 rev1=1 crypto rx=0x7f66cc025da0 tx=0x7f66cc051000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 -- 172.21.15.102:0/3865339306 shutdown_connections 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 --2- 172.21.15.102:0/3865339306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c3959231d0 unknown :-1 s=CLOSED pgs=691 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 -- 172.21.15.102:0/3865339306 >> 172.21.15.102:0/3865339306 conn(0x55c39582ea60 msgr2=0x55c39591eb50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 -- 172.21.15.102:0/3865339306 shutdown_connections 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 -- 172.21.15.102:0/3865339306 wait complete. 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 Processor -- start 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 -- start start 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c39592ab00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.355+0000 7f66def22800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c39583ad50 con 0x55c395833690 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c39592ab00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c39592ab00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51700/0 (socket says 172.21.15.102:51700) 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f66dabae640 1 -- 172.21.15.102:0/3708237944 learned_addr learned my addr 172.21.15.102:0/3708237944 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f66dabae640 1 -- 172.21.15.102:0/3708237944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c39592b060 con 0x55c395833690 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f66dabae640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c39592ab00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000c00 tx=0x7f66cc002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f65c7606640 1 -- 172.21.15.102:0/3708237944 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc073070 con 0x55c395833690 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c39592b2f0 con 0x55c395833690 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f65c7606640 1 -- 172.21.15.102:0/3708237944 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc05a450 con 0x55c395833690 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f65c7606640 1 -- 172.21.15.102:0/3708237944 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc05a730 con 0x55c395833690 2024-09-19T11:15:38.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.356+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39592bf00 con 0x55c395833690 2024-09-19T11:15:38.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.357+0000 7f65c7606640 1 -- 172.21.15.102:0/3708237944 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66cc076070 con 0x55c395833690 2024-09-19T11:15:38.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.357+0000 7f65c7606640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65c003cfb0 0x7f65c003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f65c7606640 1 -- 172.21.15.102:0/3708237944 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f66cc062070 con 0x55c395833690 2024-09-19T11:15:38.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f66da3ad640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65c003cfb0 0x7f65c003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f66def22800 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c3958348d0 0x55c395933420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c39592c7a0 con 0x55c3958348d0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f66db3af640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c3958348d0 0x55c395933420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f66da3ad640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65c003cfb0 0x7f65c003f470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f66c4001e80 tx=0x7f66c40013e0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f66db3af640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c3958348d0 0x55c395933420 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f66db3af640 1 -- 172.21.15.102:0/3708237944 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c3958348d0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.358+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c3959339c0 con 0x55c3958348d0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.359+0000 7f66db3af640 1 -- 172.21.15.102:0/3708237944 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c3958348d0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.359+0000 7f66def22800 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c3959357d0 0x55c395937bc0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.359+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c395938290 con 0x55c3959357d0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.359+0000 7f66dabae640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c3959357d0 0x55c395937bc0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.359+0000 7f66dabae640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c3959357d0 0x55c395937bc0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.360+0000 7f66dabae640 1 -- 172.21.15.102:0/3708237944 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f66cc07f070 con 0x55c3959357d0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.360+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c3959346a0 con 0x55c3958348d0 2024-09-19T11:15:38.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.360+0000 7f66db3af640 1 -- 172.21.15.102:0/3708237944 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c3958348d0 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.360+0000 7f66def22800 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c3959396d0 0x55c39593bac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.360+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c39593c1c0 con 0x55c3959396d0 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.360+0000 7f66da3ad640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c3959396d0 0x55c39593bac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.360+0000 7f66da3ad640 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c3959396d0 0x55c39593bac0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66da3ad640 1 -- 172.21.15.102:0/3708237944 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f66c400bda0 con 0x55c3959396d0 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66def22800 1 Processor -- start 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66def22800 1 -- start start 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66def22800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959306a0 0x55c39592ef10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66def22800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c39572b4a0 con 0x55c3959306a0 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959306a0 0x55c39592ef10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959306a0 0x55c39592ef10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51714/0 (socket says 172.21.15.102:51714) 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66dabae640 1 -- 172.21.15.102:0/3647834748 learned_addr learned my addr 172.21.15.102:0/3647834748 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.361+0000 7f66dabae640 1 -- 172.21.15.102:0/3647834748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c395930bc0 con 0x55c3959306a0 2024-09-19T11:15:38.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.362+0000 7f66dabae640 1 --2- 172.21.15.102:0/3647834748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959306a0 0x55c39592ef10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f66cc069000 tx=0x7f66cc065eb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.362+0000 7f65c4e01640 1 -- 172.21.15.102:0/3647834748 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc07d040 con 0x55c3959306a0 2024-09-19T11:15:38.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.362+0000 7f65c4e01640 1 -- 172.21.15.102:0/3647834748 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc064cb0 con 0x55c3959306a0 2024-09-19T11:15:38.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.362+0000 7f66def22800 1 -- 172.21.15.102:0/3647834748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c39592f450 con 0x55c3959306a0 2024-09-19T11:15:38.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.362+0000 7f65c4e01640 1 -- 172.21.15.102:0/3647834748 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc076c60 con 0x55c3959306a0 2024-09-19T11:15:38.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.362+0000 7f66def22800 1 -- 172.21.15.102:0/3647834748 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c39592f9a0 con 0x55c3959306a0 2024-09-19T11:15:38.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f65c4e01640 1 -- 172.21.15.102:0/3647834748 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66cc058070 con 0x55c3959306a0 2024-09-19T11:15:38.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f65c4e01640 1 --2- 172.21.15.102:0/3647834748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65b403cfb0 0x7f65b403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f65c4e01640 1 -- 172.21.15.102:0/3647834748 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f66cc09dac0 con 0x55c3959306a0 2024-09-19T11:15:38.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f66da3ad640 1 --2- 172.21.15.102:0/3647834748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65b403cfb0 0x7f65b403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f66def22800 1 Processor -- start 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f66da3ad640 1 --2- 172.21.15.102:0/3647834748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65b403cfb0 0x7f65b403f470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c39592c220 tx=0x7f66c400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f66def22800 1 -- start start 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f66def22800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c395958df0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.363+0000 7f66def22800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c395923b30 con 0x55c3959589f0 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.364+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c395958df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.364+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c395958df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51718/0 (socket says 172.21.15.102:51718) 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.364+0000 7f66dabae640 1 -- 172.21.15.102:0/3218446245 learned_addr learned my addr 172.21.15.102:0/3218446245 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.364+0000 7f66dabae640 1 -- 172.21.15.102:0/3218446245 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c3959593e0 con 0x55c3959589f0 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.364+0000 7f66dabae640 1 --2- 172.21.15.102:0/3218446245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c395958df0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f66cc064fb0 tx=0x7f66cc08d730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=7bc8aa44f7244e29 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.364+0000 7f65be7fc640 1 -- 172.21.15.102:0/3218446245 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc076e00 con 0x55c3959589f0 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.364+0000 7f65be7fc640 1 -- 172.21.15.102:0/3218446245 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc0ac070 con 0x55c3959589f0 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.364+0000 7f65be7fc640 1 -- 172.21.15.102:0/3218446245 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc098bd0 con 0x55c3959589f0 2024-09-19T11:15:38.377 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 -- 172.21.15.102:0/3218446245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 msgr2=0x55c395958df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 --2- 172.21.15.102:0/3218446245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c395958df0 secure :-1 s=READY pgs=694 cs=0 l=1 rev1=1 crypto rx=0x7f66cc064fb0 tx=0x7f66cc08d730 comp rx=0 tx=0).stop 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 -- 172.21.15.102:0/3218446245 shutdown_connections 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 --2- 172.21.15.102:0/3218446245 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c395958df0 unknown :-1 s=CLOSED pgs=694 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 -- 172.21.15.102:0/3218446245 >> 172.21.15.102:0/3218446245 conn(0x55c395954df0 msgr2=0x55c395953030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 -- 172.21.15.102:0/3218446245 shutdown_connections 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 -- 172.21.15.102:0/3218446245 wait complete. 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 Processor -- start 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 -- start start 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c39595fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66def22800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55c395959850 con 0x55c3959589f0 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c39595fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66dabae640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c39595fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:51730/0 (socket says 172.21.15.102:51730) 2024-09-19T11:15:38.378 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.365+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 learned_addr learned my addr 172.21.15.102:0/1355883799 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.366+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55c395960370 con 0x55c3959589f0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.366+0000 7f66dabae640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c39595fe10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f66cc08d770 tx=0x7f66cc074fa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.366+0000 7f65bcff9640 1 -- 172.21.15.102:0/1355883799 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc0b9030 con 0x55c3959589f0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.366+0000 7f65bcff9640 1 -- 172.21.15.102:0/1355883799 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f66cc076e00 con 0x55c3959589f0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.366+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55c395960370 con 0x55c3959589f0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.366+0000 7f65bcff9640 1 -- 172.21.15.102:0/1355883799 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f66cc098370 con 0x55c3959589f0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.366+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55c395960810 con 0x55c3959589f0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.367+0000 7f65bcff9640 1 -- 172.21.15.102:0/1355883799 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f66cc0bc030 con 0x55c3959589f0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f65bcff9640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65a403cfb0 0x7f65a403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f65bcff9640 1 -- 172.21.15.102:0/1355883799 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f66cc0ba070 con 0x55c3959589f0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f66da3ad640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65a403cfb0 0x7f65a403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c39596b250 0x55c39596d6e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c39596de30 con 0x55c39596b250 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f66db3af640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c39596b250 0x55c39596d6e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f66da3ad640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65a403cfb0 0x7f65a403f470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55c39593c5c0 tx=0x7f66c4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.368+0000 7f66db3af640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c39596b250 0x55c39596d6e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 realm 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c39596e240 con 0x55c39596b250 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eb10 con 0x55c39596b250 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c39596f9a0 0x55c395971d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c3959724d0 con 0x55c39596f9a0 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.369+0000 7f66dabae640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c39596f9a0 0x55c395971d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.370+0000 7f66dabae640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c39596f9a0 0x55c395971d90 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.370+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.370+0000 7f66def22800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.370+0000 7f66def22800 20 searching for the correct realm 2024-09-19T11:15:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.370+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c395974570 0x55c395976a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.370+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c395977100 con 0x55c395974570 2024-09-19T11:15:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.370+0000 7f66da3ad640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c395974570 0x55c395976a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.370+0000 7f66da3ad640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c395974570 0x55c395976a30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.371+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c4037040 con 0x55c395974570 2024-09-19T11:15:38.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.371+0000 7f66da3ad640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f66c400f070 0x7f66c403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.371+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c395977100 con 0x7f66c400f070 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.371+0000 7f66db3af640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f66c400f070 0x7f66c403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.371+0000 7f66db3af640 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f66c400f070 0x7f66c403a3c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.371+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.371+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596f9a0 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.372+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.372+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.372+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.372+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.372+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.384 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.372+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596f9a0 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.372+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.372+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596f9a0 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.373+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.373+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x7f66c400f070 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.373+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.373+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c395974570 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.373+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c4037040 con 0x55c395974570 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.373+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.373+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.373+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596f9a0 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.385 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x7f66c400f070 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c395974570 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c4037040 con 0x55c395974570 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c395974570 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f66c4037040 con 0x55c395974570 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.374+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596f9a0 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.375+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.375+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c395974570 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.375+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c4037040 con 0x55c395974570 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.375+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c395974570 2024-09-19T11:15:38.386 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.375+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c4037040 con 0x55c395974570 2024-09-19T11:15:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.375+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.375+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.387 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.375+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.376+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.376+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596f9a0 2024-09-19T11:15:38.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.376+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.376+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c395974570 2024-09-19T11:15:38.397 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.376+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c4037040 con 0x55c395974570 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.376+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x7f66c400f070 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.376+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.376+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.377+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.377+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596f9a0 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.377+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.377+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c395974570 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.377+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c4037040 con 0x55c395974570 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.377+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596f9a0 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x7f66c400f070 2024-09-19T11:15:38.398 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c395974570 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66c4049040 con 0x55c395974570 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x7f66c400f070 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x55c39596b250 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.378+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55c39596eeb0 con 0x7f66c400f070 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:38.399 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c395972e70 con 0x55c39596b250 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c395972e70 con 0x55c39596b250 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.400 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c395972e70 con 0x55c395974570 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f66c4049040 con 0x55c395974570 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 zone default found 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 4 Realm: () 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 zonegroup default 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.379+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c395973710 con 0x55c39596f9a0 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.401 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c395978f70 con 0x55c395974570 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66c4049040 con 0x55c395974570 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c395979340 con 0x55c395974570 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f66c4049040 con 0x55c395974570 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 20 started sync module instance, tier type = 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.380+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395978410 con 0x7f66c400f070 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.381+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.381+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94298516719888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395978410 con 0x7f66c400f070 2024-09-19T11:15:38.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.381+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395979e20 con 0x55c39596b250 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.382+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94298516719888] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.383+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.383+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94298516723984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395978410 con 0x55c39596b250 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.383+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597a8b0 con 0x55c395974570 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.384+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94298516723984] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.384+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66c4049040 con 0x55c395974570 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.384+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94298516717408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395978380 con 0x55c395974570 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.384+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597b770 con 0x7f66c400f070 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.385+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94298516717408] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66c4049040 con 0x55c395974570 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.385+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.385+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94298516730560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597bb90 con 0x7f66c400f070 2024-09-19T11:15:38.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.385+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597c550 con 0x55c39596b250 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.386+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.386+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94298516730560] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x7f66c400f070 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.386+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94298516734112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597c4c0 con 0x55c39596b250 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.386+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597b6e0 con 0x55c39596f9a0 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.387+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.387+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94298516737936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597d860 con 0x55c39596f9a0 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.387+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597e2b0 con 0x55c39596f9a0 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.388+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94298516734112] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.388+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(56 notify.6 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.388+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94298516736320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597eb50 con 0x55c39596f9a0 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.388+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597f510 con 0x55c39596f9a0 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.389+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94298516737936] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.389+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94298516736320] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'231 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94298516743760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597ea70 con 0x55c39596f9a0 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66def22800 20 add_watcher() i=0 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66def22800 20 add_watcher() i=1 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66def22800 20 add_watcher() i=2 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66def22800 20 add_watcher() i=3 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66def22800 20 add_watcher() i=4 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66def22800 20 add_watcher() i=5 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.390+0000 7f66def22800 20 add_watcher() i=6 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.391+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94298516743760] v37'232 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.391+0000 7f66def22800 20 add_watcher() i=7 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.391+0000 7f66def22800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:38.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.391+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c395982540 con 0x55c39596b250 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.391+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.391+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94298516746336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597f930 con 0x55c39596b250 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.392+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94298516746336] v37'230 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.392+0000 7f65917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.392+0000 7f66def22800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.392+0000 7f66def22800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.392+0000 7f66def22800 5 note: GC not initialized 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.392+0000 7f650bfff640 20 reqs_thread_entry: start 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.393+0000 7f66def22800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.393+0000 7f66def22800 20 Filter name: none 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.393+0000 7f6509ffb640 20 reqs_thread_entry: start 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.393+0000 7f66def22800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.393+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c3959b4d60 con 0x55c39596b250 2024-09-19T11:15:38.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.393+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f66d400a4d0 con 0x55c39596b250 2024-09-19T11:15:38.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.393+0000 7f66def22800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:15:38.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.393+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.13 6:cea599e4:usage::usage.10:head [call rgw.user_usage_log_read in=63b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55c3959b6180 con 0x55c39596f9a0 2024-09-19T11:15:38.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.394+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 usage.10 [call out=15b] v0'0 uv33 ondisk = 0) ==== 152+0+15 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.395+0000 7f65917e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:38.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.395+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94298516746336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597f480 con 0x55c39596b250 2024-09-19T11:15:38.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.396+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 data_loggenerations_metadata [watch unwatch cookie 94298516746336] v37'231 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f66d4040040 con 0x55c39596b250 2024-09-19T11:15:38.407 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.396+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94298516719888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597f060 con 0x7f66c400f070 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.397+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(65 notify.0 [watch unwatch cookie 94298516719888] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d4040040 con 0x7f66c400f070 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.397+0000 7f66def22800 20 remove_watcher() i=0 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.397+0000 7f66def22800 2 removed watcher, disabling cache 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.397+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94298516723984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395978910 con 0x55c39596b250 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.398+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(66 notify.1 [watch unwatch cookie 94298516723984] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d4040040 con 0x55c39596b250 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.398+0000 7f66def22800 20 remove_watcher() i=1 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.398+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94298516717408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395978910 con 0x55c395974570 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.399+0000 7f66da3ad640 1 -- 172.21.15.102:0/1355883799 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(67 notify.2 [watch unwatch cookie 94298516717408] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66c4049040 con 0x55c395974570 2024-09-19T11:15:38.412 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.399+0000 7f66def22800 20 remove_watcher() i=2 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.399+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:68 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94298516730560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395977f60 con 0x7f66c400f070 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.400+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(68 notify.3 [watch unwatch cookie 94298516730560] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d4040040 con 0x7f66c400f070 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.400+0000 7f66def22800 20 remove_watcher() i=3 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.400+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94298516734112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597b2c0 con 0x55c39596b250 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.401+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(69 notify.4 [watch unwatch cookie 94298516734112] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66d4040040 con 0x55c39596b250 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.401+0000 7f66def22800 20 remove_watcher() i=4 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.401+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94298516737936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c395977f60 con 0x55c39596f9a0 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.402+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(70 notify.5 [watch unwatch cookie 94298516737936] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.402+0000 7f66def22800 20 remove_watcher() i=5 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.402+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94298516736320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597c0a0 con 0x55c39596f9a0 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.403+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.6 [watch unwatch cookie 94298516736320] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.403+0000 7f66def22800 20 remove_watcher() i=6 2024-09-19T11:15:38.413 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.403+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94298516743760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55c39597b2c0 con 0x55c39596f9a0 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.404+0000 7f66dabae640 1 -- 172.21.15.102:0/1355883799 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(72 notify.7 [watch unwatch cookie 94298516743760] v37'233 uv231 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f66cc0c5070 con 0x55c39596f9a0 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.404+0000 7f66def22800 20 remove_watcher() i=7 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c39596f9a0 msgr2=0x55c395971d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c39596f9a0 0x55c395971d90 crc :-1 s=READY pgs=162 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c39596b250 msgr2=0x55c39596d6e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c39596b250 0x55c39596d6e0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f66c400f070 msgr2=0x7f66c403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f66c400f070 0x7f66c403a3c0 crc :-1 s=READY pgs=87 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c395974570 msgr2=0x55c395976a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c395974570 0x55c395976a30 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65a403cfb0 msgr2=0x7f65a403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65a403cfb0 0x7f65a403f470 secure :-1 s=READY pgs=289 cs=0 l=1 rev1=1 crypto rx=0x55c39593c5c0 tx=0x7f66c4010000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.414 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 msgr2=0x55c39595fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c39595fe10 secure :-1 s=READY pgs=695 cs=0 l=1 rev1=1 crypto rx=0x7f66cc08d770 tx=0x7f66cc074fa0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66db3af640 1 -- 172.21.15.102:0/1355883799 reap_dead start 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 shutdown_connections 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/1355883799 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959589f0 0x55c39595fe10 unknown :-1 s=CLOSED pgs=695 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 >> 172.21.15.102:0/1355883799 conn(0x55c395954df0 msgr2=0x55c395953000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 shutdown_connections 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/1355883799 wait complete. 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/3647834748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65b403cfb0 msgr2=0x7f65b403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/3647834748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65b403cfb0 0x7f65b403f470 secure :-1 s=READY pgs=288 cs=0 l=1 rev1=1 crypto rx=0x55c39592c220 tx=0x7f66c400f000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/3647834748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959306a0 msgr2=0x55c39592ef10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/3647834748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959306a0 0x55c39592ef10 secure :-1 s=READY pgs=693 cs=0 l=1 rev1=1 crypto rx=0x7f66cc069000 tx=0x7f66cc065eb0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.415 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/3647834748 shutdown_connections 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/3647834748 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65b403cfb0 0x7f65b403f470 unknown :-1 s=CLOSED pgs=288 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 --2- 172.21.15.102:0/3647834748 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c3959306a0 0x55c39592ef10 unknown :-1 s=CLOSED pgs=693 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/3647834748 >> 172.21.15.102:0/3647834748 conn(0x55c39593e2f0 msgr2=0x55c39593e6d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/3647834748 shutdown_connections 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.405+0000 7f66def22800 1 -- 172.21.15.102:0/3647834748 wait complete. 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c3959357d0 msgr2=0x55c395937bc0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55c3959357d0 0x55c395937bc0 crc :-1 s=READY pgs=161 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c3958348d0 msgr2=0x55c395933420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55c3958348d0 0x55c395933420 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c3959396d0 msgr2=0x55c39593bac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55c3959396d0 0x55c39593bac0 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.416 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65c003cfb0 msgr2=0x7f65c003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f65c003cfb0 0x7f65c003f470 secure :-1 s=READY pgs=287 cs=0 l=1 rev1=1 crypto rx=0x7f66c4001e80 tx=0x7f66c40013e0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 msgr2=0x55c39592ab00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 --2- 172.21.15.102:0/3708237944 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55c395833690 0x55c39592ab00 secure :-1 s=READY pgs=692 cs=0 l=1 rev1=1 crypto rx=0x7f66cc000c00 tx=0x7f66cc002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66db3af640 1 -- 172.21.15.102:0/3708237944 reap_dead start 2024-09-19T11:15:38.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 shutdown_connections 2024-09-19T11:15:38.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 >> 172.21.15.102:0/3708237944 conn(0x55c39582ea60 msgr2=0x55c39591d340 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 shutdown_connections 2024-09-19T11:15:38.417 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.406+0000 7f66def22800 1 -- 172.21.15.102:0/3708237944 wait complete. 2024-09-19T11:15:38.418 INFO:teuthology.orchestra.run.smithi102.stdout:{"entries":[],"summary":[]} 2024-09-19T11:15:38.419 DEBUG:tasks.util.rgw: json result: {'entries': [], 'summary': []} 2024-09-19T11:15:38.419 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-19T11:15:38.419 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'foo', '--purge-data'] 2024-09-19T11:15:38.419 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid foo --purge-data 2024-09-19T11:15:38.464 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:38.465 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:38.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.464+0000 7f4c68a0e800 1 Processor -- start 2024-09-19T11:15:38.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.464+0000 7f4c68a0e800 1 -- start start 2024-09-19T11:15:38.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.464+0000 7f4c68a0e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x562bd22a9b70 0x562bd22af710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.464+0000 7f4c68a0e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x562bd22a8f50 con 0x562bd22a88a0 2024-09-19T11:15:38.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.464+0000 7f4c68a0e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x562bd21337d0 con 0x562bd22a9b70 2024-09-19T11:15:38.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.465+0000 7f4c5b9bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x562bd22a9b70 0x562bd22af710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.465+0000 7f4c5b9bb640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x562bd22a9b70 0x562bd22af710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39006/0 (socket says 172.21.15.102:39006) 2024-09-19T11:15:38.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.465+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2754418616 learned_addr learned my addr 172.21.15.102:0/2754418616 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.465+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2754418616 >> v1:172.21.15.37:6789/0 conn(0x562bd22a88a0 legacy=0x562bd22a9460 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.465+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2754418616 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd22aa020 con 0x562bd22a9b70 2024-09-19T11:15:38.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.467+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2754418616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a9b70 0x562bd22af710 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00a520 tx=0x7f4c4c045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=34105f0bed5f562c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.467+0000 7f4c639bb640 1 -- 172.21.15.102:0/2754418616 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c4c055070 con 0x562bd22a9b70 2024-09-19T11:15:38.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.467+0000 7f4c639bb640 1 -- 172.21.15.102:0/2754418616 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c4c0515b0 con 0x562bd22a9b70 2024-09-19T11:15:38.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.467+0000 7f4c639bb640 1 -- 172.21.15.102:0/2754418616 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c4c0518d0 con 0x562bd22a9b70 2024-09-19T11:15:38.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.468+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2754418616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a9b70 msgr2=0x562bd22af710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.468+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2754418616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a9b70 0x562bd22af710 secure :-1 s=READY pgs=697 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c00a520 tx=0x7f4c4c045ba0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.468+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2754418616 shutdown_connections 2024-09-19T11:15:38.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.468+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2754418616 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a9b70 0x562bd22af710 unknown :-1 s=CLOSED pgs=697 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.468+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2754418616 >> 172.21.15.102:0/2754418616 conn(0x562bd22a3c70 msgr2=0x562bd22a60d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.468+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2754418616 shutdown_connections 2024-09-19T11:15:38.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.468+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2754418616 wait complete. 2024-09-19T11:15:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.481+0000 7f4c68a0e800 1 Processor -- start 2024-09-19T11:15:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.481+0000 7f4c68a0e800 1 -- start start 2024-09-19T11:15:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.481+0000 7f4c68a0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd23982f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.481+0000 7f4c68a0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562bd2140dd0 con 0x562bd22a88a0 2024-09-19T11:15:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.482+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd23982f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.482+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd23982f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39010/0 (socket says 172.21.15.102:39010) 2024-09-19T11:15:38.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.482+0000 7f4c641bc640 1 -- 172.21.15.102:0/1675587471 learned_addr learned my addr 172.21.15.102:0/1675587471 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.482+0000 7f4c641bc640 1 -- 172.21.15.102:0/1675587471 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd23988e0 con 0x562bd22a88a0 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.482+0000 7f4c641bc640 1 --2- 172.21.15.102:0/1675587471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd23982f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4c54001d40 tx=0x7f4c5400b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ec4606e721c9f844 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.482+0000 7f4b5260c640 1 -- 172.21.15.102:0/1675587471 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c5400f400 con 0x562bd22a88a0 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.482+0000 7f4b5260c640 1 -- 172.21.15.102:0/1675587471 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5400f5a0 con 0x562bd22a88a0 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.482+0000 7f4b5260c640 1 -- 172.21.15.102:0/1675587471 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c5400f900 con 0x562bd22a88a0 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1675587471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 msgr2=0x562bd23982f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/1675587471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd23982f0 secure :-1 s=READY pgs=698 cs=0 l=1 rev1=1 crypto rx=0x7f4c54001d40 tx=0x7f4c5400b5b0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1675587471 shutdown_connections 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/1675587471 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd23982f0 unknown :-1 s=CLOSED pgs=698 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1675587471 >> 172.21.15.102:0/1675587471 conn(0x562bd22a3c70 msgr2=0x562bd2393c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1675587471 shutdown_connections 2024-09-19T11:15:38.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1675587471 wait complete. 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 Processor -- start 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.483+0000 7f4c68a0e800 1 -- start start 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4c68a0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd239fe10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4c68a0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562bd22afe60 con 0x562bd22a88a0 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd239fe10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd239fe10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39014/0 (socket says 172.21.15.102:39014) 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4c641bc640 1 -- 172.21.15.102:0/2341762196 learned_addr learned my addr 172.21.15.102:0/2341762196 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4c641bc640 1 -- 172.21.15.102:0/2341762196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd23a0370 con 0x562bd22a88a0 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4c641bc640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd239fe10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x562bd2399280 tx=0x7f4c54000bc0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4b50e09640 1 -- 172.21.15.102:0/2341762196 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c5401a7c0 con 0x562bd22a88a0 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bd23a0600 con 0x562bd22a88a0 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.484+0000 7f4b50e09640 1 -- 172.21.15.102:0/2341762196 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5401a980 con 0x562bd22a88a0 2024-09-19T11:15:38.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.485+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bd23a1210 con 0x562bd22a88a0 2024-09-19T11:15:38.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.485+0000 7f4b50e09640 1 -- 172.21.15.102:0/2341762196 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c5402c060 con 0x562bd22a88a0 2024-09-19T11:15:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.485+0000 7f4b50e09640 1 -- 172.21.15.102:0/2341762196 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4c54017070 con 0x562bd22a88a0 2024-09-19T11:15:38.495 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4b50e09640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b4c03cfb0 0x7f4b4c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4b50e09640 1 -- 172.21.15.102:0/2341762196 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4c54015020 con 0x562bd22a88a0 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b4c03cfb0 0x7f4b4c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd22a9b70 0x562bd23a7460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23a79a0 con 0x562bd22a9b70 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4c649bd640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd22a9b70 0x562bd23a7460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b4c03cfb0 0x7f4b4c03f470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c057000 tx=0x7f4c4c052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4c649bd640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd22a9b70 0x562bd23a7460 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.486+0000 7f4c649bd640 1 -- 172.21.15.102:0/2341762196 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd22a9b70 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.487+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23a7d40 con 0x562bd22a9b70 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.487+0000 7f4c649bd640 1 -- 172.21.15.102:0/2341762196 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd22a9b70 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.487+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23a9800 0x562bd23abca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.496 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.487+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ac430 con 0x562bd23a9800 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.487+0000 7f4c641bc640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23a9800 0x562bd23abca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.488+0000 7f4c641bc640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23a9800 0x562bd23abca0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.488+0000 7f4c641bc640 1 -- 172.21.15.102:0/2341762196 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4c5401c970 con 0x562bd23a9800 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.488+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23a8590 con 0x562bd22a9b70 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.488+0000 7f4c649bd640 1 -- 172.21.15.102:0/2341762196 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd22a9b70 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.488+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23ad890 0x562bd23afca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.488+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23b0430 con 0x562bd23ad890 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.488+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23ad890 0x562bd23afca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.489+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23ad890 0x562bd23afca0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.489+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2341762196 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23ad890 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.489+0000 7f4c68a0e800 1 Processor -- start 2024-09-19T11:15:38.497 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.489+0000 7f4c68a0e800 1 -- start start 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.489+0000 7f4c68a0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd23be1b0 0x562bd23be5d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.489+0000 7f4c68a0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562bd219f4a0 con 0x562bd23be1b0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd23be1b0 0x562bd23be5d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd23be1b0 0x562bd23be5d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39028/0 (socket says 172.21.15.102:39028) 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4c641bc640 1 -- 172.21.15.102:0/2101817714 learned_addr learned my addr 172.21.15.102:0/2101817714 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4c641bc640 1 -- 172.21.15.102:0/2101817714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd23bec10 con 0x562bd23be1b0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4c641bc640 1 --2- 172.21.15.102:0/2101817714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd23be1b0 0x562bd23be5d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400f500 tx=0x7f4c54030c70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4b49ffb640 1 -- 172.21.15.102:0/2101817714 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54048070 con 0x562bd23be1b0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4b49ffb640 1 -- 172.21.15.102:0/2101817714 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c54049040 con 0x562bd23be1b0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2101817714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bd23bf440 con 0x562bd23be1b0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4b49ffb640 1 -- 172.21.15.102:0/2101817714 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54019bc0 con 0x562bd23be1b0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.490+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2101817714 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bd23bf440 con 0x562bd23be1b0 2024-09-19T11:15:38.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.491+0000 7f4b49ffb640 1 -- 172.21.15.102:0/2101817714 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4c5400e070 con 0x562bd23be1b0 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.491+0000 7f4b49ffb640 1 --2- 172.21.15.102:0/2101817714 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3c03d000 0x7f4b3c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.491+0000 7f4b49ffb640 1 -- 172.21.15.102:0/2101817714 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4c5403fac0 con 0x562bd23be1b0 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.491+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2101817714 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3c03d000 0x7f4b3c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c68a0e800 1 Processor -- start 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c68a0e800 1 -- start start 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2101817714 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3c03d000 0x7f4b3c03f4c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x562bd23a8930 tx=0x7f4c4c005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c68a0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd221cde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c68a0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562bd2398d10 con 0x562bd221ca00 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd221cde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd221cde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39036/0 (socket says 172.21.15.102:39036) 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c641bc640 1 -- 172.21.15.102:0/1488122303 learned_addr learned my addr 172.21.15.102:0/1488122303 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c641bc640 1 -- 172.21.15.102:0/1488122303 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd221d3d0 con 0x562bd221ca00 2024-09-19T11:15:38.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4c641bc640 1 --2- 172.21.15.102:0/1488122303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd221cde0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4c54051c50 tx=0x7f4c54031f20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63af8f7427298207 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.492+0000 7f4b437fe640 1 -- 172.21.15.102:0/1488122303 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54051130 con 0x562bd221ca00 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4b437fe640 1 -- 172.21.15.102:0/1488122303 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5404b300 con 0x562bd221ca00 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4b437fe640 1 -- 172.21.15.102:0/1488122303 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54053010 con 0x562bd221ca00 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1488122303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 msgr2=0x562bd221cde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/1488122303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd221cde0 secure :-1 s=READY pgs=701 cs=0 l=1 rev1=1 crypto rx=0x7f4c54051c50 tx=0x7f4c54031f20 comp rx=0 tx=0).stop 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1488122303 shutdown_connections 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/1488122303 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd221cde0 unknown :-1 s=CLOSED pgs=701 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1488122303 >> 172.21.15.102:0/1488122303 conn(0x562bd23c6ca0 msgr2=0x562bd23c4ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1488122303 shutdown_connections 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 -- 172.21.15.102:0/1488122303 wait complete. 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 Processor -- start 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 -- start start 2024-09-19T11:15:38.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd23d3e90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.493+0000 7f4c68a0e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x562bd221d8e0 con 0x562bd221ca00 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd23d3e90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4c641bc640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd23d3e90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39040/0 (socket says 172.21.15.102:39040) 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 learned_addr learned my addr 172.21.15.102:0/2007237096 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x562bd23d43f0 con 0x562bd221ca00 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4c641bc640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd23d3e90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4c54019f70 tx=0x7f4c5402dec0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4b41ffb640 1 -- 172.21.15.102:0/2007237096 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c5403a420 con 0x562bd221ca00 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4b41ffb640 1 -- 172.21.15.102:0/2007237096 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4c5406a070 con 0x562bd221ca00 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x562bd23d43f0 con 0x562bd221ca00 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4b41ffb640 1 -- 172.21.15.102:0/2007237096 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4c54027890 con 0x562bd221ca00 2024-09-19T11:15:38.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.494+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x562bd23d43f0 con 0x562bd221ca00 2024-09-19T11:15:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.495+0000 7f4b41ffb640 1 -- 172.21.15.102:0/2007237096 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4c54027a30 con 0x562bd221ca00 2024-09-19T11:15:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.495+0000 7f4b41ffb640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3403cfb0 0x7f4b3403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.495+0000 7f4b41ffb640 1 -- 172.21.15.102:0/2007237096 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4c5405b030 con 0x562bd221ca00 2024-09-19T11:15:38.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.495+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3403cfb0 0x7f4b3403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.496+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3403cfb0 0x7f4b3403f470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c051580 tx=0x7f4c4c06d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.496+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.496+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd23df450 0x562bd23e1910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.496+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e2060 con 0x562bd23df450 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.496+0000 7f4c649bd640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd23df450 0x562bd23e1910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.496+0000 7f4c649bd640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd23df450 0x562bd23e1910 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.496+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 realm 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e2470 con 0x562bd23df450 2024-09-19T11:15:38.515 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e2d40 con 0x562bd23df450 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.516 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23e3e40 0x562bd23e6230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e67f0 con 0x562bd23e3e40 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.497+0000 7f4c641bc640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23e3e40 0x562bd23e6230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.498+0000 7f4c641bc640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23e3e40 0x562bd23e6230 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.498+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.498+0000 7f4c68a0e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.498+0000 7f4c68a0e800 20 searching for the correct realm 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.498+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23e87a0 0x562bd23eac60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.498+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23eb330 con 0x562bd23e87a0 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.498+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23e87a0 0x562bd23eac60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.499+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23e87a0 0x562bd23eac60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.499+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.517 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.499+0000 7f4c5b9bb640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4c4c069040 0x7f4c4c08b430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.499+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23eb330 con 0x7f4c4c069040 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.499+0000 7f4c649bd640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4c4c069040 0x7f4c4c08b430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.499+0000 7f4c649bd640 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4c4c069040 0x7f4c4c08b430 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.499+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.499+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e3e40 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.500+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.500+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.500+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.500+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.500+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.500+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e3e40 2024-09-19T11:15:38.518 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.500+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.500+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e3e40 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.501+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.501+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x7f4c4c069040 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.501+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.501+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e87a0 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.501+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.501+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.501+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.501+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e3e40 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.502+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.502+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.502+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.519 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.502+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x7f4c4c069040 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.502+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.502+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e87a0 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.502+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.502+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e87a0 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.503+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.503+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e3e40 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.503+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.503+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e87a0 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.503+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.503+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e87a0 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.503+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.520 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.503+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.504+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.504+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.504+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.504+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e3e40 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.504+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.504+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e87a0 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.505+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.505+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x7f4c4c069040 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.505+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.505+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.505+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.505+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e3e40 2024-09-19T11:15:38.521 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.505+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.505+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e87a0 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.506+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.506+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e3e40 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.506+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.506+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x7f4c4c069040 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.506+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.506+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23e87a0 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.506+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.506+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x7f4c4c069040 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x562bd23df450 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.522 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e30e0 con 0x7f4c4c069040 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e70b0 con 0x562bd23df450 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.523 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.507+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e70b0 con 0x562bd23df450 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e70b0 con 0x562bd23e87a0 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 20 zone default found 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 4 Realm: () 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 20 zonegroup default 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.524 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23e79c0 con 0x562bd23e3e40 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.508+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ed2a0 con 0x562bd23e87a0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c68a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ed730 con 0x562bd23e87a0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c68a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c68a0e800 20 started sync module instance, tier type = 2024-09-19T11:15:38.525 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c68a0e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.509+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ec640 con 0x7f4c4c069040 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.510+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.510+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94746210913088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ec640 con 0x7f4c4c069040 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.510+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ee210 con 0x562bd23df450 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.511+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94746210913088] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.511+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.511+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94746210917632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ec640 con 0x562bd23df450 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.511+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23eec80 con 0x562bd23e87a0 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.513+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94746210917632] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.513+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.513+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94746210910608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ec5b0 con 0x562bd23e87a0 2024-09-19T11:15:38.526 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.513+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23efb40 con 0x7f4c4c069040 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.514+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94746210910608] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.514+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.514+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94746210924176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23eff60 con 0x7f4c4c069040 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.514+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f0920 con 0x562bd23df450 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.515+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94746210924176] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.515+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.515+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94746210925712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f0920 con 0x562bd23df450 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.516+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f12e0 con 0x562bd23e3e40 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.516+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94746210925712] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.517+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.531 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.517+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94746210927728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f0890 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.517+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f20b0 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.518+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94746210927728] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.518+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.518+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94746210932912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f2900 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.518+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f32c0 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94746210932912] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'234 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94746210936368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f32c0 con 0x562bd23e3e40 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c68a0e800 20 add_watcher() i=0 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c68a0e800 20 add_watcher() i=1 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c68a0e800 20 add_watcher() i=2 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c68a0e800 20 add_watcher() i=3 2024-09-19T11:15:38.532 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c68a0e800 20 add_watcher() i=4 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c68a0e800 20 add_watcher() i=5 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.519+0000 7f4c68a0e800 20 add_watcher() i=6 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.520+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94746210936368] v37'235 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.520+0000 7f4c68a0e800 20 add_watcher() i=7 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.520+0000 7f4c68a0e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.520+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f6620 con 0x562bd23df450 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.520+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.520+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94746210938752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f3850 con 0x562bd23df450 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.521+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94746210938752] v37'232 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.521+0000 7f4b1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.522+0000 7f4c68a0e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.522+0000 7f4c68a0e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:38.533 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.522+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23feef0 con 0x562bd23df450 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.523+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.523+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ff500 con 0x562bd23e3e40 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.524+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.524+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ff4c0 con 0x562bd23e87a0 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.525+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.525+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f5810 con 0x562bd23df450 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.526+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'233 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.526+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f5360 con 0x7f4c4c069040 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.527+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'74 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.527+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23f5360 con 0x562bd23e87a0 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.528+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'50 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.528+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2400cf0 con 0x562bd23df450 2024-09-19T11:15:38.534 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.529+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.529+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24011a0 con 0x562bd23e3e40 2024-09-19T11:15:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.530+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.535 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.530+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24011a0 con 0x7f4c4c069040 2024-09-19T11:15:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.531+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.531+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24011a0 con 0x562bd23e87a0 2024-09-19T11:15:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.532+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.532+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fcd30 con 0x7f4c4c069040 2024-09-19T11:15:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.533+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'75 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.533+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fcd30 con 0x562bd23e3e40 2024-09-19T11:15:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.534+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'35 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.536 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.534+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fcd30 con 0x7f4c4c069040 2024-09-19T11:15:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.535+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.535+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fcd30 con 0x562bd23e3e40 2024-09-19T11:15:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.536+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'55 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.537 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.536+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fcd30 con 0x562bd23df450 2024-09-19T11:15:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.538+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'234 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.538 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.538+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fcd30 con 0x562bd23e87a0 2024-09-19T11:15:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.539+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'68 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.540 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.539+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fcd30 con 0x7f4c4c069040 2024-09-19T11:15:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.540+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'76 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.541 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.540+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fcd30 con 0x562bd23e87a0 2024-09-19T11:15:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.541+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'28 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.542 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.541+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fce00 con 0x562bd23df450 2024-09-19T11:15:38.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.542+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'36 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.543 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.542+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fce00 con 0x562bd23df450 2024-09-19T11:15:38.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.543+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'235 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.544 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.543+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fce00 con 0x562bd23e87a0 2024-09-19T11:15:38.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.544+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'69 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.545 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.544+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fce00 con 0x7f4c4c069040 2024-09-19T11:15:38.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.545+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'38 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.546 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.545+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23fce00 con 0x562bd23e87a0 2024-09-19T11:15:38.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.546+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'31 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.547 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.546+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x562bd23e87a0 2024-09-19T11:15:38.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.547+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.548 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.547+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x562bd23e87a0 2024-09-19T11:15:38.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.548+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'24 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.549 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.548+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x562bd23e87a0 2024-09-19T11:15:38.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.549+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'51 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.550 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.549+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x562bd23e3e40 2024-09-19T11:15:38.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.550+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'30 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.551 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.550+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x562bd23e87a0 2024-09-19T11:15:38.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.551+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.552 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.551+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x562bd23e3e40 2024-09-19T11:15:38.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.552+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'53 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.553 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.552+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x562bd23e87a0 2024-09-19T11:15:38.554 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.554+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'70 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.554+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x562bd23e3e40 2024-09-19T11:15:38.555 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.555+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'56 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.555+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2401cb0 con 0x7f4c4c069040 2024-09-19T11:15:38.556 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.556+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'34 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.556+0000 7f4b19fe3640 20 reqs_thread_entry: start 2024-09-19T11:15:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.556+0000 7f4c68a0e800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.556+0000 7f4c68a0e800 20 Filter name: none 2024-09-19T11:15:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.556+0000 7f4b12ffd640 20 reqs_thread_entry: start 2024-09-19T11:15:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.556+0000 7f4c68a0e800 10 cache get: name=default.rgw.meta+users.uid+foo : miss 2024-09-19T11:15:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.556+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.559 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.556+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:94 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd242c600 con 0x562bd23df450 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(94 foo [call out=48b,read 0~391 out=391b,getxattrs out=75b] v0'0 uv15 ondisk = 0) ==== 231+0+514 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c68a0e800 20 rados_obj.operate() r=0 bl.length=391 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c68a0e800 10 cache put: name=default.rgw.meta+users.uid+foo info.flags=0x13 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c68a0e800 10 adding default.rgw.meta+users.uid+foo to cache LRU end 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c68a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:95 8.9 8:96d98480:users.uid::foo.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd242ef30 con 0x7f4c4c069040 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(95 foo.buckets [call out=183b] v0'0 uv43 ondisk = 0) ==== 155+0+183 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c68a0e800 10 cache get: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 : miss 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.557+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:96 8.2 8:45cc40fc:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7:head [call version.read in=11b,stat,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd242ebe0 con 0x7f4c4c069040 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(96 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 [call out=48b,stat out=16b,read 0~387 out=387b,getxattrs out=218b] v0'0 uv5 ondisk = 0) ==== 332+0+669 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.560 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 20 rados_obj.operate() r=0 bl.length=387 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 10 cache put: name=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 info.flags=0x17 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 10 adding default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 to cache LRU end 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 10 updating xattr: name=user.rgw.acl bl.length()=123 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 10 chain_cache_entry: cache_locator=default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:97 4.3e 4:7f9162c9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac1a0 con 0x7f4c4c069040 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(97 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:98 4.1a 4:582c3fe8:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac1a0 con 0x7f4c4c069040 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(98 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.561 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.558+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:99 4.24 4:26ab0c28:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac1e0 con 0x562bd23e3e40 2024-09-19T11:15:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.559+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(99 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.559+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:100 4.19 4:9a72922d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac220 con 0x562bd23e87a0 2024-09-19T11:15:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.559+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(100 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.559+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:101 4.16 4:69cf60a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac220 con 0x562bd23e87a0 2024-09-19T11:15:38.564 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.559+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(101 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4 [call out=429b] v0'0 uv7 ondisk = 0) ==== 194+0+429 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.560+0000 7f4c68a0e800 10 cls_bucket_list_unordered: got 15f6f8dc036519d7fe15b39338f6e5db 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.560+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:102 4.0 4:039cb537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac220 con 0x7f4c4c069040 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.560+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(102 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.560+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:103 4.17 4:e9825777:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac220 con 0x562bd23e3e40 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.560+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(103 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.560+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:104 4.c 4:30131e92:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac220 con 0x562bd23df450 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.561+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(104 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.561+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 4.22 4:47ffec1a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac1e0 con 0x562bd23df450 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.561+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(105 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.561+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:106 4.1f 4:fa85526a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac1e0 con 0x562bd23e87a0 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.561+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(106 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.565 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.561+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:107 4.3c 4:3dda6876:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24ac200 con 0x562bd23df450 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(107 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c68a0e800 20 get_obj_state: octx=0x7f4c5c00ab20 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x562bd24aa228 s->prefetch_data=0 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:108 3.3s0 3:c1b2feb8:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7_15f6f8dc036519d7fe15b39338f6e5db:head [call version.read in=11b,getxattrs,stat] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd242f750 con 0x7f4c4c069040 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(108 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7_15f6f8dc036519d7fe15b39338f6e5db [call out=24b,getxattrs out=877b,stat out=16b] v0'0 uv3 ondisk = 0) ==== 304+0+917 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c68a0e800 10 manifest: total_size = 6 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c68a0e800 20 get_obj_state: setting s->obj_tag to 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.4952090157131651791 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c68a0e800 20 get_obj_state: octx=0x7f4c5c00ab20 obj=myfoo:15f6f8dc036519d7fe15b39338f6e5db state=0x562bd24aa228 s->prefetch_data=0 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c68a0e800 20 prepare_atomic_modification: state is not atomic. state=0x562bd24aa228 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c68a0e800 20 bucket index object: :.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.562+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:109 4.16 4:69cf60a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_prepare_op in=210b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2433360 con 0x562bd23e87a0 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.563+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(109 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4 [stat,call,call] v37'10 uv10 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.566 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.563+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:110 3.3s0 3:c1b2feb8:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7_15f6f8dc036519d7fe15b39338f6e5db:head [call rgw.obj_remove in=40b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2433360 con 0x7f4c4c069040 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.564+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 25 ==== osd_op_reply(110 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7_15f6f8dc036519d7fe15b39338f6e5db [call] v37'4 uv4 ondisk = 0) ==== 220+0+0 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.564+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:111 4.16 4:69cf60a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4:head [stat,call rgw.guard_bucket_resharding in=36b,call rgw.bucket_complete_op in=287b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2433df0 con 0x562bd23e87a0 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.564+0000 7f4c68a0e800 20 list_objects_ordered: starting attempt 1 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.564+0000 7f4c68a0e800 10 cls_bucket_list_ordered: request from each of 11 shard(s) for 112 entries to get 1001 total entries 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:112 4.3e 4:7f9162c9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.0:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4c5c048000 con 0x7f4c4c069040 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:113 4.1a 4:582c3fe8:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.1:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2433df0 con 0x7f4c4c069040 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:114 4.24 4:26ab0c28:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.2:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2433df0 con 0x562bd23e3e40 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:115 4.19 4:9a72922d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.3:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243cae0 con 0x562bd23e87a0 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:116 4.16 4:69cf60a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243f3f0 con 0x562bd23e87a0 2024-09-19T11:15:38.571 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:117 4.0 4:039cb537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.5:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2441ee0 con 0x7f4c4c069040 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:118 4.17 4:e9825777:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.6:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444be0 con 0x562bd23e3e40 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:119 4.c 4:30131e92:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.7:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24474d0 con 0x562bd23df450 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(114 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:120 4.22 4:47ffec1a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.8:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2447940 con 0x562bd23df450 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:121 4.1f 4:fa85526a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.9:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd244a4b0 con 0x562bd23e87a0 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(115 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.565+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:122 4.3c 4:3dda6876:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.10:head [call rgw.bucket_list in=69b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd244d330 con 0x562bd23df450 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 26 ==== osd_op_reply(112 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 27 ==== osd_op_reply(113 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 28 ==== osd_op_reply(117 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x7f4c4c069040 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== osd_op_reply(121 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(120 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.572 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(118 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c54075070 con 0x562bd23e3e40 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(119 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(122 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4c5c00a4d0 con 0x562bd23df450 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(111 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4 [stat,call,call] v37'11 uv11 ondisk = 0) ==== 278+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.566+0000 7f4b437fe640 20 handle_completion(): completion ok for obj=15f6f8dc036519d7fe15b39338f6e5db 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 34 ==== osd_op_reply(116 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4 [call out=128b] v0'0 uv11 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 20 cls_bucket_list_ordered: returning, count=0, is_truncated=0 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 20 cls_bucket_list_ordered: returning, last_entry NOT SET 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 10 list_objects_ordered: end of outer loop, truncated=0, count=0, attempt=1 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 10 list_objects_ordered: exiting attempt loop because we reached end (0) or we're returning half the requested entries (0 of 1000) 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 20 abort_multiparts INFO: aborting and cleaning up multipart upload(s); bucket=":myfoo[32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7])"; uploads.size()=0; is_truncated=0 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:123 4.3e 4:7f9162c9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.0:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2433940 con 0x7f4c4c069040 2024-09-19T11:15:38.573 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:124 4.1a 4:582c3fe8:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.1:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243bb80 con 0x7f4c4c069040 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:125 4.24 4:26ab0c28:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.2:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243c460 con 0x562bd23e3e40 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:126 4.19 4:9a72922d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.3:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243fd30 con 0x562bd23e87a0 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:127 4.16 4:69cf60a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2441600 con 0x562bd23e87a0 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:128 4.0 4:039cb537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.5:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2433940 con 0x7f4c4c069040 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:129 4.17 4:e9825777:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.6:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243fd30 con 0x562bd23e3e40 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:130 4.c 4:30131e92:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.7:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243c460 con 0x562bd23df450 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 35 ==== osd_op_reply(127 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4 [call out=128b] v0'0 uv11 ondisk = 0) ==== 194+0+128 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:131 4.22 4:47ffec1a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.8:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2433940 con 0x562bd23df450 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 36 ==== osd_op_reply(126 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.3 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:132 4.1f 4:fa85526a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.9:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243fd30 con 0x562bd23e87a0 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(125 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.2 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:133 4.3c 4:3dda6876:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.10:head [call rgw.bucket_list in=47b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2441ab0 con 0x562bd23df450 2024-09-19T11:15:38.574 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(129 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.6 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 29 ==== osd_op_reply(123 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.0 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 30 ==== osd_op_reply(128 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.5 [call out=89b] v0'0 uv9 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 31 ==== osd_op_reply(124 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.1 [call out=89b] v0'0 uv3 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 37 ==== osd_op_reply(132 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.9 [call out=89b] v0'0 uv7 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(130 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.7 [call out=89b] v0'0 uv5 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(131 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.8 [call out=89b] v0'0 uv1 ondisk = 0) ==== 194+0+89 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(133 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.10 [call out=89b] v0'0 uv1 ondisk = 0) ==== 195+0+89 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.567+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:134 8.9 8:96d98480:users.uid::foo.buckets:head [call user.set_buckets_info in=207b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x7f4c4c069040 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 32 ==== osd_op_reply(134 foo.buckets [call] v37'46 uv46 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c68a0e800 10 cache get: name=default.rgw.meta+root+myfoo : miss 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:135 8.9 8:91b71841:root::myfoo:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x7f4c4c069040 2024-09-19T11:15:38.575 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 33 ==== osd_op_reply(135 myfoo [call out=48b,read 0~165 out=165b] v0'0 uv40 ondisk = 0) ==== 191+0+213 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c68a0e800 20 rados_obj.operate() r=0 bl.length=165 2024-09-19T11:15:38.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c68a0e800 10 cache put: name=default.rgw.meta+root+myfoo info.flags=0x11 2024-09-19T11:15:38.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c68a0e800 10 adding default.rgw.meta+root+myfoo to cache LRU end 2024-09-19T11:15:38.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.569+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:136 8.9 8:91b71841:root::myfoo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x7f4c4c069040 2024-09-19T11:15:38.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.570+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 34 ==== osd_op_reply(136 myfoo [call,call,delete] v37'47 uv47 ondisk = 0) ==== 233+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.570+0000 7f4c68a0e800 10 removing default.rgw.meta+root+myfoo from cache 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.570+0000 7f4c68a0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:myfoo, ofs0, ns] 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.570+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:137 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94746211203232 in=161b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x562bd23e3e40 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.571+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== watch-notify(notify (1) cookie 94746210932912 notify 158913789995 ret 0) ==== 191+0+0 (crc 0 0 0) 0x562bd23fced0 con 0x562bd23e3e40 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.571+0000 7f4b42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789995 cookie 94746210932912 notifier 4792 bl.length()=149 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.571+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(137 notify.6 [notify cookie 94746211203232 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.571+0000 7f4b42ffd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:138 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4a8c0032c0 con 0x562bd23e3e40 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.571+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(138 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.571+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== watch-notify(notify_complete (2) cookie 94746211203232 notify 158913789995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562bd23a1210 con 0x562bd23e3e40 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.571+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:139 8.2 8:45cc40fc:root::.bucket.meta.myfoo%3a32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x7f4c4c069040 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.572+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 35 ==== osd_op_reply(139 .bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 [call,call,delete] v37'6 uv6 ondisk = 0) ==== 290+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.572+0000 7f4c68a0e800 10 removing default.rgw.meta+root+.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 from cache 2024-09-19T11:15:38.581 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.572+0000 7f4c68a0e800 10 distributing notification oid=default.rgw.control:notify.6 cni=[op: 1, obj: default.rgw.meta:root:.bucket.meta.myfoo:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7, ofs0, ns] 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.572+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:140 7.14 7:2b04a3e9:::notify.6:head [notify cookie 94746211203232 in=218b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x562bd23e3e40 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== watch-notify(notify (1) cookie 94746210932912 notify 158913789996 ret 0) ==== 248+0+0 (crc 0 0 0) 0x562bd23a1210 con 0x562bd23e3e40 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4b42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789996 cookie 94746210932912 notifier 4792 bl.length()=206 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(140 notify.6 [notify cookie 94746211203232 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4b42ffd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:141 7.14 7:2b04a3e9:::notify.6:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4a8c0032c0 con 0x562bd23e3e40 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(141 notify.6 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== watch-notify(notify_complete (2) cookie 94746211203232 notify 158913789996 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562bd23a0600 con 0x562bd23e3e40 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:142 4.3e 4:7f9162c9:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.0:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x7f4c4c069040 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:143 4.1a 4:582c3fe8:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x7f4c4c069040 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:144 4.24 4:26ab0c28:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.2:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd243bf60 con 0x562bd23e3e40 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:145 4.19 4:9a72922d:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.3:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd243f750 con 0x562bd23e87a0 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:146 4.16 4:69cf60a4:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x562bd23e87a0 2024-09-19T11:15:38.582 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:147 4.0 4:039cb537:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.5:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd243bf60 con 0x7f4c4c069040 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.573+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:148 4.17 4:e9825777:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.6:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23e3e40 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.574+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:149 4.c 4:30131e92:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd243f750 con 0x562bd23df450 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.574+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:150 4.22 4:47ffec1a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.8:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd2444ba0 con 0x562bd23df450 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.574+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:151 4.1f 4:fa85526a:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.9:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd243bf60 con 0x562bd23e87a0 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.574+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:152 4.3c 4:3dda6876:::.dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.10:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23df450 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.575+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 36 ==== osd_op_reply(143 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.1 [delete] v37'4 uv4 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.575+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(148 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.6 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.575+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 37 ==== osd_op_reply(147 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.5 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.575+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(149 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.7 [delete] v37'6 uv6 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.575+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(144 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.2 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.575+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 38 ==== osd_op_reply(142 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.0 [delete] v37'10 uv10 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.575+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(150 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.8 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.583 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(152 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.10 [delete] v37'2 uv2 ondisk = 0) ==== 195+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 38 ==== osd_op_reply(145 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.3 [delete] v37'2 uv2 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 39 ==== osd_op_reply(146 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.4 [delete] v37'12 uv12 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 40 ==== osd_op_reply(151 .dir.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7.9 [delete] v37'8 uv8 ondisk = 0) ==== 194+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c68a0e800 10 cache get: name=default.rgw.log++pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 : miss 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c68a0e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:153 6.13 6:c88a93c1:::pubsub..bucket.myfoo%2f32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23e3e40 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== osd_op_reply(153 pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c68a0e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c68a0e800 10 cache put: name=default.rgw.log++pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 info.flags=0x0 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c68a0e800 10 adding default.rgw.log++pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 to cache LRU end 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.577+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:154 6.13 6:c88a93c1:::pubsub..bucket.myfoo%2f32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23e3e40 2024-09-19T11:15:38.584 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.578+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 41 ==== osd_op_reply(154 pubsub..bucket.myfoo/32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.7 [delete] v37'36 uv33 ondisk = -2 ((2) No such file or directory)) ==== 208+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.579+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:155 8.9 8:96d98480:users.uid::foo.buckets:head [call user.remove_bucket in=144b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x7f4c4c069040 2024-09-19T11:15:38.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.580+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 39 ==== osd_op_reply(155 foo.buckets [call] v37'48 uv48 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.580+0000 7f4c68a0e800 10 removing key index: 9te6NH5mcdcq0Tc5i8i1 2024-09-19T11:15:38.585 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.580+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:156 8.7 8:e4e0e270:users.keys::9te6NH5mcdcq0Tc5i8i1:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23e3e40 2024-09-19T11:15:38.588 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 42 ==== osd_op_reply(156 9te6NH5mcdcq0Tc5i8i1 [delete] v37'2 uv2 ondisk = 0) ==== 164+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c68a0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.keys:9te6NH5mcdcq0Tc5i8i1, ofs0, ns] 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:157 7.e 7:7759931f:::notify.3:head [notify cookie 94746211272240 in=182b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x7f4c4c069040 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 40 ==== watch-notify(notify (1) cookie 94746210924176 notify 158913789971 ret 0) ==== 212+0+0 (crc 0 0 0) 0x562bd242e240 con 0x7f4c4c069040 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4b42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789971 cookie 94746210924176 notifier 4792 bl.length()=170 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 41 ==== osd_op_reply(157 notify.3 [notify cookie 94746211272240 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4b42ffd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:158 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4a8c0032c0 con 0x7f4c4c069040 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 42 ==== watch-notify(notify_complete (2) cookie 94746211272240 notify 158913789971 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562bd23f5700 con 0x7f4c4c069040 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 43 ==== osd_op_reply(158 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c68a0e800 10 removing email index: foo@foo.com 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.581+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:159 8.3 8:c162d5d1:users.email::foo@foo.com:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23df450 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.582+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== osd_op_reply(159 foo@foo.com [delete] v37'2 uv2 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.589 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.582+0000 7f4c68a0e800 10 distributing notification oid=default.rgw.control:notify.3 cni=[op: 1, obj: default.rgw.meta:users.email:foo@foo.com, ofs0, ns] 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.582+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:160 7.e 7:7759931f:::notify.3:head [notify cookie 94746211203232 in=174b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd242eb50 con 0x7f4c4c069040 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.583+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 44 ==== watch-notify(notify (1) cookie 94746210924176 notify 158913789972 ret 0) ==== 204+0+0 (crc 0 0 0) 0x562bd23f5700 con 0x7f4c4c069040 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.583+0000 7f4b437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789972 cookie 94746210924176 notifier 4792 bl.length()=162 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.583+0000 7f4b437fe640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:161 7.e 7:7759931f:::notify.3:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4b28003d60 con 0x7f4c4c069040 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.583+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 45 ==== osd_op_reply(160 notify.3 [notify cookie 94746211203232 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.583+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 46 ==== watch-notify(notify_complete (2) cookie 94746211203232 notify 158913789972 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562bd23feb00 con 0x7f4c4c069040 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.583+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 47 ==== osd_op_reply(161 notify.3 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.583+0000 7f4c68a0e800 10 removing user buckets index 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.583+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:162 8.9 8:96d98480:users.uid::foo.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x7f4c4c069040 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.584+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 48 ==== osd_op_reply(162 foo.buckets [delete] v37'49 uv49 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.584+0000 7f4c68a0e800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.uid:foo.buckets, ofs0, ns] 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.584+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:163 7.3 7:c609908c:::notify.5:head [notify cookie 94746211203232 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243b6d0 con 0x562bd23e3e40 2024-09-19T11:15:38.590 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.584+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 43 ==== watch-notify(notify (1) cookie 94746210927728 notify 158913789997 ret 0) ==== 202+0+0 (crc 0 0 0) 0x562bd23a0600 con 0x562bd23e3e40 2024-09-19T11:15:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.584+0000 7f4b42ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789997 cookie 94746210927728 notifier 4792 bl.length()=160 2024-09-19T11:15:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.584+0000 7f4b42ffd640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:164 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4a8c0032c0 con 0x562bd23e3e40 2024-09-19T11:15:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.584+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 44 ==== osd_op_reply(163 notify.5 [notify cookie 94746211203232 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.591 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.585+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 45 ==== osd_op_reply(164 notify.5 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.585+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 46 ==== watch-notify(notify_complete (2) cookie 94746211203232 notify 158913789997 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562bd23a0370 con 0x562bd23e3e40 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.585+0000 7f4c68a0e800 10 removing user index: foo 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.585+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:165 8.18 8:1e6ca5ed:users.uid::foo:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23df450 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(165 foo [call,call,delete] v37'19 uv19 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4c68a0e800 10 removing default.rgw.meta+users.uid+foo from cache 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4c68a0e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 1, obj: default.rgw.meta:users.uid:foo, ofs0, ns] 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:166 7.d 7:b4812045:::notify.4:head [notify cookie 94746211203232 in=164b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x562bd243b6d0 con 0x562bd23df450 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== watch-notify(notify (1) cookie 94746210925712 notify 158913789982 ret 0) ==== 194+0+0 (crc 0 0 0) 0x562bd23feb00 con 0x562bd23df450 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4b437fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789982 cookie 94746210925712 notifier 4792 bl.length()=152 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 43 ==== osd_op_reply(166 notify.4 [notify cookie 94746211203232 out=8b] v0'0 uv234 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4b437fe640 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:167 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4b28003d60 con 0x562bd23df450 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 44 ==== watch-notify(notify_complete (2) cookie 94746211203232 notify 158913789982 ret 0) ==== 42+0+48 (crc 0 0 0) 0x562bd23f5bb0 con 0x562bd23df450 2024-09-19T11:15:38.592 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.586+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 45 ==== osd_op_reply(167 notify.4 [notify-ack] v0'0 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.587+0000 7f4b1afe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:38.593 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.587+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:168 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94746210938752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23df450 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.588+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 46 ==== osd_op_reply(168 data_loggenerations_metadata [watch unwatch cookie 94746210938752] v37'236 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.588+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:169 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94746210913088] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x7f4c4c069040 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.589+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 49 ==== osd_op_reply(169 notify.0 [watch unwatch cookie 94746210913088] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.589+0000 7f4c68a0e800 20 remove_watcher() i=0 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.589+0000 7f4c68a0e800 2 removed watcher, disabling cache 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.589+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:170 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94746210917632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23df450 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.590+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 47 ==== osd_op_reply(170 notify.1 [watch unwatch cookie 94746210917632] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.590+0000 7f4c68a0e800 20 remove_watcher() i=1 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.590+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:171 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94746210910608] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23edd00 con 0x562bd23e87a0 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.591+0000 7f4c5b9bb640 1 -- 172.21.15.102:0/2007237096 <== osd.3 v2:172.21.15.102:6800/3957239017 41 ==== osd_op_reply(171 notify.2 [watch unwatch cookie 94746210910608] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c4c057030 con 0x562bd23e87a0 2024-09-19T11:15:38.595 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.591+0000 7f4c68a0e800 20 remove_watcher() i=2 2024-09-19T11:15:38.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.591+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:172 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94746210924176] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x7f4c4c069040 2024-09-19T11:15:38.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.592+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.2 v2:172.21.15.102:6808/525557096 50 ==== osd_op_reply(172 notify.3 [watch unwatch cookie 94746210924176] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x7f4c4c069040 2024-09-19T11:15:38.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.592+0000 7f4c68a0e800 20 remove_watcher() i=3 2024-09-19T11:15:38.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.592+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:173 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94746210925712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ec190 con 0x562bd23df450 2024-09-19T11:15:38.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.594+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 <== osd.1 v2:172.21.15.102:6816/3609322588 48 ==== osd_op_reply(173 notify.4 [watch unwatch cookie 94746210925712] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5c050040 con 0x562bd23df450 2024-09-19T11:15:38.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.594+0000 7f4c68a0e800 20 remove_watcher() i=4 2024-09-19T11:15:38.596 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.594+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:174 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94746210927728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ef690 con 0x562bd23e3e40 2024-09-19T11:15:38.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.595+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 47 ==== osd_op_reply(174 notify.5 [watch unwatch cookie 94746210927728] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.595+0000 7f4c68a0e800 20 remove_watcher() i=5 2024-09-19T11:15:38.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.595+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:175 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94746210932912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd24338a0 con 0x562bd23e3e40 2024-09-19T11:15:38.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.596+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 48 ==== osd_op_reply(175 notify.6 [watch unwatch cookie 94746210932912] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.596+0000 7f4c68a0e800 20 remove_watcher() i=6 2024-09-19T11:15:38.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.596+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:176 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94746210936368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x562bd23ec190 con 0x562bd23e3e40 2024-09-19T11:15:38.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c641bc640 1 -- 172.21.15.102:0/2007237096 <== osd.0 v2:172.21.15.37:6800/394652614 49 ==== osd_op_reply(176 notify.7 [watch unwatch cookie 94746210936368] v37'236 uv234 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4c5408e040 con 0x562bd23e3e40 2024-09-19T11:15:38.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 20 remove_watcher() i=7 2024-09-19T11:15:38.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23e3e40 msgr2=0x562bd23e6230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23e3e40 0x562bd23e6230 crc :-1 s=READY pgs=164 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd23df450 msgr2=0x562bd23e1910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.600 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd23df450 0x562bd23e1910 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4c4c069040 msgr2=0x7f4c4c08b430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4c4c069040 0x7f4c4c08b430 crc :-1 s=READY pgs=88 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23e87a0 msgr2=0x562bd23eac60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23e87a0 0x562bd23eac60 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3403cfb0 msgr2=0x7f4b3403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3403cfb0 0x7f4b3403f470 secure :-1 s=READY pgs=292 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c051580 tx=0x7f4c4c06d040 comp rx=0 tx=0).stop 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 msgr2=0x562bd23d3e90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c649bd640 1 -- 172.21.15.102:0/2007237096 reap_dead start 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd23d3e90 secure :-1 s=READY pgs=702 cs=0 l=1 rev1=1 crypto rx=0x7f4c54019f70 tx=0x7f4c5402dec0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 shutdown_connections 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2007237096 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd221ca00 0x562bd23d3e90 unknown :-1 s=CLOSED pgs=702 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 >> 172.21.15.102:0/2007237096 conn(0x562bd23c6ca0 msgr2=0x562bd23c4eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.601 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 shutdown_connections 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2007237096 wait complete. 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2101817714 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3c03d000 msgr2=0x7f4b3c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2101817714 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3c03d000 0x7f4b3c03f4c0 secure :-1 s=READY pgs=291 cs=0 l=1 rev1=1 crypto rx=0x562bd23a8930 tx=0x7f4c4c005ac0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2101817714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd23be1b0 msgr2=0x562bd23be5d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2101817714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd23be1b0 0x562bd23be5d0 secure :-1 s=READY pgs=700 cs=0 l=1 rev1=1 crypto rx=0x7f4c5400f500 tx=0x7f4c54030c70 comp rx=0 tx=0).stop 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2101817714 shutdown_connections 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2101817714 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b3c03d000 0x7f4b3c03f4c0 unknown :-1 s=CLOSED pgs=291 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2101817714 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd23be1b0 0x562bd23be5d0 unknown :-1 s=CLOSED pgs=700 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2101817714 >> 172.21.15.102:0/2101817714 conn(0x562bd23b2560 msgr2=0x562bd23b2940 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2101817714 shutdown_connections 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.597+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2101817714 wait complete. 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23a9800 msgr2=0x562bd23abca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.602 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x562bd23a9800 0x562bd23abca0 crc :-1 s=READY pgs=163 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd22a9b70 msgr2=0x562bd23a7460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x562bd22a9b70 0x562bd23a7460 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23ad890 msgr2=0x562bd23afca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x562bd23ad890 0x562bd23afca0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b4c03cfb0 msgr2=0x7f4b4c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4b4c03cfb0 0x7f4b4c03f470 secure :-1 s=READY pgs=290 cs=0 l=1 rev1=1 crypto rx=0x7f4c4c057000 tx=0x7f4c4c052000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 msgr2=0x562bd239fe10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 --2- 172.21.15.102:0/2341762196 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x562bd22a88a0 0x562bd239fe10 secure :-1 s=READY pgs=699 cs=0 l=1 rev1=1 crypto rx=0x562bd2399280 tx=0x7f4c54000bc0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c649bd640 1 -- 172.21.15.102:0/2341762196 reap_dead start 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 shutdown_connections 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 >> 172.21.15.102:0/2341762196 conn(0x562bd22a3c70 msgr2=0x562bd23997e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.603 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 shutdown_connections 2024-09-19T11:15:38.604 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.598+0000 7f4c68a0e800 1 -- 172.21.15.102:0/2341762196 wait complete. 2024-09-19T11:15:38.607 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'info', '--uid', 'foo'] 2024-09-19T11:15:38.607 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'info', '--uid', 'foo'] 2024-09-19T11:15:38.608 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user info --uid foo 2024-09-19T11:15:38.651 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:38.652 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.651+0000 7fb7f4928800 1 Processor -- start 2024-09-19T11:15:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.651+0000 7fb7f4928800 1 -- start start 2024-09-19T11:15:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.651+0000 7fb7f4928800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5584cbf25ea0 0x5584cbf28290 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.651+0000 7fb7f4928800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5584cbf2c5e0 con 0x5584cbf288c0 2024-09-19T11:15:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.651+0000 7fb7f4928800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5584cbdb07d0 con 0x5584cbf25ea0 2024-09-19T11:15:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.652+0000 7fb7f066f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5584cbf25ea0 0x5584cbf28290 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.652+0000 7fb7efe6e640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5584cbf288c0 0x5584cbf2ad80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34680/0 (socket says 172.21.15.102:34680) 2024-09-19T11:15:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.652+0000 7fb7f066f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5584cbf25ea0 0x5584cbf28290 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39050/0 (socket says 172.21.15.102:39050) 2024-09-19T11:15:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.652+0000 7fb7efe6e640 1 -- 172.21.15.102:0/4256202745 learned_addr learned my addr 172.21.15.102:0/4256202745 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.652+0000 7fb7f066f640 1 -- 172.21.15.102:0/4256202745 >> v1:172.21.15.37:6789/0 conn(0x5584cbf288c0 legacy=0x5584cbf2ad80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.652+0000 7fb7f066f640 1 -- 172.21.15.102:0/4256202745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cbf2d810 con 0x5584cbf25ea0 2024-09-19T11:15:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.654+0000 7fb7f066f640 1 --2- 172.21.15.102:0/4256202745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf28290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0005fd0 tx=0x7fb7e0045c30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4fbc8d808925374 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.654+0000 7fb7ef66d640 1 -- 172.21.15.102:0/4256202745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0058530 con 0x5584cbf25ea0 2024-09-19T11:15:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.654+0000 7fb7ef66d640 1 -- 172.21.15.102:0/4256202745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e00586d0 con 0x5584cbf25ea0 2024-09-19T11:15:38.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.654+0000 7fb7ef66d640 1 -- 172.21.15.102:0/4256202745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e00589d0 con 0x5584cbf25ea0 2024-09-19T11:15:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.654+0000 7fb7f4928800 1 -- 172.21.15.102:0/4256202745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 msgr2=0x5584cbf28290 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.654+0000 7fb7f4928800 1 --2- 172.21.15.102:0/4256202745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf28290 secure :-1 s=READY pgs=704 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0005fd0 tx=0x7fb7e0045c30 comp rx=0 tx=0).stop 2024-09-19T11:15:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.655+0000 7fb7f4928800 1 -- 172.21.15.102:0/4256202745 shutdown_connections 2024-09-19T11:15:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.655+0000 7fb7f4928800 1 --2- 172.21.15.102:0/4256202745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf28290 unknown :-1 s=CLOSED pgs=704 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.655+0000 7fb7f4928800 1 -- 172.21.15.102:0/4256202745 >> 172.21.15.102:0/4256202745 conn(0x5584cbf1fa60 msgr2=0x5584cbf21ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.655+0000 7fb7f4928800 1 -- 172.21.15.102:0/4256202745 shutdown_connections 2024-09-19T11:15:38.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.655+0000 7fb7f4928800 1 -- 172.21.15.102:0/4256202745 wait complete. 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.668+0000 7fb7f4928800 1 Processor -- start 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.668+0000 7fb7f4928800 1 -- start start 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.668+0000 7fb7f4928800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf25610 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.668+0000 7fb7f4928800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584cbdbddd0 con 0x5584cbf25ea0 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.669+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf25610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.669+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf25610 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39054/0 (socket says 172.21.15.102:39054) 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.669+0000 7fb7f066f640 1 -- 172.21.15.102:0/2424573499 learned_addr learned my addr 172.21.15.102:0/2424573499 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.669+0000 7fb7f066f640 1 -- 172.21.15.102:0/2424573499 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cbf25c00 con 0x5584cbf25ea0 2024-09-19T11:15:38.670 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.669+0000 7fb7f066f640 1 --2- 172.21.15.102:0/2424573499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf25610 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000a3f0 tx=0x7fb7e0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=494c5fa7c507aeb3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.669+0000 7fb6de60c640 1 -- 172.21.15.102:0/2424573499 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0058a30 con 0x5584cbf25ea0 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.669+0000 7fb6de60c640 1 -- 172.21.15.102:0/2424573499 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0068070 con 0x5584cbf25ea0 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.669+0000 7fb6de60c640 1 -- 172.21.15.102:0/2424573499 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0058d60 con 0x5584cbf25ea0 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 -- 172.21.15.102:0/2424573499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 msgr2=0x5584cbf25610 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 --2- 172.21.15.102:0/2424573499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf25610 secure :-1 s=READY pgs=705 cs=0 l=1 rev1=1 crypto rx=0x7fb7e000a3f0 tx=0x7fb7e0051000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 -- 172.21.15.102:0/2424573499 shutdown_connections 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 --2- 172.21.15.102:0/2424573499 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cbf25610 unknown :-1 s=CLOSED pgs=705 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 -- 172.21.15.102:0/2424573499 >> 172.21.15.102:0/2424573499 conn(0x5584cbf1fa60 msgr2=0x5584cc010cd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 -- 172.21.15.102:0/2424573499 shutdown_connections 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 -- 172.21.15.102:0/2424573499 wait complete. 2024-09-19T11:15:38.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 Processor -- start 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 -- start start 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cc01ef90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.670+0000 7fb7f4928800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584cbf2cab0 con 0x5584cbf25ea0 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cc01ef90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cc01ef90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39064/0 (socket says 172.21.15.102:39064) 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb7f066f640 1 -- 172.21.15.102:0/1306092733 learned_addr learned my addr 172.21.15.102:0/1306092733 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb7f066f640 1 -- 172.21.15.102:0/1306092733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cc01f4f0 con 0x5584cbf25ea0 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb7f066f640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cc01ef90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0005bf0 tx=0x7fb7e0003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb6dce09640 1 -- 172.21.15.102:0/1306092733 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0063680 con 0x5584cbf25ea0 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb6dce09640 1 -- 172.21.15.102:0/1306092733 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0063820 con 0x5584cbf25ea0 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584cc01f780 con 0x5584cbf25ea0 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.671+0000 7fb6dce09640 1 -- 172.21.15.102:0/1306092733 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0063b40 con 0x5584cbf25ea0 2024-09-19T11:15:38.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.672+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584cc020100 con 0x5584cbf25ea0 2024-09-19T11:15:38.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.672+0000 7fb6dce09640 1 -- 172.21.15.102:0/1306092733 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb7e0063ce0 con 0x5584cbf25ea0 2024-09-19T11:15:38.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb6dce09640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6d803cfb0 0x7fb6d803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb6dce09640 1 -- 172.21.15.102:0/1306092733 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fb7e0098a30 con 0x5584cbf25ea0 2024-09-19T11:15:38.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6d803cfb0 0x7fb6d803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cbf288c0 0x5584cc0265e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc020d30 con 0x5584cbf288c0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb7f0e70640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cbf288c0 0x5584cc0265e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6d803cfb0 0x7fb6d803f470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4001d70 tx=0x7fb7e40012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb7f0e70640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cbf288c0 0x5584cc0265e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1306092733 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e80083e0 con 0x5584cbf288c0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.673+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc027020 con 0x5584cbf288c0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.674+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1306092733 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7e80083e0 con 0x5584cbf288c0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.674+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc028930 0x5584cc02add0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.674+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc02b560 con 0x5584cc028930 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.674+0000 7fb7f066f640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc028930 0x5584cc02add0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.674+0000 7fb7f066f640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc028930 0x5584cc02add0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.675+0000 7fb7f066f640 1 -- 172.21.15.102:0/1306092733 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fb7e004f3f0 con 0x5584cc028930 2024-09-19T11:15:38.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.675+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc027870 con 0x5584cbf288c0 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.675+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1306092733 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7e80083e0 con 0x5584cbf288c0 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.675+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc02c9c0 0x5584cc02edb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.675+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc02f520 con 0x5584cc02c9c0 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.675+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc02c9c0 0x5584cc02edb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.675+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc02c9c0 0x5584cc02edb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.676+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1306092733 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc02c9c0 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.676+0000 7fb7f4928800 1 Processor -- start 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.676+0000 7fb7f4928800 1 -- start start 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.676+0000 7fb7f4928800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc03d260 0x5584cc03d680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.676+0000 7fb7f4928800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584cbe1c4a0 con 0x5584cc03d260 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.676+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc03d260 0x5584cc03d680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.676+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc03d260 0x5584cc03d680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39076/0 (socket says 172.21.15.102:39076) 2024-09-19T11:15:38.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.676+0000 7fb7f066f640 1 -- 172.21.15.102:0/371539131 learned_addr learned my addr 172.21.15.102:0/371539131 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.677+0000 7fb7f066f640 1 -- 172.21.15.102:0/371539131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cc03dcc0 con 0x5584cc03d260 2024-09-19T11:15:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.677+0000 7fb7f066f640 1 --2- 172.21.15.102:0/371539131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc03d260 0x5584cc03d680 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0096d20 tx=0x7fb7e0073670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.677+0000 7fb6d5ffb640 1 -- 172.21.15.102:0/371539131 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e00748a0 con 0x5584cc03d260 2024-09-19T11:15:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.677+0000 7fb6d5ffb640 1 -- 172.21.15.102:0/371539131 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e007e900 con 0x5584cc03d260 2024-09-19T11:15:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.677+0000 7fb6d5ffb640 1 -- 172.21.15.102:0/371539131 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e007ebe0 con 0x5584cc03d260 2024-09-19T11:15:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.677+0000 7fb7f4928800 1 -- 172.21.15.102:0/371539131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584cc03e4f0 con 0x5584cc03d260 2024-09-19T11:15:38.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.677+0000 7fb7f4928800 1 -- 172.21.15.102:0/371539131 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584cc03e4f0 con 0x5584cc03d260 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.678+0000 7fb6d5ffb640 1 -- 172.21.15.102:0/371539131 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb7e0088070 con 0x5584cc03d260 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.678+0000 7fb6d5ffb640 1 --2- 172.21.15.102:0/371539131 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6c803cfb0 0x7fb6c803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.678+0000 7fb6d5ffb640 1 -- 172.21.15.102:0/371539131 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fb7e00800b0 con 0x5584cc03d260 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.678+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/371539131 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6c803cfb0 0x7fb6c803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.678+0000 7fb7f4928800 1 Processor -- start 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.678+0000 7fb7f4928800 1 -- start start 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.678+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/371539131 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6c803cfb0 0x7fb6c803f470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400bf40 tx=0x7fb7e400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb7f4928800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc049d10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb7f4928800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584cbf23ff0 con 0x5584cc049930 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc049d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc049d10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39092/0 (socket says 172.21.15.102:39092) 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb7f066f640 1 -- 172.21.15.102:0/448487248 learned_addr learned my addr 172.21.15.102:0/448487248 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb7f066f640 1 -- 172.21.15.102:0/448487248 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cc04a2e0 con 0x5584cc049930 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb7f066f640 1 --2- 172.21.15.102:0/448487248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc049d10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0073820 tx=0x7fb7e0070f70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=abf4031f12248188 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb6c77fe640 1 -- 172.21.15.102:0/448487248 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e009d040 con 0x5584cc049930 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb6c77fe640 1 -- 172.21.15.102:0/448487248 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e0090040 con 0x5584cc049930 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.679+0000 7fb6c77fe640 1 -- 172.21.15.102:0/448487248 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0095030 con 0x5584cc049930 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 -- 172.21.15.102:0/448487248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 msgr2=0x5584cc049d10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 --2- 172.21.15.102:0/448487248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc049d10 secure :-1 s=READY pgs=708 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0073820 tx=0x7fb7e0070f70 comp rx=0 tx=0).stop 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 -- 172.21.15.102:0/448487248 shutdown_connections 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 --2- 172.21.15.102:0/448487248 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc049d10 unknown :-1 s=CLOSED pgs=708 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 -- 172.21.15.102:0/448487248 >> 172.21.15.102:0/448487248 conn(0x5584cc045d30 msgr2=0x5584cc043f70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 -- 172.21.15.102:0/448487248 shutdown_connections 2024-09-19T11:15:38.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 -- 172.21.15.102:0/448487248 wait complete. 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 Processor -- start 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 -- start start 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc050d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f4928800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5584cc04a790 con 0x5584cc049930 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc050d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f066f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc050d70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39094/0 (socket says 172.21.15.102:39094) 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.680+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 learned_addr learned my addr 172.21.15.102:0/1604980241 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.681+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5584cc0512d0 con 0x5584cc049930 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.681+0000 7fb7f066f640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc050d70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0073dd0 tx=0x7fb7e0094f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.681+0000 7fb6c5ffb640 1 -- 172.21.15.102:0/1604980241 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e009d040 con 0x5584cc049930 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.681+0000 7fb6c5ffb640 1 -- 172.21.15.102:0/1604980241 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fb7e008fcd0 con 0x5584cc049930 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.681+0000 7fb6c5ffb640 1 -- 172.21.15.102:0/1604980241 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fb7e0094ba0 con 0x5584cc049930 2024-09-19T11:15:38.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.681+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5584cc0512d0 con 0x5584cc049930 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.681+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5584cc0512d0 con 0x5584cc049930 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.682+0000 7fb6c5ffb640 1 -- 172.21.15.102:0/1604980241 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fb7e006da40 con 0x5584cc049930 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.682+0000 7fb6c5ffb640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6b803cfb0 0x7fb6b803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.682+0000 7fb6c5ffb640 1 -- 172.21.15.102:0/1604980241 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fb7e00a9070 con 0x5584cc049930 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.682+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6b803cfb0 0x7fb6b803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.682+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.682+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cc05c2f0 0x5584cc05e7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05ef00 con 0x5584cc05c2f0 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f0e70640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cc05c2f0 0x5584cc05e7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6b803cfb0 0x7fb6b803f470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c010 tx=0x7fb7e4010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f0e70640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cc05c2f0 0x5584cc05e7b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e80083e0 con 0x5584cc05c2f0 2024-09-19T11:15:38.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 20 realm 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05f310 con 0x5584cc05c2f0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e80083e0 con 0x5584cc05c2f0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.683+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e80083e0 con 0x5584cc05c2f0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f4928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05ff80 con 0x5584cc05c2f0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fb7e80083e0 con 0x5584cc05c2f0 2024-09-19T11:15:38.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f4928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc0606d0 0x5584cc062ac0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc063230 con 0x5584cc0606d0 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.684+0000 7fb7f066f640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc0606d0 0x5584cc062ac0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.685+0000 7fb7f066f640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc0606d0 0x5584cc062ac0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.685+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.685+0000 7fb7f4928800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.685+0000 7fb7f4928800 20 searching for the correct realm 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.685+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc065320 0x5584cc0677e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.685+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc067eb0 con 0x5584cc065320 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.685+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc065320 0x5584cc0677e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.685+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc065320 0x5584cc0677e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.686+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.686+0000 7fb7efe6e640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb7e4037040 0x7fb7e4036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.686+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc067eb0 con 0x7fb7e4037040 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.686+0000 7fb7f0e70640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb7e4037040 0x7fb7e4036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.686+0000 7fb7f0e70640 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb7e4037040 0x7fb7e4036410 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.686+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e80083e0 con 0x7fb7e4037040 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.686+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc0606d0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.687+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.687+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.687+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e80083e0 con 0x5584cc05c2f0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.687+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.687+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.687+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc0606d0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.687+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.687+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc0606d0 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.688+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.688+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x7fb7e4037040 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.688+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.688+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc065320 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.688+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.688+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.688+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.688+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc0606d0 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.689+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.689+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.689+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.689+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x7fb7e4037040 2024-09-19T11:15:38.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.689+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.689+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc065320 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.689+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.689+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc065320 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc0606d0 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc065320 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc065320 2024-09-19T11:15:38.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.690+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.709 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.691+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.691+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc0606d0 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.691+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.691+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc065320 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.691+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.691+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x7fb7e4037040 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.691+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.691+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.692+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.692+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc0606d0 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.692+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.692+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc065320 2024-09-19T11:15:38.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.692+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.692+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc0606d0 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x7fb7e4037040 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc065320 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x7fb7e4037040 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x5584cc05c2f0 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.693+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5584cc05fbe0 con 0x7fb7e4037040 2024-09-19T11:15:38.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc063be0 con 0x5584cc05c2f0 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc063be0 con 0x5584cc05c2f0 2024-09-19T11:15:38.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc063bb0 con 0x5584cc065320 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 zone default found 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 4 Realm: () 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 zonegroup default 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.694+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc064480 con 0x5584cc0606d0 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc069d20 con 0x5584cc065320 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06a0c0 con 0x5584cc065320 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 20 started sync module instance, tier type = 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:38.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.695+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0691c0 con 0x7fb7e4037040 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.696+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.696+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94028847027904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0691c0 con 0x7fb7e4037040 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.696+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06aba0 con 0x5584cc05c2f0 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.697+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94028847027904] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.698+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.698+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94028847031920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0691c0 con 0x5584cc05c2f0 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.698+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06b610 con 0x5584cc065320 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.699+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94028847031920] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.699+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.699+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94028847025424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc069130 con 0x5584cc065320 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.699+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06c500 con 0x7fb7e4037040 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.700+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94028847025424] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.700+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.700+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94028847038544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06c920 con 0x7fb7e4037040 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.700+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06d2e0 con 0x5584cc05c2f0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.701+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94028847038544] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x7fb7e4037040 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.701+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.701+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94028847040080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06d2e0 con 0x5584cc05c2f0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.701+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06dca0 con 0x5584cc0606d0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.702+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.702+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94028847044592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06e4f0 con 0x5584cc0606d0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.702+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06efb0 con 0x5584cc0606d0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.702+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94028847040080] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.703+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94028847044592] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.703+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.703+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94028847046720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06ce30 con 0x5584cc0606d0 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.703+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06f850 con 0x5584cc0606d0 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.704+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94028847046720] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'237 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94028847049344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06f850 con 0x5584cc0606d0 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f4928800 20 add_watcher() i=0 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f4928800 20 add_watcher() i=1 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f4928800 20 add_watcher() i=2 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f4928800 20 add_watcher() i=3 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f4928800 20 add_watcher() i=4 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f4928800 20 add_watcher() i=5 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.705+0000 7fb7f4928800 20 add_watcher() i=6 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.706+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94028847049344] v37'238 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.706+0000 7fb7f4928800 20 add_watcher() i=7 2024-09-19T11:15:38.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.706+0000 7fb7f4928800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.706+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc072cb0 con 0x5584cc05c2f0 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.706+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.706+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94028847052144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0701a0 con 0x5584cc05c2f0 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.707+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94028847052144] v37'237 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7e8026040 con 0x5584cc05c2f0 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.707+0000 7fb6a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.707+0000 7fb7f4928800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.707+0000 7fb7f4928800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.707+0000 7fb7f4928800 5 note: GC not initialized 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.707+0000 7fb6a5fdb640 20 reqs_thread_entry: start 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.707+0000 7fb7f4928800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.708+0000 7fb7f4928800 20 Filter name: none 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.708+0000 7fb6177fe640 20 reqs_thread_entry: start 2024-09-19T11:15:38.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.708+0000 7fb7f4928800 20 rados->read ofs=0 len=0 2024-09-19T11:15:38.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.708+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 8.18 8:1e6ca5ed:users.uid::foo:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0a56e0 con 0x5584cc05c2f0 2024-09-19T11:15:38.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.708+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 foo [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7fb7e8036040 con 0x5584cc05c2f0 2024-09-19T11:15:38.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.708+0000 7fb7f4928800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:38.719 INFO:teuthology.orchestra.run.smithi102.stderr:could not fetch user info: no user info saved 2024-09-19T11:15:38.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.709+0000 7fb6a6fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:38.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.709+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94028847052144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0a56a0 con 0x5584cc05c2f0 2024-09-19T11:15:38.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.710+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(63 data_loggenerations_metadata [watch unwatch cookie 94028847052144] v37'238 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fb7e8036040 con 0x5584cc05c2f0 2024-09-19T11:15:38.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.710+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:64 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94028847027904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0a56a0 con 0x7fb7e4037040 2024-09-19T11:15:38.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.711+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(64 notify.0 [watch unwatch cookie 94028847027904] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8036040 con 0x7fb7e4037040 2024-09-19T11:15:38.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.711+0000 7fb7f4928800 20 remove_watcher() i=0 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.711+0000 7fb7f4928800 2 removed watcher, disabling cache 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.711+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94028847031920] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0a56a0 con 0x5584cc05c2f0 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.712+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.1 [watch unwatch cookie 94028847031920] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8036040 con 0x5584cc05c2f0 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.712+0000 7fb7f4928800 20 remove_watcher() i=1 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.712+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94028847025424] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc0a56a0 con 0x5584cc065320 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.713+0000 7fb7efe6e640 1 -- 172.21.15.102:0/1604980241 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(66 notify.2 [watch unwatch cookie 94028847025424] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e4009050 con 0x5584cc065320 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.714+0000 7fb7f4928800 20 remove_watcher() i=2 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.714+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94028847038544] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06a670 con 0x7fb7e4037040 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.714+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(67 notify.3 [watch unwatch cookie 94028847038544] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8036040 con 0x7fb7e4037040 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.715+0000 7fb7f4928800 20 remove_watcher() i=3 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.715+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94028847040080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc068d10 con 0x5584cc05c2f0 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.716+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(68 notify.4 [watch unwatch cookie 94028847040080] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e8036040 con 0x5584cc05c2f0 2024-09-19T11:15:38.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.716+0000 7fb7f4928800 20 remove_watcher() i=4 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.716+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94028847044592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06c050 con 0x5584cc0606d0 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.717+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(69 notify.5 [watch unwatch cookie 94028847044592] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.717+0000 7fb7f4928800 20 remove_watcher() i=5 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.717+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:70 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94028847046720] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06a670 con 0x5584cc0606d0 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.718+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(70 notify.6 [watch unwatch cookie 94028847046720] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.718+0000 7fb7f4928800 20 remove_watcher() i=6 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.718+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:71 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94028847049344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5584cc06c650 con 0x5584cc0606d0 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f066f640 1 -- 172.21.15.102:0/1604980241 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(71 notify.7 [watch unwatch cookie 94028847049344] v37'239 uv237 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fb7e00c2020 con 0x5584cc0606d0 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 20 remove_watcher() i=7 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc0606d0 msgr2=0x5584cc062ac0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc0606d0 0x5584cc062ac0 crc :-1 s=READY pgs=166 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cc05c2f0 msgr2=0x5584cc05e7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.726 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cc05c2f0 0x5584cc05e7b0 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb7e4037040 msgr2=0x7fb7e4036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fb7e4037040 0x7fb7e4036410 crc :-1 s=READY pgs=89 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc065320 msgr2=0x5584cc0677e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc065320 0x5584cc0677e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6b803cfb0 msgr2=0x7fb6b803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6b803cfb0 0x7fb6b803f470 secure :-1 s=READY pgs=295 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400c010 tx=0x7fb7e4010000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 msgr2=0x5584cc050d70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1604980241 reap_dead start 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc050d70 secure :-1 s=READY pgs=709 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0073dd0 tx=0x7fb7e0094f50 comp rx=0 tx=0).stop 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 shutdown_connections 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1604980241 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc049930 0x5584cc050d70 unknown :-1 s=CLOSED pgs=709 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 >> 172.21.15.102:0/1604980241 conn(0x5584cc045d30 msgr2=0x5584cc043f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.727 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 shutdown_connections 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/1604980241 wait complete. 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/371539131 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6c803cfb0 msgr2=0x7fb6c803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/371539131 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6c803cfb0 0x7fb6c803f470 secure :-1 s=READY pgs=294 cs=0 l=1 rev1=1 crypto rx=0x7fb7e400bf40 tx=0x7fb7e400f000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/371539131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc03d260 msgr2=0x5584cc03d680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/371539131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc03d260 0x5584cc03d680 secure :-1 s=READY pgs=707 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0096d20 tx=0x7fb7e0073670 comp rx=0 tx=0).stop 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/371539131 shutdown_connections 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/371539131 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6c803cfb0 0x7fb6c803f470 unknown :-1 s=CLOSED pgs=294 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 --2- 172.21.15.102:0/371539131 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cc03d260 0x5584cc03d680 unknown :-1 s=CLOSED pgs=707 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.719+0000 7fb7f4928800 1 -- 172.21.15.102:0/371539131 >> 172.21.15.102:0/371539131 conn(0x5584cc031610 msgr2=0x5584cc0319f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/371539131 shutdown_connections 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/371539131 wait complete. 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc028930 msgr2=0x5584cc02add0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5584cc028930 0x5584cc02add0 crc :-1 s=READY pgs=165 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cbf288c0 msgr2=0x5584cc0265e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5584cbf288c0 0x5584cc0265e0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc02c9c0 msgr2=0x5584cc02edb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5584cc02c9c0 0x5584cc02edb0 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6d803cfb0 msgr2=0x7fb6d803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fb6d803cfb0 0x7fb6d803f470 secure :-1 s=READY pgs=293 cs=0 l=1 rev1=1 crypto rx=0x7fb7e4001d70 tx=0x7fb7e40012d0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 msgr2=0x5584cc01ef90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 --2- 172.21.15.102:0/1306092733 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5584cbf25ea0 0x5584cc01ef90 secure :-1 s=READY pgs=706 cs=0 l=1 rev1=1 crypto rx=0x7fb7e0005bf0 tx=0x7fb7e0003330 comp rx=0 tx=0).stop 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f0e70640 1 -- 172.21.15.102:0/1306092733 reap_dead start 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 shutdown_connections 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 >> 172.21.15.102:0/1306092733 conn(0x5584cbf1fa60 msgr2=0x5584cc010820 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 shutdown_connections 2024-09-19T11:15:38.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.720+0000 7fb7f4928800 1 -- 172.21.15.102:0/1306092733 wait complete. 2024-09-19T11:15:38.730 DEBUG:teuthology.orchestra.run:got remote process result: 22 2024-09-19T11:15:38.730 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get', '--rgw-zone', 'default'] 2024-09-19T11:15:38.731 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get', '--rgw-zone', 'default'] 2024-09-19T11:15:38.731 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get --rgw-zone default 2024-09-19T11:15:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:38.774 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff602319800 1 Processor -- start 2024-09-19T11:15:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff602319800 1 -- start start 2024-09-19T11:15:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff602319800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x561f9fb5bc00 0x561f9fb5e090 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff602319800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561f9fb5e710 con 0x561f9fb580f0 2024-09-19T11:15:38.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff602319800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x561f9f9e27d0 con 0x561f9fb5bc00 2024-09-19T11:15:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff5ffe03640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x561f9fb580f0 0x561f9fb5a4e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34690/0 (socket says 172.21.15.102:34690) 2024-09-19T11:15:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff5ffe03640 1 -- 172.21.15.102:0/3580911609 learned_addr learned my addr 172.21.15.102:0/3580911609 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff5ff602640 1 --2- 172.21.15.102:0/3580911609 >> v2:172.21.15.37:3300/0 conn(0x561f9fb5bc00 0x561f9fb5e090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff5fee01640 1 -- 172.21.15.102:0/3580911609 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3390587086 0 0) 0x561f9fb5e710 con 0x561f9fb580f0 2024-09-19T11:15:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff5fee01640 1 -- 172.21.15.102:0/3580911609 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7ff5ec001e10 con 0x561f9fb580f0 2024-09-19T11:15:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff5ff602640 1 -- 172.21.15.102:0/3580911609 >> v1:172.21.15.37:6789/0 conn(0x561f9fb580f0 legacy=0x561f9fb5a4e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.774+0000 7ff5ff602640 1 -- 172.21.15.102:0/3580911609 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9fb5f940 con 0x561f9fb5bc00 2024-09-19T11:15:38.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.776+0000 7ff5ff602640 1 --2- 172.21.15.102:0/3580911609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb5bc00 0x561f9fb5e090 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800a470 tx=0x7ff5e8045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=dcedc34d07ae4e5d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.776+0000 7ff5fee01640 1 -- 172.21.15.102:0/3580911609 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8059070 con 0x561f9fb5bc00 2024-09-19T11:15:38.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.776+0000 7ff5fee01640 1 -- 172.21.15.102:0/3580911609 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5e8054570 con 0x561f9fb5bc00 2024-09-19T11:15:38.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.776+0000 7ff5fee01640 1 -- 172.21.15.102:0/3580911609 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5e8054850 con 0x561f9fb5bc00 2024-09-19T11:15:38.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.777+0000 7ff602319800 1 -- 172.21.15.102:0/3580911609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb5bc00 msgr2=0x561f9fb5e090 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.777+0000 7ff602319800 1 --2- 172.21.15.102:0/3580911609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb5bc00 0x561f9fb5e090 secure :-1 s=READY pgs=711 cs=0 l=1 rev1=1 crypto rx=0x7ff5e800a470 tx=0x7ff5e8045920 comp rx=0 tx=0).stop 2024-09-19T11:15:38.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.777+0000 7ff602319800 1 -- 172.21.15.102:0/3580911609 shutdown_connections 2024-09-19T11:15:38.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.777+0000 7ff602319800 1 --2- 172.21.15.102:0/3580911609 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb5bc00 0x561f9fb5e090 unknown :-1 s=CLOSED pgs=711 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.777+0000 7ff602319800 1 -- 172.21.15.102:0/3580911609 >> 172.21.15.102:0/3580911609 conn(0x561f9fb51bb0 msgr2=0x561f9fb53ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.777+0000 7ff602319800 1 -- 172.21.15.102:0/3580911609 shutdown_connections 2024-09-19T11:15:38.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.777+0000 7ff602319800 1 -- 172.21.15.102:0/3580911609 wait complete. 2024-09-19T11:15:38.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.790+0000 7ff602319800 1 Processor -- start 2024-09-19T11:15:38.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.790+0000 7ff602319800 1 -- start start 2024-09-19T11:15:38.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.790+0000 7ff602319800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc47220 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.790+0000 7ff602319800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f9f9efdd0 con 0x561f9fb580f0 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.791+0000 7ff5ffe03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc47220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.791+0000 7ff5ffe03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc47220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39102/0 (socket says 172.21.15.102:39102) 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.791+0000 7ff5ffe03640 1 -- 172.21.15.102:0/2154175167 learned_addr learned my addr 172.21.15.102:0/2154175167 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.791+0000 7ff5ffe03640 1 -- 172.21.15.102:0/2154175167 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9fc47810 con 0x561f9fb580f0 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.791+0000 7ff5ffe03640 1 --2- 172.21.15.102:0/2154175167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc47220 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8001e30 tx=0x7ff5f800b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2ebdf04434daf2e6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.791+0000 7ff4ede0b640 1 -- 172.21.15.102:0/2154175167 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8012020 con 0x561f9fb580f0 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.791+0000 7ff4ede0b640 1 -- 172.21.15.102:0/2154175167 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f800e470 con 0x561f9fb580f0 2024-09-19T11:15:38.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.791+0000 7ff4ede0b640 1 -- 172.21.15.102:0/2154175167 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f800e790 con 0x561f9fb580f0 2024-09-19T11:15:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 -- 172.21.15.102:0/2154175167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 msgr2=0x561f9fc47220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 --2- 172.21.15.102:0/2154175167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc47220 secure :-1 s=READY pgs=712 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8001e30 tx=0x7ff5f800b780 comp rx=0 tx=0).stop 2024-09-19T11:15:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 -- 172.21.15.102:0/2154175167 shutdown_connections 2024-09-19T11:15:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 --2- 172.21.15.102:0/2154175167 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc47220 unknown :-1 s=CLOSED pgs=712 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.803 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 -- 172.21.15.102:0/2154175167 >> 172.21.15.102:0/2154175167 conn(0x561f9fb51bb0 msgr2=0x561f9fc42ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 -- 172.21.15.102:0/2154175167 shutdown_connections 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 -- 172.21.15.102:0/2154175167 wait complete. 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 Processor -- start 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.792+0000 7ff602319800 1 -- start start 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.793+0000 7ff602319800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc4ed30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.793+0000 7ff602319800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f9fb5ebe0 con 0x561f9fb580f0 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.793+0000 7ff5ffe03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc4ed30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.793+0000 7ff5ffe03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc4ed30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39106/0 (socket says 172.21.15.102:39106) 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.793+0000 7ff5ffe03640 1 -- 172.21.15.102:0/3418670651 learned_addr learned my addr 172.21.15.102:0/3418670651 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.793+0000 7ff5ffe03640 1 -- 172.21.15.102:0/3418670651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9fc4f290 con 0x561f9fb580f0 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.793+0000 7ff5ffe03640 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc4ed30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8000c00 tx=0x7ff5f80040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff4e7fff640 1 -- 172.21.15.102:0/3418670651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8012030 con 0x561f9fb580f0 2024-09-19T11:15:38.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff4e7fff640 1 -- 172.21.15.102:0/3418670651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f801a4d0 con 0x561f9fb580f0 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f9fc4f520 con 0x561f9fb580f0 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff4e7fff640 1 -- 172.21.15.102:0/3418670651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f801a7f0 con 0x561f9fb580f0 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9fc4ff20 con 0x561f9fb580f0 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff602319800 1 Processor -- start 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff602319800 1 -- start start 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff602319800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fc5e710 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff602319800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f9fa4e4a0 con 0x561f9fc5c320 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.794+0000 7ff4e7fff640 1 -- 172.21.15.102:0/3418670651 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff5f8015020 con 0x561f9fb580f0 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff600604640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fc5e710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff600604640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fc5e710 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39116/0 (socket says 172.21.15.102:39116) 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff600604640 1 -- 172.21.15.102:0/989438119 learned_addr learned my addr 172.21.15.102:0/989438119 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff4e7fff640 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4e803d000 0x7ff4e803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff4e7fff640 1 -- 172.21.15.102:0/3418670651 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff5f8020070 con 0x561f9fb580f0 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff5ffe03640 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4e803d000 0x7ff4e803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff600604640 1 -- 172.21.15.102:0/989438119 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9fc5ece0 con 0x561f9fc5c320 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff600604640 1 --2- 172.21.15.102:0/989438119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fc5e710 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000a3e0 tx=0x7ff5f000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=96b4c9821363740 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff5ffe03640 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4e803d000 0x7ff4e803f4c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8024c90 tx=0x7ff5f8024bc0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff4e5ffb640 1 -- 172.21.15.102:0/989438119 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0015070 con 0x561f9fc5c320 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff4e5ffb640 1 -- 172.21.15.102:0/989438119 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f0001670 con 0x561f9fc5c320 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.795+0000 7ff4e5ffb640 1 -- 172.21.15.102:0/989438119 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0001990 con 0x561f9fc5c320 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 -- 172.21.15.102:0/989438119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 msgr2=0x561f9fc5e710 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 --2- 172.21.15.102:0/989438119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fc5e710 secure :-1 s=READY pgs=714 cs=0 l=1 rev1=1 crypto rx=0x7ff5f000a3e0 tx=0x7ff5f000a8a0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 -- 172.21.15.102:0/989438119 shutdown_connections 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 --2- 172.21.15.102:0/989438119 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fc5e710 unknown :-1 s=CLOSED pgs=714 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 -- 172.21.15.102:0/989438119 >> 172.21.15.102:0/989438119 conn(0x561f9fb5bc00 msgr2=0x561f9fc56c40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 -- 172.21.15.102:0/989438119 shutdown_connections 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 -- 172.21.15.102:0/989438119 wait complete. 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 Processor -- start 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 -- start start 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fb57810 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff602319800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f9fc5efd0 con 0x561f9fc5c320 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff600604640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fb57810 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff600604640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fb57810 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39128/0 (socket says 172.21.15.102:39128) 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.796+0000 7ff600604640 1 -- 172.21.15.102:0/880050336 learned_addr learned my addr 172.21.15.102:0/880050336 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.807 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.797+0000 7ff600604640 1 -- 172.21.15.102:0/880050336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9fb57d70 con 0x561f9fc5c320 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.797+0000 7ff600604640 1 --2- 172.21.15.102:0/880050336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fb57810 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0013040 tx=0x7ff5f0003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.797+0000 7ff4dffff640 1 -- 172.21.15.102:0/880050336 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0020020 con 0x561f9fc5c320 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.797+0000 7ff4dffff640 1 -- 172.21.15.102:0/880050336 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f0010780 con 0x561f9fc5c320 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.797+0000 7ff4dffff640 1 -- 172.21.15.102:0/880050336 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f0015040 con 0x561f9fc5c320 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.797+0000 7ff602319800 1 -- 172.21.15.102:0/880050336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f9fb56120 con 0x561f9fc5c320 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.797+0000 7ff602319800 1 -- 172.21.15.102:0/880050336 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9fb56660 con 0x561f9fc5c320 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.798+0000 7ff4dffff640 1 -- 172.21.15.102:0/880050336 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff5f0023020 con 0x561f9fc5c320 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.798+0000 7ff4dffff640 1 --2- 172.21.15.102:0/880050336 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4d803cfb0 0x7ff4d803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.798+0000 7ff4dffff640 1 -- 172.21.15.102:0/880050336 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff5f0053e80 con 0x561f9fc5c320 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.798+0000 7ff5ff602640 1 --2- 172.21.15.102:0/880050336 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4d803cfb0 0x7ff4d803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.798+0000 7ff602319800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.798+0000 7ff602319800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:38.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff602319800 1 Processor -- start 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff5ff602640 1 --2- 172.21.15.102:0/880050336 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4d803cfb0 0x7ff4d803f470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x561f9fac9fc0 tx=0x7ff5e8050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff602319800 1 -- start start 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff602319800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc7f260 0x561f9fc7f680 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff602319800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561f9fc47c40 con 0x561f9fc7f260 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff5ffe03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc7f260 0x561f9fc7f680 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff5ffe03640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc7f260 0x561f9fc7f680 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39140/0 (socket says 172.21.15.102:39140) 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff5ffe03640 1 -- 172.21.15.102:0/4135026866 learned_addr learned my addr 172.21.15.102:0/4135026866 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.799+0000 7ff5ffe03640 1 -- 172.21.15.102:0/4135026866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561f9fc7fcc0 con 0x561f9fc7f260 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.800+0000 7ff5ffe03640 1 --2- 172.21.15.102:0/4135026866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc7f260 0x561f9fc7f680 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8052b20 tx=0x7ff5f801ad60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.800+0000 7ff47ffff640 1 -- 172.21.15.102:0/4135026866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f8017d10 con 0x561f9fc7f260 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.800+0000 7ff47ffff640 1 -- 172.21.15.102:0/4135026866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff5f8017ad0 con 0x561f9fc7f260 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.800+0000 7ff47ffff640 1 -- 172.21.15.102:0/4135026866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff5f802d960 con 0x561f9fc7f260 2024-09-19T11:15:38.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.800+0000 7ff602319800 1 -- 172.21.15.102:0/4135026866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561f9fc804f0 con 0x561f9fc7f260 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.800+0000 7ff602319800 1 -- 172.21.15.102:0/4135026866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561f9fc80a90 con 0x561f9fc7f260 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.800+0000 7ff47ffff640 1 -- 172.21.15.102:0/4135026866 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff5f8016c30 con 0x561f9fc7f260 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.801+0000 7ff47ffff640 1 --2- 172.21.15.102:0/4135026866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff44003d000 0x7ff44003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.801+0000 7ff47ffff640 1 -- 172.21.15.102:0/4135026866 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff5f8050ac0 con 0x561f9fc7f260 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.801+0000 7ff5ff602640 1 --2- 172.21.15.102:0/4135026866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff44003d000 0x7ff44003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.801+0000 7ff47dffb640 20 reqs_thread_entry: start 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.801+0000 7ff5ff602640 1 --2- 172.21.15.102:0/4135026866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff44003d000 0x7ff44003f4c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8000c00 tx=0x7ff5e8005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.801+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561f9fc8cbd0 0x561f9fc8f070 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.801+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561f9fc8f740 con 0x561f9fc8cbd0 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.801+0000 7ff600604640 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561f9fc8cbd0 0x561f9fc8f070 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.802+0000 7ff600604640 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561f9fc8cbd0 0x561f9fc8f070 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.802+0000 7ff600604640 1 -- 172.21.15.102:0/3418670651 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7ff5f000e070 con 0x561f9fc8cbd0 2024-09-19T11:15:38.810 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.802+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561f9fc91510 0x561f9fc93900 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.802+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:2 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561f9fc94000 con 0x561f9fc91510 2024-09-19T11:15:38.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.802+0000 7ff5ffe03640 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561f9fc91510 0x561f9fc93900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.802+0000 7ff5ffe03640 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561f9fc91510 0x561f9fc93900 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.813 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff5ffe03640 1 -- 172.21.15.102:0/3418670651 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(2 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7ff5f8048020 con 0x561f9fc91510 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff602319800 1 -- 172.21.15.102:0/880050336 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4d803cfb0 msgr2=0x7ff4d803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff602319800 1 --2- 172.21.15.102:0/880050336 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4d803cfb0 0x7ff4d803f470 secure :-1 s=READY pgs=297 cs=0 l=1 rev1=1 crypto rx=0x561f9fac9fc0 tx=0x7ff5e8050000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff602319800 1 -- 172.21.15.102:0/880050336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 msgr2=0x561f9fb57810 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff602319800 1 --2- 172.21.15.102:0/880050336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fb57810 secure :-1 s=READY pgs=715 cs=0 l=1 rev1=1 crypto rx=0x7ff5f0013040 tx=0x7ff5f0003370 comp rx=0 tx=0).stop 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff602319800 1 -- 172.21.15.102:0/880050336 shutdown_connections 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff602319800 1 --2- 172.21.15.102:0/880050336 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4d803cfb0 0x7ff4d803f470 unknown :-1 s=CLOSED pgs=297 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff602319800 1 --2- 172.21.15.102:0/880050336 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc5c320 0x561f9fb57810 unknown :-1 s=CLOSED pgs=715 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.803+0000 7ff602319800 1 -- 172.21.15.102:0/880050336 >> 172.21.15.102:0/880050336 conn(0x561f9fb5bc00 msgr2=0x561f9fc56c10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/880050336 shutdown_connections 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/880050336 wait complete. 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/4135026866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff44003d000 msgr2=0x7ff44003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/4135026866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff44003d000 0x7ff44003f4c0 secure :-1 s=READY pgs=298 cs=0 l=1 rev1=1 crypto rx=0x7ff5e8000c00 tx=0x7ff5e8005a00 comp rx=0 tx=0).stop 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/4135026866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc7f260 msgr2=0x561f9fc7f680 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/4135026866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc7f260 0x561f9fc7f680 secure :-1 s=READY pgs=716 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8052b20 tx=0x7ff5f801ad60 comp rx=0 tx=0).stop 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/4135026866 shutdown_connections 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/4135026866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff44003d000 0x7ff44003f4c0 unknown :-1 s=CLOSED pgs=298 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/4135026866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fc7f260 0x561f9fc7f680 unknown :-1 s=CLOSED pgs=716 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/4135026866 >> 172.21.15.102:0/4135026866 conn(0x561f9fc747c0 msgr2=0x561f9fc74ba0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/4135026866 shutdown_connections 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/4135026866 wait complete. 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561f9fc91510 msgr2=0x561f9fc93900 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561f9fc91510 0x561f9fc93900 crc :-1 s=READY pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561f9fc8cbd0 msgr2=0x561f9fc8f070 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561f9fc8cbd0 0x561f9fc8f070 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4e803d000 msgr2=0x7ff4e803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4e803d000 0x7ff4e803f4c0 secure :-1 s=READY pgs=296 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8024c90 tx=0x7ff5f8024bc0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 msgr2=0x561f9fc4ed30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc4ed30 secure :-1 s=READY pgs=713 cs=0 l=1 rev1=1 crypto rx=0x7ff5f8000c00 tx=0x7ff5f80040e0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 shutdown_connections 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561f9fc91510 0x561f9fc93900 unknown :-1 s=CLOSED pgs=167 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561f9fc8cbd0 0x561f9fc8f070 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff4e803d000 0x7ff4e803f4c0 unknown :-1 s=CLOSED pgs=296 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 --2- 172.21.15.102:0/3418670651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561f9fb580f0 0x561f9fc4ed30 unknown :-1 s=CLOSED pgs=713 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 >> 172.21.15.102:0/3418670651 conn(0x561f9fb51bb0 msgr2=0x561f9fc48710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 shutdown_connections 2024-09-19T11:15:38.816 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.804+0000 7ff602319800 1 -- 172.21.15.102:0/3418670651 wait complete. 2024-09-19T11:15:38.817 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-19T11:15:38.817 DEBUG:tasks.util.rgw: json result: {'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-19T11:15:38.818 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'set'] 2024-09-19T11:15:38.818 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'set'] 2024-09-19T11:15:38.818 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone set 2024-09-19T11:15:38.900 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:38.900 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c8292e800 1 Processor -- start 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c8292e800 1 -- start start 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c8292e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55dc229fc840 0x55dc22a05360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c8292e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55dc22a058a0 con 0x55dc229fad20 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c8292e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55dc228877d0 con 0x55dc229fc840 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c77fff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55dc229fc840 0x55dc22a05360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c7e6dd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55dc229fad20 0x55dc229fb120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34704/0 (socket says 172.21.15.102:34704) 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/761461710 learned_addr learned my addr 172.21.15.102:0/761461710 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.900+0000 7f3c77fff640 1 --2- 172.21.15.102:0/761461710 >> v2:172.21.15.37:3300/0 conn(0x55dc229fc840 0x55dc22a05360 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39142/0 (socket says 172.21.15.102:39142) 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.901+0000 7f3c77fff640 1 -- 172.21.15.102:0/761461710 >> v1:172.21.15.37:6789/0 conn(0x55dc229fad20 legacy=0x55dc229fb120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.901+0000 7f3c77fff640 1 -- 172.21.15.102:0/761461710 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc22a06a80 con 0x55dc229fc840 2024-09-19T11:15:38.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c77fff640 1 --2- 172.21.15.102:0/761461710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fc840 0x55dc22a05360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800a470 tx=0x7f3c68045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=45a69f4365aaa068 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c7dedc640 1 -- 172.21.15.102:0/761461710 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c68053570 con 0x55dc229fc840 2024-09-19T11:15:38.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c7dedc640 1 -- 172.21.15.102:0/761461710 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c68058070 con 0x55dc229fc840 2024-09-19T11:15:38.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c7dedc640 1 -- 172.21.15.102:0/761461710 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c68053880 con 0x55dc229fc840 2024-09-19T11:15:38.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c8292e800 1 -- 172.21.15.102:0/761461710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fc840 msgr2=0x55dc22a05360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c8292e800 1 --2- 172.21.15.102:0/761461710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fc840 0x55dc22a05360 secure :-1 s=READY pgs=718 cs=0 l=1 rev1=1 crypto rx=0x7f3c6800a470 tx=0x7f3c68045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:38.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c8292e800 1 -- 172.21.15.102:0/761461710 shutdown_connections 2024-09-19T11:15:38.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c8292e800 1 --2- 172.21.15.102:0/761461710 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fc840 0x55dc22a05360 unknown :-1 s=CLOSED pgs=718 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c8292e800 1 -- 172.21.15.102:0/761461710 >> 172.21.15.102:0/761461710 conn(0x55dc229f6a50 msgr2=0x55dc229f8eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c8292e800 1 -- 172.21.15.102:0/761461710 shutdown_connections 2024-09-19T11:15:38.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.903+0000 7f3c8292e800 1 -- 172.21.15.102:0/761461710 wait complete. 2024-09-19T11:15:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.917+0000 7f3c8292e800 1 Processor -- start 2024-09-19T11:15:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.917+0000 7f3c8292e800 1 -- start start 2024-09-19T11:15:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.917+0000 7f3c8292e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22aee510 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.917+0000 7f3c8292e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc22894dd0 con 0x55dc229fad20 2024-09-19T11:15:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.917+0000 7f3c7e6dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22aee510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.917+0000 7f3c7e6dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22aee510 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39156/0 (socket says 172.21.15.102:39156) 2024-09-19T11:15:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.917+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/1216145491 learned_addr learned my addr 172.21.15.102:0/1216145491 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.919 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.918+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/1216145491 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc22aeeb00 con 0x55dc229fad20 2024-09-19T11:15:38.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.918+0000 7f3c7e6dd640 1 --2- 172.21.15.102:0/1216145491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22aee510 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3c70001e40 tx=0x7f3c70001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2a6f6bc7485cab59 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.918+0000 7f3b6c608640 1 -- 172.21.15.102:0/1216145491 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c70012020 con 0x55dc229fad20 2024-09-19T11:15:38.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.918+0000 7f3b6c608640 1 -- 172.21.15.102:0/1216145491 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c7000e5a0 con 0x55dc229fad20 2024-09-19T11:15:38.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.918+0000 7f3b6c608640 1 -- 172.21.15.102:0/1216145491 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c7000e8a0 con 0x55dc229fad20 2024-09-19T11:15:38.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 -- 172.21.15.102:0/1216145491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 msgr2=0x55dc22aee510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 --2- 172.21.15.102:0/1216145491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22aee510 secure :-1 s=READY pgs=719 cs=0 l=1 rev1=1 crypto rx=0x7f3c70001e40 tx=0x7f3c70001e70 comp rx=0 tx=0).stop 2024-09-19T11:15:38.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 -- 172.21.15.102:0/1216145491 shutdown_connections 2024-09-19T11:15:38.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 --2- 172.21.15.102:0/1216145491 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22aee510 unknown :-1 s=CLOSED pgs=719 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 -- 172.21.15.102:0/1216145491 >> 172.21.15.102:0/1216145491 conn(0x55dc229f6a50 msgr2=0x55dc22ae9e90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 -- 172.21.15.102:0/1216145491 shutdown_connections 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 -- 172.21.15.102:0/1216145491 wait complete. 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 Processor -- start 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 -- start start 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22af6060 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c8292e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc22a05d40 con 0x55dc229fad20 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c7e6dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22af6060 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c7e6dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22af6060 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39172/0 (socket says 172.21.15.102:39172) 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.919+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 learned_addr learned my addr 172.21.15.102:0/2144410323 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.920+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc22af65c0 con 0x55dc229fad20 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.920+0000 7f3c7e6dd640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22af6060 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c010 tx=0x7f3c70000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.920+0000 7f3b6ae05640 1 -- 172.21.15.102:0/2144410323 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c70012030 con 0x55dc229fad20 2024-09-19T11:15:38.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.920+0000 7f3b6ae05640 1 -- 172.21.15.102:0/2144410323 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c700014a0 con 0x55dc229fad20 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.920+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc22af6850 con 0x55dc229fad20 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.920+0000 7f3b6ae05640 1 -- 172.21.15.102:0/2144410323 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c7001a7a0 con 0x55dc229fad20 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.920+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc22af7250 con 0x55dc229fad20 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3c8292e800 1 Processor -- start 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3c8292e800 1 -- start start 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3c8292e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b05a40 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3b6ae05640 1 -- 172.21.15.102:0/2144410323 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3c70015020 con 0x55dc229fad20 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3c8292e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc228f34a0 con 0x55dc22b03650 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3b6ae05640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b6403cfb0 0x7f3b6403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3b6ae05640 1 -- 172.21.15.102:0/2144410323 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f3c70020030 con 0x55dc229fad20 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3c7e6dd640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b6403cfb0 0x7f3b6403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3c7eede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b05a40 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3c7eede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b05a40 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39174/0 (socket says 172.21.15.102:39174) 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.921+0000 7f3c7eede640 1 -- 172.21.15.102:0/3735618721 learned_addr learned my addr 172.21.15.102:0/3735618721 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c7e6dd640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b6403cfb0 0x7f3b6403f470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3c70018fd0 tx=0x7f3c70018f00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c7eede640 1 -- 172.21.15.102:0/3735618721 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc22b06010 con 0x55dc22b03650 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c7eede640 1 --2- 172.21.15.102:0/3735618721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b05a40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800a3e0 tx=0x7f3c7800a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=229d3886f55fd12e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3b68e01640 1 -- 172.21.15.102:0/3735618721 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c78015070 con 0x55dc22b03650 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3b68e01640 1 -- 172.21.15.102:0/3735618721 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c78001670 con 0x55dc22b03650 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3b68e01640 1 -- 172.21.15.102:0/3735618721 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c78001990 con 0x55dc22b03650 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c8292e800 1 -- 172.21.15.102:0/3735618721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 msgr2=0x55dc22b05a40 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c8292e800 1 --2- 172.21.15.102:0/3735618721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b05a40 secure :-1 s=READY pgs=721 cs=0 l=1 rev1=1 crypto rx=0x7f3c7800a3e0 tx=0x7f3c7800a8a0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c8292e800 1 -- 172.21.15.102:0/3735618721 shutdown_connections 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c8292e800 1 --2- 172.21.15.102:0/3735618721 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b05a40 unknown :-1 s=CLOSED pgs=721 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c8292e800 1 -- 172.21.15.102:0/3735618721 >> 172.21.15.102:0/3735618721 conn(0x55dc229fc840 msgr2=0x55dc22afdf70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c8292e800 1 -- 172.21.15.102:0/3735618721 shutdown_connections 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.922+0000 7f3c8292e800 1 -- 172.21.15.102:0/3735618721 wait complete. 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.923+0000 7f3c8292e800 1 Processor -- start 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.923+0000 7f3c8292e800 1 -- start start 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.923+0000 7f3c8292e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b0a4f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.923+0000 7f3c8292e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc22b06330 con 0x55dc22b03650 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.923+0000 7f3c7eede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b0a4f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.923+0000 7f3c7eede640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b0a4f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39184/0 (socket says 172.21.15.102:39184) 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.923+0000 7f3c7eede640 1 -- 172.21.15.102:0/2029206915 learned_addr learned my addr 172.21.15.102:0/2029206915 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.924+0000 7f3c7eede640 1 -- 172.21.15.102:0/2029206915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc22b0aa50 con 0x55dc22b03650 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.924+0000 7f3c7eede640 1 --2- 172.21.15.102:0/2029206915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b0a4f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x55dc22afe950 tx=0x7f3c78003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.924+0000 7f3b62ffd640 1 -- 172.21.15.102:0/2029206915 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c78020020 con 0x55dc22b03650 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.924+0000 7f3b62ffd640 1 -- 172.21.15.102:0/2029206915 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c78010780 con 0x55dc22b03650 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.924+0000 7f3c8292e800 1 -- 172.21.15.102:0/2029206915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc22b0ace0 con 0x55dc22b03650 2024-09-19T11:15:38.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.924+0000 7f3b62ffd640 1 -- 172.21.15.102:0/2029206915 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c78015040 con 0x55dc22b03650 2024-09-19T11:15:38.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.924+0000 7f3c8292e800 1 -- 172.21.15.102:0/2029206915 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc22b0b660 con 0x55dc22b03650 2024-09-19T11:15:38.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.925+0000 7f3b62ffd640 1 -- 172.21.15.102:0/2029206915 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3c78023020 con 0x55dc22b03650 2024-09-19T11:15:38.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.925+0000 7f3b62ffd640 1 --2- 172.21.15.102:0/2029206915 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b5803d000 0x7f3b5803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.925+0000 7f3b62ffd640 1 -- 172.21.15.102:0/2029206915 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f3c78053ef0 con 0x55dc22b03650 2024-09-19T11:15:38.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.925+0000 7f3c77fff640 1 --2- 172.21.15.102:0/2029206915 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b5803d000 0x7f3b5803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.925+0000 7f3c8292e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:38.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.925+0000 7f3c8292e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c77fff640 1 --2- 172.21.15.102:0/2029206915 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b5803d000 0x7f3b5803f4c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3c68057000 tx=0x7f3c68052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c8292e800 1 Processor -- start 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c8292e800 1 -- start start 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c8292e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b24380 0x55dc22b247a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c8292e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55dc22aeef30 con 0x55dc22b24380 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c7e6dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b24380 0x55dc22b247a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c7e6dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b24380 0x55dc22b247a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39190/0 (socket says 172.21.15.102:39190) 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/639421337 learned_addr learned my addr 172.21.15.102:0/639421337 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.926+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/639421337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55dc22b24de0 con 0x55dc22b24380 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.927+0000 7f3c7e6dd640 1 --2- 172.21.15.102:0/639421337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b24380 0x55dc22b247a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c720 tx=0x7f3c700529c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.927+0000 7f3b42fe5640 1 -- 172.21.15.102:0/639421337 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c70046020 con 0x55dc22b24380 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.927+0000 7f3b42fe5640 1 -- 172.21.15.102:0/639421337 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3c70018430 con 0x55dc22b24380 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.927+0000 7f3c8292e800 1 -- 172.21.15.102:0/639421337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55dc22b25610 con 0x55dc22b24380 2024-09-19T11:15:38.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.927+0000 7f3b42fe5640 1 -- 172.21.15.102:0/639421337 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3c7000db60 con 0x55dc22b24380 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.927+0000 7f3c8292e800 1 -- 172.21.15.102:0/639421337 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55dc22b25bb0 con 0x55dc22b24380 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3b42fe5640 1 -- 172.21.15.102:0/639421337 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3c70049020 con 0x55dc22b24380 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3b42fe5640 1 --2- 172.21.15.102:0/639421337 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ac003cfb0 0x7f3ac003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3b42fe5640 1 -- 172.21.15.102:0/639421337 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f3c7003d030 con 0x55dc22b24380 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3c77fff640 1 --2- 172.21.15.102:0/639421337 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ac003cfb0 0x7f3ac003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3b40fe1640 20 reqs_thread_entry: start 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55dc22b31ca0 0x55dc22b340f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b34730 con 0x55dc22b31ca0 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3c77fff640 1 --2- 172.21.15.102:0/639421337 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ac003cfb0 0x7f3ac003f470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55dc2296ef40 tx=0x7f3c68005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.928+0000 7f3c7eede640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55dc22b31ca0 0x55dc22b340f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.929+0000 7f3c7eede640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55dc22b31ca0 0x55dc22b340f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.929+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.929+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b35010 con 0x55dc22b31ca0 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.929+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.929+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55dc22b36920 0x55dc22b38d70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.929+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b39500 con 0x55dc22b36920 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.929+0000 7f3c7e6dd640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55dc22b36920 0x55dc22b38d70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.930+0000 7f3c7e6dd640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55dc22b36920 0x55dc22b38d70 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.930+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.930+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b46640 con 0x55dc22b31ca0 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:NOTICE: set zone's realm_id= 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55dc22b3da00 0x55dc22b40930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c77fff640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55dc22b3da00 0x55dc22b40930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c77fff640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55dc22b3da00 0x55dc22b40930 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c77fff640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3c68078040 0x7f3c6805f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:6 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x7f3c68078040 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.931+0000 7f3c7eede640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3c68078040 0x7f3c6805f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.932+0000 7f3c7eede640 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3c68078040 0x7f3c6805f420 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.932+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x7f3c68078040 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.932+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:7 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b36920 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.932+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.932+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:8 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b31ca0 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.933+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.933+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b31ca0 2024-09-19T11:15:38.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.933+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.933+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:10 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b36920 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.933+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.933+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b36920 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.933+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.933+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:12 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x7f3c68078040 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.934+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x7f3c68078040 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.934+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:13 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.934+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.934+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:14 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b31ca0 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.934+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.934+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:15 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b36920 2024-09-19T11:15:38.943 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:16 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b31ca0 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:17 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x7f3c68078040 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(17 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f3c7800e070 con 0x7f3c68078040 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:18 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(19 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.935+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:20 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b36920 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.936+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(20 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.936+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:21 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.936+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.944 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.936+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.936+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.936+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:23 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b31ca0 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.937+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.937+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b31ca0 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.937+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=74b] v28'1 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.937+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:25 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b36920 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.937+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(25 [pgnls start_epoch 37 out=107b] v35'2 uv2 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.937+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:26 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.937+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.945 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.937+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:27 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x7f3c68078040 2024-09-19T11:15:38.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.938+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x7f3c68078040 2024-09-19T11:15:38.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.938+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:28 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b31ca0 2024-09-19T11:15:38.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.938+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.938+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:29 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b36920 2024-09-19T11:15:38.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.938+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.950 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.938+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:30 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.938+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.938+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:31 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b36920 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.939+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.939+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:32 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x7f3c68078040 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.939+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x7f3c68078040 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.939+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:33 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b3da00 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.939+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c68051070 con 0x55dc22b3da00 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.939+0000 7f3c77fff640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:34 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x7f3c68078040 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.939+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x7f3c68078040 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.939+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:35 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x55dc22b31ca0 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.940+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(35 [pgnls start_epoch 37 out=115b] v28'2 uv2 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.940+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:36 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b404b0 con 0x7f3c68078040 2024-09-19T11:15:38.951 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.940+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(36 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3c7800e070 con 0x7f3c68078040 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.940+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:37 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b44510 con 0x55dc22b31ca0 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.940+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(37 zone_names.default [read 0~46 out=46b] v0'0 uv1 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.940+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:38 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b35c30 con 0x55dc22b36920 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.941+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(38 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv2 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.941+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:39 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [create,call version.set in=58b,writefull 0~1155 in=1155b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b3fd40 con 0x55dc22b36920 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.942+0000 7f3c7e6dd640 1 -- 172.21.15.102:0/2144410323 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(39 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [create,call,writefull 0~1155] v37'3 uv3 ondisk = 0) ==== 274+0+0 (crc 0 0 0) 0x7f3c700424a0 con 0x55dc22b36920 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.942+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:40 5.f 5:f43b6ece:::zone_names.default:head [create,call version.set in=58b,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b41ae0 con 0x55dc22b31ca0 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.943+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(40 zone_names.default [create,call,writefull 0~46] v37'3 uv3 ondisk = 0) ==== 246+0+0 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.943+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:41 5.19 5:9f02474b:::default.zone.:head [create,writefull 0~46 in=46b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55dc22b3f000 con 0x55dc22b31ca0 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.944+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(41 default.zone. [create,writefull 0~46] v37'2 uv1 ondisk = -17 ((17) File exists)) ==== 199+0+0 (crc 0 0 0) 0x7f3c7800e070 con 0x55dc22b31ca0 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/2029206915 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b5803d000 msgr2=0x7f3b5803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.952 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2029206915 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b5803d000 0x7f3b5803f4c0 secure :-1 s=READY pgs=300 cs=0 l=1 rev1=1 crypto rx=0x7f3c68057000 tx=0x7f3c68052000 comp rx=0 tx=0).stop 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/2029206915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 msgr2=0x55dc22b0a4f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2029206915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b0a4f0 secure :-1 s=READY pgs=722 cs=0 l=1 rev1=1 crypto rx=0x55dc22afe950 tx=0x7f3c78003370 comp rx=0 tx=0).stop 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/2029206915 shutdown_connections 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2029206915 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b5803d000 0x7f3b5803f4c0 unknown :-1 s=CLOSED pgs=300 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2029206915 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b03650 0x55dc22b0a4f0 unknown :-1 s=CLOSED pgs=722 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/2029206915 >> 172.21.15.102:0/2029206915 conn(0x55dc229fc840 msgr2=0x55dc22afdf40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/2029206915 shutdown_connections 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/2029206915 wait complete. 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/639421337 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ac003cfb0 msgr2=0x7f3ac003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 --2- 172.21.15.102:0/639421337 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ac003cfb0 0x7f3ac003f470 secure :-1 s=READY pgs=301 cs=0 l=1 rev1=1 crypto rx=0x55dc2296ef40 tx=0x7f3c68005a00 comp rx=0 tx=0).stop 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/639421337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b24380 msgr2=0x55dc22b247a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 --2- 172.21.15.102:0/639421337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b24380 0x55dc22b247a0 secure :-1 s=READY pgs=723 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c720 tx=0x7f3c700529c0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/639421337 shutdown_connections 2024-09-19T11:15:38.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 --2- 172.21.15.102:0/639421337 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3ac003cfb0 0x7f3ac003f470 unknown :-1 s=CLOSED pgs=301 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 --2- 172.21.15.102:0/639421337 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc22b24380 0x55dc22b247a0 unknown :-1 s=CLOSED pgs=723 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.945+0000 7f3c8292e800 1 -- 172.21.15.102:0/639421337 >> 172.21.15.102:0/639421337 conn(0x55dc22b198c0 msgr2=0x55dc22b19ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/639421337 shutdown_connections 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/639421337 wait complete. 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55dc22b36920 msgr2=0x55dc22b38d70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55dc22b36920 0x55dc22b38d70 crc :-1 s=READY pgs=168 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55dc22b31ca0 msgr2=0x55dc22b340f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55dc22b31ca0 0x55dc22b340f0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3c68078040 msgr2=0x7f3c6805f420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3c68078040 0x7f3c6805f420 crc :-1 s=READY pgs=90 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55dc22b3da00 msgr2=0x55dc22b40930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55dc22b3da00 0x55dc22b40930 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b6403cfb0 msgr2=0x7f3b6403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3b6403cfb0 0x7f3b6403f470 secure :-1 s=READY pgs=299 cs=0 l=1 rev1=1 crypto rx=0x7f3c70018fd0 tx=0x7f3c70018f00 comp rx=0 tx=0).stop 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 msgr2=0x55dc22af6060 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 --2- 172.21.15.102:0/2144410323 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55dc229fad20 0x55dc22af6060 secure :-1 s=READY pgs=720 cs=0 l=1 rev1=1 crypto rx=0x7f3c7000c010 tx=0x7f3c70000ed0 comp rx=0 tx=0).stop 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 reap_dead start 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c7eede640 1 -- 172.21.15.102:0/2144410323 reap_dead start 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 shutdown_connections 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 >> 172.21.15.102:0/2144410323 conn(0x55dc229f6a50 msgr2=0x55dc22aefa00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 shutdown_connections 2024-09-19T11:15:38.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:38.946+0000 7f3c8292e800 1 -- 172.21.15.102:0/2144410323 wait complete. 2024-09-19T11:15:38.956 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-19T11:15:38.956 DEBUG:tasks.util.rgw: json result: {'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-19T11:15:38.957 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'get'] 2024-09-19T11:15:38.957 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'get'] 2024-09-19T11:15:38.957 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone get 2024-09-19T11:15:39.040 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:39.040 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:39.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab92215800 1 Processor -- start 2024-09-19T11:15:39.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab92215800 1 -- start start 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab92215800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a25f5e1880 0x55a25f5e2440 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab92215800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55a25f5e1f30 con 0x55a25f5e2980 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab92215800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55a25f46c7d0 con 0x55a25f5e1880 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab8d992640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a25f5e1880 0x55a25f5e2440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab8d992640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55a25f5e1880 0x55a25f5e2440 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39194/0 (socket says 172.21.15.102:39194) 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab8d191640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55a25f5e2980 0x55a25f5e76e0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34712/0 (socket says 172.21.15.102:34712) 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.040+0000 7fab8d992640 1 -- 172.21.15.102:0/3522025916 learned_addr learned my addr 172.21.15.102:0/3522025916 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.041+0000 7fab8d992640 1 -- 172.21.15.102:0/3522025916 >> v1:172.21.15.37:6789/0 conn(0x55a25f5e2980 legacy=0x55a25f5e76e0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.041+0000 7fab8d992640 1 -- 172.21.15.102:0/3522025916 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25f5e2e30 con 0x55a25f5e1880 2024-09-19T11:15:39.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.041+0000 7fab8c990640 1 -- 172.21.15.102:0/3522025916 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1857292181 0 0) 0x55a25f5e1f30 con 0x55a25f5e2980 2024-09-19T11:15:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.042+0000 7fab8d992640 1 --2- 172.21.15.102:0/3522025916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5e2440 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fab88005fd0 tx=0x7fab88045cf0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4ae79070a5daa573 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.042+0000 7fab8c990640 1 -- 172.21.15.102:0/3522025916 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab8804e600 con 0x55a25f5e1880 2024-09-19T11:15:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.042+0000 7fab8c990640 1 -- 172.21.15.102:0/3522025916 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8804e7a0 con 0x55a25f5e1880 2024-09-19T11:15:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.042+0000 7fab8c990640 1 -- 172.21.15.102:0/3522025916 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab8804eaa0 con 0x55a25f5e1880 2024-09-19T11:15:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.043+0000 7fab92215800 1 -- 172.21.15.102:0/3522025916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 msgr2=0x55a25f5e2440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.043+0000 7fab92215800 1 --2- 172.21.15.102:0/3522025916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5e2440 secure :-1 s=READY pgs=725 cs=0 l=1 rev1=1 crypto rx=0x7fab88005fd0 tx=0x7fab88045cf0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.043+0000 7fab92215800 1 -- 172.21.15.102:0/3522025916 shutdown_connections 2024-09-19T11:15:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.043+0000 7fab92215800 1 --2- 172.21.15.102:0/3522025916 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5e2440 unknown :-1 s=CLOSED pgs=725 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.043+0000 7fab92215800 1 -- 172.21.15.102:0/3522025916 >> 172.21.15.102:0/3522025916 conn(0x55a25f5dcc50 msgr2=0x55a25f5df0b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.043+0000 7fab92215800 1 -- 172.21.15.102:0/3522025916 shutdown_connections 2024-09-19T11:15:39.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.043+0000 7fab92215800 1 -- 172.21.15.102:0/3522025916 wait complete. 2024-09-19T11:15:39.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab92215800 1 Processor -- start 2024-09-19T11:15:39.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab92215800 1 -- start start 2024-09-19T11:15:39.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab92215800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f6d1120 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab92215800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a25f479dd0 con 0x55a25f5e1880 2024-09-19T11:15:39.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab8d992640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f6d1120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab8d992640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f6d1120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39206/0 (socket says 172.21.15.102:39206) 2024-09-19T11:15:39.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab8d992640 1 -- 172.21.15.102:0/4184912793 learned_addr learned my addr 172.21.15.102:0/4184912793 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab8d992640 1 -- 172.21.15.102:0/4184912793 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25f6d1710 con 0x55a25f5e1880 2024-09-19T11:15:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.057+0000 7fab8d992640 1 --2- 172.21.15.102:0/4184912793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f6d1120 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fab8800a190 tx=0x7fab88050000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2f0004ee1887ea4e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7faa7be07640 1 -- 172.21.15.102:0/4184912793 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab88065020 con 0x55a25f5e1880 2024-09-19T11:15:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7faa7be07640 1 -- 172.21.15.102:0/4184912793 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8805c040 con 0x55a25f5e1880 2024-09-19T11:15:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7faa7be07640 1 -- 172.21.15.102:0/4184912793 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab8804ebb0 con 0x55a25f5e1880 2024-09-19T11:15:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7fab92215800 1 -- 172.21.15.102:0/4184912793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 msgr2=0x55a25f6d1120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7fab92215800 1 --2- 172.21.15.102:0/4184912793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f6d1120 secure :-1 s=READY pgs=726 cs=0 l=1 rev1=1 crypto rx=0x7fab8800a190 tx=0x7fab88050000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7fab92215800 1 -- 172.21.15.102:0/4184912793 shutdown_connections 2024-09-19T11:15:39.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7fab92215800 1 --2- 172.21.15.102:0/4184912793 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f6d1120 unknown :-1 s=CLOSED pgs=726 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7fab92215800 1 -- 172.21.15.102:0/4184912793 >> 172.21.15.102:0/4184912793 conn(0x55a25f5dcc50 msgr2=0x55a25f6ccaa0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7fab92215800 1 -- 172.21.15.102:0/4184912793 shutdown_connections 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.058+0000 7fab92215800 1 -- 172.21.15.102:0/4184912793 wait complete. 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.059+0000 7fab92215800 1 Processor -- start 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.059+0000 7fab92215800 1 -- start start 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.059+0000 7fab92215800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5570e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.059+0000 7fab92215800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a25f5e8e00 con 0x55a25f5e1880 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.059+0000 7fab8d992640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5570e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.059+0000 7fab8d992640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5570e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39208/0 (socket says 172.21.15.102:39208) 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.059+0000 7fab8d992640 1 -- 172.21.15.102:0/2771241986 learned_addr learned my addr 172.21.15.102:0/2771241986 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.059+0000 7fab8d992640 1 -- 172.21.15.102:0/2771241986 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25f557640 con 0x55a25f5e1880 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.060+0000 7fab8d992640 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5570e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fab88045d30 tx=0x7fab88003330 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.060+0000 7faa7a604640 1 -- 172.21.15.102:0/2771241986 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab88065030 con 0x55a25f5e1880 2024-09-19T11:15:39.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.060+0000 7faa7a604640 1 -- 172.21.15.102:0/2771241986 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab8804ee50 con 0x55a25f5e1880 2024-09-19T11:15:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.060+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a25f5559f0 con 0x55a25f5e1880 2024-09-19T11:15:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.060+0000 7faa7a604640 1 -- 172.21.15.102:0/2771241986 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab8806c5e0 con 0x55a25f5e1880 2024-09-19T11:15:39.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.060+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a25f556010 con 0x55a25f5e1880 2024-09-19T11:15:39.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7fab92215800 1 Processor -- start 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7fab92215800 1 -- start start 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7fab92215800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ea770 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7fab92215800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a25f4d84a0 con 0x55a25f6e8380 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7faa7a604640 1 -- 172.21.15.102:0/2771241986 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fab8806c7d0 con 0x55a25f5e1880 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7faa7a604640 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa7403cfb0 0x7faa7403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7fab8e193640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ea770 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7faa7a604640 1 -- 172.21.15.102:0/2771241986 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fab880986f0 con 0x55a25f5e1880 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7fab8e193640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ea770 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39212/0 (socket says 172.21.15.102:39212) 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7fab8e193640 1 -- 172.21.15.102:0/2434085212 learned_addr learned my addr 172.21.15.102:0/2434085212 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.061+0000 7fab8d992640 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa7403cfb0 0x7faa7403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab8e193640 1 -- 172.21.15.102:0/2434085212 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25f6ead40 con 0x55a25f6e8380 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab8d992640 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa7403cfb0 0x7faa7403f470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab88060fd0 tx=0x7fab8806bed0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab8e193640 1 --2- 172.21.15.102:0/2434085212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ea770 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fab8000a430 tx=0x7fab8000a8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3bba02cd736ce18 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7faa73fff640 1 -- 172.21.15.102:0/2434085212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab80008840 con 0x55a25f6e8380 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7faa73fff640 1 -- 172.21.15.102:0/2434085212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab80008a00 con 0x55a25f6e8380 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7faa73fff640 1 -- 172.21.15.102:0/2434085212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab80008d20 con 0x55a25f6e8380 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab92215800 1 -- 172.21.15.102:0/2434085212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 msgr2=0x55a25f6ea770 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab92215800 1 --2- 172.21.15.102:0/2434085212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ea770 secure :-1 s=READY pgs=728 cs=0 l=1 rev1=1 crypto rx=0x7fab8000a430 tx=0x7fab8000a8f0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab92215800 1 -- 172.21.15.102:0/2434085212 shutdown_connections 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab92215800 1 --2- 172.21.15.102:0/2434085212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ea770 unknown :-1 s=CLOSED pgs=728 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab92215800 1 -- 172.21.15.102:0/2434085212 >> 172.21.15.102:0/2434085212 conn(0x55a25f5e2980 msgr2=0x55a25f6e2ca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab92215800 1 -- 172.21.15.102:0/2434085212 shutdown_connections 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.062+0000 7fab92215800 1 -- 172.21.15.102:0/2434085212 wait complete. 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab92215800 1 Processor -- start 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab92215800 1 -- start start 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab92215800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ef1a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab92215800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a25f6eb000 con 0x55a25f6e8380 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab8e193640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ef1a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab8e193640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ef1a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39228/0 (socket says 172.21.15.102:39228) 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab8e193640 1 -- 172.21.15.102:0/660077508 learned_addr learned my addr 172.21.15.102:0/660077508 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab8e193640 1 -- 172.21.15.102:0/660077508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25f6ef700 con 0x55a25f6e8380 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.063+0000 7fab8e193640 1 --2- 172.21.15.102:0/660077508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ef1a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55a25f6e3680 tx=0x7fab80002ff0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.064+0000 7faa727fc640 1 -- 172.21.15.102:0/660077508 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab80022030 con 0x55a25f6e8380 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.064+0000 7faa727fc640 1 -- 172.21.15.102:0/660077508 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab80019040 con 0x55a25f6e8380 2024-09-19T11:15:39.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.064+0000 7fab92215800 1 -- 172.21.15.102:0/660077508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a25f6ef990 con 0x55a25f6e8380 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.064+0000 7faa727fc640 1 -- 172.21.15.102:0/660077508 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab80013930 con 0x55a25f6e8380 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.064+0000 7fab92215800 1 -- 172.21.15.102:0/660077508 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a25f6f0310 con 0x55a25f6e8380 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7faa727fc640 1 -- 172.21.15.102:0/660077508 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fab80025070 con 0x55a25f6e8380 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7faa727fc640 1 --2- 172.21.15.102:0/660077508 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa6803cfb0 0x7faa6803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7faa727fc640 1 -- 172.21.15.102:0/660077508 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fab80023070 con 0x55a25f6e8380 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7fab8d191640 1 --2- 172.21.15.102:0/660077508 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa6803cfb0 0x7faa6803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7fab92215800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7fab92215800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7fab92215800 1 Processor -- start 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7fab8d191640 1 --2- 172.21.15.102:0/660077508 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa6803cfb0 0x7faa6803f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab78001330 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.065+0000 7fab92215800 1 -- start start 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab92215800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f708f90 0x55a25f7093b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab92215800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55a25f6d1a80 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab8d992640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f708f90 0x55a25f7093b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab8d992640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f708f90 0x55a25f7093b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39242/0 (socket says 172.21.15.102:39242) 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab8d992640 1 -- 172.21.15.102:0/2755576790 learned_addr learned my addr 172.21.15.102:0/2755576790 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab8d992640 1 -- 172.21.15.102:0/2755576790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55a25f7099f0 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab8d992640 1 --2- 172.21.15.102:0/2755576790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f708f90 0x55a25f7093b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fab88061fd0 tx=0x7fab880554d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7faa527e4640 1 -- 172.21.15.102:0/2755576790 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab88079040 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7faa527e4640 1 -- 172.21.15.102:0/2755576790 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fab88061420 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7faa527e4640 1 -- 172.21.15.102:0/2755576790 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fab88060940 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab92215800 1 -- 172.21.15.102:0/2755576790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55a25f70a220 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.066+0000 7fab92215800 1 -- 172.21.15.102:0/2755576790 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55a25f70a7c0 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.067+0000 7faa527e4640 1 -- 172.21.15.102:0/2755576790 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fab88088040 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.067+0000 7faa527e4640 1 --2- 172.21.15.102:0/2755576790 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa9d003d000 0x7fa9d003f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.067+0000 7faa527e4640 1 -- 172.21.15.102:0/2755576790 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fab8809dac0 con 0x55a25f708f90 2024-09-19T11:15:39.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.067+0000 7fab8d191640 1 --2- 172.21.15.102:0/2755576790 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa9d003d000 0x7fa9d003f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.068+0000 7fa9c3fff640 20 reqs_thread_entry: start 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.068+0000 7fab8d191640 1 --2- 172.21.15.102:0/2755576790 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa9d003d000 0x7fa9d003f4c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab78000f60 tx=0x7fab78006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.068+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a25f7168b0 0x55a25f718d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.068+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a25f719380 con 0x55a25f7168b0 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.068+0000 7fab8e193640 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a25f7168b0 0x55a25f718d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.068+0000 7fab8e193640 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a25f7168b0 0x55a25f718d00 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.068+0000 7fab8e193640 1 -- 172.21.15.102:0/2771241986 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fab8001ed20 con 0x55a25f7168b0 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.068+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a25f719c60 con 0x55a25f7168b0 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.069+0000 7fab8e193640 1 -- 172.21.15.102:0/2771241986 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fab8001ed20 con 0x55a25f7168b0 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.069+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a25f71b570 0x55a25f71d9c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.069+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55a25f71e150 con 0x55a25f71b570 2024-09-19T11:15:39.075 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.069+0000 7fab8d992640 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a25f71b570 0x55a25f71d9c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.069+0000 7fab8d992640 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a25f71b570 0x55a25f71d9c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab8d992640 1 -- 172.21.15.102:0/2771241986 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7fab8807b070 con 0x55a25f71b570 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 -- 172.21.15.102:0/660077508 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa6803cfb0 msgr2=0x7faa6803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 --2- 172.21.15.102:0/660077508 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa6803cfb0 0x7faa6803f470 secure :-1 s=READY pgs=303 cs=0 l=1 rev1=1 crypto rx=0x7fab78000c00 tx=0x7fab78001330 comp rx=0 tx=0).stop 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 -- 172.21.15.102:0/660077508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 msgr2=0x55a25f6ef1a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 --2- 172.21.15.102:0/660077508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ef1a0 secure :-1 s=READY pgs=729 cs=0 l=1 rev1=1 crypto rx=0x55a25f6e3680 tx=0x7fab80002ff0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 -- 172.21.15.102:0/660077508 shutdown_connections 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 --2- 172.21.15.102:0/660077508 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa6803cfb0 0x7faa6803f470 unknown :-1 s=CLOSED pgs=303 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 --2- 172.21.15.102:0/660077508 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f6e8380 0x55a25f6ef1a0 unknown :-1 s=CLOSED pgs=729 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 -- 172.21.15.102:0/660077508 >> 172.21.15.102:0/660077508 conn(0x55a25f5e2980 msgr2=0x55a25f6e2c70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.078 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.070+0000 7fab92215800 1 -- 172.21.15.102:0/660077508 shutdown_connections 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/660077508 wait complete. 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2755576790 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa9d003d000 msgr2=0x7fa9d003f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2755576790 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa9d003d000 0x7fa9d003f4c0 secure :-1 s=READY pgs=304 cs=0 l=1 rev1=1 crypto rx=0x7fab78000f60 tx=0x7fab78006000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2755576790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f708f90 msgr2=0x55a25f7093b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2755576790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f708f90 0x55a25f7093b0 secure :-1 s=READY pgs=730 cs=0 l=1 rev1=1 crypto rx=0x7fab88061fd0 tx=0x7fab880554d0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2755576790 shutdown_connections 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2755576790 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fa9d003d000 0x7fa9d003f4c0 unknown :-1 s=CLOSED pgs=304 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2755576790 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f708f90 0x55a25f7093b0 unknown :-1 s=CLOSED pgs=730 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2755576790 >> 172.21.15.102:0/2755576790 conn(0x55a25f6fe510 msgr2=0x55a25f6fe8f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2755576790 shutdown_connections 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2755576790 wait complete. 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a25f71b570 msgr2=0x55a25f71d9c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a25f71b570 0x55a25f71d9c0 crc :-1 s=READY pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.079 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a25f7168b0 msgr2=0x55a25f718d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a25f7168b0 0x55a25f718d00 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa7403cfb0 msgr2=0x7faa7403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa7403cfb0 0x7faa7403f470 secure :-1 s=READY pgs=302 cs=0 l=1 rev1=1 crypto rx=0x7fab88060fd0 tx=0x7fab8806bed0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 msgr2=0x55a25f5570e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5570e0 secure :-1 s=READY pgs=727 cs=0 l=1 rev1=1 crypto rx=0x7fab88045d30 tx=0x7fab88003330 comp rx=0 tx=0).stop 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 shutdown_connections 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55a25f71b570 0x55a25f71d9c0 unknown :-1 s=CLOSED pgs=169 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55a25f7168b0 0x55a25f718d00 unknown :-1 s=CLOSED pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faa7403cfb0 0x7faa7403f470 unknown :-1 s=CLOSED pgs=302 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 --2- 172.21.15.102:0/2771241986 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55a25f5e1880 0x55a25f5570e0 unknown :-1 s=CLOSED pgs=727 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 >> 172.21.15.102:0/2771241986 conn(0x55a25f5dcc50 msgr2=0x55a25f6d2450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 shutdown_connections 2024-09-19T11:15:39.080 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.071+0000 7fab92215800 1 -- 172.21.15.102:0/2771241986 wait complete. 2024-09-19T11:15:39.081 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}},{"key":"new-placement","val":{"index_pool":".rgw.buckets.index.2","storage_classes":{"STANDARD":{"data_pool":".rgw.buckets.2"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":false}}],"realm_id":""} 2024-09-19T11:15:39.082 DEBUG:tasks.util.rgw: json result: {'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}, {'key': 'new-placement', 'val': {'index_pool': '.rgw.buckets.index.2', 'storage_classes': {'STANDARD': {'data_pool': '.rgw.buckets.2'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': False}}], 'realm_id': ''} 2024-09-19T11:15:39.082 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-19T11:15:39.082 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zone', 'placement', 'rm', '--rgw-zone', 'default', '--placement-id', 'new-placement'] 2024-09-19T11:15:39.082 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zone placement rm --rgw-zone default --placement-id new-placement 2024-09-19T11:15:39.169 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:39.169 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:39.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.169+0000 7f326c887800 1 Processor -- start 2024-09-19T11:15:39.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.169+0000 7f326c887800 1 -- start start 2024-09-19T11:15:39.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.169+0000 7f326c887800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5587db8c07d0 0x5587db8c14d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.169+0000 7f326c887800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5587db8c0e80 con 0x5587db8c1a10 2024-09-19T11:15:39.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.169+0000 7f326c887800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5587db74c7d0 con 0x5587db8c07d0 2024-09-19T11:15:39.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.169+0000 7f326a371640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5587db8c07d0 0x5587db8c14d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.170+0000 7f326a371640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5587db8c07d0 0x5587db8c14d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39246/0 (socket says 172.21.15.102:39246) 2024-09-19T11:15:39.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.170+0000 7f326a371640 1 -- 172.21.15.102:0/3578444056 learned_addr learned my addr 172.21.15.102:0/3578444056 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.170+0000 7f3269b70640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5587db8c1a10 0x5587db8c6770 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34716/0 (socket says 172.21.15.102:34716) 2024-09-19T11:15:39.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.170+0000 7f326a371640 1 -- 172.21.15.102:0/3578444056 >> v1:172.21.15.37:6789/0 conn(0x5587db8c1a10 legacy=0x5587db8c6770 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.170+0000 7f326a371640 1 -- 172.21.15.102:0/3578444056 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587db8c1ec0 con 0x5587db8c07d0 2024-09-19T11:15:39.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326a371640 1 --2- 172.21.15.102:0/3578444056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db8c14d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f326400a520 tx=0x7f3264045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=282e55cbd34c9bd6 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326936f640 1 -- 172.21.15.102:0/3578444056 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3264055070 con 0x5587db8c07d0 2024-09-19T11:15:39.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326936f640 1 -- 172.21.15.102:0/3578444056 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f32640515b0 con 0x5587db8c07d0 2024-09-19T11:15:39.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326936f640 1 -- 172.21.15.102:0/3578444056 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32640518d0 con 0x5587db8c07d0 2024-09-19T11:15:39.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326c887800 1 -- 172.21.15.102:0/3578444056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 msgr2=0x5587db8c14d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326c887800 1 --2- 172.21.15.102:0/3578444056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db8c14d0 secure :-1 s=READY pgs=732 cs=0 l=1 rev1=1 crypto rx=0x7f326400a520 tx=0x7f3264045ba0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326c887800 1 -- 172.21.15.102:0/3578444056 shutdown_connections 2024-09-19T11:15:39.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326c887800 1 --2- 172.21.15.102:0/3578444056 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db8c14d0 unknown :-1 s=CLOSED pgs=732 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326c887800 1 -- 172.21.15.102:0/3578444056 >> 172.21.15.102:0/3578444056 conn(0x5587db8bbbc0 msgr2=0x5587db8be000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326c887800 1 -- 172.21.15.102:0/3578444056 shutdown_connections 2024-09-19T11:15:39.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.172+0000 7f326c887800 1 -- 172.21.15.102:0/3578444056 wait complete. 2024-09-19T11:15:39.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.186+0000 7f326c887800 1 Processor -- start 2024-09-19T11:15:39.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.186+0000 7f326c887800 1 -- start start 2024-09-19T11:15:39.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.186+0000 7f326c887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db834970 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.186+0000 7f326c887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5587db759dd0 con 0x5587db8c07d0 2024-09-19T11:15:39.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.186+0000 7f326a371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db834970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.186+0000 7f326a371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db834970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39250/0 (socket says 172.21.15.102:39250) 2024-09-19T11:15:39.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.186+0000 7f326a371640 1 -- 172.21.15.102:0/2962605920 learned_addr learned my addr 172.21.15.102:0/2962605920 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.187+0000 7f326a371640 1 -- 172.21.15.102:0/2962605920 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587db9b3fb0 con 0x5587db8c07d0 2024-09-19T11:15:39.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.187+0000 7f326a371640 1 --2- 172.21.15.102:0/2962605920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db834970 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3264025da0 tx=0x7f3264051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=82da765e1dbaa2f0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.187+0000 7f3158608640 1 -- 172.21.15.102:0/2962605920 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3264051950 con 0x5587db8c07d0 2024-09-19T11:15:39.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.187+0000 7f3158608640 1 -- 172.21.15.102:0/2962605920 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3264051af0 con 0x5587db8c07d0 2024-09-19T11:15:39.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.187+0000 7f3158608640 1 -- 172.21.15.102:0/2962605920 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3264051dd0 con 0x5587db8c07d0 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 -- 172.21.15.102:0/2962605920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 msgr2=0x5587db834970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 --2- 172.21.15.102:0/2962605920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db834970 secure :-1 s=READY pgs=733 cs=0 l=1 rev1=1 crypto rx=0x7f3264025da0 tx=0x7f3264051000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 -- 172.21.15.102:0/2962605920 shutdown_connections 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 --2- 172.21.15.102:0/2962605920 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db834970 unknown :-1 s=CLOSED pgs=733 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 -- 172.21.15.102:0/2962605920 >> 172.21.15.102:0/2962605920 conn(0x5587db8bbbc0 msgr2=0x5587db9abc70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 -- 172.21.15.102:0/2962605920 shutdown_connections 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 -- 172.21.15.102:0/2962605920 wait complete. 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 Processor -- start 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 -- start start 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db9b8df0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326c887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5587db8c7e90 con 0x5587db8c07d0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326a371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db9b8df0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326a371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db9b8df0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39260/0 (socket says 172.21.15.102:39260) 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.188+0000 7f326a371640 1 -- 172.21.15.102:0/2973047243 learned_addr learned my addr 172.21.15.102:0/2973047243 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.189+0000 7f326a371640 1 -- 172.21.15.102:0/2973047243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587db9b9350 con 0x5587db8c07d0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.189+0000 7f326a371640 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db9b8df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3264067040 tx=0x7f3264002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.189+0000 7f3156e05640 1 -- 172.21.15.102:0/2973047243 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3264073070 con 0x5587db8c07d0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.189+0000 7f3156e05640 1 -- 172.21.15.102:0/2973047243 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326405a450 con 0x5587db8c07d0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.189+0000 7f3156e05640 1 -- 172.21.15.102:0/2973047243 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f326405a730 con 0x5587db8c07d0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.189+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587db9b95e0 con 0x5587db8c07d0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.189+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587db9ba1f0 con 0x5587db8c07d0 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f326c887800 1 Processor -- start 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f326c887800 1 -- start start 2024-09-19T11:15:39.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f326c887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9c8660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f326c887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5587db7b84a0 con 0x5587db9c8260 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f3156e05640 1 -- 172.21.15.102:0/2973047243 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3264076070 con 0x5587db8c07d0 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f326ab72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9c8660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f326ab72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9c8660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39272/0 (socket says 172.21.15.102:39272) 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f326ab72640 1 -- 172.21.15.102:0/1880865923 learned_addr learned my addr 172.21.15.102:0/1880865923 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f3156e05640 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f315003cfb0 0x7f315003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f3156e05640 1 -- 172.21.15.102:0/2973047243 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f3264062070 con 0x5587db8c07d0 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.190+0000 7f326a371640 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f315003cfb0 0x7f315003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326ab72640 1 -- 172.21.15.102:0/1880865923 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587db9c8c50 con 0x5587db9c8260 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326a371640 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f315003cfb0 0x7f315003f470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f326406ffd0 tx=0x7f326406ef40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326ab72640 1 --2- 172.21.15.102:0/1880865923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9c8660 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f325c00a3e0 tx=0x7f325c00a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=2aee4cfd5a48a91d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f3154e01640 1 -- 172.21.15.102:0/1880865923 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325c015070 con 0x5587db9c8260 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f3154e01640 1 -- 172.21.15.102:0/1880865923 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c001670 con 0x5587db9c8260 2024-09-19T11:15:39.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f3154e01640 1 -- 172.21.15.102:0/1880865923 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325c001990 con 0x5587db9c8260 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326c887800 1 -- 172.21.15.102:0/1880865923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 msgr2=0x5587db9c8660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326c887800 1 --2- 172.21.15.102:0/1880865923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9c8660 secure :-1 s=READY pgs=735 cs=0 l=1 rev1=1 crypto rx=0x7f325c00a3e0 tx=0x7f325c00a8a0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326c887800 1 -- 172.21.15.102:0/1880865923 shutdown_connections 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326c887800 1 --2- 172.21.15.102:0/1880865923 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9c8660 unknown :-1 s=CLOSED pgs=735 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326c887800 1 -- 172.21.15.102:0/1880865923 >> 172.21.15.102:0/1880865923 conn(0x5587db8c1a10 msgr2=0x5587db9aff30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326c887800 1 -- 172.21.15.102:0/1880865923 shutdown_connections 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.191+0000 7f326c887800 1 -- 172.21.15.102:0/1880865923 wait complete. 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326c887800 1 Processor -- start 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326c887800 1 -- start start 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326c887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9cf520 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326c887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5587db9c9120 con 0x5587db9c8260 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326ab72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9cf520 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326ab72640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9cf520 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39278/0 (socket says 172.21.15.102:39278) 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326ab72640 1 -- 172.21.15.102:0/521544135 learned_addr learned my addr 172.21.15.102:0/521544135 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326ab72640 1 -- 172.21.15.102:0/521544135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587db9cfa80 con 0x5587db9c8260 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.192+0000 7f326ab72640 1 --2- 172.21.15.102:0/521544135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9cf520 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x5587db9b0ef0 tx=0x7f325c003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.193+0000 7f314effd640 1 -- 172.21.15.102:0/521544135 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325c020020 con 0x5587db9c8260 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.193+0000 7f314effd640 1 -- 172.21.15.102:0/521544135 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f325c010780 con 0x5587db9c8260 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.193+0000 7f314effd640 1 -- 172.21.15.102:0/521544135 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f325c015040 con 0x5587db9c8260 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.193+0000 7f326c887800 1 -- 172.21.15.102:0/521544135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587db9cfd10 con 0x5587db9c8260 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.193+0000 7f326c887800 1 -- 172.21.15.102:0/521544135 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587db9d0690 con 0x5587db9c8260 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f314effd640 1 -- 172.21.15.102:0/521544135 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f325c023020 con 0x5587db9c8260 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f314effd640 1 --2- 172.21.15.102:0/521544135 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f314403cfb0 0x7f314403f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f314effd640 1 -- 172.21.15.102:0/521544135 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f325c053fe0 con 0x5587db9c8260 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f326c887800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f326c887800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:39.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f3269b70640 1 --2- 172.21.15.102:0/521544135 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f314403cfb0 0x7f314403f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f326c887800 1 Processor -- start 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f3269b70640 1 --2- 172.21.15.102:0/521544135 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f314403cfb0 0x7f314403f470 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3254001db0 tx=0x7f3254001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.194+0000 7f326c887800 1 -- start start 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f326c887800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9ed760 0x5587db9edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f326c887800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5587db9b41b0 con 0x5587db9ed760 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f326a371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9ed760 0x5587db9edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f326a371640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9ed760 0x5587db9edb80 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39292/0 (socket says 172.21.15.102:39292) 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f326a371640 1 -- 172.21.15.102:0/4138061327 learned_addr learned my addr 172.21.15.102:0/4138061327 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f326a371640 1 -- 172.21.15.102:0/4138061327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5587db9ee1c0 con 0x5587db9ed760 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f326a371640 1 --2- 172.21.15.102:0/4138061327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9ed760 0x5587db9edb80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3264081510 tx=0x7f3264050be0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f312efe5640 1 -- 172.21.15.102:0/4138061327 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f326407d040 con 0x5587db9ed760 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f312efe5640 1 -- 172.21.15.102:0/4138061327 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f326406f7a0 con 0x5587db9ed760 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f326c887800 1 -- 172.21.15.102:0/4138061327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5587db9ee9f0 con 0x5587db9ed760 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.195+0000 7f312efe5640 1 -- 172.21.15.102:0/4138061327 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f32640643b0 con 0x5587db9ed760 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.196+0000 7f326c887800 1 -- 172.21.15.102:0/4138061327 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5587db9eef90 con 0x5587db9ed760 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.196+0000 7f312efe5640 1 -- 172.21.15.102:0/4138061327 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f326408c040 con 0x5587db9ed760 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f312efe5640 1 --2- 172.21.15.102:0/4138061327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ac03cfb0 0x7f30ac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f312efe5640 1 -- 172.21.15.102:0/4138061327 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f32640a3d60 con 0x5587db9ed760 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f3269b70640 1 --2- 172.21.15.102:0/4138061327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ac03cfb0 0x7f30ac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f3269b70640 1 --2- 172.21.15.102:0/4138061327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ac03cfb0 0x7f30ac03f470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3254000f60 tx=0x7f325400f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f312cfe1640 20 reqs_thread_entry: start 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5587db9fb0d0 0x5587db9fd570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587db9fdc40 con 0x5587db9fb0d0 2024-09-19T11:15:39.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f326ab72640 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5587db9fb0d0 0x5587db9fd570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.197+0000 7f326ab72640 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5587db9fb0d0 0x5587db9fd570 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.198+0000 7f326ab72640 1 -- 172.21.15.102:0/2973047243 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f325c00e070 con 0x5587db9fb0d0 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.198+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5587db9ffa10 0x5587dba01e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.198+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:2 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5587dba02500 con 0x5587db9ffa10 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.198+0000 7f326a371640 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5587db9ffa10 0x5587dba01e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.198+0000 7f326a371640 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5587db9ffa10 0x5587dba01e00 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.199+0000 7f326a371640 1 -- 172.21.15.102:0/2973047243 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(2 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~1155 out=1155b] v0'0 uv3 ondisk = 0) ==== 232+0+1203 (crc 0 0 0) 0x7f3264075030 con 0x5587db9ffa10 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.199+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [stat,call version.check_conds in=122b,call version.inc in=38b,writefull 0~993 in=993b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5587db9ff0e0 con 0x5587db9ffa10 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.200+0000 7f326a371640 1 -- 172.21.15.102:0/2973047243 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [stat,call,call,writefull 0~993] v37'4 uv4 ondisk = 0) ==== 316+0+0 (crc 0 0 0) 0x7f3264075030 con 0x5587db9ffa10 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/521544135 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f314403cfb0 msgr2=0x7f314403f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 --2- 172.21.15.102:0/521544135 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f314403cfb0 0x7f314403f470 secure :-1 s=READY pgs=306 cs=0 l=1 rev1=1 crypto rx=0x7f3254001db0 tx=0x7f3254001310 comp rx=0 tx=0).stop 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/521544135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 msgr2=0x5587db9cf520 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 --2- 172.21.15.102:0/521544135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9cf520 secure :-1 s=READY pgs=736 cs=0 l=1 rev1=1 crypto rx=0x5587db9b0ef0 tx=0x7f325c003370 comp rx=0 tx=0).stop 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/521544135 shutdown_connections 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 --2- 172.21.15.102:0/521544135 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f314403cfb0 0x7f314403f470 unknown :-1 s=CLOSED pgs=306 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 --2- 172.21.15.102:0/521544135 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9c8260 0x5587db9cf520 unknown :-1 s=CLOSED pgs=736 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/521544135 >> 172.21.15.102:0/521544135 conn(0x5587db8c1a10 msgr2=0x5587db9aff00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/521544135 shutdown_connections 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/521544135 wait complete. 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/4138061327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ac03cfb0 msgr2=0x7f30ac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 --2- 172.21.15.102:0/4138061327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ac03cfb0 0x7f30ac03f470 secure :-1 s=READY pgs=307 cs=0 l=1 rev1=1 crypto rx=0x7f3254000f60 tx=0x7f325400f000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/4138061327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9ed760 msgr2=0x5587db9edb80 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 --2- 172.21.15.102:0/4138061327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9ed760 0x5587db9edb80 secure :-1 s=READY pgs=737 cs=0 l=1 rev1=1 crypto rx=0x7f3264081510 tx=0x7f3264050be0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/4138061327 shutdown_connections 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 --2- 172.21.15.102:0/4138061327 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f30ac03cfb0 0x7f30ac03f470 unknown :-1 s=CLOSED pgs=307 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 --2- 172.21.15.102:0/4138061327 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db9ed760 0x5587db9edb80 unknown :-1 s=CLOSED pgs=737 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/4138061327 >> 172.21.15.102:0/4138061327 conn(0x5587db9c1ff0 msgr2=0x5587db9c23d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/4138061327 shutdown_connections 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.201+0000 7f326c887800 1 -- 172.21.15.102:0/4138061327 wait complete. 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5587db9ffa10 msgr2=0x5587dba01e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5587db9ffa10 0x5587dba01e00 crc :-1 s=READY pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5587db9fb0d0 msgr2=0x5587db9fd570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5587db9fb0d0 0x5587db9fd570 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f315003cfb0 msgr2=0x7f315003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f315003cfb0 0x7f315003f470 secure :-1 s=READY pgs=305 cs=0 l=1 rev1=1 crypto rx=0x7f326406ffd0 tx=0x7f326406ef40 comp rx=0 tx=0).stop 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 msgr2=0x5587db9b8df0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db9b8df0 secure :-1 s=READY pgs=734 cs=0 l=1 rev1=1 crypto rx=0x7f3264067040 tx=0x7f3264002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 shutdown_connections 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5587db9ffa10 0x5587dba01e00 unknown :-1 s=CLOSED pgs=170 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5587db9fb0d0 0x5587db9fd570 unknown :-1 s=CLOSED pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f315003cfb0 0x7f315003f470 unknown :-1 s=CLOSED pgs=305 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 --2- 172.21.15.102:0/2973047243 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5587db8c07d0 0x5587db9b8df0 unknown :-1 s=CLOSED pgs=734 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 >> 172.21.15.102:0/2973047243 conn(0x5587db8bbbc0 msgr2=0x5587db9aa460 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 shutdown_connections 2024-09-19T11:15:39.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.202+0000 7f326c887800 1 -- 172.21.15.102:0/2973047243 wait complete. 2024-09-19T11:15:39.212 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a","name":"default","domain_root":"default.rgw.meta:root","control_pool":"default.rgw.control","gc_pool":"default.rgw.log:gc","lc_pool":"default.rgw.log:lc","log_pool":"default.rgw.log","intent_log_pool":"default.rgw.log:intent","usage_log_pool":"default.rgw.log:usage","roles_pool":"default.rgw.meta:roles","reshard_pool":"default.rgw.log:reshard","user_keys_pool":"default.rgw.meta:users.keys","user_email_pool":"default.rgw.meta:users.email","user_swift_pool":"default.rgw.meta:users.swift","user_uid_pool":"default.rgw.meta:users.uid","otp_pool":"default.rgw.otp","notif_pool":"default.rgw.log:notif","topics_pool":"default.rgw.meta:topics","account_pool":"default.rgw.meta:accounts","group_pool":"default.rgw.meta:groups","system_key":{"access_key":"","secret_key":""},"placement_pools":[{"key":"default-placement","val":{"index_pool":"default.rgw.buckets.index","storage_classes":{"STANDARD":{"data_pool":"default.rgw.buckets.data"}},"data_extra_pool":"default.rgw.buckets.non-ec","index_type":0,"inline_data":true}}],"realm_id":""} 2024-09-19T11:15:39.212 DEBUG:tasks.util.rgw: json result: {'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a', 'name': 'default', 'domain_root': 'default.rgw.meta:root', 'control_pool': 'default.rgw.control', 'gc_pool': 'default.rgw.log:gc', 'lc_pool': 'default.rgw.log:lc', 'log_pool': 'default.rgw.log', 'intent_log_pool': 'default.rgw.log:intent', 'usage_log_pool': 'default.rgw.log:usage', 'roles_pool': 'default.rgw.meta:roles', 'reshard_pool': 'default.rgw.log:reshard', 'user_keys_pool': 'default.rgw.meta:users.keys', 'user_email_pool': 'default.rgw.meta:users.email', 'user_swift_pool': 'default.rgw.meta:users.swift', 'user_uid_pool': 'default.rgw.meta:users.uid', 'otp_pool': 'default.rgw.otp', 'notif_pool': 'default.rgw.log:notif', 'topics_pool': 'default.rgw.meta:topics', 'account_pool': 'default.rgw.meta:accounts', 'group_pool': 'default.rgw.meta:groups', 'system_key': {'access_key': '', 'secret_key': ''}, 'placement_pools': [{'key': 'default-placement', 'val': {'index_pool': 'default.rgw.buckets.index', 'storage_classes': {'STANDARD': {'data_pool': 'default.rgw.buckets.data'}}, 'data_extra_pool': 'default.rgw.buckets.non-ec', 'index_type': 0, 'inline_data': True}}], 'realm_id': ''} 2024-09-19T11:15:39.212 INFO:tasks.util.rgw:rgwadmin: client.0 : ['zonegroup', 'get'] 2024-09-19T11:15:39.212 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'zonegroup', 'get'] 2024-09-19T11:15:39.213 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph zonegroup get 2024-09-19T11:15:39.256 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:39.257 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:39.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.256+0000 7f813a53e800 1 Processor -- start 2024-09-19T11:15:39.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.256+0000 7f813a53e800 1 -- start start 2024-09-19T11:15:39.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.256+0000 7f813a53e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56519c22da30 0x56519c22de30 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.256+0000 7f813a53e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56519c22e820 con 0x56519c22e370 2024-09-19T11:15:39.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.256+0000 7f813a53e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x56519c1447d0 con 0x56519c22da30 2024-09-19T11:15:39.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.257+0000 7f81362c0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56519c22da30 0x56519c22de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.257+0000 7f8135abf640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x56519c22e370 0x56519c2c5b40 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34726/0 (socket says 172.21.15.102:34726) 2024-09-19T11:15:39.258 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.257+0000 7f8135abf640 1 -- 172.21.15.102:0/1251882183 learned_addr learned my addr 172.21.15.102:0/1251882183 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:39.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.257+0000 7f81362c0640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56519c22da30 0x56519c22de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39302/0 (socket says 172.21.15.102:39302) 2024-09-19T11:15:39.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.257+0000 7f81362c0640 1 -- 172.21.15.102:0/1251882183 >> v1:172.21.15.37:6789/0 conn(0x56519c22e370 legacy=0x56519c2c5b40 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.259 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.257+0000 7f81362c0640 1 -- 172.21.15.102:0/1251882183 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519c2bcf40 con 0x56519c22da30 2024-09-19T11:15:39.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f81362c0640 1 --2- 172.21.15.102:0/1251882183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c22de30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f812800a470 tx=0x7f8128045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f86ec15efcfb536d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f81352be640 1 -- 172.21.15.102:0/1251882183 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8128053570 con 0x56519c22da30 2024-09-19T11:15:39.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f81352be640 1 -- 172.21.15.102:0/1251882183 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128058070 con 0x56519c22da30 2024-09-19T11:15:39.260 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f81352be640 1 -- 172.21.15.102:0/1251882183 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8128053880 con 0x56519c22da30 2024-09-19T11:15:39.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f813a53e800 1 -- 172.21.15.102:0/1251882183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 msgr2=0x56519c22de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f813a53e800 1 --2- 172.21.15.102:0/1251882183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c22de30 secure :-1 s=READY pgs=739 cs=0 l=1 rev1=1 crypto rx=0x7f812800a470 tx=0x7f8128045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:39.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f813a53e800 1 -- 172.21.15.102:0/1251882183 shutdown_connections 2024-09-19T11:15:39.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f813a53e800 1 --2- 172.21.15.102:0/1251882183 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c22de30 unknown :-1 s=CLOSED pgs=739 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f813a53e800 1 -- 172.21.15.102:0/1251882183 >> 172.21.15.102:0/1251882183 conn(0x56519c2b4c50 msgr2=0x56519c2b70b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f813a53e800 1 -- 172.21.15.102:0/1251882183 shutdown_connections 2024-09-19T11:15:39.261 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.259+0000 7f813a53e800 1 -- 172.21.15.102:0/1251882183 wait complete. 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.273+0000 7f813a53e800 1 Processor -- start 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.273+0000 7f813a53e800 1 -- start start 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.273+0000 7f813a53e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3af900 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.273+0000 7f813a53e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56519c151dd0 con 0x56519c22da30 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.274+0000 7f81362c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3af900 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.274+0000 7f81362c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3af900 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39308/0 (socket says 172.21.15.102:39308) 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.274+0000 7f81362c0640 1 -- 172.21.15.102:0/1556337029 learned_addr learned my addr 172.21.15.102:0/1556337029 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.274+0000 7f81362c0640 1 -- 172.21.15.102:0/1556337029 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519c3afef0 con 0x56519c22da30 2024-09-19T11:15:39.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.274+0000 7f81362c0640 1 --2- 172.21.15.102:0/1556337029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3af900 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8128025c20 tx=0x7f8128051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=63f733a164e1fe52 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.274+0000 7f8024608640 1 -- 172.21.15.102:0/1556337029 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f812805c580 con 0x56519c22da30 2024-09-19T11:15:39.277 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.274+0000 7f8024608640 1 -- 172.21.15.102:0/1556337029 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128063030 con 0x56519c22da30 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.274+0000 7f8024608640 1 -- 172.21.15.102:0/1556337029 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f812805c850 con 0x56519c22da30 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 -- 172.21.15.102:0/1556337029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 msgr2=0x56519c3af900 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 --2- 172.21.15.102:0/1556337029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3af900 secure :-1 s=READY pgs=740 cs=0 l=1 rev1=1 crypto rx=0x7f8128025c20 tx=0x7f8128051000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 -- 172.21.15.102:0/1556337029 shutdown_connections 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 --2- 172.21.15.102:0/1556337029 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3af900 unknown :-1 s=CLOSED pgs=740 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 -- 172.21.15.102:0/1556337029 >> 172.21.15.102:0/1556337029 conn(0x56519c2b4c50 msgr2=0x56519c3ab280 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 -- 172.21.15.102:0/1556337029 shutdown_connections 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 -- 172.21.15.102:0/1556337029 wait complete. 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 Processor -- start 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 -- start start 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3b72f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.275+0000 7f813a53e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56519c2c7470 con 0x56519c22da30 2024-09-19T11:15:39.278 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f81362c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3b72f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f81362c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3b72f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39322/0 (socket says 172.21.15.102:39322) 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f81362c0640 1 -- 172.21.15.102:0/1568511601 learned_addr learned my addr 172.21.15.102:0/1568511601 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f81362c0640 1 -- 172.21.15.102:0/1568511601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519c3b7850 con 0x56519c22da30 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f81362c0640 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3b72f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f812800a330 tx=0x7f8128002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f8022e05640 1 -- 172.21.15.102:0/1568511601 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f812806c030 con 0x56519c22da30 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f8022e05640 1 -- 172.21.15.102:0/1568511601 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f812805c580 con 0x56519c22da30 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56519c3b7ae0 con 0x56519c22da30 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.276+0000 7f8022e05640 1 -- 172.21.15.102:0/1568511601 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f812805c860 con 0x56519c22da30 2024-09-19T11:15:39.279 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519c3b86f0 con 0x56519c22da30 2024-09-19T11:15:39.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f813a53e800 1 Processor -- start 2024-09-19T11:15:39.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f813a53e800 1 -- start start 2024-09-19T11:15:39.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f813a53e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3c6d90 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f813a53e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56519c1b04a0 con 0x56519c3c49a0 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f8022e05640 1 -- 172.21.15.102:0/1568511601 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8128053440 con 0x56519c22da30 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f8136ac1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3c6d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f8136ac1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3c6d90 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39336/0 (socket says 172.21.15.102:39336) 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.277+0000 7f8136ac1640 1 -- 172.21.15.102:0/180816367 learned_addr learned my addr 172.21.15.102:0/180816367 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f8022e05640 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801c03cfb0 0x7f801c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f8022e05640 1 -- 172.21.15.102:0/1568511601 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8128070020 con 0x56519c22da30 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f81362c0640 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801c03cfb0 0x7f801c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f8136ac1640 1 -- 172.21.15.102:0/180816367 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519c3c7360 con 0x56519c3c49a0 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f8136ac1640 1 --2- 172.21.15.102:0/180816367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3c6d90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f813000a3e0 tx=0x7f813000a8a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e2b0dbb607915f46 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f81362c0640 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801c03cfb0 0x7f801c03f470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8128053fd0 tx=0x7f8128080040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f8020e01640 1 -- 172.21.15.102:0/180816367 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8130015070 con 0x56519c3c49a0 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f8020e01640 1 -- 172.21.15.102:0/180816367 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8130001670 con 0x56519c3c49a0 2024-09-19T11:15:39.286 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f8020e01640 1 -- 172.21.15.102:0/180816367 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8130001990 con 0x56519c3c49a0 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f813a53e800 1 -- 172.21.15.102:0/180816367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 msgr2=0x56519c3c6d90 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.278+0000 7f813a53e800 1 --2- 172.21.15.102:0/180816367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3c6d90 secure :-1 s=READY pgs=742 cs=0 l=1 rev1=1 crypto rx=0x7f813000a3e0 tx=0x7f813000a8a0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 -- 172.21.15.102:0/180816367 shutdown_connections 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 --2- 172.21.15.102:0/180816367 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3c6d90 unknown :-1 s=CLOSED pgs=742 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 -- 172.21.15.102:0/180816367 >> 172.21.15.102:0/180816367 conn(0x56519c22e370 msgr2=0x56519c3bf2c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 -- 172.21.15.102:0/180816367 shutdown_connections 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 -- 172.21.15.102:0/180816367 wait complete. 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 Processor -- start 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 -- start start 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3cb870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f813a53e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56519c3c75f0 con 0x56519c3c49a0 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f8136ac1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3cb870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f8136ac1640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3cb870 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39346/0 (socket says 172.21.15.102:39346) 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.279+0000 7f8136ac1640 1 -- 172.21.15.102:0/662595306 learned_addr learned my addr 172.21.15.102:0/662595306 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.280+0000 7f8136ac1640 1 -- 172.21.15.102:0/662595306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519c3cbdd0 con 0x56519c3c49a0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.280+0000 7f8136ac1640 1 --2- 172.21.15.102:0/662595306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3cb870 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8130013040 tx=0x7f8130003370 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.280+0000 7f801affd640 1 -- 172.21.15.102:0/662595306 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8130020020 con 0x56519c3c49a0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.280+0000 7f801affd640 1 -- 172.21.15.102:0/662595306 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8130010780 con 0x56519c3c49a0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.280+0000 7f801affd640 1 -- 172.21.15.102:0/662595306 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8130015040 con 0x56519c3c49a0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.280+0000 7f813a53e800 1 -- 172.21.15.102:0/662595306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56519c3cc060 con 0x56519c3c49a0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.280+0000 7f813a53e800 1 -- 172.21.15.102:0/662595306 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519c3cc9e0 con 0x56519c3c49a0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.281+0000 7f801affd640 1 -- 172.21.15.102:0/662595306 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8130023020 con 0x56519c3c49a0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.281+0000 7f801affd640 1 --2- 172.21.15.102:0/662595306 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801003cfb0 0x7f801003f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.281+0000 7f801affd640 1 -- 172.21.15.102:0/662595306 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8130053e80 con 0x56519c3c49a0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.281+0000 7f8135abf640 1 --2- 172.21.15.102:0/662595306 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801003cfb0 0x7f801003f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.281+0000 7f813a53e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.281+0000 7f813a53e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.282+0000 7f8135abf640 1 --2- 172.21.15.102:0/662595306 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801003cfb0 0x7f801003f470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f812c001cf0 tx=0x7f812c001250 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.282+0000 7f813a53e800 1 Processor -- start 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.282+0000 7f813a53e800 1 -- start start 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.282+0000 7f813a53e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3e5700 0x56519c3e5b20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.282+0000 7f813a53e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56519c3b02c0 con 0x56519c3e5700 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.282+0000 7f81362c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3e5700 0x56519c3e5b20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.282+0000 7f81362c0640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3e5700 0x56519c3e5b20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39358/0 (socket says 172.21.15.102:39358) 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.282+0000 7f81362c0640 1 -- 172.21.15.102:0/207387067 learned_addr learned my addr 172.21.15.102:0/207387067 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.283+0000 7f81362c0640 1 -- 172.21.15.102:0/207387067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56519c3e6160 con 0x56519c3e5700 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.283+0000 7f81362c0640 1 --2- 172.21.15.102:0/207387067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3e5700 0x56519c3e5b20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f812805d560 tx=0x7f812805ff70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.283+0000 7f7ffafe5640 1 -- 172.21.15.102:0/207387067 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8128079050 con 0x56519c3e5700 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.283+0000 7f7ffafe5640 1 -- 172.21.15.102:0/207387067 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8128068420 con 0x56519c3e5700 2024-09-19T11:15:39.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.283+0000 7f813a53e800 1 -- 172.21.15.102:0/207387067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56519c3e6990 con 0x56519c3e5700 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.283+0000 7f7ffafe5640 1 -- 172.21.15.102:0/207387067 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f812805f920 con 0x56519c3e5700 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.283+0000 7f813a53e800 1 -- 172.21.15.102:0/207387067 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56519c3e6f30 con 0x56519c3e5700 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f7ffafe5640 1 -- 172.21.15.102:0/207387067 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8128053730 con 0x56519c3e5700 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f7ffafe5640 1 --2- 172.21.15.102:0/207387067 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7f7803cfb0 0x7f7f7803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f7ffafe5640 1 -- 172.21.15.102:0/207387067 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f812806d070 con 0x56519c3e5700 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f8135abf640 1 --2- 172.21.15.102:0/207387067 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7f7803cfb0 0x7f7f7803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f8135abf640 1 --2- 172.21.15.102:0/207387067 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7f7803cfb0 0x7f7f7803f470 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f812c000f60 tx=0x7f812c00f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f7ff8fe1640 20 reqs_thread_entry: start 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56519c3f3020 0x56519c3f5450 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519c3f5a90 con 0x56519c3f3020 2024-09-19T11:15:39.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.284+0000 7f8136ac1640 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56519c3f3020 0x56519c3f5450 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.285+0000 7f8136ac1640 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56519c3f3020 0x56519c3f5450 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.285+0000 7f8136ac1640 1 -- 172.21.15.102:0/1568511601 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f813000e070 con 0x56519c3f3020 2024-09-19T11:15:39.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.285+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519c3f6010 con 0x56519c3f3020 2024-09-19T11:15:39.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.285+0000 7f8136ac1640 1 -- 172.21.15.102:0/1568511601 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f813000e070 con 0x56519c3f3020 2024-09-19T11:15:39.293 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.285+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56519c3f7c30 0x56519c3fa0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.285+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:3 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56519c3fa850 con 0x56519c3f7c30 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.286+0000 7f81362c0640 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56519c3f7c30 0x56519c3fa0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.286+0000 7f81362c0640 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56519c3f7c30 0x56519c3fa0c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.286+0000 7f81362c0640 1 -- 172.21.15.102:0/1568511601 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(3 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f8128084070 con 0x56519c3f7c30 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/662595306 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801003cfb0 msgr2=0x7f801003f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 --2- 172.21.15.102:0/662595306 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801003cfb0 0x7f801003f470 secure :-1 s=READY pgs=309 cs=0 l=1 rev1=1 crypto rx=0x7f812c001cf0 tx=0x7f812c001250 comp rx=0 tx=0).stop 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/662595306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 msgr2=0x56519c3cb870 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 --2- 172.21.15.102:0/662595306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3cb870 secure :-1 s=READY pgs=743 cs=0 l=1 rev1=1 crypto rx=0x7f8130013040 tx=0x7f8130003370 comp rx=0 tx=0).stop 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/662595306 shutdown_connections 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 --2- 172.21.15.102:0/662595306 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801003cfb0 0x7f801003f470 unknown :-1 s=CLOSED pgs=309 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 --2- 172.21.15.102:0/662595306 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3c49a0 0x56519c3cb870 unknown :-1 s=CLOSED pgs=743 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.294 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/662595306 >> 172.21.15.102:0/662595306 conn(0x56519c22e370 msgr2=0x56519c3bf290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/662595306 shutdown_connections 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/662595306 wait complete. 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/207387067 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7f7803cfb0 msgr2=0x7f7f7803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 --2- 172.21.15.102:0/207387067 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7f7803cfb0 0x7f7f7803f470 secure :-1 s=READY pgs=310 cs=0 l=1 rev1=1 crypto rx=0x7f812c000f60 tx=0x7f812c00f000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/207387067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3e5700 msgr2=0x56519c3e5b20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 --2- 172.21.15.102:0/207387067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3e5700 0x56519c3e5b20 secure :-1 s=READY pgs=744 cs=0 l=1 rev1=1 crypto rx=0x7f812805d560 tx=0x7f812805ff70 comp rx=0 tx=0).stop 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/207387067 shutdown_connections 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 --2- 172.21.15.102:0/207387067 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7f7803cfb0 0x7f7f7803f470 unknown :-1 s=CLOSED pgs=310 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 --2- 172.21.15.102:0/207387067 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c3e5700 0x56519c3e5b20 unknown :-1 s=CLOSED pgs=744 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/207387067 >> 172.21.15.102:0/207387067 conn(0x56519c3dac40 msgr2=0x56519c3db020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/207387067 shutdown_connections 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.287+0000 7f813a53e800 1 -- 172.21.15.102:0/207387067 wait complete. 2024-09-19T11:15:39.295 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56519c3f3020 msgr2=0x56519c3f5450 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56519c3f3020 0x56519c3f5450 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56519c3f7c30 msgr2=0x56519c3fa0c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56519c3f7c30 0x56519c3fa0c0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801c03cfb0 msgr2=0x7f801c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801c03cfb0 0x7f801c03f470 secure :-1 s=READY pgs=308 cs=0 l=1 rev1=1 crypto rx=0x7f8128053fd0 tx=0x7f8128080040 comp rx=0 tx=0).stop 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 msgr2=0x56519c3b72f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3b72f0 secure :-1 s=READY pgs=741 cs=0 l=1 rev1=1 crypto rx=0x7f812800a330 tx=0x7f8128002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 shutdown_connections 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56519c3f3020 0x56519c3f5450 unknown :-1 s=CLOSED pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f801c03cfb0 0x7f801c03f470 unknown :-1 s=CLOSED pgs=308 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56519c3f7c30 0x56519c3fa0c0 unknown :-1 s=CLOSED pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 --2- 172.21.15.102:0/1568511601 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56519c22da30 0x56519c3b72f0 unknown :-1 s=CLOSED pgs=741 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 >> 172.21.15.102:0/1568511601 conn(0x56519c2b4c50 msgr2=0x56519c3a9a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 shutdown_connections 2024-09-19T11:15:39.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.288+0000 7f813a53e800 1 -- 172.21.15.102:0/1568511601 wait complete. 2024-09-19T11:15:39.298 INFO:teuthology.orchestra.run.smithi102.stdout:{"id":"68013f1d-b756-462e-83a9-97539995db13","name":"default","api_name":"default","is_master":true,"endpoints":[],"hostnames":[],"hostnames_s3website":[],"master_zone":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a","zones":[{"id":"32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a","name":"default","endpoints":[],"log_meta":false,"log_data":false,"bucket_index_max_shards":11,"read_only":false,"tier_type":"","sync_from_all":true,"sync_from":[],"redirect_zone":"","supported_features":["notification_v2","resharding"]}],"placement_targets":[{"name":"default-placement","tags":[],"storage_classes":["STANDARD"]}],"default_placement":"default-placement","realm_id":"","sync_policy":{"groups":[]},"enabled_features":["notification_v2","resharding"]} 2024-09-19T11:15:39.298 DEBUG:tasks.util.rgw: json result: {'id': '68013f1d-b756-462e-83a9-97539995db13', 'name': 'default', 'api_name': 'default', 'is_master': True, 'endpoints': [], 'hostnames': [], 'hostnames_s3website': [], 'master_zone': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a', 'zones': [{'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a', 'name': 'default', 'endpoints': [], 'log_meta': False, 'log_data': False, 'bucket_index_max_shards': 11, 'read_only': False, 'tier_type': '', 'sync_from_all': True, 'sync_from': [], 'redirect_zone': '', 'supported_features': ['notification_v2', 'resharding']}], 'placement_targets': [{'name': 'default-placement', 'tags': [], 'storage_classes': ['STANDARD']}], 'default_placement': 'default-placement', 'realm_id': '', 'sync_policy': {'groups': []}, 'enabled_features': ['notification_v2', 'resharding']} 2024-09-19T11:15:39.301 INFO:teuthology.run_tasks:Running task radosgw-admin-rest... 2024-09-19T11:15:39.323 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-19T11:15:39.323 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'ada', '--display-name', 'Ms. Admin User', '--access-key', 'MH1WC2XQ1S8UISFDZC8W', '--secret', 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', '--max-buckets', '0', '--caps', 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write'] 2024-09-19T11:15:39.323 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid ada --display-name 'Ms. Admin User' --access-key MH1WC2XQ1S8UISFDZC8W --secret dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG --max-buckets 0 --caps 'users=read, write; usage=read, write; buckets=read, write; zone=read, write; info=read;ratelimit=read, write' 2024-09-19T11:15:39.387 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:39.387 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:39.388 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f7215f75800 1 Processor -- start 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f7215f75800 1 -- start start 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f7215f75800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55b01eed0bb0 0x55b01eed6750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f7215f75800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b01eecff90 con 0x55b01eecf8e0 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f7215f75800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55b01ed5a7d0 con 0x55b01eed0bb0 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f721325e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55b01eed0bb0 0x55b01eed6750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f7213a5f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55b01eecf8e0 0x55b01eed04a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34732/0 (socket says 172.21.15.102:34732) 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f721325e640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55b01eed0bb0 0x55b01eed6750 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39374/0 (socket says 172.21.15.102:39374) 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.387+0000 7f7213a5f640 1 -- 172.21.15.102:0/2518905702 learned_addr learned my addr 172.21.15.102:0/2518905702 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.388+0000 7f721325e640 1 -- 172.21.15.102:0/2518905702 >> v1:172.21.15.37:6789/0 conn(0x55b01eecf8e0 legacy=0x55b01eed04a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.389 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.388+0000 7f721325e640 1 -- 172.21.15.102:0/2518905702 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01eed1060 con 0x55b01eed0bb0 2024-09-19T11:15:39.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.389+0000 7f721325e640 1 --2- 172.21.15.102:0/2518905702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eed0bb0 0x55b01eed6750 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f720800a470 tx=0x7f7208045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=27ff2681a0761242 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.390 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7212a5d640 1 -- 172.21.15.102:0/2518905702 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7208053570 con 0x55b01eed0bb0 2024-09-19T11:15:39.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7212a5d640 1 -- 172.21.15.102:0/2518905702 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7208058070 con 0x55b01eed0bb0 2024-09-19T11:15:39.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7212a5d640 1 -- 172.21.15.102:0/2518905702 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7208053880 con 0x55b01eed0bb0 2024-09-19T11:15:39.391 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7215f75800 1 -- 172.21.15.102:0/2518905702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eed0bb0 msgr2=0x55b01eed6750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7215f75800 1 --2- 172.21.15.102:0/2518905702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eed0bb0 0x55b01eed6750 secure :-1 s=READY pgs=746 cs=0 l=1 rev1=1 crypto rx=0x7f720800a470 tx=0x7f7208045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:39.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7215f75800 1 -- 172.21.15.102:0/2518905702 shutdown_connections 2024-09-19T11:15:39.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7215f75800 1 --2- 172.21.15.102:0/2518905702 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eed0bb0 0x55b01eed6750 unknown :-1 s=CLOSED pgs=746 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7215f75800 1 -- 172.21.15.102:0/2518905702 >> 172.21.15.102:0/2518905702 conn(0x55b01eecacb0 msgr2=0x55b01eecd110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7215f75800 1 -- 172.21.15.102:0/2518905702 shutdown_connections 2024-09-19T11:15:39.392 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.390+0000 7f7215f75800 1 -- 172.21.15.102:0/2518905702 wait complete. 2024-09-19T11:15:39.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.404+0000 7f7215f75800 1 Processor -- start 2024-09-19T11:15:39.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.404+0000 7f7215f75800 1 -- start start 2024-09-19T11:15:39.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.404+0000 7f7215f75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01ee451d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.408 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.404+0000 7f7215f75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b01ed67dd0 con 0x55b01eecf8e0 2024-09-19T11:15:39.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.404+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01ee451d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.404+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01ee451d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39378/0 (socket says 172.21.15.102:39378) 2024-09-19T11:15:39.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.404+0000 7f7213a5f640 1 -- 172.21.15.102:0/2206336971 learned_addr learned my addr 172.21.15.102:0/2206336971 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.405+0000 7f7213a5f640 1 -- 172.21.15.102:0/2206336971 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01ee457c0 con 0x55b01eecf8e0 2024-09-19T11:15:39.409 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.405+0000 7f7213a5f640 1 --2- 172.21.15.102:0/2206336971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01ee451d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7204001e40 tx=0x7f7204001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=8feb33f475958158 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.405+0000 7f7101e0b640 1 -- 172.21.15.102:0/2206336971 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7204012020 con 0x55b01eecf8e0 2024-09-19T11:15:39.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.405+0000 7f7101e0b640 1 -- 172.21.15.102:0/2206336971 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720400e5a0 con 0x55b01eecf8e0 2024-09-19T11:15:39.410 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.405+0000 7f7101e0b640 1 -- 172.21.15.102:0/2206336971 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720400e8a0 con 0x55b01eecf8e0 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 -- 172.21.15.102:0/2206336971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 msgr2=0x55b01ee451d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 --2- 172.21.15.102:0/2206336971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01ee451d0 secure :-1 s=READY pgs=747 cs=0 l=1 rev1=1 crypto rx=0x7f7204001e40 tx=0x7f7204001e70 comp rx=0 tx=0).stop 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 -- 172.21.15.102:0/2206336971 shutdown_connections 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 --2- 172.21.15.102:0/2206336971 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01ee451d0 unknown :-1 s=CLOSED pgs=747 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 -- 172.21.15.102:0/2206336971 >> 172.21.15.102:0/2206336971 conn(0x55b01eecacb0 msgr2=0x55b01efbae20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 -- 172.21.15.102:0/2206336971 shutdown_connections 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 -- 172.21.15.102:0/2206336971 wait complete. 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 Processor -- start 2024-09-19T11:15:39.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 -- start start 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01efc9220 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7215f75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b01eed6ea0 con 0x55b01eecf8e0 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01efc9220 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01efc9220 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39380/0 (socket says 172.21.15.102:39380) 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.406+0000 7f7213a5f640 1 -- 172.21.15.102:0/1822128618 learned_addr learned my addr 172.21.15.102:0/1822128618 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.407+0000 7f7213a5f640 1 -- 172.21.15.102:0/1822128618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01efc9780 con 0x55b01eecf8e0 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.407+0000 7f7213a5f640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01efc9220 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f720400c010 tx=0x7f7204000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.407+0000 7f70fbfff640 1 -- 172.21.15.102:0/1822128618 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7204012030 con 0x55b01eecf8e0 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.407+0000 7f70fbfff640 1 -- 172.21.15.102:0/1822128618 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f72040014a0 con 0x55b01eecf8e0 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.407+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b01efc9a10 con 0x55b01eecf8e0 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.407+0000 7f70fbfff640 1 -- 172.21.15.102:0/1822128618 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720401a7a0 con 0x55b01eecf8e0 2024-09-19T11:15:39.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.407+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01efca410 con 0x55b01eecf8e0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.408+0000 7f70fbfff640 1 -- 172.21.15.102:0/1822128618 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7204015020 con 0x55b01eecf8e0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.408+0000 7f70fbfff640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70fc03cfb0 0x7f70fc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.408+0000 7f70fbfff640 1 -- 172.21.15.102:0/1822128618 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7204020030 con 0x55b01eecf8e0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.408+0000 7f721325e640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70fc03cfb0 0x7f70fc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.408+0000 7f7215f75800 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01eed0bb0 0x55b01efd0870 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.408+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01efd0db0 con 0x55b01eed0bb0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.409+0000 7f7214260640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01eed0bb0 0x55b01efd0870 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.409+0000 7f721325e640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70fc03cfb0 0x7f70fc03f470 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7208057000 tx=0x7f7208052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.409+0000 7f7214260640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01eed0bb0 0x55b01efd0870 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.409+0000 7f7214260640 1 -- 172.21.15.102:0/1822128618 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01eed0bb0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.409+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01efd1150 con 0x55b01eed0bb0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.409+0000 7f7214260640 1 -- 172.21.15.102:0/1822128618 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01eed0bb0 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.409+0000 7f7215f75800 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01efd2c10 0x55b01efd50b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.421 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.409+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01efd5840 con 0x55b01efd2c10 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.410+0000 7f7213a5f640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01efd2c10 0x55b01efd50b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.410+0000 7f7213a5f640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01efd2c10 0x55b01efd50b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.411+0000 7f7213a5f640 1 -- 172.21.15.102:0/1822128618 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f720401ab20 con 0x55b01efd2c10 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.411+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01efd19a0 con 0x55b01eed0bb0 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.411+0000 7f7214260640 1 -- 172.21.15.102:0/1822128618 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01eed0bb0 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.411+0000 7f7215f75800 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01efd6ca0 0x55b01efd9090 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.411+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01efd97d0 con 0x55b01efd6ca0 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.411+0000 7f721325e640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01efd6ca0 0x55b01efd9090 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.411+0000 7f721325e640 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01efd6ca0 0x55b01efd9090 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.412+0000 7f721325e640 1 -- 172.21.15.102:0/1822128618 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7208051070 con 0x55b01efd6ca0 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.412+0000 7f7215f75800 1 Processor -- start 2024-09-19T11:15:39.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.412+0000 7f7215f75800 1 -- start start 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.412+0000 7f7215f75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01efe7510 0x55b01efe7930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.412+0000 7f7215f75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b01edc64a0 con 0x55b01efe7510 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.412+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01efe7510 0x55b01efe7930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.412+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01efe7510 0x55b01efe7930 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39390/0 (socket says 172.21.15.102:39390) 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.412+0000 7f7213a5f640 1 -- 172.21.15.102:0/2042361514 learned_addr learned my addr 172.21.15.102:0/2042361514 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.413+0000 7f7213a5f640 1 -- 172.21.15.102:0/2042361514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01efe7f70 con 0x55b01efe7510 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.413+0000 7f7213a5f640 1 --2- 172.21.15.102:0/2042361514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01efe7510 0x55b01efe7930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f720400c720 tx=0x7f72040423b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.413+0000 7f70f97fa640 1 -- 172.21.15.102:0/2042361514 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720404f030 con 0x55b01efe7510 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.413+0000 7f70f97fa640 1 -- 172.21.15.102:0/2042361514 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7204042d40 con 0x55b01efe7510 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.413+0000 7f7215f75800 1 -- 172.21.15.102:0/2042361514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b01efe87a0 con 0x55b01efe7510 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.413+0000 7f70f97fa640 1 -- 172.21.15.102:0/2042361514 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7204051430 con 0x55b01efe7510 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.413+0000 7f7215f75800 1 -- 172.21.15.102:0/2042361514 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01efe8d40 con 0x55b01efe7510 2024-09-19T11:15:39.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f70f97fa640 1 -- 172.21.15.102:0/2042361514 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f720404b060 con 0x55b01efe7510 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f70f97fa640 1 --2- 172.21.15.102:0/2042361514 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70ec03cfb0 0x7f70ec03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f70f97fa640 1 -- 172.21.15.102:0/2042361514 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7204050070 con 0x55b01efe7510 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f721325e640 1 --2- 172.21.15.102:0/2042361514 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70ec03cfb0 0x7f70ec03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f7215f75800 1 Processor -- start 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f7215f75800 1 -- start start 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f721325e640 1 --2- 172.21.15.102:0/2042361514 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70ec03cfb0 0x7f70ec03f470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55b01efcb320 tx=0x7f7208005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f7215f75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01eff41d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.414+0000 7f7215f75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b01ee43c20 con 0x55b01eff3dd0 2024-09-19T11:15:39.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.415+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01eff41d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.415+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01eff41d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39404/0 (socket says 172.21.15.102:39404) 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.415+0000 7f7213a5f640 1 -- 172.21.15.102:0/2724410812 learned_addr learned my addr 172.21.15.102:0/2724410812 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.415+0000 7f7213a5f640 1 -- 172.21.15.102:0/2724410812 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01eff47c0 con 0x55b01eff3dd0 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.415+0000 7f7213a5f640 1 --2- 172.21.15.102:0/2724410812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01eff41d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f72040542a0 tx=0x7f72040540c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14b2c83d7825b129 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.415+0000 7f70f2ffd640 1 -- 172.21.15.102:0/2724410812 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720402d3f0 con 0x55b01eff3dd0 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.415+0000 7f70f2ffd640 1 -- 172.21.15.102:0/2724410812 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f720402d5b0 con 0x55b01eff3dd0 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.415+0000 7f70f2ffd640 1 -- 172.21.15.102:0/2724410812 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7204011170 con 0x55b01eff3dd0 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 -- 172.21.15.102:0/2724410812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 msgr2=0x55b01eff41d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 --2- 172.21.15.102:0/2724410812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01eff41d0 secure :-1 s=READY pgs=750 cs=0 l=1 rev1=1 crypto rx=0x7f72040542a0 tx=0x7f72040540c0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 -- 172.21.15.102:0/2724410812 shutdown_connections 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 --2- 172.21.15.102:0/2724410812 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01eff41d0 unknown :-1 s=CLOSED pgs=750 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 -- 172.21.15.102:0/2724410812 >> 172.21.15.102:0/2724410812 conn(0x55b01eff01d0 msgr2=0x55b01efee410 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.425 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 -- 172.21.15.102:0/2724410812 shutdown_connections 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 -- 172.21.15.102:0/2724410812 wait complete. 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 Processor -- start 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 -- start start 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01effb1f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7215f75800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b01eff4c30 con 0x55b01eff3dd0 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01effb1f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7213a5f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01effb1f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39410/0 (socket says 172.21.15.102:39410) 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.416+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 learned_addr learned my addr 172.21.15.102:0/2370080726 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.417+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b01effb750 con 0x55b01eff3dd0 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.417+0000 7f7213a5f640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01effb1f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f720401ae20 tx=0x7f720403b010 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.417+0000 7f70f17fa640 1 -- 172.21.15.102:0/2370080726 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7204024cb0 con 0x55b01eff3dd0 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.417+0000 7f70f17fa640 1 -- 172.21.15.102:0/2370080726 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7204024420 con 0x55b01eff3dd0 2024-09-19T11:15:39.426 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.417+0000 7f70f17fa640 1 -- 172.21.15.102:0/2370080726 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f720404b350 con 0x55b01eff3dd0 2024-09-19T11:15:39.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.417+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b01effb750 con 0x55b01eff3dd0 2024-09-19T11:15:39.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.417+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b01effb750 con 0x55b01eff3dd0 2024-09-19T11:15:39.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.418+0000 7f70f17fa640 1 -- 172.21.15.102:0/2370080726 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f720404b4f0 con 0x55b01eff3dd0 2024-09-19T11:15:39.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.418+0000 7f70f17fa640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70dc03cfb0 0x7f70dc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.418+0000 7f70f17fa640 1 -- 172.21.15.102:0/2370080726 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7204072d10 con 0x55b01eff3dd0 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.419+0000 7f721325e640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70dc03cfb0 0x7f70dc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.419+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.419+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01f0067c0 0x55b01f008c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.419+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f0093d0 con 0x55b01f0067c0 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.419+0000 7f7214260640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01f0067c0 0x55b01f008c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.419+0000 7f721325e640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70dc03cfb0 0x7f70dc03f470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7208053570 tx=0x7f7208053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.419+0000 7f7214260640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01f0067c0 0x55b01f008c80 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 realm 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f0097e0 con 0x55b01f0067c0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a0b0 con 0x55b01f0067c0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01f00b1b0 0x55b01f00d5a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.420+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00db60 con 0x55b01f00b1b0 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.421+0000 7f7213a5f640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01f00b1b0 0x55b01f00d5a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.421+0000 7f7213a5f640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01f00b1b0 0x55b01f00d5a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.421+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.421+0000 7f7215f75800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.421+0000 7f7215f75800 20 searching for the correct realm 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.421+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01f00fb10 0x55b01f011fd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.421+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f0126a0 con 0x55b01f00fb10 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.421+0000 7f721325e640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01f00fb10 0x55b01f011fd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.422+0000 7f721325e640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01f00fb10 0x55b01f011fd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.422+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.422+0000 7f721325e640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f720805f040 0x7f720805f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.422+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f0126a0 con 0x7f720805f040 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.422+0000 7f7214260640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f720805f040 0x7f720805f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.422+0000 7f7214260640 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f720805f040 0x7f720805f930 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.423+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.423+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00b1b0 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.423+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.423+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.423+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.423+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.423+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.423+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00b1b0 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.424+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.424+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00b1b0 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.424+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.424+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x7f720805f040 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.424+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.424+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00fb10 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.424+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.424+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.425+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.425+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00b1b0 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.425+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.425+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.425+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.425+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x7f720805f040 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.426+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.426+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00fb10 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.426+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.426+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00fb10 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.426+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.449 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.426+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00b1b0 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.427+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.427+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00fb10 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.427+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.427+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00fb10 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.427+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.427+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.427+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.427+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.428+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.428+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00b1b0 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.428+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.450 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.428+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00fb10 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.428+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.428+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x7f720805f040 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.428+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.428+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.429+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.429+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00b1b0 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.429+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.429+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00fb10 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.429+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.429+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00b1b0 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x7f720805f040 2024-09-19T11:15:39.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f00fb10 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x7f720805f040 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x55b01f0067c0 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.430+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00a450 con 0x7f720805f040 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:39.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00e420 con 0x55b01f0067c0 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00e420 con 0x55b01f0067c0 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00e420 con 0x55b01f00fb10 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 zone default found 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 4 Realm: () 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.431+0000 7f7215f75800 20 zonegroup default 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f00ed80 con 0x55b01f00b1b0 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.454 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f014670 con 0x55b01f00fb10 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f014ad0 con 0x55b01f00fb10 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 20 started sync module instance, tier type = 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.432+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f0139b0 con 0x7f720805f040 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.433+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.433+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94214922780336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f0139b0 con 0x7f720805f040 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.434+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f015630 con 0x55b01f0067c0 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.435+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94214922780336] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.435+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.435+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94214922785056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f0155f0 con 0x55b01f0067c0 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.435+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f0160b0 con 0x55b01f00fb10 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.436+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94214922785056] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.436+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.436+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94214922787808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f016450 con 0x55b01f00fb10 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.436+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f016e70 con 0x7f720805f040 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.437+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.437+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94214922787808] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.437+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94214922791264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f017740 con 0x7f720805f040 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.437+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f013540 con 0x55b01f0067c0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.438+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94214922791264] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.439+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.439+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94214922793360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f017cd0 con 0x55b01f0067c0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.439+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f018690 con 0x55b01f00b1b0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.440+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.440+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94214922797536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f018f30 con 0x55b01f00b1b0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.440+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f019960 con 0x55b01f00b1b0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.440+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94214922793360] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.441+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94214922797536] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.441+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.441+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94214922802288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f019d80 con 0x55b01f00b1b0 2024-09-19T11:15:39.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.441+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f01a5d0 con 0x55b01f00b1b0 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94214922802288] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'240 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94214922805536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f01a9f0 con 0x55b01f00b1b0 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7215f75800 20 add_watcher() i=0 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7215f75800 20 add_watcher() i=1 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7215f75800 20 add_watcher() i=2 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7215f75800 20 add_watcher() i=3 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7215f75800 20 add_watcher() i=4 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7215f75800 20 add_watcher() i=5 2024-09-19T11:15:39.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.442+0000 7f7215f75800 20 add_watcher() i=6 2024-09-19T11:15:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.443+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94214922805536] v37'241 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.443+0000 7f7215f75800 20 add_watcher() i=7 2024-09-19T11:15:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.443+0000 7f7215f75800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.443+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f01dd50 con 0x55b01f0067c0 2024-09-19T11:15:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.444+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.444+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94214922806960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f01af80 con 0x55b01f0067c0 2024-09-19T11:15:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94214922806960] v37'239 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f70c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7215f75800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7215f75800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7215f75800 5 note: GC not initialized 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f70c8fe1640 20 reqs_thread_entry: start 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7215f75800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7215f75800 20 Filter name: none 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f70427fc640 20 reqs_thread_entry: start 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7215f75800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.445+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f050d10 con 0x55b01f00b1b0 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 231+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x0 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : miss 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:63 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04f3b0 con 0x55b01f0067c0 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(63 MH1WC2XQ1S8UISFDZC8W [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 206+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x0 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 10 adding default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 10 cache get: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W : hit (negative entry) 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.446+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04fd70 con 0x55b01f00b1b0 2024-09-19T11:15:39.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 ada [delete,create,call,writefull 0~473] v37'3 uv3 ondisk = 0) ==== 273+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7215f75800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7215f75800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7215f75800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify cookie 94214923024336 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f054650 con 0x55b01f0067c0 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== watch-notify(notify (1) cookie 94214922793360 notify 158913789983 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7f720c018d10 con 0x55b01f0067c0 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f70f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789983 cookie 94214922793360 notifier 4841 bl.length()=649 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f70f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f70f2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.4 [notify cookie 94214923024336 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f70f2ffd640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f70d8003ea0 con 0x55b01f0067c0 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 94214923024336 notify 158913789983 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f720c026410 con 0x55b01f0067c0 2024-09-19T11:15:39.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 notify.4 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.448+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:67 8.18 8:1f190392:users.keys::MH1WC2XQ1S8UISFDZC8W:head [delete,create,writefull 0~7 in=7b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04f7d0 con 0x55b01f0067c0 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.449+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(67 MH1WC2XQ1S8UISFDZC8W [delete,create,writefull 0~7] v37'20 uv20 ondisk = 0) ==== 248+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.449+0000 7f7215f75800 10 cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.449+0000 7f7215f75800 10 moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.449+0000 7f7215f75800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.keys:MH1WC2XQ1S8UISFDZC8W, ofs0, ns] 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.449+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:68 7.15 7:a93a5511:::notify.2:head [notify cookie 94214923024336 in=189b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b01f054650 con 0x55b01f00fb10 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.450+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== watch-notify(notify (1) cookie 94214922787808 notify 158913789960 ret 0) ==== 219+0+0 (crc 0 0 0) 0x55b01eed1060 con 0x55b01f00fb10 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.450+0000 7f70f2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789960 cookie 94214922787808 notifier 4841 bl.length()=177 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.450+0000 7f70f2ffd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W info.flags=0x7 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.450+0000 7f70f2ffd640 10 rgw watcher librados: moving default.rgw.meta+users.keys+MH1WC2XQ1S8UISFDZC8W to cache LRU end 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.450+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(68 notify.2 [notify cookie 94214923024336 out=8b] v0'0 uv240 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.450+0000 7f70f2ffd640 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f70d8003ea0 con 0x55b01f00fb10 2024-09-19T11:15:39.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.450+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(69 notify.2 [notify-ack] v0'0 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.450+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== watch-notify(notify_complete (2) cookie 94214923024336 notify 158913789960 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f72080818c0 con 0x55b01f00fb10 2024-09-19T11:15:39.468 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.451+0000 7f70c9fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.451+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94214922806960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x55b01f0067c0 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.452+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94214922806960] v37'240 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.452+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94214922780336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x7f720805f040 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.453+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94214922780336] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.453+0000 7f7215f75800 20 remove_watcher() i=0 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.453+0000 7f7215f75800 2 removed watcher, disabling cache 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.453+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94214922785056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x55b01f0067c0 2024-09-19T11:15:39.474 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.454+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94214922785056] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.454+0000 7f7215f75800 20 remove_watcher() i=1 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.454+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94214922787808] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x55b01f00fb10 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.455+0000 7f721325e640 1 -- 172.21.15.102:0/2370080726 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94214922787808] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7208051070 con 0x55b01f00fb10 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.455+0000 7f7215f75800 20 remove_watcher() i=2 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.455+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94214922791264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x7f720805f040 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.456+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94214922791264] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x7f720805f040 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.456+0000 7f7215f75800 20 remove_watcher() i=3 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.456+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94214922793360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x55b01f0067c0 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.457+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94214922793360] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720c00a4d0 con 0x55b01f0067c0 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.457+0000 7f7215f75800 20 remove_watcher() i=4 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.457+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94214922797536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x55b01f00b1b0 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.458+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94214922797536] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.475 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.458+0000 7f7215f75800 20 remove_watcher() i=5 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.458+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94214922802288] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x55b01f00b1b0 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.459+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94214922802288] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.459+0000 7f7215f75800 20 remove_watcher() i=6 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.459+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94214922805536] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b01f04eb20 con 0x55b01f00b1b0 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.460+0000 7f7213a5f640 1 -- 172.21.15.102:0/2370080726 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94214922805536] v37'242 uv240 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f720406e020 con 0x55b01f00b1b0 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.460+0000 7f7215f75800 20 remove_watcher() i=7 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01f00b1b0 msgr2=0x55b01f00d5a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01f00b1b0 0x55b01f00d5a0 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01f0067c0 msgr2=0x55b01f008c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01f0067c0 0x55b01f008c80 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f720805f040 msgr2=0x7f720805f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f720805f040 0x7f720805f930 crc :-1 s=READY pgs=91 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.476 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01f00fb10 msgr2=0x55b01f011fd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01f00fb10 0x55b01f011fd0 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70dc03cfb0 msgr2=0x7f70dc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70dc03cfb0 0x7f70dc03f470 secure :-1 s=READY pgs=313 cs=0 l=1 rev1=1 crypto rx=0x7f7208053570 tx=0x7f7208053000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 msgr2=0x55b01effb1f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7214260640 1 -- 172.21.15.102:0/2370080726 reap_dead start 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01effb1f0 secure :-1 s=READY pgs=751 cs=0 l=1 rev1=1 crypto rx=0x7f720401ae20 tx=0x7f720403b010 comp rx=0 tx=0).stop 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 shutdown_connections 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2370080726 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eff3dd0 0x55b01effb1f0 unknown :-1 s=CLOSED pgs=751 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 >> 172.21.15.102:0/2370080726 conn(0x55b01eff01d0 msgr2=0x55b01efee3e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 shutdown_connections 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2370080726 wait complete. 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2042361514 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70ec03cfb0 msgr2=0x7f70ec03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2042361514 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70ec03cfb0 0x7f70ec03f470 secure :-1 s=READY pgs=312 cs=0 l=1 rev1=1 crypto rx=0x55b01efcb320 tx=0x7f7208005a00 comp rx=0 tx=0).stop 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2042361514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01efe7510 msgr2=0x55b01efe7930 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2042361514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01efe7510 0x55b01efe7930 secure :-1 s=READY pgs=749 cs=0 l=1 rev1=1 crypto rx=0x7f720400c720 tx=0x7f72040423b0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2042361514 shutdown_connections 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2042361514 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70ec03cfb0 0x7f70ec03f470 unknown :-1 s=CLOSED pgs=312 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 --2- 172.21.15.102:0/2042361514 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01efe7510 0x55b01efe7930 unknown :-1 s=CLOSED pgs=749 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2042361514 >> 172.21.15.102:0/2042361514 conn(0x55b01efdb8c0 msgr2=0x55b01efdbca0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2042361514 shutdown_connections 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.461+0000 7f7215f75800 1 -- 172.21.15.102:0/2042361514 wait complete. 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01efd2c10 msgr2=0x55b01efd50b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b01efd2c10 0x55b01efd50b0 crc :-1 s=READY pgs=171 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01eed0bb0 msgr2=0x55b01efd0870 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b01eed0bb0 0x55b01efd0870 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01efd6ca0 msgr2=0x55b01efd9090 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b01efd6ca0 0x55b01efd9090 crc :-1 s=READY pgs=172 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70fc03cfb0 msgr2=0x7f70fc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f70fc03cfb0 0x7f70fc03f470 secure :-1 s=READY pgs=311 cs=0 l=1 rev1=1 crypto rx=0x7f7208057000 tx=0x7f7208052000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 msgr2=0x55b01efc9220 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 --2- 172.21.15.102:0/1822128618 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b01eecf8e0 0x55b01efc9220 secure :-1 s=READY pgs=748 cs=0 l=1 rev1=1 crypto rx=0x7f720400c010 tx=0x7f7204000ed0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7214260640 1 -- 172.21.15.102:0/1822128618 reap_dead start 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 shutdown_connections 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 >> 172.21.15.102:0/1822128618 conn(0x55b01eecacb0 msgr2=0x55b01efba970 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 shutdown_connections 2024-09-19T11:15:39.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.462+0000 7f7215f75800 1 -- 172.21.15.102:0/1822128618 wait complete. 2024-09-19T11:15:39.479 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:39.480 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:39.480 ERROR:root:0 2024-09-19T11:15:39.481 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:39.495 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx00000ca5020bafbec8710-0066ec07db-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:15:39.496 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'foo', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '4'} 2024-09-19T11:15:39.515 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:39.515 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 0} 2024-09-19T11:15:39.535 INFO:tasks.radosgw_admin_rest: json result: {'keys': [], 'truncated': True, 'count': 0, 'marker': '8:1e6ca5ed:users.uid::foo:head'} 2024-09-19T11:15:39.536 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1} 2024-09-19T11:15:39.560 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['foo'], 'truncated': True, 'count': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-19T11:15:39.560 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'list'] {'list': '', 'max-entries': 1, 'marker': '8:a00000ee:users.uid::bar.buckets:head'} 2024-09-19T11:15:39.577 INFO:tasks.radosgw_admin_rest: json result: {'keys': ['ada'], 'truncated': False, 'count': 1} 2024-09-19T11:15:39.578 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:39.592 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:39.593 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'access-key': '9te6NH5mcdcq0Tc5i8i1', 'uid': 'uid_not_exist'} 2024-09-19T11:15:39.605 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:39.606 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-19T11:15:39.606 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-19T11:15:39.606 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write' 2024-09-19T11:15:39.653 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:39.653 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f6163f39800 1 Processor -- start 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f6163f39800 1 -- start start 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f6163f39800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5624ef55d8a0 0x5624ef55e460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f6163f39800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5624ef55df50 con 0x5624ef55e9a0 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f6163f39800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5624ef3e87d0 con 0x5624ef55d8a0 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f615fc81640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5624ef55d8a0 0x5624ef55e460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f615fc81640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5624ef55d8a0 0x5624ef55e460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39416/0 (socket says 172.21.15.102:39416) 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f615fc81640 1 -- 172.21.15.102:0/3993004517 learned_addr learned my addr 172.21.15.102:0/3993004517 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.653+0000 7f6157fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5624ef55e9a0 0x5624ef563700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34736/0 (socket says 172.21.15.102:34736) 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.654+0000 7f615fc81640 1 -- 172.21.15.102:0/3993004517 >> v1:172.21.15.37:6789/0 conn(0x5624ef55e9a0 legacy=0x5624ef563700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.654+0000 7f615fc81640 1 -- 172.21.15.102:0/3993004517 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ef55ee50 con 0x5624ef55d8a0 2024-09-19T11:15:39.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.655+0000 7f615fc81640 1 --2- 172.21.15.102:0/3993004517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55d8a0 0x5624ef55e460 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f615000a520 tx=0x7f6150045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f4734c8ca983d2fe server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f615f480640 1 -- 172.21.15.102:0/3993004517 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150055070 con 0x5624ef55d8a0 2024-09-19T11:15:39.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f615f480640 1 -- 172.21.15.102:0/3993004517 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61500515b0 con 0x5624ef55d8a0 2024-09-19T11:15:39.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f615f480640 1 -- 172.21.15.102:0/3993004517 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f61500518d0 con 0x5624ef55d8a0 2024-09-19T11:15:39.657 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f6163f39800 1 -- 172.21.15.102:0/3993004517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55d8a0 msgr2=0x5624ef55e460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f6163f39800 1 --2- 172.21.15.102:0/3993004517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55d8a0 0x5624ef55e460 secure :-1 s=READY pgs=753 cs=0 l=1 rev1=1 crypto rx=0x7f615000a520 tx=0x7f6150045ba0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f6163f39800 1 -- 172.21.15.102:0/3993004517 shutdown_connections 2024-09-19T11:15:39.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f6163f39800 1 --2- 172.21.15.102:0/3993004517 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55d8a0 0x5624ef55e460 unknown :-1 s=CLOSED pgs=753 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f6163f39800 1 -- 172.21.15.102:0/3993004517 >> 172.21.15.102:0/3993004517 conn(0x5624ef558c70 msgr2=0x5624ef55b0d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f6163f39800 1 -- 172.21.15.102:0/3993004517 shutdown_connections 2024-09-19T11:15:39.658 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.656+0000 7f6163f39800 1 -- 172.21.15.102:0/3993004517 wait complete. 2024-09-19T11:15:39.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.670+0000 7f6163f39800 1 Processor -- start 2024-09-19T11:15:39.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.670+0000 7f6163f39800 1 -- start start 2024-09-19T11:15:39.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.670+0000 7f6163f39800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef4d3190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.670+0000 7f6163f39800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624ef3f5dd0 con 0x5624ef55e9a0 2024-09-19T11:15:39.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.670+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef4d3190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.670+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef4d3190 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39422/0 (socket says 172.21.15.102:39422) 2024-09-19T11:15:39.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.670+0000 7f615fc81640 1 -- 172.21.15.102:0/2325289692 learned_addr learned my addr 172.21.15.102:0/2325289692 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.671+0000 7f615fc81640 1 -- 172.21.15.102:0/2325289692 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ef4d3780 con 0x5624ef55e9a0 2024-09-19T11:15:39.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.671+0000 7f615fc81640 1 --2- 172.21.15.102:0/2325289692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef4d3190 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6150025da0 tx=0x7f6150051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=223a76094f4d6002 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.671+0000 7f604de0b640 1 -- 172.21.15.102:0/2325289692 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150051890 con 0x5624ef55e9a0 2024-09-19T11:15:39.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.671+0000 7f604de0b640 1 -- 172.21.15.102:0/2325289692 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f6150051ac0 con 0x5624ef55e9a0 2024-09-19T11:15:39.673 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.671+0000 7f604de0b640 1 -- 172.21.15.102:0/2325289692 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150051da0 con 0x5624ef55e9a0 2024-09-19T11:15:39.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 -- 172.21.15.102:0/2325289692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 msgr2=0x5624ef4d3190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 --2- 172.21.15.102:0/2325289692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef4d3190 secure :-1 s=READY pgs=754 cs=0 l=1 rev1=1 crypto rx=0x7f6150025da0 tx=0x7f6150051000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 -- 172.21.15.102:0/2325289692 shutdown_connections 2024-09-19T11:15:39.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 --2- 172.21.15.102:0/2325289692 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef4d3190 unknown :-1 s=CLOSED pgs=754 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 -- 172.21.15.102:0/2325289692 >> 172.21.15.102:0/2325289692 conn(0x5624ef558c70 msgr2=0x5624ef648d90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 -- 172.21.15.102:0/2325289692 shutdown_connections 2024-09-19T11:15:39.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 -- 172.21.15.102:0/2325289692 wait complete. 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 Processor -- start 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 -- start start 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef657050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.672+0000 7f6163f39800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624ef564e20 con 0x5624ef55e9a0 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef657050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef657050 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39438/0 (socket says 172.21.15.102:39438) 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f615fc81640 1 -- 172.21.15.102:0/1307368789 learned_addr learned my addr 172.21.15.102:0/1307368789 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f615fc81640 1 -- 172.21.15.102:0/1307368789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ef6575b0 con 0x5624ef55e9a0 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f615fc81640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef657050 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6150000c00 tx=0x7f6150002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f6047fff640 1 -- 172.21.15.102:0/1307368789 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150073070 con 0x5624ef55e9a0 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f6047fff640 1 -- 172.21.15.102:0/1307368789 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f615005a450 con 0x5624ef55e9a0 2024-09-19T11:15:39.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624ef657840 con 0x5624ef55e9a0 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f6047fff640 1 -- 172.21.15.102:0/1307368789 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f615005a770 con 0x5624ef55e9a0 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.673+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624ef658450 con 0x5624ef55e9a0 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.674+0000 7f6047fff640 1 -- 172.21.15.102:0/1307368789 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6150076070 con 0x5624ef55e9a0 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.674+0000 7f6047fff640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f604803cfb0 0x7f604803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.674+0000 7f6047fff640 1 -- 172.21.15.102:0/1307368789 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f6150062070 con 0x5624ef55e9a0 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.675+0000 7f6157fff640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f604803cfb0 0x7f604803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.675+0000 7f6163f39800 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef65c690 0x5624ef65ea80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.675+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef65efc0 con 0x5624ef65c690 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.675+0000 7f6160482640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef65c690 0x5624ef65ea80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.681 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.675+0000 7f6157fff640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f604803cfb0 0x7f604803f470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6148001e30 tx=0x7f6148001390 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.675+0000 7f6160482640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef65c690 0x5624ef65ea80 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.675+0000 7f6160482640 1 -- 172.21.15.102:0/1307368789 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef65c690 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.675+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef65f360 con 0x5624ef65c690 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.676+0000 7f6160482640 1 -- 172.21.15.102:0/1307368789 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef65c690 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.676+0000 7f6163f39800 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef660ea0 0x5624ef663340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.676+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef663ad0 con 0x5624ef660ea0 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.676+0000 7f615fc81640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef660ea0 0x5624ef663340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.676+0000 7f615fc81640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef660ea0 0x5624ef663340 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.676+0000 7f615fc81640 1 -- 172.21.15.102:0/1307368789 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f615007f070 con 0x5624ef660ea0 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.676+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef65fbb0 con 0x5624ef65c690 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.677+0000 7f6160482640 1 -- 172.21.15.102:0/1307368789 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef65c690 2024-09-19T11:15:39.682 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.677+0000 7f6163f39800 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef664f30 0x5624ef667320 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.677+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef667a60 con 0x5624ef664f30 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.677+0000 7f6157fff640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef664f30 0x5624ef667320 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.677+0000 7f6157fff640 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef664f30 0x5624ef667320 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.677+0000 7f6157fff640 1 -- 172.21.15.102:0/1307368789 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f614800bd50 con 0x5624ef664f30 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.678+0000 7f6163f39800 1 Processor -- start 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.678+0000 7f6163f39800 1 -- start start 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.678+0000 7f6163f39800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef675780 0x5624ef675ba0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.678+0000 7f6163f39800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624ef4544a0 con 0x5624ef675780 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.678+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef675780 0x5624ef675ba0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.678+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef675780 0x5624ef675ba0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39454/0 (socket says 172.21.15.102:39454) 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.678+0000 7f615fc81640 1 -- 172.21.15.102:0/4142256929 learned_addr learned my addr 172.21.15.102:0/4142256929 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.678+0000 7f615fc81640 1 -- 172.21.15.102:0/4142256929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ef6761e0 con 0x5624ef675780 2024-09-19T11:15:39.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.679+0000 7f615fc81640 1 --2- 172.21.15.102:0/4142256929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef675780 0x5624ef675ba0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6150076750 tx=0x7f615005ad70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.679+0000 7f60457fa640 1 -- 172.21.15.102:0/4142256929 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150092070 con 0x5624ef675780 2024-09-19T11:15:39.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.679+0000 7f60457fa640 1 -- 172.21.15.102:0/4142256929 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61500643b0 con 0x5624ef675780 2024-09-19T11:15:39.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.679+0000 7f6163f39800 1 -- 172.21.15.102:0/4142256929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624ef676a10 con 0x5624ef675780 2024-09-19T11:15:39.695 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.679+0000 7f60457fa640 1 -- 172.21.15.102:0/4142256929 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f615007d040 con 0x5624ef675780 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.679+0000 7f6163f39800 1 -- 172.21.15.102:0/4142256929 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624ef676fb0 con 0x5624ef675780 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.679+0000 7f60457fa640 1 -- 172.21.15.102:0/4142256929 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f6150095070 con 0x5624ef675780 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f60457fa640 1 --2- 172.21.15.102:0/4142256929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f603803cf80 0x7f603803f440 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f60457fa640 1 -- 172.21.15.102:0/4142256929 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f615005d070 con 0x5624ef675780 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f6157fff640 1 --2- 172.21.15.102:0/4142256929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f603803cf80 0x7f603803f440 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f6163f39800 1 Processor -- start 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f6157fff640 1 --2- 172.21.15.102:0/4142256929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f603803cf80 0x7f603803f440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5624ef667e40 tx=0x7f614800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f6163f39800 1 -- start start 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f6163f39800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef682460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f6163f39800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624ef4d1b20 con 0x5624ef682060 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.680+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef682460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef682460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39462/0 (socket says 172.21.15.102:39462) 2024-09-19T11:15:39.696 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f615fc81640 1 -- 172.21.15.102:0/3069253620 learned_addr learned my addr 172.21.15.102:0/3069253620 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f615fc81640 1 -- 172.21.15.102:0/3069253620 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ef682a50 con 0x5624ef682060 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f615fc81640 1 --2- 172.21.15.102:0/3069253620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef682460 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f61500982d0 tx=0x7f615008d8f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=72ad491bd28233f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f603effd640 1 -- 172.21.15.102:0/3069253620 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f615008d5d0 con 0x5624ef682060 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f603effd640 1 -- 172.21.15.102:0/3069253620 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61500a8070 con 0x5624ef682060 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f603effd640 1 -- 172.21.15.102:0/3069253620 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150095360 con 0x5624ef682060 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f6163f39800 1 -- 172.21.15.102:0/3069253620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 msgr2=0x5624ef682460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f6163f39800 1 --2- 172.21.15.102:0/3069253620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef682460 secure :-1 s=READY pgs=757 cs=0 l=1 rev1=1 crypto rx=0x7f61500982d0 tx=0x7f615008d8f0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f6163f39800 1 -- 172.21.15.102:0/3069253620 shutdown_connections 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f6163f39800 1 --2- 172.21.15.102:0/3069253620 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef682460 unknown :-1 s=CLOSED pgs=757 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.681+0000 7f6163f39800 1 -- 172.21.15.102:0/3069253620 >> 172.21.15.102:0/3069253620 conn(0x5624ef67e460 msgr2=0x5624ef67c6a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f6163f39800 1 -- 172.21.15.102:0/3069253620 shutdown_connections 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f6163f39800 1 -- 172.21.15.102:0/3069253620 wait complete. 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f6163f39800 1 Processor -- start 2024-09-19T11:15:39.697 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f6163f39800 1 -- start start 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f6163f39800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef6894c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f6163f39800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5624ef682ec0 con 0x5624ef682060 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef6894c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f615fc81640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef6894c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39468/0 (socket says 172.21.15.102:39468) 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 learned_addr learned my addr 172.21.15.102:0/1846615980 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.682+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5624ef689a20 con 0x5624ef682060 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.683+0000 7f615fc81640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef6894c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6150095b20 tx=0x7f615005ef70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.683+0000 7f603d7fa640 1 -- 172.21.15.102:0/1846615980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150064d10 con 0x5624ef682060 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.683+0000 7f603d7fa640 1 -- 172.21.15.102:0/1846615980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f61500b2070 con 0x5624ef682060 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.683+0000 7f603d7fa640 1 -- 172.21.15.102:0/1846615980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f6150095360 con 0x5624ef682060 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.683+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5624ef689a20 con 0x5624ef682060 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.683+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5624ef689a20 con 0x5624ef682060 2024-09-19T11:15:39.698 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.684+0000 7f603d7fa640 1 -- 172.21.15.102:0/1846615980 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f61500aa020 con 0x5624ef682060 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.684+0000 7f603d7fa640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f602803cf60 0x7f602803f420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.684+0000 7f603d7fa640 1 -- 172.21.15.102:0/1846615980 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f615007a950 con 0x5624ef682060 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.684+0000 7f6157fff640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f602803cf60 0x7f602803f420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.684+0000 7f6157fff640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f602803cf60 0x7f602803f420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f614800ffd0 tx=0x7f6148010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.684+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.684+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef694a50 0x5624ef696f10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef697660 con 0x5624ef694a50 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6160482640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef694a50 0x5624ef696f10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6160482640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef694a50 0x5624ef696f10 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 20 realm 2024-09-19T11:15:39.699 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef697a70 con 0x5624ef694a50 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.685+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef698340 con 0x5624ef694a50 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6163f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6163f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.700 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef699440 0x5624ef69b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef69bdf0 con 0x5624ef699440 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f615fc81640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef699440 0x5624ef69b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.686+0000 7f615fc81640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef699440 0x5624ef69b830 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f6163f39800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f6163f39800 20 searching for the correct realm 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef69dda0 0x5624ef6a0260 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a0930 con 0x5624ef69dda0 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f6157fff640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef69dda0 0x5624ef6a0260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f6157fff640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef69dda0 0x5624ef6a0260 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6148037040 con 0x5624ef69dda0 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.687+0000 7f6157fff640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f614800f070 0x7f614803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.701 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.688+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a0930 con 0x7f614800f070 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.688+0000 7f6160482640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f614800f070 0x7f614803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.688+0000 7f6160482640 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f614800f070 0x7f614803a3c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.688+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.688+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef699440 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.689+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.689+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.689+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.689+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.689+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.689+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef699440 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.689+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.702 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.689+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef699440 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.690+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.690+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x7f614800f070 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.690+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.690+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef69dda0 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.690+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6148037040 con 0x5624ef69dda0 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.690+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.690+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.690+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef699440 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.691+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.691+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.691+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.691+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x7f614800f070 2024-09-19T11:15:39.703 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.691+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.691+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef69dda0 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.691+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6148037040 con 0x5624ef69dda0 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.691+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef69dda0 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f6148037040 con 0x5624ef69dda0 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef699440 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef69dda0 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6148037040 con 0x5624ef69dda0 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef69dda0 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6148037040 con 0x5624ef69dda0 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.692+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.704 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.693+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.693+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.693+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef699440 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.693+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.693+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef69dda0 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.694+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6148037040 con 0x5624ef69dda0 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.694+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x7f614800f070 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.694+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.694+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.694+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.705 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.694+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef699440 2024-09-19T11:15:39.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.695+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.695+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef69dda0 2024-09-19T11:15:39.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.695+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6148037040 con 0x5624ef69dda0 2024-09-19T11:15:39.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.695+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef699440 2024-09-19T11:15:39.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.695+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.695+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x7f614800f070 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.695+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.695+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef69dda0 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f614804a040 con 0x5624ef69dda0 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x7f614800f070 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x5624ef694a50 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6986e0 con 0x7f614800f070 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6163f39800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6163f39800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6163f39800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:39.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6163f39800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6163f39800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6163f39800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.696+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef69c6b0 con 0x5624ef694a50 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef69c6b0 con 0x5624ef694a50 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef69c6b0 con 0x5624ef69dda0 2024-09-19T11:15:39.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f614804a040 con 0x5624ef69dda0 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 zone default found 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 4 Realm: () 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 zonegroup default 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef69d000 con 0x5624ef699440 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.697+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a2930 con 0x5624ef69dda0 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f614804a040 con 0x5624ef69dda0 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6163f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a2e10 con 0x5624ef69dda0 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f614804a040 con 0x5624ef69dda0 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6163f39800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6163f39800 20 started sync module instance, tier type = 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6163f39800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.698+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a1c40 con 0x7f614800f070 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.699+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.699+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94716635521344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a1c40 con 0x7f614800f070 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.699+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a38d0 con 0x5624ef694a50 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.700+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94716635521344] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.701+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.701+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94716635526112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a1c40 con 0x5624ef694a50 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.701+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a4360 con 0x5624ef69dda0 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.702+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94716635526112] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.702+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614804a040 con 0x5624ef69dda0 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.702+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94716635518864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a1bb0 con 0x5624ef69dda0 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.702+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a5220 con 0x7f614800f070 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.703+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94716635518864] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614804a040 con 0x5624ef69dda0 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.703+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.704+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94716635532656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a5640 con 0x7f614800f070 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.704+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a6000 con 0x5624ef694a50 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.705+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94716635532656] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x7f614800f070 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.705+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.705+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94716635534192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a6000 con 0x5624ef694a50 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.705+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a69c0 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.706+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.706+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94716635538704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a6de0 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.706+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a78a0 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.706+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94716635534192] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.707+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(56 notify.6 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.707+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94716635542480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a78a0 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.707+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a82d0 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.707+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94716635538704] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94716635542480] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'243 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94716635536208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a6930 con 0x5624ef699440 2024-09-19T11:15:39.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f6163f39800 20 add_watcher() i=0 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f6163f39800 20 add_watcher() i=1 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f6163f39800 20 add_watcher() i=2 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f6163f39800 20 add_watcher() i=3 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f6163f39800 20 add_watcher() i=4 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f6163f39800 20 add_watcher() i=5 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.708+0000 7f6163f39800 20 add_watcher() i=6 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.709+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94716635536208] v37'244 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.709+0000 7f6163f39800 20 add_watcher() i=7 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.709+0000 7f6163f39800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.709+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6ab300 con 0x5624ef694a50 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.709+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.709+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94716635545056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a8780 con 0x5624ef694a50 2024-09-19T11:15:39.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.710+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94716635545056] v37'241 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6163f39800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6163f39800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6163f39800 5 note: GC not initialized 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6014fe1640 20 reqs_thread_entry: start 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6163f39800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6163f39800 20 Filter name: none 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f5f8e7fc640 20 reqs_thread_entry: start 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6163f39800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6163f39800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.711+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6de060 con 0x5624ef699440 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.712+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.712+0000 7f6163f39800 20 rados_obj.operate() r=0 bl.length=473 2024-09-19T11:15:39.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.712+0000 7f6163f39800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:39.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.712+0000 7f6163f39800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:39.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.712+0000 7f6163f39800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:39.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.712+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6e4800 con 0x5624ef699440 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'5 uv5 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f6163f39800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f6163f39800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f6163f39800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94716635791872 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6dfe80 con 0x5624ef694a50 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 94716635534192 notify 158913789985 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f6158018a00 con 0x5624ef694a50 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f603effd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789985 cookie 94716635534192 notifier 4848 bl.length()=636 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f603effd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:39.724 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 94716635791872 out=8b] v0'0 uv243 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f603effd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:39.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f603effd640 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f6024003ea0 con 0x5624ef694a50 2024-09-19T11:15:39.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.714+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f615800a4d0 con 0x5624ef694a50 2024-09-19T11:15:39.725 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.715+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 94716635791872 notify 158913789985 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f6158018bd0 con 0x5624ef694a50 2024-09-19T11:15:39.725 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:39.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.715+0000 7f6015fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:39.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.715+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94716635545056] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6dbed0 con 0x5624ef694a50 2024-09-19T11:15:39.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.716+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94716635545056] v37'242 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f6158040040 con 0x5624ef694a50 2024-09-19T11:15:39.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.716+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94716635521344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6dbed0 con 0x7f614800f070 2024-09-19T11:15:39.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.717+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94716635521344] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6158040040 con 0x7f614800f070 2024-09-19T11:15:39.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.717+0000 7f6163f39800 20 remove_watcher() i=0 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.717+0000 7f6163f39800 2 removed watcher, disabling cache 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.717+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94716635526112] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6dbed0 con 0x5624ef694a50 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.719+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94716635526112] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6158040040 con 0x5624ef694a50 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.719+0000 7f6163f39800 20 remove_watcher() i=1 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.719+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94716635518864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6dbed0 con 0x5624ef69dda0 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.720+0000 7f6157fff640 1 -- 172.21.15.102:0/1846615980 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94716635518864] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f614804a040 con 0x5624ef69dda0 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.720+0000 7f6163f39800 20 remove_watcher() i=2 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.720+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94716635532656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a33e0 con 0x7f614800f070 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.721+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94716635532656] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6158040040 con 0x7f614800f070 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.721+0000 7f6163f39800 20 remove_watcher() i=3 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.721+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94716635534192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a1790 con 0x5624ef694a50 2024-09-19T11:15:39.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.722+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94716635534192] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6158040040 con 0x5624ef694a50 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.722+0000 7f6163f39800 20 remove_watcher() i=4 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.722+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94716635538704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a4d70 con 0x5624ef699440 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.723+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94716635538704] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.723+0000 7f6163f39800 20 remove_watcher() i=5 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.723+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94716635542480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a33e0 con 0x5624ef699440 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.724+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94716635542480] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.724+0000 7f6163f39800 20 remove_watcher() i=6 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.724+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94716635536208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5624ef6a1790 con 0x5624ef699440 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.725+0000 7f615fc81640 1 -- 172.21.15.102:0/1846615980 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94716635536208] v37'245 uv243 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f6150094030 con 0x5624ef699440 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.725+0000 7f6163f39800 20 remove_watcher() i=7 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef699440 msgr2=0x5624ef69b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef699440 0x5624ef69b830 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef694a50 msgr2=0x5624ef696f10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef694a50 0x5624ef696f10 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f614800f070 msgr2=0x7f614803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f614800f070 0x7f614803a3c0 crc :-1 s=READY pgs=92 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef69dda0 msgr2=0x5624ef6a0260 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef69dda0 0x5624ef6a0260 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f602803cf60 msgr2=0x7f602803f420 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f602803cf60 0x7f602803f420 secure :-1 s=READY pgs=316 cs=0 l=1 rev1=1 crypto rx=0x7f614800ffd0 tx=0x7f6148010000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6160482640 1 -- 172.21.15.102:0/1846615980 reap_dead start 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 msgr2=0x5624ef6894c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef6894c0 secure :-1 s=READY pgs=758 cs=0 l=1 rev1=1 crypto rx=0x7f6150095b20 tx=0x7f615005ef70 comp rx=0 tx=0).stop 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 shutdown_connections 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/1846615980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef682060 0x5624ef6894c0 unknown :-1 s=CLOSED pgs=758 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 >> 172.21.15.102:0/1846615980 conn(0x5624ef67e460 msgr2=0x5624ef67c670 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 shutdown_connections 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/1846615980 wait complete. 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/4142256929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f603803cf80 msgr2=0x7f603803f440 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/4142256929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f603803cf80 0x7f603803f440 secure :-1 s=READY pgs=315 cs=0 l=1 rev1=1 crypto rx=0x5624ef667e40 tx=0x7f614800f000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/4142256929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef675780 msgr2=0x5624ef675ba0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/4142256929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef675780 0x5624ef675ba0 secure :-1 s=READY pgs=756 cs=0 l=1 rev1=1 crypto rx=0x7f6150076750 tx=0x7f615005ad70 comp rx=0 tx=0).stop 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/4142256929 shutdown_connections 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/4142256929 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f603803cf80 0x7f603803f440 unknown :-1 s=CLOSED pgs=315 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 --2- 172.21.15.102:0/4142256929 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef675780 0x5624ef675ba0 unknown :-1 s=CLOSED pgs=756 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/4142256929 >> 172.21.15.102:0/4142256929 conn(0x5624ef669b30 msgr2=0x5624ef669f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/4142256929 shutdown_connections 2024-09-19T11:15:39.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.726+0000 7f6163f39800 1 -- 172.21.15.102:0/4142256929 wait complete. 2024-09-19T11:15:39.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef660ea0 msgr2=0x5624ef663340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5624ef660ea0 0x5624ef663340 crc :-1 s=READY pgs=173 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef65c690 msgr2=0x5624ef65ea80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5624ef65c690 0x5624ef65ea80 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef664f30 msgr2=0x5624ef667320 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5624ef664f30 0x5624ef667320 crc :-1 s=READY pgs=174 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f604803cfb0 msgr2=0x7f604803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f604803cfb0 0x7f604803f470 secure :-1 s=READY pgs=314 cs=0 l=1 rev1=1 crypto rx=0x7f6148001e30 tx=0x7f6148001390 comp rx=0 tx=0).stop 2024-09-19T11:15:39.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 msgr2=0x5624ef657050 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 --2- 172.21.15.102:0/1307368789 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5624ef55e9a0 0x5624ef657050 secure :-1 s=READY pgs=755 cs=0 l=1 rev1=1 crypto rx=0x7f6150000c00 tx=0x7f6150002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6160482640 1 -- 172.21.15.102:0/1307368789 reap_dead start 2024-09-19T11:15:39.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 shutdown_connections 2024-09-19T11:15:39.739 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 >> 172.21.15.102:0/1307368789 conn(0x5624ef558c70 msgr2=0x5624ef6488e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 shutdown_connections 2024-09-19T11:15:39.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.727+0000 7f6163f39800 1 -- 172.21.15.102:0/1307368789 wait complete. 2024-09-19T11:15:39.741 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:39.741 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:39.741 ERROR:root:0 2024-09-19T11:15:39.741 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-19T11:15:39.741 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'system_user', '--display-name', 'System User', '--access-key', 'system_akey', '--secret', 'system_skey', '--caps', 'user-info-without-keys=read', '--system'] 2024-09-19T11:15:39.741 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid system_user --display-name 'System User' --access-key system_akey --secret system_skey --caps user-info-without-keys=read --system 2024-09-19T11:15:39.795 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:39.795 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:39.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.794+0000 7f725f298800 1 Processor -- start 2024-09-19T11:15:39.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.794+0000 7f725f298800 1 -- start start 2024-09-19T11:15:39.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725f298800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5616b0cabbb0 0x5616b0cb1750 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725f298800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5616b0caaf90 con 0x5616b0caa8e0 2024-09-19T11:15:39.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725f298800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5616b0b357d0 con 0x5616b0cabbb0 2024-09-19T11:15:39.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725c581640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5616b0cabbb0 0x5616b0cb1750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725cd82640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5616b0caa8e0 0x5616b0cab4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34738/0 (socket says 172.21.15.102:34738) 2024-09-19T11:15:39.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725cd82640 1 -- 172.21.15.102:0/3289212170 learned_addr learned my addr 172.21.15.102:0/3289212170 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:39.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725bd80640 1 -- 172.21.15.102:0/3289212170 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1772934490 0 0) 0x5616b0caaf90 con 0x5616b0caa8e0 2024-09-19T11:15:39.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725bd80640 1 -- 172.21.15.102:0/3289212170 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7248001e10 con 0x5616b0caa8e0 2024-09-19T11:15:39.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725c581640 1 -- 172.21.15.102:0/3289212170 >> v1:172.21.15.37:6789/0 conn(0x5616b0caa8e0 legacy=0x5616b0cab4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.795+0000 7f725c581640 1 -- 172.21.15.102:0/3289212170 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b0cac060 con 0x5616b0cabbb0 2024-09-19T11:15:39.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.797+0000 7f725c581640 1 --2- 172.21.15.102:0/3289212170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0cabbb0 0x5616b0cb1750 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f724c00a470 tx=0x7f724c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=13a666fe54ce56e0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.797+0000 7f725bd80640 1 -- 172.21.15.102:0/3289212170 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724c059070 con 0x5616b0cabbb0 2024-09-19T11:15:39.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.797+0000 7f725bd80640 1 -- 172.21.15.102:0/3289212170 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724c054570 con 0x5616b0cabbb0 2024-09-19T11:15:39.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.797+0000 7f725bd80640 1 -- 172.21.15.102:0/3289212170 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724c054870 con 0x5616b0cabbb0 2024-09-19T11:15:39.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.798+0000 7f725f298800 1 -- 172.21.15.102:0/3289212170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0cabbb0 msgr2=0x5616b0cb1750 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.798+0000 7f725f298800 1 --2- 172.21.15.102:0/3289212170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0cabbb0 0x5616b0cb1750 secure :-1 s=READY pgs=760 cs=0 l=1 rev1=1 crypto rx=0x7f724c00a470 tx=0x7f724c045920 comp rx=0 tx=0).stop 2024-09-19T11:15:39.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.798+0000 7f725f298800 1 -- 172.21.15.102:0/3289212170 shutdown_connections 2024-09-19T11:15:39.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.798+0000 7f725f298800 1 --2- 172.21.15.102:0/3289212170 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0cabbb0 0x5616b0cb1750 unknown :-1 s=CLOSED pgs=760 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.798+0000 7f725f298800 1 -- 172.21.15.102:0/3289212170 >> 172.21.15.102:0/3289212170 conn(0x5616b0ca5cb0 msgr2=0x5616b0ca8110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.798+0000 7f725f298800 1 -- 172.21.15.102:0/3289212170 shutdown_connections 2024-09-19T11:15:39.800 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.798+0000 7f725f298800 1 -- 172.21.15.102:0/3289212170 wait complete. 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.811+0000 7f725f298800 1 Processor -- start 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.812+0000 7f725f298800 1 -- start start 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.812+0000 7f725f298800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0c201d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.812+0000 7f725f298800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616b0b42dd0 con 0x5616b0caa8e0 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.812+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0c201d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.812+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0c201d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39476/0 (socket says 172.21.15.102:39476) 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.812+0000 7f725cd82640 1 -- 172.21.15.102:0/2510442450 learned_addr learned my addr 172.21.15.102:0/2510442450 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.812+0000 7f725cd82640 1 -- 172.21.15.102:0/2510442450 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b0c207c0 con 0x5616b0caa8e0 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.813+0000 7f725cd82640 1 --2- 172.21.15.102:0/2510442450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0c201d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f7244001e30 tx=0x7f724400b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4b8567d618b3d9ec server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.813+0000 7f714ae0d640 1 -- 172.21.15.102:0/2510442450 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244012020 con 0x5616b0caa8e0 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.813+0000 7f714ae0d640 1 -- 172.21.15.102:0/2510442450 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724400e470 con 0x5616b0caa8e0 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.813+0000 7f714ae0d640 1 -- 172.21.15.102:0/2510442450 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724400e790 con 0x5616b0caa8e0 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.813+0000 7f725f298800 1 -- 172.21.15.102:0/2510442450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 msgr2=0x5616b0c201d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.813+0000 7f725f298800 1 --2- 172.21.15.102:0/2510442450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0c201d0 secure :-1 s=READY pgs=761 cs=0 l=1 rev1=1 crypto rx=0x7f7244001e30 tx=0x7f724400b780 comp rx=0 tx=0).stop 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 -- 172.21.15.102:0/2510442450 shutdown_connections 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 --2- 172.21.15.102:0/2510442450 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0c201d0 unknown :-1 s=CLOSED pgs=761 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 -- 172.21.15.102:0/2510442450 >> 172.21.15.102:0/2510442450 conn(0x5616b0ca5cb0 msgr2=0x5616b0d95b90 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 -- 172.21.15.102:0/2510442450 shutdown_connections 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 -- 172.21.15.102:0/2510442450 wait complete. 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 Processor -- start 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 -- start start 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0da3f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.836 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725f298800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616b0cb1ea0 con 0x5616b0caa8e0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0da3f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0da3f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39482/0 (socket says 172.21.15.102:39482) 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.814+0000 7f725cd82640 1 -- 172.21.15.102:0/2136963859 learned_addr learned my addr 172.21.15.102:0/2136963859 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.815+0000 7f725cd82640 1 -- 172.21.15.102:0/2136963859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b0da4480 con 0x5616b0caa8e0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.815+0000 7f725cd82640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0da3f20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x5616b0c1fd00 tx=0x7f72440040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.815+0000 7f714960a640 1 -- 172.21.15.102:0/2136963859 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244012030 con 0x5616b0caa8e0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.815+0000 7f714960a640 1 -- 172.21.15.102:0/2136963859 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f724401a7a0 con 0x5616b0caa8e0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.815+0000 7f714960a640 1 -- 172.21.15.102:0/2136963859 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724401aaa0 con 0x5616b0caa8e0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.815+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b0da4710 con 0x5616b0caa8e0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.815+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b0da5110 con 0x5616b0caa8e0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.816+0000 7f714960a640 1 -- 172.21.15.102:0/2136963859 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7244015020 con 0x5616b0caa8e0 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.816+0000 7f714960a640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f714403d000 0x7f714403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.816+0000 7f714960a640 1 -- 172.21.15.102:0/2136963859 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7244020070 con 0x5616b0caa8e0 2024-09-19T11:15:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.816+0000 7f725c581640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f714403d000 0x7f714403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.816+0000 7f725f298800 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0cabbb0 0x5616b0dab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.816+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0da5d00 con 0x5616b0cabbb0 2024-09-19T11:15:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.816+0000 7f725d583640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0cabbb0 0x5616b0dab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.817+0000 7f725c581640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f714403d000 0x7f714403f4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x5616b0caa020 tx=0x7f724c050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.817+0000 7f725d583640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0cabbb0 0x5616b0dab570 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.817+0000 7f725d583640 1 -- 172.21.15.102:0/2136963859 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0cabbb0 2024-09-19T11:15:39.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.817+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0da55f0 con 0x5616b0cabbb0 2024-09-19T11:15:39.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.817+0000 7f725d583640 1 -- 172.21.15.102:0/2136963859 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0cabbb0 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.817+0000 7f725f298800 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0dada60 0x5616b0dafe50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.817+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0db0520 con 0x5616b0dada60 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.818+0000 7f725cd82640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0dada60 0x5616b0dafe50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.818+0000 7f725cd82640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0dada60 0x5616b0dafe50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.818+0000 7f725cd82640 1 -- 172.21.15.102:0/2136963859 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7244018950 con 0x5616b0dada60 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.818+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0dac900 con 0x5616b0cabbb0 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.819+0000 7f725d583640 1 -- 172.21.15.102:0/2136963859 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0cabbb0 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.819+0000 7f725f298800 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0db1960 0x5616b0db3d50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.819+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0db4490 con 0x5616b0db1960 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.819+0000 7f725c581640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0db1960 0x5616b0db3d50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.819+0000 7f725c581640 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0db1960 0x5616b0db3d50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.819+0000 7f725c581640 1 -- 172.21.15.102:0/2136963859 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f724c05c040 con 0x5616b0db1960 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.820+0000 7f725f298800 1 Processor -- start 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.820+0000 7f725f298800 1 -- start start 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.820+0000 7f725f298800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dc2210 0x5616b0dc2630 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.820+0000 7f725f298800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616b0ba14a0 con 0x5616b0dc2210 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.820+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dc2210 0x5616b0dc2630 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.820+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dc2210 0x5616b0dc2630 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39494/0 (socket says 172.21.15.102:39494) 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.820+0000 7f725cd82640 1 -- 172.21.15.102:0/2751798298 learned_addr learned my addr 172.21.15.102:0/2751798298 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.820+0000 7f725cd82640 1 -- 172.21.15.102:0/2751798298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b0dc2c70 con 0x5616b0dc2210 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.821+0000 7f725cd82640 1 --2- 172.21.15.102:0/2751798298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dc2210 0x5616b0dc2630 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7244052be0 tx=0x7f724401ae70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.821+0000 7f71427fc640 1 -- 172.21.15.102:0/2751798298 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244051650 con 0x5616b0dc2210 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.821+0000 7f71427fc640 1 -- 172.21.15.102:0/2751798298 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7244048070 con 0x5616b0dc2210 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.821+0000 7f725f298800 1 -- 172.21.15.102:0/2751798298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b0dc34a0 con 0x5616b0dc2210 2024-09-19T11:15:39.842 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.821+0000 7f71427fc640 1 -- 172.21.15.102:0/2751798298 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724404b370 con 0x5616b0dc2210 2024-09-19T11:15:39.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.821+0000 7f725f298800 1 -- 172.21.15.102:0/2751798298 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b0dc3a40 con 0x5616b0dc2210 2024-09-19T11:15:39.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f71427fc640 1 -- 172.21.15.102:0/2751798298 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f724404a020 con 0x5616b0dc2210 2024-09-19T11:15:39.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f71427fc640 1 --2- 172.21.15.102:0/2751798298 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f713403d000 0x7f713403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f71427fc640 1 -- 172.21.15.102:0/2751798298 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f724404f040 con 0x5616b0dc2210 2024-09-19T11:15:39.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725c581640 1 --2- 172.21.15.102:0/2751798298 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f713403d000 0x7f713403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725f298800 1 Processor -- start 2024-09-19T11:15:39.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725f298800 1 -- start start 2024-09-19T11:15:39.845 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725c581640 1 --2- 172.21.15.102:0/2751798298 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f713403d000 0x7f713403f4c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5616b0dabbe0 tx=0x7f724c005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725f298800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dceeb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725f298800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616b0c1ec20 con 0x5616b0dcead0 2024-09-19T11:15:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dceeb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dceeb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39508/0 (socket says 172.21.15.102:39508) 2024-09-19T11:15:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.822+0000 7f725cd82640 1 -- 172.21.15.102:0/2811524445 learned_addr learned my addr 172.21.15.102:0/2811524445 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f725cd82640 1 -- 172.21.15.102:0/2811524445 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b0dcf480 con 0x5616b0dcead0 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f725cd82640 1 --2- 172.21.15.102:0/2811524445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dceeb0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7244026040 tx=0x7f7244024cd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fb7c31113f05f7a8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f7133fff640 1 -- 172.21.15.102:0/2811524445 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724404be90 con 0x5616b0dcead0 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f7133fff640 1 -- 172.21.15.102:0/2811524445 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7244053fa0 con 0x5616b0dcead0 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f7133fff640 1 -- 172.21.15.102:0/2811524445 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7244036420 con 0x5616b0dcead0 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f725f298800 1 -- 172.21.15.102:0/2811524445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 msgr2=0x5616b0dceeb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f725f298800 1 --2- 172.21.15.102:0/2811524445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dceeb0 secure :-1 s=READY pgs=764 cs=0 l=1 rev1=1 crypto rx=0x7f7244026040 tx=0x7f7244024cd0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f725f298800 1 -- 172.21.15.102:0/2811524445 shutdown_connections 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f725f298800 1 --2- 172.21.15.102:0/2811524445 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dceeb0 unknown :-1 s=CLOSED pgs=764 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.823+0000 7f725f298800 1 -- 172.21.15.102:0/2811524445 >> 172.21.15.102:0/2811524445 conn(0x5616b0dcaed0 msgr2=0x5616b0dc9110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725f298800 1 -- 172.21.15.102:0/2811524445 shutdown_connections 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725f298800 1 -- 172.21.15.102:0/2811524445 wait complete. 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725f298800 1 Processor -- start 2024-09-19T11:15:39.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725f298800 1 -- start start 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725f298800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dd5f20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725f298800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5616b0dcf930 con 0x5616b0dcead0 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dd5f20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725cd82640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dd5f20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39518/0 (socket says 172.21.15.102:39518) 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 learned_addr learned my addr 172.21.15.102:0/888838822 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.824+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5616b0dd6480 con 0x5616b0dcead0 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.825+0000 7f725cd82640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dd5f20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7244000c00 tx=0x7f7244037890 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.825+0000 7f71327fc640 1 -- 172.21.15.102:0/888838822 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f724406f070 con 0x5616b0dcead0 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.825+0000 7f71327fc640 1 -- 172.21.15.102:0/888838822 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7244054300 con 0x5616b0dcead0 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.825+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5616b0dd6480 con 0x5616b0dcead0 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.825+0000 7f71327fc640 1 -- 172.21.15.102:0/888838822 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f72440545e0 con 0x5616b0dcead0 2024-09-19T11:15:39.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.825+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5616b0dd6480 con 0x5616b0dcead0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.826+0000 7f71327fc640 1 -- 172.21.15.102:0/888838822 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7244072070 con 0x5616b0dcead0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.826+0000 7f71327fc640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f712803cfb0 0x7f712803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.826+0000 7f71327fc640 1 -- 172.21.15.102:0/888838822 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f724405b030 con 0x5616b0dcead0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.826+0000 7f725c581640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f712803cfb0 0x7f712803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.826+0000 7f725c581640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f712803cfb0 0x7f712803f470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5616b0db4890 tx=0x7f724c062040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0de14c0 0x5616b0de3980 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725d583640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0de14c0 0x5616b0de3980 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de40d0 con 0x5616b0de14c0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725d583640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0de14c0 0x5616b0de3980 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.849 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725f298800 20 realm 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.827+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de44e0 con 0x5616b0de14c0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de4db0 con 0x5616b0de14c0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0de5eb0 0x5616b0de82a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.828+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de8860 con 0x5616b0de5eb0 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.829+0000 7f725cd82640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0de5eb0 0x5616b0de82a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.829+0000 7f725cd82640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0de5eb0 0x5616b0de82a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.829+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.829+0000 7f725f298800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.829+0000 7f725f298800 20 searching for the correct realm 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.829+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0dea810 0x5616b0deccd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.829+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0ded3a0 con 0x5616b0dea810 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.829+0000 7f725c581640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0dea810 0x5616b0deccd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.830+0000 7f725c581640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0dea810 0x5616b0deccd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.830+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.830+0000 7f725c581640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f724c085040 0x7f724c077430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.830+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0ded3a0 con 0x7f724c085040 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.830+0000 7f725d583640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f724c085040 0x7f724c077430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.830+0000 7f725d583640 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f724c085040 0x7f724c077430 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.831+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.831+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de5eb0 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.831+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.831+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.831+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.831+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.831+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.831+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de5eb0 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.832+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.832+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de5eb0 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.832+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.832+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x7f724c085040 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.832+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.832+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0dea810 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.833+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.833+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.833+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.833+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de5eb0 2024-09-19T11:15:39.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.833+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.833+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.834+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.834+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x7f724c085040 2024-09-19T11:15:39.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.834+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.834+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0dea810 2024-09-19T11:15:39.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.834+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.834+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0dea810 2024-09-19T11:15:39.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.834+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.834+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de5eb0 2024-09-19T11:15:39.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.835+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.835+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0dea810 2024-09-19T11:15:39.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.835+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.835+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0dea810 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.835+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.835+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.835+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.835+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.836+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.836+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de5eb0 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.836+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.836+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0dea810 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.836+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.836+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x7f724c085040 2024-09-19T11:15:39.868 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.836+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.836+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.837+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.837+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de5eb0 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.837+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.837+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0dea810 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.837+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.837+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de5eb0 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.837+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.837+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x7f724c085040 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0dea810 2024-09-19T11:15:39.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x7f724c085040 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x5616b0de14c0 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de5150 con 0x7f724c085040 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.838+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:39.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de9120 con 0x5616b0de14c0 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de9120 con 0x5616b0de14c0 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de9120 con 0x5616b0dea810 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 zone default found 2024-09-19T11:15:39.871 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 4 Realm: () 2024-09-19T11:15:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 zonegroup default 2024-09-19T11:15:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.839+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0de9aa0 con 0x5616b0de5eb0 2024-09-19T11:15:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0def3a0 con 0x5616b0dea810 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0def7c0 con 0x5616b0dea810 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 20 started sync module instance, tier type = 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.840+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0dee6b0 con 0x7f724c085040 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.841+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.841+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94655456668592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0dee6b0 con 0x7f724c085040 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.841+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df02d0 con 0x5616b0de14c0 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.842+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94655456668592] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.842+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.842+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94655456673216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0dee6b0 con 0x5616b0de14c0 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.842+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df0d40 con 0x5616b0dea810 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.844+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.844+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94655456675888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df15e0 con 0x5616b0dea810 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.844+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df2080 con 0x7f724c085040 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.844+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94655456673216] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.845+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.845+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94655456680784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df2470 con 0x7f724c085040 2024-09-19T11:15:39.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.845+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94655456675888] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.845+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df2980 con 0x5616b0de14c0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.846+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94655456680784] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.846+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.846+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94655456678192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df2980 con 0x5616b0de14c0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.846+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df3390 con 0x5616b0de5eb0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.847+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.847+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94655456685792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df3be0 con 0x5616b0de5eb0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.847+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df4660 con 0x5616b0de5eb0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.847+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94655456678192] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.848+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94655456685792] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.848+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.848+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94655456690512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df4a00 con 0x5616b0de5eb0 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.848+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df5290 con 0x5616b0de5eb0 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'246 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94655456690512] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94655456693664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df5b30 con 0x5616b0de5eb0 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725f298800 20 add_watcher() i=0 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725f298800 20 add_watcher() i=1 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725f298800 20 add_watcher() i=2 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725f298800 20 add_watcher() i=3 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725f298800 20 add_watcher() i=4 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725f298800 20 add_watcher() i=5 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.849+0000 7f725f298800 20 add_watcher() i=6 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.850+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94655456693664] v37'247 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.876 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.850+0000 7f725f298800 20 add_watcher() i=7 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.850+0000 7f725f298800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.850+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df8b60 con 0x5616b0de14c0 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.851+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.851+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94655456695936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0df6020 con 0x5616b0de14c0 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94655456695936] v37'243 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f7112fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f725f298800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f725f298800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f725f298800 5 note: GC not initialized 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f7111fe3640 20 reqs_thread_entry: start 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f725f298800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f725f298800 20 Filter name: none 2024-09-19T11:15:39.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f70837fe640 20 reqs_thread_entry: start 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f725f298800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.852+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e2b990 con 0x5616b0de5eb0 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 system_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 239+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x0 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 10 cache get: name=default.rgw.meta+users.keys+system_akey : miss 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 20 rados->read ofs=0 len=0 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:63 8.0 8:01223cbf:users.keys::system_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e2a030 con 0x5616b0dea810 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(63 system_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 197+0+0 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x0 2024-09-19T11:15:39.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 10 adding default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 10 cache get: name=default.rgw.meta+users.keys+system_akey : hit (negative entry) 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.853+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:64 8.1e 8:78ce4db0:users.uid::system_user:head [delete,create,call version.set in=58b,writefull 0~349 in=349b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e2a900 con 0x5616b0de5eb0 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(64 system_user [delete,create,call,writefull 0~349] v37'1 uv1 ondisk = 0) ==== 281+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725f298800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725f298800 10 moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725f298800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 0, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:65 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94655456912464 in=545b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e2ee20 con 0x7f724c085040 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== watch-notify(notify (1) cookie 94655456668592 notify 158913789975 ret 0) ==== 575+0+0 (crc 0 0 0) 0x7f7254018a20 con 0x7f724c085040 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f7133fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789975 cookie 94655456668592 notifier 4855 bl.length()=533 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(65 notify.0 [notify cookie 94655456912464 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f7133fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x17 2024-09-19T11:15:39.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f7133fff640 10 rgw watcher librados: moving default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f7133fff640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f7120003ea0 con 0x7f724c085040 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(66 notify.0 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== watch-notify(notify_complete (2) cookie 94655456912464 notify 158913789975 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7254018cc0 con 0x7f724c085040 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.855+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 8.0 8:01223cbf:users.keys::system_akey:head [delete,create,writefull 0~15 in=15b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e2a900 con 0x5616b0dea810 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.856+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 system_akey [delete,create,writefull 0~15] v37'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.856+0000 7f725f298800 10 cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.856+0000 7f725f298800 10 moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.856+0000 7f725f298800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 0, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.856+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [notify cookie 94655456912464 in=188b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e2f2d0 con 0x5616b0de14c0 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.857+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 94655456673216 notify 158913789986 ret 0) ==== 218+0+0 (crc 0 0 0) 0x7f7254018cc0 con 0x5616b0de14c0 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.857+0000 7f7133fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789986 cookie 94655456673216 notifier 4855 bl.length()=176 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.857+0000 7f7133fff640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+system_akey info.flags=0x7 2024-09-19T11:15:39.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.857+0000 7f7133fff640 10 rgw watcher librados: moving default.rgw.meta+users.keys+system_akey to cache LRU end 2024-09-19T11:15:39.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.857+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(68 notify.1 [notify cookie 94655456912464 out=8b] v0'0 uv246 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.857+0000 7f7133fff640 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:69 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f7120003ea0 con 0x5616b0de14c0 2024-09-19T11:15:39.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.857+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(69 notify.1 [notify-ack] v0'0 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.857+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 94655456912464 notify 158913789986 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f7254026620 con 0x5616b0de14c0 2024-09-19T11:15:39.881 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"system_user","display_name":"System User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"system_user","access_key":"system_akey","secret_key":"system_skey","active":true,"create_date":"2024-09-19T11:15:39.854644Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","system":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.854635Z","tags":[],"group_ids":[]} 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.858+0000 7f7112fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.858+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94655456695936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x5616b0de14c0 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.859+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94655456695936] v37'244 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.859+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94655456668592] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x7f724c085040 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.860+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94655456668592] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.860+0000 7f725f298800 20 remove_watcher() i=0 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.860+0000 7f725f298800 2 removed watcher, disabling cache 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.860+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94655456673216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x5616b0de14c0 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.861+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94655456673216] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.861+0000 7f725f298800 20 remove_watcher() i=1 2024-09-19T11:15:39.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.861+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94655456675888] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x5616b0dea810 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.862+0000 7f725c581640 1 -- 172.21.15.102:0/888838822 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94655456675888] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f724c072030 con 0x5616b0dea810 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.862+0000 7f725f298800 20 remove_watcher() i=2 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.862+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94655456680784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x7f724c085040 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.863+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94655456680784] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x7f724c085040 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.863+0000 7f725f298800 20 remove_watcher() i=3 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.863+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94655456678192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x5616b0de14c0 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.864+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94655456678192] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f725400a4d0 con 0x5616b0de14c0 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.864+0000 7f725f298800 20 remove_watcher() i=4 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.864+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94655456685792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x5616b0de5eb0 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.865+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94655456685792] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.865+0000 7f725f298800 20 remove_watcher() i=5 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.865+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94655456690512] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x5616b0de5eb0 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.866+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94655456690512] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.866+0000 7f725f298800 20 remove_watcher() i=6 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.866+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94655456693664] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5616b0e297c0 con 0x5616b0de5eb0 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725cd82640 1 -- 172.21.15.102:0/888838822 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94655456693664] v37'248 uv246 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7244071030 con 0x5616b0de5eb0 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 20 remove_watcher() i=7 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0de5eb0 msgr2=0x5616b0de82a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0de5eb0 0x5616b0de82a0 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0de14c0 msgr2=0x5616b0de3980 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0de14c0 0x5616b0de3980 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f724c085040 msgr2=0x7f724c077430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f724c085040 0x7f724c077430 crc :-1 s=READY pgs=93 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0dea810 msgr2=0x5616b0deccd0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0dea810 0x5616b0deccd0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f712803cfb0 msgr2=0x7f712803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f712803cfb0 0x7f712803f470 secure :-1 s=READY pgs=319 cs=0 l=1 rev1=1 crypto rx=0x5616b0db4890 tx=0x7f724c062040 comp rx=0 tx=0).stop 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 msgr2=0x5616b0dd5f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/888838822 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dcead0 0x5616b0dd5f20 secure :-1 s=READY pgs=765 cs=0 l=1 rev1=1 crypto rx=0x7f7244000c00 tx=0x7f7244037890 comp rx=0 tx=0).stop 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725d583640 1 -- 172.21.15.102:0/888838822 reap_dead start 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 shutdown_connections 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 >> 172.21.15.102:0/888838822 conn(0x5616b0dcaed0 msgr2=0x5616b0dc90e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 shutdown_connections 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/888838822 wait complete. 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/2751798298 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f713403d000 msgr2=0x7f713403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/2751798298 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f713403d000 0x7f713403f4c0 secure :-1 s=READY pgs=318 cs=0 l=1 rev1=1 crypto rx=0x5616b0dabbe0 tx=0x7f724c005a00 comp rx=0 tx=0).stop 2024-09-19T11:15:39.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/2751798298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dc2210 msgr2=0x5616b0dc2630 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/2751798298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dc2210 0x5616b0dc2630 secure :-1 s=READY pgs=763 cs=0 l=1 rev1=1 crypto rx=0x7f7244052be0 tx=0x7f724401ae70 comp rx=0 tx=0).stop 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/2751798298 shutdown_connections 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/2751798298 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f713403d000 0x7f713403f4c0 unknown :-1 s=CLOSED pgs=318 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 --2- 172.21.15.102:0/2751798298 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0dc2210 0x5616b0dc2630 unknown :-1 s=CLOSED pgs=763 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/2751798298 >> 172.21.15.102:0/2751798298 conn(0x5616b0db65c0 msgr2=0x5616b0db69a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/2751798298 shutdown_connections 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.868+0000 7f725f298800 1 -- 172.21.15.102:0/2751798298 wait complete. 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0dada60 msgr2=0x5616b0dafe50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5616b0dada60 0x5616b0dafe50 crc :-1 s=READY pgs=175 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0cabbb0 msgr2=0x5616b0dab570 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5616b0cabbb0 0x5616b0dab570 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0db1960 msgr2=0x5616b0db3d50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5616b0db1960 0x5616b0db3d50 crc :-1 s=READY pgs=176 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f714403d000 msgr2=0x7f714403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f714403d000 0x7f714403f4c0 secure :-1 s=READY pgs=317 cs=0 l=1 rev1=1 crypto rx=0x5616b0caa020 tx=0x7f724c050000 comp rx=0 tx=0).stop 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 msgr2=0x5616b0da3f20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 --2- 172.21.15.102:0/2136963859 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5616b0caa8e0 0x5616b0da3f20 secure :-1 s=READY pgs=762 cs=0 l=1 rev1=1 crypto rx=0x5616b0c1fd00 tx=0x7f72440040e0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725d583640 1 -- 172.21.15.102:0/2136963859 reap_dead start 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 shutdown_connections 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 >> 172.21.15.102:0/2136963859 conn(0x5616b0ca5cb0 msgr2=0x5616b0d956e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 shutdown_connections 2024-09-19T11:15:39.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.869+0000 7f725f298800 1 -- 172.21.15.102:0/2136963859 wait complete. 2024-09-19T11:15:39.892 DEBUG:tasks.util.rgw: json result: {'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-19T11:15:39.854644Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.854635Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:39.893 ERROR:root:{'user_id': 'system_user', 'display_name': 'System User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'system_user', 'access_key': 'system_akey', 'secret_key': 'system_skey', 'active': True, 'create_date': '2024-09-19T11:15:39.854644Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'system': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.854635Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:39.893 ERROR:root:0 2024-09-19T11:15:39.893 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:39.906 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:39.906 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'system_user'] 2024-09-19T11:15:39.906 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'system_user'] 2024-09-19T11:15:39.906 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid system_user 2024-09-19T11:15:39.951 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:39.951 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dc3a11800 1 Processor -- start 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dc3a11800 1 -- start start 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dc3a11800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ef654b4840 0x55ef654bd360 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dc3a11800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55ef654bd8a0 con 0x55ef654b2d20 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dc3a11800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55ef6533f7d0 con 0x55ef654b4840 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dbe947640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55ef654b4840 0x55ef654bd360 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dbf148640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55ef654b2d20 0x55ef654b3120 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34750/0 (socket says 172.21.15.102:34750) 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dbf148640 1 -- 172.21.15.102:0/3753418754 learned_addr learned my addr 172.21.15.102:0/3753418754 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.951+0000 7f7dbe146640 1 -- 172.21.15.102:0/3753418754 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3299434525 0 0) 0x55ef654bd8a0 con 0x55ef654b2d20 2024-09-19T11:15:39.953 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.952+0000 7f7dbe146640 1 -- 172.21.15.102:0/3753418754 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f7da8001e10 con 0x55ef654b2d20 2024-09-19T11:15:39.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.952+0000 7f7dbe947640 1 -- 172.21.15.102:0/3753418754 >> v1:172.21.15.37:6789/0 conn(0x55ef654b2d20 legacy=0x55ef654b3120 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.952+0000 7f7dbe947640 1 -- 172.21.15.102:0/3753418754 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef654bea80 con 0x55ef654b4840 2024-09-19T11:15:39.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.953+0000 7f7dbe947640 1 --2- 172.21.15.102:0/3753418754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 0x55ef654bd360 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7db400a470 tx=0x7f7db4045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=31d75beb1c4a895a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.954 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.953+0000 7f7dbe146640 1 -- 172.21.15.102:0/3753418754 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4059070 con 0x55ef654b4840 2024-09-19T11:15:39.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dbe146640 1 -- 172.21.15.102:0/3753418754 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db4054570 con 0x55ef654b4840 2024-09-19T11:15:39.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dbe146640 1 -- 172.21.15.102:0/3753418754 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db4054870 con 0x55ef654b4840 2024-09-19T11:15:39.955 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3753418754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 msgr2=0x55ef654bd360 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/3753418754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 0x55ef654bd360 secure :-1 s=READY pgs=767 cs=0 l=1 rev1=1 crypto rx=0x7f7db400a470 tx=0x7f7db4045920 comp rx=0 tx=0).stop 2024-09-19T11:15:39.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3753418754 shutdown_connections 2024-09-19T11:15:39.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/3753418754 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 0x55ef654bd360 unknown :-1 s=CLOSED pgs=767 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3753418754 >> 172.21.15.102:0/3753418754 conn(0x55ef654aea50 msgr2=0x55ef654b0eb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3753418754 shutdown_connections 2024-09-19T11:15:39.956 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.954+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3753418754 wait complete. 2024-09-19T11:15:39.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.968+0000 7f7dc3a11800 1 Processor -- start 2024-09-19T11:15:39.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.968+0000 7f7dc3a11800 1 -- start start 2024-09-19T11:15:39.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.968+0000 7f7dc3a11800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b2d20 0x55ef655a63a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.969 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.968+0000 7f7dc3a11800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef6534cdd0 con 0x55ef654b2d20 2024-09-19T11:15:39.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.968+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b2d20 0x55ef655a63a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.968+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b2d20 0x55ef655a63a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39536/0 (socket says 172.21.15.102:39536) 2024-09-19T11:15:39.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.968+0000 7f7dbf148640 1 -- 172.21.15.102:0/3516271728 learned_addr learned my addr 172.21.15.102:0/3516271728 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.969+0000 7f7dbf148640 1 -- 172.21.15.102:0/3516271728 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef655a6990 con 0x55ef654b2d20 2024-09-19T11:15:39.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.969+0000 7f7dbf148640 1 --2- 172.21.15.102:0/3516271728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b2d20 0x55ef655a63a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7db0001e30 tx=0x7f7db000b780 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a040f0fc0e194e6a server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.970 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.969+0000 7f7cad60a640 1 -- 172.21.15.102:0/3516271728 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0012020 con 0x55ef654b2d20 2024-09-19T11:15:39.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.969+0000 7f7cad60a640 1 -- 172.21.15.102:0/3516271728 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db000e470 con 0x55ef654b2d20 2024-09-19T11:15:39.971 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.969+0000 7f7cad60a640 1 -- 172.21.15.102:0/3516271728 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db000e790 con 0x55ef654b2d20 2024-09-19T11:15:39.974 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3516271728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b2d20 msgr2=0x55ef655a63a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/3516271728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b2d20 0x55ef655a63a0 secure :-1 s=READY pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7db0001e30 tx=0x7f7db000b780 comp rx=0 tx=0).stop 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3516271728 shutdown_connections 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/3516271728 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b2d20 0x55ef655a63a0 secure :-1 s=CLOSED pgs=768 cs=0 l=1 rev1=1 crypto rx=0x7f7db0001e30 tx=0x7f7db000b780 comp rx=0 tx=0).stop 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3516271728 >> 172.21.15.102:0/3516271728 conn(0x55ef654aea50 msgr2=0x55ef655a1d20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3516271728 shutdown_connections 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 -- 172.21.15.102:0/3516271728 wait complete. 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 Processor -- start 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 -- start start 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 0x55ef655ae0e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.970+0000 7f7dc3a11800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef654bdd40 con 0x55ef654b4840 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 0x55ef655ae0e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 0x55ef655ae0e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39540/0 (socket says 172.21.15.102:39540) 2024-09-19T11:15:39.975 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7dbf148640 1 -- 172.21.15.102:0/4114328846 learned_addr learned my addr 172.21.15.102:0/4114328846 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7dbf148640 1 -- 172.21.15.102:0/4114328846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef655ae640 con 0x55ef654b4840 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7dbf148640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 0x55ef655ae0e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x55ef655a7330 tx=0x7f7db00040e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7cabe07640 1 -- 172.21.15.102:0/4114328846 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0012030 con 0x55ef654b4840 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7cabe07640 1 -- 172.21.15.102:0/4114328846 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db001a700 con 0x55ef654b4840 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef655ae8d0 con 0x55ef654b4840 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7cabe07640 1 -- 172.21.15.102:0/4114328846 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db001a9e0 con 0x55ef654b4840 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.971+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef655af2d0 con 0x55ef654b4840 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.972+0000 7f7cabe07640 1 -- 172.21.15.102:0/4114328846 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7db0015020 con 0x55ef654b4840 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.972+0000 7f7cabe07640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ca403d000 0x7f7ca403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.972+0000 7f7cabe07640 1 -- 172.21.15.102:0/4114328846 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7db0020070 con 0x55ef654b4840 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.972+0000 7f7dbe947640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ca403d000 0x7f7ca403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.973+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655afe00 0x55ef655b5730 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.976 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.973+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655b5cb0 con 0x55ef655afe00 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.973+0000 7f7dbf949640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655afe00 0x55ef655b5730 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.973+0000 7f7dbe947640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ca403d000 0x7f7ca403f4c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55ef65427770 tx=0x7f7db4050000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.973+0000 7f7dbf949640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655afe00 0x55ef655b5730 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.973+0000 7f7dbf949640 1 -- 172.21.15.102:0/4114328846 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655afe00 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.973+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655af7b0 con 0x55ef655afe00 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.974+0000 7f7dbf949640 1 -- 172.21.15.102:0/4114328846 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655afe00 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.974+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655b8000 0x55ef655ba3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.974+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655baac0 con 0x55ef655b8000 2024-09-19T11:15:39.977 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.974+0000 7f7dbf148640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655b8000 0x55ef655ba3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.974+0000 7f7dbf148640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655b8000 0x55ef655ba3f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.974+0000 7f7dbf148640 1 -- 172.21.15.102:0/4114328846 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f7db0018950 con 0x55ef655b8000 2024-09-19T11:15:39.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.974+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655b6ea0 con 0x55ef655afe00 2024-09-19T11:15:39.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.975+0000 7f7dbf949640 1 -- 172.21.15.102:0/4114328846 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655afe00 2024-09-19T11:15:39.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.975+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655bbf00 0x55ef655be2f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.983 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.975+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655bea30 con 0x55ef655bbf00 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.975+0000 7f7dbe947640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655bbf00 0x55ef655be2f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.975+0000 7f7dbe947640 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655bbf00 0x55ef655be2f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.975+0000 7f7dbe947640 1 -- 172.21.15.102:0/4114328846 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7db405c040 con 0x55ef655bbf00 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.976+0000 7f7dc3a11800 1 Processor -- start 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.976+0000 7f7dc3a11800 1 -- start start 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.976+0000 7f7dc3a11800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655cc7b0 0x55ef655ccbd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.976+0000 7f7dc3a11800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef653ab4a0 con 0x55ef655cc7b0 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.976+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655cc7b0 0x55ef655ccbd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.976+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655cc7b0 0x55ef655ccbd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39552/0 (socket says 172.21.15.102:39552) 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.976+0000 7f7dbf148640 1 -- 172.21.15.102:0/1545489724 learned_addr learned my addr 172.21.15.102:0/1545489724 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.976+0000 7f7dbf148640 1 -- 172.21.15.102:0/1545489724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef655cd210 con 0x55ef655cc7b0 2024-09-19T11:15:39.984 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.977+0000 7f7dbf148640 1 --2- 172.21.15.102:0/1545489724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655cc7b0 0x55ef655ccbd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7db00529f0 tx=0x7f7db0042380 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.977+0000 7f7ca9602640 1 -- 172.21.15.102:0/1545489724 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db002cd90 con 0x55ef655cc7b0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.977+0000 7f7ca9602640 1 -- 172.21.15.102:0/1545489724 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db0052070 con 0x55ef655cc7b0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.977+0000 7f7ca9602640 1 -- 172.21.15.102:0/1545489724 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0016c30 con 0x55ef655cc7b0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.977+0000 7f7dc3a11800 1 -- 172.21.15.102:0/1545489724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef655cda40 con 0x55ef655cc7b0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.977+0000 7f7dc3a11800 1 -- 172.21.15.102:0/1545489724 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef655cda40 con 0x55ef655cc7b0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7ca9602640 1 -- 172.21.15.102:0/1545489724 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7db0016570 con 0x55ef655cc7b0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7ca9602640 1 --2- 172.21.15.102:0/1545489724 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c9803cfb0 0x7f7c9803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7ca9602640 1 -- 172.21.15.102:0/1545489724 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7db003bbf0 con 0x55ef655cc7b0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7dbe947640 1 --2- 172.21.15.102:0/1545489724 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c9803cfb0 0x7f7c9803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7dc3a11800 1 Processor -- start 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7dc3a11800 1 -- start start 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7dbe947640 1 --2- 172.21.15.102:0/1545489724 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c9803cfb0 0x7f7c9803f470 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55ef655b6180 tx=0x7f7db4005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7dc3a11800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655d9260 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.985 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.978+0000 7f7dc3a11800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef655a6dc0 con 0x55ef655d8e60 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.979+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655d9260 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.979+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655d9260 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39566/0 (socket says 172.21.15.102:39566) 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.979+0000 7f7dbf148640 1 -- 172.21.15.102:0/2879608786 learned_addr learned my addr 172.21.15.102:0/2879608786 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.979+0000 7f7dbf148640 1 -- 172.21.15.102:0/2879608786 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef655d9850 con 0x55ef655d8e60 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.979+0000 7f7dbf148640 1 --2- 172.21.15.102:0/2879608786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655d9260 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7db001bfd0 tx=0x7f7db003a200 comp rx=0 tx=0).ready entity=mon.0 client_cookie=fd490baf181c052d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.979+0000 7f7ca2ffd640 1 -- 172.21.15.102:0/2879608786 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db00540b0 con 0x55ef655d8e60 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.979+0000 7f7ca2ffd640 1 -- 172.21.15.102:0/2879608786 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db003ea60 con 0x55ef655d8e60 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.979+0000 7f7ca2ffd640 1 -- 172.21.15.102:0/2879608786 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db0054250 con 0x55ef655d8e60 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 -- 172.21.15.102:0/2879608786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 msgr2=0x55ef655d9260 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/2879608786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655d9260 secure :-1 s=READY pgs=771 cs=0 l=1 rev1=1 crypto rx=0x7f7db001bfd0 tx=0x7f7db003a200 comp rx=0 tx=0).stop 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 -- 172.21.15.102:0/2879608786 shutdown_connections 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/2879608786 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655d9260 unknown :-1 s=CLOSED pgs=771 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:39.986 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 -- 172.21.15.102:0/2879608786 >> 172.21.15.102:0/2879608786 conn(0x55ef655d5260 msgr2=0x55ef655d34a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 -- 172.21.15.102:0/2879608786 shutdown_connections 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 -- 172.21.15.102:0/2879608786 wait complete. 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 Processor -- start 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 -- start start 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655e0280 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dc3a11800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55ef655d9cc0 con 0x55ef655d8e60 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655e0280 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dbf148640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655e0280 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39568/0 (socket says 172.21.15.102:39568) 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.980+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 learned_addr learned my addr 172.21.15.102:0/16206110 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.981+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55ef655e07e0 con 0x55ef655d8e60 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.981+0000 7f7dbf148640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655e0280 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7db00546b0 tx=0x7f7db0031f10 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.981+0000 7f7ca17fa640 1 -- 172.21.15.102:0/16206110 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db006e070 con 0x55ef655d8e60 2024-09-19T11:15:39.987 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.981+0000 7f7ca17fa640 1 -- 172.21.15.102:0/16206110 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7db004dd20 con 0x55ef655d8e60 2024-09-19T11:15:39.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.981+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55ef655e07e0 con 0x55ef655d8e60 2024-09-19T11:15:39.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.981+0000 7f7ca17fa640 1 -- 172.21.15.102:0/16206110 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7db004d720 con 0x55ef655d8e60 2024-09-19T11:15:39.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.981+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55ef655e07e0 con 0x55ef655d8e60 2024-09-19T11:15:39.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.982+0000 7f7ca17fa640 1 -- 172.21.15.102:0/16206110 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f7db0071070 con 0x55ef655d8e60 2024-09-19T11:15:39.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.982+0000 7f7ca17fa640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c8803d000 0x7f7c8803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:39.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.982+0000 7f7ca17fa640 1 -- 172.21.15.102:0/16206110 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f7db005a070 con 0x55ef655d8e60 2024-09-19T11:15:39.988 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.982+0000 7f7dbe947640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c8803d000 0x7f7c8803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dbe947640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c8803d000 0x7f7c8803f4c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55ef655bee30 tx=0x7f7db4062040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655eb6c0 0x55ef655edb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ee2d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dbf949640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655eb6c0 0x55ef655edb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dbf949640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655eb6c0 0x55ef655edb80 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.000 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dc3a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dc3a11800 20 realm 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.983+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ee6e0 con 0x55ef655eb6c0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655eefb0 con 0x55ef655eb6c0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.001 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655f00b0 0x55ef655f24a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f2a60 con 0x55ef655f00b0 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.984+0000 7f7dbf148640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655f00b0 0x55ef655f24a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.985+0000 7f7dbf148640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655f00b0 0x55ef655f24a0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.985+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.985+0000 7f7dc3a11800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.985+0000 7f7dc3a11800 20 searching for the correct realm 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.985+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655f4a10 0x55ef655f6ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.985+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f75a0 con 0x55ef655f4a10 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.985+0000 7f7dbe947640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655f4a10 0x55ef655f6ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.985+0000 7f7dbe947640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655f4a10 0x55ef655f6ed0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.002 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.986+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.986+0000 7f7dbe947640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7db4085040 0x7f7db4077430 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.986+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f75a0 con 0x7f7db4085040 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.986+0000 7f7dbf949640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7db4085040 0x7f7db4077430 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.986+0000 7f7dbf949640 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7db4085040 0x7f7db4077430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.986+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.986+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f00b0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.987+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.987+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.987+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.987+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.987+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.987+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f00b0 2024-09-19T11:15:40.003 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f00b0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x7f7db4085040 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f4a10 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.988+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f00b0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.989+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.989+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.989+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.004 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.989+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x7f7db4085040 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.989+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.989+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f4a10 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.989+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.989+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f4a10 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.990+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.990+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f00b0 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.990+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.990+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f4a10 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.990+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.990+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f4a10 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.990+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.990+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.005 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.991+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.991+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.991+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.991+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f00b0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.991+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.991+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f4a10 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.991+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.991+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x7f7db4085040 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.992+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.992+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.992+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.992+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f00b0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.992+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.006 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.992+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f4a10 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.992+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.992+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f00b0 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.993+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.993+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x7f7db4085040 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.993+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.993+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655f4a10 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.993+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.993+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x7f7db4085040 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.993+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.993+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x55ef655eb6c0 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.007 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ef350 con 0x7f7db4085040 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f3320 con 0x55ef655eb6c0 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.008 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f3320 con 0x55ef655eb6c0 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.994+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f3320 con 0x55ef655f4a10 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 zone default found 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 4 Realm: () 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 zonegroup default 2024-09-19T11:15:40.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f3c30 con 0x55ef655f00b0 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f9510 con 0x55ef655f4a10 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f9970 con 0x55ef655f4a10 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 started sync module instance, tier type = 2024-09-19T11:15:40.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.995+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f88b0 con 0x7f7db4085040 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.996+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.996+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94486686305712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f88b0 con 0x7f7db4085040 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.996+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fa4b0 con 0x55ef655eb6c0 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.997+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94486686305712] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.997+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.998+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94486686310304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f88b0 con 0x55ef655eb6c0 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.998+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655faf40 con 0x55ef655f4a10 2024-09-19T11:15:40.011 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.999+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94486686310304] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.999+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.999+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94486686303232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f8820 con 0x55ef655f4a10 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:39.999+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fbd00 con 0x7f7db4085040 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.000+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94486686303232] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.000+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.000+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94486686315312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fc0f0 con 0x7f7db4085040 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.000+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fcaf0 con 0x55ef655eb6c0 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.002+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.002+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94486686320128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fca60 con 0x55ef655eb6c0 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.002+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fdac0 con 0x55ef655f00b0 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.002+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94486686315312] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.004+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94486686320128] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.004+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.004+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94486686322400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fb750 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.004+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fe360 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.005+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(56 notify.6 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.005+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94486686328576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fefd0 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.005+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655ffa10 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94486686322400] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94486686328576] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'249 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94486686332128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655feb20 con 0x55ef655f00b0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dc3a11800 20 add_watcher() i=0 2024-09-19T11:15:40.017 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dc3a11800 20 add_watcher() i=1 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dc3a11800 20 add_watcher() i=2 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dc3a11800 20 add_watcher() i=3 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dc3a11800 20 add_watcher() i=4 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dc3a11800 20 add_watcher() i=5 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.006+0000 7f7dc3a11800 20 add_watcher() i=6 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.007+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94486686332128] v37'250 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.007+0000 7f7dc3a11800 20 add_watcher() i=7 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.007+0000 7f7dc3a11800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.007+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef65602b10 con 0x55ef655eb6c0 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.008+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.008+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94486686324144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fff90 con 0x55ef655eb6c0 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.009+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94486686324144] v37'245 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.009+0000 7f7c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.018 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.009+0000 7f7dc3a11800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.009+0000 7f7dc3a11800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.009+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560b280 con 0x55ef655eb6c0 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.010+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.010+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560b280 con 0x55ef655f00b0 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.011+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.011+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560b280 con 0x55ef655f4a10 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.012+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.012+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560b280 con 0x55ef655eb6c0 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.013+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'246 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.013+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560c320 con 0x7f7db4085040 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.014+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'77 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.019 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.014+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560c760 con 0x55ef655f4a10 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.015+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'52 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.015+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560ccd0 con 0x55ef655eb6c0 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.016+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.016+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560d180 con 0x55ef655f00b0 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.018+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'54 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.018+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560d180 con 0x7f7db4085040 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.019+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.019+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6560d180 con 0x55ef655f4a10 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.020+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.021 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.020+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656098e0 con 0x7f7db4085040 2024-09-19T11:15:40.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.020+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'78 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.022 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.020+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656098e0 con 0x55ef655f00b0 2024-09-19T11:15:40.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.022+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'37 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.022+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x7f7db4085040 2024-09-19T11:15:40.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.023+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.023+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef65609260 con 0x55ef655f00b0 2024-09-19T11:15:40.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.024+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'57 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.024+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655eb6c0 2024-09-19T11:15:40.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.025+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'247 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.025+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef65609260 con 0x55ef655f4a10 2024-09-19T11:15:40.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.026+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'71 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.026+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x7f7db4085040 2024-09-19T11:15:40.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.027+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'79 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.027+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f4a10 2024-09-19T11:15:40.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.028+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'29 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.028+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655eb6c0 2024-09-19T11:15:40.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.029+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'37 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.030 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.029+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655eb6c0 2024-09-19T11:15:40.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.030+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'248 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.031 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.030+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f4a10 2024-09-19T11:15:40.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.031+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'72 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.032 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.031+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x7f7db4085040 2024-09-19T11:15:40.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.032+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'39 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.033 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.032+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f4a10 2024-09-19T11:15:40.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.033+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'32 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.034 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.033+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f4a10 2024-09-19T11:15:40.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.034+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.035 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.034+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f4a10 2024-09-19T11:15:40.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.035+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'25 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.036 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.035+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f4a10 2024-09-19T11:15:40.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.036+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'53 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.037 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.036+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f00b0 2024-09-19T11:15:40.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.037+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'31 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.038 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.037+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f4a10 2024-09-19T11:15:40.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.038+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.039 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.038+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f00b0 2024-09-19T11:15:40.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.039+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'55 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.040 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.039+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f4a10 2024-09-19T11:15:40.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.040+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'73 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.041 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.040+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x55ef655f00b0 2024-09-19T11:15:40.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.041+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'58 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.041+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656099e0 con 0x7f7db4085040 2024-09-19T11:15:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.042+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'35 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.043+0000 7f7c74fe1640 20 reqs_thread_entry: start 2024-09-19T11:15:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.043+0000 7f7dc3a11800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.043+0000 7f7dc3a11800 20 Filter name: none 2024-09-19T11:15:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.043+0000 7f7dc3a11800 10 cache get: name=default.rgw.meta+users.uid+system_user : miss 2024-09-19T11:15:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.043+0000 7f7bee7fc640 20 reqs_thread_entry: start 2024-09-19T11:15:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.043+0000 7f7dc3a11800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.043+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:94 8.1e 8:78ce4db0:users.uid::system_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef65609370 con 0x55ef655f00b0 2024-09-19T11:15:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(94 system_user [call out=48b,read 0~349 out=349b,getxattrs out=75b] v0'0 uv1 ondisk = 0) ==== 239+0+472 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dc3a11800 20 rados_obj.operate() r=0 bl.length=349 2024-09-19T11:15:40.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dc3a11800 10 cache put: name=default.rgw.meta+users.uid+system_user info.flags=0x13 2024-09-19T11:15:40.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dc3a11800 10 adding default.rgw.meta+users.uid+system_user to cache LRU end 2024-09-19T11:15:40.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dc3a11800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:40.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:95 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef6563ab60 con 0x55ef655f00b0 2024-09-19T11:15:40.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(95 system_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dc3a11800 10 removing key index: system_akey 2024-09-19T11:15:40.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.044+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:96 8.0 8:01223cbf:users.keys::system_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef65638b40 con 0x55ef655f4a10 2024-09-19T11:15:40.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.045+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(96 system_akey [delete] v37'4 uv4 ondisk = 0) ==== 155+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.045+0000 7f7dc3a11800 10 distributing notification oid=default.rgw.control:notify.1 cni=[op: 1, obj: default.rgw.meta:users.keys:system_akey, ofs0, ns] 2024-09-19T11:15:40.047 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.045+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:97 7.0 7:05bf5b68:::notify.1:head [notify cookie 94486686570144 in=173b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef6563af80 con 0x55ef655eb6c0 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== watch-notify(notify (1) cookie 94486686310304 notify 158913789987 ret 0) ==== 203+0+0 (crc 0 0 0) 0x55ef6560c040 con 0x55ef655eb6c0 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7ca2ffd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789987 cookie 94486686310304 notifier 4862 bl.length()=161 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7ca2ffd640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:98 7.0 7:05bf5b68:::notify.1:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f7c84003d60 con 0x55ef655eb6c0 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(97 notify.1 [notify cookie 94486686570144 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(98 notify.1 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== watch-notify(notify_complete (2) cookie 94486686570144 notify 158913789987 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef6560b450 con 0x55ef655eb6c0 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7dc3a11800 10 removing email index: 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7dc3a11800 10 removing user buckets index 2024-09-19T11:15:40.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.046+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:99 8.1e 8:79f34a7d:users.uid::system_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef65638b40 con 0x55ef655f00b0 2024-09-19T11:15:40.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.047+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(99 system_user.buckets [delete] v37'2 uv1 ondisk = -2 ((2) No such file or directory)) ==== 163+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.047+0000 7f7dc3a11800 10 removing user index: system_user 2024-09-19T11:15:40.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.047+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:100 8.1e 8:78ce4db0:users.uid::system_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef6563acc0 con 0x55ef655f00b0 2024-09-19T11:15:40.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.048+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(100 system_user [call,call,delete] v37'3 uv3 ondisk = 0) ==== 239+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.048+0000 7f7dc3a11800 10 removing default.rgw.meta+users.uid+system_user from cache 2024-09-19T11:15:40.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.048+0000 7f7dc3a11800 10 distributing notification oid=default.rgw.control:notify.0 cni=[op: 1, obj: default.rgw.meta:users.uid:system_user, ofs0, ns] 2024-09-19T11:15:40.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.048+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:101 7.1f 7:f95f44c2:::notify.0:head [notify cookie 94486686574608 in=172b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55ef6563ac30 con 0x7f7db4085040 2024-09-19T11:15:40.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.049+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== watch-notify(notify (1) cookie 94486686305712 notify 158913789976 ret 0) ==== 202+0+0 (crc 0 0 0) 0x55ef6560b450 con 0x7f7db4085040 2024-09-19T11:15:40.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.049+0000 7f7ca27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789976 cookie 94486686305712 notifier 4862 bl.length()=160 2024-09-19T11:15:40.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.049+0000 7f7ca27fc640 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:102 7.1f 7:f95f44c2:::notify.0:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f7bf40032c0 con 0x7f7db4085040 2024-09-19T11:15:40.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.049+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(101 notify.0 [notify cookie 94486686574608 out=8b] v0'0 uv249 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.049+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== watch-notify(notify_complete (2) cookie 94486686574608 notify 158913789976 ret 0) ==== 42+0+48 (crc 0 0 0) 0x55ef6560a270 con 0x7f7db4085040 2024-09-19T11:15:40.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.049+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(102 notify.0 [notify-ack] v0'0 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.050+0000 7f7c75fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.050+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94486686324144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef656088d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.051+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94486686324144] v37'249 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.051+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94486686305712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fd5b0 con 0x7f7db4085040 2024-09-19T11:15:40.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.052+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94486686305712] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.052+0000 7f7dc3a11800 20 remove_watcher() i=0 2024-09-19T11:15:40.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.052+0000 7f7dc3a11800 2 removed watcher, disabling cache 2024-09-19T11:15:40.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.052+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94486686310304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fd5b0 con 0x55ef655eb6c0 2024-09-19T11:15:40.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.053+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94486686310304] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.053+0000 7f7dc3a11800 20 remove_watcher() i=1 2024-09-19T11:15:40.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.053+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94486686303232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f9fa0 con 0x55ef655f4a10 2024-09-19T11:15:40.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.054+0000 7f7dbe947640 1 -- 172.21.15.102:0/16206110 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94486686303232] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db4072030 con 0x55ef655f4a10 2024-09-19T11:15:40.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.054+0000 7f7dc3a11800 20 remove_watcher() i=2 2024-09-19T11:15:40.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.054+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94486686315312] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fd5b0 con 0x7f7db4085040 2024-09-19T11:15:40.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.055+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94486686315312] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x7f7db4085040 2024-09-19T11:15:40.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.055+0000 7f7dc3a11800 20 remove_watcher() i=3 2024-09-19T11:15:40.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.055+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94486686320128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f8400 con 0x55ef655eb6c0 2024-09-19T11:15:40.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.056+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94486686320128] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db800a4d0 con 0x55ef655eb6c0 2024-09-19T11:15:40.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.056+0000 7f7dc3a11800 20 remove_watcher() i=4 2024-09-19T11:15:40.057 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.056+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94486686322400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655f9fa0 con 0x55ef655f00b0 2024-09-19T11:15:40.058 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.058+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94486686322400] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.058+0000 7f7dc3a11800 20 remove_watcher() i=5 2024-09-19T11:15:40.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.058+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94486686328576] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fb330 con 0x55ef655f00b0 2024-09-19T11:15:40.059 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.059+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94486686328576] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.059+0000 7f7dc3a11800 20 remove_watcher() i=6 2024-09-19T11:15:40.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.059+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94486686332128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55ef655fd5b0 con 0x55ef655f00b0 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dbf148640 1 -- 172.21.15.102:0/16206110 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94486686332128] v37'251 uv249 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7db0070030 con 0x55ef655f00b0 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 20 remove_watcher() i=7 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655f00b0 msgr2=0x55ef655f24a0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655f00b0 0x55ef655f24a0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655eb6c0 msgr2=0x55ef655edb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655eb6c0 0x55ef655edb80 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7db4085040 msgr2=0x7f7db4077430 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7db4085040 0x7f7db4077430 crc :-1 s=READY pgs=94 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655f4a10 msgr2=0x55ef655f6ed0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655f4a10 0x55ef655f6ed0 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c8803d000 msgr2=0x7f7c8803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c8803d000 0x7f7c8803f4c0 secure :-1 s=READY pgs=322 cs=0 l=1 rev1=1 crypto rx=0x55ef655bee30 tx=0x7f7db4062040 comp rx=0 tx=0).stop 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 msgr2=0x55ef655e0280 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dbf949640 1 -- 172.21.15.102:0/16206110 reap_dead start 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655e0280 secure :-1 s=READY pgs=772 cs=0 l=1 rev1=1 crypto rx=0x7f7db00546b0 tx=0x7f7db0031f10 comp rx=0 tx=0).stop 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 shutdown_connections 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/16206110 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655d8e60 0x55ef655e0280 unknown :-1 s=CLOSED pgs=772 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 >> 172.21.15.102:0/16206110 conn(0x55ef655d5260 msgr2=0x55ef655d3470 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 shutdown_connections 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/16206110 wait complete. 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/1545489724 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c9803cfb0 msgr2=0x7f7c9803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/1545489724 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c9803cfb0 0x7f7c9803f470 secure :-1 s=READY pgs=321 cs=0 l=1 rev1=1 crypto rx=0x55ef655b6180 tx=0x7f7db4005a00 comp rx=0 tx=0).stop 2024-09-19T11:15:40.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/1545489724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655cc7b0 msgr2=0x55ef655ccbd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/1545489724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655cc7b0 0x55ef655ccbd0 secure :-1 s=READY pgs=770 cs=0 l=1 rev1=1 crypto rx=0x7f7db00529f0 tx=0x7f7db0042380 comp rx=0 tx=0).stop 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/1545489724 shutdown_connections 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/1545489724 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7c9803cfb0 0x7f7c9803f470 unknown :-1 s=CLOSED pgs=321 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/1545489724 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef655cc7b0 0x55ef655ccbd0 unknown :-1 s=CLOSED pgs=770 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.060+0000 7f7dc3a11800 1 -- 172.21.15.102:0/1545489724 >> 172.21.15.102:0/1545489724 conn(0x55ef655c0b60 msgr2=0x55ef655c0f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/1545489724 shutdown_connections 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/1545489724 wait complete. 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655b8000 msgr2=0x55ef655ba3f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55ef655b8000 0x55ef655ba3f0 crc :-1 s=READY pgs=177 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655afe00 msgr2=0x55ef655b5730 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55ef655afe00 0x55ef655b5730 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655bbf00 msgr2=0x55ef655be2f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.065 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55ef655bbf00 0x55ef655be2f0 crc :-1 s=READY pgs=178 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ca403d000 msgr2=0x7f7ca403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ca403d000 0x7f7ca403f4c0 secure :-1 s=READY pgs=320 cs=0 l=1 rev1=1 crypto rx=0x55ef65427770 tx=0x7f7db4050000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 msgr2=0x55ef655ae0e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 --2- 172.21.15.102:0/4114328846 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55ef654b4840 0x55ef655ae0e0 secure :-1 s=READY pgs=769 cs=0 l=1 rev1=1 crypto rx=0x55ef655a7330 tx=0x7f7db00040e0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dbf949640 1 -- 172.21.15.102:0/4114328846 reap_dead start 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 shutdown_connections 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 >> 172.21.15.102:0/4114328846 conn(0x55ef654aea50 msgr2=0x55ef655a7910 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 shutdown_connections 2024-09-19T11:15:40.066 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.061+0000 7f7dc3a11800 1 -- 172.21.15.102:0/4114328846 wait complete. 2024-09-19T11:15:40.070 ERROR:root:None 2024-09-19T11:15:40.071 ERROR:root:0 2024-09-19T11:15:40.071 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-19T11:15:40.071 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'create', '--uid', 'a_user', '--display-name', 'True Admin User', '--access-key', 'true_admin_akey', '--secret', 'true_admin_skey', '--caps', 'user-info-without-keys=read', '--admin'] 2024-09-19T11:15:40.071 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user create --uid a_user --display-name 'True Admin User' --access-key true_admin_akey --secret true_admin_skey --caps user-info-without-keys=read --admin 2024-09-19T11:15:40.124 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:40.124 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:40.125 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.124+0000 7f4e02b37800 1 Processor -- start 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.124+0000 7f4e02b37800 1 -- start start 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.124+0000 7f4e02b37800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5598e4b76ef0 0x5598e4b792e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.124+0000 7f4e02b37800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5598e4b7d630 con 0x5598e4b79910 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.124+0000 7f4e02b37800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5598e4a017d0 con 0x5598e4b76ef0 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.124+0000 7f4dfe87d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5598e4b76ef0 0x5598e4b792e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.124+0000 7f4dfe07c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5598e4b79910 0x5598e4b7bdd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34758/0 (socket says 172.21.15.102:34758) 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.124+0000 7f4dfe07c640 1 -- 172.21.15.102:0/3630959330 learned_addr learned my addr 172.21.15.102:0/3630959330 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.125+0000 7f4dfe87d640 1 -- 172.21.15.102:0/3630959330 >> v1:172.21.15.37:6789/0 conn(0x5598e4b79910 legacy=0x5598e4b7bdd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.125+0000 7f4dfe87d640 1 -- 172.21.15.102:0/3630959330 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e4b7e860 con 0x5598e4b76ef0 2024-09-19T11:15:40.126 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.125+0000 7f4dfd87b640 1 -- 172.21.15.102:0/3630959330 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3287328713 0 0) 0x5598e4b7d630 con 0x5598e4b79910 2024-09-19T11:15:40.127 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.126+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/3630959330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b792e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4df000a470 tx=0x7f4df0045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5592defe64920f71 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.126+0000 7f4dfd87b640 1 -- 172.21.15.102:0/3630959330 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df0053570 con 0x5598e4b76ef0 2024-09-19T11:15:40.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4dfd87b640 1 -- 172.21.15.102:0/3630959330 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0058070 con 0x5598e4b76ef0 2024-09-19T11:15:40.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4dfd87b640 1 -- 172.21.15.102:0/3630959330 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df0053880 con 0x5598e4b76ef0 2024-09-19T11:15:40.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4e02b37800 1 -- 172.21.15.102:0/3630959330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 msgr2=0x5598e4b792e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.128 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4e02b37800 1 --2- 172.21.15.102:0/3630959330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b792e0 secure :-1 s=READY pgs=774 cs=0 l=1 rev1=1 crypto rx=0x7f4df000a470 tx=0x7f4df0045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:40.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4e02b37800 1 -- 172.21.15.102:0/3630959330 shutdown_connections 2024-09-19T11:15:40.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4e02b37800 1 --2- 172.21.15.102:0/3630959330 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b792e0 unknown :-1 s=CLOSED pgs=774 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4e02b37800 1 -- 172.21.15.102:0/3630959330 >> 172.21.15.102:0/3630959330 conn(0x5598e4b70ab0 msgr2=0x5598e4b72f10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4e02b37800 1 -- 172.21.15.102:0/3630959330 shutdown_connections 2024-09-19T11:15:40.129 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.127+0000 7f4e02b37800 1 -- 172.21.15.102:0/3630959330 wait complete. 2024-09-19T11:15:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.141+0000 7f4e02b37800 1 Processor -- start 2024-09-19T11:15:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.141+0000 7f4e02b37800 1 -- start start 2024-09-19T11:15:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.141+0000 7f4e02b37800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b76660 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.141+0000 7f4e02b37800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598e4a0edd0 con 0x5598e4b76ef0 2024-09-19T11:15:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.141+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b76660 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.141+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b76660 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39588/0 (socket says 172.21.15.102:39588) 2024-09-19T11:15:40.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.141+0000 7f4dfe87d640 1 -- 172.21.15.102:0/4102770374 learned_addr learned my addr 172.21.15.102:0/4102770374 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.141+0000 7f4dfe87d640 1 -- 172.21.15.102:0/4102770374 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e4b76c50 con 0x5598e4b76ef0 2024-09-19T11:15:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.142+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/4102770374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b76660 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4df0005870 tx=0x7f4df0051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c7645b4bfdbda4fc server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.142+0000 7f4cece09640 1 -- 172.21.15.102:0/4102770374 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df005c580 con 0x5598e4b76ef0 2024-09-19T11:15:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.142+0000 7f4cece09640 1 -- 172.21.15.102:0/4102770374 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0063030 con 0x5598e4b76ef0 2024-09-19T11:15:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.142+0000 7f4cece09640 1 -- 172.21.15.102:0/4102770374 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df005c850 con 0x5598e4b76ef0 2024-09-19T11:15:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.142+0000 7f4e02b37800 1 -- 172.21.15.102:0/4102770374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 msgr2=0x5598e4b76660 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.145 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 --2- 172.21.15.102:0/4102770374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b76660 secure :-1 s=READY pgs=775 cs=0 l=1 rev1=1 crypto rx=0x7f4df0005870 tx=0x7f4df0051000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 -- 172.21.15.102:0/4102770374 shutdown_connections 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 --2- 172.21.15.102:0/4102770374 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4b76660 unknown :-1 s=CLOSED pgs=775 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 -- 172.21.15.102:0/4102770374 >> 172.21.15.102:0/4102770374 conn(0x5598e4b70ab0 msgr2=0x5598e4c61bb0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 -- 172.21.15.102:0/4102770374 shutdown_connections 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 -- 172.21.15.102:0/4102770374 wait complete. 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 Processor -- start 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 -- start start 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4c6fe60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4e02b37800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598e4b7db00 con 0x5598e4b76ef0 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4c6fe60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4c6fe60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39602/0 (socket says 172.21.15.102:39602) 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.143+0000 7f4dfe87d640 1 -- 172.21.15.102:0/2253289578 learned_addr learned my addr 172.21.15.102:0/2253289578 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.146 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.144+0000 7f4dfe87d640 1 -- 172.21.15.102:0/2253289578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e4c703c0 con 0x5598e4b76ef0 2024-09-19T11:15:40.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.144+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4c6fe60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4df0045f50 tx=0x7f4df0002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.144+0000 7f4ceb606640 1 -- 172.21.15.102:0/2253289578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df0078070 con 0x5598e4b76ef0 2024-09-19T11:15:40.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.144+0000 7f4ceb606640 1 -- 172.21.15.102:0/2253289578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0054a70 con 0x5598e4b76ef0 2024-09-19T11:15:40.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.144+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598e4c70650 con 0x5598e4b76ef0 2024-09-19T11:15:40.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.144+0000 7f4ceb606640 1 -- 172.21.15.102:0/2253289578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df0054d50 con 0x5598e4b76ef0 2024-09-19T11:15:40.147 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.144+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e4c71260 con 0x5598e4b76ef0 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.145+0000 7f4ceb606640 1 -- 172.21.15.102:0/2253289578 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4df007b070 con 0x5598e4b76ef0 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.145+0000 7f4ceb606640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ce403d000 0x7f4ce403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.145+0000 7f4ceb606640 1 -- 172.21.15.102:0/2253289578 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4df0070070 con 0x5598e4b76ef0 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.145+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ce403d000 0x7f4ce403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.145+0000 7f4e02b37800 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4b79910 0x5598e4c774b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.145+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4c779f0 con 0x5598e4b79910 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.145+0000 7f4dff07e640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4b79910 0x5598e4c774b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.145+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ce403d000 0x7f4ce403f4c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4df4000c00 tx=0x7f4df40013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.146+0000 7f4dff07e640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4b79910 0x5598e4c774b0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.146+0000 7f4dff07e640 1 -- 172.21.15.102:0/2253289578 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4b79910 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.146+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4c77d90 con 0x5598e4b79910 2024-09-19T11:15:40.151 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.146+0000 7f4dff07e640 1 -- 172.21.15.102:0/2253289578 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4b79910 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.146+0000 7f4e02b37800 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4c79890 0x5598e4c7bd10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.146+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4c7c4a0 con 0x5598e4c79890 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.147+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4c79890 0x5598e4c7bd10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.147+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4c79890 0x5598e4c7bd10 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.147+0000 7f4dfe87d640 1 -- 172.21.15.102:0/2253289578 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f4df007a030 con 0x5598e4c79890 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.147+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4c785e0 con 0x5598e4b79910 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.147+0000 7f4dff07e640 1 -- 172.21.15.102:0/2253289578 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4b79910 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.147+0000 7f4e02b37800 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4c7d900 0x5598e4c7fcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.147+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4c80460 con 0x5598e4c7d900 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.148+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4c7d900 0x5598e4c7fcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.148+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4c7d900 0x5598e4c7fcf0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.152 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.148+0000 7f4dfe07c640 1 -- 172.21.15.102:0/2253289578 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f4df400f670 con 0x5598e4c7d900 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.148+0000 7f4e02b37800 1 Processor -- start 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.148+0000 7f4e02b37800 1 -- start start 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4e02b37800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c8e1a0 0x5598e4c8e5c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4e02b37800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598e4a6d4a0 con 0x5598e4c8e1a0 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c8e1a0 0x5598e4c8e5c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c8e1a0 0x5598e4c8e5c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39614/0 (socket says 172.21.15.102:39614) 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4dfe87d640 1 -- 172.21.15.102:0/535411959 learned_addr learned my addr 172.21.15.102:0/535411959 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4dfe87d640 1 -- 172.21.15.102:0/535411959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e4c8ec00 con 0x5598e4c8e1a0 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/535411959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c8e1a0 0x5598e4c8e5c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4df007c8d0 tx=0x7f4df0098170 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4ce8e01640 1 -- 172.21.15.102:0/535411959 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df007ce40 con 0x5598e4c8e1a0 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4ce8e01640 1 -- 172.21.15.102:0/535411959 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df0009b40 con 0x5598e4c8e1a0 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4e02b37800 1 -- 172.21.15.102:0/535411959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598e4c8f430 con 0x5598e4c8e1a0 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4ce8e01640 1 -- 172.21.15.102:0/535411959 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df0009e40 con 0x5598e4c8e1a0 2024-09-19T11:15:40.153 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.149+0000 7f4e02b37800 1 -- 172.21.15.102:0/535411959 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e4c8f9d0 con 0x5598e4c8e1a0 2024-09-19T11:15:40.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.150+0000 7f4ce8e01640 1 -- 172.21.15.102:0/535411959 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4df0096ab0 con 0x5598e4c8e1a0 2024-09-19T11:15:40.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.150+0000 7f4ce8e01640 1 --2- 172.21.15.102:0/535411959 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cd803cfb0 0x7f4cd803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.150+0000 7f4ce8e01640 1 -- 172.21.15.102:0/535411959 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4df0088070 con 0x5598e4c8e1a0 2024-09-19T11:15:40.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/535411959 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cd803cfb0 0x7f4cd803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4e02b37800 1 Processor -- start 2024-09-19T11:15:40.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4e02b37800 1 -- start start 2024-09-19T11:15:40.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/535411959 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cd803cfb0 0x7f4cd803f470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5598e4c80860 tx=0x7f4df4006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4e02b37800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4c9ae60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4e02b37800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598e4b750a0 con 0x5598e4c9aa80 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4c9ae60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4c9ae60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39626/0 (socket says 172.21.15.102:39626) 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4dfe87d640 1 -- 172.21.15.102:0/592830643 learned_addr learned my addr 172.21.15.102:0/592830643 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.151+0000 7f4dfe87d640 1 -- 172.21.15.102:0/592830643 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e4c9b450 con 0x5598e4c9aa80 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/592830643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4c9ae60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4df009afd0 tx=0x7f4df007dbe0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=be869429f0bb22c3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4ce27fc640 1 -- 172.21.15.102:0/592830643 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df009d070 con 0x5598e4c9aa80 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4ce27fc640 1 -- 172.21.15.102:0/592830643 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df007d810 con 0x5598e4c9aa80 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4ce27fc640 1 -- 172.21.15.102:0/592830643 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df007d440 con 0x5598e4c9aa80 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4e02b37800 1 -- 172.21.15.102:0/592830643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 msgr2=0x5598e4c9ae60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4e02b37800 1 --2- 172.21.15.102:0/592830643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4c9ae60 secure :-1 s=READY pgs=778 cs=0 l=1 rev1=1 crypto rx=0x7f4df009afd0 tx=0x7f4df007dbe0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4e02b37800 1 -- 172.21.15.102:0/592830643 shutdown_connections 2024-09-19T11:15:40.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4e02b37800 1 --2- 172.21.15.102:0/592830643 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4c9ae60 unknown :-1 s=CLOSED pgs=778 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4e02b37800 1 -- 172.21.15.102:0/592830643 >> 172.21.15.102:0/592830643 conn(0x5598e4c96e80 msgr2=0x5598e4c950c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4e02b37800 1 -- 172.21.15.102:0/592830643 shutdown_connections 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4e02b37800 1 -- 172.21.15.102:0/592830643 wait complete. 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.152+0000 7f4e02b37800 1 Processor -- start 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4e02b37800 1 -- start start 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4e02b37800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4ca1ed0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4e02b37800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5598e4c9b8e0 con 0x5598e4c9aa80 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4ca1ed0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4dfe87d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4ca1ed0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39628/0 (socket says 172.21.15.102:39628) 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 learned_addr learned my addr 172.21.15.102:0/977213509 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5598e4ca2430 con 0x5598e4c9aa80 2024-09-19T11:15:40.168 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4ca1ed0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4df0098010 tx=0x7f4df00a0ee0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4ce0ff9640 1 -- 172.21.15.102:0/977213509 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df005d3a0 con 0x5598e4c9aa80 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4ce0ff9640 1 -- 172.21.15.102:0/977213509 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f4df005d540 con 0x5598e4c9aa80 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5598e4ca2430 con 0x5598e4c9aa80 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.154+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5598e4ca2430 con 0x5598e4c9aa80 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.153+0000 7f4ce0ff9640 1 -- 172.21.15.102:0/977213509 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4df005d820 con 0x5598e4c9aa80 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.154+0000 7f4ce0ff9640 1 -- 172.21.15.102:0/977213509 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f4df00bd030 con 0x5598e4c9aa80 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.155+0000 7f4ce0ff9640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cc803d0b0 0x7f4cc803f570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.155+0000 7f4ce0ff9640 1 -- 172.21.15.102:0/977213509 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f4df00bb070 con 0x5598e4c9aa80 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.155+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cc803d0b0 0x7f4cc803f570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.155+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cc803d0b0 0x7f4cc803f570 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4df400ffd0 tx=0x7f4df4023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.155+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.169 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.155+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4cad470 0x5598e4caf930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.155+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb0080 con 0x5598e4cad470 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.155+0000 7f4dff07e640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4cad470 0x5598e4caf930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4dff07e640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4cad470 0x5598e4caf930 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 20 realm 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb0490 con 0x5598e4cad470 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.170 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb0d60 con 0x5598e4cad470 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.156+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4e02b37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4cb1e60 0x5598e4cb4250 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb4810 con 0x5598e4cb1e60 2024-09-19T11:15:40.171 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4cb1e60 0x5598e4cb4250 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4dfe87d640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4cb1e60 0x5598e4cb4250 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4e02b37800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4e02b37800 20 searching for the correct realm 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4cb67c0 0x5598e4cb8c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb9350 con 0x5598e4cb67c0 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.157+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4cb67c0 0x5598e4cb8c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.158+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4cb67c0 0x5598e4cb8c80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.158+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df4037040 con 0x5598e4cb67c0 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.158+0000 7f4dfe07c640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4df402e910 0x7f4df403a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.158+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb9350 con 0x7f4df402e910 2024-09-19T11:15:40.172 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.158+0000 7f4dff07e640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4df402e910 0x7f4df403a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.158+0000 7f4dff07e640 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4df402e910 0x7f4df403a3c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.159+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.159+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb1e60 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.159+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.159+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.159+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.159+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.159+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.159+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb1e60 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb1e60 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.173 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x7f4df402e910 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb67c0 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df4037040 con 0x5598e4cb67c0 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.160+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb1e60 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.161+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.161+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.161+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.161+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x7f4df402e910 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.161+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.174 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.161+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb67c0 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.161+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df4037040 con 0x5598e4cb67c0 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.161+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb67c0 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.162+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f4df4037040 con 0x5598e4cb67c0 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.162+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb1e60 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.162+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.162+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb67c0 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.162+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df4037040 con 0x5598e4cb67c0 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.162+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb67c0 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.162+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df4037040 con 0x5598e4cb67c0 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.162+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.163+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.163+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.175 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.163+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.163+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb1e60 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.163+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.163+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb67c0 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.163+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df4037040 con 0x5598e4cb67c0 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.163+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x7f4df402e910 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.164+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.164+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.164+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.164+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb1e60 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.164+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.176 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.164+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb67c0 2024-09-19T11:15:40.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.164+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df4037040 con 0x5598e4cb67c0 2024-09-19T11:15:40.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.164+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb1e60 2024-09-19T11:15:40.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.165+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.165+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x7f4df402e910 2024-09-19T11:15:40.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.165+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.165+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cb67c0 2024-09-19T11:15:40.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.165+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.177 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.165+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x7f4df402e910 2024-09-19T11:15:40.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.165+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.165+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x5598e4cad470 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb1100 con 0x7f4df402e910 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb50d0 con 0x5598e4cad470 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb50d0 con 0x5598e4cad470 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.166+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb50d0 con 0x5598e4cb67c0 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 20 zone default found 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 4 Realm: () 2024-09-19T11:15:40.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 20 zonegroup default 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cb5a70 con 0x5598e4cb1e60 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbb350 con 0x5598e4cb67c0 2024-09-19T11:15:40.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.167+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbb840 con 0x5598e4cb67c0 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.168+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.168+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.168+0000 7f4e02b37800 20 started sync module instance, tier type = 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.168+0000 7f4e02b37800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.168+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cba660 con 0x7f4df402e910 2024-09-19T11:15:40.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.169+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.169+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94115161942880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cba660 con 0x7f4df402e910 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.169+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbc320 con 0x5598e4cad470 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.170+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94115161942880] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.170+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.170+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94115161940400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbc320 con 0x5598e4cad470 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.170+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbce20 con 0x5598e4cb67c0 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.171+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.171+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94115161950480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbd6c0 con 0x5598e4cb67c0 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.171+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbe140 con 0x7f4df402e910 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.171+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94115161940400] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.172+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94115161950480] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.172+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.172+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94115161952784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbbe70 con 0x7f4df402e910 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.172+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbea10 con 0x5598e4cad470 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.173+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.173+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94115161957648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbe930 con 0x5598e4cad470 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.173+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94115161952784] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.173+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbdc50 con 0x5598e4cb1e60 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.175+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.175+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94115161961504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cbfcf0 con 0x5598e4cb1e60 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.175+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cc06f0 con 0x5598e4cb1e60 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.175+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94115161957648] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.175+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94115161961504] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.176+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.176+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94115161962560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cc02a0 con 0x5598e4cb1e60 2024-09-19T11:15:40.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.176+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cc0f70 con 0x5598e4cb1e60 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.176+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94115161962560] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'252 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94115161967168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cc0f30 con 0x5598e4cb1e60 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4e02b37800 20 add_watcher() i=0 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4e02b37800 20 add_watcher() i=1 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4e02b37800 20 add_watcher() i=2 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4e02b37800 20 add_watcher() i=3 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4e02b37800 20 add_watcher() i=4 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4e02b37800 20 add_watcher() i=5 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.177+0000 7f4e02b37800 20 add_watcher() i=6 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.178+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94115161967168] v37'253 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.178+0000 7f4e02b37800 20 add_watcher() i=7 2024-09-19T11:15:40.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.178+0000 7f4e02b37800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.178+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cc4420 con 0x5598e4cad470 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.178+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.178+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94115161959856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cc1910 con 0x5598e4cad470 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.179+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94115161959856] v37'250 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.179+0000 7f4cb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.179+0000 7f4e02b37800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.179+0000 7f4e02b37800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.179+0000 7f4e02b37800 5 note: GC not initialized 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4c2ffff640 20 reqs_thread_entry: start 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 20 Filter name: none 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4c2dffb640 20 reqs_thread_entry: start 2024-09-19T11:15:40.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:62 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf72b0 con 0x5598e4cb67c0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(62 a_user [call,read 0~0,getxattrs] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 234+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : miss 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:63 8.15 8:afe09604:users.keys::true_admin_akey:head [stat,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5e20 con 0x5598e4cb67c0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.180+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(63 true_admin_akey [stat,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 201+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.181+0000 7f4e02b37800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.181+0000 7f4e02b37800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x0 2024-09-19T11:15:40.197 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.181+0000 7f4e02b37800 10 adding default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.181+0000 7f4e02b37800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.181+0000 7f4e02b37800 10 cache get: name=default.rgw.meta+users.keys+true_admin_akey : hit (negative entry) 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.181+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 8.14 8:2efb937b:users.uid::a_user:head [delete,create,call version.set in=58b,writefull 0~363 in=363b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5e20 con 0x5598e4cb67c0 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(64 a_user [delete,create,call,writefull 0~363] v37'3 uv3 ondisk = 0) ==== 276+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4e02b37800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4e02b37800 10 moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4e02b37800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 0, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:65 7.15 7:a93a5511:::notify.2:head [notify cookie 94115162183984 in=554b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cfadc0 con 0x5598e4cb67c0 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== watch-notify(notify (1) cookie 94115161950480 notify 158913789961 ret 0) ==== 584+0+0 (crc 0 0 0) 0x5598e4cfa740 con 0x5598e4cb67c0 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4ce27fc640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789961 cookie 94115161950480 notifier 4869 bl.length()=542 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4ce27fc640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x17 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4ce27fc640 10 rgw watcher librados: moving default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(65 notify.2 [notify cookie 94115162183984 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.198 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4ce27fc640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:66 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4cc4003ea0 con 0x5598e4cb67c0 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(66 notify.2 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== watch-notify(notify_complete (2) cookie 94115162183984 notify 158913789961 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598e4cf63e0 con 0x5598e4cb67c0 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.182+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 8.15 8:afe09604:users.keys::true_admin_akey:head [delete,create,writefull 0~10 in=10b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cfadc0 con 0x5598e4cb67c0 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.183+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(67 true_admin_akey [delete,create,writefull 0~10] v37'3 uv3 ondisk = 0) ==== 243+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.183+0000 7f4e02b37800 10 cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.183+0000 7f4e02b37800 10 moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.183+0000 7f4e02b37800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 0, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.183+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:68 7.3 7:c609908c:::notify.5:head [notify cookie 94115162204432 in=187b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cfad30 con 0x5598e4cb1e60 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.184+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== watch-notify(notify (1) cookie 94115161961504 notify 158913789998 ret 0) ==== 217+0+0 (crc 0 0 0) 0x5598e4c8f430 con 0x5598e4cb1e60 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.184+0000 7f4ce1ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789998 cookie 94115161961504 notifier 4869 bl.length()=175 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.184+0000 7f4ce1ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.keys+true_admin_akey info.flags=0x7 2024-09-19T11:15:40.199 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.184+0000 7f4ce1ffb640 10 rgw watcher librados: moving default.rgw.meta+users.keys+true_admin_akey to cache LRU end 2024-09-19T11:15:40.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.184+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(68 notify.5 [notify cookie 94115162204432 out=8b] v0'0 uv252 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.184+0000 7f4ce1ffb640 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f4c34003400 con 0x5598e4cb1e60 2024-09-19T11:15:40.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.184+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(69 notify.5 [notify-ack] v0'0 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.200 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.184+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== watch-notify(notify_complete (2) cookie 94115162204432 notify 158913789998 ret 0) ==== 42+0+48 (crc 0 0 0) 0x5598e4c8ec00 con 0x5598e4cb1e60 2024-09-19T11:15:40.200 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"a_user","display_name":"True Admin User","email":"","suspended":0,"max_buckets":1000,"subusers":[],"keys":[{"user":"a_user","access_key":"true_admin_akey","secret_key":"true_admin_skey","active":true,"create_date":"2024-09-19T11:15:40.181849Z"}],"swift_keys":[],"caps":[{"type":"user-info-without-keys","perm":"read"}],"op_mask":"read, write, delete","admin":true,"default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:40.181838Z","tags":[],"group_ids":[]} 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.185+0000 7f4cb57e2640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.185+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:70 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94115161959856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x5598e4cad470 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.186+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(70 data_loggenerations_metadata [watch unwatch cookie 94115161959856] v37'251 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.186+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:71 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94115161942880] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x7f4df402e910 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.187+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(71 notify.0 [watch unwatch cookie 94115161942880] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.187+0000 7f4e02b37800 20 remove_watcher() i=0 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.187+0000 7f4e02b37800 2 removed watcher, disabling cache 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.187+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:72 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94115161940400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x5598e4cad470 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.188+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(72 notify.1 [watch unwatch cookie 94115161940400] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.188+0000 7f4e02b37800 20 remove_watcher() i=1 2024-09-19T11:15:40.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.188+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:73 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94115161950480] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x5598e4cb67c0 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.189+0000 7f4dfe07c640 1 -- 172.21.15.102:0/977213509 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(73 notify.2 [watch unwatch cookie 94115161950480] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df4049040 con 0x5598e4cb67c0 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.189+0000 7f4e02b37800 20 remove_watcher() i=2 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.189+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94115161952784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x7f4df402e910 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.190+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(74 notify.3 [watch unwatch cookie 94115161952784] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x7f4df402e910 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.190+0000 7f4e02b37800 20 remove_watcher() i=3 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.190+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:75 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94115161957648] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x5598e4cad470 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.191+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(75 notify.4 [watch unwatch cookie 94115161957648] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df800a4d0 con 0x5598e4cad470 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.191+0000 7f4e02b37800 20 remove_watcher() i=4 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.191+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:76 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94115161961504] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x5598e4cb1e60 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.192+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(76 notify.5 [watch unwatch cookie 94115161961504] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.192+0000 7f4e02b37800 20 remove_watcher() i=5 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.192+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:77 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94115161962560] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x5598e4cb1e60 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.193+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(77 notify.6 [watch unwatch cookie 94115161962560] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.193+0000 7f4e02b37800 20 remove_watcher() i=6 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.193+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:78 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94115161967168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5598e4cf5120 con 0x5598e4cb1e60 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4dfe87d640 1 -- 172.21.15.102:0/977213509 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(78 notify.7 [watch unwatch cookie 94115161967168] v37'254 uv252 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f4df009f070 con 0x5598e4cb1e60 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 20 remove_watcher() i=7 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4cb1e60 msgr2=0x5598e4cb4250 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4cb1e60 0x5598e4cb4250 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4cad470 msgr2=0x5598e4caf930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4cad470 0x5598e4caf930 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4df402e910 msgr2=0x7f4df403a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f4df402e910 0x7f4df403a3c0 crc :-1 s=READY pgs=95 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4cb67c0 msgr2=0x5598e4cb8c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4cb67c0 0x5598e4cb8c80 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cc803d0b0 msgr2=0x7f4cc803f570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.208 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cc803d0b0 0x7f4cc803f570 secure :-1 s=READY pgs=325 cs=0 l=1 rev1=1 crypto rx=0x7f4df400ffd0 tx=0x7f4df4023040 comp rx=0 tx=0).stop 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 msgr2=0x5598e4ca1ed0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4ca1ed0 secure :-1 s=READY pgs=779 cs=0 l=1 rev1=1 crypto rx=0x7f4df0098010 tx=0x7f4df00a0ee0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4dff07e640 1 -- 172.21.15.102:0/977213509 reap_dead start 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 shutdown_connections 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/977213509 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c9aa80 0x5598e4ca1ed0 unknown :-1 s=CLOSED pgs=779 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 >> 172.21.15.102:0/977213509 conn(0x5598e4c96e80 msgr2=0x5598e4c95090 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 shutdown_connections 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/977213509 wait complete. 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/535411959 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cd803cfb0 msgr2=0x7f4cd803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/535411959 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cd803cfb0 0x7f4cd803f470 secure :-1 s=READY pgs=324 cs=0 l=1 rev1=1 crypto rx=0x5598e4c80860 tx=0x7f4df4006000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/535411959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c8e1a0 msgr2=0x5598e4c8e5c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/535411959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c8e1a0 0x5598e4c8e5c0 secure :-1 s=READY pgs=777 cs=0 l=1 rev1=1 crypto rx=0x7f4df007c8d0 tx=0x7f4df0098170 comp rx=0 tx=0).stop 2024-09-19T11:15:40.209 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/535411959 shutdown_connections 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/535411959 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4cd803cfb0 0x7f4cd803f470 unknown :-1 s=CLOSED pgs=324 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 --2- 172.21.15.102:0/535411959 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4c8e1a0 0x5598e4c8e5c0 unknown :-1 s=CLOSED pgs=777 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/535411959 >> 172.21.15.102:0/535411959 conn(0x5598e4c82550 msgr2=0x5598e4c82930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/535411959 shutdown_connections 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.195+0000 7f4e02b37800 1 -- 172.21.15.102:0/535411959 wait complete. 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4c79890 msgr2=0x5598e4c7bd10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5598e4c79890 0x5598e4c7bd10 crc :-1 s=READY pgs=179 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4b79910 msgr2=0x5598e4c774b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5598e4b79910 0x5598e4c774b0 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4c7d900 msgr2=0x5598e4c7fcf0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5598e4c7d900 0x5598e4c7fcf0 crc :-1 s=READY pgs=180 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ce403d000 msgr2=0x7f4ce403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.210 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f4ce403d000 0x7f4ce403f4c0 secure :-1 s=READY pgs=323 cs=0 l=1 rev1=1 crypto rx=0x7f4df4000c00 tx=0x7f4df40013b0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 msgr2=0x5598e4c6fe60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 --2- 172.21.15.102:0/2253289578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5598e4b76ef0 0x5598e4c6fe60 secure :-1 s=READY pgs=776 cs=0 l=1 rev1=1 crypto rx=0x7f4df0045f50 tx=0x7f4df0002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4dff07e640 1 -- 172.21.15.102:0/2253289578 reap_dead start 2024-09-19T11:15:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 shutdown_connections 2024-09-19T11:15:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 >> 172.21.15.102:0/2253289578 conn(0x5598e4b70ab0 msgr2=0x5598e4c61700 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 shutdown_connections 2024-09-19T11:15:40.211 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.196+0000 7f4e02b37800 1 -- 172.21.15.102:0/2253289578 wait complete. 2024-09-19T11:15:40.211 DEBUG:tasks.util.rgw: json result: {'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-19T11:15:40.181849Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:40.181838Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.211 ERROR:root:{'user_id': 'a_user', 'display_name': 'True Admin User', 'email': '', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'a_user', 'access_key': 'true_admin_akey', 'secret_key': 'true_admin_skey', 'active': True, 'create_date': '2024-09-19T11:15:40.181849Z'}], 'swift_keys': [], 'caps': [{'type': 'user-info-without-keys', 'perm': 'read'}], 'op_mask': 'read, write, delete', 'admin': True, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:40.181838Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.212 ERROR:root:0 2024-09-19T11:15:40.212 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:40.225 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:40.225 INFO:tasks.util.rgw:rgwadmin: client.0 : ['user', 'rm', '--uid', 'a_user'] 2024-09-19T11:15:40.225 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'user', 'rm', '--uid', 'a_user'] 2024-09-19T11:15:40.225 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph user rm --uid a_user 2024-09-19T11:15:40.269 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:40.270 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:40.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.269+0000 7f38a551f800 1 Processor -- start 2024-09-19T11:15:40.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.269+0000 7f38a551f800 1 -- start start 2024-09-19T11:15:40.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.269+0000 7f38a551f800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564eb3a2c690 0x564eb3a2d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.269+0000 7f38a551f800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564eb3a2cd40 con 0x564eb3a2d8d0 2024-09-19T11:15:40.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.269+0000 7f38a551f800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x564eb38b87d0 con 0x564eb3a2c690 2024-09-19T11:15:40.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.270+0000 7f38a12a2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564eb3a2c690 0x564eb3a2d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.271 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.270+0000 7f38a0aa1640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x564eb3a2d8d0 0x564eb3a32630 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34774/0 (socket says 172.21.15.102:34774) 2024-09-19T11:15:40.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.270+0000 7f38a0aa1640 1 -- 172.21.15.102:0/484174073 learned_addr learned my addr 172.21.15.102:0/484174073 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:40.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.270+0000 7f3893fff640 1 -- 172.21.15.102:0/484174073 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1109385686 0 0) 0x564eb3a2cd40 con 0x564eb3a2d8d0 2024-09-19T11:15:40.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.270+0000 7f3893fff640 1 -- 172.21.15.102:0/484174073 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f388c001e10 con 0x564eb3a2d8d0 2024-09-19T11:15:40.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.270+0000 7f38a12a2640 1 -- 172.21.15.102:0/484174073 >> v1:172.21.15.37:6789/0 conn(0x564eb3a2d8d0 legacy=0x564eb3a32630 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.272 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.270+0000 7f38a12a2640 1 -- 172.21.15.102:0/484174073 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb3a2dd80 con 0x564eb3a2c690 2024-09-19T11:15:40.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.272+0000 7f38a12a2640 1 --2- 172.21.15.102:0/484174073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb3a2d390 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f389400a470 tx=0x7f3894045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=bae66babefb6f09f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.272+0000 7f3893fff640 1 -- 172.21.15.102:0/484174073 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894059070 con 0x564eb3a2c690 2024-09-19T11:15:40.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.272+0000 7f3893fff640 1 -- 172.21.15.102:0/484174073 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894054570 con 0x564eb3a2c690 2024-09-19T11:15:40.273 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.272+0000 7f3893fff640 1 -- 172.21.15.102:0/484174073 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894054870 con 0x564eb3a2c690 2024-09-19T11:15:40.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.273+0000 7f38a551f800 1 -- 172.21.15.102:0/484174073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 msgr2=0x564eb3a2d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.273+0000 7f38a551f800 1 --2- 172.21.15.102:0/484174073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb3a2d390 secure :-1 s=READY pgs=781 cs=0 l=1 rev1=1 crypto rx=0x7f389400a470 tx=0x7f3894045920 comp rx=0 tx=0).stop 2024-09-19T11:15:40.274 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.273+0000 7f38a551f800 1 -- 172.21.15.102:0/484174073 shutdown_connections 2024-09-19T11:15:40.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.273+0000 7f38a551f800 1 --2- 172.21.15.102:0/484174073 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb3a2d390 unknown :-1 s=CLOSED pgs=781 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.273+0000 7f38a551f800 1 -- 172.21.15.102:0/484174073 >> 172.21.15.102:0/484174073 conn(0x564eb3a27a60 msgr2=0x564eb3a29ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.273+0000 7f38a551f800 1 -- 172.21.15.102:0/484174073 shutdown_connections 2024-09-19T11:15:40.275 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.273+0000 7f38a551f800 1 -- 172.21.15.102:0/484174073 wait complete. 2024-09-19T11:15:40.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.286+0000 7f38a551f800 1 Processor -- start 2024-09-19T11:15:40.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.286+0000 7f38a551f800 1 -- start start 2024-09-19T11:15:40.287 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.286+0000 7f38a551f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb39a0860 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.286+0000 7f38a551f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564eb38c5dd0 con 0x564eb3a2c690 2024-09-19T11:15:40.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.287+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb39a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.287+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb39a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39646/0 (socket says 172.21.15.102:39646) 2024-09-19T11:15:40.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.287+0000 7f38a12a2640 1 -- 172.21.15.102:0/1919881758 learned_addr learned my addr 172.21.15.102:0/1919881758 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.287+0000 7f38a12a2640 1 -- 172.21.15.102:0/1919881758 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb3b1fd80 con 0x564eb3a2c690 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.287+0000 7f38a12a2640 1 --2- 172.21.15.102:0/1919881758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb39a0860 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3894000c00 tx=0x7f389404e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aac46b4adfb12109 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.287+0000 7f378f606640 1 -- 172.21.15.102:0/1919881758 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894062070 con 0x564eb3a2c690 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.287+0000 7f378f606640 1 -- 172.21.15.102:0/1919881758 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389400a230 con 0x564eb3a2c690 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.287+0000 7f378f606640 1 -- 172.21.15.102:0/1919881758 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894059040 con 0x564eb3a2c690 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 -- 172.21.15.102:0/1919881758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 msgr2=0x564eb39a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 --2- 172.21.15.102:0/1919881758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb39a0860 secure :-1 s=READY pgs=782 cs=0 l=1 rev1=1 crypto rx=0x7f3894000c00 tx=0x7f389404e000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 -- 172.21.15.102:0/1919881758 shutdown_connections 2024-09-19T11:15:40.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 --2- 172.21.15.102:0/1919881758 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb39a0860 unknown :-1 s=CLOSED pgs=782 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 -- 172.21.15.102:0/1919881758 >> 172.21.15.102:0/1919881758 conn(0x564eb3a27a60 msgr2=0x564eb3b17a40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 -- 172.21.15.102:0/1919881758 shutdown_connections 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 -- 172.21.15.102:0/1919881758 wait complete. 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 Processor -- start 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 -- start start 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb3b1d470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.288+0000 7f38a551f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564eb3a33d50 con 0x564eb3a2c690 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.289+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb3b1d470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.289+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb3b1d470 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39650/0 (socket says 172.21.15.102:39650) 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.289+0000 7f38a12a2640 1 -- 172.21.15.102:0/1951928410 learned_addr learned my addr 172.21.15.102:0/1951928410 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.289+0000 7f38a12a2640 1 -- 172.21.15.102:0/1951928410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb3b1d9d0 con 0x564eb3a2c690 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.289+0000 7f38a12a2640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb3b1d470 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3894025b20 tx=0x7f3894002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.289+0000 7f378de03640 1 -- 172.21.15.102:0/1951928410 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f389406b070 con 0x564eb3a2c690 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.290+0000 7f378de03640 1 -- 172.21.15.102:0/1951928410 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894054990 con 0x564eb3a2c690 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.290+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eb3b1bd80 con 0x564eb3a2c690 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.290+0000 7f378de03640 1 -- 172.21.15.102:0/1951928410 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894059070 con 0x564eb3a2c690 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.290+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb3b1c340 con 0x564eb3a2c690 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.290+0000 7f378de03640 1 -- 172.21.15.102:0/1951928410 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f389406e070 con 0x564eb3a2c690 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f378de03640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f378803d000 0x7f378803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.296 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f378de03640 1 -- 172.21.15.102:0/1951928410 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f3894097360 con 0x564eb3a2c690 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f378803d000 0x7f378803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f38a551f800 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3a2d8d0 0x564eb3b2e1c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b2e700 con 0x564eb3a2d8d0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f38a1aa3640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3a2d8d0 0x564eb3b2e1c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f378803d000 0x7f378803f4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3898001db0 tx=0x7f3898001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f38a1aa3640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3a2d8d0 0x564eb3b2e1c0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f38a1aa3640 1 -- 172.21.15.102:0/1951928410 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3a2d8d0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.291+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b1c900 con 0x564eb3a2d8d0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.292+0000 7f38a1aa3640 1 -- 172.21.15.102:0/1951928410 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3a2d8d0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.292+0000 7f38a551f800 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b30a10 0x564eb3b32e00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.292+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b334d0 con 0x564eb3b30a10 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.292+0000 7f38a12a2640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b30a10 0x564eb3b32e00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.297 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.292+0000 7f38a12a2640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b30a10 0x564eb3b32e00 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.293+0000 7f38a12a2640 1 -- 172.21.15.102:0/1951928410 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f3894077070 con 0x564eb3b30a10 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.293+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b2f8b0 con 0x564eb3a2d8d0 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.293+0000 7f38a1aa3640 1 -- 172.21.15.102:0/1951928410 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3a2d8d0 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.293+0000 7f38a551f800 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b34910 0x564eb3b36d00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.293+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b37440 con 0x564eb3b34910 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.293+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b34910 0x564eb3b36d00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.293+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b34910 0x564eb3b36d00 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.294+0000 7f38a0aa1640 1 -- 172.21.15.102:0/1951928410 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b34910 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.294+0000 7f38a551f800 1 Processor -- start 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.294+0000 7f38a551f800 1 -- start start 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.294+0000 7f38a551f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b451c0 0x564eb3b455e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.294+0000 7f38a551f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564eb39244a0 con 0x564eb3b451c0 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.294+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b451c0 0x564eb3b455e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.298 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.294+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b451c0 0x564eb3b455e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39654/0 (socket says 172.21.15.102:39654) 2024-09-19T11:15:40.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.294+0000 7f38a12a2640 1 -- 172.21.15.102:0/350655429 learned_addr learned my addr 172.21.15.102:0/350655429 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.295+0000 7f38a12a2640 1 -- 172.21.15.102:0/350655429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb3b45c20 con 0x564eb3b451c0 2024-09-19T11:15:40.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.295+0000 7f38a12a2640 1 --2- 172.21.15.102:0/350655429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b451c0 0x564eb3b455e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3894060040 tx=0x7f389405db30 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.295+0000 7f3786ffd640 1 -- 172.21.15.102:0/350655429 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894067880 con 0x564eb3b451c0 2024-09-19T11:15:40.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.295+0000 7f3786ffd640 1 -- 172.21.15.102:0/350655429 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f389405d370 con 0x564eb3b451c0 2024-09-19T11:15:40.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.295+0000 7f38a551f800 1 -- 172.21.15.102:0/350655429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eb3b46450 con 0x564eb3b451c0 2024-09-19T11:15:40.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.295+0000 7f3786ffd640 1 -- 172.21.15.102:0/350655429 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38940878d0 con 0x564eb3b451c0 2024-09-19T11:15:40.299 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.295+0000 7f38a551f800 1 -- 172.21.15.102:0/350655429 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb3b469f0 con 0x564eb3b451c0 2024-09-19T11:15:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f3786ffd640 1 -- 172.21.15.102:0/350655429 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3894065040 con 0x564eb3b451c0 2024-09-19T11:15:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f3786ffd640 1 --2- 172.21.15.102:0/350655429 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f377803cfb0 0x7f377803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f3786ffd640 1 -- 172.21.15.102:0/350655429 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f389407bd60 con 0x564eb3b451c0 2024-09-19T11:15:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/350655429 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f377803cfb0 0x7f377803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f38a551f800 1 Processor -- start 2024-09-19T11:15:40.314 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f38a551f800 1 -- start start 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/350655429 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f377803cfb0 0x7f377803f470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x564eb3b2eb90 tx=0x7f389800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f38a551f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b51e20 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f38a551f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564eb3b1ff80 con 0x564eb3b51a40 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.296+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b51e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b51e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39668/0 (socket says 172.21.15.102:39668) 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a12a2640 1 -- 172.21.15.102:0/271387342 learned_addr learned my addr 172.21.15.102:0/271387342 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a12a2640 1 -- 172.21.15.102:0/271387342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb3b52410 con 0x564eb3b51a40 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a12a2640 1 --2- 172.21.15.102:0/271387342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b51e20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3894066550 tx=0x7f38940958b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d06eaf25e3a27946 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f3784ff9640 1 -- 172.21.15.102:0/271387342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894070d40 con 0x564eb3b51a40 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f3784ff9640 1 -- 172.21.15.102:0/271387342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3894083800 con 0x564eb3b51a40 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f3784ff9640 1 -- 172.21.15.102:0/271387342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894070450 con 0x564eb3b51a40 2024-09-19T11:15:40.315 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a551f800 1 -- 172.21.15.102:0/271387342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 msgr2=0x564eb3b51e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a551f800 1 --2- 172.21.15.102:0/271387342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b51e20 secure :-1 s=READY pgs=785 cs=0 l=1 rev1=1 crypto rx=0x7f3894066550 tx=0x7f38940958b0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a551f800 1 -- 172.21.15.102:0/271387342 shutdown_connections 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a551f800 1 --2- 172.21.15.102:0/271387342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b51e20 unknown :-1 s=CLOSED pgs=785 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a551f800 1 -- 172.21.15.102:0/271387342 >> 172.21.15.102:0/271387342 conn(0x564eb3b4de40 msgr2=0x564eb3b4c080 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.297+0000 7f38a551f800 1 -- 172.21.15.102:0/271387342 shutdown_connections 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a551f800 1 -- 172.21.15.102:0/271387342 wait complete. 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a551f800 1 Processor -- start 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a551f800 1 -- start start 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a551f800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b58e70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a551f800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564eb3b528a0 con 0x564eb3b51a40 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b58e70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a12a2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b58e70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39682/0 (socket says 172.21.15.102:39682) 2024-09-19T11:15:40.316 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 learned_addr learned my addr 172.21.15.102:0/362268657 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.298+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564eb3b593d0 con 0x564eb3b51a40 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.299+0000 7f38a12a2640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b58e70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3894083d90 tx=0x7f3894063ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.299+0000 7f3776ffd640 1 -- 172.21.15.102:0/362268657 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3894083440 con 0x564eb3b51a40 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.299+0000 7f3776ffd640 1 -- 172.21.15.102:0/362268657 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f38940871f0 con 0x564eb3b51a40 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.299+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564eb3b593d0 con 0x564eb3b51a40 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.299+0000 7f3776ffd640 1 -- 172.21.15.102:0/362268657 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f38940874f0 con 0x564eb3b51a40 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.299+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564eb3b593d0 con 0x564eb3b51a40 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.300+0000 7f3776ffd640 1 -- 172.21.15.102:0/362268657 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f389409f030 con 0x564eb3b51a40 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.300+0000 7f3776ffd640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f376c03d000 0x7f376c03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.300+0000 7f3776ffd640 1 -- 172.21.15.102:0/362268657 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f38940a9070 con 0x564eb3b51a40 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.300+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f376c03d000 0x7f376c03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.317 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.300+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f376c03d000 0x7f376c03f4c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f389800efd0 tx=0x7f3898024000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.300+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.300+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3b64400 0x564eb3b668c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b67010 con 0x564eb3b64400 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a1aa3640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3b64400 0x564eb3b668c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a1aa3640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3b64400 0x564eb3b668c0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 20 realm 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b67420 con 0x564eb3b64400 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.318 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.301+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b67cf0 con 0x564eb3b64400 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a551f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b68df0 0x564eb3b6b1e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b6b7a0 con 0x564eb3b68df0 2024-09-19T11:15:40.319 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a12a2640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b68df0 0x564eb3b6b1e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.302+0000 7f38a12a2640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b68df0 0x564eb3b6b1e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a551f800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a551f800 20 searching for the correct realm 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b6d750 0x564eb3b6fc10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b702e0 con 0x564eb3b6d750 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b6d750 0x564eb3b6fc10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b6d750 0x564eb3b6fc10 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a0aa1640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3898038040 0x7f3898039ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b702e0 con 0x7f3898038040 2024-09-19T11:15:40.320 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.303+0000 7f38a1aa3640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3898038040 0x7f3898039ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.304+0000 7f38a1aa3640 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3898038040 0x7f3898039ab0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.304+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.304+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b68df0 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.304+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.304+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.305+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.305+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.305+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.305+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b68df0 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.305+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.305+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b68df0 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.305+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.321 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.305+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x7f3898038040 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.306+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.306+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b6d750 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.306+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.306+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.306+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.306+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b68df0 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.306+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.306+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.307+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.307+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x7f3898038040 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.307+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.307+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b6d750 2024-09-19T11:15:40.322 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.307+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.307+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b6d750 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.307+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.307+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b68df0 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b6d750 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b6d750 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.308+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b68df0 2024-09-19T11:15:40.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.309+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.309+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b6d750 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.309+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.309+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x7f3898038040 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.309+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.309+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.309+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.309+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b68df0 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.310+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.310+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b6d750 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.310+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.310+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b68df0 2024-09-19T11:15:40.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.310+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.310+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x7f3898038040 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.310+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.310+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b6d750 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x7f3898038040 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x564eb3b64400 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b68090 con 0x7f3898038040 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a551f800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:40.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a551f800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a551f800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a551f800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a551f800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a551f800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b6c060 con 0x564eb3b64400 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.311+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b6c060 con 0x564eb3b64400 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b6c060 con 0x564eb3b6d750 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 zone default found 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 4 Realm: () 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 zonegroup default 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b6c990 con 0x564eb3b68df0 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.312+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b72280 con 0x564eb3b6d750 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b72710 con 0x564eb3b6d750 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a551f800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a551f800 20 started sync module instance, tier type = 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a551f800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:40.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.313+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b715f0 con 0x7f3898038040 2024-09-19T11:15:40.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.314+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.314+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94896022559472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b715f0 con 0x7f3898038040 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.314+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b73260 con 0x564eb3b64400 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.315+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94896022559472] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.315+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.315+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94896022564144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b715f0 con 0x564eb3b64400 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.315+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b73d10 con 0x564eb3b6d750 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.316+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.316+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94896022564144] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.316+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94896022566896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b745b0 con 0x564eb3b6d750 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.316+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b71140 con 0x7f3898038040 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.317+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94896022566896] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.317+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.318+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94896022569216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b74fd0 con 0x7f3898038040 2024-09-19T11:15:40.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.318+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b758a0 con 0x564eb3b64400 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.319+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.319+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94896022569216] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.319+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94896022573008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b753f0 con 0x564eb3b64400 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.319+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b74b40 con 0x564eb3b68df0 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.320+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94896022573008] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.320+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.320+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94896022576272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b767e0 con 0x564eb3b68df0 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.320+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b771a0 con 0x564eb3b68df0 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.321+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94896022576272] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.321+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.321+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94896022577968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b779f0 con 0x564eb3b68df0 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.321+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b78240 con 0x564eb3b68df0 2024-09-19T11:15:40.335 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94896022577968] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'255 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94896022583072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b780d0 con 0x564eb3b68df0 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a551f800 20 add_watcher() i=0 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a551f800 20 add_watcher() i=1 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a551f800 20 add_watcher() i=2 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a551f800 20 add_watcher() i=3 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a551f800 20 add_watcher() i=4 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a551f800 20 add_watcher() i=5 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.322+0000 7f38a551f800 20 add_watcher() i=6 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.323+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94896022583072] v37'256 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.323+0000 7f38a551f800 20 add_watcher() i=7 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.323+0000 7f38a551f800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:40.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.323+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b7b690 con 0x564eb3b64400 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.324+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.324+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94896022584192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b78bb0 con 0x564eb3b64400 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.325+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94896022584192] v37'252 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.325+0000 7f3757fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.325+0000 7f38a551f800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.325+0000 7f38a551f800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.325+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b83ef0 con 0x564eb3b64400 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.326+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.326+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b84580 con 0x564eb3b68df0 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.327+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.327+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b84580 con 0x564eb3b6d750 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.328+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.328+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b85040 con 0x564eb3b64400 2024-09-19T11:15:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.329+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'253 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.329+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b81d60 con 0x7f3898038040 2024-09-19T11:15:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.330+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'80 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.330+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b81d30 con 0x564eb3b6d750 2024-09-19T11:15:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.331+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'54 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.331+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b85d70 con 0x564eb3b64400 2024-09-19T11:15:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.332+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.338 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.332+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b85e00 con 0x564eb3b68df0 2024-09-19T11:15:40.339 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.333+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'56 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.333+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b85e90 con 0x7f3898038040 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.334+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.334+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b85f20 con 0x564eb3b6d750 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.335+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.335+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b864f0 con 0x7f3898038040 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.336+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'81 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.336+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86490 con 0x564eb3b68df0 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.337+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'38 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.337+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86460 con 0x7f3898038040 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.338+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.338+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86460 con 0x564eb3b68df0 2024-09-19T11:15:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.339+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'59 uv40 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.339+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b863d0 con 0x564eb3b64400 2024-09-19T11:15:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.340+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'254 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.340+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b863d0 con 0x564eb3b6d750 2024-09-19T11:15:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.342+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'74 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.343 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.342+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b863d0 con 0x7f3898038040 2024-09-19T11:15:40.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.343+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'82 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.344 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.343+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86420 con 0x564eb3b6d750 2024-09-19T11:15:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.344+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'30 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.344+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b864a0 con 0x564eb3b64400 2024-09-19T11:15:40.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.345+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'38 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.345+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86920 con 0x564eb3b64400 2024-09-19T11:15:40.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.346+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'255 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.346+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86830 con 0x564eb3b6d750 2024-09-19T11:15:40.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.347+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'75 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.347+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b867f0 con 0x7f3898038040 2024-09-19T11:15:40.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.348+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'40 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.348+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b866b0 con 0x564eb3b6d750 2024-09-19T11:15:40.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.349+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'33 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.349+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86690 con 0x564eb3b6d750 2024-09-19T11:15:40.350 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.350+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.350+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86690 con 0x564eb3b6d750 2024-09-19T11:15:40.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.350+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'26 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.351 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.350+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b86690 con 0x564eb3b6d750 2024-09-19T11:15:40.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.351+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'55 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.352 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.351+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b866f0 con 0x564eb3b68df0 2024-09-19T11:15:40.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.353+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'32 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.354 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.353+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b866b0 con 0x564eb3b6d750 2024-09-19T11:15:40.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.354+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'32 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.355 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.354+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b866b0 con 0x564eb3b68df0 2024-09-19T11:15:40.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.355+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'57 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.356 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.355+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b866b0 con 0x564eb3b6d750 2024-09-19T11:15:40.357 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.357+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'76 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.358 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.357+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b866b0 con 0x564eb3b68df0 2024-09-19T11:15:40.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.358+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'60 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.359 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.358+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b866f0 con 0x7f3898038040 2024-09-19T11:15:40.360 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.359+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'36 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.361 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.359+0000 7f3756fe5640 20 reqs_thread_entry: start 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.359+0000 7f38a551f800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.359+0000 7f38a551f800 20 Filter name: none 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f3754fe1640 20 reqs_thread_entry: start 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 10 cache get: name=default.rgw.meta+users.uid+a_user : miss 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:94 8.14 8:2efb937b:users.uid::a_user:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb12d0 con 0x564eb3b6d750 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(94 a_user [call out=48b,read 0~363 out=363b,getxattrs out=75b] v0'0 uv3 ondisk = 0) ==== 234+0+486 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 20 rados_obj.operate() r=0 bl.length=363 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 10 cache put: name=default.rgw.meta+users.uid+a_user info.flags=0x13 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 10 adding default.rgw.meta+users.uid+a_user to cache LRU end 2024-09-19T11:15:40.362 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:95 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [call user.list_buckets in=34b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb3c00 con 0x564eb3b6d750 2024-09-19T11:15:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(95 a_user.buckets [call] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f3898009050 con 0x564eb3b6d750 2024-09-19T11:15:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 10 removing key index: true_admin_akey 2024-09-19T11:15:40.363 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.360+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:96 8.15 8:afe09604:users.keys::true_admin_akey:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb1be0 con 0x564eb3b6d750 2024-09-19T11:15:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.361+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(96 true_admin_akey [delete] v37'4 uv4 ondisk = 0) ==== 159+0+0 (crc 0 0 0) 0x7f389804f040 con 0x564eb3b6d750 2024-09-19T11:15:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.361+0000 7f38a551f800 10 distributing notification oid=default.rgw.control:notify.5 cni=[op: 1, obj: default.rgw.meta:users.keys:true_admin_akey, ofs0, ns] 2024-09-19T11:15:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.361+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:97 7.3 7:c609908c:::notify.5:head [notify cookie 94896022824688 in=177b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb4230 con 0x564eb3b68df0 2024-09-19T11:15:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== watch-notify(notify (1) cookie 94896022576272 notify 158913789999 ret 0) ==== 207+0+0 (crc 0 0 0) 0x564eb3b81c70 con 0x564eb3b68df0 2024-09-19T11:15:40.364 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f3784ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789999 cookie 94896022576272 notifier 4876 bl.length()=165 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f3784ff9640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:98 7.3 7:c609908c:::notify.5:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f3764003d60 con 0x564eb3b68df0 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(97 notify.5 [notify cookie 94896022824688 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== watch-notify(notify_complete (2) cookie 94896022824688 notify 158913789999 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564eb3b45c20 con 0x564eb3b68df0 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(98 notify.5 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f38a551f800 10 removing email index: 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f38a551f800 10 removing user buckets index 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.362+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:99 8.11 8:8d3ad08f:users.uid::a_user.buckets:head [delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb41b0 con 0x564eb3b6d750 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.363+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(99 a_user.buckets [delete] v37'5 uv4 ondisk = -2 ((2) No such file or directory)) ==== 158+0+0 (crc 0 0 0) 0x7f389804f040 con 0x564eb3b6d750 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.363+0000 7f38a551f800 10 removing user index: a_user 2024-09-19T11:15:40.365 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.363+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:100 8.14 8:2efb937b:users.uid::a_user:head [call version.check_conds in=122b,call version.inc in=38b,delete] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb41b0 con 0x564eb3b6d750 2024-09-19T11:15:40.366 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.364+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(100 a_user [call,call,delete] v37'4 uv4 ondisk = 0) ==== 234+0+0 (crc 0 0 0) 0x7f389804f040 con 0x564eb3b6d750 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.364+0000 7f38a551f800 10 removing default.rgw.meta+users.uid+a_user from cache 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.364+0000 7f38a551f800 10 distributing notification oid=default.rgw.control:notify.2 cni=[op: 1, obj: default.rgw.meta:users.uid:a_user, ofs0, ns] 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.364+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:101 7.15 7:a93a5511:::notify.2:head [notify cookie 94896022831536 in=167b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb26f0 con 0x564eb3b6d750 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.364+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== watch-notify(notify (1) cookie 94896022566896 notify 158913789962 ret 0) ==== 197+0+0 (crc 0 0 0) 0x564eb3b81880 con 0x564eb3b6d750 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.364+0000 7f3777fff640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789962 cookie 94896022566896 notifier 4876 bl.length()=155 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.364+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(101 notify.2 [notify cookie 94896022831536 out=8b] v0'0 uv255 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f389804f040 con 0x564eb3b6d750 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.364+0000 7f3777fff640 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:102 7.15 7:a93a5511:::notify.2:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f36c80032c0 con 0x564eb3b6d750 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.365+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 34 ==== watch-notify(notify_complete (2) cookie 94896022831536 notify 158913789962 ret 0) ==== 42+0+48 (crc 0 0 0) 0x564eb3b85ba0 con 0x564eb3b6d750 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.365+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 35 ==== osd_op_reply(102 notify.2 [notify-ack] v0'0 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389804f040 con 0x564eb3b6d750 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.366+0000 7f3757fe7640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.367 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.366+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:103 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94896022584192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb41b0 con 0x564eb3b64400 2024-09-19T11:15:40.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.367+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(103 data_loggenerations_metadata [watch unwatch cookie 94896022584192] v37'256 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.368 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.367+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:104 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94896022559472] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb41b0 con 0x7f3898038040 2024-09-19T11:15:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.368+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(104 notify.0 [watch unwatch cookie 94896022559472] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.368+0000 7f38a551f800 20 remove_watcher() i=0 2024-09-19T11:15:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.368+0000 7f38a551f800 2 removed watcher, disabling cache 2024-09-19T11:15:40.369 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.368+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:105 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94896022564144] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb41b0 con 0x564eb3b64400 2024-09-19T11:15:40.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.369+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(105 notify.1 [watch unwatch cookie 94896022564144] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.369+0000 7f38a551f800 20 remove_watcher() i=1 2024-09-19T11:15:40.370 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.369+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:106 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94896022566896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb41b0 con 0x564eb3b6d750 2024-09-19T11:15:40.371 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.370+0000 7f38a0aa1640 1 -- 172.21.15.102:0/362268657 <== osd.3 v2:172.21.15.102:6800/3957239017 36 ==== osd_op_reply(106 notify.2 [watch unwatch cookie 94896022566896] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389804f040 con 0x564eb3b6d750 2024-09-19T11:15:40.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.371+0000 7f38a551f800 20 remove_watcher() i=2 2024-09-19T11:15:40.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.371+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:107 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94896022569216] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb41b0 con 0x7f3898038040 2024-09-19T11:15:40.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.371+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(107 notify.3 [watch unwatch cookie 94896022569216] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x7f3898038040 2024-09-19T11:15:40.372 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.371+0000 7f38a551f800 20 remove_watcher() i=3 2024-09-19T11:15:40.373 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.371+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:108 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94896022573008] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b74100 con 0x564eb3b64400 2024-09-19T11:15:40.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.373+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(108 notify.4 [watch unwatch cookie 94896022573008] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f389c00a4d0 con 0x564eb3b64400 2024-09-19T11:15:40.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.373+0000 7f38a551f800 20 remove_watcher() i=4 2024-09-19T11:15:40.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.373+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:109 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94896022576272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3bb41b0 con 0x564eb3b68df0 2024-09-19T11:15:40.374 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.374+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(109 notify.5 [watch unwatch cookie 94896022576272] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.374+0000 7f38a551f800 20 remove_watcher() i=5 2024-09-19T11:15:40.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.374+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:110 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94896022577968] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b74fd0 con 0x564eb3b68df0 2024-09-19T11:15:40.375 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.375+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(110 notify.6 [watch unwatch cookie 94896022577968] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.375+0000 7f38a551f800 20 remove_watcher() i=6 2024-09-19T11:15:40.376 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.375+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:111 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94896022583072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564eb3b74100 con 0x564eb3b68df0 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a12a2640 1 -- 172.21.15.102:0/362268657 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(111 notify.7 [watch unwatch cookie 94896022583072] v37'257 uv255 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f38940b2020 con 0x564eb3b68df0 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 20 remove_watcher() i=7 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b68df0 msgr2=0x564eb3b6b1e0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b68df0 0x564eb3b6b1e0 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3b64400 msgr2=0x564eb3b668c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3b64400 0x564eb3b668c0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3898038040 msgr2=0x7f3898039ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f3898038040 0x7f3898039ab0 crc :-1 s=READY pgs=96 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b6d750 msgr2=0x564eb3b6fc10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.379 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b6d750 0x564eb3b6fc10 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f376c03d000 msgr2=0x7f376c03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f376c03d000 0x7f376c03f4c0 secure :-1 s=READY pgs=328 cs=0 l=1 rev1=1 crypto rx=0x7f389800efd0 tx=0x7f3898024000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 msgr2=0x564eb3b58e70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a1aa3640 1 -- 172.21.15.102:0/362268657 reap_dead start 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b58e70 secure :-1 s=READY pgs=786 cs=0 l=1 rev1=1 crypto rx=0x7f3894083d90 tx=0x7f3894063ed0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 shutdown_connections 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/362268657 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b51a40 0x564eb3b58e70 unknown :-1 s=CLOSED pgs=786 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 >> 172.21.15.102:0/362268657 conn(0x564eb3b4de40 msgr2=0x564eb3b4c050 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 shutdown_connections 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/362268657 wait complete. 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/350655429 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f377803cfb0 msgr2=0x7f377803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.380 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/350655429 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f377803cfb0 0x7f377803f470 secure :-1 s=READY pgs=327 cs=0 l=1 rev1=1 crypto rx=0x564eb3b2eb90 tx=0x7f389800f000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/350655429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b451c0 msgr2=0x564eb3b455e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/350655429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b451c0 0x564eb3b455e0 secure :-1 s=READY pgs=784 cs=0 l=1 rev1=1 crypto rx=0x7f3894060040 tx=0x7f389405db30 comp rx=0 tx=0).stop 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/350655429 shutdown_connections 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/350655429 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f377803cfb0 0x7f377803f470 unknown :-1 s=CLOSED pgs=327 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 --2- 172.21.15.102:0/350655429 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3b451c0 0x564eb3b455e0 unknown :-1 s=CLOSED pgs=784 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.376+0000 7f38a551f800 1 -- 172.21.15.102:0/350655429 >> 172.21.15.102:0/350655429 conn(0x564eb3b39570 msgr2=0x564eb3b39950 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/350655429 shutdown_connections 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/350655429 wait complete. 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b30a10 msgr2=0x564eb3b32e00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564eb3b30a10 0x564eb3b32e00 crc :-1 s=READY pgs=181 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3a2d8d0 msgr2=0x564eb3b2e1c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.381 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564eb3a2d8d0 0x564eb3b2e1c0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b34910 msgr2=0x564eb3b36d00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564eb3b34910 0x564eb3b36d00 crc :-1 s=READY pgs=182 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f378803d000 msgr2=0x7f378803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f378803d000 0x7f378803f4c0 secure :-1 s=READY pgs=326 cs=0 l=1 rev1=1 crypto rx=0x7f3898001db0 tx=0x7f3898001310 comp rx=0 tx=0).stop 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 msgr2=0x564eb3b1d470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 --2- 172.21.15.102:0/1951928410 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564eb3a2c690 0x564eb3b1d470 secure :-1 s=READY pgs=783 cs=0 l=1 rev1=1 crypto rx=0x7f3894025b20 tx=0x7f3894002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a1aa3640 1 -- 172.21.15.102:0/1951928410 reap_dead start 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 shutdown_connections 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 >> 172.21.15.102:0/1951928410 conn(0x564eb3a27a60 msgr2=0x564eb3b16230 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 shutdown_connections 2024-09-19T11:15:40.382 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.377+0000 7f38a551f800 1 -- 172.21.15.102:0/1951928410 wait complete. 2024-09-19T11:15:40.386 ERROR:root:None 2024-09-19T11:15:40.386 ERROR:root:0 2024-09-19T11:15:40.387 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-19T11:15:40.387 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=read'] 2024-09-19T11:15:40.387 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=read 2024-09-19T11:15:40.433 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:40.433 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.433+0000 7f0f3de98800 1 Processor -- start 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.433+0000 7f0f3de98800 1 -- start start 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.433+0000 7f0f3de98800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555790708f90 0x55579070b380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.433+0000 7f0f3de98800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55579070f5e0 con 0x55579070b8c0 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.433+0000 7f0f3de98800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5557905937d0 con 0x555790708f90 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.433+0000 7f0f3b982640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x555790708f90 0x55579070b380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.433+0000 7f0f3b181640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55579070b8c0 0x55579070dd80 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34788/0 (socket says 172.21.15.102:34788) 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.433+0000 7f0f3b181640 1 -- 172.21.15.102:0/2699149488 learned_addr learned my addr 172.21.15.102:0/2699149488 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.434+0000 7f0f3a980640 1 -- 172.21.15.102:0/2699149488 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1590796568 0 0) 0x55579070f5e0 con 0x55579070b8c0 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.434+0000 7f0f3a980640 1 -- 172.21.15.102:0/2699149488 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f0f24001e10 con 0x55579070b8c0 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.434+0000 7f0f3b982640 1 -- 172.21.15.102:0/2699149488 >> v1:172.21.15.37:6789/0 conn(0x55579070b8c0 legacy=0x55579070dd80 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.435 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.434+0000 7f0f3b982640 1 -- 172.21.15.102:0/2699149488 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x555790710810 con 0x555790708f90 2024-09-19T11:15:40.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3b982640 1 --2- 172.21.15.102:0/2699149488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x55579070b380 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00a470 tx=0x7f0f2c045920 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1c1f711d37f92987 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3a980640 1 -- 172.21.15.102:0/2699149488 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c059070 con 0x555790708f90 2024-09-19T11:15:40.437 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3a980640 1 -- 172.21.15.102:0/2699149488 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c054570 con 0x555790708f90 2024-09-19T11:15:40.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3a980640 1 -- 172.21.15.102:0/2699149488 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c054870 con 0x555790708f90 2024-09-19T11:15:40.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3de98800 1 -- 172.21.15.102:0/2699149488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 msgr2=0x55579070b380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3de98800 1 --2- 172.21.15.102:0/2699149488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x55579070b380 secure :-1 s=READY pgs=788 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c00a470 tx=0x7f0f2c045920 comp rx=0 tx=0).stop 2024-09-19T11:15:40.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3de98800 1 -- 172.21.15.102:0/2699149488 shutdown_connections 2024-09-19T11:15:40.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3de98800 1 --2- 172.21.15.102:0/2699149488 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x55579070b380 unknown :-1 s=CLOSED pgs=788 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3de98800 1 -- 172.21.15.102:0/2699149488 >> 172.21.15.102:0/2699149488 conn(0x555790702a70 msgr2=0x555790704ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3de98800 1 -- 172.21.15.102:0/2699149488 shutdown_connections 2024-09-19T11:15:40.438 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.436+0000 7f0f3de98800 1 -- 172.21.15.102:0/2699149488 wait complete. 2024-09-19T11:15:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.450+0000 7f0f3de98800 1 Processor -- start 2024-09-19T11:15:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.450+0000 7f0f3de98800 1 -- start start 2024-09-19T11:15:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.450+0000 7f0f3de98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907f8240 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.451 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.450+0000 7f0f3de98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5557905a0dd0 con 0x555790708f90 2024-09-19T11:15:40.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.450+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907f8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.450+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907f8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39704/0 (socket says 172.21.15.102:39704) 2024-09-19T11:15:40.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.450+0000 7f0f3b982640 1 -- 172.21.15.102:0/426746102 learned_addr learned my addr 172.21.15.102:0/426746102 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.452 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.451+0000 7f0f3b982640 1 -- 172.21.15.102:0/426746102 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5557907f8830 con 0x555790708f90 2024-09-19T11:15:40.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.451+0000 7f0f3b982640 1 --2- 172.21.15.102:0/426746102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907f8240 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c000c00 tx=0x7f0f2c04e000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f3c04db1dd5c579e server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.451+0000 7f0e29e0b640 1 -- 172.21.15.102:0/426746102 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c062070 con 0x555790708f90 2024-09-19T11:15:40.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.451+0000 7f0e29e0b640 1 -- 172.21.15.102:0/426746102 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c00a230 con 0x555790708f90 2024-09-19T11:15:40.453 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.451+0000 7f0e29e0b640 1 -- 172.21.15.102:0/426746102 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c059040 con 0x555790708f90 2024-09-19T11:15:40.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 -- 172.21.15.102:0/426746102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 msgr2=0x5557907f8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.455 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 --2- 172.21.15.102:0/426746102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907f8240 secure :-1 s=READY pgs=789 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c000c00 tx=0x7f0f2c04e000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 -- 172.21.15.102:0/426746102 shutdown_connections 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 --2- 172.21.15.102:0/426746102 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907f8240 unknown :-1 s=CLOSED pgs=789 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 -- 172.21.15.102:0/426746102 >> 172.21.15.102:0/426746102 conn(0x555790702a70 msgr2=0x5557907f3bc0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 -- 172.21.15.102:0/426746102 shutdown_connections 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 -- 172.21.15.102:0/426746102 wait complete. 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 Processor -- start 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 -- start start 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907ffcf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3de98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55579070fab0 con 0x555790708f90 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907ffcf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907ffcf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39714/0 (socket says 172.21.15.102:39714) 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.452+0000 7f0f3b982640 1 -- 172.21.15.102:0/828872578 learned_addr learned my addr 172.21.15.102:0/828872578 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.456 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.453+0000 7f0f3b982640 1 -- 172.21.15.102:0/828872578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555790800250 con 0x555790708f90 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.453+0000 7f0f3b982640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907ffcf0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c025b20 tx=0x7f0f2c002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.453+0000 7f0e23fff640 1 -- 172.21.15.102:0/828872578 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c06b070 con 0x555790708f90 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.453+0000 7f0e23fff640 1 -- 172.21.15.102:0/828872578 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c054990 con 0x555790708f90 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.453+0000 7f0e23fff640 1 -- 172.21.15.102:0/828872578 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c059070 con 0x555790708f90 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.453+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5557908004e0 con 0x555790708f90 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.453+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555790800ee0 con 0x555790708f90 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.454+0000 7f0e23fff640 1 -- 172.21.15.102:0/828872578 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0f2c06e070 con 0x555790708f90 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.454+0000 7f0e23fff640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e2403d000 0x7f0e2403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.454+0000 7f0e23fff640 1 -- 172.21.15.102:0/828872578 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f0f2c097470 con 0x555790708f90 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.454+0000 7f0f3b181640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e2403d000 0x7f0e2403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.454+0000 7f0f3de98800 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579070b8c0 0x555790807340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.457 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.454+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790807880 con 0x55579070b8c0 2024-09-19T11:15:40.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.454+0000 7f0f3c183640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579070b8c0 0x555790807340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.455+0000 7f0f3b181640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e2403d000 0x7f0e2403f4c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001db0 tx=0x7f0f30001310 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.458 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.455+0000 7f0f3c183640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579070b8c0 0x555790807340 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.455+0000 7f0f3c183640 1 -- 172.21.15.102:0/828872578 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579070b8c0 2024-09-19T11:15:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.455+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790807c20 con 0x55579070b8c0 2024-09-19T11:15:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.455+0000 7f0f3c183640 1 -- 172.21.15.102:0/828872578 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579070b8c0 2024-09-19T11:15:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.455+0000 7f0f3de98800 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5557908096e0 0x55579080bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.455+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55579080c310 con 0x5557908096e0 2024-09-19T11:15:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.456+0000 7f0f3b982640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5557908096e0 0x55579080bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.456+0000 7f0f3b982640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5557908096e0 0x55579080bb80 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.456+0000 7f0f3b982640 1 -- 172.21.15.102:0/828872578 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0f2c077070 con 0x5557908096e0 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.456+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790808470 con 0x55579070b8c0 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.457+0000 7f0f3c183640 1 -- 172.21.15.102:0/828872578 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579070b8c0 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.457+0000 7f0f3de98800 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55579080d770 0x55579080fb60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.457+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790810250 con 0x55579080d770 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.457+0000 7f0f3b181640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55579080d770 0x55579080fb60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.457+0000 7f0f3b181640 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55579080d770 0x55579080fb60 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.457+0000 7f0f3b181640 1 -- 172.21.15.102:0/828872578 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0f30009050 con 0x55579080d770 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.458+0000 7f0f3de98800 1 Processor -- start 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.458+0000 7f0f3de98800 1 -- start start 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.458+0000 7f0f3de98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579081dfd0 0x55579081e3f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.458+0000 7f0f3de98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5557905ff4a0 con 0x55579081dfd0 2024-09-19T11:15:40.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.458+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579081dfd0 0x55579081e3f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.458+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579081dfd0 0x55579081e3f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39720/0 (socket says 172.21.15.102:39720) 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.458+0000 7f0f3b982640 1 -- 172.21.15.102:0/2901592568 learned_addr learned my addr 172.21.15.102:0/2901592568 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.458+0000 7f0f3b982640 1 -- 172.21.15.102:0/2901592568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579081ea30 con 0x55579081dfd0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.459+0000 7f0f3b982640 1 --2- 172.21.15.102:0/2901592568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579081dfd0 0x55579081e3f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c078740 tx=0x7f0f2c05deb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.459+0000 7f0e217fa640 1 -- 172.21.15.102:0/2901592568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c0970b0 con 0x55579081dfd0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.459+0000 7f0e217fa640 1 -- 172.21.15.102:0/2901592568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c097250 con 0x55579081dfd0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.459+0000 7f0f3de98800 1 -- 172.21.15.102:0/2901592568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55579081f260 con 0x55579081dfd0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.459+0000 7f0e217fa640 1 -- 172.21.15.102:0/2901592568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c0043d0 con 0x55579081dfd0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.459+0000 7f0f3de98800 1 -- 172.21.15.102:0/2901592568 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55579081f800 con 0x55579081dfd0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0e217fa640 1 -- 172.21.15.102:0/2901592568 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0f2c065040 con 0x55579081dfd0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0e217fa640 1 --2- 172.21.15.102:0/2901592568 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e1403d000 0x7f0e1403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0e217fa640 1 -- 172.21.15.102:0/2901592568 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f0f2c000ed0 con 0x55579081dfd0 2024-09-19T11:15:40.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0f3b181640 1 --2- 172.21.15.102:0/2901592568 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e1403d000 0x7f0e1403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0f3de98800 1 Processor -- start 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0f3de98800 1 -- start start 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0f3b181640 1 --2- 172.21.15.102:0/2901592568 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e1403d000 0x7f0e1403f4c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x555790801df0 tx=0x7f0f3000f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0f3de98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x55579082abd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.460+0000 7f0f3de98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5557907f8ba0 con 0x55579082a7f0 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x55579082abd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x55579082abd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39726/0 (socket says 172.21.15.102:39726) 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3b982640 1 -- 172.21.15.102:0/4103186954 learned_addr learned my addr 172.21.15.102:0/4103186954 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3b982640 1 -- 172.21.15.102:0/4103186954 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55579082b1c0 con 0x55579082a7f0 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3b982640 1 --2- 172.21.15.102:0/4103186954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x55579082abd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c073fd0 tx=0x7f0f2c082730 comp rx=0 tx=0).ready entity=mon.0 client_cookie=738e8d2cd97494c9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0e1affd640 1 -- 172.21.15.102:0/4103186954 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c070b40 con 0x55579082a7f0 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0e1affd640 1 -- 172.21.15.102:0/4103186954 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c08b3f0 con 0x55579082a7f0 2024-09-19T11:15:40.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0e1affd640 1 -- 172.21.15.102:0/4103186954 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c070450 con 0x55579082a7f0 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3de98800 1 -- 172.21.15.102:0/4103186954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 msgr2=0x55579082abd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3de98800 1 --2- 172.21.15.102:0/4103186954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x55579082abd0 secure :-1 s=READY pgs=792 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c073fd0 tx=0x7f0f2c082730 comp rx=0 tx=0).stop 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3de98800 1 -- 172.21.15.102:0/4103186954 shutdown_connections 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3de98800 1 --2- 172.21.15.102:0/4103186954 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x55579082abd0 unknown :-1 s=CLOSED pgs=792 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.461+0000 7f0f3de98800 1 -- 172.21.15.102:0/4103186954 >> 172.21.15.102:0/4103186954 conn(0x555790826bf0 msgr2=0x555790824e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3de98800 1 -- 172.21.15.102:0/4103186954 shutdown_connections 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3de98800 1 -- 172.21.15.102:0/4103186954 wait complete. 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3de98800 1 Processor -- start 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3de98800 1 -- start start 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3de98800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x555790831c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3de98800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55579082b650 con 0x55579082a7f0 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x555790831c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3b982640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x555790831c10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39728/0 (socket says 172.21.15.102:39728) 2024-09-19T11:15:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 learned_addr learned my addr 172.21.15.102:0/722334294 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.462+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x555790832170 con 0x55579082a7f0 2024-09-19T11:15:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.463+0000 7f0f3b982640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x555790831c10 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c073fd0 tx=0x7f0f2c095f90 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.463+0000 7f0e197fa640 1 -- 172.21.15.102:0/722334294 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c070b40 con 0x55579082a7f0 2024-09-19T11:15:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.463+0000 7f0e197fa640 1 -- 172.21.15.102:0/722334294 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0f2c070630 con 0x55579082a7f0 2024-09-19T11:15:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.463+0000 7f0e197fa640 1 -- 172.21.15.102:0/722334294 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0f2c066760 con 0x55579082a7f0 2024-09-19T11:15:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.463+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x555790832170 con 0x55579082a7f0 2024-09-19T11:15:40.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.463+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x555790832170 con 0x55579082a7f0 2024-09-19T11:15:40.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.464+0000 7f0e197fa640 1 -- 172.21.15.102:0/722334294 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0f2c0b4030 con 0x55579082a7f0 2024-09-19T11:15:40.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.464+0000 7f0e197fa640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e0403d000 0x7f0e0403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.464+0000 7f0e197fa640 1 -- 172.21.15.102:0/722334294 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f0f2c0b2070 con 0x55579082a7f0 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.464+0000 7f0f3b181640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e0403d000 0x7f0e0403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.464+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.464+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579083d150 0x55579083f610 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.464+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55579083fd60 con 0x55579083d150 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3c183640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579083d150 0x55579083f610 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3c183640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579083d150 0x55579083f610 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3b181640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e0403d000 0x7f0e0403f4c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000efd0 tx=0x7f0f30024000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3de98800 20 realm 2024-09-19T11:15:40.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790840170 con 0x55579083d150 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3de98800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.465+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790840a40 con 0x55579083d150 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3de98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.483 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555790841b40 0x555790843f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790844580 con 0x555790841b40 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3b982640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555790841b40 0x555790843f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.466+0000 7f0f3b982640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555790841b40 0x555790843f30 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3de98800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3de98800 20 searching for the correct realm 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555790846550 0x555790848a10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790849090 con 0x555790846550 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3b181640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555790846550 0x555790848a10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3b181640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555790846550 0x555790848a10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.484 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3b181640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0f30038040 0x7f0f30039ab0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790849090 con 0x7f0f30038040 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.467+0000 7f0f3c183640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0f30038040 0x7f0f30039ab0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.468+0000 7f0f3c183640 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0f30038040 0x7f0f30039ab0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.468+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.468+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790841b40 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.468+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.468+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.468+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.468+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.469+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.485 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.469+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790841b40 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.469+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.469+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790841b40 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.469+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.469+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x7f0f30038040 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.470+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.470+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790846550 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.470+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.470+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.470+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.470+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790841b40 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.470+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.470+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.486 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.471+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.471+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x7f0f30038040 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.471+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.471+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790846550 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.471+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.471+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790846550 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.471+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.471+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790841b40 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790846550 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790846550 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.487 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.472+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790841b40 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.473+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.473+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790846550 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.473+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.473+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x7f0f30038040 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.473+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.473+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.474+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.474+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790841b40 2024-09-19T11:15:40.488 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.474+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.474+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790846550 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.474+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.474+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790841b40 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x7f0f30038040 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x555790846550 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x7f0f30038040 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x55579083d150 2024-09-19T11:15:40.489 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.475+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x555790840de0 con 0x7f0f30038040 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790844e40 con 0x55579083d150 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.490 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790844e40 con 0x55579083d150 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.476+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790844e40 con 0x555790846550 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 20 zone default found 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 4 Realm: () 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 20 zonegroup default 2024-09-19T11:15:40.491 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790845730 con 0x555790841b40 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55579084b000 con 0x555790846550 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.477+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55579084b440 con 0x555790846550 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.478+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.478+0000 7f0f3de98800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.492 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.478+0000 7f0f3de98800 20 started sync module instance, tier type = 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.478+0000 7f0f3de98800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.478+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084a3a0 con 0x7f0f30038040 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.479+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.479+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93834575128768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084a3a0 con 0x7f0f30038040 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.479+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084bfa0 con 0x55579083d150 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.480+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93834575128768] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.480+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.480+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93834575133328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084a3a0 con 0x55579083d150 2024-09-19T11:15:40.493 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.480+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084ca30 con 0x555790846550 2024-09-19T11:15:40.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.481+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93834575133328] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.481+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.498 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.481+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93834575126256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084a310 con 0x555790846550 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.481+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084d8f0 con 0x7f0f30038040 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.482+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93834575126256] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.482+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.482+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93834575139904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084dd10 con 0x7f0f30038040 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.482+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084e6d0 con 0x55579083d150 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.483+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93834575139904] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x7f0f30038040 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.483+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.483+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93834575141440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084e6d0 con 0x55579083d150 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.483+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084f090 con 0x555790841b40 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.484+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.484+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93834575145952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084f8e0 con 0x555790841b40 2024-09-19T11:15:40.499 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.484+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790850310 con 0x555790841b40 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.485+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93834575141440] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.485+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93834575145952] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.486+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.486+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93834575150624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790850730 con 0x555790841b40 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.486+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790850f80 con 0x555790841b40 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93834575150624] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'258 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93834575152816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790850f80 con 0x555790841b40 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 20 add_watcher() i=0 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 20 add_watcher() i=1 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 20 add_watcher() i=2 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 20 add_watcher() i=3 2024-09-19T11:15:40.500 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 20 add_watcher() i=4 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 20 add_watcher() i=5 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 20 add_watcher() i=6 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93834575152816] v37'259 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 20 add_watcher() i=7 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.487+0000 7f0f3de98800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.488+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790854380 con 0x55579083d150 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.488+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.488+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93834575154336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5557908518d0 con 0x55579083d150 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.489+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93834575154336] v37'257 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.489+0000 7f0df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.489+0000 7f0f3de98800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:40.501 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.489+0000 7f0f3de98800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.489+0000 7f0f3de98800 5 note: GC not initialized 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.489+0000 7f0df0fe1640 20 reqs_thread_entry: start 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.489+0000 7f0f3de98800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.489+0000 7f0f3de98800 20 Filter name: none 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0d6a7fc640 20 reqs_thread_entry: start 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3de98800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3de98800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790887270 con 0x555790841b40 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv5 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3de98800 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3de98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3de98800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3de98800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:40.502 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.490+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579088d6e0 con 0x555790841b40 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'6 uv6 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3de98800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3de98800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3de98800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93834575401120 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x555790888d20 con 0x55579083d150 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 93834575141440 notify 158913789988 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f0f34018850 con 0x55579083d150 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0e1affd640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789988 cookie 93834575141440 notifier 4883 bl.length()=666 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0e1affd640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0e1affd640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 93834575401120 out=8b] v0'0 uv258 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0e1affd640 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f0e00003ea0 con 0x55579083d150 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f3400a4d0 con 0x55579083d150 2024-09-19T11:15:40.503 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.492+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 93834575401120 notify 158913789988 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0f34018a20 con 0x55579083d150 2024-09-19T11:15:40.504 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"read"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.493+0000 7f0df1fe3640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.493+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93834575154336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790885100 con 0x55579083d150 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.494+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93834575154336] v37'258 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0f34040040 con 0x55579083d150 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.494+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93834575128768] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790885100 con 0x7f0f30038040 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.495+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93834575128768] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f34040040 con 0x7f0f30038040 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.495+0000 7f0f3de98800 20 remove_watcher() i=0 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.495+0000 7f0f3de98800 2 removed watcher, disabling cache 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.495+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93834575133328] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790885100 con 0x55579083d150 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.496+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93834575133328] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f34040040 con 0x55579083d150 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.496+0000 7f0f3de98800 20 remove_watcher() i=1 2024-09-19T11:15:40.509 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.496+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93834575126256] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790885100 con 0x555790846550 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.497+0000 7f0f3b181640 1 -- 172.21.15.102:0/722334294 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93834575126256] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f30009050 con 0x555790846550 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.497+0000 7f0f3de98800 20 remove_watcher() i=2 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.497+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93834575139904] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790849ef0 con 0x7f0f30038040 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.498+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93834575139904] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f34040040 con 0x7f0f30038040 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.498+0000 7f0f3de98800 20 remove_watcher() i=3 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.498+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93834575141440] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790849ef0 con 0x55579083d150 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.499+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93834575141440] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f34040040 con 0x55579083d150 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.499+0000 7f0f3de98800 20 remove_watcher() i=4 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.499+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93834575145952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790849ef0 con 0x555790841b40 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.501+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93834575145952] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.501+0000 7f0f3de98800 20 remove_watcher() i=5 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.501+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93834575150624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55579084ebe0 con 0x555790841b40 2024-09-19T11:15:40.510 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.501+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93834575150624] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.501+0000 7f0f3de98800 20 remove_watcher() i=6 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.502+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93834575152816] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x555790849ef0 con 0x555790841b40 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.502+0000 7f0f3b982640 1 -- 172.21.15.102:0/722334294 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93834575152816] v37'260 uv258 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0f2c077070 con 0x555790841b40 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.502+0000 7f0f3de98800 20 remove_watcher() i=7 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555790841b40 msgr2=0x555790843f30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x555790841b40 0x555790843f30 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579083d150 msgr2=0x55579083f610 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579083d150 0x55579083f610 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0f30038040 msgr2=0x7f0f30039ab0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f0f30038040 0x7f0f30039ab0 crc :-1 s=READY pgs=97 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555790846550 msgr2=0x555790848a10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x555790846550 0x555790848a10 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.511 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e0403d000 msgr2=0x7f0e0403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e0403d000 0x7f0e0403f4c0 secure :-1 s=READY pgs=331 cs=0 l=1 rev1=1 crypto rx=0x7f0f3000efd0 tx=0x7f0f30024000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 msgr2=0x555790831c10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x555790831c10 secure :-1 s=READY pgs=793 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c073fd0 tx=0x7f0f2c095f90 comp rx=0 tx=0).stop 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3c183640 1 -- 172.21.15.102:0/722334294 reap_dead start 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 shutdown_connections 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/722334294 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579082a7f0 0x555790831c10 unknown :-1 s=CLOSED pgs=793 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 >> 172.21.15.102:0/722334294 conn(0x555790826bf0 msgr2=0x555790824e00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 shutdown_connections 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/722334294 wait complete. 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/2901592568 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e1403d000 msgr2=0x7f0e1403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/2901592568 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e1403d000 0x7f0e1403f4c0 secure :-1 s=READY pgs=330 cs=0 l=1 rev1=1 crypto rx=0x555790801df0 tx=0x7f0f3000f000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/2901592568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579081dfd0 msgr2=0x55579081e3f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.512 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/2901592568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579081dfd0 0x55579081e3f0 secure :-1 s=READY pgs=791 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c078740 tx=0x7f0f2c05deb0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/2901592568 shutdown_connections 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/2901592568 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e1403d000 0x7f0e1403f4c0 unknown :-1 s=CLOSED pgs=330 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 --2- 172.21.15.102:0/2901592568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55579081dfd0 0x55579081e3f0 unknown :-1 s=CLOSED pgs=791 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/2901592568 >> 172.21.15.102:0/2901592568 conn(0x555790812380 msgr2=0x555790812760 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/2901592568 shutdown_connections 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.503+0000 7f0f3de98800 1 -- 172.21.15.102:0/2901592568 wait complete. 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5557908096e0 msgr2=0x55579080bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5557908096e0 0x55579080bb80 crc :-1 s=READY pgs=183 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579070b8c0 msgr2=0x555790807340 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55579070b8c0 0x555790807340 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55579080d770 msgr2=0x55579080fb60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55579080d770 0x55579080fb60 crc :-1 s=READY pgs=184 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.513 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e2403d000 msgr2=0x7f0e2403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0e2403d000 0x7f0e2403f4c0 secure :-1 s=READY pgs=329 cs=0 l=1 rev1=1 crypto rx=0x7f0f30001db0 tx=0x7f0f30001310 comp rx=0 tx=0).stop 2024-09-19T11:15:40.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 msgr2=0x5557907ffcf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 --2- 172.21.15.102:0/828872578 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x555790708f90 0x5557907ffcf0 secure :-1 s=READY pgs=790 cs=0 l=1 rev1=1 crypto rx=0x7f0f2c025b20 tx=0x7f0f2c002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3c183640 1 -- 172.21.15.102:0/828872578 reap_dead start 2024-09-19T11:15:40.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 shutdown_connections 2024-09-19T11:15:40.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 >> 172.21.15.102:0/828872578 conn(0x555790702a70 msgr2=0x5557907f23b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 shutdown_connections 2024-09-19T11:15:40.514 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.504+0000 7f0f3de98800 1 -- 172.21.15.102:0/828872578 wait complete. 2024-09-19T11:15:40.515 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.515 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'read'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.515 ERROR:root:0 2024-09-19T11:15:40.515 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:40.528 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:40.528 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-19T11:15:40.528 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=*'] 2024-09-19T11:15:40.529 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'user-info-without-keys=*' 2024-09-19T11:15:40.575 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:40.575 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:40.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.575+0000 7f40e221d800 1 Processor -- start 2024-09-19T11:15:40.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.575+0000 7f40e221d800 1 -- start start 2024-09-19T11:15:40.576 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.575+0000 7f40e221d800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x563319a71aa0 0x563319a73f60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.575+0000 7f40e221d800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x563319a745e0 con 0x563319a6df30 2024-09-19T11:15:40.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.575+0000 7f40e221d800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5633198f87d0 con 0x563319a71aa0 2024-09-19T11:15:40.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.575+0000 7f40dd1f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x563319a71aa0 0x563319a73f60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.575+0000 7f40dd1f1640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x563319a71aa0 0x563319a73f60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39736/0 (socket says 172.21.15.102:39736) 2024-09-19T11:15:40.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.575+0000 7f40dd1f1640 1 -- 172.21.15.102:0/1210577454 learned_addr learned my addr 172.21.15.102:0/1210577454 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.576+0000 7f40dd1f1640 1 -- 172.21.15.102:0/1210577454 >> v1:172.21.15.37:6789/0 conn(0x563319a6df30 legacy=0x563319a70320 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.577 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.576+0000 7f40dd1f1640 1 -- 172.21.15.102:0/1210577454 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x563319a75810 con 0x563319a71aa0 2024-09-19T11:15:40.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.577+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/1210577454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 0x563319a73f60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f40c800a520 tx=0x7f40c8045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c0f369185526ff58 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.578 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.577+0000 7f40dc9f0640 1 -- 172.21.15.102:0/1210577454 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c8055070 con 0x563319a71aa0 2024-09-19T11:15:40.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.577+0000 7f40dc9f0640 1 -- 172.21.15.102:0/1210577454 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40c80515b0 con 0x563319a71aa0 2024-09-19T11:15:40.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.578+0000 7f40dc9f0640 1 -- 172.21.15.102:0/1210577454 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40c80518d0 con 0x563319a71aa0 2024-09-19T11:15:40.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.578+0000 7f40e221d800 1 -- 172.21.15.102:0/1210577454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 msgr2=0x563319a73f60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.579 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.578+0000 7f40e221d800 1 --2- 172.21.15.102:0/1210577454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 0x563319a73f60 secure :-1 s=READY pgs=795 cs=0 l=1 rev1=1 crypto rx=0x7f40c800a520 tx=0x7f40c8045ba0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.578+0000 7f40e221d800 1 -- 172.21.15.102:0/1210577454 shutdown_connections 2024-09-19T11:15:40.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.578+0000 7f40e221d800 1 --2- 172.21.15.102:0/1210577454 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 0x563319a73f60 unknown :-1 s=CLOSED pgs=795 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.578+0000 7f40e221d800 1 -- 172.21.15.102:0/1210577454 >> 172.21.15.102:0/1210577454 conn(0x563319a67a70 msgr2=0x563319a69ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.578+0000 7f40e221d800 1 -- 172.21.15.102:0/1210577454 shutdown_connections 2024-09-19T11:15:40.580 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.578+0000 7f40e221d800 1 -- 172.21.15.102:0/1210577454 wait complete. 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.592+0000 7f40e221d800 1 Processor -- start 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.592+0000 7f40e221d800 1 -- start start 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.592+0000 7f40e221d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a6df30 0x563319b5d390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.592+0000 7f40e221d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563319905dd0 con 0x563319a6df30 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.592+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a6df30 0x563319b5d390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.592+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a6df30 0x563319b5d390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39746/0 (socket says 172.21.15.102:39746) 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.592+0000 7f40dd9f2640 1 -- 172.21.15.102:0/1665379774 learned_addr learned my addr 172.21.15.102:0/1665379774 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.592+0000 7f40dd9f2640 1 -- 172.21.15.102:0/1665379774 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563319b5d980 con 0x563319a6df30 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/1665379774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a6df30 0x563319b5d390 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f40d0001da0 tx=0x7f40d000b5b0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c552ac78d82adf39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f3fcbe07640 1 -- 172.21.15.102:0/1665379774 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d000f400 con 0x563319a6df30 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f3fcbe07640 1 -- 172.21.15.102:0/1665379774 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d000f5a0 con 0x563319a6df30 2024-09-19T11:15:40.594 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f3fcbe07640 1 -- 172.21.15.102:0/1665379774 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d000f8c0 con 0x563319a6df30 2024-09-19T11:15:40.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f40e221d800 1 -- 172.21.15.102:0/1665379774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a6df30 msgr2=0x563319b5d390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f40e221d800 1 --2- 172.21.15.102:0/1665379774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a6df30 0x563319b5d390 secure :-1 s=READY pgs=796 cs=0 l=1 rev1=1 crypto rx=0x7f40d0001da0 tx=0x7f40d000b5b0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f40e221d800 1 -- 172.21.15.102:0/1665379774 shutdown_connections 2024-09-19T11:15:40.597 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f40e221d800 1 --2- 172.21.15.102:0/1665379774 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a6df30 0x563319b5d390 unknown :-1 s=CLOSED pgs=796 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f40e221d800 1 -- 172.21.15.102:0/1665379774 >> 172.21.15.102:0/1665379774 conn(0x563319a67a70 msgr2=0x563319b58d10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f40e221d800 1 -- 172.21.15.102:0/1665379774 shutdown_connections 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.593+0000 7f40e221d800 1 -- 172.21.15.102:0/1665379774 wait complete. 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.594+0000 7f40e221d800 1 Processor -- start 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.594+0000 7f40e221d800 1 -- start start 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.594+0000 7f40e221d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 0x563319b65120 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.594+0000 7f40e221d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563319a74ab0 con 0x563319a71aa0 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.594+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 0x563319b65120 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.594+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 0x563319b65120 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39760/0 (socket says 172.21.15.102:39760) 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.594+0000 7f40dd9f2640 1 -- 172.21.15.102:0/427673466 learned_addr learned my addr 172.21.15.102:0/427673466 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.594+0000 7f40dd9f2640 1 -- 172.21.15.102:0/427673466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563319b65680 con 0x563319a71aa0 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.595+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 0x563319b65120 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x563319b5e320 tx=0x7f40d0000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.595+0000 7f3fca604640 1 -- 172.21.15.102:0/427673466 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d001a690 con 0x563319a71aa0 2024-09-19T11:15:40.598 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.595+0000 7f3fca604640 1 -- 172.21.15.102:0/427673466 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d001a870 con 0x563319a71aa0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.595+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563319b65910 con 0x563319a71aa0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.595+0000 7f3fca604640 1 -- 172.21.15.102:0/427673466 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d001ab90 con 0x563319a71aa0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.595+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563319b66520 con 0x563319a71aa0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f3fca604640 1 -- 172.21.15.102:0/427673466 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f40d0017070 con 0x563319a71aa0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f3fca604640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fc403d000 0x7f3fc403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f3fca604640 1 -- 172.21.15.102:0/427673466 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f40d0015020 con 0x563319a71aa0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fc403d000 0x7f3fc403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f40e221d800 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319b6a760 0x563319b6cb50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319b66f00 con 0x563319b6a760 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f40de1f3640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319b6a760 0x563319b6cb50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fc403d000 0x7f3fc403f4c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f40c8057000 tx=0x7f40c8052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.599 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.596+0000 7f40de1f3640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319b6a760 0x563319b6cb50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.605 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.597+0000 7f40de1f3640 1 -- 172.21.15.102:0/427673466 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319b6a760 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.597+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319b668b0 con 0x563319b6a760 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.597+0000 7f40de1f3640 1 -- 172.21.15.102:0/427673466 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319b6a760 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.597+0000 7f40e221d800 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319b6f000 0x563319b713f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.597+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319b71ac0 con 0x563319b6f000 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.597+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319b6f000 0x563319b713f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.598+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319b6f000 0x563319b713f0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.598+0000 7f40dd9f2640 1 -- 172.21.15.102:0/427673466 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f40d002e070 con 0x563319b6f000 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.598+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319b6dea0 con 0x563319b6a760 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.598+0000 7f40de1f3640 1 -- 172.21.15.102:0/427673466 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319b6a760 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.598+0000 7f40e221d800 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319b72f00 0x563319b752f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.598+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319b75a30 con 0x563319b72f00 2024-09-19T11:15:40.606 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.599+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319b72f00 0x563319b752f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.599+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319b72f00 0x563319b752f0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.599+0000 7f40dd1f1640 1 -- 172.21.15.102:0/427673466 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f40c8057030 con 0x563319b72f00 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.599+0000 7f40e221d800 1 Processor -- start 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.599+0000 7f40e221d800 1 -- start start 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40e221d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b837b0 0x563319b83bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40e221d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5633199644a0 con 0x563319b837b0 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b837b0 0x563319b83bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b837b0 0x563319b83bd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39772/0 (socket says 172.21.15.102:39772) 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40dd9f2640 1 -- 172.21.15.102:0/3874877889 learned_addr learned my addr 172.21.15.102:0/3874877889 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40dd9f2640 1 -- 172.21.15.102:0/3874877889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563319b84210 con 0x563319b837b0 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/3874877889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b837b0 0x563319b83bd0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e750 tx=0x7f40d0046f50 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f3fc37fe640 1 -- 172.21.15.102:0/3874877889 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d001caf0 con 0x563319b837b0 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f3fc37fe640 1 -- 172.21.15.102:0/3874877889 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d001c450 con 0x563319b837b0 2024-09-19T11:15:40.607 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f3fc37fe640 1 -- 172.21.15.102:0/3874877889 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0044b60 con 0x563319b837b0 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40e221d800 1 -- 172.21.15.102:0/3874877889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563319b84a40 con 0x563319b837b0 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.600+0000 7f40e221d800 1 -- 172.21.15.102:0/3874877889 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563319b84a40 con 0x563319b837b0 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.601+0000 7f3fc37fe640 1 -- 172.21.15.102:0/3874877889 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f40d0038020 con 0x563319b837b0 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.601+0000 7f3fc37fe640 1 --2- 172.21.15.102:0/3874877889 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fb803cfb0 0x7f3fb803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.601+0000 7f3fc37fe640 1 -- 172.21.15.102:0/3874877889 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f40d0036020 con 0x563319b837b0 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.601+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/3874877889 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fb803cfb0 0x7f3fb803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40e221d800 1 Processor -- start 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40e221d800 1 -- start start 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/3874877889 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fb803cfb0 0x7f3fb803f470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x563319b6d180 tx=0x7f40c8005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40e221d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319b90210 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40e221d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563319b5ddb0 con 0x563319b8fe10 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319b90210 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.608 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319b90210 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39778/0 (socket says 172.21.15.102:39778) 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40dd9f2640 1 -- 172.21.15.102:0/1014893592 learned_addr learned my addr 172.21.15.102:0/1014893592 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40dd9f2640 1 -- 172.21.15.102:0/1014893592 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563319b90800 con 0x563319b8fe10 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.602+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/1014893592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319b90210 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e700 tx=0x7f40d00306d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b328d5b0af29db7b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f3fc17fa640 1 -- 172.21.15.102:0/1014893592 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0058030 con 0x563319b8fe10 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f3fc17fa640 1 -- 172.21.15.102:0/1014893592 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d000ee40 con 0x563319b8fe10 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f3fc17fa640 1 -- 172.21.15.102:0/1014893592 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0027430 con 0x563319b8fe10 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 -- 172.21.15.102:0/1014893592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 msgr2=0x563319b90210 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 --2- 172.21.15.102:0/1014893592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319b90210 secure :-1 s=READY pgs=799 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e700 tx=0x7f40d00306d0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 -- 172.21.15.102:0/1014893592 shutdown_connections 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 --2- 172.21.15.102:0/1014893592 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319b90210 unknown :-1 s=CLOSED pgs=799 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 -- 172.21.15.102:0/1014893592 >> 172.21.15.102:0/1014893592 conn(0x563319b8c210 msgr2=0x563319b8a450 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.609 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 -- 172.21.15.102:0/1014893592 shutdown_connections 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 -- 172.21.15.102:0/1014893592 wait complete. 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 Processor -- start 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.603+0000 7f40e221d800 1 -- start start 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40e221d800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319a6d650 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40e221d800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x563319b90c70 con 0x563319b8fe10 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319a6d650 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40dd9f2640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319a6d650 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39792/0 (socket says 172.21.15.102:39792) 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 learned_addr learned my addr 172.21.15.102:0/617610589 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x563319a6dbb0 con 0x563319b8fe10 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319a6d650 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f40d003a810 tx=0x7f40d003b8d0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f3faf7fe640 1 -- 172.21.15.102:0/617610589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d006f070 con 0x563319b8fe10 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f3faf7fe640 1 -- 172.21.15.102:0/617610589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f40d00469b0 con 0x563319b8fe10 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x563319a6dbb0 con 0x563319b8fe10 2024-09-19T11:15:40.610 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f3faf7fe640 1 -- 172.21.15.102:0/617610589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f40d0027430 con 0x563319b8fe10 2024-09-19T11:15:40.611 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.604+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x563319a6dbb0 con 0x563319b8fe10 2024-09-19T11:15:40.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.605+0000 7f3faf7fe640 1 -- 172.21.15.102:0/617610589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f40d0072070 con 0x563319b8fe10 2024-09-19T11:15:40.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.605+0000 7f3faf7fe640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fa803cfb0 0x7f3fa803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.605+0000 7f3faf7fe640 1 -- 172.21.15.102:0/617610589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f40d0067070 con 0x563319b8fe10 2024-09-19T11:15:40.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.605+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fa803cfb0 0x7f3fa803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.624 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.606+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fa803cfb0 0x7f3fa803f470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f40c8000c00 tx=0x7f40c806d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.606+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.606+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319ba4970 0x563319ba6e30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.606+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319ba7580 con 0x563319ba4970 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.606+0000 7f40de1f3640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319ba4970 0x563319ba6e30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.606+0000 7f40de1f3640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319ba4970 0x563319ba6e30 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.606+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 realm 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319ba7990 con 0x563319ba4970 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.625 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8260 con 0x563319ba4970 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319ba9360 0x563319bab750 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319babd10 con 0x563319ba9360 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.607+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319ba9360 0x563319bab750 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.626 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.608+0000 7f40dd9f2640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319ba9360 0x563319bab750 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.608+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.608+0000 7f40e221d800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.608+0000 7f40e221d800 20 searching for the correct realm 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.608+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319badcc0 0x563319bb0180 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.608+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319bb0850 con 0x563319badcc0 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.608+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319badcc0 0x563319bb0180 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.608+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319badcc0 0x563319bb0180 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.609+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.609+0000 7f40dd1f1640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f40c8069040 0x7f40c806a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.609+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319bb0850 con 0x7f40c8069040 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.609+0000 7f40de1f3640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f40c8069040 0x7f40c806a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.609+0000 7f40de1f3640 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f40c8069040 0x7f40c806a940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.627 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.609+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.609+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba9360 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.610+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.610+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.610+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.610+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.610+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.610+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba9360 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.610+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.610+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba9360 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.611+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.611+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x7f40c8069040 2024-09-19T11:15:40.628 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.611+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.611+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319badcc0 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.611+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.611+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.611+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.611+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba9360 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x7f40c8069040 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319badcc0 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.629 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319badcc0 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.612+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba9360 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.613+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.613+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319badcc0 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.613+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.613+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319badcc0 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.614+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.614+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.614+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.614+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.614+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.630 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.614+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba9360 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.614+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.614+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319badcc0 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.615+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.615+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x7f40c8069040 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.615+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.615+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.615+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.615+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba9360 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.615+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.615+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319badcc0 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.616+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.616+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba9360 2024-09-19T11:15:40.631 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.616+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.616+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x7f40c8069040 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.616+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.616+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319badcc0 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x7f40c8069040 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x563319ba4970 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x563319ba8600 con 0x7f40c8069040 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:40.632 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bac5d0 con 0x563319ba4970 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.617+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bac5d0 con 0x563319ba4970 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bac5d0 con 0x563319badcc0 2024-09-19T11:15:40.633 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 20 zone default found 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 4 Realm: () 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 20 zonegroup default 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bacf20 con 0x563319ba9360 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.618+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bb2850 con 0x563319badcc0 2024-09-19T11:15:40.634 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40e221d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bb2d00 con 0x563319badcc0 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40e221d800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40e221d800 20 started sync module instance, tier type = 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40e221d800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.619+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb1b60 con 0x7f40c8069040 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.620+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.620+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94777475014784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb1b60 con 0x7f40c8069040 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.620+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb3780 con 0x563319ba4970 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.621+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94777475014784] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.635 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.621+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.621+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94777475019952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb1b60 con 0x563319ba4970 2024-09-19T11:15:40.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.621+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb41d0 con 0x563319badcc0 2024-09-19T11:15:40.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.622+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94777475019952] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.623+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.623+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94777475012272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb1ad0 con 0x563319badcc0 2024-09-19T11:15:40.636 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.623+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb4f90 con 0x7f40c8069040 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.624+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.624+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94777475025520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb5830 con 0x7f40c8069040 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.624+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb62d0 con 0x563319ba4970 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.624+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94777475012272] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.625+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.625+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94777475030432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb6290 con 0x563319ba4970 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.625+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb6d20 con 0x563319ba9360 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.625+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94777475025520] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x7f40c8069040 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.626+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94777475030432] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.641 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.626+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.626+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94777475024320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb5380 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.626+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb75c0 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.627+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94777475024320] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.627+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.627+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94777475035408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb79e0 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.627+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb83a0 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'261 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94777475038960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb87c0 con 0x563319ba9360 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40e221d800 20 add_watcher() i=0 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40e221d800 20 add_watcher() i=1 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40e221d800 20 add_watcher() i=2 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40e221d800 20 add_watcher() i=3 2024-09-19T11:15:40.642 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40e221d800 20 add_watcher() i=4 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40e221d800 20 add_watcher() i=5 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94777475035408] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.628+0000 7f40e221d800 20 add_watcher() i=6 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.629+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94777475038960] v37'262 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.629+0000 7f40e221d800 20 add_watcher() i=7 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.629+0000 7f40e221d800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.629+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bb87c0 con 0x563319ba4970 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.630+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.630+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94777475040016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb8730 con 0x563319ba4970 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.631+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94777475040016] v37'259 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.631+0000 7f3f8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.631+0000 7f40e221d800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.631+0000 7f40e221d800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:40.643 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.631+0000 7f40e221d800 5 note: GC not initialized 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.631+0000 7f3f8e7fc640 20 reqs_thread_entry: start 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.631+0000 7f40e221d800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 20 Filter name: none 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f3efffff640 20 reqs_thread_entry: start 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bee6e0 con 0x563319ba9360 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv6 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 20 rados_obj.operate() r=0 bl.length=490 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:40.644 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.632+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bf4b00 con 0x563319ba9360 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.633+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'7 uv7 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.633+0000 7f40e221d800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.633+0000 7f40e221d800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.633+0000 7f40e221d800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.633+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94777475286272 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x563319bf01c0 con 0x563319ba4970 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.634+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 94777475030432 notify 158913789989 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f40d8018920 con 0x563319ba4970 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.634+0000 7f3fc17fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789989 cookie 94777475030432 notifier 4890 bl.length()=666 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.634+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 94777475286272 out=8b] v0'0 uv261 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.634+0000 7f3fc17fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.634+0000 7f3fc17fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.634+0000 7f3fc17fa640 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f3fa0003ea0 con 0x563319ba4970 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.634+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify_complete (2) cookie 94777475286272 notify 158913789989 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f40d8018af0 con 0x563319ba4970 2024-09-19T11:15:40.645 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.634+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d800a4d0 con 0x563319ba4970 2024-09-19T11:15:40.646 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.635+0000 7f3f8f7fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.635+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94777475040016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bec550 con 0x563319ba4970 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.636+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94777475040016] v37'260 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f40d8040040 con 0x563319ba4970 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.636+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94777475014784] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bec550 con 0x7f40c8069040 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.637+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94777475014784] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8040040 con 0x7f40c8069040 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.637+0000 7f40e221d800 20 remove_watcher() i=0 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.637+0000 7f40e221d800 2 removed watcher, disabling cache 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.637+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94777475019952] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bec550 con 0x563319ba4970 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.639+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94777475019952] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8040040 con 0x563319ba4970 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.639+0000 7f40e221d800 20 remove_watcher() i=1 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.639+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94777475012272] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bec550 con 0x563319badcc0 2024-09-19T11:15:40.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.640+0000 7f40dd1f1640 1 -- 172.21.15.102:0/617610589 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94777475012272] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40c8057030 con 0x563319badcc0 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.640+0000 7f40e221d800 20 remove_watcher() i=2 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.640+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94777475025520] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb16b0 con 0x7f40c8069040 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.641+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94777475025520] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8040040 con 0x7f40c8069040 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.641+0000 7f40e221d800 20 remove_watcher() i=3 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.641+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94777475030432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb16b0 con 0x563319ba4970 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.642+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94777475030432] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d8040040 con 0x563319ba4970 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.642+0000 7f40e221d800 20 remove_watcher() i=4 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.642+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94777475024320] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb5da0 con 0x563319ba9360 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.643+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94777475024320] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.643+0000 7f40e221d800 20 remove_watcher() i=5 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.643+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94777475035408] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb16b0 con 0x563319ba9360 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.644+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94777475035408] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.652 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.644+0000 7f40e221d800 20 remove_watcher() i=6 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.644+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94777475038960] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x563319bb7110 con 0x563319ba9360 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40dd9f2640 1 -- 172.21.15.102:0/617610589 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94777475038960] v37'263 uv261 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f40d0071030 con 0x563319ba9360 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 20 remove_watcher() i=7 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319ba9360 msgr2=0x563319bab750 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319ba9360 0x563319bab750 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319ba4970 msgr2=0x563319ba6e30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319ba4970 0x563319ba6e30 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f40c8069040 msgr2=0x7f40c806a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f40c8069040 0x7f40c806a940 crc :-1 s=READY pgs=98 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319badcc0 msgr2=0x563319bb0180 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319badcc0 0x563319bb0180 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fa803cfb0 msgr2=0x7f3fa803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fa803cfb0 0x7f3fa803f470 secure :-1 s=READY pgs=334 cs=0 l=1 rev1=1 crypto rx=0x7f40c8000c00 tx=0x7f40c806d040 comp rx=0 tx=0).stop 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 msgr2=0x563319a6d650 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40de1f3640 1 -- 172.21.15.102:0/617610589 reap_dead start 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319a6d650 secure :-1 s=READY pgs=800 cs=0 l=1 rev1=1 crypto rx=0x7f40d003a810 tx=0x7f40d003b8d0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 shutdown_connections 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 --2- 172.21.15.102:0/617610589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b8fe10 0x563319a6d650 unknown :-1 s=CLOSED pgs=800 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 >> 172.21.15.102:0/617610589 conn(0x563319b8c210 msgr2=0x563319b8a420 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 shutdown_connections 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.645+0000 7f40e221d800 1 -- 172.21.15.102:0/617610589 wait complete. 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/3874877889 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fb803cfb0 msgr2=0x7f3fb803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/3874877889 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fb803cfb0 0x7f3fb803f470 secure :-1 s=READY pgs=333 cs=0 l=1 rev1=1 crypto rx=0x563319b6d180 tx=0x7f40c8005ac0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/3874877889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b837b0 msgr2=0x563319b83bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/3874877889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b837b0 0x563319b83bd0 secure :-1 s=READY pgs=798 cs=0 l=1 rev1=1 crypto rx=0x7f40d000e750 tx=0x7f40d0046f50 comp rx=0 tx=0).stop 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/3874877889 shutdown_connections 2024-09-19T11:15:40.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/3874877889 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fb803cfb0 0x7f3fb803f470 unknown :-1 s=CLOSED pgs=333 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/3874877889 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319b837b0 0x563319b83bd0 unknown :-1 s=CLOSED pgs=798 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/3874877889 >> 172.21.15.102:0/3874877889 conn(0x563319b77b60 msgr2=0x563319b77f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/3874877889 shutdown_connections 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/3874877889 wait complete. 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319b6f000 msgr2=0x563319b713f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x563319b6f000 0x563319b713f0 crc :-1 s=READY pgs=185 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319b6a760 msgr2=0x563319b6cb50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x563319b6a760 0x563319b6cb50 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319b72f00 msgr2=0x563319b752f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x563319b72f00 0x563319b752f0 crc :-1 s=READY pgs=186 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fc403d000 msgr2=0x7f3fc403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3fc403d000 0x7f3fc403f4c0 secure :-1 s=READY pgs=332 cs=0 l=1 rev1=1 crypto rx=0x7f40c8057000 tx=0x7f40c8052000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.655 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 msgr2=0x563319b65120 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 --2- 172.21.15.102:0/427673466 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x563319a71aa0 0x563319b65120 secure :-1 s=READY pgs=797 cs=0 l=1 rev1=1 crypto rx=0x563319b5e320 tx=0x7f40d0000ed0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40de1f3640 1 -- 172.21.15.102:0/427673466 reap_dead start 2024-09-19T11:15:40.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 shutdown_connections 2024-09-19T11:15:40.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 >> 172.21.15.102:0/427673466 conn(0x563319a67a70 msgr2=0x563319b5e900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 shutdown_connections 2024-09-19T11:15:40.656 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.646+0000 7f40e221d800 1 -- 172.21.15.102:0/427673466 wait complete. 2024-09-19T11:15:40.657 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.657 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.657 ERROR:root:0 2024-09-19T11:15:40.657 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:40.670 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:40.670 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-19T11:15:40.670 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-19T11:15:40.670 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-19T11:15:40.716 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:40.717 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.716+0000 7f952f90c800 1 Processor -- start 2024-09-19T11:15:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.716+0000 7f952f90c800 1 -- start start 2024-09-19T11:15:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.716+0000 7f952f90c800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557c051a96a0 0x557c051aa3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.717+0000 7f952f90c800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x557c051a9d50 con 0x557c051aa8e0 2024-09-19T11:15:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.717+0000 7f952f90c800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x557c050357d0 con 0x557c051a96a0 2024-09-19T11:15:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.717+0000 7f952d3f6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x557c051a96a0 0x557c051aa3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.717+0000 7f9524bf5640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x557c051aa8e0 0x557c051af640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34806/0 (socket says 172.21.15.102:34806) 2024-09-19T11:15:40.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.717+0000 7f9524bf5640 1 -- 172.21.15.102:0/4247296533 learned_addr learned my addr 172.21.15.102:0/4247296533 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:40.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.717+0000 7f952d3f6640 1 -- 172.21.15.102:0/4247296533 >> v1:172.21.15.37:6789/0 conn(0x557c051aa8e0 legacy=0x557c051af640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.719 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.717+0000 7f952d3f6640 1 -- 172.21.15.102:0/4247296533 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c051aad90 con 0x557c051a96a0 2024-09-19T11:15:40.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.719+0000 7f952d3f6640 1 --2- 172.21.15.102:0/4247296533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c051aa3a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f952000a470 tx=0x7f9520045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b71cc62327b839c8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.719+0000 7f952cbf5640 1 -- 172.21.15.102:0/4247296533 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520053570 con 0x557c051a96a0 2024-09-19T11:15:40.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.719+0000 7f952cbf5640 1 -- 172.21.15.102:0/4247296533 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520058070 con 0x557c051a96a0 2024-09-19T11:15:40.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.719+0000 7f952cbf5640 1 -- 172.21.15.102:0/4247296533 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520053880 con 0x557c051a96a0 2024-09-19T11:15:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.720+0000 7f952f90c800 1 -- 172.21.15.102:0/4247296533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 msgr2=0x557c051aa3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.720+0000 7f952f90c800 1 --2- 172.21.15.102:0/4247296533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c051aa3a0 secure :-1 s=READY pgs=802 cs=0 l=1 rev1=1 crypto rx=0x7f952000a470 tx=0x7f9520045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.720+0000 7f952f90c800 1 -- 172.21.15.102:0/4247296533 shutdown_connections 2024-09-19T11:15:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.720+0000 7f952f90c800 1 --2- 172.21.15.102:0/4247296533 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c051aa3a0 unknown :-1 s=CLOSED pgs=802 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.720+0000 7f952f90c800 1 -- 172.21.15.102:0/4247296533 >> 172.21.15.102:0/4247296533 conn(0x557c051a4a70 msgr2=0x557c051a6ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.720+0000 7f952f90c800 1 -- 172.21.15.102:0/4247296533 shutdown_connections 2024-09-19T11:15:40.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.720+0000 7f952f90c800 1 -- 172.21.15.102:0/4247296533 wait complete. 2024-09-19T11:15:40.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.733+0000 7f952f90c800 1 Processor -- start 2024-09-19T11:15:40.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.733+0000 7f952f90c800 1 -- start start 2024-09-19T11:15:40.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f952f90c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c0529a3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f952f90c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557c05042dd0 con 0x557c051a96a0 2024-09-19T11:15:40.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c0529a3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c0529a3a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39810/0 (socket says 172.21.15.102:39810) 2024-09-19T11:15:40.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f952d3f6640 1 -- 172.21.15.102:0/446781202 learned_addr learned my addr 172.21.15.102:0/446781202 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f952d3f6640 1 -- 172.21.15.102:0/446781202 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c0529a990 con 0x557c051a96a0 2024-09-19T11:15:40.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f952d3f6640 1 --2- 172.21.15.102:0/446781202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c0529a3a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9520025c20 tx=0x7f9520051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ae3d8b83dc31a013 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f941b606640 1 -- 172.21.15.102:0/446781202 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f952005c580 con 0x557c051a96a0 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.734+0000 7f941b606640 1 -- 172.21.15.102:0/446781202 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520063030 con 0x557c051a96a0 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.735+0000 7f941b606640 1 -- 172.21.15.102:0/446781202 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f952005c850 con 0x557c051a96a0 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.735+0000 7f952f90c800 1 -- 172.21.15.102:0/446781202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 msgr2=0x557c0529a3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.735+0000 7f952f90c800 1 --2- 172.21.15.102:0/446781202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c0529a3a0 secure :-1 s=READY pgs=803 cs=0 l=1 rev1=1 crypto rx=0x7f9520025c20 tx=0x7f9520051000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.735+0000 7f952f90c800 1 -- 172.21.15.102:0/446781202 shutdown_connections 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.735+0000 7f952f90c800 1 --2- 172.21.15.102:0/446781202 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c0529a3a0 unknown :-1 s=CLOSED pgs=803 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.735+0000 7f952f90c800 1 -- 172.21.15.102:0/446781202 >> 172.21.15.102:0/446781202 conn(0x557c051a4a70 msgr2=0x557c05298780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.735+0000 7f952f90c800 1 -- 172.21.15.102:0/446781202 shutdown_connections 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.735+0000 7f952f90c800 1 -- 172.21.15.102:0/446781202 wait complete. 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952f90c800 1 Processor -- start 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952f90c800 1 -- start start 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952f90c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c052a1e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952f90c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557c051b0d60 con 0x557c051a96a0 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c052a1e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c052a1e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39826/0 (socket says 172.21.15.102:39826) 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952d3f6640 1 -- 172.21.15.102:0/2861068641 learned_addr learned my addr 172.21.15.102:0/2861068641 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952d3f6640 1 -- 172.21.15.102:0/2861068641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c052a2370 con 0x557c051a96a0 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.736+0000 7f952d3f6640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c052a1e10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9520045f50 tx=0x7f9520002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.737+0000 7f9419e03640 1 -- 172.21.15.102:0/2861068641 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520054ad0 con 0x557c051a96a0 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.737+0000 7f9419e03640 1 -- 172.21.15.102:0/2861068641 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520054c70 con 0x557c051a96a0 2024-09-19T11:15:40.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.737+0000 7f9419e03640 1 -- 172.21.15.102:0/2861068641 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520068420 con 0x557c051a96a0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.737+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c052a2600 con 0x557c051a96a0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.737+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c052a3000 con 0x557c051a96a0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.737+0000 7f9419e03640 1 -- 172.21.15.102:0/2861068641 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f95200685c0 con 0x557c051a96a0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f9419e03640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f941403d000 0x7f941403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f9419e03640 1 -- 172.21.15.102:0/2861068641 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f9520070030 con 0x557c051a96a0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f9524bf5640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f941403d000 0x7f941403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f952f90c800 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c051aa8e0 0x557c052a9460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052a99a0 con 0x557c051aa8e0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f952dbf7640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c051aa8e0 0x557c052a9460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f9524bf5640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f941403d000 0x7f941403f4c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9518001d70 tx=0x7f95180012d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f952dbf7640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c051aa8e0 0x557c052a9460 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f952dbf7640 1 -- 172.21.15.102:0/2861068641 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c051aa8e0 2024-09-19T11:15:40.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.738+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052a9d40 con 0x557c051aa8e0 2024-09-19T11:15:40.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.739+0000 7f952dbf7640 1 -- 172.21.15.102:0/2861068641 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f952800a4d0 con 0x557c051aa8e0 2024-09-19T11:15:40.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.739+0000 7f952f90c800 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052ab800 0x557c052adca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.739+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052ae430 con 0x557c052ab800 2024-09-19T11:15:40.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.739+0000 7f952d3f6640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052ab800 0x557c052adca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.739+0000 7f952d3f6640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052ab800 0x557c052adca0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.740+0000 7f952d3f6640 1 -- 172.21.15.102:0/2861068641 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f9520051070 con 0x557c052ab800 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.740+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052aa590 con 0x557c051aa8e0 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.740+0000 7f952dbf7640 1 -- 172.21.15.102:0/2861068641 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f952800a4d0 con 0x557c051aa8e0 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.740+0000 7f952f90c800 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052af890 0x557c052b1c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.740+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052b2410 con 0x557c052af890 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.740+0000 7f9524bf5640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052af890 0x557c052b1c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.740+0000 7f9524bf5640 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052af890 0x557c052b1c80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.741+0000 7f9524bf5640 1 -- 172.21.15.102:0/2861068641 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f9518009050 con 0x557c052af890 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.741+0000 7f952f90c800 1 Processor -- start 2024-09-19T11:15:40.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.741+0000 7f952f90c800 1 -- start start 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.741+0000 7f952f90c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052c0150 0x557c052c0570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.741+0000 7f952f90c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557c050a14a0 con 0x557c052c0150 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.741+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052c0150 0x557c052c0570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.741+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052c0150 0x557c052c0570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39832/0 (socket says 172.21.15.102:39832) 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.741+0000 7f952d3f6640 1 -- 172.21.15.102:0/510343025 learned_addr learned my addr 172.21.15.102:0/510343025 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.742+0000 7f952d3f6640 1 -- 172.21.15.102:0/510343025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c052c0bb0 con 0x557c052c0150 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.742+0000 7f952d3f6640 1 --2- 172.21.15.102:0/510343025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052c0150 0x557c052c0570 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9520074fd0 tx=0x7f95200744e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.742+0000 7f9412ffd640 1 -- 172.21.15.102:0/510343025 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f952008e020 con 0x557c052c0150 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.742+0000 7f9412ffd640 1 -- 172.21.15.102:0/510343025 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520091250 con 0x557c052c0150 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.742+0000 7f9412ffd640 1 -- 172.21.15.102:0/510343025 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f9520096e60 con 0x557c052c0150 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.742+0000 7f952f90c800 1 -- 172.21.15.102:0/510343025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c052c13e0 con 0x557c052c0150 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.742+0000 7f952f90c800 1 -- 172.21.15.102:0/510343025 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c052c13e0 con 0x557c052c0150 2024-09-19T11:15:40.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.743+0000 7f9412ffd640 1 -- 172.21.15.102:0/510343025 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f9520068bc0 con 0x557c052c0150 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.743+0000 7f9412ffd640 1 --2- 172.21.15.102:0/510343025 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f940803cfb0 0x7f940803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.743+0000 7f9412ffd640 1 -- 172.21.15.102:0/510343025 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f95200610e0 con 0x557c052c0150 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.743+0000 7f9524bf5640 1 --2- 172.21.15.102:0/510343025 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f940803cfb0 0x7f940803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.743+0000 7f952f90c800 1 Processor -- start 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.743+0000 7f952f90c800 1 -- start start 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.743+0000 7f9524bf5640 1 --2- 172.21.15.102:0/510343025 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f940803cfb0 0x7f940803f470 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f951800bf40 tx=0x7f951800f000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f952f90c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052ccc00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f952f90c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557c0529ad60 con 0x557c052cc820 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052ccc00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052ccc00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39840/0 (socket says 172.21.15.102:39840) 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f952d3f6640 1 -- 172.21.15.102:0/74442529 learned_addr learned my addr 172.21.15.102:0/74442529 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f952d3f6640 1 -- 172.21.15.102:0/74442529 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c052cd1f0 con 0x557c052cc820 2024-09-19T11:15:40.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f952d3f6640 1 --2- 172.21.15.102:0/74442529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052ccc00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f952007f080 tx=0x7f9520067670 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b6ffb0b9bd5c135 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f9410ff9640 1 -- 172.21.15.102:0/74442529 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200b1070 con 0x557c052cc820 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f9410ff9640 1 -- 172.21.15.102:0/74442529 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f952008ad10 con 0x557c052cc820 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.744+0000 7f9410ff9640 1 -- 172.21.15.102:0/74442529 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200951d0 con 0x557c052cc820 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 -- 172.21.15.102:0/74442529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 msgr2=0x557c052ccc00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 --2- 172.21.15.102:0/74442529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052ccc00 secure :-1 s=READY pgs=806 cs=0 l=1 rev1=1 crypto rx=0x7f952007f080 tx=0x7f9520067670 comp rx=0 tx=0).stop 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 -- 172.21.15.102:0/74442529 shutdown_connections 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 --2- 172.21.15.102:0/74442529 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052ccc00 unknown :-1 s=CLOSED pgs=806 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 -- 172.21.15.102:0/74442529 >> 172.21.15.102:0/74442529 conn(0x557c052c8c20 msgr2=0x557c052c6e60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 -- 172.21.15.102:0/74442529 shutdown_connections 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 -- 172.21.15.102:0/74442529 wait complete. 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 Processor -- start 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 -- start start 2024-09-19T11:15:40.754 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052d3c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.745+0000 7f952f90c800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x557c052cd680 con 0x557c052cc820 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052d3c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f952d3f6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052d3c60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39844/0 (socket says 172.21.15.102:39844) 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 learned_addr learned my addr 172.21.15.102:0/3289050729 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x557c052d41c0 con 0x557c052cc820 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f952d3f6640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052d3c60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9520098750 tx=0x7f952008f840 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f93feffd640 1 -- 172.21.15.102:0/3289050729 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200bc020 con 0x557c052cc820 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f93feffd640 1 -- 172.21.15.102:0/3289050729 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f9520091e30 con 0x557c052cc820 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f93feffd640 1 -- 172.21.15.102:0/3289050729 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f95200b1030 con 0x557c052cc820 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x557c052d41c0 con 0x557c052cc820 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.746+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x557c052d41c0 con 0x557c052cc820 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.747+0000 7f93feffd640 1 -- 172.21.15.102:0/3289050729 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f95200bf020 con 0x557c052cc820 2024-09-19T11:15:40.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.747+0000 7f93feffd640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93f803cf10 0x7f93f803f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.747+0000 7f93feffd640 1 -- 172.21.15.102:0/3289050729 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f95200b2070 con 0x557c052cc820 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.747+0000 7f9524bf5640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93f803cf10 0x7f93f803f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.748+0000 7f9524bf5640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93f803cf10 0x7f93f803f3d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f951800c010 tx=0x7f9518010000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.748+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.748+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c052defa0 0x557c052e1460 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.748+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e1bb0 con 0x557c052defa0 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.748+0000 7f952dbf7640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c052defa0 0x557c052e1460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.748+0000 7f952dbf7640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c052defa0 0x557c052e1460 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 realm 2024-09-19T11:15:40.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e1fc0 con 0x557c052defa0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2890 con 0x557c052defa0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052e3990 0x557c052e5d80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.749+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e6340 con 0x557c052e3990 2024-09-19T11:15:40.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.750+0000 7f952d3f6640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052e3990 0x557c052e5d80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.750+0000 7f952d3f6640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052e3990 0x557c052e5d80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.750+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.750+0000 7f952f90c800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.750+0000 7f952f90c800 20 searching for the correct realm 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.750+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052e82f0 0x557c052ea7b0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.750+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052eae80 con 0x557c052e82f0 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.750+0000 7f9524bf5640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052e82f0 0x557c052ea7b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.751+0000 7f9524bf5640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052e82f0 0x557c052ea7b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.751+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.751+0000 7f9524bf5640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f9518037040 0x7f9518036410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.751+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052eae80 con 0x7f9518037040 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.751+0000 7f952dbf7640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f9518037040 0x7f9518036410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.751+0000 7f952dbf7640 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f9518037040 0x7f9518036410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.751+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.770 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.751+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e3990 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.752+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.752+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.752+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.752+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.752+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.752+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e3990 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.752+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.752+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e3990 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.753+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.753+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x7f9518037040 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.753+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.753+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e82f0 2024-09-19T11:15:40.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.753+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.753+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.753+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.753+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e3990 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.754+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.754+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.754+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.754+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x7f9518037040 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.754+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.754+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e82f0 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.754+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.754+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e82f0 2024-09-19T11:15:40.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.755+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.755+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e3990 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.755+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.755+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e82f0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.755+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.755+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e82f0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.755+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.755+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.756+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.756+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.756+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.756+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e3990 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.756+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.773 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.756+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e82f0 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.756+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.756+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x7f9518037040 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.757+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.757+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.757+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.757+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e3990 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.757+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.757+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e82f0 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.757+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.757+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e3990 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.758+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.774 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.758+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x7f9518037040 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.758+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.758+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052e82f0 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.758+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.758+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x7f9518037040 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.758+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.758+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x557c052defa0 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x557c052e2c30 con 0x7f9518037040 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:40.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e6c00 con 0x557c052defa0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e6c00 con 0x557c052defa0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.759+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e6c00 con 0x557c052e82f0 2024-09-19T11:15:40.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 zone default found 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 4 Realm: () 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 zonegroup default 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052e7500 con 0x557c052e3990 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052ecdf0 con 0x557c052e82f0 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052ed330 con 0x557c052e82f0 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 started sync module instance, tier type = 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.760+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ec190 con 0x7f9518037040 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.761+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.761+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 93991151257264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ec190 con 0x7f9518037040 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.761+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052eddb0 con 0x557c052defa0 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.762+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 93991151257264] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.778 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.763+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.763+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 93991151262432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ec190 con 0x557c052defa0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.763+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ee840 con 0x557c052e82f0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.764+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 93991151262432] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.764+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.764+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 93991151254752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ec100 con 0x557c052e82f0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.764+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ef700 con 0x7f9518037040 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.765+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 93991151254752] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.765+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.765+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 93991151268432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ef670 con 0x7f9518037040 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.765+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f05c0 con 0x557c052defa0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.766+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.766+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 93991151272208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f09e0 con 0x557c052defa0 2024-09-19T11:15:40.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.766+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f1400 con 0x557c052e3990 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.766+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 93991151268432] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.767+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.767+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 93991151275760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f17f0 con 0x557c052e3990 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.767+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f21f0 con 0x557c052e3990 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.767+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 93991151272208] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.768+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 93991151275760] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.768+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.768+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 93991151273264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f2590 con 0x557c052e3990 2024-09-19T11:15:40.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.768+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f2e20 con 0x557c052e3990 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 93991151273264] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'264 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 93991151279360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f2a40 con 0x557c052e3990 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952f90c800 20 add_watcher() i=0 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952f90c800 20 add_watcher() i=1 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952f90c800 20 add_watcher() i=2 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952f90c800 20 add_watcher() i=3 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952f90c800 20 add_watcher() i=4 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952f90c800 20 add_watcher() i=5 2024-09-19T11:15:40.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.769+0000 7f952f90c800 20 add_watcher() i=6 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.771+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 93991151279360] v37'265 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.771+0000 7f952f90c800 20 add_watcher() i=7 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.771+0000 7f952f90c800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.771+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c052f62d0 con 0x557c052defa0 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.771+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.771+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 93991151282016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052f37f0 con 0x557c052defa0 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.772+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 93991151282016] v37'261 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.772+0000 7f93e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.772+0000 7f952f90c800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.772+0000 7f952f90c800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.772+0000 7f952f90c800 5 note: GC not initialized 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.772+0000 7f93e27e4640 20 reqs_thread_entry: start 2024-09-19T11:15:40.785 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.772+0000 7f952f90c800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 20 Filter name: none 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f9353fff640 20 reqs_thread_entry: start 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c05329210 con 0x557c052e3990 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv7 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 20 rados_obj.operate() r=0 bl.length=490 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.773+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~503 in=503b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c0532f750 con 0x557c052e3990 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.774+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~503] v37'8 uv8 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.786 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.774+0000 7f952f90c800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.774+0000 7f952f90c800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.774+0000 7f952f90c800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.774+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 93991151530320 in=691b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x557c0532adb0 con 0x557c052defa0 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.775+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 93991151272208 notify 158913789990 ret 0) ==== 721+0+0 (crc 0 0 0) 0x7f95280189f0 con 0x557c052defa0 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.775+0000 7f9410ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789990 cookie 93991151272208 notifier 4897 bl.length()=679 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.775+0000 7f9410ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.775+0000 7f9410ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.775+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 93991151530320 out=8b] v0'0 uv264 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.775+0000 7f9410ff9640 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f93f0003ea0 con 0x557c052defa0 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.775+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.787 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.775+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 93991151530320 notify 158913789990 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f9528018bc0 con 0x557c052defa0 2024-09-19T11:15:40.788 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.776+0000 7f93e37e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.776+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 93991151282016] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c05327080 con 0x557c052defa0 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.777+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 93991151282016] v37'262 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.777+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 93991151257264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c05327080 con 0x7f9518037040 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.778+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 93991151257264] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.778+0000 7f952f90c800 20 remove_watcher() i=0 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.778+0000 7f952f90c800 2 removed watcher, disabling cache 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.778+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 93991151262432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c05327080 con 0x557c052defa0 2024-09-19T11:15:40.793 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.779+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 93991151262432] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.779+0000 7f952f90c800 20 remove_watcher() i=1 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.779+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 93991151254752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c05327080 con 0x557c052e82f0 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.781+0000 7f9524bf5640 1 -- 172.21.15.102:0/3289050729 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 93991151254752] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f9518009050 con 0x557c052e82f0 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.781+0000 7f952f90c800 20 remove_watcher() i=2 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.781+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 93991151268432] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052edae0 con 0x7f9518037040 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.782+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 93991151268432] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x7f9518037040 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.782+0000 7f952f90c800 20 remove_watcher() i=3 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.782+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 93991151272208] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ebce0 con 0x557c052defa0 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.783+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 93991151272208] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952800a4d0 con 0x557c052defa0 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.783+0000 7f952f90c800 20 remove_watcher() i=4 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.783+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 93991151275760] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ef250 con 0x557c052e3990 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.784+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 93991151275760] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.794 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.784+0000 7f952f90c800 20 remove_watcher() i=5 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.784+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 93991151273264] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052edae0 con 0x557c052e3990 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.785+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 93991151273264] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.785+0000 7f952f90c800 20 remove_watcher() i=6 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.785+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 93991151279360] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x557c052ebce0 con 0x557c052e3990 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952d3f6640 1 -- 172.21.15.102:0/3289050729 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 93991151279360] v37'266 uv264 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f952009e020 con 0x557c052e3990 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 20 remove_watcher() i=7 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052e3990 msgr2=0x557c052e5d80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052e3990 0x557c052e5d80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c052defa0 msgr2=0x557c052e1460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c052defa0 0x557c052e1460 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f9518037040 msgr2=0x7f9518036410 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f9518037040 0x7f9518036410 crc :-1 s=READY pgs=99 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052e82f0 msgr2=0x557c052ea7b0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052e82f0 0x557c052ea7b0 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93f803cf10 msgr2=0x7f93f803f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f93f803cf10 0x7f93f803f3d0 secure :-1 s=READY pgs=337 cs=0 l=1 rev1=1 crypto rx=0x7f951800c010 tx=0x7f9518010000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 msgr2=0x557c052d3c60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952dbf7640 1 -- 172.21.15.102:0/3289050729 reap_dead start 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052d3c60 secure :-1 s=READY pgs=807 cs=0 l=1 rev1=1 crypto rx=0x7f9520098750 tx=0x7f952008f840 comp rx=0 tx=0).stop 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 shutdown_connections 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 --2- 172.21.15.102:0/3289050729 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052cc820 0x557c052d3c60 unknown :-1 s=CLOSED pgs=807 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 >> 172.21.15.102:0/3289050729 conn(0x557c052c8c20 msgr2=0x557c052c6e30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 shutdown_connections 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.786+0000 7f952f90c800 1 -- 172.21.15.102:0/3289050729 wait complete. 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/510343025 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f940803cfb0 msgr2=0x7f940803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/510343025 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f940803cfb0 0x7f940803f470 secure :-1 s=READY pgs=336 cs=0 l=1 rev1=1 crypto rx=0x7f951800bf40 tx=0x7f951800f000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/510343025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052c0150 msgr2=0x557c052c0570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/510343025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052c0150 0x557c052c0570 secure :-1 s=READY pgs=805 cs=0 l=1 rev1=1 crypto rx=0x7f9520074fd0 tx=0x7f95200744e0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/510343025 shutdown_connections 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/510343025 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f940803cfb0 0x7f940803f470 unknown :-1 s=CLOSED pgs=336 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/510343025 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c052c0150 0x557c052c0570 unknown :-1 s=CLOSED pgs=805 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/510343025 >> 172.21.15.102:0/510343025 conn(0x557c052b4500 msgr2=0x557c052b48e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/510343025 shutdown_connections 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/510343025 wait complete. 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052ab800 msgr2=0x557c052adca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x557c052ab800 0x557c052adca0 crc :-1 s=READY pgs=187 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c051aa8e0 msgr2=0x557c052a9460 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x557c051aa8e0 0x557c052a9460 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052af890 msgr2=0x557c052b1c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.797 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x557c052af890 0x557c052b1c80 crc :-1 s=READY pgs=188 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f941403d000 msgr2=0x7f941403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f941403d000 0x7f941403f4c0 secure :-1 s=READY pgs=335 cs=0 l=1 rev1=1 crypto rx=0x7f9518001d70 tx=0x7f95180012d0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 msgr2=0x557c052a1e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 --2- 172.21.15.102:0/2861068641 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x557c051a96a0 0x557c052a1e10 secure :-1 s=READY pgs=804 cs=0 l=1 rev1=1 crypto rx=0x7f9520045f50 tx=0x7f9520002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952dbf7640 1 -- 172.21.15.102:0/2861068641 reap_dead start 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 shutdown_connections 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 >> 172.21.15.102:0/2861068641 conn(0x557c051a4a70 msgr2=0x557c05293c20 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 shutdown_connections 2024-09-19T11:15:40.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.787+0000 7f952f90c800 1 -- 172.21.15.102:0/2861068641 wait complete. 2024-09-19T11:15:40.799 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.799 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.799 ERROR:root:0 2024-09-19T11:15:40.799 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:40.812 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:40.813 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-19T11:15:40.813 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'users=read, write; user-info-without-keys=*'] 2024-09-19T11:15:40.813 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps 'users=read, write; user-info-without-keys=*' 2024-09-19T11:15:40.860 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:40.860 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:40.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.859+0000 7f5c045ad800 1 Processor -- start 2024-09-19T11:15:40.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c045ad800 1 -- start start 2024-09-19T11:15:40.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c045ad800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564e6dc028a0 0x564e6dc03460 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c045ad800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x564e6dc02f50 con 0x564e6dc039a0 2024-09-19T11:15:40.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c045ad800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x564e6da8d7d0 con 0x564e6dc028a0 2024-09-19T11:15:40.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c02097640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564e6dc028a0 0x564e6dc03460 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c01896640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x564e6dc039a0 0x564e6dc08700 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34812/0 (socket says 172.21.15.102:34812) 2024-09-19T11:15:40.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c02097640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x564e6dc028a0 0x564e6dc03460 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39854/0 (socket says 172.21.15.102:39854) 2024-09-19T11:15:40.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c01896640 1 -- 172.21.15.102:0/181327387 learned_addr learned my addr 172.21.15.102:0/181327387 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:40.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c02097640 1 -- 172.21.15.102:0/181327387 >> v1:172.21.15.37:6789/0 conn(0x564e6dc039a0 legacy=0x564e6dc08700 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c02097640 1 -- 172.21.15.102:0/181327387 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6dc03e50 con 0x564e6dc028a0 2024-09-19T11:15:40.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.860+0000 7f5c01095640 1 -- 172.21.15.102:0/181327387 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1430005004 0 0) 0x564e6dc02f50 con 0x564e6dc039a0 2024-09-19T11:15:40.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.862+0000 7f5c02097640 1 --2- 172.21.15.102:0/181327387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6dc03460 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400a470 tx=0x7f5bf4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f9d4796a71906aaf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.862+0000 7f5c01095640 1 -- 172.21.15.102:0/181327387 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4053570 con 0x564e6dc028a0 2024-09-19T11:15:40.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.862+0000 7f5c01095640 1 -- 172.21.15.102:0/181327387 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4058070 con 0x564e6dc028a0 2024-09-19T11:15:40.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.862+0000 7f5c01095640 1 -- 172.21.15.102:0/181327387 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4053880 con 0x564e6dc028a0 2024-09-19T11:15:40.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.863+0000 7f5c045ad800 1 -- 172.21.15.102:0/181327387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 msgr2=0x564e6dc03460 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.863+0000 7f5c045ad800 1 --2- 172.21.15.102:0/181327387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6dc03460 secure :-1 s=READY pgs=809 cs=0 l=1 rev1=1 crypto rx=0x7f5bf400a470 tx=0x7f5bf4045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:40.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.863+0000 7f5c045ad800 1 -- 172.21.15.102:0/181327387 shutdown_connections 2024-09-19T11:15:40.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.863+0000 7f5c045ad800 1 --2- 172.21.15.102:0/181327387 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6dc03460 unknown :-1 s=CLOSED pgs=809 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.863+0000 7f5c045ad800 1 -- 172.21.15.102:0/181327387 >> 172.21.15.102:0/181327387 conn(0x564e6dbfdc70 msgr2=0x564e6dc000d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.863+0000 7f5c045ad800 1 -- 172.21.15.102:0/181327387 shutdown_connections 2024-09-19T11:15:40.865 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.863+0000 7f5c045ad800 1 -- 172.21.15.102:0/181327387 wait complete. 2024-09-19T11:15:40.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.877+0000 7f5c045ad800 1 Processor -- start 2024-09-19T11:15:40.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.877+0000 7f5c045ad800 1 -- start start 2024-09-19T11:15:40.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.877+0000 7f5c045ad800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6db78170 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.877+0000 7f5c045ad800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e6da9add0 con 0x564e6dc028a0 2024-09-19T11:15:40.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.877+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6db78170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.877+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6db78170 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39868/0 (socket says 172.21.15.102:39868) 2024-09-19T11:15:40.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.877+0000 7f5c02097640 1 -- 172.21.15.102:0/2407039818 learned_addr learned my addr 172.21.15.102:0/2407039818 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.878+0000 7f5c02097640 1 -- 172.21.15.102:0/2407039818 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6db78760 con 0x564e6dc028a0 2024-09-19T11:15:40.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.878+0000 7f5c02097640 1 --2- 172.21.15.102:0/2407039818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6db78170 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005870 tx=0x7f5bf4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c3df3854585c9daf server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.878+0000 7f5af0608640 1 -- 172.21.15.102:0/2407039818 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf405c580 con 0x564e6dc028a0 2024-09-19T11:15:40.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.878+0000 7f5af0608640 1 -- 172.21.15.102:0/2407039818 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4063030 con 0x564e6dc028a0 2024-09-19T11:15:40.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.878+0000 7f5af0608640 1 -- 172.21.15.102:0/2407039818 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf405c850 con 0x564e6dc028a0 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 -- 172.21.15.102:0/2407039818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 msgr2=0x564e6db78170 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 --2- 172.21.15.102:0/2407039818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6db78170 secure :-1 s=READY pgs=810 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4005870 tx=0x7f5bf4051000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 -- 172.21.15.102:0/2407039818 shutdown_connections 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 --2- 172.21.15.102:0/2407039818 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6db78170 unknown :-1 s=CLOSED pgs=810 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 -- 172.21.15.102:0/2407039818 >> 172.21.15.102:0/2407039818 conn(0x564e6dbfdc70 msgr2=0x564e6dcedb40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 -- 172.21.15.102:0/2407039818 shutdown_connections 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 -- 172.21.15.102:0/2407039818 wait complete. 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 Processor -- start 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 -- start start 2024-09-19T11:15:40.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6dcfbdd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.879+0000 7f5c045ad800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e6dc09e20 con 0x564e6dc028a0 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6dcfbdd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6dcfbdd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39882/0 (socket says 172.21.15.102:39882) 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5c02097640 1 -- 172.21.15.102:0/1990560332 learned_addr learned my addr 172.21.15.102:0/1990560332 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5c02097640 1 -- 172.21.15.102:0/1990560332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6dcfc330 con 0x564e6dc028a0 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5c02097640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6dcfbdd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4045f50 tx=0x7f5bf4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5aeee05640 1 -- 172.21.15.102:0/1990560332 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4078070 con 0x564e6dc028a0 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5aeee05640 1 -- 172.21.15.102:0/1990560332 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4054a70 con 0x564e6dc028a0 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e6dcfc5c0 con 0x564e6dc028a0 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5aeee05640 1 -- 172.21.15.102:0/1990560332 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4054d50 con 0x564e6dc028a0 2024-09-19T11:15:40.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.880+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6dcfd1d0 con 0x564e6dc028a0 2024-09-19T11:15:40.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.881+0000 7f5aeee05640 1 -- 172.21.15.102:0/1990560332 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5bf407b070 con 0x564e6dc028a0 2024-09-19T11:15:40.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.881+0000 7f5aeee05640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ae803d000 0x7f5ae803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5aeee05640 1 -- 172.21.15.102:0/1990560332 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f5bf4070070 con 0x564e6dc028a0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5c01896640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ae803d000 0x7f5ae803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dc039a0 0x564e6dd03420 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd03960 con 0x564e6dc039a0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5c02898640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dc039a0 0x564e6dd03420 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5c01896640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ae803d000 0x7f5ae803f4c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8000c00 tx=0x7f5bf80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5c02898640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dc039a0 0x564e6dd03420 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5c02898640 1 -- 172.21.15.102:0/1990560332 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dc039a0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.882+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd03d00 con 0x564e6dc039a0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.883+0000 7f5c02898640 1 -- 172.21.15.102:0/1990560332 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dc039a0 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.883+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd05800 0x564e6dd07c80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.883+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd08410 con 0x564e6dd05800 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.883+0000 7f5c02097640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd05800 0x564e6dd07c80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.883+0000 7f5c02097640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd05800 0x564e6dd07c80 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.884+0000 7f5c02097640 1 -- 172.21.15.102:0/1990560332 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f5bf407a030 con 0x564e6dd05800 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.884+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd04550 con 0x564e6dc039a0 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.884+0000 7f5c02898640 1 -- 172.21.15.102:0/1990560332 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dc039a0 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.884+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd09870 0x564e6dd0bc60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.884+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd0c3d0 con 0x564e6dd09870 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.884+0000 7f5c01896640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd09870 0x564e6dd0bc60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.884+0000 7f5c01896640 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd09870 0x564e6dd0bc60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.885+0000 7f5c01896640 1 -- 172.21.15.102:0/1990560332 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f5bf800f670 con 0x564e6dd09870 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.885+0000 7f5c045ad800 1 Processor -- start 2024-09-19T11:15:40.888 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.885+0000 7f5c045ad800 1 -- start start 2024-09-19T11:15:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.885+0000 7f5c045ad800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd1a110 0x564e6dd1a530 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.885+0000 7f5c045ad800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e6daf94a0 con 0x564e6dd1a110 2024-09-19T11:15:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd1a110 0x564e6dd1a530 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd1a110 0x564e6dd1a530 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39892/0 (socket says 172.21.15.102:39892) 2024-09-19T11:15:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5c02097640 1 -- 172.21.15.102:0/1021945328 learned_addr learned my addr 172.21.15.102:0/1021945328 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.889 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5c02097640 1 -- 172.21.15.102:0/1021945328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6dd1ab70 con 0x564e6dd1a110 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5c02097640 1 --2- 172.21.15.102:0/1021945328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd1a110 0x564e6dd1a530 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5bf407c8d0 tx=0x7f5bf407c470 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5ae7fff640 1 -- 172.21.15.102:0/1021945328 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4009b40 con 0x564e6dd1a110 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5ae7fff640 1 -- 172.21.15.102:0/1021945328 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4009ce0 con 0x564e6dd1a110 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5c045ad800 1 -- 172.21.15.102:0/1021945328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e6dd1b3a0 con 0x564e6dd1a110 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5ae7fff640 1 -- 172.21.15.102:0/1021945328 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4096a70 con 0x564e6dd1a110 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.886+0000 7f5c045ad800 1 -- 172.21.15.102:0/1021945328 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6dd1b940 con 0x564e6dd1a110 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.887+0000 7f5ae7fff640 1 -- 172.21.15.102:0/1021945328 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5bf4096c10 con 0x564e6dd1a110 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.887+0000 7f5ae7fff640 1 --2- 172.21.15.102:0/1021945328 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5adc03d000 0x7f5adc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.887+0000 7f5ae7fff640 1 -- 172.21.15.102:0/1021945328 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f5bf4088070 con 0x564e6dd1a110 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.887+0000 7f5c01896640 1 --2- 172.21.15.102:0/1021945328 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5adc03d000 0x7f5adc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.900 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.887+0000 7f5c045ad800 1 Processor -- start 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c01896640 1 --2- 172.21.15.102:0/1021945328 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5adc03d000 0x7f5adc03f4c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x564e6dd0c7d0 tx=0x7f5bf8006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c045ad800 1 -- start start 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c045ad800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd26dd0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c045ad800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e6db76bb0 con 0x564e6dd269f0 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd26dd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd26dd0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39896/0 (socket says 172.21.15.102:39896) 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c02097640 1 -- 172.21.15.102:0/682767242 learned_addr learned my addr 172.21.15.102:0/682767242 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c02097640 1 -- 172.21.15.102:0/682767242 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6dd273c0 con 0x564e6dd269f0 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5c02097640 1 --2- 172.21.15.102:0/682767242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd26dd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009850 tx=0x7f5bf405dde0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e83f59ea0d567c01 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5ae5ffb640 1 -- 172.21.15.102:0/682767242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf409d070 con 0x564e6dd269f0 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5ae5ffb640 1 -- 172.21.15.102:0/682767242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf40745e0 con 0x564e6dd269f0 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.888+0000 7f5ae5ffb640 1 -- 172.21.15.102:0/682767242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf4068420 con 0x564e6dd269f0 2024-09-19T11:15:40.901 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 -- 172.21.15.102:0/682767242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 msgr2=0x564e6dd26dd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 --2- 172.21.15.102:0/682767242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd26dd0 secure :-1 s=READY pgs=813 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4009850 tx=0x7f5bf405dde0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 -- 172.21.15.102:0/682767242 shutdown_connections 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 --2- 172.21.15.102:0/682767242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd26dd0 unknown :-1 s=CLOSED pgs=813 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 -- 172.21.15.102:0/682767242 >> 172.21.15.102:0/682767242 conn(0x564e6dd22df0 msgr2=0x564e6dd21030 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 -- 172.21.15.102:0/682767242 shutdown_connections 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 -- 172.21.15.102:0/682767242 wait complete. 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 Processor -- start 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 -- start start 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd2de30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c045ad800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x564e6dd27850 con 0x564e6dd269f0 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.889+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd2de30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5c02097640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd2de30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39910/0 (socket says 172.21.15.102:39910) 2024-09-19T11:15:40.902 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 learned_addr learned my addr 172.21.15.102:0/113290579 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x564e6dd2e390 con 0x564e6dd269f0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5c02097640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd2de30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5bf405eff0 tx=0x7f5bf405ef80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5ad3fff640 1 -- 172.21.15.102:0/113290579 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf40bb070 con 0x564e6dd269f0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5ad3fff640 1 -- 172.21.15.102:0/113290579 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5bf4068700 con 0x564e6dd269f0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x564e6dd2e390 con 0x564e6dd269f0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5ad3fff640 1 -- 172.21.15.102:0/113290579 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5bf409d040 con 0x564e6dd269f0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.890+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x564e6dd2e390 con 0x564e6dd269f0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.891+0000 7f5ad3fff640 1 -- 172.21.15.102:0/113290579 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5bf40be070 con 0x564e6dd269f0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.891+0000 7f5ad3fff640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5acc03cf10 0x7f5acc03f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.891+0000 7f5ad3fff640 1 -- 172.21.15.102:0/113290579 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f5bf40b1030 con 0x564e6dd269f0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.891+0000 7f5c01896640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5acc03cf10 0x7f5acc03f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.903 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c01896640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5acc03cf10 0x7f5acc03f3d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800ffd0 tx=0x7f5bf8023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dd39370 0x564e6dd3b830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3bf80 con 0x564e6dd39370 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c02898640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dd39370 0x564e6dd3b830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c02898640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dd39370 0x564e6dd3b830 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c045ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c045ad800 20 realm 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.892+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3c390 con 0x564e6dd39370 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.904 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3cc60 con 0x564e6dd39370 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd3dd60 0x564e6dd40150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd40710 con 0x564e6dd3dd60 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.893+0000 7f5c02097640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd3dd60 0x564e6dd40150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.905 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.894+0000 7f5c02097640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd3dd60 0x564e6dd40150 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.894+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.894+0000 7f5c045ad800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.894+0000 7f5c045ad800 20 searching for the correct realm 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.894+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd426c0 0x564e6dd44b80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.894+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd45250 con 0x564e6dd426c0 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.894+0000 7f5c01896640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd426c0 0x564e6dd44b80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.894+0000 7f5c01896640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd426c0 0x564e6dd44b80 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.895+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf8037040 con 0x564e6dd426c0 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.895+0000 7f5c01896640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5bf802e910 0x7f5bf803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.895+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd45250 con 0x7f5bf802e910 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.895+0000 7f5c02898640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5bf802e910 0x7f5bf803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.895+0000 7f5c02898640 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5bf802e910 0x7f5bf803a3c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.906 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.895+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.895+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd3dd60 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.895+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd3dd60 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd3dd60 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.896+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x7f5bf802e910 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.897+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.907 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.897+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd426c0 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.897+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf8037040 con 0x564e6dd426c0 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.897+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.897+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.897+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd3dd60 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.897+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.897+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.898+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.898+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x7f5bf802e910 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.898+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.898+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd426c0 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.898+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf8037040 con 0x564e6dd426c0 2024-09-19T11:15:40.908 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.898+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd426c0 2024-09-19T11:15:40.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.898+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f5bf8037040 con 0x564e6dd426c0 2024-09-19T11:15:40.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.898+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd3dd60 2024-09-19T11:15:40.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd426c0 2024-09-19T11:15:40.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf8037040 con 0x564e6dd426c0 2024-09-19T11:15:40.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd426c0 2024-09-19T11:15:40.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf8037040 con 0x564e6dd426c0 2024-09-19T11:15:40.909 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.920 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.899+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd3dd60 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.900+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.900+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd426c0 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.900+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf8037040 con 0x564e6dd426c0 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.900+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x7f5bf802e910 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.900+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.900+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.901+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.901+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd3dd60 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.901+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.901+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd426c0 2024-09-19T11:15:40.921 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.901+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf8037040 con 0x564e6dd426c0 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.901+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd3dd60 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.901+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.901+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x7f5bf802e910 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.902+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.902+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd426c0 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.902+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bf8049040 con 0x564e6dd426c0 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.902+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x7f5bf802e910 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.902+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.902+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x564e6dd39370 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.902+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.902+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd3d000 con 0x7f5bf802e910 2024-09-19T11:15:40.922 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd40fd0 con 0x564e6dd39370 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd40fd0 con 0x564e6dd39370 2024-09-19T11:15:40.923 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd40fd0 con 0x564e6dd426c0 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f5bf8049040 con 0x564e6dd426c0 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 zone default found 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 4 Realm: () 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 zonegroup default 2024-09-19T11:15:40.924 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.903+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd41970 con 0x564e6dd3dd60 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd47250 con 0x564e6dd426c0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5bf8049040 con 0x564e6dd426c0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd47720 con 0x564e6dd426c0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f5bf8049040 con 0x564e6dd426c0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:40.925 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 20 started sync module instance, tier type = 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.904+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd46560 con 0x7f5bf802e910 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.905+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.905+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94894850075232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd46560 con 0x7f5bf802e910 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.905+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd48260 con 0x564e6dd39370 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.906+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94894850075232] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.907+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.907+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94894850080080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd46560 con 0x564e6dd39370 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.907+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd48cf0 con 0x564e6dd426c0 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.908+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94894850080080] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.908+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf8049040 con 0x564e6dd426c0 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.908+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94894850072752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd464d0 con 0x564e6dd426c0 2024-09-19T11:15:40.926 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.908+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd49bb0 con 0x7f5bf802e910 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.909+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94894850072752] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf8049040 con 0x564e6dd426c0 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.909+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.909+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94894850086656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd49b20 con 0x7f5bf802e910 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.909+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4aa70 con 0x564e6dd39370 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.910+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94894850086656] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.910+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.910+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94894850088752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4aa70 con 0x564e6dd39370 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.910+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4b430 con 0x564e6dd3dd60 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.911+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.911+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94894850088752] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.911+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94894850092928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4bc80 con 0x564e6dd3dd60 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.912+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4a600 con 0x564e6dd3dd60 2024-09-19T11:15:40.927 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.913+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94894850092928] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.913+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.913+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94894850097600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4ca90 con 0x564e6dd3dd60 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.913+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4d2e0 con 0x564e6dd3dd60 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94894850097600] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'267 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94894850099136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4d150 con 0x564e6dd3dd60 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c045ad800 20 add_watcher() i=0 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c045ad800 20 add_watcher() i=1 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c045ad800 20 add_watcher() i=2 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c045ad800 20 add_watcher() i=3 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c045ad800 20 add_watcher() i=4 2024-09-19T11:15:40.928 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c045ad800 20 add_watcher() i=5 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.914+0000 7f5c045ad800 20 add_watcher() i=6 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.915+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94894850099136] v37'268 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.915+0000 7f5c045ad800 20 add_watcher() i=7 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.915+0000 7f5c045ad800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.915+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd50730 con 0x564e6dd39370 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.915+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.915+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94894850100192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd4dc80 con 0x564e6dd39370 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.916+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94894850100192] v37'263 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.916+0000 7f5ab8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.916+0000 7f5c045ad800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.916+0000 7f5c045ad800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.916+0000 7f5c045ad800 5 note: GC not initialized 2024-09-19T11:15:40.929 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.916+0000 7f5a337fe640 20 reqs_thread_entry: start 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 20 Filter name: none 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5a317fa640 20 reqs_thread_entry: start 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 20 rados->read ofs=0 len=0 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd83610 con 0x564e6dd3dd60 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~503 out=503b,getxattrs out=75b] v0'0 uv8 ondisk = 0) ==== 231+0+626 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 20 rados_obj.operate() r=0 bl.length=503 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:40.930 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.917+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd89e00 con 0x564e6dd3dd60 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'9 uv9 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c045ad800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c045ad800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c045ad800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94894850349056 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd854c0 con 0x564e6dd39370 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 94894850088752 notify 158913789991 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f5bfc0189f0 con 0x564e6dd39370 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5ae5ffb640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789991 cookie 94894850088752 notifier 4904 bl.length()=636 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 94894850349056 out=8b] v0'0 uv267 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5ae5ffb640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5ae5ffb640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5ae5ffb640 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f5ac8003ea0 con 0x564e6dd39370 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.931 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.919+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 94894850349056 notify 158913789991 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f5bfc018bc0 con 0x564e6dd39370 2024-09-19T11:15:40.932 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:40.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.920+0000 7f5ab8fe1640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:40.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.920+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94894850100192] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd81490 con 0x564e6dd39370 2024-09-19T11:15:40.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.921+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94894850100192] v37'264 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.921+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94894850075232] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd81490 con 0x7f5bf802e910 2024-09-19T11:15:40.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.922+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94894850075232] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.937 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.922+0000 7f5c045ad800 20 remove_watcher() i=0 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.922+0000 7f5c045ad800 2 removed watcher, disabling cache 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.922+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94894850080080] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd81490 con 0x564e6dd39370 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.923+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94894850080080] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.923+0000 7f5c045ad800 20 remove_watcher() i=1 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.923+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94894850072752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd81490 con 0x564e6dd426c0 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.925+0000 7f5c01896640 1 -- 172.21.15.102:0/113290579 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94894850072752] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf8049040 con 0x564e6dd426c0 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.925+0000 7f5c045ad800 20 remove_watcher() i=2 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.925+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94894850086656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd460b0 con 0x7f5bf802e910 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.926+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94894850086656] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x7f5bf802e910 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.926+0000 7f5c045ad800 20 remove_watcher() i=3 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.926+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94894850088752] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd49700 con 0x564e6dd39370 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.927+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94894850088752] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bfc00a4d0 con 0x564e6dd39370 2024-09-19T11:15:40.938 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.927+0000 7f5c045ad800 20 remove_watcher() i=4 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.927+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94894850092928] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd460b0 con 0x564e6dd3dd60 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.928+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94894850092928] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.928+0000 7f5c045ad800 20 remove_watcher() i=5 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.928+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94894850097600] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd49f30 con 0x564e6dd3dd60 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.929+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94894850097600] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.929+0000 7f5c045ad800 20 remove_watcher() i=6 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.929+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94894850099136] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x564e6dd49700 con 0x564e6dd3dd60 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c02097640 1 -- 172.21.15.102:0/113290579 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94894850099136] v37'269 uv267 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f5bf40bd030 con 0x564e6dd3dd60 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 20 remove_watcher() i=7 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd3dd60 msgr2=0x564e6dd40150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd3dd60 0x564e6dd40150 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dd39370 msgr2=0x564e6dd3b830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.939 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dd39370 0x564e6dd3b830 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5bf802e910 msgr2=0x7f5bf803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f5bf802e910 0x7f5bf803a3c0 crc :-1 s=READY pgs=100 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd426c0 msgr2=0x564e6dd44b80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd426c0 0x564e6dd44b80 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5acc03cf10 msgr2=0x7f5acc03f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5acc03cf10 0x7f5acc03f3d0 secure :-1 s=READY pgs=340 cs=0 l=1 rev1=1 crypto rx=0x7f5bf800ffd0 tx=0x7f5bf8023040 comp rx=0 tx=0).stop 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 msgr2=0x564e6dd2de30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 --2- 172.21.15.102:0/113290579 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd269f0 0x564e6dd2de30 secure :-1 s=READY pgs=814 cs=0 l=1 rev1=1 crypto rx=0x7f5bf405eff0 tx=0x7f5bf405ef80 comp rx=0 tx=0).stop 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 reap_dead start 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c02898640 1 -- 172.21.15.102:0/113290579 reap_dead start 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 shutdown_connections 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 >> 172.21.15.102:0/113290579 conn(0x564e6dd22df0 msgr2=0x564e6dd21000 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.940 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.930+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 shutdown_connections 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/113290579 wait complete. 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1021945328 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5adc03d000 msgr2=0x7f5adc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1021945328 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5adc03d000 0x7f5adc03f4c0 secure :-1 s=READY pgs=339 cs=0 l=1 rev1=1 crypto rx=0x564e6dd0c7d0 tx=0x7f5bf8006000 comp rx=0 tx=0).stop 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1021945328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd1a110 msgr2=0x564e6dd1a530 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1021945328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd1a110 0x564e6dd1a530 secure :-1 s=READY pgs=812 cs=0 l=1 rev1=1 crypto rx=0x7f5bf407c8d0 tx=0x7f5bf407c470 comp rx=0 tx=0).stop 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1021945328 shutdown_connections 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1021945328 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5adc03d000 0x7f5adc03f4c0 unknown :-1 s=CLOSED pgs=339 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1021945328 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dd1a110 0x564e6dd1a530 unknown :-1 s=CLOSED pgs=812 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1021945328 >> 172.21.15.102:0/1021945328 conn(0x564e6dd0e4c0 msgr2=0x564e6dd0e8a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1021945328 shutdown_connections 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1021945328 wait complete. 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd05800 msgr2=0x564e6dd07c80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.941 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x564e6dd05800 0x564e6dd07c80 crc :-1 s=READY pgs=189 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dc039a0 msgr2=0x564e6dd03420 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x564e6dc039a0 0x564e6dd03420 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd09870 msgr2=0x564e6dd0bc60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x564e6dd09870 0x564e6dd0bc60 crc :-1 s=READY pgs=190 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ae803d000 msgr2=0x7f5ae803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ae803d000 0x7f5ae803f4c0 secure :-1 s=READY pgs=338 cs=0 l=1 rev1=1 crypto rx=0x7f5bf8000c00 tx=0x7f5bf80013b0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 msgr2=0x564e6dcfbdd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 --2- 172.21.15.102:0/1990560332 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x564e6dc028a0 0x564e6dcfbdd0 secure :-1 s=READY pgs=811 cs=0 l=1 rev1=1 crypto rx=0x7f5bf4045f50 tx=0x7f5bf4002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c02898640 1 -- 172.21.15.102:0/1990560332 reap_dead start 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 shutdown_connections 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.931+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 >> 172.21.15.102:0/1990560332 conn(0x564e6dbfdc70 msgr2=0x564e6dced690 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.932+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 shutdown_connections 2024-09-19T11:15:40.942 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.932+0000 7f5c045ad800 1 -- 172.21.15.102:0/1990560332 wait complete. 2024-09-19T11:15:40.943 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.943 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:40.944 ERROR:root:0 2024-09-19T11:15:40.944 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-19T11:15:40.944 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-19T11:15:40.944 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps user-info-without-keys=write 2024-09-19T11:15:40.991 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:40.991 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:40.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.990+0000 7f8015526800 1 Processor -- start 2024-09-19T11:15:40.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.990+0000 7f8015526800 1 -- start start 2024-09-19T11:15:40.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.990+0000 7f8015526800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55b1723cdab0 0x55b1723cff70 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:40.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.990+0000 7f8015526800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55b1723d05f0 con 0x55b1723c9f40 2024-09-19T11:15:40.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.990+0000 7f8015526800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55b1722547d0 con 0x55b1723cdab0 2024-09-19T11:15:40.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.991+0000 7f8008ad5640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55b1723cdab0 0x55b1723cff70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:40.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.991+0000 7f80112d6640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55b1723c9f40 0x55b1723cc330 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34816/0 (socket says 172.21.15.102:34816) 2024-09-19T11:15:40.992 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.991+0000 7f80112d6640 1 -- 172.21.15.102:0/3934912212 learned_addr learned my addr 172.21.15.102:0/3934912212 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:40.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.991+0000 7f8008ad5640 1 -- 172.21.15.102:0/3934912212 >> v1:172.21.15.37:6789/0 conn(0x55b1723c9f40 legacy=0x55b1723cc330 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.993 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.991+0000 7f8008ad5640 1 -- 172.21.15.102:0/3934912212 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1723d1820 con 0x55b1723cdab0 2024-09-19T11:15:40.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.993+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3934912212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723cdab0 0x55b1723cff70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00a470 tx=0x7f7ffc045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c561117bba049b26 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:40.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.993+0000 7f8010ad5640 1 -- 172.21.15.102:0/3934912212 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ffc053570 con 0x55b1723cdab0 2024-09-19T11:15:40.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.993+0000 7f8010ad5640 1 -- 172.21.15.102:0/3934912212 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f7ffc058070 con 0x55b1723cdab0 2024-09-19T11:15:40.994 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.993+0000 7f8010ad5640 1 -- 172.21.15.102:0/3934912212 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f7ffc053880 con 0x55b1723cdab0 2024-09-19T11:15:40.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.994+0000 7f8015526800 1 -- 172.21.15.102:0/3934912212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723cdab0 msgr2=0x55b1723cff70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:40.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.994+0000 7f8015526800 1 --2- 172.21.15.102:0/3934912212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723cdab0 0x55b1723cff70 secure :-1 s=READY pgs=816 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc00a470 tx=0x7f7ffc045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:40.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.994+0000 7f8015526800 1 -- 172.21.15.102:0/3934912212 shutdown_connections 2024-09-19T11:15:40.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.994+0000 7f8015526800 1 --2- 172.21.15.102:0/3934912212 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723cdab0 0x55b1723cff70 unknown :-1 s=CLOSED pgs=816 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:40.995 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.994+0000 7f8015526800 1 -- 172.21.15.102:0/3934912212 >> 172.21.15.102:0/3934912212 conn(0x55b1723c3aa0 msgr2=0x55b1723c5ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:40.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.994+0000 7f8015526800 1 -- 172.21.15.102:0/3934912212 shutdown_connections 2024-09-19T11:15:40.996 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:40.994+0000 7f8015526800 1 -- 172.21.15.102:0/3934912212 wait complete. 2024-09-19T11:15:41.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.007+0000 7f8015526800 1 Processor -- start 2024-09-19T11:15:41.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.007+0000 7f8015526800 1 -- start start 2024-09-19T11:15:41.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.007+0000 7f8015526800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724b9380 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.007+0000 7f8015526800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b172261dd0 con 0x55b1723c9f40 2024-09-19T11:15:41.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.008+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724b9380 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.009 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.008+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724b9380 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39922/0 (socket says 172.21.15.102:39922) 2024-09-19T11:15:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.008+0000 7f80112d6640 1 -- 172.21.15.102:0/1005438191 learned_addr learned my addr 172.21.15.102:0/1005438191 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.008+0000 7f80112d6640 1 -- 172.21.15.102:0/1005438191 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1724b9970 con 0x55b1723c9f40 2024-09-19T11:15:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.008+0000 7f80112d6640 1 --2- 172.21.15.102:0/1005438191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724b9380 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8004001e40 tx=0x7f8004001e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4a28c95b4ed517f8 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.008+0000 7f7eff606640 1 -- 172.21.15.102:0/1005438191 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8004012020 con 0x55b1723c9f40 2024-09-19T11:15:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.008+0000 7f7eff606640 1 -- 172.21.15.102:0/1005438191 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f800400e5a0 con 0x55b1723c9f40 2024-09-19T11:15:41.010 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.008+0000 7f7eff606640 1 -- 172.21.15.102:0/1005438191 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800400e8a0 con 0x55b1723c9f40 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 -- 172.21.15.102:0/1005438191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 msgr2=0x55b1724b9380 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 --2- 172.21.15.102:0/1005438191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724b9380 secure :-1 s=READY pgs=817 cs=0 l=1 rev1=1 crypto rx=0x7f8004001e40 tx=0x7f8004001e70 comp rx=0 tx=0).stop 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 -- 172.21.15.102:0/1005438191 shutdown_connections 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 --2- 172.21.15.102:0/1005438191 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724b9380 unknown :-1 s=CLOSED pgs=817 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 -- 172.21.15.102:0/1005438191 >> 172.21.15.102:0/1005438191 conn(0x55b1723c3aa0 msgr2=0x55b1724b4d00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 -- 172.21.15.102:0/1005438191 shutdown_connections 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 -- 172.21.15.102:0/1005438191 wait complete. 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 Processor -- start 2024-09-19T11:15:41.013 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.009+0000 7f8015526800 1 -- start start 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f8015526800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724c0ef0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f8015526800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b1723d0ac0 con 0x55b1723c9f40 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724c0ef0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724c0ef0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39934/0 (socket says 172.21.15.102:39934) 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f80112d6640 1 -- 172.21.15.102:0/3606208832 learned_addr learned my addr 172.21.15.102:0/3606208832 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f80112d6640 1 -- 172.21.15.102:0/3606208832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1724c1450 con 0x55b1723c9f40 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f80112d6640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724c0ef0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f800400c010 tx=0x7f8004000ed0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f7efde03640 1 -- 172.21.15.102:0/3606208832 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8004012030 con 0x55b1723c9f40 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f7efde03640 1 -- 172.21.15.102:0/3606208832 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f80040014a0 con 0x55b1723c9f40 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1724c16e0 con 0x55b1723c9f40 2024-09-19T11:15:41.014 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f7efde03640 1 -- 172.21.15.102:0/3606208832 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800401a7a0 con 0x55b1723c9f40 2024-09-19T11:15:41.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.010+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1724c20e0 con 0x55b1723c9f40 2024-09-19T11:15:41.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.011+0000 7f7efde03640 1 -- 172.21.15.102:0/3606208832 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8004015020 con 0x55b1723c9f40 2024-09-19T11:15:41.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.011+0000 7f7efde03640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ef803d000 0x7f7ef803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f7efde03640 1 -- 172.21.15.102:0/3606208832 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8004020030 con 0x55b1723c9f40 2024-09-19T11:15:41.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ef803d000 0x7f7ef803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f8015526800 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b1723cdab0 0x55b1724c8540 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.015 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b1724c2c70 con 0x55b1723cdab0 2024-09-19T11:15:41.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f8011ad7640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b1723cdab0 0x55b1724c8540 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ef803d000 0x7f7ef803f4c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc057000 tx=0x7f7ffc052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.016 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f8011ad7640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b1723cdab0 0x55b1724c8540 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f8011ad7640 1 -- 172.21.15.102:0/3606208832 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b1723cdab0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.012+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b1724c2570 con 0x55b1723cdab0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.013+0000 7f8011ad7640 1 -- 172.21.15.102:0/3606208832 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b1723cdab0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.013+0000 7f8015526800 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b1724ca9b0 0x55b1724ccda0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.013+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b1724cd470 con 0x55b1724ca9b0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.013+0000 7f80112d6640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b1724ca9b0 0x55b1724ccda0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.013+0000 7f80112d6640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b1724ca9b0 0x55b1724ccda0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.014+0000 7f80112d6640 1 -- 172.21.15.102:0/3606208832 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f80040187b0 con 0x55b1724ca9b0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.014+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b1724c9850 con 0x55b1723cdab0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.014+0000 7f8011ad7640 1 -- 172.21.15.102:0/3606208832 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b1723cdab0 2024-09-19T11:15:41.023 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.014+0000 7f8015526800 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1724ce8b0 0x55b1724d0ca0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.014+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b1724d13e0 con 0x55b1724ce8b0 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.014+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1724ce8b0 0x55b1724d0ca0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.014+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1724ce8b0 0x55b1724d0ca0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.015+0000 7f8008ad5640 1 -- 172.21.15.102:0/3606208832 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1724ce8b0 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.015+0000 7f8015526800 1 Processor -- start 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.015+0000 7f8015526800 1 -- start start 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.015+0000 7f8015526800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c96c0 0x55b1723c7f30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.015+0000 7f8015526800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b1722c04a0 con 0x55b1723c96c0 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.015+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c96c0 0x55b1723c7f30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.015+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c96c0 0x55b1723c7f30 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39950/0 (socket says 172.21.15.102:39950) 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.015+0000 7f80112d6640 1 -- 172.21.15.102:0/768162979 learned_addr learned my addr 172.21.15.102:0/768162979 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.024 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.016+0000 7f80112d6640 1 -- 172.21.15.102:0/768162979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1723c9be0 con 0x55b1723c96c0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.016+0000 7f80112d6640 1 --2- 172.21.15.102:0/768162979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c96c0 0x55b1723c7f30 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8004001250 tx=0x7f8004042da0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.016+0000 7f7ef6ffd640 1 -- 172.21.15.102:0/768162979 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800400d3d0 con 0x55b1723c96c0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.016+0000 7f7ef6ffd640 1 -- 172.21.15.102:0/768162979 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8004048070 con 0x55b1723c96c0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.016+0000 7f8015526800 1 -- 172.21.15.102:0/768162979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1723c8470 con 0x55b1723c96c0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.016+0000 7f7ef6ffd640 1 -- 172.21.15.102:0/768162979 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8004051510 con 0x55b1723c96c0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.016+0000 7f8015526800 1 -- 172.21.15.102:0/768162979 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1723c8470 con 0x55b1723c96c0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.017+0000 7f7ef6ffd640 1 -- 172.21.15.102:0/768162979 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f800404b370 con 0x55b1723c96c0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.017+0000 7f7ef6ffd640 1 --2- 172.21.15.102:0/768162979 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ee803d000 0x7f7ee803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.017+0000 7f7ef6ffd640 1 -- 172.21.15.102:0/768162979 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8004037950 con 0x55b1723c96c0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.017+0000 7f8008ad5640 1 --2- 172.21.15.102:0/768162979 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ee803d000 0x7f7ee803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.017+0000 7f8015526800 1 Processor -- start 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.017+0000 7f8015526800 1 -- start start 2024-09-19T11:15:41.025 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f8015526800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724edde0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f8015526800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b1724b9da0 con 0x55b1724ed9e0 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f8008ad5640 1 --2- 172.21.15.102:0/768162979 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ee803d000 0x7f7ee803f4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55b1724c8b50 tx=0x7f7ffc005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724edde0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724edde0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39966/0 (socket says 172.21.15.102:39966) 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f80112d6640 1 -- 172.21.15.102:0/1600714637 learned_addr learned my addr 172.21.15.102:0/1600714637 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f80112d6640 1 -- 172.21.15.102:0/1600714637 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1724ee3d0 con 0x55b1724ed9e0 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f80112d6640 1 --2- 172.21.15.102:0/1600714637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724edde0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8004024d80 tx=0x7f8004044b60 comp rx=0 tx=0).ready entity=mon.0 client_cookie=4610ab31486cdda1 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f7ef4ff9640 1 -- 172.21.15.102:0/1600714637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8004037420 con 0x55b1724ed9e0 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f7ef4ff9640 1 -- 172.21.15.102:0/1600714637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8004053e20 con 0x55b1724ed9e0 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.018+0000 7f7ef4ff9640 1 -- 172.21.15.102:0/1600714637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800404b990 con 0x55b1724ed9e0 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 -- 172.21.15.102:0/1600714637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 msgr2=0x55b1724edde0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 --2- 172.21.15.102:0/1600714637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724edde0 secure :-1 s=READY pgs=820 cs=0 l=1 rev1=1 crypto rx=0x7f8004024d80 tx=0x7f8004044b60 comp rx=0 tx=0).stop 2024-09-19T11:15:41.026 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 -- 172.21.15.102:0/1600714637 shutdown_connections 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 --2- 172.21.15.102:0/1600714637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724edde0 unknown :-1 s=CLOSED pgs=820 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 -- 172.21.15.102:0/1600714637 >> 172.21.15.102:0/1600714637 conn(0x55b1724e9de0 msgr2=0x55b1724e8020 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 -- 172.21.15.102:0/1600714637 shutdown_connections 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 -- 172.21.15.102:0/1600714637 wait complete. 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 Processor -- start 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 -- start start 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724f4e20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f8015526800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55b1724ee840 con 0x55b1724ed9e0 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724f4e20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f80112d6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724f4e20 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:39982/0 (socket says 172.21.15.102:39982) 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.019+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 learned_addr learned my addr 172.21.15.102:0/3744037678 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.020+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55b1724f5380 con 0x55b1724ed9e0 2024-09-19T11:15:41.027 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.020+0000 7f80112d6640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724f4e20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8004053fd0 tx=0x7f80040375c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.020+0000 7f7ee6ffd640 1 -- 172.21.15.102:0/3744037678 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800406e070 con 0x55b1724ed9e0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.020+0000 7f7ee6ffd640 1 -- 172.21.15.102:0/3744037678 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8004016850 con 0x55b1724ed9e0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.020+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55b1724f5380 con 0x55b1724ed9e0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.020+0000 7f7ee6ffd640 1 -- 172.21.15.102:0/3744037678 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f800403e360 con 0x55b1724ed9e0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.020+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55b1724f5380 con 0x55b1724ed9e0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.021+0000 7f7ee6ffd640 1 -- 172.21.15.102:0/3744037678 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8004071070 con 0x55b1724ed9e0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.021+0000 7f7ee6ffd640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7edc03d000 0x7f7edc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.021+0000 7f7ee6ffd640 1 -- 172.21.15.102:0/3744037678 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f800405a030 con 0x55b1724ed9e0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.021+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7edc03d000 0x7f7edc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.021+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7edc03d000 0x7f7edc03f4c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc053570 tx=0x7f7ffc053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.021+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.028 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b172500370 0x55b172502830 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172502f80 con 0x55b172500370 2024-09-19T11:15:41.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8011ad7640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b172500370 0x55b172502830 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.029 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8011ad7640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b172500370 0x55b172502830 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 20 realm 2024-09-19T11:15:41.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172503390 con 0x55b172500370 2024-09-19T11:15:41.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.042 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.022+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172503c60 con 0x55b172500370 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8015526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8015526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b172504d60 0x55b172507150 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172507710 con 0x55b172504d60 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f80112d6640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b172504d60 0x55b172507150 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.043 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.023+0000 7f80112d6640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b172504d60 0x55b172507150 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8015526800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8015526800 20 searching for the correct realm 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1725096c0 0x55b17250bb80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b17250c250 con 0x55b1725096c0 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1725096c0 0x55b17250bb80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1725096c0 0x55b17250bb80 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8008ad5640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7ffc05f040 0x7f7ffc05f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.024+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b17250c250 con 0x7f7ffc05f040 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.025+0000 7f8011ad7640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7ffc05f040 0x7f7ffc05f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.044 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.025+0000 7f8011ad7640 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7ffc05f040 0x7f7ffc05f930 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.025+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.025+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172504d60 2024-09-19T11:15:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.025+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.025+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.045 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172504d60 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172504d60 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x7f7ffc05f040 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.026+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b1725096c0 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.027+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.027+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.046 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.027+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.027+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172504d60 2024-09-19T11:15:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.027+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.027+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.027+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.027+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x7f7ffc05f040 2024-09-19T11:15:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.028+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.028+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b1725096c0 2024-09-19T11:15:41.048 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.028+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.028+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b1725096c0 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.028+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.028+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172504d60 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.028+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.028+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b1725096c0 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.029+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.029+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b1725096c0 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.029+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.029+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.029+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.029+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.049 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.029+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.029+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172504d60 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.030+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.030+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b1725096c0 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.030+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.030+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x7f7ffc05f040 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.030+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.030+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.030+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.030+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172504d60 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.031+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.031+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b1725096c0 2024-09-19T11:15:41.050 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.031+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.031+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172504d60 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.031+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.031+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x7f7ffc05f040 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.031+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.031+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b1725096c0 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x7f7ffc05f040 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x55b172500370 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55b172504000 con 0x7f7ffc05f040 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.051 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172507fd0 con 0x55b172500370 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.032+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172507fd0 con 0x55b172500370 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.052 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172507fd0 con 0x55b1725096c0 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 20 zone default found 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 4 Realm: () 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 20 zonegroup default 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172508920 con 0x55b172504d60 2024-09-19T11:15:41.053 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.033+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b17250e220 con 0x55b1725096c0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8015526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b17250e690 con 0x55b1725096c0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8015526800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8015526800 20 started sync module instance, tier type = 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8015526800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.034+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b17250d560 con 0x7f7ffc05f040 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.035+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.054 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.035+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94220615473792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b17250d560 con 0x7f7ffc05f040 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.035+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b17250f170 con 0x55b172500370 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.036+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94220615473792] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.036+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.036+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94220615478336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b17250f130 con 0x55b172500370 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.036+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b17250fc20 con 0x55b1725096c0 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.037+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94220615478336] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.038+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.038+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94220615481072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172510010 con 0x55b1725096c0 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.038+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172510a10 con 0x7f7ffc05f040 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.039+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.039+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94220615484704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b1725112b0 con 0x7f7ffc05f040 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.039+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94220615481072] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.055 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.039+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b17250d0f0 con 0x55b172500370 2024-09-19T11:15:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.040+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94220615484704] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.040+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.040+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94220615486736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172511840 con 0x55b172500370 2024-09-19T11:15:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.040+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172512200 con 0x55b172504d60 2024-09-19T11:15:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.041+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.041+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94220615486736] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.041+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94220615490896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b1725125f0 con 0x55b172504d60 2024-09-19T11:15:41.056 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.041+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172512fb0 con 0x55b172504d60 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.042+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94220615490896] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.042+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.042+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94220615487792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172513800 con 0x55b172504d60 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.042+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b1725141c0 con 0x55b172504d60 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94220615487792] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'270 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94220615499024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b1725145e0 con 0x55b172504d60 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f8015526800 20 add_watcher() i=0 2024-09-19T11:15:41.060 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f8015526800 20 add_watcher() i=1 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f8015526800 20 add_watcher() i=2 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f8015526800 20 add_watcher() i=3 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f8015526800 20 add_watcher() i=4 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f8015526800 20 add_watcher() i=5 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.043+0000 7f8015526800 20 add_watcher() i=6 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.044+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94220615499024] v37'271 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.044+0000 7f8015526800 20 add_watcher() i=7 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.044+0000 7f8015526800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.044+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b172517880 con 0x55b172500370 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.045+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.045+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94220615500448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172514b70 con 0x55b172500370 2024-09-19T11:15:41.061 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94220615500448] v37'265 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f7ec77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f8015526800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f8015526800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f8015526800 5 note: GC not initialized 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f7ec67e4640 20 reqs_thread_entry: start 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f8015526800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f8015526800 20 Filter name: none 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f7e37fff640 20 reqs_thread_entry: start 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f8015526800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.046+0000 7f8015526800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.047+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b17254a7b0 con 0x55b172504d60 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.047+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv9 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.062 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.047+0000 7f8015526800 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.047+0000 7f8015526800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.047+0000 7f8015526800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.047+0000 7f8015526800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.047+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~490 in=490b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172550c50 con 0x55b172504d60 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~490] v37'10 uv10 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f8015526800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f8015526800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f8015526800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94220615747088 in=678b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55b17254c290 con 0x55b172500370 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 94220615486736 notify 158913789992 ret 0) ==== 708+0+0 (crc 0 0 0) 0x7f800c018a00 con 0x55b172500370 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f7ef4ff9640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789992 cookie 94220615486736 notifier 4911 bl.length()=666 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f7ef4ff9640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f7ef4ff9640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.063 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 94220615747088 out=8b] v0'0 uv270 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f7ef4ff9640 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f7ed4003ea0 con 0x55b172500370 2024-09-19T11:15:41.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.064 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.049+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 94220615747088 notify 158913789992 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f800c018bd0 con 0x55b172500370 2024-09-19T11:15:41.064 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"user-info-without-keys","perm":"write"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.050+0000 7f7ec77e6640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.050+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94220615500448] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x55b172500370 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.051+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94220615500448] v37'266 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.051+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94220615473792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x7f7ffc05f040 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.052+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94220615473792] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.052+0000 7f8015526800 20 remove_watcher() i=0 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.052+0000 7f8015526800 2 removed watcher, disabling cache 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.052+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94220615478336] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x55b172500370 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.053+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94220615478336] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.069 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.053+0000 7f8015526800 20 remove_watcher() i=1 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.053+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94220615481072] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x55b1725096c0 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.054+0000 7f8008ad5640 1 -- 172.21.15.102:0/3744037678 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94220615481072] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f7ffc051070 con 0x55b1725096c0 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.054+0000 7f8015526800 20 remove_watcher() i=2 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.054+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94220615484704] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x7f7ffc05f040 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.055+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94220615484704] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x7f7ffc05f040 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.055+0000 7f8015526800 20 remove_watcher() i=3 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.055+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94220615486736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x55b172500370 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.056+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94220615486736] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f800c00a4d0 con 0x55b172500370 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.056+0000 7f8015526800 20 remove_watcher() i=4 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.056+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94220615490896] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x55b172504d60 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.057+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94220615490896] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.057+0000 7f8015526800 20 remove_watcher() i=5 2024-09-19T11:15:41.070 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.057+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94220615487792] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x55b172504d60 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.058+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94220615487792] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.058+0000 7f8015526800 20 remove_watcher() i=6 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.058+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94220615499024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55b172548620 con 0x55b172504d60 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f80112d6640 1 -- 172.21.15.102:0/3744037678 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94220615499024] v37'272 uv270 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f8004070030 con 0x55b172504d60 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 20 remove_watcher() i=7 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b172504d60 msgr2=0x55b172507150 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b172504d60 0x55b172507150 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b172500370 msgr2=0x55b172502830 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b172500370 0x55b172502830 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7ffc05f040 msgr2=0x7f7ffc05f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f7ffc05f040 0x7f7ffc05f930 crc :-1 s=READY pgs=101 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1725096c0 msgr2=0x55b17250bb80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.071 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1725096c0 0x55b17250bb80 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7edc03d000 msgr2=0x7f7edc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7edc03d000 0x7f7edc03f4c0 secure :-1 s=READY pgs=343 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc053570 tx=0x7f7ffc053000 comp rx=0 tx=0).stop 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 msgr2=0x55b1724f4e20 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/3744037678 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1724ed9e0 0x55b1724f4e20 secure :-1 s=READY pgs=821 cs=0 l=1 rev1=1 crypto rx=0x7f8004053fd0 tx=0x7f80040375c0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 reap_dead start 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8011ad7640 1 -- 172.21.15.102:0/3744037678 reap_dead start 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 shutdown_connections 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 >> 172.21.15.102:0/3744037678 conn(0x55b1724e9de0 msgr2=0x55b1724e7ff0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 shutdown_connections 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/3744037678 wait complete. 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/768162979 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ee803d000 msgr2=0x7f7ee803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.072 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/768162979 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ee803d000 0x7f7ee803f4c0 secure :-1 s=READY pgs=342 cs=0 l=1 rev1=1 crypto rx=0x55b1724c8b50 tx=0x7f7ffc005a00 comp rx=0 tx=0).stop 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/768162979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c96c0 msgr2=0x55b1723c7f30 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/768162979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c96c0 0x55b1723c7f30 secure :-1 s=READY pgs=819 cs=0 l=1 rev1=1 crypto rx=0x7f8004001250 tx=0x7f8004042da0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/768162979 shutdown_connections 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/768162979 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ee803d000 0x7f7ee803f4c0 unknown :-1 s=CLOSED pgs=342 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 --2- 172.21.15.102:0/768162979 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c96c0 0x55b1723c7f30 unknown :-1 s=CLOSED pgs=819 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.060+0000 7f8015526800 1 -- 172.21.15.102:0/768162979 >> 172.21.15.102:0/768162979 conn(0x55b1724d34f0 msgr2=0x55b1724d38d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/768162979 shutdown_connections 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/768162979 wait complete. 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b1724ca9b0 msgr2=0x55b1724ccda0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55b1724ca9b0 0x55b1724ccda0 crc :-1 s=READY pgs=191 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b1723cdab0 msgr2=0x55b1724c8540 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55b1723cdab0 0x55b1724c8540 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1724ce8b0 msgr2=0x55b1724d0ca0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.073 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55b1724ce8b0 0x55b1724d0ca0 crc :-1 s=READY pgs=192 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ef803d000 msgr2=0x7f7ef803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f7ef803d000 0x7f7ef803f4c0 secure :-1 s=READY pgs=341 cs=0 l=1 rev1=1 crypto rx=0x7f7ffc057000 tx=0x7f7ffc052000 comp rx=0 tx=0).stop 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 msgr2=0x55b1724c0ef0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 --2- 172.21.15.102:0/3606208832 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55b1723c9f40 0x55b1724c0ef0 secure :-1 s=READY pgs=818 cs=0 l=1 rev1=1 crypto rx=0x7f800400c010 tx=0x7f8004000ed0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8011ad7640 1 -- 172.21.15.102:0/3606208832 reap_dead start 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 shutdown_connections 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 >> 172.21.15.102:0/3606208832 conn(0x55b1723c3aa0 msgr2=0x55b1724ba870 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 shutdown_connections 2024-09-19T11:15:41.074 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.061+0000 7f8015526800 1 -- 172.21.15.102:0/3606208832 wait complete. 2024-09-19T11:15:41.075 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:41.075 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'user-info-without-keys', 'perm': 'write'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:41.075 ERROR:root:0 2024-09-19T11:15:41.075 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.089 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'AccessDenied', 'Message': '', 'RequestId': 'tx0000002ecd7f20af7869a-0066ec07dd-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:15:41.090 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-19T11:15:41.090 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'rm', '--uid', 'ada', '--caps', 'user-info-without-keys=write'] 2024-09-19T11:15:41.090 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps rm --uid ada --caps user-info-without-keys=write 2024-09-19T11:15:41.136 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:41.137 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:41.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.136+0000 7f04a452e800 1 Processor -- start 2024-09-19T11:15:41.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.136+0000 7f04a452e800 1 -- start start 2024-09-19T11:15:41.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.136+0000 7f04a452e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56545303bac0 0x56545303df60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.136+0000 7f04a452e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x56545303e5e0 con 0x565453037fb0 2024-09-19T11:15:41.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.136+0000 7f04a452e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x565452ec27d0 con 0x56545303bac0 2024-09-19T11:15:41.138 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.137+0000 7f049fadc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x56545303bac0 0x56545303df60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.137+0000 7f04a02dd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x565453037fb0 0x56545303a3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34822/0 (socket says 172.21.15.102:34822) 2024-09-19T11:15:41.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.137+0000 7f04a02dd640 1 -- 172.21.15.102:0/3243270700 learned_addr learned my addr 172.21.15.102:0/3243270700 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:41.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.137+0000 7f049fadc640 1 -- 172.21.15.102:0/3243270700 >> v1:172.21.15.37:6789/0 conn(0x565453037fb0 legacy=0x56545303a3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.137+0000 7f049f2db640 1 -- 172.21.15.102:0/3243270700 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1079172634 0 0) 0x56545303e5e0 con 0x565453037fb0 2024-09-19T11:15:41.139 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.137+0000 7f049fadc640 1 -- 172.21.15.102:0/3243270700 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545303f810 con 0x56545303bac0 2024-09-19T11:15:41.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.139+0000 7f049fadc640 1 --2- 172.21.15.102:0/3243270700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545303bac0 0x56545303df60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f048800a470 tx=0x7f0488045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=aa304a3ce7f56865 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.139+0000 7f049f2db640 1 -- 172.21.15.102:0/3243270700 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0488053570 con 0x56545303bac0 2024-09-19T11:15:41.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.139+0000 7f049f2db640 1 -- 172.21.15.102:0/3243270700 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0488058070 con 0x56545303bac0 2024-09-19T11:15:41.140 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.139+0000 7f049f2db640 1 -- 172.21.15.102:0/3243270700 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0488053880 con 0x56545303bac0 2024-09-19T11:15:41.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.139+0000 7f04a452e800 1 -- 172.21.15.102:0/3243270700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545303bac0 msgr2=0x56545303df60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.139+0000 7f04a452e800 1 --2- 172.21.15.102:0/3243270700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545303bac0 0x56545303df60 secure :-1 s=READY pgs=823 cs=0 l=1 rev1=1 crypto rx=0x7f048800a470 tx=0x7f0488045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:41.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.140+0000 7f04a452e800 1 -- 172.21.15.102:0/3243270700 shutdown_connections 2024-09-19T11:15:41.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.140+0000 7f04a452e800 1 --2- 172.21.15.102:0/3243270700 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545303bac0 0x56545303df60 unknown :-1 s=CLOSED pgs=823 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.140+0000 7f04a452e800 1 -- 172.21.15.102:0/3243270700 >> 172.21.15.102:0/3243270700 conn(0x565453031a70 msgr2=0x565453033ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.141 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.140+0000 7f04a452e800 1 -- 172.21.15.102:0/3243270700 shutdown_connections 2024-09-19T11:15:41.142 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.140+0000 7f04a452e800 1 -- 172.21.15.102:0/3243270700 wait complete. 2024-09-19T11:15:41.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.153+0000 7f04a452e800 1 Processor -- start 2024-09-19T11:15:41.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.153+0000 7f04a452e800 1 -- start start 2024-09-19T11:15:41.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.153+0000 7f04a452e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x5654531271f0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.153+0000 7f04a452e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565452ecfdd0 con 0x565453037fb0 2024-09-19T11:15:41.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.154+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x5654531271f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.154+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x5654531271f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40000/0 (socket says 172.21.15.102:40000) 2024-09-19T11:15:41.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.154+0000 7f04a02dd640 1 -- 172.21.15.102:0/2088202342 learned_addr learned my addr 172.21.15.102:0/2088202342 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.155 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.154+0000 7f04a02dd640 1 -- 172.21.15.102:0/2088202342 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5654531277e0 con 0x565453037fb0 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.154+0000 7f04a02dd640 1 --2- 172.21.15.102:0/2088202342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x5654531271f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0490006fa0 tx=0x7f0490001b00 comp rx=0 tx=0).ready entity=mon.0 client_cookie=435b44e22ca2db04 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.154+0000 7f038e60c640 1 -- 172.21.15.102:0/2088202342 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0490003450 con 0x565453037fb0 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.154+0000 7f038e60c640 1 -- 172.21.15.102:0/2088202342 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0490003610 con 0x565453037fb0 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.154+0000 7f038e60c640 1 -- 172.21.15.102:0/2088202342 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0490003970 con 0x565453037fb0 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.155+0000 7f04a452e800 1 -- 172.21.15.102:0/2088202342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 msgr2=0x5654531271f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.155+0000 7f04a452e800 1 --2- 172.21.15.102:0/2088202342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x5654531271f0 secure :-1 s=READY pgs=824 cs=0 l=1 rev1=1 crypto rx=0x7f0490006fa0 tx=0x7f0490001b00 comp rx=0 tx=0).stop 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.155+0000 7f04a452e800 1 -- 172.21.15.102:0/2088202342 shutdown_connections 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.155+0000 7f04a452e800 1 --2- 172.21.15.102:0/2088202342 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x5654531271f0 unknown :-1 s=CLOSED pgs=824 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.155+0000 7f04a452e800 1 -- 172.21.15.102:0/2088202342 >> 172.21.15.102:0/2088202342 conn(0x565453031a70 msgr2=0x565453122b70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.155+0000 7f04a452e800 1 -- 172.21.15.102:0/2088202342 shutdown_connections 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.155+0000 7f04a452e800 1 -- 172.21.15.102:0/2088202342 wait complete. 2024-09-19T11:15:41.158 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.155+0000 7f04a452e800 1 Processor -- start 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f04a452e800 1 -- start start 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f04a452e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x56545312ece0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f04a452e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56545303eab0 con 0x565453037fb0 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x56545312ece0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x56545312ece0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40004/0 (socket says 172.21.15.102:40004) 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f04a02dd640 1 -- 172.21.15.102:0/3105734802 learned_addr learned my addr 172.21.15.102:0/3105734802 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f04a02dd640 1 -- 172.21.15.102:0/3105734802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545312f240 con 0x565453037fb0 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f04a02dd640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x56545312ece0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x565453128180 tx=0x7f0490001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.156+0000 7f038ce09640 1 -- 172.21.15.102:0/3105734802 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0490014a10 con 0x565453037fb0 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.157+0000 7f038ce09640 1 -- 172.21.15.102:0/3105734802 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0490014bb0 con 0x565453037fb0 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.157+0000 7f038ce09640 1 -- 172.21.15.102:0/3105734802 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049001e3f0 con 0x565453037fb0 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.157+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56545312f4d0 con 0x565453037fb0 2024-09-19T11:15:41.159 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.157+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545312fed0 con 0x565453037fb0 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.157+0000 7f038ce09640 1 -- 172.21.15.102:0/3105734802 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0490010070 con 0x565453037fb0 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.158+0000 7f038ce09640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f038803d000 0x7f038803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.158+0000 7f038ce09640 1 -- 172.21.15.102:0/3105734802 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f0490018070 con 0x565453037fb0 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.158+0000 7f049fadc640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f038803d000 0x7f038803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.158+0000 7f04a452e800 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545303bac0 0x565453136330 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.158+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453136870 con 0x56545303bac0 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.158+0000 7f04a0ade640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545303bac0 0x565453136330 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.158+0000 7f049fadc640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f038803d000 0x7f038803f4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0488057000 tx=0x7f0488052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.164 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.158+0000 7f04a0ade640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545303bac0 0x565453136330 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.159+0000 7f04a0ade640 1 -- 172.21.15.102:0/3105734802 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04980083e0 con 0x56545303bac0 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.159+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453136c10 con 0x56545303bac0 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.159+0000 7f04a0ade640 1 -- 172.21.15.102:0/3105734802 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04980083e0 con 0x56545303bac0 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.159+0000 7f04a452e800 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453138710 0x56545313ab90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.159+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56545313b320 con 0x565453138710 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.159+0000 7f04a02dd640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453138710 0x56545313ab90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.159+0000 7f04a02dd640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453138710 0x56545313ab90 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.160+0000 7f04a02dd640 1 -- 172.21.15.102:0/3105734802 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7f0490051040 con 0x565453138710 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.160+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453137460 con 0x56545303bac0 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.160+0000 7f04a0ade640 1 -- 172.21.15.102:0/3105734802 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f04980083e0 con 0x56545303bac0 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.160+0000 7f04a452e800 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56545313c780 0x56545313eb70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.160+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56545313f2e0 con 0x56545313c780 2024-09-19T11:15:41.165 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.160+0000 7f049fadc640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56545313c780 0x56545313eb70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.160+0000 7f049fadc640 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56545313c780 0x56545313eb70 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.161+0000 7f049fadc640 1 -- 172.21.15.102:0/3105734802 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7f0488051070 con 0x56545313c780 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.161+0000 7f04a452e800 1 Processor -- start 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.161+0000 7f04a452e800 1 -- start start 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.161+0000 7f04a452e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545314d060 0x56545314d480 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.161+0000 7f04a452e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565452f2e4a0 con 0x56545314d060 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.161+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545314d060 0x56545314d480 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545314d060 0x56545314d480 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40008/0 (socket says 172.21.15.102:40008) 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f04a02dd640 1 -- 172.21.15.102:0/2494268980 learned_addr learned my addr 172.21.15.102:0/2494268980 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f04a02dd640 1 -- 172.21.15.102:0/2494268980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545314dac0 con 0x56545314d060 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f04a02dd640 1 --2- 172.21.15.102:0/2494268980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545314d060 0x56545314d480 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0490011ff0 tx=0x7f0490028e70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f0385ffb640 1 -- 172.21.15.102:0/2494268980 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049004b1f0 con 0x56545314d060 2024-09-19T11:15:41.166 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f0385ffb640 1 -- 172.21.15.102:0/2494268980 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049004f040 con 0x56545314d060 2024-09-19T11:15:41.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f0385ffb640 1 -- 172.21.15.102:0/2494268980 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f049004b3d0 con 0x56545314d060 2024-09-19T11:15:41.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f04a452e800 1 -- 172.21.15.102:0/2494268980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x56545314e2f0 con 0x56545314d060 2024-09-19T11:15:41.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.162+0000 7f04a452e800 1 -- 172.21.15.102:0/2494268980 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x56545314e890 con 0x56545314d060 2024-09-19T11:15:41.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.163+0000 7f0385ffb640 1 -- 172.21.15.102:0/2494268980 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f049003a030 con 0x56545314d060 2024-09-19T11:15:41.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.163+0000 7f0385ffb640 1 --2- 172.21.15.102:0/2494268980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f037803cfb0 0x7f037803f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.163+0000 7f0385ffb640 1 -- 172.21.15.102:0/2494268980 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f0490038070 con 0x56545314d060 2024-09-19T11:15:41.167 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.163+0000 7f049fadc640 1 --2- 172.21.15.102:0/2494268980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f037803cfb0 0x7f037803f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.163+0000 7f04a452e800 1 Processor -- start 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.163+0000 7f04a452e800 1 -- start start 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.163+0000 7f049fadc640 1 --2- 172.21.15.102:0/2494268980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f037803cfb0 0x7f037803f470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x565453137800 tx=0x7f0488005a00 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f04a452e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x565453159f00 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f04a452e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x565453127c10 con 0x565453159b00 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x565453159f00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x565453159f00 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40018/0 (socket says 172.21.15.102:40018) 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f04a02dd640 1 -- 172.21.15.102:0/2162861613 learned_addr learned my addr 172.21.15.102:0/2162861613 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.182 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f04a02dd640 1 -- 172.21.15.102:0/2162861613 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x56545315a4f0 con 0x565453159b00 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f04a02dd640 1 --2- 172.21.15.102:0/2162861613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x565453159f00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f049004d010 tx=0x7f049004b9f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=ed06001f15cfab39 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f03777fe640 1 -- 172.21.15.102:0/2162861613 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0490021bb0 con 0x565453159b00 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f03777fe640 1 -- 172.21.15.102:0/2162861613 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f049003c410 con 0x565453159b00 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.164+0000 7f03777fe640 1 -- 172.21.15.102:0/2162861613 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f04900214c0 con 0x565453159b00 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 -- 172.21.15.102:0/2162861613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 msgr2=0x565453159f00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 --2- 172.21.15.102:0/2162861613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x565453159f00 secure :-1 s=READY pgs=827 cs=0 l=1 rev1=1 crypto rx=0x7f049004d010 tx=0x7f049004b9f0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 -- 172.21.15.102:0/2162861613 shutdown_connections 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 --2- 172.21.15.102:0/2162861613 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x565453159f00 unknown :-1 s=CLOSED pgs=827 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 -- 172.21.15.102:0/2162861613 >> 172.21.15.102:0/2162861613 conn(0x565453155f00 msgr2=0x565453154140 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 -- 172.21.15.102:0/2162861613 shutdown_connections 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 -- 172.21.15.102:0/2162861613 wait complete. 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 Processor -- start 2024-09-19T11:15:41.183 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 -- start start 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x5654530376d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a452e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x56545315a960 con 0x565453159b00 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.165+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x5654530376d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f04a02dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x5654530376d0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40026/0 (socket says 172.21.15.102:40026) 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 learned_addr learned my addr 172.21.15.102:0/1856578123 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x565453037c30 con 0x565453159b00 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f04a02dd640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x5654530376d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f049004d010 tx=0x7f0490013800 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f0375ffb640 1 -- 172.21.15.102:0/1856578123 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0490021bb0 con 0x565453159b00 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f0375ffb640 1 -- 172.21.15.102:0/1856578123 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0490012890 con 0x565453159b00 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f0375ffb640 1 -- 172.21.15.102:0/1856578123 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0490054180 con 0x565453159b00 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x565453037c30 con 0x565453159b00 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.166+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x565453037c30 con 0x565453159b00 2024-09-19T11:15:41.184 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.167+0000 7f0375ffb640 1 -- 172.21.15.102:0/1856578123 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f049006c020 con 0x565453159b00 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.167+0000 7f0375ffb640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f036803d000 0x7f036803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.167+0000 7f0375ffb640 1 -- 172.21.15.102:0/1856578123 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f0490062d80 con 0x565453159b00 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.167+0000 7f049fadc640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f036803d000 0x7f036803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f049fadc640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f036803d000 0x7f036803f4c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x56545313f6e0 tx=0x7f0488053000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545316e540 0x565453170a00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453171150 con 0x56545316e540 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a0ade640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545316e540 0x565453170a00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a0ade640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545316e540 0x565453170a00 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04980083e0 con 0x56545316e540 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.185 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a452e800 20 realm 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.168+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453171560 con 0x56545316e540 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04980083e0 con 0x56545316e540 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f04980083e0 con 0x56545316e540 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5654531721d0 con 0x56545316e540 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7f04980083e0 con 0x56545316e540 2024-09-19T11:15:41.186 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453172b90 0x565453174f80 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.169+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5654531755d0 con 0x565453172b90 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f04a02dd640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453172b90 0x565453174f80 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f04a02dd640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453172b90 0x565453174f80 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f04a452e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f04a452e800 20 searching for the correct realm 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x565453177560 0x565453179a20 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56545317a0a0 con 0x565453177560 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f049fadc640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x565453177560 0x565453179a20 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.170+0000 7f049fadc640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x565453177560 0x565453179a20 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.187 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.171+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.171+0000 7f049fadc640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f048805f040 0x7f048805f930 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.171+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x56545317a0a0 con 0x7f048805f040 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.171+0000 7f04a0ade640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f048805f040 0x7f048805f930 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.171+0000 7f04a0ade640 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f048805f040 0x7f048805f930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.171+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980083e0 con 0x7f048805f040 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.171+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453172b90 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.172+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.172+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.172+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f04980083e0 con 0x56545316e540 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.172+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.172+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.172+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453172b90 2024-09-19T11:15:41.188 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.172+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.172+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453172b90 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.173+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.173+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x7f048805f040 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.173+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.173+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453177560 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.173+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.173+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.173+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.173+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453172b90 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.174+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.174+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.189 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.174+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.174+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x7f048805f040 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.174+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.174+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453177560 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.174+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.174+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453177560 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453172b90 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453177560 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453177560 2024-09-19T11:15:41.190 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.175+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.176+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.176+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453172b90 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.176+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.176+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453177560 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.176+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.176+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x7f048805f040 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.176+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.176+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.177+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.191 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.177+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453172b90 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.177+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.177+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453177560 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.177+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.177+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453172b90 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.177+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.177+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x7f048805f040 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.178+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.178+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x565453177560 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.178+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.178+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x7f048805f040 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.178+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.192 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.178+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x56545316e540 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.178+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.178+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x565453171e30 con 0x7f048805f040 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453175970 con 0x56545316e540 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.193 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453175970 con 0x56545316e540 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453175970 con 0x565453177560 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 zone default found 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 4 Realm: () 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:41.194 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 zonegroup default 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.179+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5654531762a0 con 0x565453172b90 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56545317c040 con 0x565453177560 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x56545317c4a0 con 0x565453177560 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.195 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 20 started sync module instance, tier type = 2024-09-19T11:15:41.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:41.196 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.180+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317b3b0 con 0x7f048805f040 2024-09-19T11:15:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.181+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.181+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94920171305168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317b3b0 con 0x7f048805f040 2024-09-19T11:15:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.181+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317cf90 con 0x56545316e540 2024-09-19T11:15:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.182+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94920171305168] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.183+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.201 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.183+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94920171309728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317b3b0 con 0x56545316e540 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.183+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317da40 con 0x565453177560 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.184+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94920171309728] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.184+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.184+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94920171302656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317b320 con 0x565453177560 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.184+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317e900 con 0x7f048805f040 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.185+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.185+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94920171316304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317ed20 con 0x7f048805f040 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.185+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317f810 con 0x56545316e540 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.185+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94920171302656] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.186+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94920171316304] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498026040 con 0x7f048805f040 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.186+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.186+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94920171320032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317e870 con 0x56545316e540 2024-09-19T11:15:41.202 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.186+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531800b0 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.187+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94920171320032] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.187+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.187+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94920171322368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x56545317e870 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.187+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565453180a70 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.188+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(56 notify.6 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.188+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94920171324864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565453180ed0 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.188+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531819a0 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.189+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(55 notify.5 [watch watch cookie 94920171322368] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.189+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94920171324864] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'273 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94920171328656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531809e0 con 0x565453172b90 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 20 add_watcher() i=0 2024-09-19T11:15:41.203 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 20 add_watcher() i=1 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 20 add_watcher() i=2 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 20 add_watcher() i=3 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 20 add_watcher() i=4 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 20 add_watcher() i=5 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 20 add_watcher() i=6 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94920171328656] v37'274 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 20 add_watcher() i=7 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.190+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x565453184990 con 0x56545316e540 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.191+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.191+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94920171314736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x565453181e50 con 0x56545316e540 2024-09-19T11:15:41.204 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94920171314736] v37'267 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0498026040 con 0x56545316e540 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f0356fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f04a452e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f04a452e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f04a452e800 5 note: GC not initialized 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f0355fdb640 20 reqs_thread_entry: start 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f04a452e800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f04a452e800 20 Filter name: none 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.192+0000 7f02c77fe640 20 reqs_thread_entry: start 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.193+0000 7f04a452e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.193+0000 7f04a452e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.193+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5654531b77a0 con 0x565453172b90 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.194+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~490 out=490b,getxattrs out=75b] v0'0 uv10 ondisk = 0) ==== 231+0+613 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.194+0000 7f04a452e800 20 rados_obj.operate() r=0 bl.length=490 2024-09-19T11:15:41.205 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.194+0000 7f04a452e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.194+0000 7f04a452e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.194+0000 7f04a452e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.194+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~460 in=460b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531bdb80 con 0x565453172b90 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.195+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~460] v37'11 uv11 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.195+0000 7f04a452e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.195+0000 7f04a452e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.195+0000 7f04a452e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.195+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94920171574592 in=648b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5654531b91e0 con 0x56545316e540 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.196+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 94920171320032 notify 158913789993 ret 0) ==== 678+0+0 (crc 0 0 0) 0x7f0498032040 con 0x56545316e540 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.196+0000 7f03777fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789993 cookie 94920171320032 notifier 4918 bl.length()=636 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.196+0000 7f03777fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.196+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 94920171574592 out=8b] v0'0 uv273 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7f0498036040 con 0x56545316e540 2024-09-19T11:15:41.206 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.196+0000 7f03777fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.196+0000 7f03777fe640 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7f036c003ea0 con 0x56545316e540 2024-09-19T11:15:41.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.196+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498036040 con 0x56545316e540 2024-09-19T11:15:41.207 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.196+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 94920171574592 notify 158913789993 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7f0498010040 con 0x56545316e540 2024-09-19T11:15:41.207 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:41.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.197+0000 7f0356fdd640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:41.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.197+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94920171314736] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x56545316e540 2024-09-19T11:15:41.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.198+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94920171314736] v37'268 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7f0498036040 con 0x56545316e540 2024-09-19T11:15:41.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.198+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94920171305168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x7f048805f040 2024-09-19T11:15:41.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.199+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94920171305168] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498036040 con 0x7f048805f040 2024-09-19T11:15:41.212 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.199+0000 7f04a452e800 20 remove_watcher() i=0 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.199+0000 7f04a452e800 2 removed watcher, disabling cache 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.199+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94920171309728] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x56545316e540 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.200+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94920171309728] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498036040 con 0x56545316e540 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.200+0000 7f04a452e800 20 remove_watcher() i=1 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.200+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94920171302656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x565453177560 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.201+0000 7f049fadc640 1 -- 172.21.15.102:0/1856578123 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94920171302656] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f048807c040 con 0x565453177560 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.201+0000 7f04a452e800 20 remove_watcher() i=2 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.201+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94920171316304] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x7f048805f040 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.202+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94920171316304] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498036040 con 0x7f048805f040 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.202+0000 7f04a452e800 20 remove_watcher() i=3 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.202+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94920171320032] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x56545316e540 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.203+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94920171320032] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f0498036040 con 0x56545316e540 2024-09-19T11:15:41.213 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.203+0000 7f04a452e800 20 remove_watcher() i=4 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.203+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94920171322368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x565453172b90 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.204+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94920171322368] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.204+0000 7f04a452e800 20 remove_watcher() i=5 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.204+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94920171324864] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x565453172b90 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.205+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94920171324864] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.205+0000 7f04a452e800 20 remove_watcher() i=6 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.205+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94920171328656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5654531b55d0 con 0x565453172b90 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a02dd640 1 -- 172.21.15.102:0/1856578123 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94920171328656] v37'275 uv273 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7f049005d070 con 0x565453172b90 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 20 remove_watcher() i=7 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453172b90 msgr2=0x565453174f80 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453172b90 0x565453174f80 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545316e540 msgr2=0x565453170a00 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545316e540 0x565453170a00 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.214 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f048805f040 msgr2=0x7f048805f930 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7f048805f040 0x7f048805f930 crc :-1 s=READY pgs=102 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x565453177560 msgr2=0x565453179a20 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x565453177560 0x565453179a20 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f036803d000 msgr2=0x7f036803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f036803d000 0x7f036803f4c0 secure :-1 s=READY pgs=346 cs=0 l=1 rev1=1 crypto rx=0x56545313f6e0 tx=0x7f0488053000 comp rx=0 tx=0).stop 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 msgr2=0x5654530376d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 --2- 172.21.15.102:0/1856578123 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453159b00 0x5654530376d0 secure :-1 s=READY pgs=828 cs=0 l=1 rev1=1 crypto rx=0x7f049004d010 tx=0x7f0490013800 comp rx=0 tx=0).stop 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 reap_dead start 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a0ade640 1 -- 172.21.15.102:0/1856578123 reap_dead start 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 shutdown_connections 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.206+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 >> 172.21.15.102:0/1856578123 conn(0x565453155f00 msgr2=0x565453154110 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.215 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 shutdown_connections 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/1856578123 wait complete. 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/2494268980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f037803cfb0 msgr2=0x7f037803f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/2494268980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f037803cfb0 0x7f037803f470 secure :-1 s=READY pgs=345 cs=0 l=1 rev1=1 crypto rx=0x565453137800 tx=0x7f0488005a00 comp rx=0 tx=0).stop 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/2494268980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545314d060 msgr2=0x56545314d480 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/2494268980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545314d060 0x56545314d480 secure :-1 s=READY pgs=826 cs=0 l=1 rev1=1 crypto rx=0x7f0490011ff0 tx=0x7f0490028e70 comp rx=0 tx=0).stop 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/2494268980 shutdown_connections 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/2494268980 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f037803cfb0 0x7f037803f470 unknown :-1 s=CLOSED pgs=345 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/2494268980 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x56545314d060 0x56545314d480 unknown :-1 s=CLOSED pgs=826 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/2494268980 >> 172.21.15.102:0/2494268980 conn(0x565453141410 msgr2=0x5654531417f0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/2494268980 shutdown_connections 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/2494268980 wait complete. 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453138710 msgr2=0x56545313ab90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.216 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x565453138710 0x56545313ab90 crc :-1 s=READY pgs=193 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545303bac0 msgr2=0x565453136330 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x56545303bac0 0x565453136330 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56545313c780 msgr2=0x56545313eb70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x56545313c780 0x56545313eb70 crc :-1 s=READY pgs=194 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f038803d000 msgr2=0x7f038803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f038803d000 0x7f038803f4c0 secure :-1 s=READY pgs=344 cs=0 l=1 rev1=1 crypto rx=0x7f0488057000 tx=0x7f0488052000 comp rx=0 tx=0).stop 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 msgr2=0x56545312ece0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 --2- 172.21.15.102:0/3105734802 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x565453037fb0 0x56545312ece0 secure :-1 s=READY pgs=825 cs=0 l=1 rev1=1 crypto rx=0x565453128180 tx=0x7f0490001250 comp rx=0 tx=0).stop 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a0ade640 1 -- 172.21.15.102:0/3105734802 reap_dead start 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 shutdown_connections 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 >> 172.21.15.102:0/3105734802 conn(0x565453031a70 msgr2=0x5654531286e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.217 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.207+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 shutdown_connections 2024-09-19T11:15:41.218 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.208+0000 7f04a452e800 1 -- 172.21.15.102:0/3105734802 wait complete. 2024-09-19T11:15:41.218 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:41.219 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:41.219 ERROR:root:0 2024-09-19T11:15:41.219 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-19T11:15:41.219 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-19T11:15:41.219 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-19T11:15:41.265 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:41.265 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:41.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe935b24800 1 Processor -- start 2024-09-19T11:15:41.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe935b24800 1 -- start start 2024-09-19T11:15:41.266 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe935b24800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55fa08293fd0 0x55fa082963c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe935b24800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x55fa0829a5f0 con 0x55fa08296900 2024-09-19T11:15:41.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe935b24800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x55fa0811e7d0 con 0x55fa08293fd0 2024-09-19T11:15:41.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe931868640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x55fa08293fd0 0x55fa082963c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe931067640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x55fa08296900 0x55fa08298d90 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34834/0 (socket says 172.21.15.102:34834) 2024-09-19T11:15:41.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe931067640 1 -- 172.21.15.102:0/3339283651 learned_addr learned my addr 172.21.15.102:0/3339283651 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:41.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe931868640 1 -- 172.21.15.102:0/3339283651 >> v1:172.21.15.37:6789/0 conn(0x55fa08296900 legacy=0x55fa08298d90 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe931868640 1 -- 172.21.15.102:0/3339283651 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa0829b820 con 0x55fa08293fd0 2024-09-19T11:15:41.267 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.265+0000 7fe930866640 1 -- 172.21.15.102:0/3339283651 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3279383165 0 0) 0x55fa0829a5f0 con 0x55fa08296900 2024-09-19T11:15:41.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.267+0000 7fe931868640 1 --2- 172.21.15.102:0/3339283651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa082963c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe92400a470 tx=0x7fe924045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=97edd4a91e945b3c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.268 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.267+0000 7fe930866640 1 -- 172.21.15.102:0/3339283651 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe924053570 con 0x55fa08293fd0 2024-09-19T11:15:41.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.267+0000 7fe930866640 1 -- 172.21.15.102:0/3339283651 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe924058070 con 0x55fa08293fd0 2024-09-19T11:15:41.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.267+0000 7fe930866640 1 -- 172.21.15.102:0/3339283651 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe924053880 con 0x55fa08293fd0 2024-09-19T11:15:41.269 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.268+0000 7fe935b24800 1 -- 172.21.15.102:0/3339283651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 msgr2=0x55fa082963c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.268+0000 7fe935b24800 1 --2- 172.21.15.102:0/3339283651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa082963c0 secure :-1 s=READY pgs=830 cs=0 l=1 rev1=1 crypto rx=0x7fe92400a470 tx=0x7fe924045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:41.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.268+0000 7fe935b24800 1 -- 172.21.15.102:0/3339283651 shutdown_connections 2024-09-19T11:15:41.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.268+0000 7fe935b24800 1 --2- 172.21.15.102:0/3339283651 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa082963c0 unknown :-1 s=CLOSED pgs=830 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.268+0000 7fe935b24800 1 -- 172.21.15.102:0/3339283651 >> 172.21.15.102:0/3339283651 conn(0x55fa0828da70 msgr2=0x55fa0828fed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.268+0000 7fe935b24800 1 -- 172.21.15.102:0/3339283651 shutdown_connections 2024-09-19T11:15:41.270 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.268+0000 7fe935b24800 1 -- 172.21.15.102:0/3339283651 wait complete. 2024-09-19T11:15:41.283 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.281+0000 7fe935b24800 1 Processor -- start 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.282+0000 7fe935b24800 1 -- start start 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.282+0000 7fe935b24800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa083831e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.282+0000 7fe935b24800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa0812bdd0 con 0x55fa08293fd0 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.282+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa083831e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.282+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa083831e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40030/0 (socket says 172.21.15.102:40030) 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.282+0000 7fe931868640 1 -- 172.21.15.102:0/936275770 learned_addr learned my addr 172.21.15.102:0/936275770 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.282+0000 7fe931868640 1 -- 172.21.15.102:0/936275770 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa083837d0 con 0x55fa08293fd0 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.282+0000 7fe931868640 1 --2- 172.21.15.102:0/936275770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa083831e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe924005870 tx=0x7fe924051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=3438351cdb6dea3f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe81fe07640 1 -- 172.21.15.102:0/936275770 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe92405c580 con 0x55fa08293fd0 2024-09-19T11:15:41.284 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe81fe07640 1 -- 172.21.15.102:0/936275770 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe924063030 con 0x55fa08293fd0 2024-09-19T11:15:41.285 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe81fe07640 1 -- 172.21.15.102:0/936275770 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe92405c850 con 0x55fa08293fd0 2024-09-19T11:15:41.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe935b24800 1 -- 172.21.15.102:0/936275770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 msgr2=0x55fa083831e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.288 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe935b24800 1 --2- 172.21.15.102:0/936275770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa083831e0 secure :-1 s=READY pgs=831 cs=0 l=1 rev1=1 crypto rx=0x7fe924005870 tx=0x7fe924051000 comp rx=0 tx=0).stop 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe935b24800 1 -- 172.21.15.102:0/936275770 shutdown_connections 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe935b24800 1 --2- 172.21.15.102:0/936275770 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa083831e0 unknown :-1 s=CLOSED pgs=831 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe935b24800 1 -- 172.21.15.102:0/936275770 >> 172.21.15.102:0/936275770 conn(0x55fa0828da70 msgr2=0x55fa0837eb60 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe935b24800 1 -- 172.21.15.102:0/936275770 shutdown_connections 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.283+0000 7fe935b24800 1 -- 172.21.15.102:0/936275770 wait complete. 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.284+0000 7fe935b24800 1 Processor -- start 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.284+0000 7fe935b24800 1 -- start start 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.284+0000 7fe935b24800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa082936f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.284+0000 7fe935b24800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa0829aac0 con 0x55fa08293fd0 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.284+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa082936f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.284+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa082936f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40034/0 (socket says 172.21.15.102:40034) 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.284+0000 7fe931868640 1 -- 172.21.15.102:0/2311178197 learned_addr learned my addr 172.21.15.102:0/2311178197 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.289 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.285+0000 7fe931868640 1 -- 172.21.15.102:0/2311178197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa08293c50 con 0x55fa08293fd0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.285+0000 7fe931868640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa082936f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe924045f50 tx=0x7fe924002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.285+0000 7fe81e604640 1 -- 172.21.15.102:0/2311178197 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe924078070 con 0x55fa08293fd0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.285+0000 7fe81e604640 1 -- 172.21.15.102:0/2311178197 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe924054a70 con 0x55fa08293fd0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.285+0000 7fe81e604640 1 -- 172.21.15.102:0/2311178197 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe924054d50 con 0x55fa08293fd0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.285+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa08292000 con 0x55fa08293fd0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.285+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa08292620 con 0x55fa08293fd0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.286+0000 7fe81e604640 1 -- 172.21.15.102:0/2311178197 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe92407b070 con 0x55fa08293fd0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.286+0000 7fe81e604640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe81803d000 0x7fe81803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.286+0000 7fe81e604640 1 -- 172.21.15.102:0/2311178197 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fe924070070 con 0x55fa08293fd0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.286+0000 7fe931067640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe81803d000 0x7fe81803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.286+0000 7fe935b24800 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa08296900 0x55fa08394130 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.290 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.286+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa08394670 con 0x55fa08296900 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.286+0000 7fe932069640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa08296900 0x55fa08394130 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.287+0000 7fe931067640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe81803d000 0x7fe81803f4c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe928000c00 tx=0x7fe9280013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.287+0000 7fe932069640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa08296900 0x55fa08394130 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.287+0000 7fe932069640 1 -- 172.21.15.102:0/2311178197 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa08296900 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.287+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa08292b30 con 0x55fa08296900 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.287+0000 7fe932069640 1 -- 172.21.15.102:0/2311178197 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa08296900 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.287+0000 7fe935b24800 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083969a0 0x55fa08398d90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.287+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa08399460 con 0x55fa083969a0 2024-09-19T11:15:41.291 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.288+0000 7fe931868640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083969a0 0x55fa08398d90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.288+0000 7fe931868640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083969a0 0x55fa08398d90 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.288+0000 7fe931868640 1 -- 172.21.15.102:0/2311178197 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fe92407a030 con 0x55fa083969a0 2024-09-19T11:15:41.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.288+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa08395840 con 0x55fa08296900 2024-09-19T11:15:41.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.288+0000 7fe932069640 1 -- 172.21.15.102:0/2311178197 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa08296900 2024-09-19T11:15:41.302 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.288+0000 7fe935b24800 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa0839a8a0 0x55fa0839cc90 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.288+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa0839d3d0 con 0x55fa0839a8a0 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.289+0000 7fe931067640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa0839a8a0 0x55fa0839cc90 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.289+0000 7fe931067640 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa0839a8a0 0x55fa0839cc90 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.289+0000 7fe931067640 1 -- 172.21.15.102:0/2311178197 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fe92800f670 con 0x55fa0839a8a0 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.289+0000 7fe935b24800 1 Processor -- start 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.289+0000 7fe935b24800 1 -- start start 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe935b24800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083ab150 0x55fa083ab570 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe935b24800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa0818a4a0 con 0x55fa083ab150 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083ab150 0x55fa083ab570 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083ab150 0x55fa083ab570 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40044/0 (socket says 172.21.15.102:40044) 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe931868640 1 -- 172.21.15.102:0/3614451921 learned_addr learned my addr 172.21.15.102:0/3614451921 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe931868640 1 -- 172.21.15.102:0/3614451921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa083abbb0 con 0x55fa083ab150 2024-09-19T11:15:41.303 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe931868640 1 --2- 172.21.15.102:0/3614451921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083ab150 0x55fa083ab570 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe92407c8d0 tx=0x7fe92407c630 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe8177fe640 1 -- 172.21.15.102:0/3614451921 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe924009d50 con 0x55fa083ab150 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe8177fe640 1 -- 172.21.15.102:0/3614451921 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe924068420 con 0x55fa083ab150 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe8177fe640 1 -- 172.21.15.102:0/3614451921 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe924068610 con 0x55fa083ab150 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe935b24800 1 -- 172.21.15.102:0/3614451921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa083ac3e0 con 0x55fa083ab150 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.290+0000 7fe935b24800 1 -- 172.21.15.102:0/3614451921 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa083ac980 con 0x55fa083ab150 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.291+0000 7fe8177fe640 1 -- 172.21.15.102:0/3614451921 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe9240687b0 con 0x55fa083ab150 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.291+0000 7fe8177fe640 1 --2- 172.21.15.102:0/3614451921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe80c03cfb0 0x7fe80c03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.291+0000 7fe8177fe640 1 -- 172.21.15.102:0/3614451921 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fe924088070 con 0x55fa083ab150 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.291+0000 7fe931067640 1 --2- 172.21.15.102:0/3614451921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe80c03cfb0 0x7fe80c03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe935b24800 1 Processor -- start 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe935b24800 1 -- start start 2024-09-19T11:15:41.304 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe931067640 1 --2- 172.21.15.102:0/3614451921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe80c03cfb0 0x7fe80c03f470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55fa08394b40 tx=0x7fe928006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe935b24800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083b7e10 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe935b24800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa08383ba0 con 0x55fa083b7a30 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083b7e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083b7e10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40056/0 (socket says 172.21.15.102:40056) 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe931868640 1 -- 172.21.15.102:0/2225704730 learned_addr learned my addr 172.21.15.102:0/2225704730 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe931868640 1 -- 172.21.15.102:0/2225704730 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa083b8400 con 0x55fa083b7a30 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.292+0000 7fe931868640 1 --2- 172.21.15.102:0/2225704730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083b7e10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe92405f530 tx=0x7fe92407da40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=14c45569787603f3 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe8157fa640 1 -- 172.21.15.102:0/2225704730 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe92409d070 con 0x55fa083b7a30 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe8157fa640 1 -- 172.21.15.102:0/2225704730 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe9240080e0 con 0x55fa083b7a30 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe8157fa640 1 -- 172.21.15.102:0/2225704730 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe92405e850 con 0x55fa083b7a30 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 -- 172.21.15.102:0/2225704730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 msgr2=0x55fa083b7e10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 --2- 172.21.15.102:0/2225704730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083b7e10 secure :-1 s=READY pgs=834 cs=0 l=1 rev1=1 crypto rx=0x7fe92405f530 tx=0x7fe92407da40 comp rx=0 tx=0).stop 2024-09-19T11:15:41.305 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 -- 172.21.15.102:0/2225704730 shutdown_connections 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 --2- 172.21.15.102:0/2225704730 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083b7e10 unknown :-1 s=CLOSED pgs=834 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 -- 172.21.15.102:0/2225704730 >> 172.21.15.102:0/2225704730 conn(0x55fa083b3e30 msgr2=0x55fa083b2070 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 -- 172.21.15.102:0/2225704730 shutdown_connections 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 -- 172.21.15.102:0/2225704730 wait complete. 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 Processor -- start 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.293+0000 7fe935b24800 1 -- start start 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe935b24800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083bee70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe935b24800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x55fa083b8890 con 0x55fa083b7a30 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083bee70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe931868640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083bee70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40058/0 (socket says 172.21.15.102:40058) 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 learned_addr learned my addr 172.21.15.102:0/2645192021 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.306 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x55fa083bf3d0 con 0x55fa083b7a30 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe931868640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083bee70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe924009ad0 tx=0x7fe92406eea0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe8037fe640 1 -- 172.21.15.102:0/2645192021 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe9240bb070 con 0x55fa083b7a30 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe8037fe640 1 -- 172.21.15.102:0/2645192021 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe92407d570 con 0x55fa083b7a30 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe8037fe640 1 -- 172.21.15.102:0/2645192021 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe92405e980 con 0x55fa083b7a30 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x55fa083bf3d0 con 0x55fa083b7a30 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.294+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x55fa083bf3d0 con 0x55fa083b7a30 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.295+0000 7fe8037fe640 1 -- 172.21.15.102:0/2645192021 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe9240be070 con 0x55fa083b7a30 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.295+0000 7fe8037fe640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe7fc03cfb0 0x7fe7fc03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.295+0000 7fe8037fe640 1 -- 172.21.15.102:0/2645192021 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fe9240b2030 con 0x55fa083b7a30 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.295+0000 7fe931067640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe7fc03cfb0 0x7fe7fc03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.296+0000 7fe931067640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe7fc03cfb0 0x7fe7fc03f470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe92800ffd0 tx=0x7fe928023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.296+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.307 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.296+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa083ca450 0x55fa083cc910 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.296+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083cd060 con 0x55fa083ca450 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.296+0000 7fe932069640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa083ca450 0x55fa083cc910 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.296+0000 7fe932069640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa083ca450 0x55fa083cc910 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 realm 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083cd470 con 0x55fa083ca450 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.308 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083cdd40 con 0x55fa083ca450 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ce0e0 con 0x55fa083ca450 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083cee40 0x55fa083d1230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.297+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d17f0 con 0x55fa083cee40 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.298+0000 7fe931868640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083cee40 0x55fa083d1230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.298+0000 7fe931868640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083cee40 0x55fa083d1230 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.298+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.309 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.298+0000 7fe935b24800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.298+0000 7fe935b24800 20 searching for the correct realm 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.298+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa083d37a0 0x55fa083d5c60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.298+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d6330 con 0x55fa083d37a0 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.298+0000 7fe931067640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa083d37a0 0x55fa083d5c60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.299+0000 7fe931067640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa083d37a0 0x55fa083d5c60 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.299+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe928037040 con 0x55fa083d37a0 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.299+0000 7fe931067640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe92802e910 0x7fe92803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.299+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d6330 con 0x7fe92802e910 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.299+0000 7fe932069640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe92802e910 0x7fe92803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.299+0000 7fe932069640 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe92802e910 0x7fe92803a3c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.300+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.300+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ce0e0 con 0x55fa083cee40 2024-09-19T11:15:41.310 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.300+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.300+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ce0e0 con 0x55fa083ca450 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.300+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.300+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ce0e0 con 0x55fa083ca450 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.300+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.300+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ce0e0 con 0x55fa083cee40 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ce0e0 con 0x55fa083cee40 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x7fe92802e910 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083d37a0 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe928037040 con 0x55fa083d37a0 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083ca450 2024-09-19T11:15:41.311 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.312 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.301+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083cee40 2024-09-19T11:15:41.323 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.302+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.302+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083ca450 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.302+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.302+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x7fe92802e910 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.302+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.302+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083d37a0 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.302+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe928037040 con 0x55fa083d37a0 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.302+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083d37a0 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.303+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fe928037040 con 0x55fa083d37a0 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.303+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083cee40 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.303+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.324 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.303+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083d37a0 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.303+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe928037040 con 0x55fa083d37a0 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.303+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083d37a0 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.303+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe928037040 con 0x55fa083d37a0 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.303+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083ca450 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.304+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.304+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083ca450 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.304+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.304+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083cee40 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.304+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.304+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083d37a0 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.304+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe928037040 con 0x55fa083d37a0 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.304+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x7fe92802e910 2024-09-19T11:15:41.325 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.305+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.305+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083ca450 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.305+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.305+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083cee40 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.305+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.305+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083d37a0 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.305+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe928037040 con 0x55fa083d37a0 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.305+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083cee40 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.306+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.306+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x7fe92802e910 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.306+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.306+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083d37a0 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.306+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe928049040 con 0x55fa083d37a0 2024-09-19T11:15:41.326 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.306+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x7fe92802e910 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.306+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.306+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x55fa083ca450 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x7fe9240cd040 con 0x7fe92802e910 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.327 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d20b0 con 0x55fa083ca450 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d20b0 con 0x55fa083ca450 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.307+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d20b0 con 0x55fa083d37a0 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fe928049040 con 0x55fa083d37a0 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 20 zone default found 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 4 Realm: () 2024-09-19T11:15:41.328 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 20 zonegroup default 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d29e0 con 0x55fa083cee40 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d82a0 con 0x55fa083d37a0 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe928049040 con 0x55fa083d37a0 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.329 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.308+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d87e0 con 0x55fa083d37a0 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.309+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fe928049040 con 0x55fa083d37a0 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.309+0000 7fe935b24800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.309+0000 7fe935b24800 20 started sync module instance, tier type = 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.309+0000 7fe935b24800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.309+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d7640 con 0x7fe92802e910 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.310+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.310+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94532368431936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d7640 con 0x7fe92802e910 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.310+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d92e0 con 0x55fa083ca450 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.311+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94532368431936] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.311+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.311+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94532368436656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d7640 con 0x55fa083ca450 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.311+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d9d90 con 0x55fa083d37a0 2024-09-19T11:15:41.330 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.312+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94532368436656] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.312+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe928049040 con 0x55fa083d37a0 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.312+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94532368429456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083d75b0 con 0x55fa083d37a0 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.312+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083dac50 con 0x7fe92802e910 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.313+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94532368429456] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe928049040 con 0x55fa083d37a0 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.313+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.313+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94532368443296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083db070 con 0x7fe92802e910 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.313+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083dba30 con 0x55fa083ca450 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.314+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94532368443296] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x7fe92802e910 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.315+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.315+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94532368444832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083dba30 con 0x55fa083ca450 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.315+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083dc3f0 con 0x55fa083cee40 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.316+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.331 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.316+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94532368449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083dc810 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.316+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94532368444832] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.316+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083db5c0 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.317+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94532368449344] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.318+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.318+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94532368450400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083dc780 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.318+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083dd8d0 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(58 notify.7 [create] v37'276 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94532368454688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ddcf0 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(57 notify.6 [watch watch cookie 94532368450400] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 20 add_watcher() i=0 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 20 add_watcher() i=1 2024-09-19T11:15:41.332 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 20 add_watcher() i=2 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 20 add_watcher() i=3 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 20 add_watcher() i=4 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 20 add_watcher() i=5 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 20 add_watcher() i=6 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94532368454688] v37'277 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 20 add_watcher() i=7 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.320+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ddcf0 con 0x55fa083ca450 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.321+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.321+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94532368455744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa083ddc60 con 0x55fa083ca450 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.322+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94532368455744] v37'269 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.333 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.322+0000 7fe7e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.322+0000 7fe935b24800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.322+0000 7fe935b24800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.322+0000 7fe935b24800 5 note: GC not initialized 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.322+0000 7fe7e27fc640 20 reqs_thread_entry: start 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.322+0000 7fe935b24800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.322+0000 7fe935b24800 20 Filter name: none 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe753fff640 20 reqs_thread_entry: start 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe935b24800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe935b24800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.334 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa08413aa0 con 0x55fa083cee40 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~460 out=460b,getxattrs out=75b] v0'0 uv11 ondisk = 0) ==== 231+0+583 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe935b24800 20 rados_obj.operate() r=0 bl.length=460 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe935b24800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe935b24800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe935b24800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.323+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa08419e90 con 0x55fa083cee40 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.324+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v37'12 uv12 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.324+0000 7fe935b24800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:41.336 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.324+0000 7fe935b24800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.324+0000 7fe935b24800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.324+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94532368701584 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x55fa08415510 con 0x55fa083ca450 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.325+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 94532368444832 notify 158913789994 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fe92c018c80 con 0x55fa083ca450 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.325+0000 7fe8157fa640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789994 cookie 94532368444832 notifier 4925 bl.length()=649 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.325+0000 7fe8157fa640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.325+0000 7fe8157fa640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.325+0000 7fe8157fa640 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fe7f4003ea0 con 0x55fa083ca450 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.325+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 94532368701584 out=8b] v0'0 uv276 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.325+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c00a4d0 con 0x55fa083ca450 2024-09-19T11:15:41.337 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.325+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== watch-notify(notify_complete (2) cookie 94532368701584 notify 158913789994 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fe92c026410 con 0x55fa083ca450 2024-09-19T11:15:41.338 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.326+0000 7fe7e37fe640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.326+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94532368455744] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa08419170 con 0x55fa083ca450 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.327+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94532368455744] v37'270 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fe92c040040 con 0x55fa083ca450 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.327+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94532368431936] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa08419170 con 0x7fe92802e910 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.333+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94532368431936] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c040040 con 0x7fe92802e910 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.333+0000 7fe935b24800 20 remove_watcher() i=0 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.333+0000 7fe935b24800 2 removed watcher, disabling cache 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.333+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94532368436656] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa08419170 con 0x55fa083ca450 2024-09-19T11:15:41.340 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.334+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94532368436656] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c040040 con 0x55fa083ca450 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.334+0000 7fe935b24800 20 remove_watcher() i=1 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.334+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94532368429456] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa08419170 con 0x55fa083d37a0 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.335+0000 7fe931067640 1 -- 172.21.15.102:0/2645192021 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94532368429456] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe928049040 con 0x55fa083d37a0 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.335+0000 7fe935b24800 20 remove_watcher() i=2 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.335+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94532368443296] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa084118f0 con 0x7fe92802e910 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.336+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94532368443296] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c040040 con 0x7fe92802e910 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.336+0000 7fe935b24800 20 remove_watcher() i=3 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.336+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94532368444832] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa084118f0 con 0x55fa083ca450 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.337+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94532368444832] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe92c040040 con 0x55fa083ca450 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.337+0000 7fe935b24800 20 remove_watcher() i=4 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.337+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94532368449344] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa084118f0 con 0x55fa083cee40 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.338+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94532368449344] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.341 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.338+0000 7fe935b24800 20 remove_watcher() i=5 2024-09-19T11:15:41.342 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.338+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94532368450400] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa084118f0 con 0x55fa083cee40 2024-09-19T11:15:41.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.340+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94532368450400] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.340+0000 7fe935b24800 20 remove_watcher() i=6 2024-09-19T11:15:41.345 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.340+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94532368454688] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x55fa084118f0 con 0x55fa083cee40 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe931868640 1 -- 172.21.15.102:0/2645192021 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94532368454688] v37'278 uv276 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fe9240bd030 con 0x55fa083cee40 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 20 remove_watcher() i=7 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083cee40 msgr2=0x55fa083d1230 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083cee40 0x55fa083d1230 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa083ca450 msgr2=0x55fa083cc910 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa083ca450 0x55fa083cc910 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe92802e910 msgr2=0x7fe92803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fe92802e910 0x7fe92803a3c0 crc :-1 s=READY pgs=103 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa083d37a0 msgr2=0x55fa083d5c60 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa083d37a0 0x55fa083d5c60 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe7fc03cfb0 msgr2=0x7fe7fc03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe7fc03cfb0 0x7fe7fc03f470 secure :-1 s=READY pgs=349 cs=0 l=1 rev1=1 crypto rx=0x7fe92800ffd0 tx=0x7fe928023040 comp rx=0 tx=0).stop 2024-09-19T11:15:41.346 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe932069640 1 -- 172.21.15.102:0/2645192021 reap_dead start 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 msgr2=0x55fa083bee70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083bee70 secure :-1 s=READY pgs=835 cs=0 l=1 rev1=1 crypto rx=0x7fe924009ad0 tx=0x7fe92406eea0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 shutdown_connections 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/2645192021 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083b7a30 0x55fa083bee70 unknown :-1 s=CLOSED pgs=835 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 >> 172.21.15.102:0/2645192021 conn(0x55fa083b3e30 msgr2=0x55fa083b2040 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 shutdown_connections 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/2645192021 wait complete. 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/3614451921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe80c03cfb0 msgr2=0x7fe80c03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/3614451921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe80c03cfb0 0x7fe80c03f470 secure :-1 s=READY pgs=348 cs=0 l=1 rev1=1 crypto rx=0x55fa08394b40 tx=0x7fe928006000 comp rx=0 tx=0).stop 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/3614451921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083ab150 msgr2=0x55fa083ab570 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/3614451921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083ab150 0x55fa083ab570 secure :-1 s=READY pgs=833 cs=0 l=1 rev1=1 crypto rx=0x7fe92407c8d0 tx=0x7fe92407c630 comp rx=0 tx=0).stop 2024-09-19T11:15:41.347 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/3614451921 shutdown_connections 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/3614451921 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe80c03cfb0 0x7fe80c03f470 unknown :-1 s=CLOSED pgs=348 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 --2- 172.21.15.102:0/3614451921 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa083ab150 0x55fa083ab570 unknown :-1 s=CLOSED pgs=833 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/3614451921 >> 172.21.15.102:0/3614451921 conn(0x55fa0839f500 msgr2=0x55fa0839f8e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/3614451921 shutdown_connections 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.341+0000 7fe935b24800 1 -- 172.21.15.102:0/3614451921 wait complete. 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083969a0 msgr2=0x55fa08398d90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x55fa083969a0 0x55fa08398d90 crc :-1 s=READY pgs=195 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa08296900 msgr2=0x55fa08394130 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x55fa08296900 0x55fa08394130 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa0839a8a0 msgr2=0x55fa0839cc90 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x55fa0839a8a0 0x55fa0839cc90 crc :-1 s=READY pgs=196 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe81803d000 msgr2=0x7fe81803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.348 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe81803d000 0x7fe81803f4c0 secure :-1 s=READY pgs=347 cs=0 l=1 rev1=1 crypto rx=0x7fe928000c00 tx=0x7fe9280013b0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 msgr2=0x55fa082936f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 --2- 172.21.15.102:0/2311178197 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x55fa08293fd0 0x55fa082936f0 secure :-1 s=READY pgs=832 cs=0 l=1 rev1=1 crypto rx=0x7fe924045f50 tx=0x7fe924002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe932069640 1 -- 172.21.15.102:0/2311178197 reap_dead start 2024-09-19T11:15:41.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 shutdown_connections 2024-09-19T11:15:41.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 >> 172.21.15.102:0/2311178197 conn(0x55fa0828da70 msgr2=0x55fa0837d350 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 shutdown_connections 2024-09-19T11:15:41.349 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.342+0000 7fe935b24800 1 -- 172.21.15.102:0/2311178197 wait complete. 2024-09-19T11:15:41.352 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:41.352 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:41.352 ERROR:root:0 2024-09-19T11:15:41.352 INFO:tasks.util.rgw:rgwadmin: client.0 : ['caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-19T11:15:41.353 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'caps', 'add', '--uid', 'ada', '--caps', 'users=read, write'] 2024-09-19T11:15:41.353 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph caps add --uid ada --caps 'users=read, write' 2024-09-19T11:15:41.400 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:15:41.401 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.400+0000 7fc4d872e800 1 Processor -- start 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.400+0000 7fc4d872e800 1 -- start start 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.400+0000 7fc4d872e800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x561288e7b6a0 0x561288e7c3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.400+0000 7fc4d872e800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x561288e7bd50 con 0x561288e7c8e0 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.400+0000 7fc4d872e800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x561288d077d0 con 0x561288e7b6a0 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.401+0000 7fc4d44dd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x561288e7b6a0 0x561288e7c3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.401+0000 7fc4d3cdc640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x561288e7c8e0 0x561288e81640 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:34846/0 (socket says 172.21.15.102:34846) 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.401+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/2763853151 learned_addr learned my addr 172.21.15.102:0/2763853151 (peer_addr_for_me v1:172.21.15.102:0/0) 2024-09-19T11:15:41.402 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.401+0000 7fc4d44dd640 1 -- 172.21.15.102:0/2763853151 >> v1:172.21.15.37:6789/0 conn(0x561288e7c8e0 legacy=0x561288e81640 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.401+0000 7fc4d34db640 1 -- 172.21.15.102:0/2763853151 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2044563614 0 0) 0x561288e7bd50 con 0x561288e7c8e0 2024-09-19T11:15:41.403 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.401+0000 7fc4d44dd640 1 -- 172.21.15.102:0/2763853151 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x561288e7cd90 con 0x561288e7b6a0 2024-09-19T11:15:41.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.403+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/2763853151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288e7c3a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400a470 tx=0x7fc4c4045a20 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e95800237b85730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.403+0000 7fc4d34db640 1 -- 172.21.15.102:0/2763853151 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c4053570 con 0x561288e7b6a0 2024-09-19T11:15:41.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.403+0000 7fc4d34db640 1 -- 172.21.15.102:0/2763853151 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4058070 con 0x561288e7b6a0 2024-09-19T11:15:41.404 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.403+0000 7fc4d34db640 1 -- 172.21.15.102:0/2763853151 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c4053880 con 0x561288e7b6a0 2024-09-19T11:15:41.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.404+0000 7fc4d872e800 1 -- 172.21.15.102:0/2763853151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 msgr2=0x561288e7c3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.404+0000 7fc4d872e800 1 --2- 172.21.15.102:0/2763853151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288e7c3a0 secure :-1 s=READY pgs=837 cs=0 l=1 rev1=1 crypto rx=0x7fc4c400a470 tx=0x7fc4c4045a20 comp rx=0 tx=0).stop 2024-09-19T11:15:41.405 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.404+0000 7fc4d872e800 1 -- 172.21.15.102:0/2763853151 shutdown_connections 2024-09-19T11:15:41.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.404+0000 7fc4d872e800 1 --2- 172.21.15.102:0/2763853151 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288e7c3a0 unknown :-1 s=CLOSED pgs=837 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.404+0000 7fc4d872e800 1 -- 172.21.15.102:0/2763853151 >> 172.21.15.102:0/2763853151 conn(0x561288e76a70 msgr2=0x561288e78ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.404+0000 7fc4d872e800 1 -- 172.21.15.102:0/2763853151 shutdown_connections 2024-09-19T11:15:41.406 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.404+0000 7fc4d872e800 1 -- 172.21.15.102:0/2763853151 wait complete. 2024-09-19T11:15:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.417+0000 7fc4d872e800 1 Processor -- start 2024-09-19T11:15:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.418+0000 7fc4d872e800 1 -- start start 2024-09-19T11:15:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.418+0000 7fc4d872e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f6b0b0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.418+0000 7fc4d872e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561288d14dd0 con 0x561288e7b6a0 2024-09-19T11:15:41.419 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.418+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f6b0b0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.418+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f6b0b0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40086/0 (socket says 172.21.15.102:40086) 2024-09-19T11:15:41.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.418+0000 7fc4d44dd640 1 -- 172.21.15.102:0/2897931007 learned_addr learned my addr 172.21.15.102:0/2897931007 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.420 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.418+0000 7fc4d44dd640 1 -- 172.21.15.102:0/2897931007 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561288f6b6a0 con 0x561288e7b6a0 2024-09-19T11:15:41.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.419+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/2897931007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f6b0b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4045f50 tx=0x7fc4c4051000 comp rx=0 tx=0).ready entity=mon.0 client_cookie=1cf8239659f0ac5f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.419+0000 7fc3c260c640 1 -- 172.21.15.102:0/2897931007 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c4053c20 con 0x561288e7b6a0 2024-09-19T11:15:41.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.419+0000 7fc3c260c640 1 -- 172.21.15.102:0/2897931007 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4063030 con 0x561288e7b6a0 2024-09-19T11:15:41.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.419+0000 7fc3c260c640 1 -- 172.21.15.102:0/2897931007 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c4053440 con 0x561288e7b6a0 2024-09-19T11:15:41.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.419+0000 7fc4d872e800 1 -- 172.21.15.102:0/2897931007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 msgr2=0x561288f6b0b0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.422 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.419+0000 7fc4d872e800 1 --2- 172.21.15.102:0/2897931007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f6b0b0 secure :-1 s=READY pgs=838 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4045f50 tx=0x7fc4c4051000 comp rx=0 tx=0).stop 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 -- 172.21.15.102:0/2897931007 shutdown_connections 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 --2- 172.21.15.102:0/2897931007 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f6b0b0 unknown :-1 s=CLOSED pgs=838 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 -- 172.21.15.102:0/2897931007 >> 172.21.15.102:0/2897931007 conn(0x561288e76a70 msgr2=0x561288f66a30 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 -- 172.21.15.102:0/2897931007 shutdown_connections 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 -- 172.21.15.102:0/2897931007 wait complete. 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 Processor -- start 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 -- start start 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f70b60 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d872e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561288e82d60 con 0x561288e7b6a0 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f70b60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f70b60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40088/0 (socket says 172.21.15.102:40088) 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.420+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3574996741 learned_addr learned my addr 172.21.15.102:0/3574996741 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.423 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.421+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3574996741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561288f710c0 con 0x561288e7b6a0 2024-09-19T11:15:41.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.421+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f70b60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4045f20 tx=0x7fc4c4002fb0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.421+0000 7fc3c0e09640 1 -- 172.21.15.102:0/3574996741 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c4053570 con 0x561288e7b6a0 2024-09-19T11:15:41.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.421+0000 7fc3c0e09640 1 -- 172.21.15.102:0/3574996741 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4053710 con 0x561288e7b6a0 2024-09-19T11:15:41.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.421+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561288f6f470 con 0x561288e7b6a0 2024-09-19T11:15:41.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.421+0000 7fc3c0e09640 1 -- 172.21.15.102:0/3574996741 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c4068420 con 0x561288e7b6a0 2024-09-19T11:15:41.424 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.421+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561288f6f9b0 con 0x561288e7b6a0 2024-09-19T11:15:41.427 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.422+0000 7fc3c0e09640 1 -- 172.21.15.102:0/3574996741 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc4c40685c0 con 0x561288e7b6a0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.422+0000 7fc3c0e09640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3bc03d000 0x7fc3bc03f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.422+0000 7fc3c0e09640 1 -- 172.21.15.102:0/3574996741 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc4c4070070 con 0x561288e7b6a0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.422+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3bc03d000 0x7fc3bc03f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.422+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288e7c8e0 0x561288f7d170 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.422+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288f7d6b0 con 0x561288e7c8e0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.422+0000 7fc4d4cde640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288e7c8e0 0x561288f7d170 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.423+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3bc03d000 0x7fc3bc03f4c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8000c00 tx=0x7fc4c80013b0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.423+0000 7fc4d4cde640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288e7c8e0 0x561288f7d170 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.423+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3574996741 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288e7c8e0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.423+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288f6fef0 con 0x561288e7c8e0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.423+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3574996741 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288e7c8e0 2024-09-19T11:15:41.428 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.423+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288f7f920 0x561288f81d10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.423+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288f823e0 con 0x561288f7f920 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.424+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288f7f920 0x561288f81d10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.424+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288f7f920 0x561288f81d10 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.424+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3574996741 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc4c4051070 con 0x561288f7f920 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.424+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288f7e730 con 0x561288e7c8e0 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.425+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3574996741 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288e7c8e0 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.425+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288f83820 0x561288f85c10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.425+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288f86270 con 0x561288f83820 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.425+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288f83820 0x561288f85c10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.425+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288f83820 0x561288f85c10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.425+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3574996741 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc4c800f670 con 0x561288f83820 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.425+0000 7fc4d872e800 1 Processor -- start 2024-09-19T11:15:41.429 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d872e800 1 -- start start 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d872e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288f93ff0 0x561288f94410 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d872e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561288d734a0 con 0x561288f93ff0 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288f93ff0 0x561288f94410 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288f93ff0 0x561288f94410 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40090/0 (socket says 172.21.15.102:40090) 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d44dd640 1 -- 172.21.15.102:0/143605223 learned_addr learned my addr 172.21.15.102:0/143605223 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d44dd640 1 -- 172.21.15.102:0/143605223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561288f94a50 con 0x561288f93ff0 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/143605223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288f93ff0 0x561288f94410 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4067dc0 tx=0x7fc4c405cf40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc3b9ffb640 1 -- 172.21.15.102:0/143605223 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c40920c0 con 0x561288f93ff0 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc3b9ffb640 1 -- 172.21.15.102:0/143605223 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4092260 con 0x561288f93ff0 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc3b9ffb640 1 -- 172.21.15.102:0/143605223 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c40981e0 con 0x561288f93ff0 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.426+0000 7fc4d872e800 1 -- 172.21.15.102:0/143605223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561288f95280 con 0x561288f93ff0 2024-09-19T11:15:41.430 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.427+0000 7fc4d872e800 1 -- 172.21.15.102:0/143605223 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561288f95820 con 0x561288f93ff0 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.427+0000 7fc3b9ffb640 1 -- 172.21.15.102:0/143605223 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc4c408f2c0 con 0x561288f93ff0 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.427+0000 7fc3b9ffb640 1 --2- 172.21.15.102:0/143605223 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3ac03cfb0 0x7fc3ac03f470 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.427+0000 7fc3b9ffb640 1 -- 172.21.15.102:0/143605223 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc4c408ad50 con 0x561288f93ff0 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.427+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/143605223 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3ac03cfb0 0x7fc3ac03f470 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d872e800 1 Processor -- start 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d872e800 1 -- start start 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/143605223 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3ac03cfb0 0x7fc3ac03f470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x561288f7daf0 tx=0x7fc4c8006000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d872e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa0cb0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d872e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561288f6ba70 con 0x561288fa08d0 2024-09-19T11:15:41.440 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa0cb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa0cb0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40104/0 (socket says 172.21.15.102:40104) 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d44dd640 1 -- 172.21.15.102:0/2658050838 learned_addr learned my addr 172.21.15.102:0/2658050838 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.428+0000 7fc4d44dd640 1 -- 172.21.15.102:0/2658050838 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561288fa12a0 con 0x561288fa08d0 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/2658050838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa0cb0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4095630 tx=0x7fc4c408cfd0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eb4586a8962ef9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc3ab7fe640 1 -- 172.21.15.102:0/2658050838 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c40a7070 con 0x561288fa08d0 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc3ab7fe640 1 -- 172.21.15.102:0/2658050838 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c4073c20 con 0x561288fa08d0 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc3ab7fe640 1 -- 172.21.15.102:0/2658050838 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c407ce10 con 0x561288fa08d0 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d872e800 1 -- 172.21.15.102:0/2658050838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 msgr2=0x561288fa0cb0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d872e800 1 --2- 172.21.15.102:0/2658050838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa0cb0 secure :-1 s=READY pgs=841 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4095630 tx=0x7fc4c408cfd0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d872e800 1 -- 172.21.15.102:0/2658050838 shutdown_connections 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d872e800 1 --2- 172.21.15.102:0/2658050838 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa0cb0 unknown :-1 s=CLOSED pgs=841 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d872e800 1 -- 172.21.15.102:0/2658050838 >> 172.21.15.102:0/2658050838 conn(0x561288f9ccd0 msgr2=0x561288f9af10 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.441 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d872e800 1 -- 172.21.15.102:0/2658050838 shutdown_connections 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d872e800 1 -- 172.21.15.102:0/2658050838 wait complete. 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.429+0000 7fc4d872e800 1 Processor -- start 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d872e800 1 -- start start 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d872e800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa7cf0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d872e800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x561288fa1730 con 0x561288fa08d0 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa7cf0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d44dd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa7cf0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:40106/0 (socket says 172.21.15.102:40106) 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 learned_addr learned my addr 172.21.15.102:0/3416543627 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x561288fa8250 con 0x561288fa08d0 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa7cf0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40077e0 tx=0x7fc4c4007770 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc3a9ffb640 1 -- 172.21.15.102:0/3416543627 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c4091050 con 0x561288fa08d0 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc3a9ffb640 1 -- 172.21.15.102:0/3416543627 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc4c40bb070 con 0x561288fa08d0 2024-09-19T11:15:41.442 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x561288fa8250 con 0x561288fa08d0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.430+0000 7fc3a9ffb640 1 -- 172.21.15.102:0/3416543627 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc4c407cc30 con 0x561288fa08d0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.431+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x561288fa8250 con 0x561288fa08d0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.431+0000 7fc3a9ffb640 1 -- 172.21.15.102:0/3416543627 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc4c40aa070 con 0x561288fa08d0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.431+0000 7fc3a9ffb640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc39c03cf10 0x7fc39c03f3d0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.432+0000 7fc3a9ffb640 1 -- 172.21.15.102:0/3416543627 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc4c406e130 con 0x561288fa08d0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.432+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc39c03cf10 0x7fc39c03f3d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.432+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc39c03cf10 0x7fc39c03f3d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800ffd0 tx=0x7fc4c8023040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.432+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.432+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288fb3030 0x561288fb54f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.432+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fb5c40 con 0x561288fb3030 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.432+0000 7fc4d4cde640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288fb3030 0x561288fb54f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.432+0000 7fc4d4cde640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288fb3030 0x561288fb54f0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.443 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 realm 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6050 con 0x561288fb3030 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6920 con 0x561288fb3030 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.444 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.433+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288fb7a20 0x561288fb9e10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fba3d0 con 0x561288fb7a20 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288fb7a20 0x561288fb9e10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d44dd640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288fb7a20 0x561288fb9e10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d872e800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d872e800 20 searching for the correct realm 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288fbc380 0x561288fbe840 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fbef10 con 0x561288fbc380 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.434+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288fbc380 0x561288fbe840 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.445 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.435+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288fbc380 0x561288fbe840 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.435+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x561288fbc380 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.435+0000 7fc4d3cdc640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc4c802e910 0x7fc4c803a3c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.435+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fbef10 con 0x7fc4c802e910 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.435+0000 7fc4d4cde640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc4c802e910 0x7fc4c803a3c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.435+0000 7fc4d4cde640 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc4c802e910 0x7fc4c803a3c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.436+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.436+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb7a20 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.436+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.436+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.436+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.436+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.446 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.436+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.436+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb7a20 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb7a20 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x7fc4c802e910 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fbc380 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x561288fbc380 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.437+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb7a20 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.438+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.438+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.447 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.438+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.438+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x7fc4c802e910 2024-09-19T11:15:41.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.438+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.438+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fbc380 2024-09-19T11:15:41.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.439+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x561288fbc380 2024-09-19T11:15:41.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.439+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fbc380 2024-09-19T11:15:41.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.439+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc4c8037040 con 0x561288fbc380 2024-09-19T11:15:41.448 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.439+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb7a20 2024-09-19T11:15:41.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.439+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.439+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fbc380 2024-09-19T11:15:41.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.439+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x561288fbc380 2024-09-19T11:15:41.459 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.439+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fbc380 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.440+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x561288fbc380 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.440+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.440+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.440+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.440+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.440+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb7a20 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.440+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.440+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fbc380 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.441+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x561288fbc380 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.441+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x7fc4c802e910 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.441+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.441+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.460 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.441+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.441+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb7a20 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.441+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.441+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fbc380 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.442+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8037040 con 0x561288fbc380 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.442+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb7a20 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.442+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.442+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x7fc4c802e910 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.442+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.442+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fbc380 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.442+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4c8049040 con 0x561288fbc380 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.442+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x7fc4c802e910 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.461 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x561288fb3030 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x561288fb6cc0 con 0x7fc4c802e910 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fbac90 con 0x561288fb3030 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.462 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.443+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fbac90 con 0x561288fb3030 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fbac90 con 0x561288fbc380 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc4c8049040 con 0x561288fbc380 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 20 zone default found 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 4 Realm: () 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:15:41.463 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 20 zonegroup default 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fbb5c0 con 0x561288fb7a20 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 165+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.444+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fc0eb0 con 0x561288fbc380 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4c8049040 con 0x561288fbc380 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fc1370 con 0x561288fbc380 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc4c8049040 con 0x561288fbc380 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d872e800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d872e800 20 started sync module instance, tier type = 2024-09-19T11:15:41.464 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d872e800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.445+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc0220 con 0x7fc4c802e910 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.446+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.446+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94637607618384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc0220 con 0x7fc4c802e910 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.446+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc1e90 con 0x561288fb3030 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.447+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94637607618384] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.447+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.447+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94637607623024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc0220 con 0x561288fb3030 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.447+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc2920 con 0x561288fbc380 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.448+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8049040 con 0x561288fbc380 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.448+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94637607625712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc31c0 con 0x561288fbc380 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.449+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc3c70 con 0x7fc4c802e910 2024-09-19T11:15:41.465 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.449+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94637607623024] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.450+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94637607625712] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8049040 con 0x561288fbc380 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.450+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.450+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94637607628048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc3750 con 0x7fc4c802e910 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.450+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc4550 con 0x561288fb3030 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.451+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94637607628048] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.451+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.451+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94637607615856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc44c0 con 0x561288fb3030 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.451+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc4f60 con 0x561288fb7a20 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.452+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.452+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94637607615856] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.452+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94637607632912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc4f60 con 0x561288fb7a20 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.452+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc5920 con 0x561288fb7a20 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.453+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94637607632912] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.466 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.453+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.453+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94637607635632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc5920 con 0x561288fb7a20 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.453+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc6340 con 0x561288fb7a20 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94637607635632] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'279 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94637607640624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc6300 con 0x561288fb7a20 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d872e800 20 add_watcher() i=0 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d872e800 20 add_watcher() i=1 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d872e800 20 add_watcher() i=2 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d872e800 20 add_watcher() i=3 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d872e800 20 add_watcher() i=4 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d872e800 20 add_watcher() i=5 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.454+0000 7fc4d872e800 20 add_watcher() i=6 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.455+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94637607640624] v37'280 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.467 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.455+0000 7fc4d872e800 20 add_watcher() i=7 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.455+0000 7fc4d872e800 2 all 8 watchers are set, enabling cache 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.455+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288fc97c0 con 0x561288fb3030 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.456+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.456+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94637607638128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc6cb0 con 0x561288fb3030 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94637607638128] v37'271 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc38a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc4d872e800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc4d872e800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc4d872e800 5 note: GC not initialized 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc3897e2640 20 reqs_thread_entry: start 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc4d872e800 20 init_complete bucket index max shards: 11 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc4d872e800 20 Filter name: none 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.457+0000 7fc2faffd640 20 reqs_thread_entry: start 2024-09-19T11:15:41.468 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.458+0000 7fc4d872e800 10 cache get: name=default.rgw.meta+users.uid+ada : miss 2024-09-19T11:15:41.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.458+0000 7fc4d872e800 20 rados->read ofs=0 len=0 2024-09-19T11:15:41.469 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.458+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:62 8.7 8:e1d59a8c:users.uid::ada:head [call version.read in=11b,read 0~0,getxattrs] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288ffc6f0 con 0x561288fb7a20 2024-09-19T11:15:41.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.459+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(62 ada [call out=48b,read 0~473 out=473b,getxattrs out=75b] v0'0 uv12 ondisk = 0) ==== 231+0+596 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.459+0000 7fc4d872e800 20 rados_obj.operate() r=0 bl.length=473 2024-09-19T11:15:41.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.459+0000 7fc4d872e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x13 2024-09-19T11:15:41.470 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.459+0000 7fc4d872e800 10 adding default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.459+0000 7fc4d872e800 10 updating xattr: name=ceph.objclass.version bl.length()=42 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.459+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 8.7 8:e1d59a8c:users.uid::ada:head [delete,create,call version.check_conds in=122b,call version.set in=58b,writefull 0~473 in=473b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561289002e50 con 0x561288fb7a20 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.460+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(63 ada [delete,create,call,call,writefull 0~473] v37'13 uv13 ondisk = 0) ==== 315+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.460+0000 7fc4d872e800 10 cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.460+0000 7fc4d872e800 10 moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.460+0000 7fc4d872e800 10 distributing notification oid=default.rgw.control:notify.4 cni=[op: 0, obj: default.rgw.meta:users.uid:ada, ofs0, ns] 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.460+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:64 7.d 7:b4812045:::notify.4:head [notify cookie 94637607888976 in=661b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x561288ffe4d0 con 0x561288fb3030 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.461+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== watch-notify(notify (1) cookie 94637607615856 notify 158913789995 ret 0) ==== 691+0+0 (crc 0 0 0) 0x7fc4cc018cf0 con 0x561288fb3030 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.461+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(64 notify.4 [notify cookie 94637607888976 out=8b] v0'0 uv279 ondisk = 0) ==== 152+0+8 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.461+0000 7fc3ab7fe640 10 rgw watcher librados: RGWWatcher::handle_notify() notify_id 158913789995 cookie 94637607615856 notifier 4932 bl.length()=649 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.461+0000 7fc3ab7fe640 10 rgw watcher librados: cache put: name=default.rgw.meta+users.uid+ada info.flags=0x17 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.461+0000 7fc3ab7fe640 10 rgw watcher librados: moving default.rgw.meta+users.uid+ada to cache LRU end 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.461+0000 7fc3ab7fe640 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 7.d 7:b4812045:::notify.4:head [notify-ack in=20b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x7fc398003ea0 con 0x561288fb3030 2024-09-19T11:15:41.471 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.461+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== watch-notify(notify_complete (2) cookie 94637607888976 notify 158913789995 ret 0) ==== 42+0+48 (crc 0 0 0) 0x7fc4cc026410 con 0x561288fb3030 2024-09-19T11:15:41.472 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.461+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(65 notify.4 [notify-ack] v0'0 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.472 INFO:teuthology.orchestra.run.smithi102.stdout:{"user_id":"ada","display_name":"Ms. Admin User","email":"","suspended":0,"max_buckets":0,"subusers":[],"keys":[{"user":"ada","access_key":"MH1WC2XQ1S8UISFDZC8W","secret_key":"dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG","active":true,"create_date":"2024-09-19T11:15:39.447449Z"}],"swift_keys":[],"caps":[{"type":"buckets","perm":"*"},{"type":"info","perm":"read"},{"type":"ratelimit","perm":"*"},{"type":"usage","perm":"*"},{"type":"users","perm":"*"},{"type":"zone","perm":"*"}],"op_mask":"read, write, delete","default_placement":"","default_storage_class":"","placement_tags":[],"bucket_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"user_quota":{"enabled":false,"check_on_raw":false,"max_size":-1,"max_size_kb":0,"max_objects":-1},"temp_url_keys":[],"type":"rgw","mfa_ids":[],"account_id":"","path":"/","create_date":"2024-09-19T11:15:39.447433Z","tags":[],"group_ids":[]} 2024-09-19T11:15:41.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.462+0000 7fc38a7e4640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:15:41.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.462+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:66 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94637607638128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288ffa540 con 0x561288fb3030 2024-09-19T11:15:41.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.463+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(66 data_loggenerations_metadata [watch unwatch cookie 94637607638128] v37'272 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.463+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:67 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94637607618384] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288ffa540 con 0x7fc4c802e910 2024-09-19T11:15:41.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.464+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(67 notify.0 [watch unwatch cookie 94637607618384] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.464+0000 7fc4d872e800 20 remove_watcher() i=0 2024-09-19T11:15:41.477 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.464+0000 7fc4d872e800 2 removed watcher, disabling cache 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.464+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94637607623024] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288ffa540 con 0x561288fb3030 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.465+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(68 notify.1 [watch unwatch cookie 94637607623024] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.465+0000 7fc4d872e800 20 remove_watcher() i=1 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.465+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:69 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94637607625712] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288ffa540 con 0x561288fbc380 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.466+0000 7fc4d3cdc640 1 -- 172.21.15.102:0/3416543627 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(69 notify.2 [watch unwatch cookie 94637607625712] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c8049040 con 0x561288fbc380 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.466+0000 7fc4d872e800 20 remove_watcher() i=2 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.466+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94637607628048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc0750 con 0x7fc4c802e910 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.467+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 notify.3 [watch unwatch cookie 94637607628048] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x7fc4c802e910 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.467+0000 7fc4d872e800 20 remove_watcher() i=3 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.467+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:71 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94637607615856] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc1970 con 0x561288fb3030 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.468+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(71 notify.4 [watch unwatch cookie 94637607615856] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4cc00a4d0 con 0x561288fb3030 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.468+0000 7fc4d872e800 20 remove_watcher() i=4 2024-09-19T11:15:41.478 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.468+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:72 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94637607632912] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc2d10 con 0x561288fb7a20 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.469+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(72 notify.5 [watch unwatch cookie 94637607632912] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.469+0000 7fc4d872e800 20 remove_watcher() i=5 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.469+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94637607635632] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc0750 con 0x561288fb7a20 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.470+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(73 notify.6 [watch unwatch cookie 94637607635632] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.470+0000 7fc4d872e800 20 remove_watcher() i=6 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.470+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:74 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94637607640624] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x561288fc1970 con 0x561288fb7a20 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.471+0000 7fc4d44dd640 1 -- 172.21.15.102:0/3416543627 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(74 notify.7 [watch unwatch cookie 94637607640624] v37'281 uv279 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc4c40a9030 con 0x561288fb7a20 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.471+0000 7fc4d872e800 20 remove_watcher() i=7 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288fb7a20 msgr2=0x561288fb9e10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288fb7a20 0x561288fb9e10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288fb3030 msgr2=0x561288fb54f0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288fb3030 0x561288fb54f0 crc :-1 s=READY pgs=203 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.479 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc4c802e910 msgr2=0x7fc4c803a3c0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc4c802e910 0x7fc4c803a3c0 crc :-1 s=READY pgs=104 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288fbc380 msgr2=0x561288fbe840 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288fbc380 0x561288fbe840 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc39c03cf10 msgr2=0x7fc39c03f3d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc39c03cf10 0x7fc39c03f3d0 secure :-1 s=READY pgs=352 cs=0 l=1 rev1=1 crypto rx=0x7fc4c800ffd0 tx=0x7fc4c8023040 comp rx=0 tx=0).stop 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 msgr2=0x561288fa7cf0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3416543627 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288fa08d0 0x561288fa7cf0 secure :-1 s=READY pgs=842 cs=0 l=1 rev1=1 crypto rx=0x7fc4c40077e0 tx=0x7fc4c4007770 comp rx=0 tx=0).stop 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3416543627 reap_dead start 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 shutdown_connections 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 >> 172.21.15.102:0/3416543627 conn(0x561288f9ccd0 msgr2=0x561288f9aee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 shutdown_connections 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/3416543627 wait complete. 2024-09-19T11:15:41.480 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/143605223 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3ac03cfb0 msgr2=0x7fc3ac03f470 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/143605223 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3ac03cfb0 0x7fc3ac03f470 secure :-1 s=READY pgs=351 cs=0 l=1 rev1=1 crypto rx=0x561288f7daf0 tx=0x7fc4c8006000 comp rx=0 tx=0).stop 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/143605223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288f93ff0 msgr2=0x561288f94410 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/143605223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288f93ff0 0x561288f94410 secure :-1 s=READY pgs=840 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4067dc0 tx=0x7fc4c405cf40 comp rx=0 tx=0).stop 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/143605223 shutdown_connections 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/143605223 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3ac03cfb0 0x7fc3ac03f470 unknown :-1 s=CLOSED pgs=351 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 --2- 172.21.15.102:0/143605223 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288f93ff0 0x561288f94410 unknown :-1 s=CLOSED pgs=840 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/143605223 >> 172.21.15.102:0/143605223 conn(0x561288f883a0 msgr2=0x561288f88780 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/143605223 shutdown_connections 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.472+0000 7fc4d872e800 1 -- 172.21.15.102:0/143605223 wait complete. 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288f7f920 msgr2=0x561288f81d10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x561288f7f920 0x561288f81d10 crc :-1 s=READY pgs=197 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288e7c8e0 msgr2=0x561288f7d170 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.481 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x561288e7c8e0 0x561288f7d170 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288f83820 msgr2=0x561288f85c10 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x561288f83820 0x561288f85c10 crc :-1 s=READY pgs=198 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3bc03d000 msgr2=0x7fc3bc03f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc3bc03d000 0x7fc3bc03f4c0 secure :-1 s=READY pgs=350 cs=0 l=1 rev1=1 crypto rx=0x7fc4c8000c00 tx=0x7fc4c80013b0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 msgr2=0x561288f70b60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 --2- 172.21.15.102:0/3574996741 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x561288e7b6a0 0x561288f70b60 secure :-1 s=READY pgs=839 cs=0 l=1 rev1=1 crypto rx=0x7fc4c4045f20 tx=0x7fc4c4002fb0 comp rx=0 tx=0).stop 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d4cde640 1 -- 172.21.15.102:0/3574996741 reap_dead start 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 shutdown_connections 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 >> 172.21.15.102:0/3574996741 conn(0x561288e76a70 msgr2=0x561288f6c4a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 shutdown_connections 2024-09-19T11:15:41.482 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:15:41.473+0000 7fc4d872e800 1 -- 172.21.15.102:0/3574996741 wait complete. 2024-09-19T11:15:41.483 DEBUG:tasks.util.rgw: json result: {'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:41.483 ERROR:root:{'user_id': 'ada', 'display_name': 'Ms. Admin User', 'email': '', 'suspended': 0, 'max_buckets': 0, 'subusers': [], 'keys': [{'user': 'ada', 'access_key': 'MH1WC2XQ1S8UISFDZC8W', 'secret_key': 'dQyrTPA0s248YeN5bBv4ukvKU0kh54LWWywkrpoG', 'active': True, 'create_date': '2024-09-19T11:15:39.447449Z'}], 'swift_keys': [], 'caps': [{'type': 'buckets', 'perm': '*'}, {'type': 'info', 'perm': 'read'}, {'type': 'ratelimit', 'perm': '*'}, {'type': 'usage', 'perm': '*'}, {'type': 'users', 'perm': '*'}, {'type': 'zone', 'perm': '*'}], 'op_mask': 'read, write, delete', 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': [], 'account_id': '', 'path': '/', 'create_date': '2024-09-19T11:15:39.447433Z', 'tags': [], 'group_ids': []} 2024-09-19T11:15:41.484 ERROR:root:0 2024-09-19T11:15:41.484 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-19T11:15:41.499 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.499 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.510 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.511 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-19T11:15:41.524 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.525 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.536 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.537 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'create'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh'} 2024-09-19T11:15:41.552 INFO:tasks.radosgw_admin_rest: json result: [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}] 2024-09-19T11:15:41.552 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.564 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}, {'user': 'foo', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.564 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'uid': 'foo', 'access-key': 'p5YnriCv1nAtykxBrupQ'} 2024-09-19T11:15:41.579 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:41.579 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.592 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.592 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo1', 'secret-key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'key-type': 'swift'} 2024-09-19T11:15:41.608 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}] 2024-09-19T11:15:41.608 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.620 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.621 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'create'] {'subuser': 'foo:foo2', 'secret-key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'key-type': 'swift'} 2024-09-19T11:15:41.636 INFO:tasks.radosgw_admin_rest: json result: [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}] 2024-09-19T11:15:41.637 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.649 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo1', 'secret_key': 'gpS2G9RREMrnbqlp29PP2D36kgPR1tm72n5fPYfL', 'active': True}, {'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.649 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['key', 'rm'] {'subuser': 'foo:foo1', 'key-type': 'swift'} 2024-09-19T11:15:41.663 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:41.664 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.676 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo1', 'permissions': ''}, {'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.676 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo1'} 2024-09-19T11:15:41.690 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:41.690 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.702 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [{'id': 'foo:foo2', 'permissions': ''}], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [{'user': 'foo:foo2', 'secret_key': 'ri2VJQcKSYATOY6uaDUX7pxgkW+W1YmC6OCxPHwy', 'active': True}], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.703 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['subuser', 'rm'] {'subuser': 'foo:foo2', 'key-type': 'swift', '{purge-keys': True} 2024-09-19T11:15:41.719 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:41.720 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.733 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.733 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.745 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-19T11:15:41.746 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-19T11:15:41.758 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-19T11:15:41.778 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo'} 2024-09-19T11:15:41.791 INFO:tasks.radosgw_admin_rest: json result: ['myfoo'] 2024-09-19T11:15:41.791 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-19T11:15:41.803 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68013f1d-b756-462e-83a9-97539995db13', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-19T11:15:41.773730Z', 'creation_time': '2024-09-19T11:15:41.770410Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-19T11:15:41.804 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'uid': 'foo', 'stats': True} 2024-09-19T11:15:41.817 INFO:tasks.radosgw_admin_rest: json result: [{'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68013f1d-b756-462e-83a9-97539995db13', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#1,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-19T11:15:41.773730Z', 'creation_time': '2024-09-19T11:15:41.770410Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1}] 2024-09-19T11:15:41.822 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-19T11:15:41.834 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68013f1d-b756-462e-83a9-97539995db13', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#2,6#1,7#1,8#1,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-19T11:15:41.773730Z', 'creation_time': '2024-09-19T11:15:41.770410Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 3, 'size_actual': 4096, 'size_utilized': 3, 'size_kb': 1, 'size_kb_actual': 4, 'size_kb_utilized': 1, 'num_objects': 1}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 1} 2024-09-19T11:15:41.835 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'doesnotexist'} 2024-09-19T11:15:41.848 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchBucket', 'Message': '', 'RequestId': 'tx00000b3214676ceb00854-0066ec07dd-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:15:41.853 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'unlink'] {'uid': 'foo', 'bucket': 'myfoo'} 2024-09-19T11:15:41.869 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:41.870 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'fud', 'display-name': 'Fud', 'access-key': 'p5YnriCv1nAtykxBrupQ', 'secret-key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'max-buckets': '1'} 2024-09-19T11:15:41.887 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'fud', 'tenant': '', 'user_id': 'fud', 'display_name': 'Fud', 'email': '', 'suspended': 0, 'max_buckets': 1, 'subusers': [], 'keys': [{'user': 'fud', 'access_key': 'p5YnriCv1nAtykxBrupQ', 'secret_key': 'Q8Tk6Q/27hfbFSYdSkPtUqhqx1GgzvpXa4WARozh', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:15:41.898 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'fud', 'bucket': 'myfoo', 'bucket-id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11'} 2024-09-19T11:15:41.919 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:41.965 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'link'] {'uid': 'foo', 'bucket': 'myfoo', 'bucket-id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11'} 2024-09-19T11:15:41.984 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:41.985 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'fud'} 2024-09-19T11:15:42.005 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:42.023 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['object', 'rm'] {'bucket': 'myfoo', 'object': 'four'} 2024-09-19T11:15:42.037 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:15:42.038 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'info'] {'bucket': 'myfoo', 'stats': True} 2024-09-19T11:15:42.050 INFO:tasks.radosgw_admin_rest: json result: {'bucket': 'myfoo', 'tenant': '', 'versioning': 'off', 'zonegroup': '68013f1d-b756-462e-83a9-97539995db13', 'placement_rule': 'default-placement', 'explicit_placement': {'data_pool': '', 'data_extra_pool': '', 'index_pool': ''}, 'id': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11', 'marker': '32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11', 'index_type': 'Normal', 'index_generation': 0, 'num_shards': 11, 'reshard_status': 'None', 'judge_reshard_lock_time': '0.000000', 'object_lock_enabled': False, 'mfa_enabled': False, 'owner': 'foo', 'ver': '0#1,1#1,2#1,3#1,4#1,5#3,6#3,7#1,8#3,9#1,10#1', 'master_ver': '0#0,1#0,2#0,3#0,4#0,5#0,6#0,7#0,8#0,9#0,10#0', 'mtime': '2024-09-19T11:15:41.979437Z', 'creation_time': '2024-09-19T11:15:41.770410Z', 'max_marker': '0#,1#,2#,3#,4#,5#,6#,7#,8#,9#,10#', 'usage': {'rgw.main': {'size': 0, 'size_actual': 0, 'size_utilized': 0, 'size_kb': 0, 'size_kb_actual': 0, 'size_kb_utilized': 0, 'num_objects': 0}}, 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'read_tracker': 3} 2024-09-19T11:16:42.103 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'categories': 'delete_obj'} 2024-09-19T11:16:42.131 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'anonymous', 'categories': [], 's3select': {}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'bar', 'categories': [], 's3select': {}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'bud', 'categories': [], 's3select': {}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'fud', 'categories': [], 's3select': {}}, {'bucket': 'myfoo7', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'fud', 'categories': [], 's3select': {}}]}], 'summary': [{'user': 'anonymous', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 0, 'successful_ops': 0, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:16:42.132 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] None 2024-09-19T11:16:42.156 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'anonymous', 'buckets': [{'bucket': '', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bar', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'bud', 'buckets': [{'bucket': 'myfoo6', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}, {'user': 'fud', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'fud', 'categories': [{'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 0, 'ops': 1, 'successful_ops': 0}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'myfoo7', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'anonymous', 'categories': [{'category': 'list_buckets', 'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 204, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bar', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 8, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 8, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'bud', 'categories': [{'category': 'get_obj', 'bytes_sent': 16, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 16, 'bytes_received': 0, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}, {'user': 'fud', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'get_obj', 'bytes_sent': 8, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 234, 'bytes_received': 8, 'ops': 2, 'successful_ops': 1}, {'category': 'stat_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 242, 'bytes_received': 8, 'ops': 5, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:16:42.156 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-19T11:16:42.169 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}, {'bucket': 'useless-bucket', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {'bytes_processed': 0, 'bytes_returned': 0}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}, {'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}, {'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}, {'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 10, 'successful_ops': 10, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:16:42.169 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'create_bucket'} 2024-09-19T11:16:42.183 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'create_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:16:42.183 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'put_obj'} 2024-09-19T11:16:42.197 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 10, 'ops': 3, 'successful_ops': 3}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 14, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'put_obj', 'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4}], 'total': {'bytes_sent': 0, 'bytes_received': 24, 'ops': 4, 'successful_ops': 4, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:16:42.198 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_obj'} 2024-09-19T11:16:42.211 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 2, 'successful_ops': 2}], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_obj', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 3, 'successful_ops': 3, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:16:42.211 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo', 'categories': 'delete_bucket'} 2024-09-19T11:16:42.224 INFO:tasks.radosgw_admin_rest: json result: {'entries': [{'user': 'foo', 'buckets': [{'bucket': 'myfoo', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [], 's3select': {}}, {'bucket': 'useless-bucket', 'time': '2024-09-19T11:00:00.000000Z', 'epoch': 1726743600, 'owner': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 's3select': {}}]}], 'summary': [{'user': 'foo', 'categories': [{'category': 'delete_bucket', 'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1}], 'total': {'bytes_sent': 0, 'bytes_received': 0, 'ops': 1, 'successful_ops': 1, 'bytes_processed': 0, 'bytes_returned': 0}}]} 2024-09-19T11:16:42.225 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'trim'] {'uid': 'foo'} 2024-09-19T11:16:42.241 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:16:42.241 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['usage', 'show'] {'uid': 'foo'} 2024-09-19T11:16:42.255 INFO:tasks.radosgw_admin_rest: json result: {'entries': [], 'summary': []} 2024-09-19T11:16:42.256 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': True} 2024-09-19T11:16:42.274 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 1, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:16:42.286 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'modify'] {'uid': 'foo', 'suspended': 'false'} 2024-09-19T11:16:42.304 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'foo', 'tenant': '', 'user_id': 'foo', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 4, 'subusers': [], 'keys': [{'user': 'foo', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:16:42.586 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-19T11:16:42.598 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000032b26e4c7605bee9-0066ec081a-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:42.702 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-19T11:16:42.715 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [], 'grant_map': [{'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-19T11:16:42.719 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['policy', 'show'] {'bucket': 'myfoo', 'object': b'bb3aec0fdcdbc2974890f805c585d432'} 2024-09-19T11:16:42.732 INFO:tasks.radosgw_admin_rest: json result: {'acl': {'acl_user_map': [{'user': 'foo', 'acl': 15}], 'acl_group_map': [{'group': 1, 'acl': 1}], 'grant_map': [{'id': '', 'grant': {'type': {'type': 2}, 'group': 1, 'permission': {'flags': 1}}}, {'id': 'foo', 'grant': {'type': {'type': 0}, 'id': 'foo', 'name': 'Foo', 'permission': {'flags': 15}}}]}, 'owner': {'id': 'foo', 'display_name': 'Foo'}} 2024-09-19T11:16:42.861 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['bucket', 'rm'] {'bucket': 'myfoo', 'purge-objects': True} 2024-09-19T11:16:42.910 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:16:42.911 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'add'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-19T11:16:42.925 INFO:tasks.radosgw_admin_rest: json result: [{'type': 'usage', 'perm': 'read'}] 2024-09-19T11:16:42.925 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['caps', 'rm'] {'uid': 'foo', 'user-caps': 'usage=read'} 2024-09-19T11:16:42.939 INFO:tasks.radosgw_admin_rest: json result: [] 2024-09-19T11:16:42.949 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo'} 2024-09-19T11:16:42.962 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'BucketAlreadyExists', 'Message': '', 'RequestId': 'tx0000030ad38b5b617fa30-0066ec081a-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:42.982 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'rm'] {'uid': 'foo', 'purge-data': True} 2024-09-19T11:16:43.019 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:16:43.019 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'info'] {'uid': 'foo'} 2024-09-19T11:16:43.032 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchUser', 'Message': '', 'RequestId': 'tx000007c1c07edb82adc58-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.032 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['info', ''] None 2024-09-19T11:16:43.044 INFO:tasks.radosgw_admin_rest: json result: {'info': {'storage_backends': [{'name': 'rados', 'cluster_id': 'ea40044b-acee-4485-a78a-0f4c700e12ca'}]}} 2024-09-19T11:16:43.044 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['user', 'create'] {'uid': 'ratelimit_user', 'display-name': 'Foo', 'email': 'foo@foo.com', 'access-key': '9te6NH5mcdcq0Tc5i8i1', 'secret-key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'max-buckets': '1000'} 2024-09-19T11:16:43.063 INFO:tasks.radosgw_admin_rest: json result: {'full_user_id': 'ratelimit_user', 'tenant': '', 'user_id': 'ratelimit_user', 'display_name': 'Foo', 'email': 'foo@foo.com', 'suspended': 0, 'max_buckets': 1000, 'subusers': [], 'keys': [{'user': 'ratelimit_user', 'access_key': '9te6NH5mcdcq0Tc5i8i1', 'secret_key': 'Ny4IOauQoL18Gp2zM7lC1vLmoawgqcYP/YGcWfXu', 'active': True}], 'swift_keys': [], 'caps': [], 'op_mask': 'read, write, delete', 'system': False, 'admin': False, 'default_placement': '', 'default_storage_class': '', 'placement_tags': [], 'bucket_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'user_quota': {'enabled': False, 'check_on_raw': False, 'max_size': -1, 'max_size_kb': 0, 'max_objects': -1}, 'temp_url_keys': [], 'type': 'rgw', 'mfa_ids': []} 2024-09-19T11:16:43.064 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-19T11:16:43.075 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-19T11:16:43.076 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring'} 2024-09-19T11:16:43.088 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx0000087b362e30577155a-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.089 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user'} 2024-09-19T11:16:43.100 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx000008d6cd1ab10c17909-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.111 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-19T11:16:43.123 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-19T11:16:43.124 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring'} 2024-09-19T11:16:43.135 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000008c4f26280f69db06-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.135 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket'} 2024-09-19T11:16:43.149 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000086e3eae69f183008-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.150 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'global': 'true'} 2024-09-19T11:16:43.163 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}, 'anonymous_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 0, 'enabled': False}} 2024-09-19T11:16:43.163 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_userstring', 'enabled': 'true'} 2024-09-19T11:16:43.175 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx000004bd28c7fa8c32fb9-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.175 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user'} 2024-09-19T11:16:43.187 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx00000a6802b44b7334746-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.187 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucketstring', 'enabled': 'true'} 2024-09-19T11:16:43.198 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'NoSuchKey', 'Message': '', 'RequestId': 'tx00000b9515b5d33480cce-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.198 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'enabled': 'true'} 2024-09-19T11:16:43.210 INFO:tasks.radosgw_admin_rest: json result: {'Code': 'InvalidArgument', 'Message': '', 'RequestId': 'tx0000099a413b15f83eef2-0066ec081b-4239-default', 'HostId': '4239-default-default'} 2024-09-19T11:16:43.210 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user', 'enabled': 'true', 'max-read-bytes': '2'} 2024-09-19T11:16:43.227 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:16:43.227 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'user', 'uid': 'ratelimit_user'} 2024-09-19T11:16:43.239 INFO:tasks.radosgw_admin_rest: json result: {'user_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 2, 'max_write_bytes': 0, 'enabled': True}} 2024-09-19T11:16:43.239 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket', 'enabled': 'true', 'max-write-bytes': '2'} 2024-09-19T11:16:43.253 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:16:43.253 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'info'] {'ratelimit-scope': 'bucket', 'bucket': 'ratelimitbucket'} 2024-09-19T11:16:43.266 INFO:tasks.radosgw_admin_rest: json result: {'bucket_ratelimit': {'max_read_ops': 0, 'max_write_ops': 0, 'max_read_bytes': 0, 'max_write_bytes': 2, 'enabled': True}} 2024-09-19T11:16:43.266 INFO:tasks.radosgw_admin_rest:radosgw-admin-rest: ['ratelimit', 'modify'] {'ratelimit-scope': 'bucket', 'global': 'true', 'enabled': 'true'} 2024-09-19T11:16:43.280 INFO:tasks.radosgw_admin_rest: empty result 2024-09-19T11:16:43.285 DEBUG:teuthology.run_tasks:Unwinding manager rgw 2024-09-19T11:16:43.295 DEBUG:tasks.rgw.client.0:waiting for process to exit 2024-09-19T11:16:43.295 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T11:16:43.297 INFO:tasks.rgw.client.0.smithi102.stdout:2024-09-19T11:16:43.295+0000 7f1660333640 -1 received signal: Terminated from /usr/bin/python3 /bin/daemon-helper term radosgw --rgw-frontends beast port=80 -n client.0 --cluster ceph -k /etc/ceph/ceph.client.0.keyring --log-file /var/log/ceph/rgw.ceph.client.0.log --rgw_ops_log_socket_path /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock --foreground (PID: 36037) UID: 0 2024-09-19T11:16:43.297 INFO:tasks.rgw.client.0.smithi102.stdout:2024-09-19T11:16:43.296+0000 7f1663b93880 -1 shutting down 2024-09-19T11:16:48.258 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 is failed for ~0s 2024-09-19T11:16:49.397 INFO:tasks.rgw.client.0:Stopped 2024-09-19T11:16:49.398 DEBUG:teuthology.orchestra.run.smithi102:> rm -f /home/ubuntu/cephtest/rgw.opslog.ceph.client.0.sock 2024-09-19T11:16:49.417 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /etc/ceph/vault-root-token 2024-09-19T11:16:49.487 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f /home/ubuntu/cephtest/url_file 2024-09-19T11:16:49.558 INFO:tasks.util.rgw:rgwadmin: client.0 : ['gc', 'process', '--include-all'] 2024-09-19T11:16:49.558 DEBUG:tasks.util.rgw:rgwadmin: cmd=['adjust-ulimits', 'ceph-coverage', '/home/ubuntu/cephtest/archive/coverage', 'radosgw-admin', '--log-to-stderr', '--format', 'json', '-n', 'client.0', '--cluster', 'ceph', 'gc', 'process', '--include-all'] 2024-09-19T11:16:49.558 DEBUG:teuthology.orchestra.run.smithi102:> adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage radosgw-admin --log-to-stderr --format json -n client.0 --cluster ceph gc process --include-all 2024-09-19T11:16:49.648 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setuser ceph since I am not root 2024-09-19T11:16:49.648 INFO:teuthology.orchestra.run.smithi102.stderr:ignoring --setgroup ceph since I am not root 2024-09-19T11:16:49.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.647+0000 7fc301140800 1 Processor -- start 2024-09-19T11:16:49.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.647+0000 7fc301140800 1 -- start start 2024-09-19T11:16:49.649 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.647+0000 7fc301140800 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5644a8588870 0x5644a8591390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.647+0000 7fc301140800 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 26 bytes epoch 0) -- 0x5644a85918d0 con 0x5644a8586d50 2024-09-19T11:16:49.650 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.647+0000 7fc301140800 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x5644a84137d0 con 0x5644a8588870 2024-09-19T11:16:49.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.648+0000 7fc2fc685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5644a8588870 0x5644a8591390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.648+0000 7fc2fc685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x5644a8588870 0x5644a8591390 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:47660/0 (socket says 172.21.15.102:47660) 2024-09-19T11:16:49.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.648+0000 7fc2fce86640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x5644a8586d50 0x5644a8587150 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.102:60352/0 (socket says 172.21.15.102:60352) 2024-09-19T11:16:49.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.648+0000 7fc2fc685640 1 -- 172.21.15.102:0/3680115655 learned_addr learned my addr 172.21.15.102:0/3680115655 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:16:49.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.648+0000 7fc2fc685640 1 -- 172.21.15.102:0/3680115655 >> v1:172.21.15.37:6789/0 conn(0x5644a8586d50 legacy=0x5644a8587150 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.651 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.648+0000 7fc2fc685640 1 -- 172.21.15.102:0/3680115655 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a8592ab0 con 0x5644a8588870 2024-09-19T11:16:49.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.650+0000 7fc2fc685640 1 --2- 172.21.15.102:0/3680115655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8588870 0x5644a8591390 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000a520 tx=0x7fc2f0045ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=613df4a9501cdfd7 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc2fbe84640 1 -- 172.21.15.102:0/3680115655 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f0055070 con 0x5644a8588870 2024-09-19T11:16:49.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc2fbe84640 1 -- 172.21.15.102:0/3680115655 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2f00515b0 con 0x5644a8588870 2024-09-19T11:16:49.653 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc2fbe84640 1 -- 172.21.15.102:0/3680115655 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2f00518d0 con 0x5644a8588870 2024-09-19T11:16:49.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc301140800 1 -- 172.21.15.102:0/3680115655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8588870 msgr2=0x5644a8591390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc301140800 1 --2- 172.21.15.102:0/3680115655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8588870 0x5644a8591390 secure :-1 s=READY pgs=844 cs=0 l=1 rev1=1 crypto rx=0x7fc2f000a520 tx=0x7fc2f0045ba0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc301140800 1 -- 172.21.15.102:0/3680115655 shutdown_connections 2024-09-19T11:16:49.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc301140800 1 --2- 172.21.15.102:0/3680115655 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8588870 0x5644a8591390 unknown :-1 s=CLOSED pgs=844 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc301140800 1 -- 172.21.15.102:0/3680115655 >> 172.21.15.102:0/3680115655 conn(0x5644a8582a60 msgr2=0x5644a8584ec0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:49.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc301140800 1 -- 172.21.15.102:0/3680115655 shutdown_connections 2024-09-19T11:16:49.654 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.651+0000 7fc301140800 1 -- 172.21.15.102:0/3680115655 wait complete. 2024-09-19T11:16:49.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.669+0000 7fc301140800 1 Processor -- start 2024-09-19T11:16:49.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.669+0000 7fc301140800 1 -- start start 2024-09-19T11:16:49.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.670+0000 7fc301140800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a867a550 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.672 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.670+0000 7fc301140800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5644a8420dd0 con 0x5644a8586d50 2024-09-19T11:16:49.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.670+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a867a550 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.674 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.670+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a867a550 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:47676/0 (socket says 172.21.15.102:47676) 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.670+0000 7fc2fce86640 1 -- 172.21.15.102:0/1883731665 learned_addr learned my addr 172.21.15.102:0/1883731665 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.670+0000 7fc2fce86640 1 -- 172.21.15.102:0/1883731665 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a867ab40 con 0x5644a8586d50 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.671+0000 7fc2fce86640 1 --2- 172.21.15.102:0/1883731665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a867a550 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0016e0 tx=0x7fc2ec001ba0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=5db1f78e2720e166 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.671+0000 7fc1eae0d640 1 -- 172.21.15.102:0/1883731665 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec013420 con 0x5644a8586d50 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.671+0000 7fc1eae0d640 1 -- 172.21.15.102:0/1883731665 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec0135e0 con 0x5644a8586d50 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.671+0000 7fc1eae0d640 1 -- 172.21.15.102:0/1883731665 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec013900 con 0x5644a8586d50 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 -- 172.21.15.102:0/1883731665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 msgr2=0x5644a867a550 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 --2- 172.21.15.102:0/1883731665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a867a550 secure :-1 s=READY pgs=845 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec0016e0 tx=0x7fc2ec001ba0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 -- 172.21.15.102:0/1883731665 shutdown_connections 2024-09-19T11:16:49.675 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 --2- 172.21.15.102:0/1883731665 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a867a550 unknown :-1 s=CLOSED pgs=845 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 -- 172.21.15.102:0/1883731665 >> 172.21.15.102:0/1883731665 conn(0x5644a8582a60 msgr2=0x5644a8675ed0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 -- 172.21.15.102:0/1883731665 shutdown_connections 2024-09-19T11:16:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 -- 172.21.15.102:0/1883731665 wait complete. 2024-09-19T11:16:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 Processor -- start 2024-09-19T11:16:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.672+0000 7fc301140800 1 -- start start 2024-09-19T11:16:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.673+0000 7fc301140800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a86820c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.676 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.673+0000 7fc301140800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5644a8591da0 con 0x5644a8586d50 2024-09-19T11:16:49.678 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.673+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a86820c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.673+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a86820c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:47678/0 (socket says 172.21.15.102:47678) 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.673+0000 7fc2fce86640 1 -- 172.21.15.102:0/274189560 learned_addr learned my addr 172.21.15.102:0/274189560 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.673+0000 7fc2fce86640 1 -- 172.21.15.102:0/274189560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a8682620 con 0x5644a8586d50 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.674+0000 7fc2fce86640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a86820c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec000f80 tx=0x7fc2ec001250 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.674+0000 7fc1e960a640 1 -- 172.21.15.102:0/274189560 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec022020 con 0x5644a8586d50 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.674+0000 7fc1e960a640 1 -- 172.21.15.102:0/274189560 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec006810 con 0x5644a8586d50 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.674+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a86828b0 con 0x5644a8586d50 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.674+0000 7fc1e960a640 1 -- 172.21.15.102:0/274189560 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec004ae0 con 0x5644a8586d50 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.674+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a86832b0 con 0x5644a8586d50 2024-09-19T11:16:49.679 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.675+0000 7fc1e960a640 1 -- 172.21.15.102:0/274189560 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc2ec025020 con 0x5644a8586d50 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.675+0000 7fc1e960a640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1e403d050 0x7fc1e403f510 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.675+0000 7fc1e960a640 1 -- 172.21.15.102:0/274189560 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc2ec018030 con 0x5644a8586d50 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.675+0000 7fc2fc685640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1e403d050 0x7fc1e403f510 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.675+0000 7fc301140800 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a8588870 0x5644a8689710 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.675+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8689c50 con 0x5644a8588870 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.676+0000 7fc2fd687640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a8588870 0x5644a8689710 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.676+0000 7fc2fc685640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1e403d050 0x7fc1e403f510 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0057000 tx=0x7fc2f0052000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.676+0000 7fc2fd687640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a8588870 0x5644a8689710 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.676+0000 7fc2fd687640 1 -- 172.21.15.102:0/274189560 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f40083e0 con 0x5644a8588870 2024-09-19T11:16:49.680 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.676+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8689ff0 con 0x5644a8588870 2024-09-19T11:16:49.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.677+0000 7fc2fd687640 1 -- 172.21.15.102:0/274189560 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2f40083e0 con 0x5644a8588870 2024-09-19T11:16:49.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.677+0000 7fc301140800 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a868baf0 0x5644a868df70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.677+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:3 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a868e700 con 0x5644a868baf0 2024-09-19T11:16:49.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.678+0000 7fc2fce86640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a868baf0 0x5644a868df70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.678+0000 7fc2fce86640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a868baf0 0x5644a868df70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.683 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.679+0000 7fc2fce86640 1 -- 172.21.15.102:0/274189560 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(3 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [call out=48b,read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 232+0+1041 (crc 0 0 0) 0x7fc2ec01b070 con 0x5644a868baf0 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.679+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a868a840 con 0x5644a8588870 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.679+0000 7fc2fd687640 1 -- 172.21.15.102:0/274189560 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(4 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2f40083e0 con 0x5644a8588870 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.679+0000 7fc301140800 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a868fb60 0x5644a8691f50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.679+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:5 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86926c0 con 0x5644a868fb60 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.679+0000 7fc2fc685640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a868fb60 0x5644a8691f50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.680+0000 7fc2fc685640 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a868fb60 0x5644a8691f50 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.680+0000 7fc2fc685640 1 -- 172.21.15.102:0/274189560 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(5 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [call out=48b,read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 237+0+484 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a868fb60 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.680+0000 7fc301140800 1 Processor -- start 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.680+0000 7fc301140800 1 -- start start 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.681+0000 7fc301140800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86a0440 0x5644a86a0860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.684 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.681+0000 7fc301140800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5644a847f4a0 con 0x5644a86a0440 2024-09-19T11:16:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.681+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86a0440 0x5644a86a0860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.681+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86a0440 0x5644a86a0860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:47686/0 (socket says 172.21.15.102:47686) 2024-09-19T11:16:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.681+0000 7fc2fce86640 1 -- 172.21.15.102:0/2824163813 learned_addr learned my addr 172.21.15.102:0/2824163813 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:16:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.681+0000 7fc2fce86640 1 -- 172.21.15.102:0/2824163813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a86a0ea0 con 0x5644a86a0440 2024-09-19T11:16:49.685 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.681+0000 7fc2fce86640 1 --2- 172.21.15.102:0/2824163813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86a0440 0x5644a86a0860 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec052a50 tx=0x7fc2ec01e7c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.682+0000 7fc1e27fc640 1 -- 172.21.15.102:0/2824163813 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec035070 con 0x5644a86a0440 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.682+0000 7fc1e27fc640 1 -- 172.21.15.102:0/2824163813 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec054110 con 0x5644a86a0440 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.682+0000 7fc301140800 1 -- 172.21.15.102:0/2824163813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a86a16d0 con 0x5644a86a0440 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.682+0000 7fc1e27fc640 1 -- 172.21.15.102:0/2824163813 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec0543f0 con 0x5644a86a0440 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.682+0000 7fc301140800 1 -- 172.21.15.102:0/2824163813 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a86a16d0 con 0x5644a86a0440 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.683+0000 7fc1e27fc640 1 -- 172.21.15.102:0/2824163813 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc2ec038070 con 0x5644a86a0440 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.683+0000 7fc1e27fc640 1 --2- 172.21.15.102:0/2824163813 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1d403d000 0x7fc1d403f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.683+0000 7fc1e27fc640 1 -- 172.21.15.102:0/2824163813 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc2ec04a070 con 0x5644a86a0440 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.683+0000 7fc2fc685640 1 --2- 172.21.15.102:0/2824163813 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1d403d000 0x7fc1d403f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.690 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.683+0000 7fc301140800 1 Processor -- start 2024-09-19T11:16:49.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.683+0000 7fc301140800 1 -- start start 2024-09-19T11:16:49.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.683+0000 7fc2fc685640 1 --2- 172.21.15.102:0/2824163813 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1d403d000 0x7fc1d403f4c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x5644a868abe0 tx=0x7fc2f0005ac0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.684+0000 7fc301140800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86acf60 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.684+0000 7fc301140800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5644a867af70 con 0x5644a86acb60 2024-09-19T11:16:49.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.684+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86acf60 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.684+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86acf60 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=0 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:47692/0 (socket says 172.21.15.102:47692) 2024-09-19T11:16:49.691 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.684+0000 7fc2fce86640 1 -- 172.21.15.102:0/1115271449 learned_addr learned my addr 172.21.15.102:0/1115271449 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.684+0000 7fc2fce86640 1 -- 172.21.15.102:0/1115271449 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a86ad550 con 0x5644a86acb60 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.684+0000 7fc2fce86640 1 --2- 172.21.15.102:0/1115271449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86acf60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec004430 tx=0x7fc2ec010aa0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=6c1869e73d4188e5 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.684+0000 7fc1d3fff640 1 -- 172.21.15.102:0/1115271449 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec064070 con 0x5644a86acb60 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc1d3fff640 1 -- 172.21.15.102:0/1115271449 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec0265d0 con 0x5644a86acb60 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc1d3fff640 1 -- 172.21.15.102:0/1115271449 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec05b040 con 0x5644a86acb60 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc301140800 1 -- 172.21.15.102:0/1115271449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 msgr2=0x5644a86acf60 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc301140800 1 --2- 172.21.15.102:0/1115271449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86acf60 secure :-1 s=READY pgs=848 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec004430 tx=0x7fc2ec010aa0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc301140800 1 -- 172.21.15.102:0/1115271449 shutdown_connections 2024-09-19T11:16:49.692 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc301140800 1 --2- 172.21.15.102:0/1115271449 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86acf60 unknown :-1 s=CLOSED pgs=848 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc301140800 1 -- 172.21.15.102:0/1115271449 >> 172.21.15.102:0/1115271449 conn(0x5644a86a8f60 msgr2=0x5644a86a71a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:49.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc301140800 1 -- 172.21.15.102:0/1115271449 shutdown_connections 2024-09-19T11:16:49.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc301140800 1 -- 172.21.15.102:0/1115271449 wait complete. 2024-09-19T11:16:49.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.685+0000 7fc301140800 1 Processor -- start 2024-09-19T11:16:49.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.686+0000 7fc301140800 1 -- start start 2024-09-19T11:16:49.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.686+0000 7fc301140800 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86b3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.693 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.686+0000 7fc301140800 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x5644a86ad9c0 con 0x5644a86acb60 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.686+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86b3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.686+0000 7fc2fce86640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86b3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.102:47698/0 (socket says 172.21.15.102:47698) 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.686+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 learned_addr learned my addr 172.21.15.102:0/574085329 (peer_addr_for_me v2:172.21.15.102:0/0) 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.686+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x5644a86b4500 con 0x5644a86acb60 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.687+0000 7fc2fce86640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86b3fa0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec026780 tx=0x7fc2ec04c080 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.687+0000 7fc1d27fc640 1 -- 172.21.15.102:0/574085329 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec064070 con 0x5644a86acb60 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.687+0000 7fc1d27fc640 1 -- 172.21.15.102:0/574085329 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fc2ec06e070 con 0x5644a86acb60 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.687+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x5644a86b4500 con 0x5644a86acb60 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.687+0000 7fc1d27fc640 1 -- 172.21.15.102:0/574085329 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fc2ec03e170 con 0x5644a86acb60 2024-09-19T11:16:49.694 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.687+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x5644a86b4500 con 0x5644a86acb60 2024-09-19T11:16:49.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.689+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.690+0000 7fc1d27fc640 1 -- 172.21.15.102:0/574085329 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fc2ec010070 con 0x5644a86acb60 2024-09-19T11:16:49.710 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.690+0000 7fc1d27fc640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1c803d000 0x7fc1c803f4c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.690+0000 7fc1d27fc640 1 -- 172.21.15.102:0/574085329 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fc2ec009140 con 0x5644a86acb60 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.690+0000 7fc2fc685640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1c803d000 0x7fc1c803f4c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.690+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a86bf5a0 0x5644a86c1a30 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.690+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:1 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2180 con 0x5644a86bf5a0 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.691+0000 7fc2fd687640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a86bf5a0 0x5644a86c1a30 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.691+0000 7fc2fc685640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1c803d000 0x7fc1c803f4c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0000c00 tx=0x7fc2f006d040 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.691+0000 7fc2fd687640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a86bf5a0 0x5644a86c1a30 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.691+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== osd_op_reply(1 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f40083e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.691+0000 7fc301140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.691+0000 7fc301140800 20 realm 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.691+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.711 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.691+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:2 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2590 con 0x5644a86bf5a0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== osd_op_reply(2 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f40083e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 4 RGWPeriod::init failed to init realm id : (2) No such file or directory 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:3 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 3 ==== osd_op_reply(3 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f40083e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:4 5.f 5:f43b6ece:::zone_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c3200 con 0x5644a86bf5a0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 4 ==== osd_op_reply(4 zone_names.default [read 0~46 out=46b] v0'0 uv3 ondisk = 0) ==== 162+0+46 (crc 0 0 0) 0x7fc2f40083e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:16:49.712 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a86c3bc0 0x5644a86c5fb0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:5 5.5 5:a4547d2c:::zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c6600 con 0x5644a86c3bc0 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.692+0000 7fc2fce86640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a86c3bc0 0x5644a86c5fb0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.693+0000 7fc2fce86640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a86c3bc0 0x5644a86c5fb0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.693+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== osd_op_reply(5 zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a [read 0~993 out=993b] v0'0 uv4 ondisk = 0) ==== 190+0+993 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.693+0000 7fc301140800 20 rados_obj.operate() r=0 bl.length=993 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.693+0000 7fc301140800 20 searching for the correct realm 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.693+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a86c8590 0x5644a86caa50 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.693+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:6 5.0 5:00000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cb0d0 con 0x5644a86c8590 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.693+0000 7fc2fc685640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a86c8590 0x5644a86caa50 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.694+0000 7fc2fc685640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a86c8590 0x5644a86caa50 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.694+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== osd_op_reply(6 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.713 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.694+0000 7fc2fc685640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc2f0069040 0x7fc2f006a940 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.694+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:7 5.10 5:08000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cb0d0 con 0x7fc2f0069040 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.694+0000 7fc2fd687640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc2f0069040 0x7fc2f006a940 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.694+0000 7fc2fd687640 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc2f0069040 0x7fc2f006a940 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.695+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== osd_op_reply(7 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f40083e0 con 0x7fc2f0069040 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.695+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:8 5.8 5:10000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c3bc0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.695+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== osd_op_reply(8 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.695+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:9 5.18 5:18000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.695+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 5 ==== osd_op_reply(9 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f40083e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.696+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:10 5.4 5:20000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.696+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 6 ==== osd_op_reply(10 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.696+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:11 5.14 5:28000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c3bc0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.696+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 3 ==== osd_op_reply(11 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.714 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.696+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:12 5.c 5:30000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c3bc0 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.697+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 4 ==== osd_op_reply(12 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.697+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:13 5.1c 5:38000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x7fc2f0069040 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.697+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== osd_op_reply(13 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.697+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:14 5.2 5:40000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c8590 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.697+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== osd_op_reply(14 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.697+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:15 5.12 5:48000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.697+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 7 ==== osd_op_reply(15 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.697+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:16 5.a 5:50000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c3bc0 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.698+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 5 ==== osd_op_reply(16 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.698+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:17 5.1a 5:58000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.698+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 8 ==== osd_op_reply(17 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.698+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:18 5.6 5:60000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x7fc2f0069040 2024-09-19T11:16:49.715 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.698+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 3 ==== osd_op_reply(18 [pgnls start_epoch 37 out=79b] v28'1 uv1 ondisk = 1) ==== 144+0+79 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.698+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:19 5.16 5:68000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c8590 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.699+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 3 ==== osd_op_reply(19 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.699+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:20 5.e 5:70000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c8590 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.699+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 4 ==== osd_op_reply(20 [pgnls start_epoch 37 out=112b] v28'1 uv1 ondisk = 1) ==== 144+0+112 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.699+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:21 5.1e 5:78000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c3bc0 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.699+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 6 ==== osd_op_reply(21 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.699+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:22 5.1 5:80000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c8590 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.700+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 5 ==== osd_op_reply(22 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.700+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:23 5.11 5:88000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c8590 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.700+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 6 ==== osd_op_reply(23 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.700+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:24 5.9 5:90000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.700+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 9 ==== osd_op_reply(24 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.716 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.700+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:25 5.19 5:98000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.700+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 10 ==== osd_op_reply(25 [pgnls start_epoch 37 out=74b] v37'2 uv1 ondisk = 1) ==== 144+0+74 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.700+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:26 5.5 5:a0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c3bc0 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.701+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 7 ==== osd_op_reply(26 [pgnls start_epoch 37 out=107b] v37'4 uv4 ondisk = 1) ==== 144+0+107 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.701+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:27 5.15 5:a8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c8590 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.701+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 7 ==== osd_op_reply(27 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.701+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:28 5.d 5:b0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x7fc2f0069040 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.701+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 4 ==== osd_op_reply(28 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.701+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:29 5.1d 5:b8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.702+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 11 ==== osd_op_reply(29 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.702+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:30 5.3 5:c0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c3bc0 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.702+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 8 ==== osd_op_reply(30 [pgnls start_epoch 37 out=82b] v37'1 uv1 ondisk = 1) ==== 144+0+82 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.702+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:31 5.13 5:c8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c8590 2024-09-19T11:16:49.717 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.702+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 8 ==== osd_op_reply(31 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.702+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:32 5.b 5:d0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c3bc0 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.703+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 9 ==== osd_op_reply(32 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.703+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:33 5.1b 5:d8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x7fc2f0069040 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.703+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 5 ==== osd_op_reply(33 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.703+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:34 5.7 5:e0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86c8590 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.703+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 9 ==== osd_op_reply(34 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.703+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:35 5.17 5:e8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x7fc2f0069040 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 6 ==== osd_op_reply(35 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.718 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:36 5.f 5:f0000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x5644a86bf5a0 2024-09-19T11:16:49.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 12 ==== osd_op_reply(36 [pgnls start_epoch 37 out=115b] v37'3 uv3 ondisk = 1) ==== 144+0+115 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:37 5.1f 5:f8000000::::head [pgnls start_epoch 37 in=39b] snapc 0=[] ondisk+read+ignore_overlay+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c2e60 con 0x7fc2f0069040 2024-09-19T11:16:49.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 7 ==== osd_op_reply(37 [pgnls start_epoch 37 out=49b] v0'0 uv0 ondisk = 1) ==== 144+0+49 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 RGWRados::pool_iterate: got default.zonegroup. 2024-09-19T11:16:49.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 RGWRados::pool_iterate: got zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 2024-09-19T11:16:49.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 RGWRados::pool_iterate: got default.zone. 2024-09-19T11:16:49.720 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 RGWRados::pool_iterate: got zone_info.32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 RGWRados::pool_iterate: got period_config.default 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 RGWRados::pool_iterate: got zone_names.default 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 RGWRados::pool_iterate: got zonegroups_names.default 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:38 5.12 5:49953fa1:::default.realm:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c69a0 con 0x5644a86bf5a0 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 13 ==== osd_op_reply(38 default.realm [read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 157+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.704+0000 7fc301140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:39 5.f 5:f4c53578:::zonegroups_names.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c69a0 con 0x5644a86bf5a0 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 14 ==== osd_op_reply(39 zonegroups_names.default [read 0~46 out=46b] v0'0 uv2 ondisk = 0) ==== 168+0+46 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 20 rados_obj.operate() r=0 bl.length=46 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:40 5.e 5:779b4bbb:::zonegroup_info.68013f1d-b756-462e-83a9-97539995db13:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c69a0 con 0x5644a86c8590 2024-09-19T11:16:49.721 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 10 ==== osd_op_reply(40 zonegroup_info.68013f1d-b756-462e-83a9-97539995db13 [read 0~436 out=436b] v0'0 uv1 ondisk = 0) ==== 195+0+436 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 20 rados_obj.operate() r=0 bl.length=436 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 20 zone default found 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 4 Realm: () 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 4 ZoneGroup: default (68013f1d-b756-462e-83a9-97539995db13) 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 4 Zone: default (32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a) 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 10 cannot find current period zonegroup using local zonegroup configuration 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 20 zonegroup default 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.705+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:41 5.3 5:c52100b6:::period_config.default:head [read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86c7240 con 0x5644a86c3bc0 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 10 ==== osd_op_reply(41 period_config.default [read 0~187 out=187b] v0'0 uv1 ondisk = 0) ==== 165+0+187 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 20 rados_obj.operate() r=0 bl.length=187 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.722 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:42 6.2 6:4347d321:::bucket.sync-source-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cd0d0 con 0x5644a86c8590 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 11 ==== osd_op_reply(42 bucket.sync-source-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 20 rados->read ofs=0 len=0 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:43 6.b 6:d467b91b:::bucket.sync-target-hints.:head [call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cd510 con 0x5644a86c8590 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 12 ==== osd_op_reply(43 bucket.sync-target-hints. [call,read 0~0] v0'0 uv0 ondisk = -2 ((2) No such file or directory)) ==== 211+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 20 rados_obj.operate() r=-2 bl.length=0 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 20 started sync module instance, tier type = 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.706+0000 7fc301140800 20 started zone id=32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a (name=default) with tier type = 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.707+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:44 7.1f 7:f95f44c2:::notify.0:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cc3e0 con 0x7fc2f0069040 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.708+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 8 ==== osd_op_reply(44 notify.0 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.708+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:45 7.1f 7:f95f44c2:::notify.0:head [watch watch cookie 94852883466464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cc3e0 con 0x7fc2f0069040 2024-09-19T11:16:49.723 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.708+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:46 7.0 7:05bf5b68:::notify.1:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86ce050 con 0x5644a86bf5a0 2024-09-19T11:16:49.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.709+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 9 ==== osd_op_reply(45 notify.0 [watch watch cookie 94852883466464] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.709+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 15 ==== osd_op_reply(46 notify.1 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.709+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:47 7.0 7:05bf5b68:::notify.1:head [watch watch cookie 94852883471168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cc3e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.709+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:48 7.15 7:a93a5511:::notify.2:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cea60 con 0x5644a86c8590 2024-09-19T11:16:49.728 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.711+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 16 ==== osd_op_reply(47 notify.1 [watch watch cookie 94852883471168] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.711+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 13 ==== osd_op_reply(48 notify.2 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.711+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:49 7.15 7:a93a5511:::notify.2:head [watch watch cookie 94852883463984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cc350 con 0x5644a86c8590 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.711+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:50 7.e 7:7759931f:::notify.3:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cf920 con 0x7fc2f0069040 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.712+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 10 ==== osd_op_reply(50 notify.3 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.712+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:51 7.e 7:7759931f:::notify.3:head [watch watch cookie 94852883478128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d01c0 con 0x7fc2f0069040 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.712+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:52 7.d 7:b4812045:::notify.4:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d0c10 con 0x5644a86bf5a0 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.712+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 14 ==== osd_op_reply(49 notify.2 [watch watch cookie 94852883463984] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.713+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 17 ==== osd_op_reply(52 notify.4 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.713+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:53 7.d 7:b4812045:::notify.4:head [watch watch cookie 94852883482368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d0bd0 con 0x5644a86bf5a0 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.713+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 11 ==== osd_op_reply(51 notify.3 [watch watch cookie 94852883478128] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.713+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:54 7.3 7:c609908c:::notify.5:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cfd10 con 0x5644a86c3bc0 2024-09-19T11:16:49.729 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.715+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 18 ==== osd_op_reply(53 notify.4 [watch watch cookie 94852883482368] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.715+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 11 ==== osd_op_reply(54 notify.5 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.715+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:55 7.3 7:c609908c:::notify.5:head [watch watch cookie 94852883476048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d1620 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.715+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:56 7.14 7:2b04a3e9:::notify.6:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d1eb0 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.716+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 12 ==== osd_op_reply(55 notify.5 [watch watch cookie 94852883476048] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.716+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 13 ==== osd_op_reply(56 notify.6 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.716+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:57 7.14 7:2b04a3e9:::notify.6:head [watch watch cookie 94852883485040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d22a0 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.716+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:58 7.9 7:93e5b521:::notify.7:head [create] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d2c60 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 14 ==== osd_op_reply(57 notify.6 [watch watch cookie 94852883485040] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 15 ==== osd_op_reply(58 notify.7 [create] v37'283 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:59 7.9 7:93e5b521:::notify.7:head [watch watch cookie 94852883487168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d2c60 con 0x5644a86c3bc0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc301140800 20 add_watcher() i=0 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc301140800 20 add_watcher() i=1 2024-09-19T11:16:49.730 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc301140800 20 add_watcher() i=2 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc301140800 20 add_watcher() i=3 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc301140800 20 add_watcher() i=4 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc301140800 20 add_watcher() i=5 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.717+0000 7fc301140800 20 add_watcher() i=6 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.719+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 16 ==== osd_op_reply(59 notify.7 [watch watch cookie 94852883487168] v37'284 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.719+0000 7fc301140800 20 add_watcher() i=7 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.719+0000 7fc301140800 2 all 8 watchers are set, enabling cache 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.719+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:60 6.4 6:22d26bf9:::data_loggenerations_metadata:head [call version.check_conds in=74b,call version.read in=11b,read 0~0] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d6090 con 0x5644a86bf5a0 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.719+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 19 ==== osd_op_reply(60 data_loggenerations_metadata [call,call out=48b,read 0~28 out=28b] v0'0 uv1 ondisk = 0) ==== 256+0+76 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.719+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:61 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch watch cookie 94852883491200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d35e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.720+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 20 ==== osd_op_reply(61 data_loggenerations_metadata [watch watch cookie 94852883491200] v37'274 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.720+0000 7fc1b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:16:49.731 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.720+0000 7fc301140800 20 rgw_check_secure_mon_conn(): auth registy supported: methods=[2] modes=[2,1] 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.720+0000 7fc301140800 20 rgw_check_secure_mon_conn(): mode 1 is insecure 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.720+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:62 6.19 6:9a6dd8c0:gc::gc.0:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86de7d0 con 0x5644a86bf5a0 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.722+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 21 ==== osd_op_reply(62 gc.0 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.722+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:63 6.18 6:1e85421f:gc::gc.1:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86dede0 con 0x5644a86c3bc0 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.723+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 17 ==== osd_op_reply(63 gc.1 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.723+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:64 6.b 6:d242335b:gc::gc.2:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86deda0 con 0x5644a86c8590 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.725+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 15 ==== osd_op_reply(64 gc.2 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.725+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:65 6.4 6:2166d8e1:gc::gc.3:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d50c0 con 0x5644a86bf5a0 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.726+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 22 ==== osd_op_reply(65 gc.3 [create,call,call,call] v37'275 uv166 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.732 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.726+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:66 6.3 6:c60da066:gc::gc.4:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d4c10 con 0x7fc2f0069040 2024-09-19T11:16:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.727+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 12 ==== osd_op_reply(66 gc.4 [create,call,call,call] v37'83 uv51 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.727+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:67 6.9 6:954be8d2:gc::gc.5:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d4d20 con 0x5644a86c8590 2024-09-19T11:16:49.733 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.728+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 16 ==== osd_op_reply(67 gc.5 [create,call,call,call] v37'56 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.728+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:68 6.e 6:748722ff:gc::gc.6:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e04f0 con 0x5644a86bf5a0 2024-09-19T11:16:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.730+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 23 ==== osd_op_reply(68 gc.6 [create,call,call,call] v37'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.730+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:69 6.1d 6:beaa4be4:gc::gc.7:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e04f0 con 0x5644a86c3bc0 2024-09-19T11:16:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.731+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 18 ==== osd_op_reply(69 gc.7 [create,call,call,call] v37'58 uv35 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.731+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:70 6.12 6:4f78e9a2:gc::gc.8:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e04f0 con 0x7fc2f0069040 2024-09-19T11:16:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.732+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 13 ==== osd_op_reply(70 gc.8 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.734 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.732+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:71 6.1c 6:3e426232:gc::gc.9:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e04f0 con 0x5644a86c8590 2024-09-19T11:16:49.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.733+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 17 ==== osd_op_reply(71 gc.9 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 274+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.735 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.733+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:72 6.3 6:c31f41d7:gc::gc.10:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0a60 con 0x7fc2f0069040 2024-09-19T11:16:49.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.734+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 14 ==== osd_op_reply(72 gc.10 [create,call,call,call] v37'84 uv53 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.736 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.734+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:73 6.13 6:c8333aab:gc::gc.11:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0a60 con 0x5644a86c3bc0 2024-09-19T11:16:49.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.735+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 19 ==== osd_op_reply(73 gc.11 [create,call,call,call] v37'45 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.737 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.735+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:74 6.15 6:ab569f81:gc::gc.12:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0ee0 con 0x7fc2f0069040 2024-09-19T11:16:49.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.736+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 15 ==== osd_op_reply(74 gc.12 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.738 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.736+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:75 6.0 6:0667bb13:gc::gc.13:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0c60 con 0x5644a86c3bc0 2024-09-19T11:16:49.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.738+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 20 ==== osd_op_reply(75 gc.13 [create,call,call,call] v37'63 uv61 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.740 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.738+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:76 6.4 6:227f63b5:gc::gc.14:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0c20 con 0x5644a86bf5a0 2024-09-19T11:16:49.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.739+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 24 ==== osd_op_reply(76 gc.14 [create,call,call,call] v37'276 uv162 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.741 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.739+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:77 6.7 6:e07a6548:gc::gc.15:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0c20 con 0x5644a86c8590 2024-09-19T11:16:49.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.740+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 18 ==== osd_op_reply(77 gc.15 [create,call,call,call] v37'77 uv45 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.742 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.740+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:78 6.3 6:c623b173:gc::gc.16:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0c20 con 0x7fc2f0069040 2024-09-19T11:16:49.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.741+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 16 ==== osd_op_reply(78 gc.16 [create,call,call,call] v37'85 uv55 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.743 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.741+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:79 6.16 6:6849fd06:gc::gc.17:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0c20 con 0x5644a86c8590 2024-09-19T11:16:49.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.742+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 19 ==== osd_op_reply(79 gc.17 [create,call,call,call] v37'31 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.744 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.742+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:80 6.d 6:b019ea83:gc::gc.18:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0c20 con 0x5644a86bf5a0 2024-09-19T11:16:49.745 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.744+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 25 ==== osd_op_reply(80 gc.18 [create,call,call,call] v37'39 uv29 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.746 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.744+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:81 6.4 6:24c8e1ae:gc::gc.19:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0c20 con 0x5644a86bf5a0 2024-09-19T11:16:49.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.745+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 26 ==== osd_op_reply(81 gc.19 [create,call,call,call] v37'277 uv164 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x5644a86bf5a0 2024-09-19T11:16:49.747 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.745+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:82 6.7 6:e622f76a:gc::gc.20:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0c20 con 0x5644a86c8590 2024-09-19T11:16:49.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.746+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 20 ==== osd_op_reply(82 gc.20 [create,call,call,call] v37'78 uv47 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.748 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.746+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:83 6.a 6:5127e642:gc::gc.21:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0d20 con 0x7fc2f0069040 2024-09-19T11:16:49.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.747+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 17 ==== osd_op_reply(83 gc.21 [create,call,call,call] v37'41 uv31 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.749 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.747+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:84 6.11 6:8eb99c53:gc::gc.22:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0d20 con 0x5644a86c8590 2024-09-19T11:16:49.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.748+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 21 ==== osd_op_reply(84 gc.22 [create,call,call,call] v37'34 uv24 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.750 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.748+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:85 6.8 6:17d7e8ed:gc::gc.23:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0d20 con 0x5644a86c8590 2024-09-19T11:16:49.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.749+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 22 ==== osd_op_reply(85 gc.23 [create,call,call,call] v37'38 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.751 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.749+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:86 6.1b 6:db9d130d:gc::gc.24:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0d60 con 0x5644a86c8590 2024-09-19T11:16:49.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.750+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 23 ==== osd_op_reply(86 gc.24 [create,call,call,call] v37'27 uv17 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.752 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.750+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:87 6.9 6:921ecdb1:gc::gc.25:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0d50 con 0x5644a86c8590 2024-09-19T11:16:49.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.751+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 24 ==== osd_op_reply(87 gc.25 [create,call,call,call] v37'57 uv37 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.753 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.751+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:88 6.1f 6:fde4dd55:gc::gc.26:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0d50 con 0x5644a86c3bc0 2024-09-19T11:16:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.752+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 21 ==== osd_op_reply(88 gc.26 [create,call,call,call] v37'33 uv23 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.752+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:89 6.1a 6:5909e671:gc::gc.27:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0da0 con 0x5644a86c8590 2024-09-19T11:16:49.755 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.754+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 25 ==== osd_op_reply(89 gc.27 [create,call,call,call] v37'35 uv21 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.754+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:90 6.1d 6:b88e3271:gc::gc.28:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0d90 con 0x5644a86c3bc0 2024-09-19T11:16:49.756 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.755+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 22 ==== osd_op_reply(90 gc.28 [create,call,call,call] v37'59 uv38 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.757 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.755+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:91 6.7 6:e47c9322:gc::gc.29:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0dd0 con 0x5644a86c8590 2024-09-19T11:16:49.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.756+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 26 ==== osd_op_reply(91 gc.29 [create,call,call,call] v37'79 uv49 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.758 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.756+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:92 6.0 6:013d6c33:gc::gc.30:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0d90 con 0x5644a86c3bc0 2024-09-19T11:16:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.757+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 23 ==== osd_op_reply(92 gc.30 [create,call,call,call] v37'64 uv42 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.757+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:93 6.f 6:f24cb4a8:gc::gc.31:head [create,call version.check_conds in=74b,call rgw_gc.rgw_gc_queue_init in=45b,call version.set in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86e0dd0 con 0x7fc2f0069040 2024-09-19T11:16:49.760 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.758+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 18 ==== osd_op_reply(93 gc.31 [create,call,call,call] v37'37 uv27 ondisk = -125 ((125) Operation canceled)) ==== 275+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.759+0000 7fc1b1fe3640 20 reqs_thread_entry: start 2024-09-19T11:16:49.761 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.759+0000 7fc301140800 20 init_complete bucket index max shards: 11 2024-09-19T11:16:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.759+0000 7fc301140800 20 Filter name: none 2024-09-19T11:16:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.759+0000 7fc1237fe640 20 reqs_thread_entry: start 2024-09-19T11:16:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.759+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=9, max_secs=3600, expired_only=0 2024-09-19T11:16:49.762 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.759+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:94 6.1c 6:3e426232:gc::gc.9:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c8590 2024-09-19T11:16:49.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.760+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 27 ==== osd_op_reply(94 gc.9 [call] v37'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.760+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:95 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c8590 2024-09-19T11:16:49.764 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.760+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 28 ==== osd_op_reply(95 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.760+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.760+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:96 6.1c 6:3e426232:gc::gc.9:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870bcf0 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.761+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 29 ==== osd_op_reply(96 gc.9 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.761+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:97 6.1c 6:3e426232:gc::gc.9:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.761+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 30 ==== osd_op_reply(97 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.761+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.761+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:98 6.1c 6:3e426232:gc::gc.9:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.761+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 31 ==== osd_op_reply(98 gc.9 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.761+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.761+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:99 6.1c 6:3e426232:gc::gc.9:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.762+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 32 ==== osd_op_reply(99 gc.9 [call] v37'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.765 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.762+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=10, max_secs=3600, expired_only=0 2024-09-19T11:16:49.766 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.762+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:100 6.3 6:c31f41d7:gc::gc.10:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.767 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.763+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 19 ==== osd_op_reply(100 gc.10 [call] v37'86 uv86 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.763+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:101 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.763+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 20 ==== osd_op_reply(101 gc.10 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.763+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.763+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:102 6.3 6:c31f41d7:gc::gc.10:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870bcf0 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.764+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 21 ==== osd_op_reply(102 gc.10 [call out=24b] v0'0 uv86 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.764+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:103 6.3 6:c31f41d7:gc::gc.10:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.764+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 22 ==== osd_op_reply(103 gc.10 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4026040 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.764+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.764+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:104 6.3 6:c31f41d7:gc::gc.10:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.764+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 23 ==== osd_op_reply(104 gc.10 [call out=15b] v0'0 uv86 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.768 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.764+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.764+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:105 6.3 6:c31f41d7:gc::gc.10:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.765+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 24 ==== osd_op_reply(105 gc.10 [call] v37'87 uv87 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.765+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=11, max_secs=3600, expired_only=0 2024-09-19T11:16:49.769 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.765+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:106 6.13 6:c8333aab:gc::gc.11:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.766+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 24 ==== osd_op_reply(106 gc.11 [call] v37'46 uv46 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.766+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:107 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.767+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 25 ==== osd_op_reply(107 gc.11 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.767+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.767+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:108 6.13 6:c8333aab:gc::gc.11:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870bcf0 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.767+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 26 ==== osd_op_reply(108 gc.11 [call out=24b] v0'0 uv46 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.767+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:109 6.13 6:c8333aab:gc::gc.11:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.767+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 27 ==== osd_op_reply(109 gc.11 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.767+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.767+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:110 6.13 6:c8333aab:gc::gc.11:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.771 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.768+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 28 ==== osd_op_reply(110 gc.11 [call out=15b] v0'0 uv46 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.768+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.768+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:111 6.13 6:c8333aab:gc::gc.11:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.769+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 29 ==== osd_op_reply(111 gc.11 [call] v37'47 uv47 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.769+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=12, max_secs=3600, expired_only=0 2024-09-19T11:16:49.772 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.769+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:112 6.15 6:ab569f81:gc::gc.12:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 25 ==== osd_op_reply(112 gc.12 [call] v37'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:113 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.775 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 26 ==== osd_op_reply(113 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:114 6.15 6:ab569f81:gc::gc.12:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870bcf0 con 0x7fc2f0069040 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 27 ==== osd_op_reply(114 gc.12 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:115 6.15 6:ab569f81:gc::gc.12:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 28 ==== osd_op_reply(115 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.770+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:116 6.15 6:ab569f81:gc::gc.12:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.771+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 29 ==== osd_op_reply(116 gc.12 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.776 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.771+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.771+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:117 6.15 6:ab569f81:gc::gc.12:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x7fc2f0069040 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.772+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 30 ==== osd_op_reply(117 gc.12 [call] v37'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.772+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=13, max_secs=3600, expired_only=0 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.772+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:118 6.0 6:0667bb13:gc::gc.13:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.773+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 30 ==== osd_op_reply(118 gc.13 [call] v37'65 uv65 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.773+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:119 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.773+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 31 ==== osd_op_reply(119 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.773+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.773+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:120 6.0 6:0667bb13:gc::gc.13:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870bcf0 con 0x5644a86c3bc0 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.773+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 32 ==== osd_op_reply(120 gc.13 [call out=24b] v0'0 uv65 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.777 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.773+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:121 6.0 6:0667bb13:gc::gc.13:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 33 ==== osd_op_reply(121 gc.13 [call out=15b] v0'0 uv65 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.779 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:122 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870cd00 con 0x5644a86c3bc0 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 34 ==== osd_op_reply(122 gc.13 [call out=1716b] v0'0 uv65 ondisk = 0) ==== 149+0+1716 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=1, truncated=0, next_marker='' 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 20 garbage collection: RGWGC::process iterating over entry tag='32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.12322685053085364967', time=2024-09-19T11:16:57.584334+0000, chain.objs.size()=7 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_1 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:123 3.19s0 3:9adbb2d9:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_1:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870b030 con 0x5644a86bf5a0 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_2 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:124 3.2fs0 3:f5214d75:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_2:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870ff00 con 0x5644a86c8590 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_3 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:125 3.2as0 3:577d5030:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_3:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8712ad0 con 0x5644a86bf5a0 2024-09-19T11:16:49.780 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_4 2024-09-19T11:16:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:126 3.1s0 3:8020bead:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_4:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a87154d0 con 0x5644a86c3bc0 2024-09-19T11:16:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_5 2024-09-19T11:16:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:127 3.36s0 3:6f0fe40c:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_5:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8717d40 con 0x7fc2f0069040 2024-09-19T11:16:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_6 2024-09-19T11:16:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:128 3.31s0 3:8c7927f3:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_6:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a87154d0 con 0x5644a86c3bc0 2024-09-19T11:16:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 5 garbage collection: RGWGC::process removing default.rgw.buckets.data:32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_7 2024-09-19T11:16:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.774+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:129 3.18s0 3:1a18c27d:::32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_7:head [call refcount.put in=85b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870ff00 con 0x5644a86c8590 2024-09-19T11:16:49.781 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.777+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 35 ==== osd_op_reply(126 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_4 [call] v37'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.780+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 31 ==== osd_op_reply(127 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_5 [call] v37'4 uv4 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.782 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.780+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 36 ==== osd_op_reply(128 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_6 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.780+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 33 ==== osd_op_reply(124 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_2 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.783 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.781+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 34 ==== osd_op_reply(129 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_7 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.781+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 27 ==== osd_op_reply(123 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_1 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.781+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 28 ==== osd_op_reply(125 32dfc5b1-f2fa-47e4-bcf8-811ad5b6fe4a.4239.11__shadow_.-fl-6fGEeTiYkMNc9Bf3029zsKyJrZW_3 [call] v37'2 uv2 ondisk = 0) ==== 231+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.781+0000 7fc301140800 5 garbage collection: RGWGC::process removing entries, marker: 2024-09-19T11:16:49.784 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.781+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:130 6.0 6:0667bb13:gc::gc.13:head [call rgw_gc.rgw_gc_queue_remove_entries in=47b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870aa20 con 0x5644a86c3bc0 2024-09-19T11:16:49.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.789+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 37 ==== osd_op_reply(130 gc.13 [call] v37'66 uv66 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.791 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.789+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:131 6.0 6:0667bb13:gc::gc.13:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870aa20 con 0x5644a86c3bc0 2024-09-19T11:16:49.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.790+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 38 ==== osd_op_reply(131 gc.13 [call] v37'67 uv67 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.790+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=14, max_secs=3600, expired_only=0 2024-09-19T11:16:49.792 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.790+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:132 6.4 6:227f63b5:gc::gc.14:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a870aa20 con 0x5644a86bf5a0 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 29 ==== osd_op_reply(132 gc.14 [call] v37'278 uv278 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:133 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a870a9d0 con 0x5644a86bf5a0 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 30 ==== osd_op_reply(133 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:134 6.4 6:227f63b5:gc::gc.14:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a87113d0 con 0x5644a86bf5a0 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 31 ==== osd_op_reply(134 gc.14 [call out=24b] v0'0 uv278 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:135 6.4 6:227f63b5:gc::gc.14:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a87123e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 32 ==== osd_op_reply(135 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.795 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.792+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:136 6.4 6:227f63b5:gc::gc.14:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a87123e0 con 0x5644a86bf5a0 2024-09-19T11:16:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.793+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 33 ==== osd_op_reply(136 gc.14 [call out=15b] v0'0 uv278 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.793+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.793+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:137 6.4 6:227f63b5:gc::gc.14:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8712390 con 0x5644a86bf5a0 2024-09-19T11:16:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.794+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 34 ==== osd_op_reply(137 gc.14 [call] v37'279 uv279 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.794+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=15, max_secs=3600, expired_only=0 2024-09-19T11:16:49.796 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.794+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:138 6.7 6:e07a6548:gc::gc.15:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8712390 con 0x5644a86c8590 2024-09-19T11:16:49.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.795+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 35 ==== osd_op_reply(138 gc.15 [call] v37'80 uv80 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.795+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:139 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8712390 con 0x5644a86c8590 2024-09-19T11:16:49.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.795+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 36 ==== osd_op_reply(139 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.795+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.798 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.795+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:140 6.7 6:e07a6548:gc::gc.15:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8711380 con 0x5644a86c8590 2024-09-19T11:16:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.795+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 37 ==== osd_op_reply(140 gc.15 [call out=24b] v0'0 uv80 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.795+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:141 6.7 6:e07a6548:gc::gc.15:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8712390 con 0x5644a86c8590 2024-09-19T11:16:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.796+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 38 ==== osd_op_reply(141 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.796+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.796+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:142 6.7 6:e07a6548:gc::gc.15:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8712390 con 0x5644a86c8590 2024-09-19T11:16:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.796+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 39 ==== osd_op_reply(142 gc.15 [call out=15b] v0'0 uv80 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.796+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.799 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.796+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:143 6.7 6:e07a6548:gc::gc.15:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8712390 con 0x5644a86c8590 2024-09-19T11:16:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.797+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 40 ==== osd_op_reply(143 gc.15 [call] v37'81 uv81 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.797+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=16, max_secs=3600, expired_only=0 2024-09-19T11:16:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.797+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:144 6.3 6:c623b173:gc::gc.16:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8712390 con 0x7fc2f0069040 2024-09-19T11:16:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.798+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 32 ==== osd_op_reply(144 gc.16 [call] v37'88 uv88 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.798+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:145 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.798+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 33 ==== osd_op_reply(145 gc.16 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.801 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.798+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.798+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:146 6.3 6:c623b173:gc::gc.16:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x7fc2f0069040 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.798+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 34 ==== osd_op_reply(146 gc.16 [call out=24b] v0'0 uv88 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.798+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:147 6.3 6:c623b173:gc::gc.16:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.799+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 35 ==== osd_op_reply(147 gc.16 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.799+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.799+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:148 6.3 6:c623b173:gc::gc.16:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.799+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 36 ==== osd_op_reply(148 gc.16 [call out=15b] v0'0 uv88 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.799+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.802 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.799+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:149 6.3 6:c623b173:gc::gc.16:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.800+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 37 ==== osd_op_reply(149 gc.16 [call] v37'89 uv89 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.800+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=17, max_secs=3600, expired_only=0 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.800+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:150 6.16 6:6849fd06:gc::gc.17:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 41 ==== osd_op_reply(150 gc.17 [call] v37'32 uv32 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:151 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 42 ==== osd_op_reply(151 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:152 6.16 6:6849fd06:gc::gc.17:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x5644a86c8590 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 43 ==== osd_op_reply(152 gc.17 [call out=24b] v0'0 uv32 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:153 6.16 6:6849fd06:gc::gc.17:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 44 ==== osd_op_reply(153 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.804 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.801+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:154 6.16 6:6849fd06:gc::gc.17:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.802+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 45 ==== osd_op_reply(154 gc.17 [call out=15b] v0'0 uv32 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.802+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.802+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:155 6.16 6:6849fd06:gc::gc.17:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.803+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 46 ==== osd_op_reply(155 gc.17 [call] v37'33 uv33 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.803+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=18, max_secs=3600, expired_only=0 2024-09-19T11:16:49.805 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.803+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:156 6.d 6:b019ea83:gc::gc.18:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.804+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 35 ==== osd_op_reply(156 gc.18 [call] v37'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.804+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:157 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.804+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 36 ==== osd_op_reply(157 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.804+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.806 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.804+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:158 6.d 6:b019ea83:gc::gc.18:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x5644a86bf5a0 2024-09-19T11:16:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.805+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 37 ==== osd_op_reply(158 gc.18 [call out=24b] v0'0 uv40 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.805+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:159 6.d 6:b019ea83:gc::gc.18:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.805+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 38 ==== osd_op_reply(159 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.805+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.805+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:160 6.d 6:b019ea83:gc::gc.18:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.805+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 39 ==== osd_op_reply(160 gc.18 [call out=15b] v0'0 uv40 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.805+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.808 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.805+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:161 6.d 6:b019ea83:gc::gc.18:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.807+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 40 ==== osd_op_reply(161 gc.18 [call] v37'41 uv41 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.807+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=19, max_secs=3600, expired_only=0 2024-09-19T11:16:49.809 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.807+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:162 6.4 6:24c8e1ae:gc::gc.19:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 41 ==== osd_op_reply(162 gc.19 [call] v37'280 uv280 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:163 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 42 ==== osd_op_reply(163 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:164 6.4 6:24c8e1ae:gc::gc.19:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 43 ==== osd_op_reply(164 gc.19 [call out=24b] v0'0 uv280 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:165 6.4 6:24c8e1ae:gc::gc.19:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 44 ==== osd_op_reply(165 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.808+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:166 6.4 6:24c8e1ae:gc::gc.19:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.809+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 45 ==== osd_op_reply(166 gc.19 [call out=15b] v0'0 uv280 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.811 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.809+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.809+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:167 6.4 6:24c8e1ae:gc::gc.19:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86bf5a0 2024-09-19T11:16:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.810+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 46 ==== osd_op_reply(167 gc.19 [call] v37'281 uv281 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.810+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=20, max_secs=3600, expired_only=0 2024-09-19T11:16:49.812 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.810+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:168 6.7 6:e622f76a:gc::gc.20:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 47 ==== osd_op_reply(168 gc.20 [call] v37'82 uv82 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:169 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 48 ==== osd_op_reply(169 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:170 6.7 6:e622f76a:gc::gc.20:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x5644a86c8590 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 49 ==== osd_op_reply(170 gc.20 [call out=24b] v0'0 uv82 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:171 6.7 6:e622f76a:gc::gc.20:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 50 ==== osd_op_reply(171 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.814 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.811+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:172 6.7 6:e622f76a:gc::gc.20:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.812+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 51 ==== osd_op_reply(172 gc.20 [call out=15b] v0'0 uv82 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.812+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.815 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.812+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:173 6.7 6:e622f76a:gc::gc.20:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.813+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 52 ==== osd_op_reply(173 gc.20 [call] v37'83 uv83 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.813+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=21, max_secs=3600, expired_only=0 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.813+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:174 6.a 6:5127e642:gc::gc.21:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 38 ==== osd_op_reply(174 gc.21 [call] v37'42 uv42 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:175 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 39 ==== osd_op_reply(175 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:176 6.a 6:5127e642:gc::gc.21:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x7fc2f0069040 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 40 ==== osd_op_reply(176 gc.21 [call out=24b] v0'0 uv42 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.817 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:177 6.a 6:5127e642:gc::gc.21:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 41 ==== osd_op_reply(177 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.814+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:178 6.a 6:5127e642:gc::gc.21:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.815+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 42 ==== osd_op_reply(178 gc.21 [call out=15b] v0'0 uv42 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.815+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.818 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.815+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:179 6.a 6:5127e642:gc::gc.21:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x7fc2f0069040 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.816+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 43 ==== osd_op_reply(179 gc.21 [call] v37'43 uv43 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.816+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=22, max_secs=3600, expired_only=0 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.816+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:180 6.11 6:8eb99c53:gc::gc.22:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 53 ==== osd_op_reply(180 gc.22 [call] v37'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:181 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 54 ==== osd_op_reply(181 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:182 6.11 6:8eb99c53:gc::gc.22:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x5644a86c8590 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 55 ==== osd_op_reply(182 gc.22 [call out=24b] v0'0 uv35 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.820 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:183 6.11 6:8eb99c53:gc::gc.22:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 56 ==== osd_op_reply(183 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.817+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:184 6.11 6:8eb99c53:gc::gc.22:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.818+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 57 ==== osd_op_reply(184 gc.22 [call out=15b] v0'0 uv35 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.818+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.818+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:185 6.11 6:8eb99c53:gc::gc.22:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.821 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.819+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 58 ==== osd_op_reply(185 gc.22 [call] v37'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.819+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=23, max_secs=3600, expired_only=0 2024-09-19T11:16:49.822 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.819+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:186 6.8 6:17d7e8ed:gc::gc.23:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.821+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 59 ==== osd_op_reply(186 gc.23 [call] v37'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.821+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:187 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.824 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.821+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 60 ==== osd_op_reply(187 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:188 6.8 6:17d7e8ed:gc::gc.23:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x5644a86c8590 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 61 ==== osd_op_reply(188 gc.23 [call out=24b] v0'0 uv39 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:189 6.8 6:17d7e8ed:gc::gc.23:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 62 ==== osd_op_reply(189 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:190 6.8 6:17d7e8ed:gc::gc.23:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 63 ==== osd_op_reply(190 gc.23 [call out=15b] v0'0 uv39 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.825 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.822+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:191 6.8 6:17d7e8ed:gc::gc.23:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.823+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 64 ==== osd_op_reply(191 gc.23 [call] v37'40 uv40 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.823+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=24, max_secs=3600, expired_only=0 2024-09-19T11:16:49.827 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.823+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:192 6.1b 6:db9d130d:gc::gc.24:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.824+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 65 ==== osd_op_reply(192 gc.24 [call] v37'28 uv28 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.824+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:193 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.824+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 66 ==== osd_op_reply(193 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.824+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.824+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:194 6.1b 6:db9d130d:gc::gc.24:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.824+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 67 ==== osd_op_reply(194 gc.24 [call out=24b] v0'0 uv28 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.824+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:195 6.1b 6:db9d130d:gc::gc.24:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.825+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 68 ==== osd_op_reply(195 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.825+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.825+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:196 6.1b 6:db9d130d:gc::gc.24:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.825+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 69 ==== osd_op_reply(196 gc.24 [call out=15b] v0'0 uv28 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.828 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.825+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.829 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.825+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:197 6.1b 6:db9d130d:gc::gc.24:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.826+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 70 ==== osd_op_reply(197 gc.24 [call] v37'29 uv29 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.826+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=25, max_secs=3600, expired_only=0 2024-09-19T11:16:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.826+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:198 6.9 6:921ecdb1:gc::gc.25:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.827+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 71 ==== osd_op_reply(198 gc.25 [call] v37'58 uv58 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.827+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:199 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.827+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 72 ==== osd_op_reply(199 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.827+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.831 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.827+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:200 6.9 6:921ecdb1:gc::gc.25:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8719080 con 0x5644a86c8590 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.827+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 73 ==== osd_op_reply(200 gc.25 [call out=24b] v0'0 uv58 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.827+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:201 6.9 6:921ecdb1:gc::gc.25:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.828+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 74 ==== osd_op_reply(201 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.828+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.828+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:202 6.9 6:921ecdb1:gc::gc.25:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.828+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 75 ==== osd_op_reply(202 gc.25 [call out=15b] v0'0 uv58 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.828+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.828+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:203 6.9 6:921ecdb1:gc::gc.25:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c8590 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.829+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 76 ==== osd_op_reply(203 gc.25 [call] v37'59 uv59 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.829+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=26, max_secs=3600, expired_only=0 2024-09-19T11:16:49.832 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.829+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:204 6.1f 6:fde4dd55:gc::gc.26:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a871a090 con 0x5644a86c3bc0 2024-09-19T11:16:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.830+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 39 ==== osd_op_reply(204 gc.26 [call] v37'34 uv34 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.830+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:205 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.830+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 40 ==== osd_op_reply(205 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.830+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.830+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:206 6.1f 6:fde4dd55:gc::gc.26:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c3bc0 2024-09-19T11:16:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.831+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 41 ==== osd_op_reply(206 gc.26 [call out=24b] v0'0 uv34 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.834 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.831+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:207 6.1f 6:fde4dd55:gc::gc.26:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.831+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 42 ==== osd_op_reply(207 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.831+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.831+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:208 6.1f 6:fde4dd55:gc::gc.26:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.832+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 43 ==== osd_op_reply(208 gc.26 [call out=15b] v0'0 uv34 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.832+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.835 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.832+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:209 6.1f 6:fde4dd55:gc::gc.26:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.833+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 44 ==== osd_op_reply(209 gc.26 [call] v37'35 uv35 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.833+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=27, max_secs=3600, expired_only=0 2024-09-19T11:16:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.833+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:210 6.1a 6:5909e671:gc::gc.27:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.834+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 77 ==== osd_op_reply(210 gc.27 [call] v37'36 uv36 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.834+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:211 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.834+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 78 ==== osd_op_reply(211 gc.27 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.834+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.837 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.834+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:212 6.1a 6:5909e671:gc::gc.27:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c8590 2024-09-19T11:16:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.834+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 79 ==== osd_op_reply(212 gc.27 [call out=24b] v0'0 uv36 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.834+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:213 6.1a 6:5909e671:gc::gc.27:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.835+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 80 ==== osd_op_reply(213 gc.27 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.835+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.835+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:214 6.1a 6:5909e671:gc::gc.27:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.835+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 81 ==== osd_op_reply(214 gc.27 [call out=15b] v0'0 uv36 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.835+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.838 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.835+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:215 6.1a 6:5909e671:gc::gc.27:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.836+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 82 ==== osd_op_reply(215 gc.27 [call] v37'37 uv37 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.836+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=28, max_secs=3600, expired_only=0 2024-09-19T11:16:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.836+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:216 6.1d 6:b88e3271:gc::gc.28:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.837+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 45 ==== osd_op_reply(216 gc.28 [call] v37'60 uv60 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.837+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:217 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.837+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 46 ==== osd_op_reply(217 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.837+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.840 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.837+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:218 6.1d 6:b88e3271:gc::gc.28:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c3bc0 2024-09-19T11:16:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.837+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 47 ==== osd_op_reply(218 gc.28 [call out=24b] v0'0 uv60 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.837+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:219 6.1d 6:b88e3271:gc::gc.28:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.838+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 48 ==== osd_op_reply(219 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.838+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.838+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:220 6.1d 6:b88e3271:gc::gc.28:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.838+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 49 ==== osd_op_reply(220 gc.28 [call out=15b] v0'0 uv60 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.838+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.841 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.838+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:221 6.1d 6:b88e3271:gc::gc.28:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.839+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 50 ==== osd_op_reply(221 gc.28 [call] v37'61 uv61 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.839+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=29, max_secs=3600, expired_only=0 2024-09-19T11:16:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.839+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:222 6.7 6:e47c9322:gc::gc.29:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.840+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 83 ==== osd_op_reply(222 gc.29 [call] v37'84 uv84 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.843 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.840+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:223 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.840+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 84 ==== osd_op_reply(223 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.840+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.840+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:224 6.7 6:e47c9322:gc::gc.29:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c8590 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.841+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 85 ==== osd_op_reply(224 gc.29 [call out=24b] v0'0 uv84 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.841+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:225 6.7 6:e47c9322:gc::gc.29:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.841+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 86 ==== osd_op_reply(225 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.841+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.841+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:226 6.7 6:e47c9322:gc::gc.29:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.841+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 87 ==== osd_op_reply(226 gc.29 [call out=15b] v0'0 uv84 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.841+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.844 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.841+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:227 6.7 6:e47c9322:gc::gc.29:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.842+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 88 ==== osd_op_reply(227 gc.29 [call] v37'85 uv85 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.842+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=30, max_secs=3600, expired_only=0 2024-09-19T11:16:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.842+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:228 6.0 6:013d6c33:gc::gc.30:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.843+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 51 ==== osd_op_reply(228 gc.30 [call] v37'68 uv68 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.843+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:229 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.846 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.843+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 52 ==== osd_op_reply(229 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.843+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.843+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:230 6.0 6:013d6c33:gc::gc.30:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c3bc0 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.844+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 53 ==== osd_op_reply(230 gc.30 [call out=24b] v0'0 uv68 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.844+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:231 6.0 6:013d6c33:gc::gc.30:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.844+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 54 ==== osd_op_reply(231 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.844+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.844+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:232 6.0 6:013d6c33:gc::gc.30:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.844+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 55 ==== osd_op_reply(232 gc.30 [call out=15b] v0'0 uv68 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.844+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.847 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.844+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:233 6.0 6:013d6c33:gc::gc.30:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.845+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 56 ==== osd_op_reply(233 gc.30 [call] v37'69 uv69 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.845+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=31, max_secs=3600, expired_only=0 2024-09-19T11:16:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.845+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:234 6.f 6:f24cb4a8:gc::gc.31:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.846+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 44 ==== osd_op_reply(234 gc.31 [call] v37'38 uv38 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.848 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.846+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:235 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 45 ==== osd_op_reply(235 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:236 6.f 6:f24cb4a8:gc::gc.31:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x7fc2f0069040 2024-09-19T11:16:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 46 ==== osd_op_reply(236 gc.31 [call out=24b] v0'0 uv38 ondisk = 0) ==== 149+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:237 6.f 6:f24cb4a8:gc::gc.31:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.850 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 47 ==== osd_op_reply(237 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:238 6.f 6:f24cb4a8:gc::gc.31:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 48 ==== osd_op_reply(238 gc.31 [call out=15b] v0'0 uv38 ondisk = 0) ==== 149+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.847+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:239 6.f 6:f24cb4a8:gc::gc.31:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.851 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.849+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 49 ==== osd_op_reply(239 gc.31 [call] v37'39 uv39 ondisk = 0) ==== 149+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.849+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=0, max_secs=3600, expired_only=0 2024-09-19T11:16:49.852 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.849+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:240 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.850+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 47 ==== osd_op_reply(240 gc.0 [call] v37'38 uv38 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.850+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:241 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.850+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 48 ==== osd_op_reply(241 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.853 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.850+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.850+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:242 6.19 6:9a6dd8c0:gc::gc.0:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86bf5a0 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.851+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 49 ==== osd_op_reply(242 gc.0 [call out=24b] v0'0 uv38 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.851+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:243 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.851+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 50 ==== osd_op_reply(243 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.851+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.851+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:244 6.19 6:9a6dd8c0:gc::gc.0:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.851+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 51 ==== osd_op_reply(244 gc.0 [call out=15b] v0'0 uv38 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.851+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.854 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.851+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:245 6.19 6:9a6dd8c0:gc::gc.0:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.852+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 52 ==== osd_op_reply(245 gc.0 [call] v37'39 uv39 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.852+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=1, max_secs=3600, expired_only=0 2024-09-19T11:16:49.855 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.852+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:246 6.18 6:1e85421f:gc::gc.1:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.856 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.853+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 57 ==== osd_op_reply(246 gc.1 [call] v37'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.853+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:247 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 58 ==== osd_op_reply(247 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:248 6.18 6:1e85421f:gc::gc.1:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 59 ==== osd_op_reply(248 gc.1 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:249 6.18 6:1e85421f:gc::gc.1:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 60 ==== osd_op_reply(249 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:250 6.18 6:1e85421f:gc::gc.1:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.854+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 61 ==== osd_op_reply(250 gc.1 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.857 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.855+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.858 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.855+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:251 6.18 6:1e85421f:gc::gc.1:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.859 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.855+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 62 ==== osd_op_reply(251 gc.1 [call] v37'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.855+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=2, max_secs=3600, expired_only=0 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.855+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:252 6.b 6:d242335b:gc::gc.2:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.856+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 89 ==== osd_op_reply(252 gc.2 [call] v37'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.856+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:253 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.857+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 90 ==== osd_op_reply(253 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.857+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.857+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:254 6.b 6:d242335b:gc::gc.2:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c8590 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.857+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 91 ==== osd_op_reply(254 gc.2 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.857+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:255 6.b 6:d242335b:gc::gc.2:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.857+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 92 ==== osd_op_reply(255 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.860 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.857+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.857+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:256 6.b 6:d242335b:gc::gc.2:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.858+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 93 ==== osd_op_reply(256 gc.2 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.858+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.861 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.858+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:257 6.b 6:d242335b:gc::gc.2:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.862 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.858+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 94 ==== osd_op_reply(257 gc.2 [call] v37'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.858+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=3, max_secs=3600, expired_only=0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.858+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:258 6.4 6:2166d8e1:gc::gc.3:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.859+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 53 ==== osd_op_reply(258 gc.3 [call] v37'282 uv282 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.859+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:259 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 54 ==== osd_op_reply(259 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:260 6.4 6:2166d8e1:gc::gc.3:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86bf5a0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 55 ==== osd_op_reply(260 gc.3 [call out=24b] v0'0 uv282 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:261 6.4 6:2166d8e1:gc::gc.3:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 56 ==== osd_op_reply(261 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.863 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:262 6.4 6:2166d8e1:gc::gc.3:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 57 ==== osd_op_reply(262 gc.3 [call out=15b] v0'0 uv282 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.864 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.860+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:263 6.4 6:2166d8e1:gc::gc.3:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.861+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 58 ==== osd_op_reply(263 gc.3 [call] v37'283 uv283 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.861+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=4, max_secs=3600, expired_only=0 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.861+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:264 6.3 6:c60da066:gc::gc.4:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.862+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 50 ==== osd_op_reply(264 gc.4 [call] v37'90 uv90 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.862+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:265 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.862+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 51 ==== osd_op_reply(265 gc.4 [call out=15b] v0'0 uv90 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.862+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.862+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:266 6.3 6:c60da066:gc::gc.4:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x7fc2f0069040 2024-09-19T11:16:49.866 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.863+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 52 ==== osd_op_reply(266 gc.4 [call out=24b] v0'0 uv90 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.863+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:267 6.3 6:c60da066:gc::gc.4:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.863+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 53 ==== osd_op_reply(267 gc.4 [call out=15b] v0'0 uv90 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.863+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.863+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:268 6.3 6:c60da066:gc::gc.4:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.863+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 54 ==== osd_op_reply(268 gc.4 [call out=15b] v0'0 uv90 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.863+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.863+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:269 6.3 6:c60da066:gc::gc.4:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.864+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 55 ==== osd_op_reply(269 gc.4 [call] v37'91 uv91 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.864+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=5, max_secs=3600, expired_only=0 2024-09-19T11:16:49.867 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.864+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:270 6.9 6:954be8d2:gc::gc.5:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.865+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 95 ==== osd_op_reply(270 gc.5 [call] v37'60 uv60 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.865+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:271 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.865+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 96 ==== osd_op_reply(271 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.865+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.865+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:272 6.9 6:954be8d2:gc::gc.5:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c8590 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.865+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 97 ==== osd_op_reply(272 gc.5 [call out=24b] v0'0 uv60 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.865+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:273 6.9 6:954be8d2:gc::gc.5:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.866+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 98 ==== osd_op_reply(273 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.869 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.866+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.866+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:274 6.9 6:954be8d2:gc::gc.5:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.866+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 99 ==== osd_op_reply(274 gc.5 [call out=15b] v0'0 uv60 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.866+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.866+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:275 6.9 6:954be8d2:gc::gc.5:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c8590 2024-09-19T11:16:49.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.867+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 100 ==== osd_op_reply(275 gc.5 [call] v37'61 uv61 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.867+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=6, max_secs=3600, expired_only=0 2024-09-19T11:16:49.870 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.867+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:276 6.e 6:748722ff:gc::gc.6:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.868+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 59 ==== osd_op_reply(276 gc.6 [call] v37'34 uv34 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.868+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:277 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.868+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 60 ==== osd_op_reply(277 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.868+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.868+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:278 6.e 6:748722ff:gc::gc.6:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86bf5a0 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.868+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 61 ==== osd_op_reply(278 gc.6 [call out=24b] v0'0 uv34 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.868+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:279 6.e 6:748722ff:gc::gc.6:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.869+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 62 ==== osd_op_reply(279 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.869+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.872 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.869+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:280 6.e 6:748722ff:gc::gc.6:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.869+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 63 ==== osd_op_reply(280 gc.6 [call out=15b] v0'0 uv34 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.869+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.869+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:281 6.e 6:748722ff:gc::gc.6:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86bf5a0 2024-09-19T11:16:49.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.870+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 64 ==== osd_op_reply(281 gc.6 [call] v37'35 uv35 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.870+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=7, max_secs=3600, expired_only=0 2024-09-19T11:16:49.873 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.870+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:282 6.1d 6:beaa4be4:gc::gc.7:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.871+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 63 ==== osd_op_reply(282 gc.7 [call] v37'62 uv62 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.871+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:283 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.874 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.871+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 64 ==== osd_op_reply(283 gc.7 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.871+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.871+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:284 6.1d 6:beaa4be4:gc::gc.7:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x5644a86c3bc0 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.872+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 65 ==== osd_op_reply(284 gc.7 [call out=24b] v0'0 uv62 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.872+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:285 6.1d 6:beaa4be4:gc::gc.7:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.872+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 66 ==== osd_op_reply(285 gc.7 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.872+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.872+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:286 6.1d 6:beaa4be4:gc::gc.7:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.872+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 67 ==== osd_op_reply(286 gc.7 [call out=15b] v0'0 uv62 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.872+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.875 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.872+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:287 6.1d 6:beaa4be4:gc::gc.7:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x5644a86c3bc0 2024-09-19T11:16:49.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.873+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 68 ==== osd_op_reply(287 gc.7 [call] v37'63 uv63 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.873+0000 7fc301140800 20 garbage collection: RGWGC::process entered with GC index_shard=8, max_secs=3600, expired_only=0 2024-09-19T11:16:49.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.873+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:288 6.12 6:4f78e9a2:gc::gc.8:head [call lock.lock in=50b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.874+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 56 ==== osd_op_reply(288 gc.8 [call] v37'32 uv32 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.874+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:289 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.874+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 57 ==== osd_op_reply(289 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.874+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned with returned:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.877 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.874+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:290 6.12 6:4f78e9a2:gc::gc.8:head [call version.read in=11b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8713f50 con 0x7fc2f0069040 2024-09-19T11:16:49.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.874+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 58 ==== osd_op_reply(290 gc.8 [call out=24b] v0'0 uv32 ondisk = 0) ==== 148+0+24 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.874+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:291 6.12 6:4f78e9a2:gc::gc.8:head [call rgw.gc_list in=25b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.875+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 59 ==== osd_op_reply(291 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.875+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_list returned NO non expired entries, so setting cache entry to TRUE 2024-09-19T11:16:49.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.875+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:292 6.12 6:4f78e9a2:gc::gc.8:head [call rgw_gc.rgw_gc_queue_list_entries in=46b] snapc 0=[] ondisk+read+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.875+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 60 ==== osd_op_reply(292 gc.8 [call out=15b] v0'0 uv32 ondisk = 0) ==== 148+0+15 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.875+0000 7fc301140800 20 garbage collection: RGWGC::process cls_rgw_gc_queue_list_entries returned with return value:0, entries.size=0, truncated=0, next_marker='' 2024-09-19T11:16:49.878 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.875+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:293 6.12 6:4f78e9a2:gc::gc.8:head [call lock.unlock in=34b] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a8714f60 con 0x7fc2f0069040 2024-09-19T11:16:49.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.876+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 61 ==== osd_op_reply(293 gc.8 [call] v37'33 uv33 ondisk = 0) ==== 148+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.877+0000 7fc1b2fe5640 2 rgw data changes log: RGWDataChangesLog::ChangesRenewThread: start 2024-09-19T11:16:49.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.877+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:294 6.4 6:22d26bf9:::data_loggenerations_metadata:head [watch unwatch cookie 94852883491200] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86dd940 con 0x5644a86bf5a0 2024-09-19T11:16:49.879 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.878+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 65 ==== osd_op_reply(294 data_loggenerations_metadata [watch unwatch cookie 94852883491200] v37'284 uv1 ondisk = 0) ==== 172+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.880 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.878+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:295 7.1f 7:f95f44c2:::notify.0:head [watch unwatch cookie 94852883466464] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d2950 con 0x7fc2f0069040 2024-09-19T11:16:49.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.879+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 62 ==== osd_op_reply(295 notify.0 [watch unwatch cookie 94852883466464] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.879+0000 7fc301140800 20 remove_watcher() i=0 2024-09-19T11:16:49.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.879+0000 7fc301140800 2 removed watcher, disabling cache 2024-09-19T11:16:49.881 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.879+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:296 7.0 7:05bf5b68:::notify.1:head [watch unwatch cookie 94852883471168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cc7d0 con 0x5644a86bf5a0 2024-09-19T11:16:49.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.880+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 66 ==== osd_op_reply(296 notify.1 [watch unwatch cookie 94852883471168] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.880+0000 7fc301140800 20 remove_watcher() i=1 2024-09-19T11:16:49.882 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.880+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- osd_op(unknown.0.0:297 7.15 7:a93a5511:::notify.2:head [watch unwatch cookie 94852883463984] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cdb40 con 0x5644a86c8590 2024-09-19T11:16:49.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.881+0000 7fc2fc685640 1 -- 172.21.15.102:0/574085329 <== osd.3 v2:172.21.15.102:6800/3957239017 101 ==== osd_op_reply(297 notify.2 [watch unwatch cookie 94852883463984] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f0057030 con 0x5644a86c8590 2024-09-19T11:16:49.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.881+0000 7fc301140800 20 remove_watcher() i=2 2024-09-19T11:16:49.883 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.881+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- osd_op(unknown.0.0:298 7.e 7:7759931f:::notify.3:head [watch unwatch cookie 94852883478128] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cbf30 con 0x7fc2f0069040 2024-09-19T11:16:49.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.882+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.2 v2:172.21.15.102:6808/525557096 63 ==== osd_op_reply(298 notify.3 [watch unwatch cookie 94852883478128] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x7fc2f0069040 2024-09-19T11:16:49.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.882+0000 7fc301140800 20 remove_watcher() i=3 2024-09-19T11:16:49.884 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.882+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- osd_op(unknown.0.0:299 7.d 7:b4812045:::notify.4:head [watch unwatch cookie 94852883482368] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cbf30 con 0x5644a86bf5a0 2024-09-19T11:16:49.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.883+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 <== osd.1 v2:172.21.15.102:6816/3609322588 67 ==== osd_op_reply(299 notify.4 [watch unwatch cookie 94852883482368] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2f4036040 con 0x5644a86bf5a0 2024-09-19T11:16:49.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.883+0000 7fc301140800 20 remove_watcher() i=4 2024-09-19T11:16:49.885 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.883+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:300 7.3 7:c609908c:::notify.5:head [watch unwatch cookie 94852883476048] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d0700 con 0x5644a86c3bc0 2024-09-19T11:16:49.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.884+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 69 ==== osd_op_reply(300 notify.5 [watch unwatch cookie 94852883476048] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.884+0000 7fc301140800 20 remove_watcher() i=5 2024-09-19T11:16:49.886 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.884+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:301 7.14 7:2b04a3e9:::notify.6:head [watch unwatch cookie 94852883485040] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86cbf30 con 0x5644a86c3bc0 2024-09-19T11:16:49.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.885+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 70 ==== osd_op_reply(301 notify.6 [watch unwatch cookie 94852883485040] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.885+0000 7fc301140800 20 remove_watcher() i=6 2024-09-19T11:16:49.887 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.885+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- osd_op(unknown.0.0:302 7.9 7:93e5b521:::notify.7:head [watch unwatch cookie 94852883487168] snapc 0=[] ondisk+write+known_if_redirected+supports_pool_eio e37) -- 0x5644a86d1170 con 0x5644a86c3bc0 2024-09-19T11:16:49.890 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.886+0000 7fc2fce86640 1 -- 172.21.15.102:0/574085329 <== osd.0 v2:172.21.15.37:6800/394652614 71 ==== osd_op_reply(302 notify.7 [watch unwatch cookie 94852883487168] v37'285 uv283 ondisk = 0) ==== 152+0+0 (crc 0 0 0) 0x7fc2ec067070 con 0x5644a86c3bc0 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.886+0000 7fc301140800 20 remove_watcher() i=7 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.886+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a86c3bc0 msgr2=0x5644a86c5fb0 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.886+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a86c3bc0 0x5644a86c5fb0 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.886+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a86bf5a0 msgr2=0x5644a86c1a30 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.886+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a86bf5a0 0x5644a86c1a30 crc :-1 s=READY pgs=205 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc2f0069040 msgr2=0x7fc2f006a940 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fc2f0069040 0x7fc2f006a940 crc :-1 s=READY pgs=105 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a86c8590 msgr2=0x5644a86caa50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a86c8590 0x5644a86caa50 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1c803d000 msgr2=0x7fc1c803f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.891 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1c803d000 0x7fc1c803f4c0 secure :-1 s=READY pgs=355 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0000c00 tx=0x7fc2f006d040 comp rx=0 tx=0).stop 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 msgr2=0x5644a86b3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86b3fa0 secure :-1 s=READY pgs=849 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec026780 tx=0x7fc2ec04c080 comp rx=0 tx=0).stop 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc2fd687640 1 -- 172.21.15.102:0/574085329 reap_dead start 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 shutdown_connections 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/574085329 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86acb60 0x5644a86b3fa0 unknown :-1 s=CLOSED pgs=849 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 >> 172.21.15.102:0/574085329 conn(0x5644a86a8f60 msgr2=0x5644a86a7170 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 shutdown_connections 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/574085329 wait complete. 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/2824163813 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1d403d000 msgr2=0x7fc1d403f4c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/2824163813 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1d403d000 0x7fc1d403f4c0 secure :-1 s=READY pgs=354 cs=0 l=1 rev1=1 crypto rx=0x5644a868abe0 tx=0x7fc2f0005ac0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/2824163813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86a0440 msgr2=0x5644a86a0860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.892 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/2824163813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86a0440 0x5644a86a0860 secure :-1 s=READY pgs=847 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec052a50 tx=0x7fc2ec01e7c0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/2824163813 shutdown_connections 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/2824163813 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1d403d000 0x7fc1d403f4c0 unknown :-1 s=CLOSED pgs=354 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 --2- 172.21.15.102:0/2824163813 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a86a0440 0x5644a86a0860 unknown :-1 s=CLOSED pgs=847 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/2824163813 >> 172.21.15.102:0/2824163813 conn(0x5644a86947f0 msgr2=0x5644a8694bd0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/2824163813 shutdown_connections 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.887+0000 7fc301140800 1 -- 172.21.15.102:0/2824163813 wait complete. 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a868baf0 msgr2=0x5644a868df70 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x5644a868baf0 0x5644a868df70 crc :-1 s=READY pgs=199 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a8588870 msgr2=0x5644a8689710 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x5644a8588870 0x5644a8689710 crc :-1 s=READY pgs=204 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a868fb60 msgr2=0x5644a8691f50 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x5644a868fb60 0x5644a8691f50 crc :-1 s=READY pgs=200 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:49.893 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1e403d050 msgr2=0x7fc1e403f510 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fc1e403d050 0x7fc1e403f510 secure :-1 s=READY pgs=353 cs=0 l=1 rev1=1 crypto rx=0x7fc2f0057000 tx=0x7fc2f0052000 comp rx=0 tx=0).stop 2024-09-19T11:16:49.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 msgr2=0x5644a86820c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:49.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 --2- 172.21.15.102:0/274189560 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x5644a8586d50 0x5644a86820c0 secure :-1 s=READY pgs=846 cs=0 l=1 rev1=1 crypto rx=0x7fc2ec000f80 tx=0x7fc2ec001250 comp rx=0 tx=0).stop 2024-09-19T11:16:49.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc2fd687640 1 -- 172.21.15.102:0/274189560 reap_dead start 2024-09-19T11:16:49.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 shutdown_connections 2024-09-19T11:16:49.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 >> 172.21.15.102:0/274189560 conn(0x5644a8582a60 msgr2=0x5644a867ba40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:49.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 shutdown_connections 2024-09-19T11:16:49.894 INFO:teuthology.orchestra.run.smithi102.stderr:2024-09-19T11:16:49.888+0000 7fc301140800 1 -- 172.21.15.102:0/274189560 wait complete. 2024-09-19T11:16:49.898 DEBUG:teuthology.run_tasks:Unwinding manager ceph 2024-09-19T11:16:49.907 INFO:tasks.ceph.ceph_manager.ceph:waiting for clean 2024-09-19T11:16:49.908 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:16:50.014 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.012+0000 7fe04009b640 1 Processor -- start 2024-09-19T11:16:50.015 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe04009b640 1 -- start start 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe04009b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe03809bb80 0x7fe038097190 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe04009b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fe03809bf60 con 0x7fe0380976d0 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe04009b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fe038099bc0 con 0x7fe03809bb80 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe03de37640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fe03809bb80 0x7fe038097190 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe03d636640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fe0380976d0 0x7fe038133db0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57642/0 (socket says 172.21.15.37:57642) 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe03d636640 1 -- 172.21.15.37:0/2779557913 learned_addr learned my addr 172.21.15.37:0/2779557913 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe03de37640 1 -- 172.21.15.37:0/2779557913 >> v1:172.21.15.37:6789/0 conn(0x7fe0380976d0 legacy=0x7fe038133db0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe03de37640 1 -- 172.21.15.37:0/2779557913 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe038097b40 con 0x7fe03809bb80 2024-09-19T11:16:50.016 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.013+0000 7fe03ce35640 1 -- 172.21.15.37:0/2779557913 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2677333165 0 0) 0x7fe03809bf60 con 0x7fe0380976d0 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.014+0000 7fe03de37640 1 --2- 172.21.15.37:0/2779557913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03809bb80 0x7fe038097190 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe034009720 tx=0x7fe03402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e3d01e6ed9bf1341 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.014+0000 7fe03ce35640 1 -- 172.21.15.37:0/2779557913 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe034037070 con 0x7fe03809bb80 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.014+0000 7fe03ce35640 1 -- 172.21.15.37:0/2779557913 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe03402ad90 con 0x7fe03809bb80 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.014+0000 7fe03ce35640 1 -- 172.21.15.37:0/2779557913 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe034032590 con 0x7fe03809bb80 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.015+0000 7fe04009b640 1 -- 172.21.15.37:0/2779557913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03809bb80 msgr2=0x7fe038097190 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.015+0000 7fe04009b640 1 --2- 172.21.15.37:0/2779557913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03809bb80 0x7fe038097190 secure :-1 s=READY pgs=851 cs=0 l=1 rev1=1 crypto rx=0x7fe034009720 tx=0x7fe03402a110 comp rx=0 tx=0).stop 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.015+0000 7fe04009b640 1 -- 172.21.15.37:0/2779557913 shutdown_connections 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.015+0000 7fe04009b640 1 --2- 172.21.15.37:0/2779557913 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe03809bb80 0x7fe038097190 unknown :-1 s=CLOSED pgs=851 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.015+0000 7fe04009b640 1 -- 172.21.15.37:0/2779557913 >> 172.21.15.37:0/2779557913 conn(0x7fe03809cb40 msgr2=0x7fe03809cf50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:50.018 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.015+0000 7fe04009b640 1 -- 172.21.15.37:0/2779557913 shutdown_connections 2024-09-19T11:16:50.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.015+0000 7fe04009b640 1 -- 172.21.15.37:0/2779557913 wait complete. 2024-09-19T11:16:50.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.016+0000 7fe04009b640 1 Processor -- start 2024-09-19T11:16:50.019 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.016+0000 7fe04009b640 1 -- start start 2024-09-19T11:16:50.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.016+0000 7fe04009b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380976d0 0x7fe038124ce0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.020 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.016+0000 7fe04009b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fe0381354d0 con 0x7fe0380976d0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.016+0000 7fe03de37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380976d0 0x7fe038124ce0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.016+0000 7fe03de37640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380976d0 0x7fe038124ce0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55078/0 (socket says 172.21.15.37:55078) 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.016+0000 7fe03de37640 1 -- 172.21.15.37:0/1838387554 learned_addr learned my addr 172.21.15.37:0/1838387554 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.017+0000 7fe03de37640 1 -- 172.21.15.37:0/1838387554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fe0381261e0 con 0x7fe0380976d0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.017+0000 7fe03de37640 1 --2- 172.21.15.37:0/1838387554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380976d0 0x7fe038124ce0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe034009720 tx=0x7fe0340046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.017+0000 7fe02e7fc640 1 -- 172.21.15.37:0/1838387554 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe034037040 con 0x7fe0380976d0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.017+0000 7fe02e7fc640 1 -- 172.21.15.37:0/1838387554 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fe034004160 con 0x7fe0380976d0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.017+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fe038099f90 con 0x7fe0380976d0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.017+0000 7fe02e7fc640 1 -- 172.21.15.37:0/1838387554 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fe034004440 con 0x7fe0380976d0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.017+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fe038095350 con 0x7fe0380976d0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.018+0000 7fe02e7fc640 1 -- 172.21.15.37:0/1838387554 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fe034003610 con 0x7fe0380976d0 2024-09-19T11:16:50.021 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.018+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fe038097190 con 0x7fe0380976d0 2024-09-19T11:16:50.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.018+0000 7fe02e7fc640 1 --2- 172.21.15.37:0/1838387554 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe01c03e710 0x7fe01c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.018+0000 7fe02e7fc640 1 -- 172.21.15.37:0/1838387554 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fe0340747d0 con 0x7fe0380976d0 2024-09-19T11:16:50.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.019+0000 7fe03d636640 1 --2- 172.21.15.37:0/1838387554 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe01c03e710 0x7fe01c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.022 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.019+0000 7fe03d636640 1 --2- 172.21.15.37:0/1838387554 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe01c03e710 0x7fe01c040bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe028000c00 tx=0x7fe028007a40 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.025 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.023+0000 7fe02e7fc640 1 -- 172.21.15.37:0/1838387554 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fe03403c3d0 con 0x7fe0380976d0 2024-09-19T11:16:50.209 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.207+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7fe038050ee0 con 0x7fe01c03e710 2024-09-19T11:16:50.220 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.218+0000 7fe02e7fc640 1 -- 172.21.15.37:0/1838387554 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666061 (secure 0 0 0) 0x7fe038050ee0 con 0x7fe01c03e710 2024-09-19T11:16:50.229 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:16:50.235 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:16:50.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe01c03e710 msgr2=0x7fe01c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 --2- 172.21.15.37:0/1838387554 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe01c03e710 0x7fe01c040bd0 secure :-1 s=READY pgs=356 cs=0 l=1 rev1=1 crypto rx=0x7fe028000c00 tx=0x7fe028007a40 comp rx=0 tx=0).stop 2024-09-19T11:16:50.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380976d0 msgr2=0x7fe038124ce0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 --2- 172.21.15.37:0/1838387554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380976d0 0x7fe038124ce0 secure :-1 s=READY pgs=852 cs=0 l=1 rev1=1 crypto rx=0x7fe034009720 tx=0x7fe0340046c0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 shutdown_connections 2024-09-19T11:16:50.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 --2- 172.21.15.37:0/1838387554 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fe01c03e710 0x7fe01c040bd0 unknown :-1 s=CLOSED pgs=356 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.238 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 --2- 172.21.15.37:0/1838387554 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fe0380976d0 0x7fe038124ce0 unknown :-1 s=CLOSED pgs=852 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 >> 172.21.15.37:0/1838387554 conn(0x7fe03809cb40 msgr2=0x7fe0380717d0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 shutdown_connections 2024-09-19T11:16:50.239 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.223+0000 7fe04009b640 1 -- 172.21.15.37:0/1838387554 wait complete. 2024-09-19T11:16:50.239 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-19T11:16:48.574198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416913,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4967,"num_read_kb":4505,"num_write":2052,"num_write_kb":60589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4436,"ondisk_log_size":4436,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182168,"kb_used_data":36632,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377305192,"statfs":{"total":386547056640,"available":386360516608,"internally_reserved":0,"allocated":37511168,"data_stored":36247610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":491,"num_write":388,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003988"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.894957+0000","last_change":"2024-09-19T11:13:31.355447+0000","last_active":"2024-09-19T11:15:41.894957+0000","last_peered":"2024-09-19T11:15:41.894957+0000","last_clean":"2024-09-19T11:15:41.894957+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:15:41.894957+0000","last_undegraded":"2024-09-19T11:15:41.894957+0000","last_fullsized":"2024-09-19T11:15:41.894957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:32:10.862799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114848+0000","last_change":"2024-09-19T11:13:33.358262+0000","last_active":"2024-09-19T11:14:58.114848+0000","last_peered":"2024-09-19T11:14:58.114848+0000","last_clean":"2024-09-19T11:14:58.114848+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:14:58.114848+0000","last_undegraded":"2024-09-19T11:14:58.114848+0000","last_fullsized":"2024-09-19T11:14:58.114848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:04.357110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589370+0000","last_change":"2024-09-19T11:13:31.378145+0000","last_active":"2024-09-19T11:14:07.589370+0000","last_peered":"2024-09-19T11:14:07.589370+0000","last_clean":"2024-09-19T11:14:07.589370+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:14:07.589370+0000","last_undegraded":"2024-09-19T11:14:07.589370+0000","last_fullsized":"2024-09-19T11:14:07.589370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.937182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.010386+0000","last_change":"2024-09-19T11:13:33.353250+0000","last_active":"2024-09-19T11:16:43.010386+0000","last_peered":"2024-09-19T11:16:43.010386+0000","last_clean":"2024-09-19T11:16:43.010386+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:16:43.010386+0000","last_undegraded":"2024-09-19T11:16:43.010386+0000","last_fullsized":"2024-09-19T11:16:43.010386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:36.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588134+0000","last_change":"2024-09-19T11:13:31.373399+0000","last_active":"2024-09-19T11:14:07.588134+0000","last_peered":"2024-09-19T11:14:07.588134+0000","last_clean":"2024-09-19T11:14:07.588134+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:14:07.588134+0000","last_undegraded":"2024-09-19T11:14:07.588134+0000","last_fullsized":"2024-09-19T11:14:07.588134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:37.878601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740541+0000","last_change":"2024-09-19T11:14:07.595868+0000","last_active":"2024-09-19T11:16:42.740541+0000","last_peered":"2024-09-19T11:16:42.740541+0000","last_clean":"2024-09-19T11:16:42.740541+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:16:42.740541+0000","last_undegraded":"2024-09-19T11:16:42.740541+0000","last_fullsized":"2024-09-19T11:16:42.740541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:59.387595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588085+0000","last_change":"2024-09-19T11:13:31.369527+0000","last_active":"2024-09-19T11:14:07.588085+0000","last_peered":"2024-09-19T11:14:07.588085+0000","last_clean":"2024-09-19T11:14:07.588085+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:14:07.588085+0000","last_undegraded":"2024-09-19T11:14:07.588085+0000","last_fullsized":"2024-09-19T11:14:07.588085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:42.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.965800+0000","last_change":"2024-09-19T11:13:33.349816+0000","last_active":"2024-09-19T11:16:42.965800+0000","last_peered":"2024-09-19T11:16:42.965800+0000","last_clean":"2024-09-19T11:16:42.965800+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:16:42.965800+0000","last_undegraded":"2024-09-19T11:16:42.965800+0000","last_fullsized":"2024-09-19T11:16:42.965800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:57.078087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586339+0000","last_change":"2024-09-19T11:13:31.373460+0000","last_active":"2024-09-19T11:14:07.586339+0000","last_peered":"2024-09-19T11:14:07.586339+0000","last_clean":"2024-09-19T11:14:07.586339+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:14:07.586339+0000","last_undegraded":"2024-09-19T11:14:07.586339+0000","last_fullsized":"2024-09-19T11:14:07.586339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:25.708826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003992+0000","last_change":"2024-09-19T11:13:33.347020+0000","last_active":"2024-09-19T11:16:43.003992+0000","last_peered":"2024-09-19T11:16:43.003992+0000","last_clean":"2024-09-19T11:16:43.003992+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:16:43.003992+0000","last_undegraded":"2024-09-19T11:16:43.003992+0000","last_fullsized":"2024-09-19T11:16:43.003992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:10.234097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588864+0000","last_change":"2024-09-19T11:13:31.359276+0000","last_active":"2024-09-19T11:14:07.588864+0000","last_peered":"2024-09-19T11:14:07.588864+0000","last_clean":"2024-09-19T11:14:07.588864+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:14:07.588864+0000","last_undegraded":"2024-09-19T11:14:07.588864+0000","last_fullsized":"2024-09-19T11:14:07.588864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.682041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'21","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:13.543344+0000","last_change":"2024-09-19T11:14:07.607174+0000","last_active":"2024-09-19T11:16:13.543344+0000","last_peered":"2024-09-19T11:16:13.543344+0000","last_clean":"2024-09-19T11:16:13.543344+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:16:13.543344+0000","last_undegraded":"2024-09-19T11:16:13.543344+0000","last_fullsized":"2024-09-19T11:16:13.543344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:02.443641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585495+0000","last_change":"2024-09-19T11:13:31.366931+0000","last_active":"2024-09-19T11:14:07.585495+0000","last_peered":"2024-09-19T11:14:07.585495+0000","last_clean":"2024-09-19T11:14:07.585495+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:14:07.585495+0000","last_undegraded":"2024-09-19T11:14:07.585495+0000","last_fullsized":"2024-09-19T11:14:07.585495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:34.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966174+0000","last_change":"2024-09-19T11:13:33.347406+0000","last_active":"2024-09-19T11:16:42.966174+0000","last_peered":"2024-09-19T11:16:42.966174+0000","last_clean":"2024-09-19T11:16:42.966174+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:16:42.966174+0000","last_undegraded":"2024-09-19T11:16:42.966174+0000","last_fullsized":"2024-09-19T11:16:42.966174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:53.972293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.853085+0000","last_change":"2024-09-19T11:13:31.364605+0000","last_active":"2024-09-19T11:15:41.853085+0000","last_peered":"2024-09-19T11:15:41.853085+0000","last_clean":"2024-09-19T11:15:41.853085+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:15:41.853085+0000","last_undegraded":"2024-09-19T11:15:41.853085+0000","last_fullsized":"2024-09-19T11:15:41.853085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:34.677119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:13:33.353995+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:03.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096691+0000","last_change":"2024-09-19T11:13:33.353058+0000","last_active":"2024-09-19T11:15:42.096691+0000","last_peered":"2024-09-19T11:15:42.096691+0000","last_clean":"2024-09-19T11:15:42.096691+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:15:42.096691+0000","last_undegraded":"2024-09-19T11:15:42.096691+0000","last_fullsized":"2024-09-19T11:15:42.096691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:02.922700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.597092+0000","last_change":"2024-09-19T11:13:31.365956+0000","last_active":"2024-09-19T11:14:07.597092+0000","last_peered":"2024-09-19T11:14:07.597092+0000","last_clean":"2024-09-19T11:14:07.597092+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:14:07.597092+0000","last_undegraded":"2024-09-19T11:14:07.597092+0000","last_fullsized":"2024-09-19T11:14:07.597092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:41.205308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594343+0000","last_change":"2024-09-19T11:13:33.357169+0000","last_active":"2024-09-19T11:14:07.594343+0000","last_peered":"2024-09-19T11:14:07.594343+0000","last_clean":"2024-09-19T11:14:07.594343+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:14:07.594343+0000","last_undegraded":"2024-09-19T11:14:07.594343+0000","last_fullsized":"2024-09-19T11:14:07.594343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.541252+0000","last_change":"2024-09-19T11:13:31.372373+0000","last_active":"2024-09-19T11:15:58.541252+0000","last_peered":"2024-09-19T11:15:58.541252+0000","last_clean":"2024-09-19T11:15:58.541252+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:15:58.541252+0000","last_undegraded":"2024-09-19T11:15:58.541252+0000","last_fullsized":"2024-09-19T11:15:58.541252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.073704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595274+0000","last_change":"2024-09-19T11:13:33.359507+0000","last_active":"2024-09-19T11:14:07.595274+0000","last_peered":"2024-09-19T11:14:07.595274+0000","last_clean":"2024-09-19T11:14:07.595274+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:14:07.595274+0000","last_undegraded":"2024-09-19T11:14:07.595274+0000","last_fullsized":"2024-09-19T11:14:07.595274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.272518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.103060+0000","last_change":"2024-09-19T11:13:31.365136+0000","last_active":"2024-09-19T11:14:58.103060+0000","last_peered":"2024-09-19T11:14:58.103060+0000","last_clean":"2024-09-19T11:14:58.103060+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:14:58.103060+0000","last_undegraded":"2024-09-19T11:14:58.103060+0000","last_fullsized":"2024-09-19T11:14:58.103060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.682041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966073+0000","last_change":"2024-09-19T11:13:33.350242+0000","last_active":"2024-09-19T11:16:42.966073+0000","last_peered":"2024-09-19T11:16:42.966073+0000","last_clean":"2024-09-19T11:16:42.966073+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:16:42.966073+0000","last_undegraded":"2024-09-19T11:16:42.966073+0000","last_fullsized":"2024-09-19T11:16:42.966073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:29.796543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595616+0000","last_change":"2024-09-19T11:13:31.364143+0000","last_active":"2024-09-19T11:14:07.595616+0000","last_peered":"2024-09-19T11:14:07.595616+0000","last_clean":"2024-09-19T11:14:07.595616+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:14:07.595616+0000","last_undegraded":"2024-09-19T11:14:07.595616+0000","last_fullsized":"2024-09-19T11:14:07.595616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:37.328576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004192+0000","last_change":"2024-09-19T11:13:33.354404+0000","last_active":"2024-09-19T11:16:43.004192+0000","last_peered":"2024-09-19T11:16:43.004192+0000","last_clean":"2024-09-19T11:16:43.004192+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:16:43.004192+0000","last_undegraded":"2024-09-19T11:16:43.004192+0000","last_fullsized":"2024-09-19T11:16:43.004192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.704309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.524833+0000","last_change":"2024-09-19T11:13:31.379619+0000","last_active":"2024-09-19T11:14:14.524833+0000","last_peered":"2024-09-19T11:14:14.524833+0000","last_clean":"2024-09-19T11:14:14.524833+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:14:14.524833+0000","last_undegraded":"2024-09-19T11:14:14.524833+0000","last_fullsized":"2024-09-19T11:14:14.524833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:44.219899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380970+0000","last_change":"2024-09-19T11:13:33.345480+0000","last_active":"2024-09-19T11:14:15.380970+0000","last_peered":"2024-09-19T11:14:15.380970+0000","last_clean":"2024-09-19T11:14:15.380970+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:14:15.380970+0000","last_undegraded":"2024-09-19T11:14:15.380970+0000","last_fullsized":"2024-09-19T11:14:15.380970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:37.629627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585477+0000","last_change":"2024-09-19T11:13:31.368987+0000","last_active":"2024-09-19T11:14:07.585477+0000","last_peered":"2024-09-19T11:14:07.585477+0000","last_clean":"2024-09-19T11:14:07.585477+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:14:07.585477+0000","last_undegraded":"2024-09-19T11:14:07.585477+0000","last_fullsized":"2024-09-19T11:14:07.585477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:51.462004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.938013+0000","last_change":"2024-09-19T11:13:41.395109+0000","last_active":"2024-09-19T11:16:42.938013+0000","last_peered":"2024-09-19T11:16:42.938013+0000","last_clean":"2024-09-19T11:16:42.938013+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:16:42.938013+0000","last_undegraded":"2024-09-19T11:16:42.938013+0000","last_fullsized":"2024-09-19T11:16:42.938013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:41.943528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.635691+0000","last_change":"2024-09-19T11:13:33.348565+0000","last_active":"2024-09-19T11:16:42.635691+0000","last_peered":"2024-09-19T11:16:42.635691+0000","last_clean":"2024-09-19T11:16:42.635691+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:16:42.635691+0000","last_undegraded":"2024-09-19T11:16:42.635691+0000","last_fullsized":"2024-09-19T11:16:42.635691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:09.744080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585089+0000","last_change":"2024-09-19T11:13:31.378052+0000","last_active":"2024-09-19T11:14:07.585089+0000","last_peered":"2024-09-19T11:14:07.585089+0000","last_clean":"2024-09-19T11:14:07.585089+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:14:07.585089+0000","last_undegraded":"2024-09-19T11:14:07.585089+0000","last_fullsized":"2024-09-19T11:14:07.585089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:57.883105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586243+0000","last_change":"2024-09-19T11:13:35.358078+0000","last_active":"2024-09-19T11:14:07.586243+0000","last_peered":"2024-09-19T11:14:07.586243+0000","last_clean":"2024-09-19T11:14:07.586243+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:14:07.586243+0000","last_undegraded":"2024-09-19T11:14:07.586243+0000","last_fullsized":"2024-09-19T11:14:07.586243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:59.783214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.344946+0000","last_change":"2024-09-19T11:13:37.368405+0000","last_active":"2024-09-19T11:15:40.344946+0000","last_peered":"2024-09-19T11:15:40.344946+0000","last_clean":"2024-09-19T11:15:40.344946+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:15:40.344946+0000","last_undegraded":"2024-09-19T11:15:40.344946+0000","last_fullsized":"2024-09-19T11:15:40.344946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:09.867739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596623+0000","last_change":"2024-09-19T11:13:39.376399+0000","last_active":"2024-09-19T11:14:07.596623+0000","last_peered":"2024-09-19T11:14:07.596623+0000","last_clean":"2024-09-19T11:14:07.596623+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:14:07.596623+0000","last_undegraded":"2024-09-19T11:14:07.596623+0000","last_fullsized":"2024-09-19T11:14:07.596623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:16.668274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.935993+0000","last_change":"2024-09-19T11:13:41.393295+0000","last_active":"2024-09-19T11:14:57.935993+0000","last_peered":"2024-09-19T11:14:57.935993+0000","last_clean":"2024-09-19T11:14:57.935993+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:14:57.935993+0000","last_undegraded":"2024-09-19T11:14:57.935993+0000","last_fullsized":"2024-09-19T11:14:57.935993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:48.199857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112515+0000","last_change":"2024-09-19T11:13:33.353288+0000","last_active":"2024-09-19T11:14:58.112515+0000","last_peered":"2024-09-19T11:14:58.112515+0000","last_clean":"2024-09-19T11:14:58.112515+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:14:58.112515+0000","last_undegraded":"2024-09-19T11:14:58.112515+0000","last_fullsized":"2024-09-19T11:14:58.112515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.684931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.037595+0000","last_change":"2024-09-19T11:13:31.359853+0000","last_active":"2024-09-19T11:15:42.037595+0000","last_peered":"2024-09-19T11:15:42.037595+0000","last_clean":"2024-09-19T11:15:42.037595+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:15:42.037595+0000","last_undegraded":"2024-09-19T11:15:42.037595+0000","last_fullsized":"2024-09-19T11:15:42.037595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:35.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586880+0000","last_change":"2024-09-19T11:13:35.350079+0000","last_active":"2024-09-19T11:14:07.586880+0000","last_peered":"2024-09-19T11:14:07.586880+0000","last_clean":"2024-09-19T11:14:07.586880+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:14:07.586880+0000","last_undegraded":"2024-09-19T11:14:07.586880+0000","last_fullsized":"2024-09-19T11:14:07.586880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:28.629336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596198+0000","last_change":"2024-09-19T11:13:37.365209+0000","last_active":"2024-09-19T11:14:07.596198+0000","last_peered":"2024-09-19T11:14:07.596198+0000","last_clean":"2024-09-19T11:14:07.596198+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:14:07.596198+0000","last_undegraded":"2024-09-19T11:14:07.596198+0000","last_fullsized":"2024-09-19T11:14:07.596198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:11.593458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595746+0000","last_change":"2024-09-19T11:13:39.377776+0000","last_active":"2024-09-19T11:14:07.595746+0000","last_peered":"2024-09-19T11:14:07.595746+0000","last_clean":"2024-09-19T11:14:07.595746+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:14:07.595746+0000","last_undegraded":"2024-09-19T11:14:07.595746+0000","last_fullsized":"2024-09-19T11:14:07.595746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:02.688553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586216+0000","last_change":"2024-09-19T11:13:41.387845+0000","last_active":"2024-09-19T11:14:07.586216+0000","last_peered":"2024-09-19T11:14:07.586216+0000","last_clean":"2024-09-19T11:14:07.586216+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:14:07.586216+0000","last_undegraded":"2024-09-19T11:14:07.586216+0000","last_fullsized":"2024-09-19T11:14:07.586216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:01.782452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004066+0000","last_change":"2024-09-19T11:13:33.354310+0000","last_active":"2024-09-19T11:16:43.004066+0000","last_peered":"2024-09-19T11:16:43.004066+0000","last_clean":"2024-09-19T11:16:43.004066+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:16:43.004066+0000","last_undegraded":"2024-09-19T11:16:43.004066+0000","last_fullsized":"2024-09-19T11:16:43.004066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.803193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584449+0000","last_change":"2024-09-19T11:13:31.367163+0000","last_active":"2024-09-19T11:14:07.584449+0000","last_peered":"2024-09-19T11:14:07.584449+0000","last_clean":"2024-09-19T11:14:07.584449+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:14:07.584449+0000","last_undegraded":"2024-09-19T11:14:07.584449+0000","last_fullsized":"2024-09-19T11:14:07.584449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:05.930286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:08.524886+0000","last_change":"2024-09-19T11:14:07.594305+0000","last_active":"2024-09-19T11:14:08.524886+0000","last_peered":"2024-09-19T11:14:08.524886+0000","last_clean":"2024-09-19T11:14:08.524886+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:14:08.524886+0000","last_undegraded":"2024-09-19T11:14:08.524886+0000","last_fullsized":"2024-09-19T11:14:08.524886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:34.741293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587760+0000","last_change":"2024-09-19T11:13:37.365423+0000","last_active":"2024-09-19T11:14:07.587760+0000","last_peered":"2024-09-19T11:14:07.587760+0000","last_clean":"2024-09-19T11:14:07.587760+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:14:07.587760+0000","last_undegraded":"2024-09-19T11:14:07.587760+0000","last_fullsized":"2024-09-19T11:14:07.587760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:05.026614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":382,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437367+0000","last_change":"2024-09-19T11:13:39.380724+0000","last_active":"2024-09-19T11:16:40.437367+0000","last_peered":"2024-09-19T11:16:40.437367+0000","last_clean":"2024-09-19T11:16:40.437367+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:16:40.437367+0000","last_undegraded":"2024-09-19T11:16:40.437367+0000","last_fullsized":"2024-09-19T11:16:40.437367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587647+0000","last_change":"2024-09-19T11:13:41.387332+0000","last_active":"2024-09-19T11:14:07.587647+0000","last_peered":"2024-09-19T11:14:07.587647+0000","last_clean":"2024-09-19T11:14:07.587647+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:14:07.587647+0000","last_undegraded":"2024-09-19T11:14:07.587647+0000","last_fullsized":"2024-09-19T11:14:07.587647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:45.206952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740577+0000","last_change":"2024-09-19T11:13:33.349800+0000","last_active":"2024-09-19T11:16:42.740577+0000","last_peered":"2024-09-19T11:16:42.740577+0000","last_clean":"2024-09-19T11:16:42.740577+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:16:42.740577+0000","last_undegraded":"2024-09-19T11:16:42.740577+0000","last_fullsized":"2024-09-19T11:16:42.740577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.241186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.999172+0000","last_change":"2024-09-19T11:13:31.365771+0000","last_active":"2024-09-19T11:16:42.999172+0000","last_peered":"2024-09-19T11:16:42.999172+0000","last_clean":"2024-09-19T11:16:42.999172+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:42.999172+0000","last_undegraded":"2024-09-19T11:16:42.999172+0000","last_fullsized":"2024-09-19T11:16:42.999172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:03.270284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586260+0000","last_change":"2024-09-19T11:13:35.355473+0000","last_active":"2024-09-19T11:14:07.586260+0000","last_peered":"2024-09-19T11:14:07.586260+0000","last_clean":"2024-09-19T11:14:07.586260+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:14:07.586260+0000","last_undegraded":"2024-09-19T11:14:07.586260+0000","last_fullsized":"2024-09-19T11:14:07.586260+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:26.695828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.339270+0000","last_change":"2024-09-19T11:13:37.367406+0000","last_active":"2024-09-19T11:15:40.339270+0000","last_peered":"2024-09-19T11:15:40.339270+0000","last_clean":"2024-09-19T11:15:40.339270+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:15:40.339270+0000","last_undegraded":"2024-09-19T11:15:40.339270+0000","last_fullsized":"2024-09-19T11:15:40.339270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.650159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'282","reported_seq":442,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.007015+0000","last_change":"2024-09-19T11:13:39.380575+0000","last_active":"2024-09-19T11:16:43.007015+0000","last_peered":"2024-09-19T11:16:43.007015+0000","last_clean":"2024-09-19T11:16:43.007015+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:16:43.007015+0000","last_undegraded":"2024-09-19T11:16:43.007015+0000","last_fullsized":"2024-09-19T11:16:43.007015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:21.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898938+0000","last_change":"2024-09-19T11:13:33.354325+0000","last_active":"2024-09-19T11:16:42.898938+0000","last_peered":"2024-09-19T11:16:42.898938+0000","last_clean":"2024-09-19T11:16:42.898938+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:16:42.898938+0000","last_undegraded":"2024-09-19T11:16:42.898938+0000","last_fullsized":"2024-09-19T11:16:42.898938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:50.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.591224+0000","last_change":"2024-09-19T11:13:31.353600+0000","last_active":"2024-09-19T11:14:07.591224+0000","last_peered":"2024-09-19T11:14:07.591224+0000","last_clean":"2024-09-19T11:14:07.591224+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:14:07.591224+0000","last_undegraded":"2024-09-19T11:14:07.591224+0000","last_fullsized":"2024-09-19T11:14:07.591224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:09.178158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593431+0000","last_change":"2024-09-19T11:13:35.356693+0000","last_active":"2024-09-19T11:14:07.593431+0000","last_peered":"2024-09-19T11:14:07.593431+0000","last_clean":"2024-09-19T11:14:07.593431+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:14:07.593431+0000","last_undegraded":"2024-09-19T11:14:07.593431+0000","last_fullsized":"2024-09-19T11:14:07.593431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:50.222469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'40","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.348918+0000","last_change":"2024-09-19T11:13:37.371444+0000","last_active":"2024-09-19T11:15:40.348918+0000","last_peered":"2024-09-19T11:15:40.348918+0000","last_clean":"2024-09-19T11:15:40.348918+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:15:40.348918+0000","last_undegraded":"2024-09-19T11:15:40.348918+0000","last_fullsized":"2024-09-19T11:15:40.348918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:45.830373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587567+0000","last_change":"2024-09-19T11:13:39.374414+0000","last_active":"2024-09-19T11:14:07.587567+0000","last_peered":"2024-09-19T11:14:07.587567+0000","last_clean":"2024-09-19T11:14:07.587567+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:14:07.587567+0000","last_undegraded":"2024-09-19T11:14:07.587567+0000","last_fullsized":"2024-09-19T11:14:07.587567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:56.581253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.937677+0000","last_change":"2024-09-19T11:13:41.391613+0000","last_active":"2024-09-19T11:14:57.937677+0000","last_peered":"2024-09-19T11:14:57.937677+0000","last_clean":"2024-09-19T11:14:57.937677+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:14:57.937677+0000","last_undegraded":"2024-09-19T11:14:57.937677+0000","last_fullsized":"2024-09-19T11:14:57.937677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:05.344146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740320+0000","last_change":"2024-09-19T11:13:33.342412+0000","last_active":"2024-09-19T11:16:42.740320+0000","last_peered":"2024-09-19T11:16:42.740320+0000","last_clean":"2024-09-19T11:16:42.740320+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:16:42.740320+0000","last_undegraded":"2024-09-19T11:16:42.740320+0000","last_fullsized":"2024-09-19T11:16:42.740320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590222+0000","last_change":"2024-09-19T11:13:31.355731+0000","last_active":"2024-09-19T11:14:07.590222+0000","last_peered":"2024-09-19T11:14:07.590222+0000","last_clean":"2024-09-19T11:14:07.590222+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:14:07.590222+0000","last_undegraded":"2024-09-19T11:14:07.590222+0000","last_fullsized":"2024-09-19T11:14:07.590222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:05.006192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586420+0000","last_change":"2024-09-19T11:13:35.352067+0000","last_active":"2024-09-19T11:14:07.586420+0000","last_peered":"2024-09-19T11:14:07.586420+0000","last_clean":"2024-09-19T11:14:07.586420+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:14:07.586420+0000","last_undegraded":"2024-09-19T11:14:07.586420+0000","last_fullsized":"2024-09-19T11:14:07.586420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:58.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.329228+0000","last_change":"2024-09-19T11:13:37.369761+0000","last_active":"2024-09-19T11:15:40.329228+0000","last_peered":"2024-09-19T11:15:40.329228+0000","last_clean":"2024-09-19T11:15:40.329228+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:15:40.329228+0000","last_undegraded":"2024-09-19T11:15:40.329228+0000","last_fullsized":"2024-09-19T11:15:40.329228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.455607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587463+0000","last_change":"2024-09-19T11:13:39.381205+0000","last_active":"2024-09-19T11:14:07.587463+0000","last_peered":"2024-09-19T11:14:07.587463+0000","last_clean":"2024-09-19T11:14:07.587463+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:14:07.587463+0000","last_undegraded":"2024-09-19T11:14:07.587463+0000","last_fullsized":"2024-09-19T11:14:07.587463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:48.612042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:52.381729+0000","last_change":"2024-09-19T11:13:41.393002+0000","last_active":"2024-09-19T11:14:52.381729+0000","last_peered":"2024-09-19T11:14:52.381729+0000","last_clean":"2024-09-19T11:14:52.381729+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:14:52.381729+0000","last_undegraded":"2024-09-19T11:14:52.381729+0000","last_fullsized":"2024-09-19T11:14:52.381729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:23.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115156+0000","last_change":"2024-09-19T11:13:33.351582+0000","last_active":"2024-09-19T11:14:58.115156+0000","last_peered":"2024-09-19T11:14:58.115156+0000","last_clean":"2024-09-19T11:14:58.115156+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:14:58.115156+0000","last_undegraded":"2024-09-19T11:14:58.115156+0000","last_fullsized":"2024-09-19T11:14:58.115156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587814+0000","last_change":"2024-09-19T11:13:31.376937+0000","last_active":"2024-09-19T11:14:07.587814+0000","last_peered":"2024-09-19T11:14:07.587814+0000","last_clean":"2024-09-19T11:14:07.587814+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:14:07.587814+0000","last_undegraded":"2024-09-19T11:14:07.587814+0000","last_fullsized":"2024-09-19T11:14:07.587814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:00.098524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587259+0000","last_change":"2024-09-19T11:13:35.349926+0000","last_active":"2024-09-19T11:14:07.587259+0000","last_peered":"2024-09-19T11:14:07.587259+0000","last_clean":"2024-09-19T11:14:07.587259+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:14:07.587259+0000","last_undegraded":"2024-09-19T11:14:07.587259+0000","last_fullsized":"2024-09-19T11:14:07.587259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:43.037527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'37","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540038+0000","last_change":"2024-09-19T11:13:37.371294+0000","last_active":"2024-09-19T11:15:48.540038+0000","last_peered":"2024-09-19T11:15:48.540038+0000","last_clean":"2024-09-19T11:15:48.540038+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:15:48.540038+0000","last_undegraded":"2024-09-19T11:15:48.540038+0000","last_fullsized":"2024-09-19T11:15:48.540038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:44.761683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'282","reported_seq":349,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.280499+0000","last_change":"2024-09-19T11:13:39.381485+0000","last_active":"2024-09-19T11:16:43.280499+0000","last_peered":"2024-09-19T11:16:43.280499+0000","last_clean":"2024-09-19T11:16:43.280499+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:16:43.280499+0000","last_undegraded":"2024-09-19T11:16:43.280499+0000","last_fullsized":"2024-09-19T11:16:43.280499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:13.407016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.028397+0000","last_change":"2024-09-19T11:13:41.390450+0000","last_active":"2024-09-19T11:14:15.028397+0000","last_peered":"2024-09-19T11:14:15.028397+0000","last_clean":"2024-09-19T11:14:15.028397+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:14:15.028397+0000","last_undegraded":"2024-09-19T11:14:15.028397+0000","last_fullsized":"2024-09-19T11:14:15.028397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.925221+0000","last_change":"2024-09-19T11:13:33.346907+0000","last_active":"2024-09-19T11:14:57.925221+0000","last_peered":"2024-09-19T11:14:57.925221+0000","last_clean":"2024-09-19T11:14:57.925221+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:14:57.925221+0000","last_undegraded":"2024-09-19T11:14:57.925221+0000","last_fullsized":"2024-09-19T11:14:57.925221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:38.606989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585782+0000","last_change":"2024-09-19T11:13:31.373736+0000","last_active":"2024-09-19T11:14:07.585782+0000","last_peered":"2024-09-19T11:14:07.585782+0000","last_clean":"2024-09-19T11:14:07.585782+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:14:07.585782+0000","last_undegraded":"2024-09-19T11:14:07.585782+0000","last_fullsized":"2024-09-19T11:14:07.585782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:35.619254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586467+0000","last_change":"2024-09-19T11:13:35.353930+0000","last_active":"2024-09-19T11:14:07.586467+0000","last_peered":"2024-09-19T11:14:07.586467+0000","last_clean":"2024-09-19T11:14:07.586467+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:14:07.586467+0000","last_undegraded":"2024-09-19T11:14:07.586467+0000","last_fullsized":"2024-09-19T11:14:07.586467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:50.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'55","reported_seq":112,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.352655+0000","last_change":"2024-09-19T11:13:37.371428+0000","last_active":"2024-09-19T11:15:40.352655+0000","last_peered":"2024-09-19T11:15:40.352655+0000","last_clean":"2024-09-19T11:15:40.352655+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:15:40.352655+0000","last_undegraded":"2024-09-19T11:15:40.352655+0000","last_fullsized":"2024-09-19T11:15:40.352655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:11.185147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586195+0000","last_change":"2024-09-19T11:13:39.369302+0000","last_active":"2024-09-19T11:14:07.586195+0000","last_peered":"2024-09-19T11:14:07.586195+0000","last_clean":"2024-09-19T11:14:07.586195+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:14:07.586195+0000","last_undegraded":"2024-09-19T11:14:07.586195+0000","last_fullsized":"2024-09-19T11:14:07.586195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:58.150298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.223256+0000","last_change":"2024-09-19T11:13:41.385457+0000","last_active":"2024-09-19T11:16:43.223256+0000","last_peered":"2024-09-19T11:16:43.223256+0000","last_clean":"2024-09-19T11:16:43.223256+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:16:43.223256+0000","last_undegraded":"2024-09-19T11:16:43.223256+0000","last_fullsized":"2024-09-19T11:16:43.223256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:04.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740486+0000","last_change":"2024-09-19T11:13:33.354021+0000","last_active":"2024-09-19T11:16:42.740486+0000","last_peered":"2024-09-19T11:16:42.740486+0000","last_clean":"2024-09-19T11:16:42.740486+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:16:42.740486+0000","last_undegraded":"2024-09-19T11:16:42.740486+0000","last_fullsized":"2024-09-19T11:16:42.740486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:06.071580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587381+0000","last_change":"2024-09-19T11:13:31.378149+0000","last_active":"2024-09-19T11:14:07.587381+0000","last_peered":"2024-09-19T11:14:07.587381+0000","last_clean":"2024-09-19T11:14:07.587381+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:14:07.587381+0000","last_undegraded":"2024-09-19T11:14:07.587381+0000","last_fullsized":"2024-09-19T11:14:07.587381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:54.799765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589532+0000","last_change":"2024-09-19T11:13:35.359219+0000","last_active":"2024-09-19T11:14:07.589532+0000","last_peered":"2024-09-19T11:14:07.589532+0000","last_clean":"2024-09-19T11:14:07.589532+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:14:07.589532+0000","last_undegraded":"2024-09-19T11:14:07.589532+0000","last_fullsized":"2024-09-19T11:14:07.589532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:43.307746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.333416+0000","last_change":"2024-09-19T11:13:37.362218+0000","last_active":"2024-09-19T11:15:40.333416+0000","last_peered":"2024-09-19T11:15:40.333416+0000","last_clean":"2024-09-19T11:15:40.333416+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:15:40.333416+0000","last_undegraded":"2024-09-19T11:15:40.333416+0000","last_fullsized":"2024-09-19T11:15:40.333416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:38.878721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589393+0000","last_change":"2024-09-19T11:13:39.378975+0000","last_active":"2024-09-19T11:14:07.589393+0000","last_peered":"2024-09-19T11:14:07.589393+0000","last_clean":"2024-09-19T11:14:07.589393+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:14:07.589393+0000","last_undegraded":"2024-09-19T11:14:07.589393+0000","last_fullsized":"2024-09-19T11:14:07.589393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:43.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:43.539247+0000","last_change":"2024-09-19T11:13:41.390986+0000","last_active":"2024-09-19T11:15:43.539247+0000","last_peered":"2024-09-19T11:15:43.539247+0000","last_clean":"2024-09-19T11:15:43.539247+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:15:43.539247+0000","last_undegraded":"2024-09-19T11:15:43.539247+0000","last_fullsized":"2024-09-19T11:15:43.539247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:29.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588444+0000","last_change":"2024-09-19T11:13:33.360955+0000","last_active":"2024-09-19T11:14:07.588444+0000","last_peered":"2024-09-19T11:14:07.588444+0000","last_clean":"2024-09-19T11:14:07.588444+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:14:07.588444+0000","last_undegraded":"2024-09-19T11:14:07.588444+0000","last_fullsized":"2024-09-19T11:14:07.588444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.739277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.595717+0000","last_change":"2024-09-19T11:13:31.378434+0000","last_active":"2024-09-19T11:14:15.595717+0000","last_peered":"2024-09-19T11:14:15.595717+0000","last_clean":"2024-09-19T11:14:15.595717+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:14:15.595717+0000","last_undegraded":"2024-09-19T11:14:15.595717+0000","last_fullsized":"2024-09-19T11:14:15.595717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:49.941394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586955+0000","last_change":"2024-09-19T11:13:35.348523+0000","last_active":"2024-09-19T11:14:07.586955+0000","last_peered":"2024-09-19T11:14:07.586955+0000","last_clean":"2024-09-19T11:14:07.586955+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:14:07.586955+0000","last_undegraded":"2024-09-19T11:14:07.586955+0000","last_fullsized":"2024-09-19T11:14:07.586955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:26.593052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.360329+0000","last_change":"2024-09-19T11:13:37.362855+0000","last_active":"2024-09-19T11:15:40.360329+0000","last_peered":"2024-09-19T11:15:40.360329+0000","last_clean":"2024-09-19T11:15:40.360329+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:15:40.360329+0000","last_undegraded":"2024-09-19T11:15:40.360329+0000","last_fullsized":"2024-09-19T11:15:40.360329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:36.268162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":432,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.227280+0000","last_change":"2024-09-19T11:13:39.381222+0000","last_active":"2024-09-19T11:16:43.227280+0000","last_peered":"2024-09-19T11:16:43.227280+0000","last_clean":"2024-09-19T11:16:43.227280+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:16:43.227280+0000","last_undegraded":"2024-09-19T11:16:43.227280+0000","last_fullsized":"2024-09-19T11:16:43.227280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:02.724027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:45.538583+0000","last_change":"2024-09-19T11:13:41.387843+0000","last_active":"2024-09-19T11:15:45.538583+0000","last_peered":"2024-09-19T11:15:45.538583+0000","last_clean":"2024-09-19T11:15:45.538583+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:15:45.538583+0000","last_undegraded":"2024-09-19T11:15:45.538583+0000","last_fullsized":"2024-09-19T11:15:45.538583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.060376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.539438+0000","last_change":"2024-09-19T11:13:33.351314+0000","last_active":"2024-09-19T11:15:48.539438+0000","last_peered":"2024-09-19T11:15:48.539438+0000","last_clean":"2024-09-19T11:15:48.539438+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:15:48.539438+0000","last_undegraded":"2024-09-19T11:15:48.539438+0000","last_fullsized":"2024-09-19T11:15:48.539438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:21.853847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.893715+0000","last_change":"2024-09-19T11:13:31.368833+0000","last_active":"2024-09-19T11:16:42.893715+0000","last_peered":"2024-09-19T11:16:42.893715+0000","last_clean":"2024-09-19T11:16:42.893715+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:16:42.893715+0000","last_undegraded":"2024-09-19T11:16:42.893715+0000","last_fullsized":"2024-09-19T11:16:42.893715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:58.341667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.444942+0000","last_change":"2024-09-19T11:13:35.352798+0000","last_active":"2024-09-19T11:15:41.444942+0000","last_peered":"2024-09-19T11:15:41.444942+0000","last_clean":"2024-09-19T11:15:41.444942+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:15:41.444942+0000","last_undegraded":"2024-09-19T11:15:41.444942+0000","last_fullsized":"2024-09-19T11:15:41.444942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:46.869358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586975+0000","last_change":"2024-09-19T11:13:37.369616+0000","last_active":"2024-09-19T11:14:07.586975+0000","last_peered":"2024-09-19T11:14:07.586975+0000","last_clean":"2024-09-19T11:14:07.586975+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:14:07.586975+0000","last_undegraded":"2024-09-19T11:14:07.586975+0000","last_fullsized":"2024-09-19T11:14:07.586975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.498959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":469,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.110426+0000","last_change":"2024-09-19T11:13:39.364476+0000","last_active":"2024-09-19T11:16:43.110426+0000","last_peered":"2024-09-19T11:16:43.110426+0000","last_clean":"2024-09-19T11:16:43.110426+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:16:43.110426+0000","last_undegraded":"2024-09-19T11:16:43.110426+0000","last_fullsized":"2024-09-19T11:16:43.110426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:05.251594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.968627+0000","last_change":"2024-09-19T11:13:41.382500+0000","last_active":"2024-09-19T11:16:42.968627+0000","last_peered":"2024-09-19T11:16:42.968627+0000","last_clean":"2024-09-19T11:16:42.968627+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:16:42.968627+0000","last_undegraded":"2024-09-19T11:16:42.968627+0000","last_fullsized":"2024-09-19T11:16:42.968627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:44.429934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.615161+0000","last_change":"2024-09-19T11:13:33.361148+0000","last_active":"2024-09-19T11:14:15.615161+0000","last_peered":"2024-09-19T11:14:15.615161+0000","last_clean":"2024-09-19T11:14:15.615161+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:14:15.615161+0000","last_undegraded":"2024-09-19T11:14:15.615161+0000","last_fullsized":"2024-09-19T11:14:15.615161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:18.909904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584784+0000","last_change":"2024-09-19T11:13:31.376571+0000","last_active":"2024-09-19T11:14:07.584784+0000","last_peered":"2024-09-19T11:14:07.584784+0000","last_clean":"2024-09-19T11:14:07.584784+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:14:07.584784+0000","last_undegraded":"2024-09-19T11:14:07.584784+0000","last_fullsized":"2024-09-19T11:14:07.584784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:21.093655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"28'1","reported_seq":219,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.445222+0000","last_change":"2024-09-19T11:13:35.359895+0000","last_active":"2024-09-19T11:15:41.445222+0000","last_peered":"2024-09-19T11:15:41.445222+0000","last_clean":"2024-09-19T11:15:41.445222+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:15:41.445222+0000","last_undegraded":"2024-09-19T11:15:41.445222+0000","last_fullsized":"2024-09-19T11:15:41.445222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:48.665046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'38","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.346012+0000","last_change":"2024-09-19T11:13:37.367380+0000","last_active":"2024-09-19T11:15:40.346012+0000","last_peered":"2024-09-19T11:15:40.346012+0000","last_clean":"2024-09-19T11:15:40.346012+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:15:40.346012+0000","last_undegraded":"2024-09-19T11:15:40.346012+0000","last_fullsized":"2024-09-19T11:15:40.346012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:44.610147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587829+0000","last_change":"2024-09-19T11:13:39.381930+0000","last_active":"2024-09-19T11:14:07.587829+0000","last_peered":"2024-09-19T11:14:07.587829+0000","last_clean":"2024-09-19T11:14:07.587829+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:14:07.587829+0000","last_undegraded":"2024-09-19T11:14:07.587829+0000","last_fullsized":"2024-09-19T11:14:07.587829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:20.757672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'8","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.224963+0000","last_change":"2024-09-19T11:13:41.383036+0000","last_active":"2024-09-19T11:16:43.224963+0000","last_peered":"2024-09-19T11:16:43.224963+0000","last_clean":"2024-09-19T11:16:43.224963+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:16:43.224963+0000","last_undegraded":"2024-09-19T11:16:43.224963+0000","last_fullsized":"2024-09-19T11:16:43.224963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:22.046963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004072+0000","last_change":"2024-09-19T11:13:33.360700+0000","last_active":"2024-09-19T11:16:43.004072+0000","last_peered":"2024-09-19T11:16:43.004072+0000","last_clean":"2024-09-19T11:16:43.004072+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:16:43.004072+0000","last_undegraded":"2024-09-19T11:16:43.004072+0000","last_fullsized":"2024-09-19T11:16:43.004072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:38.890842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593057+0000","last_change":"2024-09-19T11:13:16.796669+0000","last_active":"2024-09-19T11:14:07.593057+0000","last_peered":"2024-09-19T11:14:07.593057+0000","last_clean":"2024-09-19T11:14:07.593057+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:14:07.593057+0000","last_undegraded":"2024-09-19T11:14:07.593057+0000","last_fullsized":"2024-09-19T11:14:07.593057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_clean_scrub_stamp":"2024-09-19T11:13:15.217500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:15.868833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586588+0000","last_change":"2024-09-19T11:13:21.254644+0000","last_active":"2024-09-19T11:14:07.586588+0000","last_peered":"2024-09-19T11:14:07.586588+0000","last_clean":"2024-09-19T11:14:07.586588+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:14:07.586588+0000","last_undegraded":"2024-09-19T11:14:07.586588+0000","last_fullsized":"2024-09-19T11:14:07.586588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:09.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585255+0000","last_change":"2024-09-19T11:13:31.378802+0000","last_active":"2024-09-19T11:14:07.585255+0000","last_peered":"2024-09-19T11:14:07.585255+0000","last_clean":"2024-09-19T11:14:07.585255+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:14:07.585255+0000","last_undegraded":"2024-09-19T11:14:07.585255+0000","last_fullsized":"2024-09-19T11:14:07.585255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:21.545126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598099+0000","last_change":"2024-09-19T11:14:07.597443+0000","last_active":"2024-09-19T11:14:07.598099+0000","last_peered":"2024-09-19T11:14:07.598099+0000","last_clean":"2024-09-19T11:14:07.598099+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:14:07.598099+0000","last_undegraded":"2024-09-19T11:14:07.598099+0000","last_fullsized":"2024-09-19T11:14:07.598099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:01.646429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'76","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.357806+0000","last_change":"2024-09-19T11:13:37.369113+0000","last_active":"2024-09-19T11:15:40.357806+0000","last_peered":"2024-09-19T11:15:40.357806+0000","last_clean":"2024-09-19T11:15:40.357806+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:15:40.357806+0000","last_undegraded":"2024-09-19T11:15:40.357806+0000","last_fullsized":"2024-09-19T11:15:40.357806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:17.600400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588503+0000","last_change":"2024-09-19T11:13:39.381749+0000","last_active":"2024-09-19T11:14:07.588503+0000","last_peered":"2024-09-19T11:14:07.588503+0000","last_clean":"2024-09-19T11:14:07.588503+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:14:07.588503+0000","last_undegraded":"2024-09-19T11:14:07.588503+0000","last_fullsized":"2024-09-19T11:14:07.588503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:31.206255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.012984+0000","last_change":"2024-09-19T11:13:41.382469+0000","last_active":"2024-09-19T11:16:43.012984+0000","last_peered":"2024-09-19T11:16:43.012984+0000","last_clean":"2024-09-19T11:16:43.012984+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:16:43.012984+0000","last_undegraded":"2024-09-19T11:16:43.012984+0000","last_fullsized":"2024-09-19T11:16:43.012984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:23.490546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096383+0000","last_change":"2024-09-19T11:13:33.352593+0000","last_active":"2024-09-19T11:15:42.096383+0000","last_peered":"2024-09-19T11:15:42.096383+0000","last_clean":"2024-09-19T11:15:42.096383+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:15:42.096383+0000","last_undegraded":"2024-09-19T11:15:42.096383+0000","last_fullsized":"2024-09-19T11:15:42.096383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:32.858735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584255+0000","last_change":"2024-09-19T11:13:21.254355+0000","last_active":"2024-09-19T11:14:07.584255+0000","last_peered":"2024-09-19T11:14:07.584255+0000","last_clean":"2024-09-19T11:14:07.584255+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:14:07.584255+0000","last_undegraded":"2024-09-19T11:14:07.584255+0000","last_fullsized":"2024-09-19T11:14:07.584255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:49.014710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:35.537088+0000","last_change":"2024-09-19T11:13:31.364094+0000","last_active":"2024-09-19T11:15:35.537088+0000","last_peered":"2024-09-19T11:15:35.537088+0000","last_clean":"2024-09-19T11:15:35.537088+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:15:35.537088+0000","last_undegraded":"2024-09-19T11:15:35.537088+0000","last_fullsized":"2024-09-19T11:15:35.537088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.487218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589544+0000","last_change":"2024-09-19T11:13:35.355733+0000","last_active":"2024-09-19T11:14:07.589544+0000","last_peered":"2024-09-19T11:14:07.589544+0000","last_clean":"2024-09-19T11:14:07.589544+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:14:07.589544+0000","last_undegraded":"2024-09-19T11:14:07.589544+0000","last_fullsized":"2024-09-19T11:14:07.589544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:16.022467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'273","reported_seq":477,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437573+0000","last_change":"2024-09-19T11:13:37.365037+0000","last_active":"2024-09-19T11:16:40.437573+0000","last_peered":"2024-09-19T11:16:40.437573+0000","last_clean":"2024-09-19T11:16:40.437573+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:16:40.437573+0000","last_undegraded":"2024-09-19T11:16:40.437573+0000","last_fullsized":"2024-09-19T11:16:40.437573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:00.713713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585295+0000","last_change":"2024-09-19T11:13:39.379958+0000","last_active":"2024-09-19T11:14:07.585295+0000","last_peered":"2024-09-19T11:14:07.585295+0000","last_clean":"2024-09-19T11:14:07.585295+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:14:07.585295+0000","last_undegraded":"2024-09-19T11:14:07.585295+0000","last_fullsized":"2024-09-19T11:14:07.585295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.435708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.934138+0000","last_change":"2024-09-19T11:13:41.394316+0000","last_active":"2024-09-19T11:14:57.934138+0000","last_peered":"2024-09-19T11:14:57.934138+0000","last_clean":"2024-09-19T11:14:57.934138+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:14:57.934138+0000","last_undegraded":"2024-09-19T11:14:57.934138+0000","last_fullsized":"2024-09-19T11:14:57.934138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:54.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589975+0000","last_change":"2024-09-19T11:13:33.348762+0000","last_active":"2024-09-19T11:14:07.589975+0000","last_peered":"2024-09-19T11:14:07.589975+0000","last_clean":"2024-09-19T11:14:07.589975+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:14:07.589975+0000","last_undegraded":"2024-09-19T11:14:07.589975+0000","last_fullsized":"2024-09-19T11:14:07.589975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:36:09.372432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589222+0000","last_change":"2024-09-19T11:13:21.252701+0000","last_active":"2024-09-19T11:14:07.589222+0000","last_peered":"2024-09-19T11:14:07.589222+0000","last_clean":"2024-09-19T11:14:07.589222+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:14:07.589222+0000","last_undegraded":"2024-09-19T11:14:07.589222+0000","last_fullsized":"2024-09-19T11:14:07.589222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:32.819428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585864+0000","last_change":"2024-09-19T11:13:31.377758+0000","last_active":"2024-09-19T11:14:07.585864+0000","last_peered":"2024-09-19T11:14:07.585864+0000","last_clean":"2024-09-19T11:14:07.585864+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:14:07.585864+0000","last_undegraded":"2024-09-19T11:14:07.585864+0000","last_fullsized":"2024-09-19T11:14:07.585864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:51.569099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589942+0000","last_change":"2024-09-19T11:13:35.350142+0000","last_active":"2024-09-19T11:14:07.589942+0000","last_peered":"2024-09-19T11:14:07.589942+0000","last_clean":"2024-09-19T11:14:07.589942+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:14:07.589942+0000","last_undegraded":"2024-09-19T11:14:07.589942+0000","last_fullsized":"2024-09-19T11:14:07.589942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:13.732591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437418+0000","last_change":"2024-09-19T11:13:37.369777+0000","last_active":"2024-09-19T11:16:40.437418+0000","last_peered":"2024-09-19T11:16:40.437418+0000","last_clean":"2024-09-19T11:16:40.437418+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:16:40.437418+0000","last_undegraded":"2024-09-19T11:16:40.437418+0000","last_fullsized":"2024-09-19T11:16:40.437418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:09.642366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587165+0000","last_change":"2024-09-19T11:13:39.382026+0000","last_active":"2024-09-19T11:14:07.587165+0000","last_peered":"2024-09-19T11:14:07.587165+0000","last_clean":"2024-09-19T11:14:07.587165+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:14:07.587165+0000","last_undegraded":"2024-09-19T11:14:07.587165+0000","last_fullsized":"2024-09-19T11:14:07.587165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:05.351431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.301235+0000","last_change":"2024-09-19T11:13:41.390159+0000","last_active":"2024-09-19T11:16:42.301235+0000","last_peered":"2024-09-19T11:16:42.301235+0000","last_clean":"2024-09-19T11:16:42.301235+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:16:42.301235+0000","last_undegraded":"2024-09-19T11:16:42.301235+0000","last_fullsized":"2024-09-19T11:16:42.301235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:47.188979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112810+0000","last_change":"2024-09-19T11:13:33.352483+0000","last_active":"2024-09-19T11:14:58.112810+0000","last_peered":"2024-09-19T11:14:58.112810+0000","last_clean":"2024-09-19T11:14:58.112810+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:14:58.112810+0000","last_undegraded":"2024-09-19T11:14:58.112810+0000","last_fullsized":"2024-09-19T11:14:58.112810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:17.063492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584626+0000","last_change":"2024-09-19T11:13:21.254900+0000","last_active":"2024-09-19T11:14:07.584626+0000","last_peered":"2024-09-19T11:14:07.584626+0000","last_clean":"2024-09-19T11:14:07.584626+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:14:07.584626+0000","last_undegraded":"2024-09-19T11:14:07.584626+0000","last_fullsized":"2024-09-19T11:14:07.584626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:06.693190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.563187+0000","last_change":"2024-09-19T11:13:31.370903+0000","last_active":"2024-09-19T11:15:38.563187+0000","last_peered":"2024-09-19T11:15:38.563187+0000","last_clean":"2024-09-19T11:15:38.563187+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:15:38.563187+0000","last_undegraded":"2024-09-19T11:15:38.563187+0000","last_fullsized":"2024-09-19T11:15:38.563187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:36.343297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'4","reported_seq":227,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.425383+0000","last_change":"2024-09-19T11:13:35.357655+0000","last_active":"2024-09-19T11:15:41.425383+0000","last_peered":"2024-09-19T11:15:41.425383+0000","last_clean":"2024-09-19T11:15:41.425383+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:15:41.425383+0000","last_undegraded":"2024-09-19T11:15:41.425383+0000","last_fullsized":"2024-09-19T11:15:41.425383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:09.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'14","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.146449+0000","last_change":"2024-09-19T11:13:37.369199+0000","last_active":"2024-09-19T11:16:42.146449+0000","last_peered":"2024-09-19T11:16:42.146449+0000","last_clean":"2024-09-19T11:16:42.146449+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:16:42.146449+0000","last_undegraded":"2024-09-19T11:16:42.146449+0000","last_fullsized":"2024-09-19T11:16:42.146449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:43.083589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589764+0000","last_change":"2024-09-19T11:13:39.379563+0000","last_active":"2024-09-19T11:14:07.589764+0000","last_peered":"2024-09-19T11:14:07.589764+0000","last_clean":"2024-09-19T11:14:07.589764+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:14:07.589764+0000","last_undegraded":"2024-09-19T11:14:07.589764+0000","last_fullsized":"2024-09-19T11:14:07.589764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:20.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.946285+0000","last_change":"2024-09-19T11:13:41.395412+0000","last_active":"2024-09-19T11:16:42.946285+0000","last_peered":"2024-09-19T11:16:42.946285+0000","last_clean":"2024-09-19T11:16:42.946285+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:16:42.946285+0000","last_undegraded":"2024-09-19T11:16:42.946285+0000","last_fullsized":"2024-09-19T11:16:42.946285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:05.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.967341+0000","last_change":"2024-09-19T11:13:33.356242+0000","last_active":"2024-09-19T11:16:42.967341+0000","last_peered":"2024-09-19T11:16:42.967341+0000","last_clean":"2024-09-19T11:16:42.967341+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:16:42.967341+0000","last_undegraded":"2024-09-19T11:16:42.967341+0000","last_fullsized":"2024-09-19T11:16:42.967341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588322+0000","last_change":"2024-09-19T11:13:31.374247+0000","last_active":"2024-09-19T11:14:07.588322+0000","last_peered":"2024-09-19T11:14:07.588322+0000","last_clean":"2024-09-19T11:14:07.588322+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:14:07.588322+0000","last_undegraded":"2024-09-19T11:14:07.588322+0000","last_fullsized":"2024-09-19T11:14:07.588322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:36.456865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587109+0000","last_change":"2024-09-19T11:13:21.259380+0000","last_active":"2024-09-19T11:14:07.587109+0000","last_peered":"2024-09-19T11:14:07.587109+0000","last_clean":"2024-09-19T11:14:07.587109+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:14:07.587109+0000","last_undegraded":"2024-09-19T11:14:07.587109+0000","last_fullsized":"2024-09-19T11:14:07.587109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:46.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.537929+0000","last_change":"2024-09-19T11:13:35.354864+0000","last_active":"2024-09-19T11:15:40.537929+0000","last_peered":"2024-09-19T11:15:40.537929+0000","last_clean":"2024-09-19T11:15:40.537929+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:15:40.537929+0000","last_undegraded":"2024-09-19T11:15:40.537929+0000","last_fullsized":"2024-09-19T11:15:40.537929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:59.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'62","reported_seq":122,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.586384+0000","last_change":"2024-09-19T11:13:37.366497+0000","last_active":"2024-09-19T11:16:42.586384+0000","last_peered":"2024-09-19T11:16:42.586384+0000","last_clean":"2024-09-19T11:16:42.586384+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:16:42.586384+0000","last_undegraded":"2024-09-19T11:16:42.586384+0000","last_fullsized":"2024-09-19T11:16:42.586384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:05.665285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5917,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586753+0000","last_change":"2024-09-19T11:13:39.380023+0000","last_active":"2024-09-19T11:14:07.586753+0000","last_peered":"2024-09-19T11:14:07.586753+0000","last_clean":"2024-09-19T11:14:07.586753+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:14:07.586753+0000","last_undegraded":"2024-09-19T11:14:07.586753+0000","last_fullsized":"2024-09-19T11:14:07.586753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.513854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.002199+0000","last_change":"2024-09-19T11:13:41.384779+0000","last_active":"2024-09-19T11:15:42.002199+0000","last_peered":"2024-09-19T11:15:42.002199+0000","last_clean":"2024-09-19T11:15:42.002199+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:15:42.002199+0000","last_undegraded":"2024-09-19T11:15:42.002199+0000","last_fullsized":"2024-09-19T11:15:42.002199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:01.181785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003973+0000","last_change":"2024-09-19T11:13:33.355203+0000","last_active":"2024-09-19T11:16:43.003973+0000","last_peered":"2024-09-19T11:16:43.003973+0000","last_clean":"2024-09-19T11:16:43.003973+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:16:43.003973+0000","last_undegraded":"2024-09-19T11:16:43.003973+0000","last_fullsized":"2024-09-19T11:16:43.003973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:39.888974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.523511+0000","last_change":"2024-09-19T11:13:31.363980+0000","last_active":"2024-09-19T11:14:14.523511+0000","last_peered":"2024-09-19T11:14:14.523511+0000","last_clean":"2024-09-19T11:14:14.523511+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:14:14.523511+0000","last_undegraded":"2024-09-19T11:14:14.523511+0000","last_fullsized":"2024-09-19T11:14:14.523511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:08.281382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587424+0000","last_change":"2024-09-19T11:13:21.254921+0000","last_active":"2024-09-19T11:14:07.587424+0000","last_peered":"2024-09-19T11:14:07.587424+0000","last_clean":"2024-09-19T11:14:07.587424+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:14:07.587424+0000","last_undegraded":"2024-09-19T11:14:07.587424+0000","last_fullsized":"2024-09-19T11:14:07.587424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:50.538143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584330+0000","last_change":"2024-09-19T11:13:35.355937+0000","last_active":"2024-09-19T11:14:07.584330+0000","last_peered":"2024-09-19T11:14:07.584330+0000","last_clean":"2024-09-19T11:14:07.584330+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:14:07.584330+0000","last_undegraded":"2024-09-19T11:14:07.584330+0000","last_fullsized":"2024-09-19T11:14:07.584330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:41.799805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593910+0000","last_change":"2024-09-19T11:13:37.367919+0000","last_active":"2024-09-19T11:14:07.593910+0000","last_peered":"2024-09-19T11:14:07.593910+0000","last_clean":"2024-09-19T11:14:07.593910+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:14:07.593910+0000","last_undegraded":"2024-09-19T11:14:07.593910+0000","last_fullsized":"2024-09-19T11:14:07.593910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:53.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437340+0000","last_change":"2024-09-19T11:13:39.370313+0000","last_active":"2024-09-19T11:16:40.437340+0000","last_peered":"2024-09-19T11:16:40.437340+0000","last_clean":"2024-09-19T11:16:40.437340+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:16:40.437340+0000","last_undegraded":"2024-09-19T11:16:40.437340+0000","last_fullsized":"2024-09-19T11:16:40.437340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:56.937960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.649914+0000","last_change":"2024-09-19T11:13:41.391610+0000","last_active":"2024-09-19T11:16:42.649914+0000","last_peered":"2024-09-19T11:16:42.649914+0000","last_clean":"2024-09-19T11:16:42.649914+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:16:42.649914+0000","last_undegraded":"2024-09-19T11:16:42.649914+0000","last_fullsized":"2024-09-19T11:16:42.649914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.303997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096636+0000","last_change":"2024-09-19T11:14:07.601620+0000","last_active":"2024-09-19T11:15:42.096636+0000","last_peered":"2024-09-19T11:15:42.096636+0000","last_clean":"2024-09-19T11:15:42.096636+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:15:42.096636+0000","last_undegraded":"2024-09-19T11:15:42.096636+0000","last_fullsized":"2024-09-19T11:15:42.096636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:56.955418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.879840+0000","last_change":"2024-09-19T11:13:31.367766+0000","last_active":"2024-09-19T11:16:42.879840+0000","last_peered":"2024-09-19T11:16:42.879840+0000","last_clean":"2024-09-19T11:16:42.879840+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:16:42.879840+0000","last_undegraded":"2024-09-19T11:16:42.879840+0000","last_fullsized":"2024-09-19T11:16:42.879840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:46.005854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588837+0000","last_change":"2024-09-19T11:13:21.259371+0000","last_active":"2024-09-19T11:14:07.588837+0000","last_peered":"2024-09-19T11:14:07.588837+0000","last_clean":"2024-09-19T11:14:07.588837+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:14:07.588837+0000","last_undegraded":"2024-09-19T11:14:07.588837+0000","last_fullsized":"2024-09-19T11:14:07.588837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:58.914941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584240+0000","last_change":"2024-09-19T11:13:35.355501+0000","last_active":"2024-09-19T11:14:07.584240+0000","last_peered":"2024-09-19T11:14:07.584240+0000","last_clean":"2024-09-19T11:14:07.584240+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:14:07.584240+0000","last_undegraded":"2024-09-19T11:14:07.584240+0000","last_fullsized":"2024-09-19T11:14:07.584240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:17.393322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585599+0000","last_change":"2024-09-19T11:13:37.371529+0000","last_active":"2024-09-19T11:14:07.585599+0000","last_peered":"2024-09-19T11:14:07.585599+0000","last_clean":"2024-09-19T11:14:07.585599+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:14:07.585599+0000","last_undegraded":"2024-09-19T11:14:07.585599+0000","last_fullsized":"2024-09-19T11:14:07.585599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.201187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'282","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.253160+0000","last_change":"2024-09-19T11:13:39.374381+0000","last_active":"2024-09-19T11:16:43.253160+0000","last_peered":"2024-09-19T11:16:43.253160+0000","last_clean":"2024-09-19T11:16:43.253160+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:16:43.253160+0000","last_undegraded":"2024-09-19T11:16:43.253160+0000","last_fullsized":"2024-09-19T11:16:43.253160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:52.357745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.093870+0000","last_change":"2024-09-19T11:13:41.392744+0000","last_active":"2024-09-19T11:15:42.093870+0000","last_peered":"2024-09-19T11:15:42.093870+0000","last_clean":"2024-09-19T11:15:42.093870+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:15:42.093870+0000","last_undegraded":"2024-09-19T11:15:42.093870+0000","last_fullsized":"2024-09-19T11:15:42.093870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:06.085455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.967344+0000","last_change":"2024-09-19T11:13:33.350528+0000","last_active":"2024-09-19T11:16:42.967344+0000","last_peered":"2024-09-19T11:16:42.967344+0000","last_clean":"2024-09-19T11:16:42.967344+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:16:42.967344+0000","last_undegraded":"2024-09-19T11:16:42.967344+0000","last_fullsized":"2024-09-19T11:16:42.967344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:39.714383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.525531+0000","last_change":"2024-09-19T11:13:31.363581+0000","last_active":"2024-09-19T11:14:14.525531+0000","last_peered":"2024-09-19T11:14:14.525531+0000","last_clean":"2024-09-19T11:14:14.525531+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:14:14.525531+0000","last_undegraded":"2024-09-19T11:14:14.525531+0000","last_fullsized":"2024-09-19T11:14:14.525531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:35.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590511+0000","last_change":"2024-09-19T11:13:21.254352+0000","last_active":"2024-09-19T11:14:07.590511+0000","last_peered":"2024-09-19T11:14:07.590511+0000","last_clean":"2024-09-19T11:14:07.590511+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:14:07.590511+0000","last_undegraded":"2024-09-19T11:14:07.590511+0000","last_fullsized":"2024-09-19T11:14:07.590511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:50.082399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584254+0000","last_change":"2024-09-19T11:13:35.355920+0000","last_active":"2024-09-19T11:14:07.584254+0000","last_peered":"2024-09-19T11:14:07.584254+0000","last_clean":"2024-09-19T11:14:07.584254+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:14:07.584254+0000","last_undegraded":"2024-09-19T11:14:07.584254+0000","last_fullsized":"2024-09-19T11:14:07.584254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:38.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'82","reported_seq":155,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.344082+0000","last_change":"2024-09-19T11:13:37.367000+0000","last_active":"2024-09-19T11:15:40.344082+0000","last_peered":"2024-09-19T11:15:40.344082+0000","last_clean":"2024-09-19T11:15:40.344082+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:15:40.344082+0000","last_undegraded":"2024-09-19T11:15:40.344082+0000","last_fullsized":"2024-09-19T11:15:40.344082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.428269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586150+0000","last_change":"2024-09-19T11:13:39.369482+0000","last_active":"2024-09-19T11:14:07.586150+0000","last_peered":"2024-09-19T11:14:07.586150+0000","last_clean":"2024-09-19T11:14:07.586150+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:14:07.586150+0000","last_undegraded":"2024-09-19T11:14:07.586150+0000","last_fullsized":"2024-09-19T11:14:07.586150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:52.197649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.742094+0000","last_change":"2024-09-19T11:13:41.387841+0000","last_active":"2024-09-19T11:16:42.742094+0000","last_peered":"2024-09-19T11:16:42.742094+0000","last_clean":"2024-09-19T11:16:42.742094+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:16:42.742094+0000","last_undegraded":"2024-09-19T11:16:42.742094+0000","last_fullsized":"2024-09-19T11:16:42.742094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:41.664645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589320+0000","last_change":"2024-09-19T11:13:41.387407+0000","last_active":"2024-09-19T11:14:07.589320+0000","last_peered":"2024-09-19T11:14:07.589320+0000","last_clean":"2024-09-19T11:14:07.589320+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:14:07.589320+0000","last_undegraded":"2024-09-19T11:14:07.589320+0000","last_fullsized":"2024-09-19T11:14:07.589320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:24.850379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899053+0000","last_change":"2024-09-19T11:13:33.353234+0000","last_active":"2024-09-19T11:16:42.899053+0000","last_peered":"2024-09-19T11:16:42.899053+0000","last_clean":"2024-09-19T11:16:42.899053+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:16:42.899053+0000","last_undegraded":"2024-09-19T11:16:42.899053+0000","last_fullsized":"2024-09-19T11:16:42.899053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.889699+0000","last_change":"2024-09-19T11:13:31.373496+0000","last_active":"2024-09-19T11:16:42.889699+0000","last_peered":"2024-09-19T11:16:42.889699+0000","last_clean":"2024-09-19T11:16:42.889699+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:16:42.889699+0000","last_undegraded":"2024-09-19T11:16:42.889699+0000","last_fullsized":"2024-09-19T11:16:42.889699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:04.061207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593909+0000","last_change":"2024-09-19T11:13:35.353000+0000","last_active":"2024-09-19T11:14:07.593909+0000","last_peered":"2024-09-19T11:14:07.593909+0000","last_clean":"2024-09-19T11:14:07.593909+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:14:07.593909+0000","last_undegraded":"2024-09-19T11:14:07.593909+0000","last_fullsized":"2024-09-19T11:14:07.593909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:23.618637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'33","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.349850+0000","last_change":"2024-09-19T11:13:37.369688+0000","last_active":"2024-09-19T11:15:40.349850+0000","last_peered":"2024-09-19T11:15:40.349850+0000","last_clean":"2024-09-19T11:15:40.349850+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:15:40.349850+0000","last_undegraded":"2024-09-19T11:15:40.349850+0000","last_fullsized":"2024-09-19T11:15:40.349850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:22.810135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585707+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.585707+0000","last_peered":"2024-09-19T11:14:07.585707+0000","last_clean":"2024-09-19T11:14:07.585707+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:14:07.585707+0000","last_undegraded":"2024-09-19T11:14:07.585707+0000","last_fullsized":"2024-09-19T11:14:07.585707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:32.078155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.049603+0000","last_change":"2024-09-19T11:13:41.388648+0000","last_active":"2024-09-19T11:15:40.049603+0000","last_peered":"2024-09-19T11:15:40.049603+0000","last_clean":"2024-09-19T11:15:40.049603+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:15:40.049603+0000","last_undegraded":"2024-09-19T11:15:40.049603+0000","last_fullsized":"2024-09-19T11:15:40.049603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:00.390668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899095+0000","last_change":"2024-09-19T11:13:33.356046+0000","last_active":"2024-09-19T11:16:42.899095+0000","last_peered":"2024-09-19T11:16:42.899095+0000","last_clean":"2024-09-19T11:16:42.899095+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:16:42.899095+0000","last_undegraded":"2024-09-19T11:16:42.899095+0000","last_fullsized":"2024-09-19T11:16:42.899095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:32.352474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.580671+0000","last_change":"2024-09-19T11:13:31.371002+0000","last_active":"2024-09-19T11:16:42.580671+0000","last_peered":"2024-09-19T11:16:42.580671+0000","last_clean":"2024-09-19T11:16:42.580671+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:42.580671+0000","last_undegraded":"2024-09-19T11:16:42.580671+0000","last_fullsized":"2024-09-19T11:16:42.580671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:54.573687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584591+0000","last_change":"2024-09-19T11:13:35.353851+0000","last_active":"2024-09-19T11:14:07.584591+0000","last_peered":"2024-09-19T11:14:07.584591+0000","last_clean":"2024-09-19T11:14:07.584591+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:14:07.584591+0000","last_undegraded":"2024-09-19T11:14:07.584591+0000","last_fullsized":"2024-09-19T11:14:07.584591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:37.329718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.125107+0000","last_change":"2024-09-19T11:13:37.361748+0000","last_active":"2024-09-19T11:16:42.125107+0000","last_peered":"2024-09-19T11:16:42.125107+0000","last_clean":"2024-09-19T11:16:42.125107+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:16:42.125107+0000","last_undegraded":"2024-09-19T11:16:42.125107+0000","last_fullsized":"2024-09-19T11:16:42.125107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:52.506674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588151+0000","last_change":"2024-09-19T11:13:39.381924+0000","last_active":"2024-09-19T11:14:07.588151+0000","last_peered":"2024-09-19T11:14:07.588151+0000","last_clean":"2024-09-19T11:14:07.588151+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:14:07.588151+0000","last_undegraded":"2024-09-19T11:14:07.588151+0000","last_fullsized":"2024-09-19T11:14:07.588151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:37.700824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587758+0000","last_change":"2024-09-19T11:13:41.381057+0000","last_active":"2024-09-19T11:14:07.587758+0000","last_peered":"2024-09-19T11:14:07.587758+0000","last_clean":"2024-09-19T11:14:07.587758+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:14:07.587758+0000","last_undegraded":"2024-09-19T11:14:07.587758+0000","last_fullsized":"2024-09-19T11:14:07.587758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:11.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003956+0000","last_change":"2024-09-19T11:13:33.350098+0000","last_active":"2024-09-19T11:16:43.003956+0000","last_peered":"2024-09-19T11:16:43.003956+0000","last_clean":"2024-09-19T11:16:43.003956+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:16:43.003956+0000","last_undegraded":"2024-09-19T11:16:43.003956+0000","last_fullsized":"2024-09-19T11:16:43.003956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:02.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590332+0000","last_change":"2024-09-19T11:13:31.356268+0000","last_active":"2024-09-19T11:14:07.590332+0000","last_peered":"2024-09-19T11:14:07.590332+0000","last_clean":"2024-09-19T11:14:07.590332+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:14:07.590332+0000","last_undegraded":"2024-09-19T11:14:07.590332+0000","last_fullsized":"2024-09-19T11:14:07.590332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:33.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587433+0000","last_change":"2024-09-19T11:13:35.356889+0000","last_active":"2024-09-19T11:14:07.587433+0000","last_peered":"2024-09-19T11:14:07.587433+0000","last_clean":"2024-09-19T11:14:07.587433+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:14:07.587433+0000","last_undegraded":"2024-09-19T11:14:07.587433+0000","last_fullsized":"2024-09-19T11:14:07.587433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:48.945891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'44","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.550147+0000","last_change":"2024-09-19T11:13:37.358517+0000","last_active":"2024-09-19T11:16:42.550147+0000","last_peered":"2024-09-19T11:16:42.550147+0000","last_clean":"2024-09-19T11:16:42.550147+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:16:42.550147+0000","last_undegraded":"2024-09-19T11:16:42.550147+0000","last_fullsized":"2024-09-19T11:16:42.550147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.932100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":65,"num_write":48,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593589+0000","last_change":"2024-09-19T11:13:39.368887+0000","last_active":"2024-09-19T11:14:07.593589+0000","last_peered":"2024-09-19T11:14:07.593589+0000","last_clean":"2024-09-19T11:14:07.593589+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:14:07.593589+0000","last_undegraded":"2024-09-19T11:14:07.593589+0000","last_fullsized":"2024-09-19T11:14:07.593589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:59.906873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585207+0000","last_change":"2024-09-19T11:13:41.390580+0000","last_active":"2024-09-19T11:14:07.585207+0000","last_peered":"2024-09-19T11:14:07.585207+0000","last_clean":"2024-09-19T11:14:07.585207+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:14:07.585207+0000","last_undegraded":"2024-09-19T11:14:07.585207+0000","last_fullsized":"2024-09-19T11:14:07.585207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:00.635835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.628513+0000","last_change":"2024-09-19T11:13:33.359154+0000","last_active":"2024-09-19T11:16:42.628513+0000","last_peered":"2024-09-19T11:16:42.628513+0000","last_clean":"2024-09-19T11:16:42.628513+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:16:42.628513+0000","last_undegraded":"2024-09-19T11:16:42.628513+0000","last_fullsized":"2024-09-19T11:16:42.628513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.291758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.525594+0000","last_change":"2024-09-19T11:13:31.362807+0000","last_active":"2024-09-19T11:14:14.525594+0000","last_peered":"2024-09-19T11:14:14.525594+0000","last_clean":"2024-09-19T11:14:14.525594+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:14:14.525594+0000","last_undegraded":"2024-09-19T11:14:14.525594+0000","last_fullsized":"2024-09-19T11:14:14.525594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:56.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584231+0000","last_change":"2024-09-19T11:13:35.356852+0000","last_active":"2024-09-19T11:14:07.584231+0000","last_peered":"2024-09-19T11:14:07.584231+0000","last_clean":"2024-09-19T11:14:07.584231+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:14:07.584231+0000","last_undegraded":"2024-09-19T11:14:07.584231+0000","last_fullsized":"2024-09-19T11:14:07.584231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:35.050288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.335466+0000","last_change":"2024-09-19T11:13:37.360189+0000","last_active":"2024-09-19T11:15:40.335466+0000","last_peered":"2024-09-19T11:15:40.335466+0000","last_clean":"2024-09-19T11:15:40.335466+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:15:40.335466+0000","last_undegraded":"2024-09-19T11:15:40.335466+0000","last_fullsized":"2024-09-19T11:15:40.335466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:54.329596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587792+0000","last_change":"2024-09-19T11:13:39.375493+0000","last_active":"2024-09-19T11:14:07.587792+0000","last_peered":"2024-09-19T11:14:07.587792+0000","last_clean":"2024-09-19T11:14:07.587792+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:14:07.587792+0000","last_undegraded":"2024-09-19T11:14:07.587792+0000","last_fullsized":"2024-09-19T11:14:07.587792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:12.594777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.568582+0000","last_change":"2024-09-19T11:13:33.354025+0000","last_active":"2024-09-19T11:15:38.568582+0000","last_peered":"2024-09-19T11:15:38.568582+0000","last_clean":"2024-09-19T11:15:38.568582+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:15:38.568582+0000","last_undegraded":"2024-09-19T11:15:38.568582+0000","last_fullsized":"2024-09-19T11:15:38.568582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:42.535989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.541620+0000","last_change":"2024-09-19T11:13:31.376331+0000","last_active":"2024-09-19T11:15:58.541620+0000","last_peered":"2024-09-19T11:15:58.541620+0000","last_clean":"2024-09-19T11:15:58.541620+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:15:58.541620+0000","last_undegraded":"2024-09-19T11:15:58.541620+0000","last_fullsized":"2024-09-19T11:15:58.541620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:08.223724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588717+0000","last_change":"2024-09-19T11:13:35.357178+0000","last_active":"2024-09-19T11:14:07.588717+0000","last_peered":"2024-09-19T11:14:07.588717+0000","last_clean":"2024-09-19T11:14:07.588717+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:14:07.588717+0000","last_undegraded":"2024-09-19T11:14:07.588717+0000","last_fullsized":"2024-09-19T11:14:07.588717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:59.098976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'57","reported_seq":114,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.356451+0000","last_change":"2024-09-19T11:13:37.363593+0000","last_active":"2024-09-19T11:15:40.356451+0000","last_peered":"2024-09-19T11:15:40.356451+0000","last_clean":"2024-09-19T11:15:40.356451+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:15:40.356451+0000","last_undegraded":"2024-09-19T11:15:40.356451+0000","last_fullsized":"2024-09-19T11:15:40.356451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:57.886776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587378+0000","last_change":"2024-09-19T11:13:39.375431+0000","last_active":"2024-09-19T11:14:07.587378+0000","last_peered":"2024-09-19T11:14:07.587378+0000","last_clean":"2024-09-19T11:14:07.587378+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:14:07.587378+0000","last_undegraded":"2024-09-19T11:14:07.587378+0000","last_fullsized":"2024-09-19T11:14:07.587378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:55.629772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.998936+0000","last_change":"2024-09-19T11:13:41.387630+0000","last_active":"2024-09-19T11:15:41.998936+0000","last_peered":"2024-09-19T11:15:41.998936+0000","last_clean":"2024-09-19T11:15:41.998936+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:15:41.998936+0000","last_undegraded":"2024-09-19T11:15:41.998936+0000","last_fullsized":"2024-09-19T11:15:41.998936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:27.480898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004030+0000","last_change":"2024-09-19T11:13:33.342352+0000","last_active":"2024-09-19T11:16:43.004030+0000","last_peered":"2024-09-19T11:16:43.004030+0000","last_clean":"2024-09-19T11:16:43.004030+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:16:43.004030+0000","last_undegraded":"2024-09-19T11:16:43.004030+0000","last_fullsized":"2024-09-19T11:16:43.004030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:09.205289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.543575+0000","last_change":"2024-09-19T11:13:31.360617+0000","last_active":"2024-09-19T11:15:58.543575+0000","last_peered":"2024-09-19T11:15:58.543575+0000","last_clean":"2024-09-19T11:15:58.543575+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:15:58.543575+0000","last_undegraded":"2024-09-19T11:15:58.543575+0000","last_fullsized":"2024-09-19T11:15:58.543575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:26.660836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590449+0000","last_change":"2024-09-19T11:13:35.350569+0000","last_active":"2024-09-19T11:14:07.590449+0000","last_peered":"2024-09-19T11:14:07.590449+0000","last_clean":"2024-09-19T11:14:07.590449+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:14:07.590449+0000","last_undegraded":"2024-09-19T11:14:07.590449+0000","last_fullsized":"2024-09-19T11:14:07.590449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:44.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.336398+0000","last_change":"2024-09-19T11:13:37.368372+0000","last_active":"2024-09-19T11:15:40.336398+0000","last_peered":"2024-09-19T11:15:40.336398+0000","last_clean":"2024-09-19T11:15:40.336398+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:15:40.336398+0000","last_undegraded":"2024-09-19T11:15:40.336398+0000","last_fullsized":"2024-09-19T11:15:40.336398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:42.470532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595510+0000","last_change":"2024-09-19T11:13:39.377106+0000","last_active":"2024-09-19T11:14:07.595510+0000","last_peered":"2024-09-19T11:14:07.595510+0000","last_clean":"2024-09-19T11:14:07.595510+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:14:07.595510+0000","last_undegraded":"2024-09-19T11:14:07.595510+0000","last_fullsized":"2024-09-19T11:14:07.595510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:40.364349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584320+0000","last_change":"2024-09-19T11:13:41.395172+0000","last_active":"2024-09-19T11:14:07.584320+0000","last_peered":"2024-09-19T11:14:07.584320+0000","last_clean":"2024-09-19T11:14:07.584320+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:14:07.584320+0000","last_undegraded":"2024-09-19T11:14:07.584320+0000","last_fullsized":"2024-09-19T11:14:07.584320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:31.640115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115025+0000","last_change":"2024-09-19T11:13:33.361006+0000","last_active":"2024-09-19T11:14:58.115025+0000","last_peered":"2024-09-19T11:14:58.115025+0000","last_clean":"2024-09-19T11:14:58.115025+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:14:58.115025+0000","last_undegraded":"2024-09-19T11:14:58.115025+0000","last_fullsized":"2024-09-19T11:14:58.115025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:15.458106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.074402+0000","last_change":"2024-09-19T11:13:31.369805+0000","last_active":"2024-09-19T11:15:42.074402+0000","last_peered":"2024-09-19T11:15:42.074402+0000","last_clean":"2024-09-19T11:15:42.074402+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:15:42.074402+0000","last_undegraded":"2024-09-19T11:15:42.074402+0000","last_fullsized":"2024-09-19T11:15:42.074402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:31.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588215+0000","last_change":"2024-09-19T11:13:35.351248+0000","last_active":"2024-09-19T11:14:07.588215+0000","last_peered":"2024-09-19T11:14:07.588215+0000","last_clean":"2024-09-19T11:14:07.588215+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:14:07.588215+0000","last_undegraded":"2024-09-19T11:14:07.588215+0000","last_fullsized":"2024-09-19T11:14:07.588215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:06.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.354147+0000","last_change":"2024-09-19T11:13:37.358368+0000","last_active":"2024-09-19T11:15:40.354147+0000","last_peered":"2024-09-19T11:15:40.354147+0000","last_clean":"2024-09-19T11:15:40.354147+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:15:40.354147+0000","last_undegraded":"2024-09-19T11:15:40.354147+0000","last_fullsized":"2024-09-19T11:15:40.354147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:44.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588427+0000","last_change":"2024-09-19T11:13:39.380360+0000","last_active":"2024-09-19T11:14:07.588427+0000","last_peered":"2024-09-19T11:14:07.588427+0000","last_clean":"2024-09-19T11:14:07.588427+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:14:07.588427+0000","last_undegraded":"2024-09-19T11:14:07.588427+0000","last_fullsized":"2024-09-19T11:14:07.588427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:19.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.092425+0000","last_change":"2024-09-19T11:13:41.392005+0000","last_active":"2024-09-19T11:15:42.092425+0000","last_peered":"2024-09-19T11:15:42.092425+0000","last_clean":"2024-09-19T11:15:42.092425+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:15:42.092425+0000","last_undegraded":"2024-09-19T11:15:42.092425+0000","last_fullsized":"2024-09-19T11:15:42.092425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:49.976836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003882+0000","last_change":"2024-09-19T11:13:33.352824+0000","last_active":"2024-09-19T11:16:43.003882+0000","last_peered":"2024-09-19T11:16:43.003882+0000","last_clean":"2024-09-19T11:16:43.003882+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:16:43.003882+0000","last_undegraded":"2024-09-19T11:16:43.003882+0000","last_fullsized":"2024-09-19T11:16:43.003882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:01.378601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587054+0000","last_change":"2024-09-19T11:13:31.377732+0000","last_active":"2024-09-19T11:14:07.587054+0000","last_peered":"2024-09-19T11:14:07.587054+0000","last_clean":"2024-09-19T11:14:07.587054+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:14:07.587054+0000","last_undegraded":"2024-09-19T11:14:07.587054+0000","last_fullsized":"2024-09-19T11:14:07.587054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:21:08.712618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598624+0000","last_change":"2024-09-19T11:14:07.597921+0000","last_active":"2024-09-19T11:14:07.598624+0000","last_peered":"2024-09-19T11:14:07.598624+0000","last_clean":"2024-09-19T11:14:07.598624+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:14:07.598624+0000","last_undegraded":"2024-09-19T11:14:07.598624+0000","last_fullsized":"2024-09-19T11:14:07.598624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:55.324299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586647+0000","last_change":"2024-09-19T11:13:37.371652+0000","last_active":"2024-09-19T11:14:07.586647+0000","last_peered":"2024-09-19T11:14:07.586647+0000","last_clean":"2024-09-19T11:14:07.586647+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:14:07.586647+0000","last_undegraded":"2024-09-19T11:14:07.586647+0000","last_fullsized":"2024-09-19T11:14:07.586647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:28.501389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":367,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437335+0000","last_change":"2024-09-19T11:13:39.382597+0000","last_active":"2024-09-19T11:16:40.437335+0000","last_peered":"2024-09-19T11:16:40.437335+0000","last_clean":"2024-09-19T11:16:40.437335+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:16:40.437335+0000","last_undegraded":"2024-09-19T11:16:40.437335+0000","last_fullsized":"2024-09-19T11:16:40.437335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:46.620461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.583768+0000","last_change":"2024-09-19T11:13:41.390206+0000","last_active":"2024-09-19T11:14:07.583768+0000","last_peered":"2024-09-19T11:14:07.583768+0000","last_clean":"2024-09-19T11:14:07.583768+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:14:07.583768+0000","last_undegraded":"2024-09-19T11:14:07.583768+0000","last_fullsized":"2024-09-19T11:14:07.583768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:11.171587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003933+0000","last_change":"2024-09-19T11:13:33.345970+0000","last_active":"2024-09-19T11:16:43.003933+0000","last_peered":"2024-09-19T11:16:43.003933+0000","last_clean":"2024-09-19T11:16:43.003933+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:16:43.003933+0000","last_undegraded":"2024-09-19T11:16:43.003933+0000","last_fullsized":"2024-09-19T11:16:43.003933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:42.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596073+0000","last_change":"2024-09-19T11:13:31.363961+0000","last_active":"2024-09-19T11:14:07.596073+0000","last_peered":"2024-09-19T11:14:07.596073+0000","last_clean":"2024-09-19T11:14:07.596073+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:14:07.596073+0000","last_undegraded":"2024-09-19T11:14:07.596073+0000","last_fullsized":"2024-09-19T11:14:07.596073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:09.178158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593781+0000","last_change":"2024-09-19T11:13:35.355437+0000","last_active":"2024-09-19T11:14:07.593781+0000","last_peered":"2024-09-19T11:14:07.593781+0000","last_clean":"2024-09-19T11:14:07.593781+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:14:07.593781+0000","last_undegraded":"2024-09-19T11:14:07.593781+0000","last_fullsized":"2024-09-19T11:14:07.593781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.209336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.327235+0000","last_change":"2024-09-19T11:13:37.367049+0000","last_active":"2024-09-19T11:15:40.327235+0000","last_peered":"2024-09-19T11:15:40.327235+0000","last_clean":"2024-09-19T11:15:40.327235+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:15:40.327235+0000","last_undegraded":"2024-09-19T11:15:40.327235+0000","last_fullsized":"2024-09-19T11:15:40.327235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:18.747358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586010+0000","last_change":"2024-09-19T11:13:39.381142+0000","last_active":"2024-09-19T11:14:07.586010+0000","last_peered":"2024-09-19T11:14:07.586010+0000","last_clean":"2024-09-19T11:14:07.586010+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:14:07.586010+0000","last_undegraded":"2024-09-19T11:14:07.586010+0000","last_fullsized":"2024-09-19T11:14:07.586010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:40.981200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.110163+0000","last_change":"2024-09-19T11:13:41.388869+0000","last_active":"2024-09-19T11:14:58.110163+0000","last_peered":"2024-09-19T11:14:58.110163+0000","last_clean":"2024-09-19T11:14:58.110163+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:14:58.110163+0000","last_undegraded":"2024-09-19T11:14:58.110163+0000","last_fullsized":"2024-09-19T11:14:58.110163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:20.834731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739953+0000","last_change":"2024-09-19T11:13:33.347043+0000","last_active":"2024-09-19T11:16:42.739953+0000","last_peered":"2024-09-19T11:16:42.739953+0000","last_clean":"2024-09-19T11:16:42.739953+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:16:42.739953+0000","last_undegraded":"2024-09-19T11:16:42.739953+0000","last_fullsized":"2024-09-19T11:16:42.739953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587518+0000","last_change":"2024-09-19T11:13:31.371968+0000","last_active":"2024-09-19T11:14:07.587518+0000","last_peered":"2024-09-19T11:14:07.587518+0000","last_clean":"2024-09-19T11:14:07.587518+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:14:07.587518+0000","last_undegraded":"2024-09-19T11:14:07.587518+0000","last_fullsized":"2024-09-19T11:14:07.587518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:11.662633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589719+0000","last_change":"2024-09-19T11:13:35.357430+0000","last_active":"2024-09-19T11:14:07.589719+0000","last_peered":"2024-09-19T11:14:07.589719+0000","last_clean":"2024-09-19T11:14:07.589719+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:14:07.589719+0000","last_undegraded":"2024-09-19T11:14:07.589719+0000","last_fullsized":"2024-09-19T11:14:07.589719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:37.024755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.328327+0000","last_change":"2024-09-19T11:13:37.365759+0000","last_active":"2024-09-19T11:15:40.328327+0000","last_peered":"2024-09-19T11:15:40.328327+0000","last_clean":"2024-09-19T11:15:40.328327+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:15:40.328327+0000","last_undegraded":"2024-09-19T11:15:40.328327+0000","last_fullsized":"2024-09-19T11:15:40.328327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:56.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584006+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.584006+0000","last_peered":"2024-09-19T11:14:07.584006+0000","last_clean":"2024-09-19T11:14:07.584006+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:14:07.584006+0000","last_undegraded":"2024-09-19T11:14:07.584006+0000","last_fullsized":"2024-09-19T11:14:07.584006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:21.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586387+0000","last_change":"2024-09-19T11:13:41.394164+0000","last_active":"2024-09-19T11:14:07.586387+0000","last_peered":"2024-09-19T11:14:07.586387+0000","last_clean":"2024-09-19T11:14:07.586387+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:14:07.586387+0000","last_undegraded":"2024-09-19T11:14:07.586387+0000","last_fullsized":"2024-09-19T11:14:07.586387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.249643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.105117+0000","last_change":"2024-09-19T11:13:33.349183+0000","last_active":"2024-09-19T11:16:43.105117+0000","last_peered":"2024-09-19T11:16:43.105117+0000","last_clean":"2024-09-19T11:16:43.105117+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:16:43.105117+0000","last_undegraded":"2024-09-19T11:16:43.105117+0000","last_fullsized":"2024-09-19T11:16:43.105117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:16.760506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588874+0000","last_change":"2024-09-19T11:13:31.364611+0000","last_active":"2024-09-19T11:14:07.588874+0000","last_peered":"2024-09-19T11:14:07.588874+0000","last_clean":"2024-09-19T11:14:07.588874+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:14:07.588874+0000","last_undegraded":"2024-09-19T11:14:07.588874+0000","last_fullsized":"2024-09-19T11:14:07.588874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:03.025212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.592890+0000","last_change":"2024-09-19T11:13:35.359098+0000","last_active":"2024-09-19T11:14:07.592890+0000","last_peered":"2024-09-19T11:14:07.592890+0000","last_clean":"2024-09-19T11:14:07.592890+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:14:07.592890+0000","last_undegraded":"2024-09-19T11:14:07.592890+0000","last_fullsized":"2024-09-19T11:14:07.592890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.137473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'26","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.351671+0000","last_change":"2024-09-19T11:13:37.368500+0000","last_active":"2024-09-19T11:15:40.351671+0000","last_peered":"2024-09-19T11:15:40.351671+0000","last_clean":"2024-09-19T11:15:40.351671+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:15:40.351671+0000","last_undegraded":"2024-09-19T11:15:40.351671+0000","last_fullsized":"2024-09-19T11:15:40.351671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:42.855744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584628+0000","last_change":"2024-09-19T11:13:39.375517+0000","last_active":"2024-09-19T11:14:07.584628+0000","last_peered":"2024-09-19T11:14:07.584628+0000","last_clean":"2024-09-19T11:14:07.584628+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:14:07.584628+0000","last_undegraded":"2024-09-19T11:14:07.584628+0000","last_fullsized":"2024-09-19T11:14:07.584628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:42.881775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.362489+0000","last_change":"2024-09-19T11:13:41.393750+0000","last_active":"2024-09-19T11:15:40.362489+0000","last_peered":"2024-09-19T11:15:40.362489+0000","last_clean":"2024-09-19T11:15:40.362489+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:15:40.362489+0000","last_undegraded":"2024-09-19T11:15:40.362489+0000","last_fullsized":"2024-09-19T11:15:40.362489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:29.365114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739944+0000","last_change":"2024-09-19T11:13:33.342298+0000","last_active":"2024-09-19T11:16:42.739944+0000","last_peered":"2024-09-19T11:16:42.739944+0000","last_clean":"2024-09-19T11:16:42.739944+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:16:42.739944+0000","last_undegraded":"2024-09-19T11:16:42.739944+0000","last_fullsized":"2024-09-19T11:16:42.739944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:30.192043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.609055+0000","last_change":"2024-09-19T11:13:31.364730+0000","last_active":"2024-09-19T11:16:42.609055+0000","last_peered":"2024-09-19T11:16:42.609055+0000","last_clean":"2024-09-19T11:16:42.609055+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:42.609055+0000","last_undegraded":"2024-09-19T11:16:42.609055+0000","last_fullsized":"2024-09-19T11:16:42.609055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:42.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.945426+0000","last_change":"2024-09-19T11:13:35.357671+0000","last_active":"2024-09-19T11:15:38.945426+0000","last_peered":"2024-09-19T11:15:38.945426+0000","last_clean":"2024-09-19T11:15:38.945426+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:15:38.945426+0000","last_undegraded":"2024-09-19T11:15:38.945426+0000","last_fullsized":"2024-09-19T11:15:38.945426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:03.047743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'34","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.151584+0000","last_change":"2024-09-19T11:13:37.371443+0000","last_active":"2024-09-19T11:16:42.151584+0000","last_peered":"2024-09-19T11:16:42.151584+0000","last_clean":"2024-09-19T11:16:42.151584+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:16:42.151584+0000","last_undegraded":"2024-09-19T11:16:42.151584+0000","last_fullsized":"2024-09-19T11:16:42.151584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.734955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586898+0000","last_change":"2024-09-19T11:13:39.381795+0000","last_active":"2024-09-19T11:14:07.586898+0000","last_peered":"2024-09-19T11:14:07.586898+0000","last_clean":"2024-09-19T11:14:07.586898+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:14:07.586898+0000","last_undegraded":"2024-09-19T11:14:07.586898+0000","last_fullsized":"2024-09-19T11:14:07.586898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:05.918916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.365479+0000","last_change":"2024-09-19T11:13:41.392101+0000","last_active":"2024-09-19T11:15:40.365479+0000","last_peered":"2024-09-19T11:15:40.365479+0000","last_clean":"2024-09-19T11:15:40.365479+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:15:40.365479+0000","last_undegraded":"2024-09-19T11:15:40.365479+0000","last_fullsized":"2024-09-19T11:15:40.365479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:25.270293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.930575+0000","last_change":"2024-09-19T11:13:33.361155+0000","last_active":"2024-09-19T11:14:57.930575+0000","last_peered":"2024-09-19T11:14:57.930575+0000","last_clean":"2024-09-19T11:14:57.930575+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:14:57.930575+0000","last_undegraded":"2024-09-19T11:14:57.930575+0000","last_fullsized":"2024-09-19T11:14:57.930575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:51.951767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.589542+0000","last_change":"2024-09-19T11:13:31.372398+0000","last_active":"2024-09-19T11:14:15.589542+0000","last_peered":"2024-09-19T11:14:15.589542+0000","last_clean":"2024-09-19T11:14:15.589542+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:14:15.589542+0000","last_undegraded":"2024-09-19T11:14:15.589542+0000","last_fullsized":"2024-09-19T11:14:15.589542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:31.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899012+0000","last_change":"2024-09-19T11:13:33.352614+0000","last_active":"2024-09-19T11:16:42.899012+0000","last_peered":"2024-09-19T11:16:42.899012+0000","last_clean":"2024-09-19T11:16:42.899012+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:16:42.899012+0000","last_undegraded":"2024-09-19T11:16:42.899012+0000","last_fullsized":"2024-09-19T11:16:42.899012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:26.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585940+0000","last_change":"2024-09-19T11:13:31.363757+0000","last_active":"2024-09-19T11:14:07.585940+0000","last_peered":"2024-09-19T11:14:07.585940+0000","last_clean":"2024-09-19T11:14:07.585940+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:14:07.585940+0000","last_undegraded":"2024-09-19T11:14:07.585940+0000","last_fullsized":"2024-09-19T11:14:07.585940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:15.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.614216+0000","last_change":"2024-09-19T11:13:33.352551+0000","last_active":"2024-09-19T11:14:15.614216+0000","last_peered":"2024-09-19T11:14:15.614216+0000","last_clean":"2024-09-19T11:14:15.614216+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:14:15.614216+0000","last_undegraded":"2024-09-19T11:14:15.614216+0000","last_fullsized":"2024-09-19T11:14:15.614216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:30.759232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584809+0000","last_change":"2024-09-19T11:13:31.379078+0000","last_active":"2024-09-19T11:14:07.584809+0000","last_peered":"2024-09-19T11:14:07.584809+0000","last_clean":"2024-09-19T11:14:07.584809+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:14:07.584809+0000","last_undegraded":"2024-09-19T11:14:07.584809+0000","last_fullsized":"2024-09-19T11:14:07.584809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.899531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'19","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.972405+0000","last_change":"2024-09-19T11:13:33.352928+0000","last_active":"2024-09-19T11:16:42.972405+0000","last_peered":"2024-09-19T11:16:42.972405+0000","last_clean":"2024-09-19T11:16:42.972405+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:16:42.972405+0000","last_undegraded":"2024-09-19T11:16:42.972405+0000","last_fullsized":"2024-09-19T11:16:42.972405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:48.077538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587528+0000","last_change":"2024-09-19T11:13:31.379320+0000","last_active":"2024-09-19T11:14:07.587528+0000","last_peered":"2024-09-19T11:14:07.587528+0000","last_clean":"2024-09-19T11:14:07.587528+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:14:07.587528+0000","last_undegraded":"2024-09-19T11:14:07.587528+0000","last_fullsized":"2024-09-19T11:14:07.587528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:03.713851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974126+0000","last_change":"2024-09-19T11:13:33.350710+0000","last_active":"2024-09-19T11:16:42.974126+0000","last_peered":"2024-09-19T11:16:42.974126+0000","last_clean":"2024-09-19T11:16:42.974126+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:16:42.974126+0000","last_undegraded":"2024-09-19T11:16:42.974126+0000","last_fullsized":"2024-09-19T11:16:42.974126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:39.016549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587371+0000","last_change":"2024-09-19T11:13:31.364930+0000","last_active":"2024-09-19T11:14:07.587371+0000","last_peered":"2024-09-19T11:14:07.587371+0000","last_clean":"2024-09-19T11:14:07.587371+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:14:07.587371+0000","last_undegraded":"2024-09-19T11:14:07.587371+0000","last_fullsized":"2024-09-19T11:14:07.587371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:12.851669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740563+0000","last_change":"2024-09-19T11:13:33.356293+0000","last_active":"2024-09-19T11:16:42.740563+0000","last_peered":"2024-09-19T11:16:42.740563+0000","last_clean":"2024-09-19T11:16:42.740563+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:16:42.740563+0000","last_undegraded":"2024-09-19T11:16:42.740563+0000","last_fullsized":"2024-09-19T11:16:42.740563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:41.299802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.883059+0000","last_change":"2024-09-19T11:13:31.365707+0000","last_active":"2024-09-19T11:16:42.883059+0000","last_peered":"2024-09-19T11:16:42.883059+0000","last_clean":"2024-09-19T11:16:42.883059+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:16:42.883059+0000","last_undegraded":"2024-09-19T11:16:42.883059+0000","last_fullsized":"2024-09-19T11:16:42.883059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:40.080906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899087+0000","last_change":"2024-09-19T11:13:33.342404+0000","last_active":"2024-09-19T11:16:42.899087+0000","last_peered":"2024-09-19T11:16:42.899087+0000","last_clean":"2024-09-19T11:16:42.899087+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:16:42.899087+0000","last_undegraded":"2024-09-19T11:16:42.899087+0000","last_fullsized":"2024-09-19T11:16:42.899087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:34.386826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.592506+0000","last_change":"2024-09-19T11:13:31.357124+0000","last_active":"2024-09-19T11:14:15.592506+0000","last_peered":"2024-09-19T11:14:15.592506+0000","last_clean":"2024-09-19T11:14:15.592506+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:14:15.592506+0000","last_undegraded":"2024-09-19T11:14:15.592506+0000","last_fullsized":"2024-09-19T11:14:15.592506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:00.612209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114647+0000","last_change":"2024-09-19T11:13:33.350433+0000","last_active":"2024-09-19T11:14:58.114647+0000","last_peered":"2024-09-19T11:14:58.114647+0000","last_clean":"2024-09-19T11:14:58.114647+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:14:58.114647+0000","last_undegraded":"2024-09-19T11:14:58.114647+0000","last_fullsized":"2024-09-19T11:14:58.114647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:46.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.604436+0000","last_change":"2024-09-19T11:13:31.377880+0000","last_active":"2024-09-19T11:14:15.604436+0000","last_peered":"2024-09-19T11:14:15.604436+0000","last_clean":"2024-09-19T11:14:15.604436+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:14:15.604436+0000","last_undegraded":"2024-09-19T11:14:15.604436+0000","last_fullsized":"2024-09-19T11:14:15.604436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:33.996472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.627034+0000","last_change":"2024-09-19T11:13:33.359004+0000","last_active":"2024-09-19T11:16:42.627034+0000","last_peered":"2024-09-19T11:16:42.627034+0000","last_clean":"2024-09-19T11:16:42.627034+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:16:42.627034+0000","last_undegraded":"2024-09-19T11:16:42.627034+0000","last_fullsized":"2024-09-19T11:16:42.627034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:23.555499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584642+0000","last_change":"2024-09-19T11:13:31.375014+0000","last_active":"2024-09-19T11:14:07.584642+0000","last_peered":"2024-09-19T11:14:07.584642+0000","last_clean":"2024-09-19T11:14:07.584642+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:14:07.584642+0000","last_undegraded":"2024-09-19T11:14:07.584642+0000","last_fullsized":"2024-09-19T11:14:07.584642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:40.622834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974025+0000","last_change":"2024-09-19T11:13:33.353505+0000","last_active":"2024-09-19T11:16:42.974025+0000","last_peered":"2024-09-19T11:16:42.974025+0000","last_clean":"2024-09-19T11:16:42.974025+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:16:42.974025+0000","last_undegraded":"2024-09-19T11:16:42.974025+0000","last_fullsized":"2024-09-19T11:16:42.974025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:00.609441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.886205+0000","last_change":"2024-09-19T11:13:31.378087+0000","last_active":"2024-09-19T11:16:42.886205+0000","last_peered":"2024-09-19T11:16:42.886205+0000","last_clean":"2024-09-19T11:16:42.886205+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:16:42.886205+0000","last_undegraded":"2024-09-19T11:16:42.886205+0000","last_fullsized":"2024-09-19T11:16:42.886205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:38.991849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'11","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:50.539564+0000","last_change":"2024-09-19T11:13:33.355120+0000","last_active":"2024-09-19T11:15:50.539564+0000","last_peered":"2024-09-19T11:15:50.539564+0000","last_clean":"2024-09-19T11:15:50.539564+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:15:50.539564+0000","last_undegraded":"2024-09-19T11:15:50.539564+0000","last_fullsized":"2024-09-19T11:15:50.539564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:31.601366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542095+0000","last_change":"2024-09-19T11:13:31.369529+0000","last_active":"2024-09-19T11:15:48.542095+0000","last_peered":"2024-09-19T11:15:48.542095+0000","last_clean":"2024-09-19T11:15:48.542095+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:15:48.542095+0000","last_undegraded":"2024-09-19T11:15:48.542095+0000","last_fullsized":"2024-09-19T11:15:48.542095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:19.935588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003913+0000","last_change":"2024-09-19T11:13:33.343642+0000","last_active":"2024-09-19T11:16:43.003913+0000","last_peered":"2024-09-19T11:16:43.003913+0000","last_clean":"2024-09-19T11:16:43.003913+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:16:43.003913+0000","last_undegraded":"2024-09-19T11:16:43.003913+0000","last_fullsized":"2024-09-19T11:16:43.003913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:53.472377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594243+0000","last_change":"2024-09-19T11:13:31.367046+0000","last_active":"2024-09-19T11:14:07.594243+0000","last_peered":"2024-09-19T11:14:07.594243+0000","last_clean":"2024-09-19T11:14:07.594243+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:14:07.594243+0000","last_undegraded":"2024-09-19T11:14:07.594243+0000","last_fullsized":"2024-09-19T11:14:07.594243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.073704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:14:07.601382+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:18:56.799598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586433+0000","last_change":"2024-09-19T11:13:31.368567+0000","last_active":"2024-09-19T11:14:07.586433+0000","last_peered":"2024-09-19T11:14:07.586433+0000","last_clean":"2024-09-19T11:14:07.586433+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:14:07.586433+0000","last_undegraded":"2024-09-19T11:14:07.586433+0000","last_fullsized":"2024-09-19T11:14:07.586433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:54.576708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'11","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542111+0000","last_change":"2024-09-19T11:13:33.358374+0000","last_active":"2024-09-19T11:15:48.542111+0000","last_peered":"2024-09-19T11:15:48.542111+0000","last_clean":"2024-09-19T11:15:48.542111+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:15:48.542111+0000","last_undegraded":"2024-09-19T11:15:48.542111+0000","last_fullsized":"2024-09-19T11:15:48.542111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:51.284800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587720+0000","last_change":"2024-09-19T11:13:31.368596+0000","last_active":"2024-09-19T11:14:07.587720+0000","last_peered":"2024-09-19T11:14:07.587720+0000","last_clean":"2024-09-19T11:14:07.587720+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:14:07.587720+0000","last_undegraded":"2024-09-19T11:14:07.587720+0000","last_fullsized":"2024-09-19T11:14:07.587720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540107+0000","last_change":"2024-09-19T11:13:33.348514+0000","last_active":"2024-09-19T11:15:48.540107+0000","last_peered":"2024-09-19T11:15:48.540107+0000","last_clean":"2024-09-19T11:15:48.540107+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:15:48.540107+0000","last_undegraded":"2024-09-19T11:15:48.540107+0000","last_fullsized":"2024-09-19T11:15:48.540107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:09.293276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590777+0000","last_change":"2024-09-19T11:13:31.358674+0000","last_active":"2024-09-19T11:14:07.590777+0000","last_peered":"2024-09-19T11:14:07.590777+0000","last_clean":"2024-09-19T11:14:07.590777+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:14:07.590777+0000","last_undegraded":"2024-09-19T11:14:07.590777+0000","last_fullsized":"2024-09-19T11:14:07.590777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:33.620173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380975+0000","last_change":"2024-09-19T11:13:33.349772+0000","last_active":"2024-09-19T11:14:15.380975+0000","last_peered":"2024-09-19T11:14:15.380975+0000","last_clean":"2024-09-19T11:14:15.380975+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:14:15.380975+0000","last_undegraded":"2024-09-19T11:14:15.380975+0000","last_fullsized":"2024-09-19T11:14:15.380975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:19.296584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:53.541138+0000","last_change":"2024-09-19T11:13:31.367744+0000","last_active":"2024-09-19T11:15:53.541138+0000","last_peered":"2024-09-19T11:15:53.541138+0000","last_clean":"2024-09-19T11:15:53.541138+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:15:53.541138+0000","last_undegraded":"2024-09-19T11:15:53.541138+0000","last_fullsized":"2024-09-19T11:15:53.541138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:00.738468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585297+0000","last_change":"2024-09-19T11:13:31.375358+0000","last_active":"2024-09-19T11:14:07.585297+0000","last_peered":"2024-09-19T11:14:07.585297+0000","last_clean":"2024-09-19T11:14:07.585297+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:14:07.585297+0000","last_undegraded":"2024-09-19T11:14:07.585297+0000","last_fullsized":"2024-09-19T11:14:07.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:48:05.720807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898876+0000","last_change":"2024-09-19T11:13:33.349130+0000","last_active":"2024-09-19T11:16:42.898876+0000","last_peered":"2024-09-19T11:16:42.898876+0000","last_clean":"2024-09-19T11:16:42.898876+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:16:42.898876+0000","last_undegraded":"2024-09-19T11:16:42.898876+0000","last_fullsized":"2024-09-19T11:16:42.898876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:05.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:50.539463+0000","last_change":"2024-09-19T11:13:31.378883+0000","last_active":"2024-09-19T11:15:50.539463+0000","last_peered":"2024-09-19T11:15:50.539463+0000","last_clean":"2024-09-19T11:15:50.539463+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:15:50.539463+0000","last_undegraded":"2024-09-19T11:15:50.539463+0000","last_fullsized":"2024-09-19T11:15:50.539463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:53.943968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740036+0000","last_change":"2024-09-19T11:13:33.353238+0000","last_active":"2024-09-19T11:16:42.740036+0000","last_peered":"2024-09-19T11:16:42.740036+0000","last_clean":"2024-09-19T11:16:42.740036+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:16:42.740036+0000","last_undegraded":"2024-09-19T11:16:42.740036+0000","last_fullsized":"2024-09-19T11:16:42.740036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:02.108897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1403,"num_read_kb":1189,"num_write":533,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1276,"ondisk_log_size":1276,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44252,"kb_used_data":8908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327588,"statfs":{"total":96636764160,"available":96591450112,"internally_reserved":0,"allocated":9121792,"data_stored":8769388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44756,"kb_used_data":9412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327084,"statfs":{"total":96636764160,"available":96590934016,"internally_reserved":0,"allocated":9637888,"data_stored":9354762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640304,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44780,"kb_used_data":9436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327060,"statfs":{"total":96636764160,"available":96590909440,"internally_reserved":0,"allocated":9662464,"data_stored":9355091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8768369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:16:50.250 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:16:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.375+0000 7f4551333640 1 Processor -- start 2024-09-19T11:16:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.375+0000 7f4551333640 1 -- start start 2024-09-19T11:16:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.375+0000 7f4551333640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f454c12cba0 0x7f454c1315e0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.375+0000 7f4551333640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f454c09a290 con 0x7f454c12c0b0 2024-09-19T11:16:50.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.375+0000 7f4551333640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f454c071860 con 0x7f454c12cba0 2024-09-19T11:16:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.375+0000 7f45427fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f454c12cba0 0x7f454c1315e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.376+0000 7f454affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f454c12c0b0 0x7f454c12c490 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57658/0 (socket says 172.21.15.37:57658) 2024-09-19T11:16:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.376+0000 7f454affd640 1 -- 172.21.15.37:0/847361059 learned_addr learned my addr 172.21.15.37:0/847361059 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.376+0000 7f45427fc640 1 -- 172.21.15.37:0/847361059 >> v1:172.21.15.37:6789/0 conn(0x7f454c12c0b0 legacy=0x7f454c12c490 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.379 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.376+0000 7f45427fc640 1 -- 172.21.15.37:0/847361059 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c099e20 con 0x7f454c12cba0 2024-09-19T11:16:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f45427fc640 1 --2- 172.21.15.37:0/847361059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12cba0 0x7f454c1315e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4534009750 tx=0x7f453402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b380da56d2fef80 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f454a7fc640 1 -- 172.21.15.37:0/847361059 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4534037070 con 0x7f454c12cba0 2024-09-19T11:16:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f454a7fc640 1 -- 172.21.15.37:0/847361059 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453402ad80 con 0x7f454c12cba0 2024-09-19T11:16:50.380 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f454a7fc640 1 -- 172.21.15.37:0/847361059 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f4534032590 con 0x7f454c12cba0 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f4551333640 1 -- 172.21.15.37:0/847361059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12cba0 msgr2=0x7f454c1315e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f4551333640 1 --2- 172.21.15.37:0/847361059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12cba0 0x7f454c1315e0 secure :-1 s=READY pgs=854 cs=0 l=1 rev1=1 crypto rx=0x7f4534009750 tx=0x7f453402a140 comp rx=0 tx=0).stop 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f4551333640 1 -- 172.21.15.37:0/847361059 shutdown_connections 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f4551333640 1 --2- 172.21.15.37:0/847361059 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12cba0 0x7f454c1315e0 unknown :-1 s=CLOSED pgs=854 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f4551333640 1 -- 172.21.15.37:0/847361059 >> 172.21.15.37:0/847361059 conn(0x7f454c09abc0 msgr2=0x7f454c098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f4551333640 1 -- 172.21.15.37:0/847361059 shutdown_connections 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.377+0000 7f4551333640 1 -- 172.21.15.37:0/847361059 wait complete. 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.378+0000 7f4551333640 1 Processor -- start 2024-09-19T11:16:50.381 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.378+0000 7f4551333640 1 -- start start 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f4551333640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12c0b0 0x7f454c096b70 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f4551333640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f454c070c40 con 0x7f454c12c0b0 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f454affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12c0b0 0x7f454c096b70 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f454affd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12c0b0 0x7f454c096b70 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55088/0 (socket says 172.21.15.37:55088) 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f454affd640 1 -- 172.21.15.37:0/1480821011 learned_addr learned my addr 172.21.15.37:0/1480821011 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f454affd640 1 -- 172.21.15.37:0/1480821011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f454c08c320 con 0x7f454c12c0b0 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f454affd640 1 --2- 172.21.15.37:0/1480821011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12c0b0 0x7f454c096b70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f453c00c480 tx=0x7f453c00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f4543fff640 1 -- 172.21.15.37:0/1480821011 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453c017070 con 0x7f454c12c0b0 2024-09-19T11:16:50.383 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f4543fff640 1 -- 172.21.15.37:0/1480821011 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f453c005c10 con 0x7f454c12c0b0 2024-09-19T11:16:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f4543fff640 1 -- 172.21.15.37:0/1480821011 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f453c007070 con 0x7f454c12c0b0 2024-09-19T11:16:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f454c08c7b0 con 0x7f454c12c0b0 2024-09-19T11:16:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.379+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f454c127450 con 0x7f454c12c0b0 2024-09-19T11:16:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.380+0000 7f4543fff640 1 -- 172.21.15.37:0/1480821011 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f453c01a070 con 0x7f454c12c0b0 2024-09-19T11:16:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.380+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f454c12c490 con 0x7f454c12c0b0 2024-09-19T11:16:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.381+0000 7f4543fff640 1 --2- 172.21.15.37:0/1480821011 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f452c03e710 0x7f452c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.381+0000 7f4543fff640 1 -- 172.21.15.37:0/1480821011 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f453c052a70 con 0x7f454c12c0b0 2024-09-19T11:16:50.384 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.381+0000 7f45427fc640 1 --2- 172.21.15.37:0/1480821011 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f452c03e710 0x7f452c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.385 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.381+0000 7f45427fc640 1 --2- 172.21.15.37:0/1480821011 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f452c03e710 0x7f452c040bd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4534034000 tx=0x7f453402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.387 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.385+0000 7f4543fff640 1 -- 172.21.15.37:0/1480821011 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f453c019cd0 con 0x7f454c12c0b0 2024-09-19T11:16:50.572 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.569+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f454c074090 con 0x7f452c03e710 2024-09-19T11:16:50.581 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.579+0000 7f4543fff640 1 -- 172.21.15.37:0/1480821011 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666061 (secure 0 0 0) 0x7f454c074090 con 0x7f452c03e710 2024-09-19T11:16:50.588 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:16:50.594 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:16:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f452c03e710 msgr2=0x7f452c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 --2- 172.21.15.37:0/1480821011 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f452c03e710 0x7f452c040bd0 secure :-1 s=READY pgs=357 cs=0 l=1 rev1=1 crypto rx=0x7f4534034000 tx=0x7f453402e000 comp rx=0 tx=0).stop 2024-09-19T11:16:50.596 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12c0b0 msgr2=0x7f454c096b70 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 --2- 172.21.15.37:0/1480821011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12c0b0 0x7f454c096b70 secure :-1 s=READY pgs=855 cs=0 l=1 rev1=1 crypto rx=0x7f453c00c480 tx=0x7f453c00c940 comp rx=0 tx=0).stop 2024-09-19T11:16:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 shutdown_connections 2024-09-19T11:16:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 --2- 172.21.15.37:0/1480821011 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f452c03e710 0x7f452c040bd0 unknown :-1 s=CLOSED pgs=357 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 --2- 172.21.15.37:0/1480821011 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f454c12c0b0 0x7f454c096b70 unknown :-1 s=CLOSED pgs=855 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 >> 172.21.15.37:0/1480821011 conn(0x7f454c09abc0 msgr2=0x7f454c097530 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 shutdown_connections 2024-09-19T11:16:50.597 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.584+0000 7f4551333640 1 -- 172.21.15.37:0/1480821011 wait complete. 2024-09-19T11:16:50.597 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":143,"stamp":"2024-09-19T11:16:48.574198+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":26416913,"num_objects":229,"num_object_clones":0,"num_object_copies":472,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":229,"num_whiteouts":0,"num_read":4967,"num_read_kb":4505,"num_write":2052,"num_write_kb":60589,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4436,"ondisk_log_size":4436,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182168,"kb_used_data":36632,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377305192,"statfs":{"total":386547056640,"available":386360516608,"internally_reserved":0,"allocated":37511168,"data_stored":36247610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":25815784,"num_objects":9,"num_object_clones":0,"num_object_copies":32,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":548,"num_read_kb":491,"num_write":388,"num_write_kb":29374,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003988"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.894957+0000","last_change":"2024-09-19T11:13:31.355447+0000","last_active":"2024-09-19T11:15:41.894957+0000","last_peered":"2024-09-19T11:15:41.894957+0000","last_clean":"2024-09-19T11:15:41.894957+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:15:41.894957+0000","last_undegraded":"2024-09-19T11:15:41.894957+0000","last_fullsized":"2024-09-19T11:15:41.894957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:32:10.862799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114848+0000","last_change":"2024-09-19T11:13:33.358262+0000","last_active":"2024-09-19T11:14:58.114848+0000","last_peered":"2024-09-19T11:14:58.114848+0000","last_clean":"2024-09-19T11:14:58.114848+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:14:58.114848+0000","last_undegraded":"2024-09-19T11:14:58.114848+0000","last_fullsized":"2024-09-19T11:14:58.114848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:04.357110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589370+0000","last_change":"2024-09-19T11:13:31.378145+0000","last_active":"2024-09-19T11:14:07.589370+0000","last_peered":"2024-09-19T11:14:07.589370+0000","last_clean":"2024-09-19T11:14:07.589370+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:14:07.589370+0000","last_undegraded":"2024-09-19T11:14:07.589370+0000","last_fullsized":"2024-09-19T11:14:07.589370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.937182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.010386+0000","last_change":"2024-09-19T11:13:33.353250+0000","last_active":"2024-09-19T11:16:43.010386+0000","last_peered":"2024-09-19T11:16:43.010386+0000","last_clean":"2024-09-19T11:16:43.010386+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:16:43.010386+0000","last_undegraded":"2024-09-19T11:16:43.010386+0000","last_fullsized":"2024-09-19T11:16:43.010386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:36.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588134+0000","last_change":"2024-09-19T11:13:31.373399+0000","last_active":"2024-09-19T11:14:07.588134+0000","last_peered":"2024-09-19T11:14:07.588134+0000","last_clean":"2024-09-19T11:14:07.588134+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:14:07.588134+0000","last_undegraded":"2024-09-19T11:14:07.588134+0000","last_fullsized":"2024-09-19T11:14:07.588134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:37.878601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740541+0000","last_change":"2024-09-19T11:14:07.595868+0000","last_active":"2024-09-19T11:16:42.740541+0000","last_peered":"2024-09-19T11:16:42.740541+0000","last_clean":"2024-09-19T11:16:42.740541+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:16:42.740541+0000","last_undegraded":"2024-09-19T11:16:42.740541+0000","last_fullsized":"2024-09-19T11:16:42.740541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:59.387595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588085+0000","last_change":"2024-09-19T11:13:31.369527+0000","last_active":"2024-09-19T11:14:07.588085+0000","last_peered":"2024-09-19T11:14:07.588085+0000","last_clean":"2024-09-19T11:14:07.588085+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:14:07.588085+0000","last_undegraded":"2024-09-19T11:14:07.588085+0000","last_fullsized":"2024-09-19T11:14:07.588085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:42.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.965800+0000","last_change":"2024-09-19T11:13:33.349816+0000","last_active":"2024-09-19T11:16:42.965800+0000","last_peered":"2024-09-19T11:16:42.965800+0000","last_clean":"2024-09-19T11:16:42.965800+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:16:42.965800+0000","last_undegraded":"2024-09-19T11:16:42.965800+0000","last_fullsized":"2024-09-19T11:16:42.965800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:57.078087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586339+0000","last_change":"2024-09-19T11:13:31.373460+0000","last_active":"2024-09-19T11:14:07.586339+0000","last_peered":"2024-09-19T11:14:07.586339+0000","last_clean":"2024-09-19T11:14:07.586339+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:14:07.586339+0000","last_undegraded":"2024-09-19T11:14:07.586339+0000","last_fullsized":"2024-09-19T11:14:07.586339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:25.708826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003992+0000","last_change":"2024-09-19T11:13:33.347020+0000","last_active":"2024-09-19T11:16:43.003992+0000","last_peered":"2024-09-19T11:16:43.003992+0000","last_clean":"2024-09-19T11:16:43.003992+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:16:43.003992+0000","last_undegraded":"2024-09-19T11:16:43.003992+0000","last_fullsized":"2024-09-19T11:16:43.003992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:10.234097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588864+0000","last_change":"2024-09-19T11:13:31.359276+0000","last_active":"2024-09-19T11:14:07.588864+0000","last_peered":"2024-09-19T11:14:07.588864+0000","last_clean":"2024-09-19T11:14:07.588864+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:14:07.588864+0000","last_undegraded":"2024-09-19T11:14:07.588864+0000","last_fullsized":"2024-09-19T11:14:07.588864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.682041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'21","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:13.543344+0000","last_change":"2024-09-19T11:14:07.607174+0000","last_active":"2024-09-19T11:16:13.543344+0000","last_peered":"2024-09-19T11:16:13.543344+0000","last_clean":"2024-09-19T11:16:13.543344+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:16:13.543344+0000","last_undegraded":"2024-09-19T11:16:13.543344+0000","last_fullsized":"2024-09-19T11:16:13.543344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:02.443641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585495+0000","last_change":"2024-09-19T11:13:31.366931+0000","last_active":"2024-09-19T11:14:07.585495+0000","last_peered":"2024-09-19T11:14:07.585495+0000","last_clean":"2024-09-19T11:14:07.585495+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:14:07.585495+0000","last_undegraded":"2024-09-19T11:14:07.585495+0000","last_fullsized":"2024-09-19T11:14:07.585495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:34.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966174+0000","last_change":"2024-09-19T11:13:33.347406+0000","last_active":"2024-09-19T11:16:42.966174+0000","last_peered":"2024-09-19T11:16:42.966174+0000","last_clean":"2024-09-19T11:16:42.966174+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:16:42.966174+0000","last_undegraded":"2024-09-19T11:16:42.966174+0000","last_fullsized":"2024-09-19T11:16:42.966174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:53.972293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.853085+0000","last_change":"2024-09-19T11:13:31.364605+0000","last_active":"2024-09-19T11:15:41.853085+0000","last_peered":"2024-09-19T11:15:41.853085+0000","last_clean":"2024-09-19T11:15:41.853085+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:15:41.853085+0000","last_undegraded":"2024-09-19T11:15:41.853085+0000","last_fullsized":"2024-09-19T11:15:41.853085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:34.677119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:13:33.353995+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:03.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096691+0000","last_change":"2024-09-19T11:13:33.353058+0000","last_active":"2024-09-19T11:15:42.096691+0000","last_peered":"2024-09-19T11:15:42.096691+0000","last_clean":"2024-09-19T11:15:42.096691+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:15:42.096691+0000","last_undegraded":"2024-09-19T11:15:42.096691+0000","last_fullsized":"2024-09-19T11:15:42.096691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:02.922700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.597092+0000","last_change":"2024-09-19T11:13:31.365956+0000","last_active":"2024-09-19T11:14:07.597092+0000","last_peered":"2024-09-19T11:14:07.597092+0000","last_clean":"2024-09-19T11:14:07.597092+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:14:07.597092+0000","last_undegraded":"2024-09-19T11:14:07.597092+0000","last_fullsized":"2024-09-19T11:14:07.597092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:41.205308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594343+0000","last_change":"2024-09-19T11:13:33.357169+0000","last_active":"2024-09-19T11:14:07.594343+0000","last_peered":"2024-09-19T11:14:07.594343+0000","last_clean":"2024-09-19T11:14:07.594343+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:14:07.594343+0000","last_undegraded":"2024-09-19T11:14:07.594343+0000","last_fullsized":"2024-09-19T11:14:07.594343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.541252+0000","last_change":"2024-09-19T11:13:31.372373+0000","last_active":"2024-09-19T11:15:58.541252+0000","last_peered":"2024-09-19T11:15:58.541252+0000","last_clean":"2024-09-19T11:15:58.541252+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:15:58.541252+0000","last_undegraded":"2024-09-19T11:15:58.541252+0000","last_fullsized":"2024-09-19T11:15:58.541252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.073704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595274+0000","last_change":"2024-09-19T11:13:33.359507+0000","last_active":"2024-09-19T11:14:07.595274+0000","last_peered":"2024-09-19T11:14:07.595274+0000","last_clean":"2024-09-19T11:14:07.595274+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:14:07.595274+0000","last_undegraded":"2024-09-19T11:14:07.595274+0000","last_fullsized":"2024-09-19T11:14:07.595274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.272518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.103060+0000","last_change":"2024-09-19T11:13:31.365136+0000","last_active":"2024-09-19T11:14:58.103060+0000","last_peered":"2024-09-19T11:14:58.103060+0000","last_clean":"2024-09-19T11:14:58.103060+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:14:58.103060+0000","last_undegraded":"2024-09-19T11:14:58.103060+0000","last_fullsized":"2024-09-19T11:14:58.103060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.682041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966073+0000","last_change":"2024-09-19T11:13:33.350242+0000","last_active":"2024-09-19T11:16:42.966073+0000","last_peered":"2024-09-19T11:16:42.966073+0000","last_clean":"2024-09-19T11:16:42.966073+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:16:42.966073+0000","last_undegraded":"2024-09-19T11:16:42.966073+0000","last_fullsized":"2024-09-19T11:16:42.966073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:29.796543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595616+0000","last_change":"2024-09-19T11:13:31.364143+0000","last_active":"2024-09-19T11:14:07.595616+0000","last_peered":"2024-09-19T11:14:07.595616+0000","last_clean":"2024-09-19T11:14:07.595616+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:14:07.595616+0000","last_undegraded":"2024-09-19T11:14:07.595616+0000","last_fullsized":"2024-09-19T11:14:07.595616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:37.328576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004192+0000","last_change":"2024-09-19T11:13:33.354404+0000","last_active":"2024-09-19T11:16:43.004192+0000","last_peered":"2024-09-19T11:16:43.004192+0000","last_clean":"2024-09-19T11:16:43.004192+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:16:43.004192+0000","last_undegraded":"2024-09-19T11:16:43.004192+0000","last_fullsized":"2024-09-19T11:16:43.004192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.704309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.524833+0000","last_change":"2024-09-19T11:13:31.379619+0000","last_active":"2024-09-19T11:14:14.524833+0000","last_peered":"2024-09-19T11:14:14.524833+0000","last_clean":"2024-09-19T11:14:14.524833+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:14:14.524833+0000","last_undegraded":"2024-09-19T11:14:14.524833+0000","last_fullsized":"2024-09-19T11:14:14.524833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:44.219899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380970+0000","last_change":"2024-09-19T11:13:33.345480+0000","last_active":"2024-09-19T11:14:15.380970+0000","last_peered":"2024-09-19T11:14:15.380970+0000","last_clean":"2024-09-19T11:14:15.380970+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:14:15.380970+0000","last_undegraded":"2024-09-19T11:14:15.380970+0000","last_fullsized":"2024-09-19T11:14:15.380970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:37.629627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585477+0000","last_change":"2024-09-19T11:13:31.368987+0000","last_active":"2024-09-19T11:14:07.585477+0000","last_peered":"2024-09-19T11:14:07.585477+0000","last_clean":"2024-09-19T11:14:07.585477+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:14:07.585477+0000","last_undegraded":"2024-09-19T11:14:07.585477+0000","last_fullsized":"2024-09-19T11:14:07.585477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:51.462004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.938013+0000","last_change":"2024-09-19T11:13:41.395109+0000","last_active":"2024-09-19T11:16:42.938013+0000","last_peered":"2024-09-19T11:16:42.938013+0000","last_clean":"2024-09-19T11:16:42.938013+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:16:42.938013+0000","last_undegraded":"2024-09-19T11:16:42.938013+0000","last_fullsized":"2024-09-19T11:16:42.938013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:41.943528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.635691+0000","last_change":"2024-09-19T11:13:33.348565+0000","last_active":"2024-09-19T11:16:42.635691+0000","last_peered":"2024-09-19T11:16:42.635691+0000","last_clean":"2024-09-19T11:16:42.635691+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:16:42.635691+0000","last_undegraded":"2024-09-19T11:16:42.635691+0000","last_fullsized":"2024-09-19T11:16:42.635691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:09.744080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585089+0000","last_change":"2024-09-19T11:13:31.378052+0000","last_active":"2024-09-19T11:14:07.585089+0000","last_peered":"2024-09-19T11:14:07.585089+0000","last_clean":"2024-09-19T11:14:07.585089+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:14:07.585089+0000","last_undegraded":"2024-09-19T11:14:07.585089+0000","last_fullsized":"2024-09-19T11:14:07.585089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:57.883105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586243+0000","last_change":"2024-09-19T11:13:35.358078+0000","last_active":"2024-09-19T11:14:07.586243+0000","last_peered":"2024-09-19T11:14:07.586243+0000","last_clean":"2024-09-19T11:14:07.586243+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:14:07.586243+0000","last_undegraded":"2024-09-19T11:14:07.586243+0000","last_fullsized":"2024-09-19T11:14:07.586243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:59.783214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.344946+0000","last_change":"2024-09-19T11:13:37.368405+0000","last_active":"2024-09-19T11:15:40.344946+0000","last_peered":"2024-09-19T11:15:40.344946+0000","last_clean":"2024-09-19T11:15:40.344946+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:15:40.344946+0000","last_undegraded":"2024-09-19T11:15:40.344946+0000","last_fullsized":"2024-09-19T11:15:40.344946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:09.867739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596623+0000","last_change":"2024-09-19T11:13:39.376399+0000","last_active":"2024-09-19T11:14:07.596623+0000","last_peered":"2024-09-19T11:14:07.596623+0000","last_clean":"2024-09-19T11:14:07.596623+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:14:07.596623+0000","last_undegraded":"2024-09-19T11:14:07.596623+0000","last_fullsized":"2024-09-19T11:14:07.596623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:16.668274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.935993+0000","last_change":"2024-09-19T11:13:41.393295+0000","last_active":"2024-09-19T11:14:57.935993+0000","last_peered":"2024-09-19T11:14:57.935993+0000","last_clean":"2024-09-19T11:14:57.935993+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:14:57.935993+0000","last_undegraded":"2024-09-19T11:14:57.935993+0000","last_fullsized":"2024-09-19T11:14:57.935993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:48.199857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112515+0000","last_change":"2024-09-19T11:13:33.353288+0000","last_active":"2024-09-19T11:14:58.112515+0000","last_peered":"2024-09-19T11:14:58.112515+0000","last_clean":"2024-09-19T11:14:58.112515+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:14:58.112515+0000","last_undegraded":"2024-09-19T11:14:58.112515+0000","last_fullsized":"2024-09-19T11:14:58.112515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.684931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.037595+0000","last_change":"2024-09-19T11:13:31.359853+0000","last_active":"2024-09-19T11:15:42.037595+0000","last_peered":"2024-09-19T11:15:42.037595+0000","last_clean":"2024-09-19T11:15:42.037595+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:15:42.037595+0000","last_undegraded":"2024-09-19T11:15:42.037595+0000","last_fullsized":"2024-09-19T11:15:42.037595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:35.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586880+0000","last_change":"2024-09-19T11:13:35.350079+0000","last_active":"2024-09-19T11:14:07.586880+0000","last_peered":"2024-09-19T11:14:07.586880+0000","last_clean":"2024-09-19T11:14:07.586880+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:14:07.586880+0000","last_undegraded":"2024-09-19T11:14:07.586880+0000","last_fullsized":"2024-09-19T11:14:07.586880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:28.629336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596198+0000","last_change":"2024-09-19T11:13:37.365209+0000","last_active":"2024-09-19T11:14:07.596198+0000","last_peered":"2024-09-19T11:14:07.596198+0000","last_clean":"2024-09-19T11:14:07.596198+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:14:07.596198+0000","last_undegraded":"2024-09-19T11:14:07.596198+0000","last_fullsized":"2024-09-19T11:14:07.596198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:11.593458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595746+0000","last_change":"2024-09-19T11:13:39.377776+0000","last_active":"2024-09-19T11:14:07.595746+0000","last_peered":"2024-09-19T11:14:07.595746+0000","last_clean":"2024-09-19T11:14:07.595746+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:14:07.595746+0000","last_undegraded":"2024-09-19T11:14:07.595746+0000","last_fullsized":"2024-09-19T11:14:07.595746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:02.688553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586216+0000","last_change":"2024-09-19T11:13:41.387845+0000","last_active":"2024-09-19T11:14:07.586216+0000","last_peered":"2024-09-19T11:14:07.586216+0000","last_clean":"2024-09-19T11:14:07.586216+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:14:07.586216+0000","last_undegraded":"2024-09-19T11:14:07.586216+0000","last_fullsized":"2024-09-19T11:14:07.586216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:01.782452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004066+0000","last_change":"2024-09-19T11:13:33.354310+0000","last_active":"2024-09-19T11:16:43.004066+0000","last_peered":"2024-09-19T11:16:43.004066+0000","last_clean":"2024-09-19T11:16:43.004066+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:16:43.004066+0000","last_undegraded":"2024-09-19T11:16:43.004066+0000","last_fullsized":"2024-09-19T11:16:43.004066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.803193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584449+0000","last_change":"2024-09-19T11:13:31.367163+0000","last_active":"2024-09-19T11:14:07.584449+0000","last_peered":"2024-09-19T11:14:07.584449+0000","last_clean":"2024-09-19T11:14:07.584449+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:14:07.584449+0000","last_undegraded":"2024-09-19T11:14:07.584449+0000","last_fullsized":"2024-09-19T11:14:07.584449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:05.930286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:08.524886+0000","last_change":"2024-09-19T11:14:07.594305+0000","last_active":"2024-09-19T11:14:08.524886+0000","last_peered":"2024-09-19T11:14:08.524886+0000","last_clean":"2024-09-19T11:14:08.524886+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:14:08.524886+0000","last_undegraded":"2024-09-19T11:14:08.524886+0000","last_fullsized":"2024-09-19T11:14:08.524886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:34.741293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587760+0000","last_change":"2024-09-19T11:13:37.365423+0000","last_active":"2024-09-19T11:14:07.587760+0000","last_peered":"2024-09-19T11:14:07.587760+0000","last_clean":"2024-09-19T11:14:07.587760+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:14:07.587760+0000","last_undegraded":"2024-09-19T11:14:07.587760+0000","last_fullsized":"2024-09-19T11:14:07.587760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:05.026614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":382,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437367+0000","last_change":"2024-09-19T11:13:39.380724+0000","last_active":"2024-09-19T11:16:40.437367+0000","last_peered":"2024-09-19T11:16:40.437367+0000","last_clean":"2024-09-19T11:16:40.437367+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:16:40.437367+0000","last_undegraded":"2024-09-19T11:16:40.437367+0000","last_fullsized":"2024-09-19T11:16:40.437367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587647+0000","last_change":"2024-09-19T11:13:41.387332+0000","last_active":"2024-09-19T11:14:07.587647+0000","last_peered":"2024-09-19T11:14:07.587647+0000","last_clean":"2024-09-19T11:14:07.587647+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:14:07.587647+0000","last_undegraded":"2024-09-19T11:14:07.587647+0000","last_fullsized":"2024-09-19T11:14:07.587647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:45.206952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740577+0000","last_change":"2024-09-19T11:13:33.349800+0000","last_active":"2024-09-19T11:16:42.740577+0000","last_peered":"2024-09-19T11:16:42.740577+0000","last_clean":"2024-09-19T11:16:42.740577+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:16:42.740577+0000","last_undegraded":"2024-09-19T11:16:42.740577+0000","last_fullsized":"2024-09-19T11:16:42.740577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.241186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.999172+0000","last_change":"2024-09-19T11:13:31.365771+0000","last_active":"2024-09-19T11:16:42.999172+0000","last_peered":"2024-09-19T11:16:42.999172+0000","last_clean":"2024-09-19T11:16:42.999172+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:42.999172+0000","last_undegraded":"2024-09-19T11:16:42.999172+0000","last_fullsized":"2024-09-19T11:16:42.999172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:03.270284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586260+0000","last_change":"2024-09-19T11:13:35.355473+0000","last_active":"2024-09-19T11:14:07.586260+0000","last_peered":"2024-09-19T11:14:07.586260+0000","last_clean":"2024-09-19T11:14:07.586260+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:14:07.586260+0000","last_undegraded":"2024-09-19T11:14:07.586260+0000","last_fullsized":"2024-09-19T11:14:07.586260+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:26.695828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.339270+0000","last_change":"2024-09-19T11:13:37.367406+0000","last_active":"2024-09-19T11:15:40.339270+0000","last_peered":"2024-09-19T11:15:40.339270+0000","last_clean":"2024-09-19T11:15:40.339270+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:15:40.339270+0000","last_undegraded":"2024-09-19T11:15:40.339270+0000","last_fullsized":"2024-09-19T11:15:40.339270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.650159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'282","reported_seq":442,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.007015+0000","last_change":"2024-09-19T11:13:39.380575+0000","last_active":"2024-09-19T11:16:43.007015+0000","last_peered":"2024-09-19T11:16:43.007015+0000","last_clean":"2024-09-19T11:16:43.007015+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:16:43.007015+0000","last_undegraded":"2024-09-19T11:16:43.007015+0000","last_fullsized":"2024-09-19T11:16:43.007015+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:21.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898938+0000","last_change":"2024-09-19T11:13:33.354325+0000","last_active":"2024-09-19T11:16:42.898938+0000","last_peered":"2024-09-19T11:16:42.898938+0000","last_clean":"2024-09-19T11:16:42.898938+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:16:42.898938+0000","last_undegraded":"2024-09-19T11:16:42.898938+0000","last_fullsized":"2024-09-19T11:16:42.898938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:50.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.591224+0000","last_change":"2024-09-19T11:13:31.353600+0000","last_active":"2024-09-19T11:14:07.591224+0000","last_peered":"2024-09-19T11:14:07.591224+0000","last_clean":"2024-09-19T11:14:07.591224+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:14:07.591224+0000","last_undegraded":"2024-09-19T11:14:07.591224+0000","last_fullsized":"2024-09-19T11:14:07.591224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:09.178158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593431+0000","last_change":"2024-09-19T11:13:35.356693+0000","last_active":"2024-09-19T11:14:07.593431+0000","last_peered":"2024-09-19T11:14:07.593431+0000","last_clean":"2024-09-19T11:14:07.593431+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:14:07.593431+0000","last_undegraded":"2024-09-19T11:14:07.593431+0000","last_fullsized":"2024-09-19T11:14:07.593431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:50.222469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'40","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.348918+0000","last_change":"2024-09-19T11:13:37.371444+0000","last_active":"2024-09-19T11:15:40.348918+0000","last_peered":"2024-09-19T11:15:40.348918+0000","last_clean":"2024-09-19T11:15:40.348918+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:15:40.348918+0000","last_undegraded":"2024-09-19T11:15:40.348918+0000","last_fullsized":"2024-09-19T11:15:40.348918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:45.830373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587567+0000","last_change":"2024-09-19T11:13:39.374414+0000","last_active":"2024-09-19T11:14:07.587567+0000","last_peered":"2024-09-19T11:14:07.587567+0000","last_clean":"2024-09-19T11:14:07.587567+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:14:07.587567+0000","last_undegraded":"2024-09-19T11:14:07.587567+0000","last_fullsized":"2024-09-19T11:14:07.587567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:56.581253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.937677+0000","last_change":"2024-09-19T11:13:41.391613+0000","last_active":"2024-09-19T11:14:57.937677+0000","last_peered":"2024-09-19T11:14:57.937677+0000","last_clean":"2024-09-19T11:14:57.937677+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:14:57.937677+0000","last_undegraded":"2024-09-19T11:14:57.937677+0000","last_fullsized":"2024-09-19T11:14:57.937677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:05.344146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740320+0000","last_change":"2024-09-19T11:13:33.342412+0000","last_active":"2024-09-19T11:16:42.740320+0000","last_peered":"2024-09-19T11:16:42.740320+0000","last_clean":"2024-09-19T11:16:42.740320+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:16:42.740320+0000","last_undegraded":"2024-09-19T11:16:42.740320+0000","last_fullsized":"2024-09-19T11:16:42.740320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590222+0000","last_change":"2024-09-19T11:13:31.355731+0000","last_active":"2024-09-19T11:14:07.590222+0000","last_peered":"2024-09-19T11:14:07.590222+0000","last_clean":"2024-09-19T11:14:07.590222+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:14:07.590222+0000","last_undegraded":"2024-09-19T11:14:07.590222+0000","last_fullsized":"2024-09-19T11:14:07.590222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:05.006192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586420+0000","last_change":"2024-09-19T11:13:35.352067+0000","last_active":"2024-09-19T11:14:07.586420+0000","last_peered":"2024-09-19T11:14:07.586420+0000","last_clean":"2024-09-19T11:14:07.586420+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:14:07.586420+0000","last_undegraded":"2024-09-19T11:14:07.586420+0000","last_fullsized":"2024-09-19T11:14:07.586420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:58.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.329228+0000","last_change":"2024-09-19T11:13:37.369761+0000","last_active":"2024-09-19T11:15:40.329228+0000","last_peered":"2024-09-19T11:15:40.329228+0000","last_clean":"2024-09-19T11:15:40.329228+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:15:40.329228+0000","last_undegraded":"2024-09-19T11:15:40.329228+0000","last_fullsized":"2024-09-19T11:15:40.329228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.455607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587463+0000","last_change":"2024-09-19T11:13:39.381205+0000","last_active":"2024-09-19T11:14:07.587463+0000","last_peered":"2024-09-19T11:14:07.587463+0000","last_clean":"2024-09-19T11:14:07.587463+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:14:07.587463+0000","last_undegraded":"2024-09-19T11:14:07.587463+0000","last_fullsized":"2024-09-19T11:14:07.587463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:48.612042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:52.381729+0000","last_change":"2024-09-19T11:13:41.393002+0000","last_active":"2024-09-19T11:14:52.381729+0000","last_peered":"2024-09-19T11:14:52.381729+0000","last_clean":"2024-09-19T11:14:52.381729+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:14:52.381729+0000","last_undegraded":"2024-09-19T11:14:52.381729+0000","last_fullsized":"2024-09-19T11:14:52.381729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:23.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115156+0000","last_change":"2024-09-19T11:13:33.351582+0000","last_active":"2024-09-19T11:14:58.115156+0000","last_peered":"2024-09-19T11:14:58.115156+0000","last_clean":"2024-09-19T11:14:58.115156+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:14:58.115156+0000","last_undegraded":"2024-09-19T11:14:58.115156+0000","last_fullsized":"2024-09-19T11:14:58.115156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587814+0000","last_change":"2024-09-19T11:13:31.376937+0000","last_active":"2024-09-19T11:14:07.587814+0000","last_peered":"2024-09-19T11:14:07.587814+0000","last_clean":"2024-09-19T11:14:07.587814+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:14:07.587814+0000","last_undegraded":"2024-09-19T11:14:07.587814+0000","last_fullsized":"2024-09-19T11:14:07.587814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:00.098524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587259+0000","last_change":"2024-09-19T11:13:35.349926+0000","last_active":"2024-09-19T11:14:07.587259+0000","last_peered":"2024-09-19T11:14:07.587259+0000","last_clean":"2024-09-19T11:14:07.587259+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:14:07.587259+0000","last_undegraded":"2024-09-19T11:14:07.587259+0000","last_fullsized":"2024-09-19T11:14:07.587259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:43.037527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'37","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540038+0000","last_change":"2024-09-19T11:13:37.371294+0000","last_active":"2024-09-19T11:15:48.540038+0000","last_peered":"2024-09-19T11:15:48.540038+0000","last_clean":"2024-09-19T11:15:48.540038+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:15:48.540038+0000","last_undegraded":"2024-09-19T11:15:48.540038+0000","last_fullsized":"2024-09-19T11:15:48.540038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:44.761683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'282","reported_seq":349,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.280499+0000","last_change":"2024-09-19T11:13:39.381485+0000","last_active":"2024-09-19T11:16:43.280499+0000","last_peered":"2024-09-19T11:16:43.280499+0000","last_clean":"2024-09-19T11:16:43.280499+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:16:43.280499+0000","last_undegraded":"2024-09-19T11:16:43.280499+0000","last_fullsized":"2024-09-19T11:16:43.280499+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:13.407016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.028397+0000","last_change":"2024-09-19T11:13:41.390450+0000","last_active":"2024-09-19T11:14:15.028397+0000","last_peered":"2024-09-19T11:14:15.028397+0000","last_clean":"2024-09-19T11:14:15.028397+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:14:15.028397+0000","last_undegraded":"2024-09-19T11:14:15.028397+0000","last_fullsized":"2024-09-19T11:14:15.028397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.925221+0000","last_change":"2024-09-19T11:13:33.346907+0000","last_active":"2024-09-19T11:14:57.925221+0000","last_peered":"2024-09-19T11:14:57.925221+0000","last_clean":"2024-09-19T11:14:57.925221+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:14:57.925221+0000","last_undegraded":"2024-09-19T11:14:57.925221+0000","last_fullsized":"2024-09-19T11:14:57.925221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:38.606989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585782+0000","last_change":"2024-09-19T11:13:31.373736+0000","last_active":"2024-09-19T11:14:07.585782+0000","last_peered":"2024-09-19T11:14:07.585782+0000","last_clean":"2024-09-19T11:14:07.585782+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:14:07.585782+0000","last_undegraded":"2024-09-19T11:14:07.585782+0000","last_fullsized":"2024-09-19T11:14:07.585782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:35.619254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586467+0000","last_change":"2024-09-19T11:13:35.353930+0000","last_active":"2024-09-19T11:14:07.586467+0000","last_peered":"2024-09-19T11:14:07.586467+0000","last_clean":"2024-09-19T11:14:07.586467+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:14:07.586467+0000","last_undegraded":"2024-09-19T11:14:07.586467+0000","last_fullsized":"2024-09-19T11:14:07.586467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:50.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'55","reported_seq":112,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.352655+0000","last_change":"2024-09-19T11:13:37.371428+0000","last_active":"2024-09-19T11:15:40.352655+0000","last_peered":"2024-09-19T11:15:40.352655+0000","last_clean":"2024-09-19T11:15:40.352655+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:15:40.352655+0000","last_undegraded":"2024-09-19T11:15:40.352655+0000","last_fullsized":"2024-09-19T11:15:40.352655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:11.185147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586195+0000","last_change":"2024-09-19T11:13:39.369302+0000","last_active":"2024-09-19T11:14:07.586195+0000","last_peered":"2024-09-19T11:14:07.586195+0000","last_clean":"2024-09-19T11:14:07.586195+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:14:07.586195+0000","last_undegraded":"2024-09-19T11:14:07.586195+0000","last_fullsized":"2024-09-19T11:14:07.586195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:58.150298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.223256+0000","last_change":"2024-09-19T11:13:41.385457+0000","last_active":"2024-09-19T11:16:43.223256+0000","last_peered":"2024-09-19T11:16:43.223256+0000","last_clean":"2024-09-19T11:16:43.223256+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:16:43.223256+0000","last_undegraded":"2024-09-19T11:16:43.223256+0000","last_fullsized":"2024-09-19T11:16:43.223256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:04.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740486+0000","last_change":"2024-09-19T11:13:33.354021+0000","last_active":"2024-09-19T11:16:42.740486+0000","last_peered":"2024-09-19T11:16:42.740486+0000","last_clean":"2024-09-19T11:16:42.740486+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:16:42.740486+0000","last_undegraded":"2024-09-19T11:16:42.740486+0000","last_fullsized":"2024-09-19T11:16:42.740486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:06.071580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587381+0000","last_change":"2024-09-19T11:13:31.378149+0000","last_active":"2024-09-19T11:14:07.587381+0000","last_peered":"2024-09-19T11:14:07.587381+0000","last_clean":"2024-09-19T11:14:07.587381+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:14:07.587381+0000","last_undegraded":"2024-09-19T11:14:07.587381+0000","last_fullsized":"2024-09-19T11:14:07.587381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:54.799765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589532+0000","last_change":"2024-09-19T11:13:35.359219+0000","last_active":"2024-09-19T11:14:07.589532+0000","last_peered":"2024-09-19T11:14:07.589532+0000","last_clean":"2024-09-19T11:14:07.589532+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:14:07.589532+0000","last_undegraded":"2024-09-19T11:14:07.589532+0000","last_fullsized":"2024-09-19T11:14:07.589532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:43.307746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.333416+0000","last_change":"2024-09-19T11:13:37.362218+0000","last_active":"2024-09-19T11:15:40.333416+0000","last_peered":"2024-09-19T11:15:40.333416+0000","last_clean":"2024-09-19T11:15:40.333416+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:15:40.333416+0000","last_undegraded":"2024-09-19T11:15:40.333416+0000","last_fullsized":"2024-09-19T11:15:40.333416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:38.878721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589393+0000","last_change":"2024-09-19T11:13:39.378975+0000","last_active":"2024-09-19T11:14:07.589393+0000","last_peered":"2024-09-19T11:14:07.589393+0000","last_clean":"2024-09-19T11:14:07.589393+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:14:07.589393+0000","last_undegraded":"2024-09-19T11:14:07.589393+0000","last_fullsized":"2024-09-19T11:14:07.589393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:43.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:43.539247+0000","last_change":"2024-09-19T11:13:41.390986+0000","last_active":"2024-09-19T11:15:43.539247+0000","last_peered":"2024-09-19T11:15:43.539247+0000","last_clean":"2024-09-19T11:15:43.539247+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:15:43.539247+0000","last_undegraded":"2024-09-19T11:15:43.539247+0000","last_fullsized":"2024-09-19T11:15:43.539247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:29.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588444+0000","last_change":"2024-09-19T11:13:33.360955+0000","last_active":"2024-09-19T11:14:07.588444+0000","last_peered":"2024-09-19T11:14:07.588444+0000","last_clean":"2024-09-19T11:14:07.588444+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:14:07.588444+0000","last_undegraded":"2024-09-19T11:14:07.588444+0000","last_fullsized":"2024-09-19T11:14:07.588444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.739277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.595717+0000","last_change":"2024-09-19T11:13:31.378434+0000","last_active":"2024-09-19T11:14:15.595717+0000","last_peered":"2024-09-19T11:14:15.595717+0000","last_clean":"2024-09-19T11:14:15.595717+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:14:15.595717+0000","last_undegraded":"2024-09-19T11:14:15.595717+0000","last_fullsized":"2024-09-19T11:14:15.595717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:49.941394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586955+0000","last_change":"2024-09-19T11:13:35.348523+0000","last_active":"2024-09-19T11:14:07.586955+0000","last_peered":"2024-09-19T11:14:07.586955+0000","last_clean":"2024-09-19T11:14:07.586955+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:14:07.586955+0000","last_undegraded":"2024-09-19T11:14:07.586955+0000","last_fullsized":"2024-09-19T11:14:07.586955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:26.593052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.360329+0000","last_change":"2024-09-19T11:13:37.362855+0000","last_active":"2024-09-19T11:15:40.360329+0000","last_peered":"2024-09-19T11:15:40.360329+0000","last_clean":"2024-09-19T11:15:40.360329+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:15:40.360329+0000","last_undegraded":"2024-09-19T11:15:40.360329+0000","last_fullsized":"2024-09-19T11:15:40.360329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:36.268162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":432,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.227280+0000","last_change":"2024-09-19T11:13:39.381222+0000","last_active":"2024-09-19T11:16:43.227280+0000","last_peered":"2024-09-19T11:16:43.227280+0000","last_clean":"2024-09-19T11:16:43.227280+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:16:43.227280+0000","last_undegraded":"2024-09-19T11:16:43.227280+0000","last_fullsized":"2024-09-19T11:16:43.227280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:02.724027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:45.538583+0000","last_change":"2024-09-19T11:13:41.387843+0000","last_active":"2024-09-19T11:15:45.538583+0000","last_peered":"2024-09-19T11:15:45.538583+0000","last_clean":"2024-09-19T11:15:45.538583+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:15:45.538583+0000","last_undegraded":"2024-09-19T11:15:45.538583+0000","last_fullsized":"2024-09-19T11:15:45.538583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.060376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.539438+0000","last_change":"2024-09-19T11:13:33.351314+0000","last_active":"2024-09-19T11:15:48.539438+0000","last_peered":"2024-09-19T11:15:48.539438+0000","last_clean":"2024-09-19T11:15:48.539438+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:15:48.539438+0000","last_undegraded":"2024-09-19T11:15:48.539438+0000","last_fullsized":"2024-09-19T11:15:48.539438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:21.853847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.893715+0000","last_change":"2024-09-19T11:13:31.368833+0000","last_active":"2024-09-19T11:16:42.893715+0000","last_peered":"2024-09-19T11:16:42.893715+0000","last_clean":"2024-09-19T11:16:42.893715+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:16:42.893715+0000","last_undegraded":"2024-09-19T11:16:42.893715+0000","last_fullsized":"2024-09-19T11:16:42.893715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:58.341667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.444942+0000","last_change":"2024-09-19T11:13:35.352798+0000","last_active":"2024-09-19T11:15:41.444942+0000","last_peered":"2024-09-19T11:15:41.444942+0000","last_clean":"2024-09-19T11:15:41.444942+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:15:41.444942+0000","last_undegraded":"2024-09-19T11:15:41.444942+0000","last_fullsized":"2024-09-19T11:15:41.444942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:46.869358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586975+0000","last_change":"2024-09-19T11:13:37.369616+0000","last_active":"2024-09-19T11:14:07.586975+0000","last_peered":"2024-09-19T11:14:07.586975+0000","last_clean":"2024-09-19T11:14:07.586975+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:14:07.586975+0000","last_undegraded":"2024-09-19T11:14:07.586975+0000","last_fullsized":"2024-09-19T11:14:07.586975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.498959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":469,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.110426+0000","last_change":"2024-09-19T11:13:39.364476+0000","last_active":"2024-09-19T11:16:43.110426+0000","last_peered":"2024-09-19T11:16:43.110426+0000","last_clean":"2024-09-19T11:16:43.110426+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:16:43.110426+0000","last_undegraded":"2024-09-19T11:16:43.110426+0000","last_fullsized":"2024-09-19T11:16:43.110426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:05.251594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.968627+0000","last_change":"2024-09-19T11:13:41.382500+0000","last_active":"2024-09-19T11:16:42.968627+0000","last_peered":"2024-09-19T11:16:42.968627+0000","last_clean":"2024-09-19T11:16:42.968627+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:16:42.968627+0000","last_undegraded":"2024-09-19T11:16:42.968627+0000","last_fullsized":"2024-09-19T11:16:42.968627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:44.429934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.615161+0000","last_change":"2024-09-19T11:13:33.361148+0000","last_active":"2024-09-19T11:14:15.615161+0000","last_peered":"2024-09-19T11:14:15.615161+0000","last_clean":"2024-09-19T11:14:15.615161+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:14:15.615161+0000","last_undegraded":"2024-09-19T11:14:15.615161+0000","last_fullsized":"2024-09-19T11:14:15.615161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:18.909904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584784+0000","last_change":"2024-09-19T11:13:31.376571+0000","last_active":"2024-09-19T11:14:07.584784+0000","last_peered":"2024-09-19T11:14:07.584784+0000","last_clean":"2024-09-19T11:14:07.584784+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:14:07.584784+0000","last_undegraded":"2024-09-19T11:14:07.584784+0000","last_fullsized":"2024-09-19T11:14:07.584784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:21.093655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"28'1","reported_seq":219,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.445222+0000","last_change":"2024-09-19T11:13:35.359895+0000","last_active":"2024-09-19T11:15:41.445222+0000","last_peered":"2024-09-19T11:15:41.445222+0000","last_clean":"2024-09-19T11:15:41.445222+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:15:41.445222+0000","last_undegraded":"2024-09-19T11:15:41.445222+0000","last_fullsized":"2024-09-19T11:15:41.445222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:48.665046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'38","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.346012+0000","last_change":"2024-09-19T11:13:37.367380+0000","last_active":"2024-09-19T11:15:40.346012+0000","last_peered":"2024-09-19T11:15:40.346012+0000","last_clean":"2024-09-19T11:15:40.346012+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:15:40.346012+0000","last_undegraded":"2024-09-19T11:15:40.346012+0000","last_fullsized":"2024-09-19T11:15:40.346012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:44.610147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587829+0000","last_change":"2024-09-19T11:13:39.381930+0000","last_active":"2024-09-19T11:14:07.587829+0000","last_peered":"2024-09-19T11:14:07.587829+0000","last_clean":"2024-09-19T11:14:07.587829+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:14:07.587829+0000","last_undegraded":"2024-09-19T11:14:07.587829+0000","last_fullsized":"2024-09-19T11:14:07.587829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:20.757672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'8","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.224963+0000","last_change":"2024-09-19T11:13:41.383036+0000","last_active":"2024-09-19T11:16:43.224963+0000","last_peered":"2024-09-19T11:16:43.224963+0000","last_clean":"2024-09-19T11:16:43.224963+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:16:43.224963+0000","last_undegraded":"2024-09-19T11:16:43.224963+0000","last_fullsized":"2024-09-19T11:16:43.224963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:22.046963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004072+0000","last_change":"2024-09-19T11:13:33.360700+0000","last_active":"2024-09-19T11:16:43.004072+0000","last_peered":"2024-09-19T11:16:43.004072+0000","last_clean":"2024-09-19T11:16:43.004072+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:16:43.004072+0000","last_undegraded":"2024-09-19T11:16:43.004072+0000","last_fullsized":"2024-09-19T11:16:43.004072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:38.890842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593057+0000","last_change":"2024-09-19T11:13:16.796669+0000","last_active":"2024-09-19T11:14:07.593057+0000","last_peered":"2024-09-19T11:14:07.593057+0000","last_clean":"2024-09-19T11:14:07.593057+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:14:07.593057+0000","last_undegraded":"2024-09-19T11:14:07.593057+0000","last_fullsized":"2024-09-19T11:14:07.593057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_clean_scrub_stamp":"2024-09-19T11:13:15.217500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:15.868833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586588+0000","last_change":"2024-09-19T11:13:21.254644+0000","last_active":"2024-09-19T11:14:07.586588+0000","last_peered":"2024-09-19T11:14:07.586588+0000","last_clean":"2024-09-19T11:14:07.586588+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:14:07.586588+0000","last_undegraded":"2024-09-19T11:14:07.586588+0000","last_fullsized":"2024-09-19T11:14:07.586588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:09.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585255+0000","last_change":"2024-09-19T11:13:31.378802+0000","last_active":"2024-09-19T11:14:07.585255+0000","last_peered":"2024-09-19T11:14:07.585255+0000","last_clean":"2024-09-19T11:14:07.585255+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:14:07.585255+0000","last_undegraded":"2024-09-19T11:14:07.585255+0000","last_fullsized":"2024-09-19T11:14:07.585255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:21.545126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598099+0000","last_change":"2024-09-19T11:14:07.597443+0000","last_active":"2024-09-19T11:14:07.598099+0000","last_peered":"2024-09-19T11:14:07.598099+0000","last_clean":"2024-09-19T11:14:07.598099+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:14:07.598099+0000","last_undegraded":"2024-09-19T11:14:07.598099+0000","last_fullsized":"2024-09-19T11:14:07.598099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:01.646429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'76","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.357806+0000","last_change":"2024-09-19T11:13:37.369113+0000","last_active":"2024-09-19T11:15:40.357806+0000","last_peered":"2024-09-19T11:15:40.357806+0000","last_clean":"2024-09-19T11:15:40.357806+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:15:40.357806+0000","last_undegraded":"2024-09-19T11:15:40.357806+0000","last_fullsized":"2024-09-19T11:15:40.357806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:17.600400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588503+0000","last_change":"2024-09-19T11:13:39.381749+0000","last_active":"2024-09-19T11:14:07.588503+0000","last_peered":"2024-09-19T11:14:07.588503+0000","last_clean":"2024-09-19T11:14:07.588503+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:14:07.588503+0000","last_undegraded":"2024-09-19T11:14:07.588503+0000","last_fullsized":"2024-09-19T11:14:07.588503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:31.206255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.012984+0000","last_change":"2024-09-19T11:13:41.382469+0000","last_active":"2024-09-19T11:16:43.012984+0000","last_peered":"2024-09-19T11:16:43.012984+0000","last_clean":"2024-09-19T11:16:43.012984+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:16:43.012984+0000","last_undegraded":"2024-09-19T11:16:43.012984+0000","last_fullsized":"2024-09-19T11:16:43.012984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:23.490546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096383+0000","last_change":"2024-09-19T11:13:33.352593+0000","last_active":"2024-09-19T11:15:42.096383+0000","last_peered":"2024-09-19T11:15:42.096383+0000","last_clean":"2024-09-19T11:15:42.096383+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:15:42.096383+0000","last_undegraded":"2024-09-19T11:15:42.096383+0000","last_fullsized":"2024-09-19T11:15:42.096383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:32.858735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584255+0000","last_change":"2024-09-19T11:13:21.254355+0000","last_active":"2024-09-19T11:14:07.584255+0000","last_peered":"2024-09-19T11:14:07.584255+0000","last_clean":"2024-09-19T11:14:07.584255+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:14:07.584255+0000","last_undegraded":"2024-09-19T11:14:07.584255+0000","last_fullsized":"2024-09-19T11:14:07.584255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:49.014710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:35.537088+0000","last_change":"2024-09-19T11:13:31.364094+0000","last_active":"2024-09-19T11:15:35.537088+0000","last_peered":"2024-09-19T11:15:35.537088+0000","last_clean":"2024-09-19T11:15:35.537088+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:15:35.537088+0000","last_undegraded":"2024-09-19T11:15:35.537088+0000","last_fullsized":"2024-09-19T11:15:35.537088+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.487218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589544+0000","last_change":"2024-09-19T11:13:35.355733+0000","last_active":"2024-09-19T11:14:07.589544+0000","last_peered":"2024-09-19T11:14:07.589544+0000","last_clean":"2024-09-19T11:14:07.589544+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:14:07.589544+0000","last_undegraded":"2024-09-19T11:14:07.589544+0000","last_fullsized":"2024-09-19T11:14:07.589544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:16.022467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'273","reported_seq":477,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437573+0000","last_change":"2024-09-19T11:13:37.365037+0000","last_active":"2024-09-19T11:16:40.437573+0000","last_peered":"2024-09-19T11:16:40.437573+0000","last_clean":"2024-09-19T11:16:40.437573+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:16:40.437573+0000","last_undegraded":"2024-09-19T11:16:40.437573+0000","last_fullsized":"2024-09-19T11:16:40.437573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:00.713713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585295+0000","last_change":"2024-09-19T11:13:39.379958+0000","last_active":"2024-09-19T11:14:07.585295+0000","last_peered":"2024-09-19T11:14:07.585295+0000","last_clean":"2024-09-19T11:14:07.585295+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:14:07.585295+0000","last_undegraded":"2024-09-19T11:14:07.585295+0000","last_fullsized":"2024-09-19T11:14:07.585295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.435708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.934138+0000","last_change":"2024-09-19T11:13:41.394316+0000","last_active":"2024-09-19T11:14:57.934138+0000","last_peered":"2024-09-19T11:14:57.934138+0000","last_clean":"2024-09-19T11:14:57.934138+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:14:57.934138+0000","last_undegraded":"2024-09-19T11:14:57.934138+0000","last_fullsized":"2024-09-19T11:14:57.934138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:54.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589975+0000","last_change":"2024-09-19T11:13:33.348762+0000","last_active":"2024-09-19T11:14:07.589975+0000","last_peered":"2024-09-19T11:14:07.589975+0000","last_clean":"2024-09-19T11:14:07.589975+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:14:07.589975+0000","last_undegraded":"2024-09-19T11:14:07.589975+0000","last_fullsized":"2024-09-19T11:14:07.589975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:36:09.372432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589222+0000","last_change":"2024-09-19T11:13:21.252701+0000","last_active":"2024-09-19T11:14:07.589222+0000","last_peered":"2024-09-19T11:14:07.589222+0000","last_clean":"2024-09-19T11:14:07.589222+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:14:07.589222+0000","last_undegraded":"2024-09-19T11:14:07.589222+0000","last_fullsized":"2024-09-19T11:14:07.589222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:32.819428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585864+0000","last_change":"2024-09-19T11:13:31.377758+0000","last_active":"2024-09-19T11:14:07.585864+0000","last_peered":"2024-09-19T11:14:07.585864+0000","last_clean":"2024-09-19T11:14:07.585864+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:14:07.585864+0000","last_undegraded":"2024-09-19T11:14:07.585864+0000","last_fullsized":"2024-09-19T11:14:07.585864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:51.569099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589942+0000","last_change":"2024-09-19T11:13:35.350142+0000","last_active":"2024-09-19T11:14:07.589942+0000","last_peered":"2024-09-19T11:14:07.589942+0000","last_clean":"2024-09-19T11:14:07.589942+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:14:07.589942+0000","last_undegraded":"2024-09-19T11:14:07.589942+0000","last_fullsized":"2024-09-19T11:14:07.589942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:13.732591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437418+0000","last_change":"2024-09-19T11:13:37.369777+0000","last_active":"2024-09-19T11:16:40.437418+0000","last_peered":"2024-09-19T11:16:40.437418+0000","last_clean":"2024-09-19T11:16:40.437418+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:16:40.437418+0000","last_undegraded":"2024-09-19T11:16:40.437418+0000","last_fullsized":"2024-09-19T11:16:40.437418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:09.642366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587165+0000","last_change":"2024-09-19T11:13:39.382026+0000","last_active":"2024-09-19T11:14:07.587165+0000","last_peered":"2024-09-19T11:14:07.587165+0000","last_clean":"2024-09-19T11:14:07.587165+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:14:07.587165+0000","last_undegraded":"2024-09-19T11:14:07.587165+0000","last_fullsized":"2024-09-19T11:14:07.587165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:05.351431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.301235+0000","last_change":"2024-09-19T11:13:41.390159+0000","last_active":"2024-09-19T11:16:42.301235+0000","last_peered":"2024-09-19T11:16:42.301235+0000","last_clean":"2024-09-19T11:16:42.301235+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:16:42.301235+0000","last_undegraded":"2024-09-19T11:16:42.301235+0000","last_fullsized":"2024-09-19T11:16:42.301235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:47.188979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112810+0000","last_change":"2024-09-19T11:13:33.352483+0000","last_active":"2024-09-19T11:14:58.112810+0000","last_peered":"2024-09-19T11:14:58.112810+0000","last_clean":"2024-09-19T11:14:58.112810+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:14:58.112810+0000","last_undegraded":"2024-09-19T11:14:58.112810+0000","last_fullsized":"2024-09-19T11:14:58.112810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:17.063492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584626+0000","last_change":"2024-09-19T11:13:21.254900+0000","last_active":"2024-09-19T11:14:07.584626+0000","last_peered":"2024-09-19T11:14:07.584626+0000","last_clean":"2024-09-19T11:14:07.584626+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:14:07.584626+0000","last_undegraded":"2024-09-19T11:14:07.584626+0000","last_fullsized":"2024-09-19T11:14:07.584626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:06.693190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.563187+0000","last_change":"2024-09-19T11:13:31.370903+0000","last_active":"2024-09-19T11:15:38.563187+0000","last_peered":"2024-09-19T11:15:38.563187+0000","last_clean":"2024-09-19T11:15:38.563187+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:15:38.563187+0000","last_undegraded":"2024-09-19T11:15:38.563187+0000","last_fullsized":"2024-09-19T11:15:38.563187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:36.343297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'4","reported_seq":227,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.425383+0000","last_change":"2024-09-19T11:13:35.357655+0000","last_active":"2024-09-19T11:15:41.425383+0000","last_peered":"2024-09-19T11:15:41.425383+0000","last_clean":"2024-09-19T11:15:41.425383+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:15:41.425383+0000","last_undegraded":"2024-09-19T11:15:41.425383+0000","last_fullsized":"2024-09-19T11:15:41.425383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:09.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":298,"num_read_kb":298,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'14","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.146449+0000","last_change":"2024-09-19T11:13:37.369199+0000","last_active":"2024-09-19T11:16:42.146449+0000","last_peered":"2024-09-19T11:16:42.146449+0000","last_clean":"2024-09-19T11:16:42.146449+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:16:42.146449+0000","last_undegraded":"2024-09-19T11:16:42.146449+0000","last_fullsized":"2024-09-19T11:16:42.146449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:43.083589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589764+0000","last_change":"2024-09-19T11:13:39.379563+0000","last_active":"2024-09-19T11:14:07.589764+0000","last_peered":"2024-09-19T11:14:07.589764+0000","last_clean":"2024-09-19T11:14:07.589764+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:14:07.589764+0000","last_undegraded":"2024-09-19T11:14:07.589764+0000","last_fullsized":"2024-09-19T11:14:07.589764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:20.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.946285+0000","last_change":"2024-09-19T11:13:41.395412+0000","last_active":"2024-09-19T11:16:42.946285+0000","last_peered":"2024-09-19T11:16:42.946285+0000","last_clean":"2024-09-19T11:16:42.946285+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:16:42.946285+0000","last_undegraded":"2024-09-19T11:16:42.946285+0000","last_fullsized":"2024-09-19T11:16:42.946285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:05.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.967341+0000","last_change":"2024-09-19T11:13:33.356242+0000","last_active":"2024-09-19T11:16:42.967341+0000","last_peered":"2024-09-19T11:16:42.967341+0000","last_clean":"2024-09-19T11:16:42.967341+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:16:42.967341+0000","last_undegraded":"2024-09-19T11:16:42.967341+0000","last_fullsized":"2024-09-19T11:16:42.967341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588322+0000","last_change":"2024-09-19T11:13:31.374247+0000","last_active":"2024-09-19T11:14:07.588322+0000","last_peered":"2024-09-19T11:14:07.588322+0000","last_clean":"2024-09-19T11:14:07.588322+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:14:07.588322+0000","last_undegraded":"2024-09-19T11:14:07.588322+0000","last_fullsized":"2024-09-19T11:14:07.588322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:36.456865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587109+0000","last_change":"2024-09-19T11:13:21.259380+0000","last_active":"2024-09-19T11:14:07.587109+0000","last_peered":"2024-09-19T11:14:07.587109+0000","last_clean":"2024-09-19T11:14:07.587109+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:14:07.587109+0000","last_undegraded":"2024-09-19T11:14:07.587109+0000","last_fullsized":"2024-09-19T11:14:07.587109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:46.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.537929+0000","last_change":"2024-09-19T11:13:35.354864+0000","last_active":"2024-09-19T11:15:40.537929+0000","last_peered":"2024-09-19T11:15:40.537929+0000","last_clean":"2024-09-19T11:15:40.537929+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:15:40.537929+0000","last_undegraded":"2024-09-19T11:15:40.537929+0000","last_fullsized":"2024-09-19T11:15:40.537929+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:59.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'62","reported_seq":122,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.586384+0000","last_change":"2024-09-19T11:13:37.366497+0000","last_active":"2024-09-19T11:16:42.586384+0000","last_peered":"2024-09-19T11:16:42.586384+0000","last_clean":"2024-09-19T11:16:42.586384+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:16:42.586384+0000","last_undegraded":"2024-09-19T11:16:42.586384+0000","last_fullsized":"2024-09-19T11:16:42.586384+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":62,"log_dups_size":0,"ondisk_log_size":62,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:05.665285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":5917,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":61,"num_read_kb":49,"num_write":28,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586753+0000","last_change":"2024-09-19T11:13:39.380023+0000","last_active":"2024-09-19T11:14:07.586753+0000","last_peered":"2024-09-19T11:14:07.586753+0000","last_clean":"2024-09-19T11:14:07.586753+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:14:07.586753+0000","last_undegraded":"2024-09-19T11:14:07.586753+0000","last_fullsized":"2024-09-19T11:14:07.586753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.513854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.002199+0000","last_change":"2024-09-19T11:13:41.384779+0000","last_active":"2024-09-19T11:15:42.002199+0000","last_peered":"2024-09-19T11:15:42.002199+0000","last_clean":"2024-09-19T11:15:42.002199+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:15:42.002199+0000","last_undegraded":"2024-09-19T11:15:42.002199+0000","last_fullsized":"2024-09-19T11:15:42.002199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:01.181785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003973+0000","last_change":"2024-09-19T11:13:33.355203+0000","last_active":"2024-09-19T11:16:43.003973+0000","last_peered":"2024-09-19T11:16:43.003973+0000","last_clean":"2024-09-19T11:16:43.003973+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:16:43.003973+0000","last_undegraded":"2024-09-19T11:16:43.003973+0000","last_fullsized":"2024-09-19T11:16:43.003973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:39.888974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.523511+0000","last_change":"2024-09-19T11:13:31.363980+0000","last_active":"2024-09-19T11:14:14.523511+0000","last_peered":"2024-09-19T11:14:14.523511+0000","last_clean":"2024-09-19T11:14:14.523511+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:14:14.523511+0000","last_undegraded":"2024-09-19T11:14:14.523511+0000","last_fullsized":"2024-09-19T11:14:14.523511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:08.281382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587424+0000","last_change":"2024-09-19T11:13:21.254921+0000","last_active":"2024-09-19T11:14:07.587424+0000","last_peered":"2024-09-19T11:14:07.587424+0000","last_clean":"2024-09-19T11:14:07.587424+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:14:07.587424+0000","last_undegraded":"2024-09-19T11:14:07.587424+0000","last_fullsized":"2024-09-19T11:14:07.587424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:50.538143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584330+0000","last_change":"2024-09-19T11:13:35.355937+0000","last_active":"2024-09-19T11:14:07.584330+0000","last_peered":"2024-09-19T11:14:07.584330+0000","last_clean":"2024-09-19T11:14:07.584330+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:14:07.584330+0000","last_undegraded":"2024-09-19T11:14:07.584330+0000","last_fullsized":"2024-09-19T11:14:07.584330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:41.799805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593910+0000","last_change":"2024-09-19T11:13:37.367919+0000","last_active":"2024-09-19T11:14:07.593910+0000","last_peered":"2024-09-19T11:14:07.593910+0000","last_clean":"2024-09-19T11:14:07.593910+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:14:07.593910+0000","last_undegraded":"2024-09-19T11:14:07.593910+0000","last_fullsized":"2024-09-19T11:14:07.593910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:53.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437340+0000","last_change":"2024-09-19T11:13:39.370313+0000","last_active":"2024-09-19T11:16:40.437340+0000","last_peered":"2024-09-19T11:16:40.437340+0000","last_clean":"2024-09-19T11:16:40.437340+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:16:40.437340+0000","last_undegraded":"2024-09-19T11:16:40.437340+0000","last_fullsized":"2024-09-19T11:16:40.437340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:56.937960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.649914+0000","last_change":"2024-09-19T11:13:41.391610+0000","last_active":"2024-09-19T11:16:42.649914+0000","last_peered":"2024-09-19T11:16:42.649914+0000","last_clean":"2024-09-19T11:16:42.649914+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:16:42.649914+0000","last_undegraded":"2024-09-19T11:16:42.649914+0000","last_fullsized":"2024-09-19T11:16:42.649914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.303997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096636+0000","last_change":"2024-09-19T11:14:07.601620+0000","last_active":"2024-09-19T11:15:42.096636+0000","last_peered":"2024-09-19T11:15:42.096636+0000","last_clean":"2024-09-19T11:15:42.096636+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:15:42.096636+0000","last_undegraded":"2024-09-19T11:15:42.096636+0000","last_fullsized":"2024-09-19T11:15:42.096636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:56.955418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.879840+0000","last_change":"2024-09-19T11:13:31.367766+0000","last_active":"2024-09-19T11:16:42.879840+0000","last_peered":"2024-09-19T11:16:42.879840+0000","last_clean":"2024-09-19T11:16:42.879840+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:16:42.879840+0000","last_undegraded":"2024-09-19T11:16:42.879840+0000","last_fullsized":"2024-09-19T11:16:42.879840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:46.005854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588837+0000","last_change":"2024-09-19T11:13:21.259371+0000","last_active":"2024-09-19T11:14:07.588837+0000","last_peered":"2024-09-19T11:14:07.588837+0000","last_clean":"2024-09-19T11:14:07.588837+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:14:07.588837+0000","last_undegraded":"2024-09-19T11:14:07.588837+0000","last_fullsized":"2024-09-19T11:14:07.588837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:58.914941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584240+0000","last_change":"2024-09-19T11:13:35.355501+0000","last_active":"2024-09-19T11:14:07.584240+0000","last_peered":"2024-09-19T11:14:07.584240+0000","last_clean":"2024-09-19T11:14:07.584240+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:14:07.584240+0000","last_undegraded":"2024-09-19T11:14:07.584240+0000","last_fullsized":"2024-09-19T11:14:07.584240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:17.393322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585599+0000","last_change":"2024-09-19T11:13:37.371529+0000","last_active":"2024-09-19T11:14:07.585599+0000","last_peered":"2024-09-19T11:14:07.585599+0000","last_clean":"2024-09-19T11:14:07.585599+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:14:07.585599+0000","last_undegraded":"2024-09-19T11:14:07.585599+0000","last_fullsized":"2024-09-19T11:14:07.585599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.201187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'282","reported_seq":400,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.253160+0000","last_change":"2024-09-19T11:13:39.374381+0000","last_active":"2024-09-19T11:16:43.253160+0000","last_peered":"2024-09-19T11:16:43.253160+0000","last_clean":"2024-09-19T11:16:43.253160+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:16:43.253160+0000","last_undegraded":"2024-09-19T11:16:43.253160+0000","last_fullsized":"2024-09-19T11:16:43.253160+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:52.357745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.093870+0000","last_change":"2024-09-19T11:13:41.392744+0000","last_active":"2024-09-19T11:15:42.093870+0000","last_peered":"2024-09-19T11:15:42.093870+0000","last_clean":"2024-09-19T11:15:42.093870+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:15:42.093870+0000","last_undegraded":"2024-09-19T11:15:42.093870+0000","last_fullsized":"2024-09-19T11:15:42.093870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:06.085455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.967344+0000","last_change":"2024-09-19T11:13:33.350528+0000","last_active":"2024-09-19T11:16:42.967344+0000","last_peered":"2024-09-19T11:16:42.967344+0000","last_clean":"2024-09-19T11:16:42.967344+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:16:42.967344+0000","last_undegraded":"2024-09-19T11:16:42.967344+0000","last_fullsized":"2024-09-19T11:16:42.967344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:39.714383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.525531+0000","last_change":"2024-09-19T11:13:31.363581+0000","last_active":"2024-09-19T11:14:14.525531+0000","last_peered":"2024-09-19T11:14:14.525531+0000","last_clean":"2024-09-19T11:14:14.525531+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:14:14.525531+0000","last_undegraded":"2024-09-19T11:14:14.525531+0000","last_fullsized":"2024-09-19T11:14:14.525531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:35.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590511+0000","last_change":"2024-09-19T11:13:21.254352+0000","last_active":"2024-09-19T11:14:07.590511+0000","last_peered":"2024-09-19T11:14:07.590511+0000","last_clean":"2024-09-19T11:14:07.590511+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:14:07.590511+0000","last_undegraded":"2024-09-19T11:14:07.590511+0000","last_fullsized":"2024-09-19T11:14:07.590511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:50.082399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584254+0000","last_change":"2024-09-19T11:13:35.355920+0000","last_active":"2024-09-19T11:14:07.584254+0000","last_peered":"2024-09-19T11:14:07.584254+0000","last_clean":"2024-09-19T11:14:07.584254+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:14:07.584254+0000","last_undegraded":"2024-09-19T11:14:07.584254+0000","last_fullsized":"2024-09-19T11:14:07.584254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:38.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'82","reported_seq":155,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.344082+0000","last_change":"2024-09-19T11:13:37.367000+0000","last_active":"2024-09-19T11:15:40.344082+0000","last_peered":"2024-09-19T11:15:40.344082+0000","last_clean":"2024-09-19T11:15:40.344082+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:15:40.344082+0000","last_undegraded":"2024-09-19T11:15:40.344082+0000","last_fullsized":"2024-09-19T11:15:40.344082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.428269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586150+0000","last_change":"2024-09-19T11:13:39.369482+0000","last_active":"2024-09-19T11:14:07.586150+0000","last_peered":"2024-09-19T11:14:07.586150+0000","last_clean":"2024-09-19T11:14:07.586150+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:14:07.586150+0000","last_undegraded":"2024-09-19T11:14:07.586150+0000","last_fullsized":"2024-09-19T11:14:07.586150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:52.197649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.742094+0000","last_change":"2024-09-19T11:13:41.387841+0000","last_active":"2024-09-19T11:16:42.742094+0000","last_peered":"2024-09-19T11:16:42.742094+0000","last_clean":"2024-09-19T11:16:42.742094+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:16:42.742094+0000","last_undegraded":"2024-09-19T11:16:42.742094+0000","last_fullsized":"2024-09-19T11:16:42.742094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:41.664645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589320+0000","last_change":"2024-09-19T11:13:41.387407+0000","last_active":"2024-09-19T11:14:07.589320+0000","last_peered":"2024-09-19T11:14:07.589320+0000","last_clean":"2024-09-19T11:14:07.589320+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:14:07.589320+0000","last_undegraded":"2024-09-19T11:14:07.589320+0000","last_fullsized":"2024-09-19T11:14:07.589320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:24.850379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899053+0000","last_change":"2024-09-19T11:13:33.353234+0000","last_active":"2024-09-19T11:16:42.899053+0000","last_peered":"2024-09-19T11:16:42.899053+0000","last_clean":"2024-09-19T11:16:42.899053+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:16:42.899053+0000","last_undegraded":"2024-09-19T11:16:42.899053+0000","last_fullsized":"2024-09-19T11:16:42.899053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.889699+0000","last_change":"2024-09-19T11:13:31.373496+0000","last_active":"2024-09-19T11:16:42.889699+0000","last_peered":"2024-09-19T11:16:42.889699+0000","last_clean":"2024-09-19T11:16:42.889699+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:16:42.889699+0000","last_undegraded":"2024-09-19T11:16:42.889699+0000","last_fullsized":"2024-09-19T11:16:42.889699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:04.061207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593909+0000","last_change":"2024-09-19T11:13:35.353000+0000","last_active":"2024-09-19T11:14:07.593909+0000","last_peered":"2024-09-19T11:14:07.593909+0000","last_clean":"2024-09-19T11:14:07.593909+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:14:07.593909+0000","last_undegraded":"2024-09-19T11:14:07.593909+0000","last_fullsized":"2024-09-19T11:14:07.593909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:23.618637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'33","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.349850+0000","last_change":"2024-09-19T11:13:37.369688+0000","last_active":"2024-09-19T11:15:40.349850+0000","last_peered":"2024-09-19T11:15:40.349850+0000","last_clean":"2024-09-19T11:15:40.349850+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:15:40.349850+0000","last_undegraded":"2024-09-19T11:15:40.349850+0000","last_fullsized":"2024-09-19T11:15:40.349850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:22.810135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585707+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.585707+0000","last_peered":"2024-09-19T11:14:07.585707+0000","last_clean":"2024-09-19T11:14:07.585707+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:14:07.585707+0000","last_undegraded":"2024-09-19T11:14:07.585707+0000","last_fullsized":"2024-09-19T11:14:07.585707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:32.078155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.049603+0000","last_change":"2024-09-19T11:13:41.388648+0000","last_active":"2024-09-19T11:15:40.049603+0000","last_peered":"2024-09-19T11:15:40.049603+0000","last_clean":"2024-09-19T11:15:40.049603+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:15:40.049603+0000","last_undegraded":"2024-09-19T11:15:40.049603+0000","last_fullsized":"2024-09-19T11:15:40.049603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:00.390668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899095+0000","last_change":"2024-09-19T11:13:33.356046+0000","last_active":"2024-09-19T11:16:42.899095+0000","last_peered":"2024-09-19T11:16:42.899095+0000","last_clean":"2024-09-19T11:16:42.899095+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:16:42.899095+0000","last_undegraded":"2024-09-19T11:16:42.899095+0000","last_fullsized":"2024-09-19T11:16:42.899095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:32.352474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.580671+0000","last_change":"2024-09-19T11:13:31.371002+0000","last_active":"2024-09-19T11:16:42.580671+0000","last_peered":"2024-09-19T11:16:42.580671+0000","last_clean":"2024-09-19T11:16:42.580671+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:42.580671+0000","last_undegraded":"2024-09-19T11:16:42.580671+0000","last_fullsized":"2024-09-19T11:16:42.580671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:54.573687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584591+0000","last_change":"2024-09-19T11:13:35.353851+0000","last_active":"2024-09-19T11:14:07.584591+0000","last_peered":"2024-09-19T11:14:07.584591+0000","last_clean":"2024-09-19T11:14:07.584591+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:14:07.584591+0000","last_undegraded":"2024-09-19T11:14:07.584591+0000","last_fullsized":"2024-09-19T11:14:07.584591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:37.329718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.125107+0000","last_change":"2024-09-19T11:13:37.361748+0000","last_active":"2024-09-19T11:16:42.125107+0000","last_peered":"2024-09-19T11:16:42.125107+0000","last_clean":"2024-09-19T11:16:42.125107+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:16:42.125107+0000","last_undegraded":"2024-09-19T11:16:42.125107+0000","last_fullsized":"2024-09-19T11:16:42.125107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:52.506674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588151+0000","last_change":"2024-09-19T11:13:39.381924+0000","last_active":"2024-09-19T11:14:07.588151+0000","last_peered":"2024-09-19T11:14:07.588151+0000","last_clean":"2024-09-19T11:14:07.588151+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:14:07.588151+0000","last_undegraded":"2024-09-19T11:14:07.588151+0000","last_fullsized":"2024-09-19T11:14:07.588151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:37.700824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587758+0000","last_change":"2024-09-19T11:13:41.381057+0000","last_active":"2024-09-19T11:14:07.587758+0000","last_peered":"2024-09-19T11:14:07.587758+0000","last_clean":"2024-09-19T11:14:07.587758+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:14:07.587758+0000","last_undegraded":"2024-09-19T11:14:07.587758+0000","last_fullsized":"2024-09-19T11:14:07.587758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:11.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003956+0000","last_change":"2024-09-19T11:13:33.350098+0000","last_active":"2024-09-19T11:16:43.003956+0000","last_peered":"2024-09-19T11:16:43.003956+0000","last_clean":"2024-09-19T11:16:43.003956+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:16:43.003956+0000","last_undegraded":"2024-09-19T11:16:43.003956+0000","last_fullsized":"2024-09-19T11:16:43.003956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:02.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590332+0000","last_change":"2024-09-19T11:13:31.356268+0000","last_active":"2024-09-19T11:14:07.590332+0000","last_peered":"2024-09-19T11:14:07.590332+0000","last_clean":"2024-09-19T11:14:07.590332+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:14:07.590332+0000","last_undegraded":"2024-09-19T11:14:07.590332+0000","last_fullsized":"2024-09-19T11:14:07.590332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:33.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587433+0000","last_change":"2024-09-19T11:13:35.356889+0000","last_active":"2024-09-19T11:14:07.587433+0000","last_peered":"2024-09-19T11:14:07.587433+0000","last_clean":"2024-09-19T11:14:07.587433+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:14:07.587433+0000","last_undegraded":"2024-09-19T11:14:07.587433+0000","last_fullsized":"2024-09-19T11:14:07.587433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:48.945891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'44","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.550147+0000","last_change":"2024-09-19T11:13:37.358517+0000","last_active":"2024-09-19T11:16:42.550147+0000","last_peered":"2024-09-19T11:16:42.550147+0000","last_clean":"2024-09-19T11:16:42.550147+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:16:42.550147+0000","last_undegraded":"2024-09-19T11:16:42.550147+0000","last_fullsized":"2024-09-19T11:16:42.550147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":44,"log_dups_size":0,"ondisk_log_size":44,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.932100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":62,"num_read_kb":65,"num_write":48,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593589+0000","last_change":"2024-09-19T11:13:39.368887+0000","last_active":"2024-09-19T11:14:07.593589+0000","last_peered":"2024-09-19T11:14:07.593589+0000","last_clean":"2024-09-19T11:14:07.593589+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:14:07.593589+0000","last_undegraded":"2024-09-19T11:14:07.593589+0000","last_fullsized":"2024-09-19T11:14:07.593589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:59.906873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585207+0000","last_change":"2024-09-19T11:13:41.390580+0000","last_active":"2024-09-19T11:14:07.585207+0000","last_peered":"2024-09-19T11:14:07.585207+0000","last_clean":"2024-09-19T11:14:07.585207+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:14:07.585207+0000","last_undegraded":"2024-09-19T11:14:07.585207+0000","last_fullsized":"2024-09-19T11:14:07.585207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:00.635835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.628513+0000","last_change":"2024-09-19T11:13:33.359154+0000","last_active":"2024-09-19T11:16:42.628513+0000","last_peered":"2024-09-19T11:16:42.628513+0000","last_clean":"2024-09-19T11:16:42.628513+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:16:42.628513+0000","last_undegraded":"2024-09-19T11:16:42.628513+0000","last_fullsized":"2024-09-19T11:16:42.628513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.291758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.525594+0000","last_change":"2024-09-19T11:13:31.362807+0000","last_active":"2024-09-19T11:14:14.525594+0000","last_peered":"2024-09-19T11:14:14.525594+0000","last_clean":"2024-09-19T11:14:14.525594+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:14:14.525594+0000","last_undegraded":"2024-09-19T11:14:14.525594+0000","last_fullsized":"2024-09-19T11:14:14.525594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:56.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584231+0000","last_change":"2024-09-19T11:13:35.356852+0000","last_active":"2024-09-19T11:14:07.584231+0000","last_peered":"2024-09-19T11:14:07.584231+0000","last_clean":"2024-09-19T11:14:07.584231+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:14:07.584231+0000","last_undegraded":"2024-09-19T11:14:07.584231+0000","last_fullsized":"2024-09-19T11:14:07.584231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:35.050288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.335466+0000","last_change":"2024-09-19T11:13:37.360189+0000","last_active":"2024-09-19T11:15:40.335466+0000","last_peered":"2024-09-19T11:15:40.335466+0000","last_clean":"2024-09-19T11:15:40.335466+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:15:40.335466+0000","last_undegraded":"2024-09-19T11:15:40.335466+0000","last_fullsized":"2024-09-19T11:15:40.335466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:54.329596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587792+0000","last_change":"2024-09-19T11:13:39.375493+0000","last_active":"2024-09-19T11:14:07.587792+0000","last_peered":"2024-09-19T11:14:07.587792+0000","last_clean":"2024-09-19T11:14:07.587792+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:14:07.587792+0000","last_undegraded":"2024-09-19T11:14:07.587792+0000","last_fullsized":"2024-09-19T11:14:07.587792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:12.594777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.568582+0000","last_change":"2024-09-19T11:13:33.354025+0000","last_active":"2024-09-19T11:15:38.568582+0000","last_peered":"2024-09-19T11:15:38.568582+0000","last_clean":"2024-09-19T11:15:38.568582+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:15:38.568582+0000","last_undegraded":"2024-09-19T11:15:38.568582+0000","last_fullsized":"2024-09-19T11:15:38.568582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:42.535989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.541620+0000","last_change":"2024-09-19T11:13:31.376331+0000","last_active":"2024-09-19T11:15:58.541620+0000","last_peered":"2024-09-19T11:15:58.541620+0000","last_clean":"2024-09-19T11:15:58.541620+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:15:58.541620+0000","last_undegraded":"2024-09-19T11:15:58.541620+0000","last_fullsized":"2024-09-19T11:15:58.541620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:08.223724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588717+0000","last_change":"2024-09-19T11:13:35.357178+0000","last_active":"2024-09-19T11:14:07.588717+0000","last_peered":"2024-09-19T11:14:07.588717+0000","last_clean":"2024-09-19T11:14:07.588717+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:14:07.588717+0000","last_undegraded":"2024-09-19T11:14:07.588717+0000","last_fullsized":"2024-09-19T11:14:07.588717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:59.098976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'57","reported_seq":114,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.356451+0000","last_change":"2024-09-19T11:13:37.363593+0000","last_active":"2024-09-19T11:15:40.356451+0000","last_peered":"2024-09-19T11:15:40.356451+0000","last_clean":"2024-09-19T11:15:40.356451+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:15:40.356451+0000","last_undegraded":"2024-09-19T11:15:40.356451+0000","last_fullsized":"2024-09-19T11:15:40.356451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":57,"log_dups_size":0,"ondisk_log_size":57,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:57.886776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":55,"num_read_kb":61,"num_write":22,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587378+0000","last_change":"2024-09-19T11:13:39.375431+0000","last_active":"2024-09-19T11:14:07.587378+0000","last_peered":"2024-09-19T11:14:07.587378+0000","last_clean":"2024-09-19T11:14:07.587378+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:14:07.587378+0000","last_undegraded":"2024-09-19T11:14:07.587378+0000","last_fullsized":"2024-09-19T11:14:07.587378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:55.629772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.998936+0000","last_change":"2024-09-19T11:13:41.387630+0000","last_active":"2024-09-19T11:15:41.998936+0000","last_peered":"2024-09-19T11:15:41.998936+0000","last_clean":"2024-09-19T11:15:41.998936+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:15:41.998936+0000","last_undegraded":"2024-09-19T11:15:41.998936+0000","last_fullsized":"2024-09-19T11:15:41.998936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:27.480898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004030+0000","last_change":"2024-09-19T11:13:33.342352+0000","last_active":"2024-09-19T11:16:43.004030+0000","last_peered":"2024-09-19T11:16:43.004030+0000","last_clean":"2024-09-19T11:16:43.004030+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:16:43.004030+0000","last_undegraded":"2024-09-19T11:16:43.004030+0000","last_fullsized":"2024-09-19T11:16:43.004030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:09.205289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.543575+0000","last_change":"2024-09-19T11:13:31.360617+0000","last_active":"2024-09-19T11:15:58.543575+0000","last_peered":"2024-09-19T11:15:58.543575+0000","last_clean":"2024-09-19T11:15:58.543575+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:15:58.543575+0000","last_undegraded":"2024-09-19T11:15:58.543575+0000","last_fullsized":"2024-09-19T11:15:58.543575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:26.660836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590449+0000","last_change":"2024-09-19T11:13:35.350569+0000","last_active":"2024-09-19T11:14:07.590449+0000","last_peered":"2024-09-19T11:14:07.590449+0000","last_clean":"2024-09-19T11:14:07.590449+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:14:07.590449+0000","last_undegraded":"2024-09-19T11:14:07.590449+0000","last_fullsized":"2024-09-19T11:14:07.590449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:44.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.336398+0000","last_change":"2024-09-19T11:13:37.368372+0000","last_active":"2024-09-19T11:15:40.336398+0000","last_peered":"2024-09-19T11:15:40.336398+0000","last_clean":"2024-09-19T11:15:40.336398+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:15:40.336398+0000","last_undegraded":"2024-09-19T11:15:40.336398+0000","last_fullsized":"2024-09-19T11:15:40.336398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:42.470532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595510+0000","last_change":"2024-09-19T11:13:39.377106+0000","last_active":"2024-09-19T11:14:07.595510+0000","last_peered":"2024-09-19T11:14:07.595510+0000","last_clean":"2024-09-19T11:14:07.595510+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:14:07.595510+0000","last_undegraded":"2024-09-19T11:14:07.595510+0000","last_fullsized":"2024-09-19T11:14:07.595510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:40.364349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584320+0000","last_change":"2024-09-19T11:13:41.395172+0000","last_active":"2024-09-19T11:14:07.584320+0000","last_peered":"2024-09-19T11:14:07.584320+0000","last_clean":"2024-09-19T11:14:07.584320+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:14:07.584320+0000","last_undegraded":"2024-09-19T11:14:07.584320+0000","last_fullsized":"2024-09-19T11:14:07.584320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:31.640115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115025+0000","last_change":"2024-09-19T11:13:33.361006+0000","last_active":"2024-09-19T11:14:58.115025+0000","last_peered":"2024-09-19T11:14:58.115025+0000","last_clean":"2024-09-19T11:14:58.115025+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:14:58.115025+0000","last_undegraded":"2024-09-19T11:14:58.115025+0000","last_fullsized":"2024-09-19T11:14:58.115025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:15.458106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.074402+0000","last_change":"2024-09-19T11:13:31.369805+0000","last_active":"2024-09-19T11:15:42.074402+0000","last_peered":"2024-09-19T11:15:42.074402+0000","last_clean":"2024-09-19T11:15:42.074402+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:15:42.074402+0000","last_undegraded":"2024-09-19T11:15:42.074402+0000","last_fullsized":"2024-09-19T11:15:42.074402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:31.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588215+0000","last_change":"2024-09-19T11:13:35.351248+0000","last_active":"2024-09-19T11:14:07.588215+0000","last_peered":"2024-09-19T11:14:07.588215+0000","last_clean":"2024-09-19T11:14:07.588215+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:14:07.588215+0000","last_undegraded":"2024-09-19T11:14:07.588215+0000","last_fullsized":"2024-09-19T11:14:07.588215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:06.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.354147+0000","last_change":"2024-09-19T11:13:37.358368+0000","last_active":"2024-09-19T11:15:40.354147+0000","last_peered":"2024-09-19T11:15:40.354147+0000","last_clean":"2024-09-19T11:15:40.354147+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:15:40.354147+0000","last_undegraded":"2024-09-19T11:15:40.354147+0000","last_fullsized":"2024-09-19T11:15:40.354147+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:44.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588427+0000","last_change":"2024-09-19T11:13:39.380360+0000","last_active":"2024-09-19T11:14:07.588427+0000","last_peered":"2024-09-19T11:14:07.588427+0000","last_clean":"2024-09-19T11:14:07.588427+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:14:07.588427+0000","last_undegraded":"2024-09-19T11:14:07.588427+0000","last_fullsized":"2024-09-19T11:14:07.588427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:19.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.092425+0000","last_change":"2024-09-19T11:13:41.392005+0000","last_active":"2024-09-19T11:15:42.092425+0000","last_peered":"2024-09-19T11:15:42.092425+0000","last_clean":"2024-09-19T11:15:42.092425+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:15:42.092425+0000","last_undegraded":"2024-09-19T11:15:42.092425+0000","last_fullsized":"2024-09-19T11:15:42.092425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:49.976836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003882+0000","last_change":"2024-09-19T11:13:33.352824+0000","last_active":"2024-09-19T11:16:43.003882+0000","last_peered":"2024-09-19T11:16:43.003882+0000","last_clean":"2024-09-19T11:16:43.003882+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:16:43.003882+0000","last_undegraded":"2024-09-19T11:16:43.003882+0000","last_fullsized":"2024-09-19T11:16:43.003882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:01.378601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587054+0000","last_change":"2024-09-19T11:13:31.377732+0000","last_active":"2024-09-19T11:14:07.587054+0000","last_peered":"2024-09-19T11:14:07.587054+0000","last_clean":"2024-09-19T11:14:07.587054+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:14:07.587054+0000","last_undegraded":"2024-09-19T11:14:07.587054+0000","last_fullsized":"2024-09-19T11:14:07.587054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:21:08.712618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598624+0000","last_change":"2024-09-19T11:14:07.597921+0000","last_active":"2024-09-19T11:14:07.598624+0000","last_peered":"2024-09-19T11:14:07.598624+0000","last_clean":"2024-09-19T11:14:07.598624+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:14:07.598624+0000","last_undegraded":"2024-09-19T11:14:07.598624+0000","last_fullsized":"2024-09-19T11:14:07.598624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:55.324299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586647+0000","last_change":"2024-09-19T11:13:37.371652+0000","last_active":"2024-09-19T11:14:07.586647+0000","last_peered":"2024-09-19T11:14:07.586647+0000","last_clean":"2024-09-19T11:14:07.586647+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:14:07.586647+0000","last_undegraded":"2024-09-19T11:14:07.586647+0000","last_fullsized":"2024-09-19T11:14:07.586647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:28.501389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":367,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437335+0000","last_change":"2024-09-19T11:13:39.382597+0000","last_active":"2024-09-19T11:16:40.437335+0000","last_peered":"2024-09-19T11:16:40.437335+0000","last_clean":"2024-09-19T11:16:40.437335+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:16:40.437335+0000","last_undegraded":"2024-09-19T11:16:40.437335+0000","last_fullsized":"2024-09-19T11:16:40.437335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:46.620461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.583768+0000","last_change":"2024-09-19T11:13:41.390206+0000","last_active":"2024-09-19T11:14:07.583768+0000","last_peered":"2024-09-19T11:14:07.583768+0000","last_clean":"2024-09-19T11:14:07.583768+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:14:07.583768+0000","last_undegraded":"2024-09-19T11:14:07.583768+0000","last_fullsized":"2024-09-19T11:14:07.583768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:11.171587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003933+0000","last_change":"2024-09-19T11:13:33.345970+0000","last_active":"2024-09-19T11:16:43.003933+0000","last_peered":"2024-09-19T11:16:43.003933+0000","last_clean":"2024-09-19T11:16:43.003933+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:16:43.003933+0000","last_undegraded":"2024-09-19T11:16:43.003933+0000","last_fullsized":"2024-09-19T11:16:43.003933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:42.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596073+0000","last_change":"2024-09-19T11:13:31.363961+0000","last_active":"2024-09-19T11:14:07.596073+0000","last_peered":"2024-09-19T11:14:07.596073+0000","last_clean":"2024-09-19T11:14:07.596073+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:14:07.596073+0000","last_undegraded":"2024-09-19T11:14:07.596073+0000","last_fullsized":"2024-09-19T11:14:07.596073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:09.178158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593781+0000","last_change":"2024-09-19T11:13:35.355437+0000","last_active":"2024-09-19T11:14:07.593781+0000","last_peered":"2024-09-19T11:14:07.593781+0000","last_clean":"2024-09-19T11:14:07.593781+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:14:07.593781+0000","last_undegraded":"2024-09-19T11:14:07.593781+0000","last_fullsized":"2024-09-19T11:14:07.593781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.209336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.327235+0000","last_change":"2024-09-19T11:13:37.367049+0000","last_active":"2024-09-19T11:15:40.327235+0000","last_peered":"2024-09-19T11:15:40.327235+0000","last_clean":"2024-09-19T11:15:40.327235+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:15:40.327235+0000","last_undegraded":"2024-09-19T11:15:40.327235+0000","last_fullsized":"2024-09-19T11:15:40.327235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:18.747358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586010+0000","last_change":"2024-09-19T11:13:39.381142+0000","last_active":"2024-09-19T11:14:07.586010+0000","last_peered":"2024-09-19T11:14:07.586010+0000","last_clean":"2024-09-19T11:14:07.586010+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:14:07.586010+0000","last_undegraded":"2024-09-19T11:14:07.586010+0000","last_fullsized":"2024-09-19T11:14:07.586010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:40.981200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.110163+0000","last_change":"2024-09-19T11:13:41.388869+0000","last_active":"2024-09-19T11:14:58.110163+0000","last_peered":"2024-09-19T11:14:58.110163+0000","last_clean":"2024-09-19T11:14:58.110163+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:14:58.110163+0000","last_undegraded":"2024-09-19T11:14:58.110163+0000","last_fullsized":"2024-09-19T11:14:58.110163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:20.834731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739953+0000","last_change":"2024-09-19T11:13:33.347043+0000","last_active":"2024-09-19T11:16:42.739953+0000","last_peered":"2024-09-19T11:16:42.739953+0000","last_clean":"2024-09-19T11:16:42.739953+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:16:42.739953+0000","last_undegraded":"2024-09-19T11:16:42.739953+0000","last_fullsized":"2024-09-19T11:16:42.739953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587518+0000","last_change":"2024-09-19T11:13:31.371968+0000","last_active":"2024-09-19T11:14:07.587518+0000","last_peered":"2024-09-19T11:14:07.587518+0000","last_clean":"2024-09-19T11:14:07.587518+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:14:07.587518+0000","last_undegraded":"2024-09-19T11:14:07.587518+0000","last_fullsized":"2024-09-19T11:14:07.587518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:11.662633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589719+0000","last_change":"2024-09-19T11:13:35.357430+0000","last_active":"2024-09-19T11:14:07.589719+0000","last_peered":"2024-09-19T11:14:07.589719+0000","last_clean":"2024-09-19T11:14:07.589719+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:14:07.589719+0000","last_undegraded":"2024-09-19T11:14:07.589719+0000","last_fullsized":"2024-09-19T11:14:07.589719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:37.024755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.328327+0000","last_change":"2024-09-19T11:13:37.365759+0000","last_active":"2024-09-19T11:15:40.328327+0000","last_peered":"2024-09-19T11:15:40.328327+0000","last_clean":"2024-09-19T11:15:40.328327+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:15:40.328327+0000","last_undegraded":"2024-09-19T11:15:40.328327+0000","last_fullsized":"2024-09-19T11:15:40.328327+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:56.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584006+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.584006+0000","last_peered":"2024-09-19T11:14:07.584006+0000","last_clean":"2024-09-19T11:14:07.584006+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:14:07.584006+0000","last_undegraded":"2024-09-19T11:14:07.584006+0000","last_fullsized":"2024-09-19T11:14:07.584006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:21.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586387+0000","last_change":"2024-09-19T11:13:41.394164+0000","last_active":"2024-09-19T11:14:07.586387+0000","last_peered":"2024-09-19T11:14:07.586387+0000","last_clean":"2024-09-19T11:14:07.586387+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:14:07.586387+0000","last_undegraded":"2024-09-19T11:14:07.586387+0000","last_fullsized":"2024-09-19T11:14:07.586387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.249643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.105117+0000","last_change":"2024-09-19T11:13:33.349183+0000","last_active":"2024-09-19T11:16:43.105117+0000","last_peered":"2024-09-19T11:16:43.105117+0000","last_clean":"2024-09-19T11:16:43.105117+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:16:43.105117+0000","last_undegraded":"2024-09-19T11:16:43.105117+0000","last_fullsized":"2024-09-19T11:16:43.105117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:16.760506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588874+0000","last_change":"2024-09-19T11:13:31.364611+0000","last_active":"2024-09-19T11:14:07.588874+0000","last_peered":"2024-09-19T11:14:07.588874+0000","last_clean":"2024-09-19T11:14:07.588874+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:14:07.588874+0000","last_undegraded":"2024-09-19T11:14:07.588874+0000","last_fullsized":"2024-09-19T11:14:07.588874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:03.025212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.592890+0000","last_change":"2024-09-19T11:13:35.359098+0000","last_active":"2024-09-19T11:14:07.592890+0000","last_peered":"2024-09-19T11:14:07.592890+0000","last_clean":"2024-09-19T11:14:07.592890+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:14:07.592890+0000","last_undegraded":"2024-09-19T11:14:07.592890+0000","last_fullsized":"2024-09-19T11:14:07.592890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.137473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'26","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.351671+0000","last_change":"2024-09-19T11:13:37.368500+0000","last_active":"2024-09-19T11:15:40.351671+0000","last_peered":"2024-09-19T11:15:40.351671+0000","last_clean":"2024-09-19T11:15:40.351671+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:15:40.351671+0000","last_undegraded":"2024-09-19T11:15:40.351671+0000","last_fullsized":"2024-09-19T11:15:40.351671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:42.855744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584628+0000","last_change":"2024-09-19T11:13:39.375517+0000","last_active":"2024-09-19T11:14:07.584628+0000","last_peered":"2024-09-19T11:14:07.584628+0000","last_clean":"2024-09-19T11:14:07.584628+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:14:07.584628+0000","last_undegraded":"2024-09-19T11:14:07.584628+0000","last_fullsized":"2024-09-19T11:14:07.584628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:42.881775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.362489+0000","last_change":"2024-09-19T11:13:41.393750+0000","last_active":"2024-09-19T11:15:40.362489+0000","last_peered":"2024-09-19T11:15:40.362489+0000","last_clean":"2024-09-19T11:15:40.362489+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:15:40.362489+0000","last_undegraded":"2024-09-19T11:15:40.362489+0000","last_fullsized":"2024-09-19T11:15:40.362489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:29.365114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739944+0000","last_change":"2024-09-19T11:13:33.342298+0000","last_active":"2024-09-19T11:16:42.739944+0000","last_peered":"2024-09-19T11:16:42.739944+0000","last_clean":"2024-09-19T11:16:42.739944+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:16:42.739944+0000","last_undegraded":"2024-09-19T11:16:42.739944+0000","last_fullsized":"2024-09-19T11:16:42.739944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:30.192043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.609055+0000","last_change":"2024-09-19T11:13:31.364730+0000","last_active":"2024-09-19T11:16:42.609055+0000","last_peered":"2024-09-19T11:16:42.609055+0000","last_clean":"2024-09-19T11:16:42.609055+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:42.609055+0000","last_undegraded":"2024-09-19T11:16:42.609055+0000","last_fullsized":"2024-09-19T11:16:42.609055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:42.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.945426+0000","last_change":"2024-09-19T11:13:35.357671+0000","last_active":"2024-09-19T11:15:38.945426+0000","last_peered":"2024-09-19T11:15:38.945426+0000","last_clean":"2024-09-19T11:15:38.945426+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:15:38.945426+0000","last_undegraded":"2024-09-19T11:15:38.945426+0000","last_fullsized":"2024-09-19T11:15:38.945426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:03.047743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'34","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.151584+0000","last_change":"2024-09-19T11:13:37.371443+0000","last_active":"2024-09-19T11:16:42.151584+0000","last_peered":"2024-09-19T11:16:42.151584+0000","last_clean":"2024-09-19T11:16:42.151584+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:16:42.151584+0000","last_undegraded":"2024-09-19T11:16:42.151584+0000","last_fullsized":"2024-09-19T11:16:42.151584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.734955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586898+0000","last_change":"2024-09-19T11:13:39.381795+0000","last_active":"2024-09-19T11:14:07.586898+0000","last_peered":"2024-09-19T11:14:07.586898+0000","last_clean":"2024-09-19T11:14:07.586898+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:14:07.586898+0000","last_undegraded":"2024-09-19T11:14:07.586898+0000","last_fullsized":"2024-09-19T11:14:07.586898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:05.918916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.365479+0000","last_change":"2024-09-19T11:13:41.392101+0000","last_active":"2024-09-19T11:15:40.365479+0000","last_peered":"2024-09-19T11:15:40.365479+0000","last_clean":"2024-09-19T11:15:40.365479+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:15:40.365479+0000","last_undegraded":"2024-09-19T11:15:40.365479+0000","last_fullsized":"2024-09-19T11:15:40.365479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:25.270293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.930575+0000","last_change":"2024-09-19T11:13:33.361155+0000","last_active":"2024-09-19T11:14:57.930575+0000","last_peered":"2024-09-19T11:14:57.930575+0000","last_clean":"2024-09-19T11:14:57.930575+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:14:57.930575+0000","last_undegraded":"2024-09-19T11:14:57.930575+0000","last_fullsized":"2024-09-19T11:14:57.930575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:51.951767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.589542+0000","last_change":"2024-09-19T11:13:31.372398+0000","last_active":"2024-09-19T11:14:15.589542+0000","last_peered":"2024-09-19T11:14:15.589542+0000","last_clean":"2024-09-19T11:14:15.589542+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:14:15.589542+0000","last_undegraded":"2024-09-19T11:14:15.589542+0000","last_fullsized":"2024-09-19T11:14:15.589542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:31.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899012+0000","last_change":"2024-09-19T11:13:33.352614+0000","last_active":"2024-09-19T11:16:42.899012+0000","last_peered":"2024-09-19T11:16:42.899012+0000","last_clean":"2024-09-19T11:16:42.899012+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:16:42.899012+0000","last_undegraded":"2024-09-19T11:16:42.899012+0000","last_fullsized":"2024-09-19T11:16:42.899012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:26.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585940+0000","last_change":"2024-09-19T11:13:31.363757+0000","last_active":"2024-09-19T11:14:07.585940+0000","last_peered":"2024-09-19T11:14:07.585940+0000","last_clean":"2024-09-19T11:14:07.585940+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:14:07.585940+0000","last_undegraded":"2024-09-19T11:14:07.585940+0000","last_fullsized":"2024-09-19T11:14:07.585940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:15.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.614216+0000","last_change":"2024-09-19T11:13:33.352551+0000","last_active":"2024-09-19T11:14:15.614216+0000","last_peered":"2024-09-19T11:14:15.614216+0000","last_clean":"2024-09-19T11:14:15.614216+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:14:15.614216+0000","last_undegraded":"2024-09-19T11:14:15.614216+0000","last_fullsized":"2024-09-19T11:14:15.614216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:30.759232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584809+0000","last_change":"2024-09-19T11:13:31.379078+0000","last_active":"2024-09-19T11:14:07.584809+0000","last_peered":"2024-09-19T11:14:07.584809+0000","last_clean":"2024-09-19T11:14:07.584809+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:14:07.584809+0000","last_undegraded":"2024-09-19T11:14:07.584809+0000","last_fullsized":"2024-09-19T11:14:07.584809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.899531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'19","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.972405+0000","last_change":"2024-09-19T11:13:33.352928+0000","last_active":"2024-09-19T11:16:42.972405+0000","last_peered":"2024-09-19T11:16:42.972405+0000","last_clean":"2024-09-19T11:16:42.972405+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:16:42.972405+0000","last_undegraded":"2024-09-19T11:16:42.972405+0000","last_fullsized":"2024-09-19T11:16:42.972405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:48.077538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587528+0000","last_change":"2024-09-19T11:13:31.379320+0000","last_active":"2024-09-19T11:14:07.587528+0000","last_peered":"2024-09-19T11:14:07.587528+0000","last_clean":"2024-09-19T11:14:07.587528+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:14:07.587528+0000","last_undegraded":"2024-09-19T11:14:07.587528+0000","last_fullsized":"2024-09-19T11:14:07.587528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:03.713851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974126+0000","last_change":"2024-09-19T11:13:33.350710+0000","last_active":"2024-09-19T11:16:42.974126+0000","last_peered":"2024-09-19T11:16:42.974126+0000","last_clean":"2024-09-19T11:16:42.974126+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:16:42.974126+0000","last_undegraded":"2024-09-19T11:16:42.974126+0000","last_fullsized":"2024-09-19T11:16:42.974126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:39.016549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587371+0000","last_change":"2024-09-19T11:13:31.364930+0000","last_active":"2024-09-19T11:14:07.587371+0000","last_peered":"2024-09-19T11:14:07.587371+0000","last_clean":"2024-09-19T11:14:07.587371+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:14:07.587371+0000","last_undegraded":"2024-09-19T11:14:07.587371+0000","last_fullsized":"2024-09-19T11:14:07.587371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:12.851669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740563+0000","last_change":"2024-09-19T11:13:33.356293+0000","last_active":"2024-09-19T11:16:42.740563+0000","last_peered":"2024-09-19T11:16:42.740563+0000","last_clean":"2024-09-19T11:16:42.740563+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:16:42.740563+0000","last_undegraded":"2024-09-19T11:16:42.740563+0000","last_fullsized":"2024-09-19T11:16:42.740563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:41.299802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.883059+0000","last_change":"2024-09-19T11:13:31.365707+0000","last_active":"2024-09-19T11:16:42.883059+0000","last_peered":"2024-09-19T11:16:42.883059+0000","last_clean":"2024-09-19T11:16:42.883059+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:16:42.883059+0000","last_undegraded":"2024-09-19T11:16:42.883059+0000","last_fullsized":"2024-09-19T11:16:42.883059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:40.080906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899087+0000","last_change":"2024-09-19T11:13:33.342404+0000","last_active":"2024-09-19T11:16:42.899087+0000","last_peered":"2024-09-19T11:16:42.899087+0000","last_clean":"2024-09-19T11:16:42.899087+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:16:42.899087+0000","last_undegraded":"2024-09-19T11:16:42.899087+0000","last_fullsized":"2024-09-19T11:16:42.899087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:34.386826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.592506+0000","last_change":"2024-09-19T11:13:31.357124+0000","last_active":"2024-09-19T11:14:15.592506+0000","last_peered":"2024-09-19T11:14:15.592506+0000","last_clean":"2024-09-19T11:14:15.592506+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:14:15.592506+0000","last_undegraded":"2024-09-19T11:14:15.592506+0000","last_fullsized":"2024-09-19T11:14:15.592506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:00.612209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114647+0000","last_change":"2024-09-19T11:13:33.350433+0000","last_active":"2024-09-19T11:14:58.114647+0000","last_peered":"2024-09-19T11:14:58.114647+0000","last_clean":"2024-09-19T11:14:58.114647+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:14:58.114647+0000","last_undegraded":"2024-09-19T11:14:58.114647+0000","last_fullsized":"2024-09-19T11:14:58.114647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:46.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.604436+0000","last_change":"2024-09-19T11:13:31.377880+0000","last_active":"2024-09-19T11:14:15.604436+0000","last_peered":"2024-09-19T11:14:15.604436+0000","last_clean":"2024-09-19T11:14:15.604436+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:14:15.604436+0000","last_undegraded":"2024-09-19T11:14:15.604436+0000","last_fullsized":"2024-09-19T11:14:15.604436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:33.996472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.627034+0000","last_change":"2024-09-19T11:13:33.359004+0000","last_active":"2024-09-19T11:16:42.627034+0000","last_peered":"2024-09-19T11:16:42.627034+0000","last_clean":"2024-09-19T11:16:42.627034+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:16:42.627034+0000","last_undegraded":"2024-09-19T11:16:42.627034+0000","last_fullsized":"2024-09-19T11:16:42.627034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:23.555499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584642+0000","last_change":"2024-09-19T11:13:31.375014+0000","last_active":"2024-09-19T11:14:07.584642+0000","last_peered":"2024-09-19T11:14:07.584642+0000","last_clean":"2024-09-19T11:14:07.584642+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:14:07.584642+0000","last_undegraded":"2024-09-19T11:14:07.584642+0000","last_fullsized":"2024-09-19T11:14:07.584642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:40.622834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974025+0000","last_change":"2024-09-19T11:13:33.353505+0000","last_active":"2024-09-19T11:16:42.974025+0000","last_peered":"2024-09-19T11:16:42.974025+0000","last_clean":"2024-09-19T11:16:42.974025+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:16:42.974025+0000","last_undegraded":"2024-09-19T11:16:42.974025+0000","last_fullsized":"2024-09-19T11:16:42.974025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:00.609441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.886205+0000","last_change":"2024-09-19T11:13:31.378087+0000","last_active":"2024-09-19T11:16:42.886205+0000","last_peered":"2024-09-19T11:16:42.886205+0000","last_clean":"2024-09-19T11:16:42.886205+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:16:42.886205+0000","last_undegraded":"2024-09-19T11:16:42.886205+0000","last_fullsized":"2024-09-19T11:16:42.886205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:38.991849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'11","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:50.539564+0000","last_change":"2024-09-19T11:13:33.355120+0000","last_active":"2024-09-19T11:15:50.539564+0000","last_peered":"2024-09-19T11:15:50.539564+0000","last_clean":"2024-09-19T11:15:50.539564+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:15:50.539564+0000","last_undegraded":"2024-09-19T11:15:50.539564+0000","last_fullsized":"2024-09-19T11:15:50.539564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:31.601366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542095+0000","last_change":"2024-09-19T11:13:31.369529+0000","last_active":"2024-09-19T11:15:48.542095+0000","last_peered":"2024-09-19T11:15:48.542095+0000","last_clean":"2024-09-19T11:15:48.542095+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:15:48.542095+0000","last_undegraded":"2024-09-19T11:15:48.542095+0000","last_fullsized":"2024-09-19T11:15:48.542095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:19.935588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003913+0000","last_change":"2024-09-19T11:13:33.343642+0000","last_active":"2024-09-19T11:16:43.003913+0000","last_peered":"2024-09-19T11:16:43.003913+0000","last_clean":"2024-09-19T11:16:43.003913+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:16:43.003913+0000","last_undegraded":"2024-09-19T11:16:43.003913+0000","last_fullsized":"2024-09-19T11:16:43.003913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:53.472377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594243+0000","last_change":"2024-09-19T11:13:31.367046+0000","last_active":"2024-09-19T11:14:07.594243+0000","last_peered":"2024-09-19T11:14:07.594243+0000","last_clean":"2024-09-19T11:14:07.594243+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:14:07.594243+0000","last_undegraded":"2024-09-19T11:14:07.594243+0000","last_fullsized":"2024-09-19T11:14:07.594243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.073704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:14:07.601382+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:18:56.799598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586433+0000","last_change":"2024-09-19T11:13:31.368567+0000","last_active":"2024-09-19T11:14:07.586433+0000","last_peered":"2024-09-19T11:14:07.586433+0000","last_clean":"2024-09-19T11:14:07.586433+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:14:07.586433+0000","last_undegraded":"2024-09-19T11:14:07.586433+0000","last_fullsized":"2024-09-19T11:14:07.586433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:54.576708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'11","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542111+0000","last_change":"2024-09-19T11:13:33.358374+0000","last_active":"2024-09-19T11:15:48.542111+0000","last_peered":"2024-09-19T11:15:48.542111+0000","last_clean":"2024-09-19T11:15:48.542111+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:15:48.542111+0000","last_undegraded":"2024-09-19T11:15:48.542111+0000","last_fullsized":"2024-09-19T11:15:48.542111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:51.284800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587720+0000","last_change":"2024-09-19T11:13:31.368596+0000","last_active":"2024-09-19T11:14:07.587720+0000","last_peered":"2024-09-19T11:14:07.587720+0000","last_clean":"2024-09-19T11:14:07.587720+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:14:07.587720+0000","last_undegraded":"2024-09-19T11:14:07.587720+0000","last_fullsized":"2024-09-19T11:14:07.587720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540107+0000","last_change":"2024-09-19T11:13:33.348514+0000","last_active":"2024-09-19T11:15:48.540107+0000","last_peered":"2024-09-19T11:15:48.540107+0000","last_clean":"2024-09-19T11:15:48.540107+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:15:48.540107+0000","last_undegraded":"2024-09-19T11:15:48.540107+0000","last_fullsized":"2024-09-19T11:15:48.540107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:09.293276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590777+0000","last_change":"2024-09-19T11:13:31.358674+0000","last_active":"2024-09-19T11:14:07.590777+0000","last_peered":"2024-09-19T11:14:07.590777+0000","last_clean":"2024-09-19T11:14:07.590777+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:14:07.590777+0000","last_undegraded":"2024-09-19T11:14:07.590777+0000","last_fullsized":"2024-09-19T11:14:07.590777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:33.620173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380975+0000","last_change":"2024-09-19T11:13:33.349772+0000","last_active":"2024-09-19T11:14:15.380975+0000","last_peered":"2024-09-19T11:14:15.380975+0000","last_clean":"2024-09-19T11:14:15.380975+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:14:15.380975+0000","last_undegraded":"2024-09-19T11:14:15.380975+0000","last_fullsized":"2024-09-19T11:14:15.380975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:19.296584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:53.541138+0000","last_change":"2024-09-19T11:13:31.367744+0000","last_active":"2024-09-19T11:15:53.541138+0000","last_peered":"2024-09-19T11:15:53.541138+0000","last_clean":"2024-09-19T11:15:53.541138+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:15:53.541138+0000","last_undegraded":"2024-09-19T11:15:53.541138+0000","last_fullsized":"2024-09-19T11:15:53.541138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:00.738468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585297+0000","last_change":"2024-09-19T11:13:31.375358+0000","last_active":"2024-09-19T11:14:07.585297+0000","last_peered":"2024-09-19T11:14:07.585297+0000","last_clean":"2024-09-19T11:14:07.585297+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:14:07.585297+0000","last_undegraded":"2024-09-19T11:14:07.585297+0000","last_fullsized":"2024-09-19T11:14:07.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:48:05.720807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898876+0000","last_change":"2024-09-19T11:13:33.349130+0000","last_active":"2024-09-19T11:16:42.898876+0000","last_peered":"2024-09-19T11:16:42.898876+0000","last_clean":"2024-09-19T11:16:42.898876+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:16:42.898876+0000","last_undegraded":"2024-09-19T11:16:42.898876+0000","last_fullsized":"2024-09-19T11:16:42.898876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:05.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:50.539463+0000","last_change":"2024-09-19T11:13:31.378883+0000","last_active":"2024-09-19T11:15:50.539463+0000","last_peered":"2024-09-19T11:15:50.539463+0000","last_clean":"2024-09-19T11:15:50.539463+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:15:50.539463+0000","last_undegraded":"2024-09-19T11:15:50.539463+0000","last_fullsized":"2024-09-19T11:15:50.539463+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:53.943968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740036+0000","last_change":"2024-09-19T11:13:33.353238+0000","last_active":"2024-09-19T11:16:42.740036+0000","last_peered":"2024-09-19T11:16:42.740036+0000","last_clean":"2024-09-19T11:16:42.740036+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:16:42.740036+0000","last_undegraded":"2024-09-19T11:16:42.740036+0000","last_fullsized":"2024-09-19T11:16:42.740036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:02.108897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2256,"ondisk_log_size":2256,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":13385,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1403,"num_read_kb":1189,"num_write":533,"num_write_kb":73,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":286720,"data_stored":10826,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1276,"ondisk_log_size":1276,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":961,"num_read_kb":961,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":25809792,"num_objects":7,"num_object_clones":0,"num_object_copies":28,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":182,"num_read_kb":87,"num_write":309,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":34422784,"data_stored":34422784,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":76,"ondisk_log_size":76,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44252,"kb_used_data":8908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327588,"statfs":{"total":96636764160,"available":96591450112,"internally_reserved":0,"allocated":9121792,"data_stored":8769388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44756,"kb_used_data":9412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327084,"statfs":{"total":96636764160,"available":96590934016,"internally_reserved":0,"allocated":9637888,"data_stored":9354762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640304,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44780,"kb_used_data":9436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327060,"statfs":{"total":96636764160,"available":96590909440,"internally_reserved":0,"allocated":9662464,"data_stored":9355091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705710,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8768369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":65536,"data_stored":3361,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:16:50.606 INFO:tasks.ceph.ceph_manager.ceph:clean! 2024-09-19T11:16:50.607 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:16:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.736+0000 7f207f685640 1 Processor -- start 2024-09-19T11:16:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.736+0000 7f207f685640 1 -- start start 2024-09-19T11:16:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.737+0000 7f207f685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f207812c320 0x7f207812c700 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.737+0000 7f207f685640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f207812c0a0 con 0x7f207812f330 2024-09-19T11:16:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.737+0000 7f207f685640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f2078098f30 con 0x7f207812c320 2024-09-19T11:16:50.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.737+0000 7f207d421640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f207812c320 0x7f207812c700 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.737+0000 7f207cc20640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f207812f330 0x7f207812f740 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57662/0 (socket says 172.21.15.37:57662) 2024-09-19T11:16:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.737+0000 7f207cc20640 1 -- 172.21.15.37:0/2770853528 learned_addr learned my addr 172.21.15.37:0/2770853528 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.737+0000 7f207d421640 1 -- 172.21.15.37:0/2770853528 >> v1:172.21.15.37:6789/0 conn(0x7f207812f330 legacy=0x7f207812f740 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.740 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.737+0000 7f207d421640 1 -- 172.21.15.37:0/2770853528 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2078073aa0 con 0x7f207812c320 2024-09-19T11:16:50.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.738+0000 7f207d421640 1 --2- 172.21.15.37:0/2770853528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f207812c700 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2068009d90 tx=0x7f206802a6f0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=38577d148e4c6284 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.741 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.738+0000 7f2077fff640 1 -- 172.21.15.37:0/2770853528 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2068007670 con 0x7f207812c320 2024-09-19T11:16:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.738+0000 7f2077fff640 1 -- 172.21.15.37:0/2770853528 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2068007810 con 0x7f207812c320 2024-09-19T11:16:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.738+0000 7f2077fff640 1 -- 172.21.15.37:0/2770853528 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2068007b10 con 0x7f207812c320 2024-09-19T11:16:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.738+0000 7f207f685640 1 -- 172.21.15.37:0/2770853528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 msgr2=0x7f207812c700 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.738+0000 7f207f685640 1 --2- 172.21.15.37:0/2770853528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f207812c700 secure :-1 s=READY pgs=857 cs=0 l=1 rev1=1 crypto rx=0x7f2068009d90 tx=0x7f206802a6f0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.739+0000 7f207f685640 1 -- 172.21.15.37:0/2770853528 shutdown_connections 2024-09-19T11:16:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.739+0000 7f207f685640 1 --2- 172.21.15.37:0/2770853528 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f207812c700 unknown :-1 s=CLOSED pgs=857 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.739+0000 7f207f685640 1 -- 172.21.15.37:0/2770853528 >> 172.21.15.37:0/2770853528 conn(0x7f207809edf0 msgr2=0x7f207809f200 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:50.744 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.739+0000 7f207f685640 1 -- 172.21.15.37:0/2770853528 shutdown_connections 2024-09-19T11:16:50.745 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.739+0000 7f207f685640 1 -- 172.21.15.37:0/2770853528 wait complete. 2024-09-19T11:16:50.746 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.739+0000 7f207f685640 1 Processor -- start 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.740+0000 7f207f685640 1 -- start start 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.740+0000 7f207f685640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f20781c43f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.740+0000 7f207f685640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f207812fe50 con 0x7f207812c320 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.740+0000 7f207d421640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f20781c43f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.740+0000 7f207d421640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f20781c43f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55110/0 (socket says 172.21.15.37:55110) 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.740+0000 7f207d421640 1 -- 172.21.15.37:0/1626210412 learned_addr learned my addr 172.21.15.37:0/1626210412 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.740+0000 7f207d421640 1 -- 172.21.15.37:0/1626210412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f2078098d20 con 0x7f207812c320 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.740+0000 7f207d421640 1 --2- 172.21.15.37:0/1626210412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f20781c43f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2068009eb0 tx=0x7f2068004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.741+0000 7f2075ffb640 1 -- 172.21.15.37:0/1626210412 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2068040070 con 0x7f207812c320 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.741+0000 7f2075ffb640 1 -- 172.21.15.37:0/1626210412 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f2068031a90 con 0x7f207812c320 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.741+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f207808c860 con 0x7f207812c320 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.741+0000 7f2075ffb640 1 -- 172.21.15.37:0/1626210412 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f2068031d70 con 0x7f207812c320 2024-09-19T11:16:50.747 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.741+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f20781c4b10 con 0x7f207812c320 2024-09-19T11:16:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.742+0000 7f2075ffb640 1 -- 172.21.15.37:0/1626210412 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f2068039040 con 0x7f207812c320 2024-09-19T11:16:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.742+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f207812c700 con 0x7f207812c320 2024-09-19T11:16:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.742+0000 7f2075ffb640 1 --2- 172.21.15.37:0/1626210412 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f206403e710 0x7f2064040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.742+0000 7f2075ffb640 1 -- 172.21.15.37:0/1626210412 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f20680752c0 con 0x7f207812c320 2024-09-19T11:16:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.742+0000 7f207cc20640 1 --2- 172.21.15.37:0/1626210412 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f206403e710 0x7f2064040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.743+0000 7f207cc20640 1 --2- 172.21.15.37:0/1626210412 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f206403e710 0x7f2064040bd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f206c007fd0 tx=0x7f206c007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:50.748 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.746+0000 7f2075ffb640 1 -- 172.21.15.37:0/1626210412 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f206803cc20 con 0x7f207812c320 2024-09-19T11:16:50.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.929+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f207808c330 con 0x7f206403e710 2024-09-19T11:16:50.940 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.939+0000 7f2075ffb640 1 -- 172.21.15.37:0/1626210412 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666036 (secure 0 0 0) 0x7f207808c330 con 0x7f206403e710 2024-09-19T11:16:50.950 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:16:50.956 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:16:50.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f206403e710 msgr2=0x7f2064040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 --2- 172.21.15.37:0/1626210412 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f206403e710 0x7f2064040bd0 secure :-1 s=READY pgs=358 cs=0 l=1 rev1=1 crypto rx=0x7f206c007fd0 tx=0x7f206c007aa0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 msgr2=0x7f20781c43f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:50.961 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 --2- 172.21.15.37:0/1626210412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f20781c43f0 secure :-1 s=READY pgs=858 cs=0 l=1 rev1=1 crypto rx=0x7f2068009eb0 tx=0x7f2068004a40 comp rx=0 tx=0).stop 2024-09-19T11:16:50.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 shutdown_connections 2024-09-19T11:16:50.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 --2- 172.21.15.37:0/1626210412 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f206403e710 0x7f2064040bd0 unknown :-1 s=CLOSED pgs=358 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 --2- 172.21.15.37:0/1626210412 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f207812c320 0x7f20781c43f0 unknown :-1 s=CLOSED pgs=858 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:50.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 >> 172.21.15.37:0/1626210412 conn(0x7f207809edf0 msgr2=0x7f20780972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:50.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 shutdown_connections 2024-09-19T11:16:50.962 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:50.944+0000 7f207f685640 1 -- 172.21.15.37:0/1626210412 wait complete. 2024-09-19T11:16:50.962 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":144,"stamp":"2024-09-19T11:16:50.580345+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18034786,"num_objects":227,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":5018,"num_read_kb":4565,"num_write":2070,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4469,"ondisk_log_size":4469,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182168,"kb_used_data":36632,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377305192,"statfs":{"total":386547056640,"available":386360516608,"internally_reserved":0,"allocated":37511168,"data_stored":36247610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17433657,"num_objects":7,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":599,"num_read_kb":551,"num_write":406,"num_write_kb":29375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009536"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.894957+0000","last_change":"2024-09-19T11:13:31.355447+0000","last_active":"2024-09-19T11:15:41.894957+0000","last_peered":"2024-09-19T11:15:41.894957+0000","last_clean":"2024-09-19T11:15:41.894957+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:15:41.894957+0000","last_undegraded":"2024-09-19T11:15:41.894957+0000","last_fullsized":"2024-09-19T11:15:41.894957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:32:10.862799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114848+0000","last_change":"2024-09-19T11:13:33.358262+0000","last_active":"2024-09-19T11:14:58.114848+0000","last_peered":"2024-09-19T11:14:58.114848+0000","last_clean":"2024-09-19T11:14:58.114848+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:14:58.114848+0000","last_undegraded":"2024-09-19T11:14:58.114848+0000","last_fullsized":"2024-09-19T11:14:58.114848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:04.357110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589370+0000","last_change":"2024-09-19T11:13:31.378145+0000","last_active":"2024-09-19T11:14:07.589370+0000","last_peered":"2024-09-19T11:14:07.589370+0000","last_clean":"2024-09-19T11:14:07.589370+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:14:07.589370+0000","last_undegraded":"2024-09-19T11:14:07.589370+0000","last_fullsized":"2024-09-19T11:14:07.589370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.937182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.010386+0000","last_change":"2024-09-19T11:13:33.353250+0000","last_active":"2024-09-19T11:16:43.010386+0000","last_peered":"2024-09-19T11:16:43.010386+0000","last_clean":"2024-09-19T11:16:43.010386+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:16:43.010386+0000","last_undegraded":"2024-09-19T11:16:43.010386+0000","last_fullsized":"2024-09-19T11:16:43.010386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:36.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588134+0000","last_change":"2024-09-19T11:13:31.373399+0000","last_active":"2024-09-19T11:14:07.588134+0000","last_peered":"2024-09-19T11:14:07.588134+0000","last_clean":"2024-09-19T11:14:07.588134+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:14:07.588134+0000","last_undegraded":"2024-09-19T11:14:07.588134+0000","last_fullsized":"2024-09-19T11:14:07.588134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:37.878601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740541+0000","last_change":"2024-09-19T11:14:07.595868+0000","last_active":"2024-09-19T11:16:42.740541+0000","last_peered":"2024-09-19T11:16:42.740541+0000","last_clean":"2024-09-19T11:16:42.740541+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:16:42.740541+0000","last_undegraded":"2024-09-19T11:16:42.740541+0000","last_fullsized":"2024-09-19T11:16:42.740541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:59.387595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588085+0000","last_change":"2024-09-19T11:13:31.369527+0000","last_active":"2024-09-19T11:14:07.588085+0000","last_peered":"2024-09-19T11:14:07.588085+0000","last_clean":"2024-09-19T11:14:07.588085+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:14:07.588085+0000","last_undegraded":"2024-09-19T11:14:07.588085+0000","last_fullsized":"2024-09-19T11:14:07.588085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:42.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.965800+0000","last_change":"2024-09-19T11:13:33.349816+0000","last_active":"2024-09-19T11:16:42.965800+0000","last_peered":"2024-09-19T11:16:42.965800+0000","last_clean":"2024-09-19T11:16:42.965800+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:16:42.965800+0000","last_undegraded":"2024-09-19T11:16:42.965800+0000","last_fullsized":"2024-09-19T11:16:42.965800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:57.078087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586339+0000","last_change":"2024-09-19T11:13:31.373460+0000","last_active":"2024-09-19T11:14:07.586339+0000","last_peered":"2024-09-19T11:14:07.586339+0000","last_clean":"2024-09-19T11:14:07.586339+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:14:07.586339+0000","last_undegraded":"2024-09-19T11:14:07.586339+0000","last_fullsized":"2024-09-19T11:14:07.586339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:25.708826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003992+0000","last_change":"2024-09-19T11:13:33.347020+0000","last_active":"2024-09-19T11:16:43.003992+0000","last_peered":"2024-09-19T11:16:43.003992+0000","last_clean":"2024-09-19T11:16:43.003992+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:16:43.003992+0000","last_undegraded":"2024-09-19T11:16:43.003992+0000","last_fullsized":"2024-09-19T11:16:43.003992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:10.234097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588864+0000","last_change":"2024-09-19T11:13:31.359276+0000","last_active":"2024-09-19T11:14:07.588864+0000","last_peered":"2024-09-19T11:14:07.588864+0000","last_clean":"2024-09-19T11:14:07.588864+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:14:07.588864+0000","last_undegraded":"2024-09-19T11:14:07.588864+0000","last_fullsized":"2024-09-19T11:14:07.588864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.682041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'21","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:13.543344+0000","last_change":"2024-09-19T11:14:07.607174+0000","last_active":"2024-09-19T11:16:13.543344+0000","last_peered":"2024-09-19T11:16:13.543344+0000","last_clean":"2024-09-19T11:16:13.543344+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:16:13.543344+0000","last_undegraded":"2024-09-19T11:16:13.543344+0000","last_fullsized":"2024-09-19T11:16:13.543344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:02.443641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585495+0000","last_change":"2024-09-19T11:13:31.366931+0000","last_active":"2024-09-19T11:14:07.585495+0000","last_peered":"2024-09-19T11:14:07.585495+0000","last_clean":"2024-09-19T11:14:07.585495+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:14:07.585495+0000","last_undegraded":"2024-09-19T11:14:07.585495+0000","last_fullsized":"2024-09-19T11:14:07.585495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:34.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966174+0000","last_change":"2024-09-19T11:13:33.347406+0000","last_active":"2024-09-19T11:16:42.966174+0000","last_peered":"2024-09-19T11:16:42.966174+0000","last_clean":"2024-09-19T11:16:42.966174+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:16:42.966174+0000","last_undegraded":"2024-09-19T11:16:42.966174+0000","last_fullsized":"2024-09-19T11:16:42.966174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:53.972293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.853085+0000","last_change":"2024-09-19T11:13:31.364605+0000","last_active":"2024-09-19T11:15:41.853085+0000","last_peered":"2024-09-19T11:15:41.853085+0000","last_clean":"2024-09-19T11:15:41.853085+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:15:41.853085+0000","last_undegraded":"2024-09-19T11:15:41.853085+0000","last_fullsized":"2024-09-19T11:15:41.853085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:34.677119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:13:33.353995+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:03.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096691+0000","last_change":"2024-09-19T11:13:33.353058+0000","last_active":"2024-09-19T11:15:42.096691+0000","last_peered":"2024-09-19T11:15:42.096691+0000","last_clean":"2024-09-19T11:15:42.096691+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:15:42.096691+0000","last_undegraded":"2024-09-19T11:15:42.096691+0000","last_fullsized":"2024-09-19T11:15:42.096691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:02.922700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.597092+0000","last_change":"2024-09-19T11:13:31.365956+0000","last_active":"2024-09-19T11:14:07.597092+0000","last_peered":"2024-09-19T11:14:07.597092+0000","last_clean":"2024-09-19T11:14:07.597092+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:14:07.597092+0000","last_undegraded":"2024-09-19T11:14:07.597092+0000","last_fullsized":"2024-09-19T11:14:07.597092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:41.205308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594343+0000","last_change":"2024-09-19T11:13:33.357169+0000","last_active":"2024-09-19T11:14:07.594343+0000","last_peered":"2024-09-19T11:14:07.594343+0000","last_clean":"2024-09-19T11:14:07.594343+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:14:07.594343+0000","last_undegraded":"2024-09-19T11:14:07.594343+0000","last_fullsized":"2024-09-19T11:14:07.594343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.541252+0000","last_change":"2024-09-19T11:13:31.372373+0000","last_active":"2024-09-19T11:15:58.541252+0000","last_peered":"2024-09-19T11:15:58.541252+0000","last_clean":"2024-09-19T11:15:58.541252+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:15:58.541252+0000","last_undegraded":"2024-09-19T11:15:58.541252+0000","last_fullsized":"2024-09-19T11:15:58.541252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.073704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595274+0000","last_change":"2024-09-19T11:13:33.359507+0000","last_active":"2024-09-19T11:14:07.595274+0000","last_peered":"2024-09-19T11:14:07.595274+0000","last_clean":"2024-09-19T11:14:07.595274+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:14:07.595274+0000","last_undegraded":"2024-09-19T11:14:07.595274+0000","last_fullsized":"2024-09-19T11:14:07.595274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.272518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.103060+0000","last_change":"2024-09-19T11:13:31.365136+0000","last_active":"2024-09-19T11:14:58.103060+0000","last_peered":"2024-09-19T11:14:58.103060+0000","last_clean":"2024-09-19T11:14:58.103060+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:14:58.103060+0000","last_undegraded":"2024-09-19T11:14:58.103060+0000","last_fullsized":"2024-09-19T11:14:58.103060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.682041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966073+0000","last_change":"2024-09-19T11:13:33.350242+0000","last_active":"2024-09-19T11:16:42.966073+0000","last_peered":"2024-09-19T11:16:42.966073+0000","last_clean":"2024-09-19T11:16:42.966073+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:16:42.966073+0000","last_undegraded":"2024-09-19T11:16:42.966073+0000","last_fullsized":"2024-09-19T11:16:42.966073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:29.796543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595616+0000","last_change":"2024-09-19T11:13:31.364143+0000","last_active":"2024-09-19T11:14:07.595616+0000","last_peered":"2024-09-19T11:14:07.595616+0000","last_clean":"2024-09-19T11:14:07.595616+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:14:07.595616+0000","last_undegraded":"2024-09-19T11:14:07.595616+0000","last_fullsized":"2024-09-19T11:14:07.595616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:37.328576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004192+0000","last_change":"2024-09-19T11:13:33.354404+0000","last_active":"2024-09-19T11:16:43.004192+0000","last_peered":"2024-09-19T11:16:43.004192+0000","last_clean":"2024-09-19T11:16:43.004192+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:16:43.004192+0000","last_undegraded":"2024-09-19T11:16:43.004192+0000","last_fullsized":"2024-09-19T11:16:43.004192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.704309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.524833+0000","last_change":"2024-09-19T11:13:31.379619+0000","last_active":"2024-09-19T11:14:14.524833+0000","last_peered":"2024-09-19T11:14:14.524833+0000","last_clean":"2024-09-19T11:14:14.524833+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:14:14.524833+0000","last_undegraded":"2024-09-19T11:14:14.524833+0000","last_fullsized":"2024-09-19T11:14:14.524833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:44.219899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380970+0000","last_change":"2024-09-19T11:13:33.345480+0000","last_active":"2024-09-19T11:14:15.380970+0000","last_peered":"2024-09-19T11:14:15.380970+0000","last_clean":"2024-09-19T11:14:15.380970+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:14:15.380970+0000","last_undegraded":"2024-09-19T11:14:15.380970+0000","last_fullsized":"2024-09-19T11:14:15.380970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:37.629627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585477+0000","last_change":"2024-09-19T11:13:31.368987+0000","last_active":"2024-09-19T11:14:07.585477+0000","last_peered":"2024-09-19T11:14:07.585477+0000","last_clean":"2024-09-19T11:14:07.585477+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:14:07.585477+0000","last_undegraded":"2024-09-19T11:14:07.585477+0000","last_fullsized":"2024-09-19T11:14:07.585477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:51.462004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.938013+0000","last_change":"2024-09-19T11:13:41.395109+0000","last_active":"2024-09-19T11:16:42.938013+0000","last_peered":"2024-09-19T11:16:42.938013+0000","last_clean":"2024-09-19T11:16:42.938013+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:16:42.938013+0000","last_undegraded":"2024-09-19T11:16:42.938013+0000","last_fullsized":"2024-09-19T11:16:42.938013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:41.943528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.635691+0000","last_change":"2024-09-19T11:13:33.348565+0000","last_active":"2024-09-19T11:16:42.635691+0000","last_peered":"2024-09-19T11:16:42.635691+0000","last_clean":"2024-09-19T11:16:42.635691+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:16:42.635691+0000","last_undegraded":"2024-09-19T11:16:42.635691+0000","last_fullsized":"2024-09-19T11:16:42.635691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:09.744080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585089+0000","last_change":"2024-09-19T11:13:31.378052+0000","last_active":"2024-09-19T11:14:07.585089+0000","last_peered":"2024-09-19T11:14:07.585089+0000","last_clean":"2024-09-19T11:14:07.585089+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:14:07.585089+0000","last_undegraded":"2024-09-19T11:14:07.585089+0000","last_fullsized":"2024-09-19T11:14:07.585089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:57.883105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586243+0000","last_change":"2024-09-19T11:13:35.358078+0000","last_active":"2024-09-19T11:14:07.586243+0000","last_peered":"2024-09-19T11:14:07.586243+0000","last_clean":"2024-09-19T11:14:07.586243+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:14:07.586243+0000","last_undegraded":"2024-09-19T11:14:07.586243+0000","last_fullsized":"2024-09-19T11:14:07.586243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:59.783214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.344946+0000","last_change":"2024-09-19T11:13:37.368405+0000","last_active":"2024-09-19T11:15:40.344946+0000","last_peered":"2024-09-19T11:15:40.344946+0000","last_clean":"2024-09-19T11:15:40.344946+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:15:40.344946+0000","last_undegraded":"2024-09-19T11:15:40.344946+0000","last_fullsized":"2024-09-19T11:15:40.344946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:09.867739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596623+0000","last_change":"2024-09-19T11:13:39.376399+0000","last_active":"2024-09-19T11:14:07.596623+0000","last_peered":"2024-09-19T11:14:07.596623+0000","last_clean":"2024-09-19T11:14:07.596623+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:14:07.596623+0000","last_undegraded":"2024-09-19T11:14:07.596623+0000","last_fullsized":"2024-09-19T11:14:07.596623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:16.668274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.935993+0000","last_change":"2024-09-19T11:13:41.393295+0000","last_active":"2024-09-19T11:14:57.935993+0000","last_peered":"2024-09-19T11:14:57.935993+0000","last_clean":"2024-09-19T11:14:57.935993+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:14:57.935993+0000","last_undegraded":"2024-09-19T11:14:57.935993+0000","last_fullsized":"2024-09-19T11:14:57.935993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:48.199857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112515+0000","last_change":"2024-09-19T11:13:33.353288+0000","last_active":"2024-09-19T11:14:58.112515+0000","last_peered":"2024-09-19T11:14:58.112515+0000","last_clean":"2024-09-19T11:14:58.112515+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:14:58.112515+0000","last_undegraded":"2024-09-19T11:14:58.112515+0000","last_fullsized":"2024-09-19T11:14:58.112515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.684931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.037595+0000","last_change":"2024-09-19T11:13:31.359853+0000","last_active":"2024-09-19T11:15:42.037595+0000","last_peered":"2024-09-19T11:15:42.037595+0000","last_clean":"2024-09-19T11:15:42.037595+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:15:42.037595+0000","last_undegraded":"2024-09-19T11:15:42.037595+0000","last_fullsized":"2024-09-19T11:15:42.037595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:35.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586880+0000","last_change":"2024-09-19T11:13:35.350079+0000","last_active":"2024-09-19T11:14:07.586880+0000","last_peered":"2024-09-19T11:14:07.586880+0000","last_clean":"2024-09-19T11:14:07.586880+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:14:07.586880+0000","last_undegraded":"2024-09-19T11:14:07.586880+0000","last_fullsized":"2024-09-19T11:14:07.586880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:28.629336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596198+0000","last_change":"2024-09-19T11:13:37.365209+0000","last_active":"2024-09-19T11:14:07.596198+0000","last_peered":"2024-09-19T11:14:07.596198+0000","last_clean":"2024-09-19T11:14:07.596198+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:14:07.596198+0000","last_undegraded":"2024-09-19T11:14:07.596198+0000","last_fullsized":"2024-09-19T11:14:07.596198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:11.593458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595746+0000","last_change":"2024-09-19T11:13:39.377776+0000","last_active":"2024-09-19T11:14:07.595746+0000","last_peered":"2024-09-19T11:14:07.595746+0000","last_clean":"2024-09-19T11:14:07.595746+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:14:07.595746+0000","last_undegraded":"2024-09-19T11:14:07.595746+0000","last_fullsized":"2024-09-19T11:14:07.595746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:02.688553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586216+0000","last_change":"2024-09-19T11:13:41.387845+0000","last_active":"2024-09-19T11:14:07.586216+0000","last_peered":"2024-09-19T11:14:07.586216+0000","last_clean":"2024-09-19T11:14:07.586216+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:14:07.586216+0000","last_undegraded":"2024-09-19T11:14:07.586216+0000","last_fullsized":"2024-09-19T11:14:07.586216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:01.782452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004066+0000","last_change":"2024-09-19T11:13:33.354310+0000","last_active":"2024-09-19T11:16:43.004066+0000","last_peered":"2024-09-19T11:16:43.004066+0000","last_clean":"2024-09-19T11:16:43.004066+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:16:43.004066+0000","last_undegraded":"2024-09-19T11:16:43.004066+0000","last_fullsized":"2024-09-19T11:16:43.004066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.803193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584449+0000","last_change":"2024-09-19T11:13:31.367163+0000","last_active":"2024-09-19T11:14:07.584449+0000","last_peered":"2024-09-19T11:14:07.584449+0000","last_clean":"2024-09-19T11:14:07.584449+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:14:07.584449+0000","last_undegraded":"2024-09-19T11:14:07.584449+0000","last_fullsized":"2024-09-19T11:14:07.584449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:05.930286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:08.524886+0000","last_change":"2024-09-19T11:14:07.594305+0000","last_active":"2024-09-19T11:14:08.524886+0000","last_peered":"2024-09-19T11:14:08.524886+0000","last_clean":"2024-09-19T11:14:08.524886+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:14:08.524886+0000","last_undegraded":"2024-09-19T11:14:08.524886+0000","last_fullsized":"2024-09-19T11:14:08.524886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:34.741293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587760+0000","last_change":"2024-09-19T11:13:37.365423+0000","last_active":"2024-09-19T11:14:07.587760+0000","last_peered":"2024-09-19T11:14:07.587760+0000","last_clean":"2024-09-19T11:14:07.587760+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:14:07.587760+0000","last_undegraded":"2024-09-19T11:14:07.587760+0000","last_fullsized":"2024-09-19T11:14:07.587760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:05.026614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":382,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437367+0000","last_change":"2024-09-19T11:13:39.380724+0000","last_active":"2024-09-19T11:16:40.437367+0000","last_peered":"2024-09-19T11:16:40.437367+0000","last_clean":"2024-09-19T11:16:40.437367+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:16:40.437367+0000","last_undegraded":"2024-09-19T11:16:40.437367+0000","last_fullsized":"2024-09-19T11:16:40.437367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587647+0000","last_change":"2024-09-19T11:13:41.387332+0000","last_active":"2024-09-19T11:14:07.587647+0000","last_peered":"2024-09-19T11:14:07.587647+0000","last_clean":"2024-09-19T11:14:07.587647+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:14:07.587647+0000","last_undegraded":"2024-09-19T11:14:07.587647+0000","last_fullsized":"2024-09-19T11:14:07.587647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:45.206952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740577+0000","last_change":"2024-09-19T11:13:33.349800+0000","last_active":"2024-09-19T11:16:42.740577+0000","last_peered":"2024-09-19T11:16:42.740577+0000","last_clean":"2024-09-19T11:16:42.740577+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:16:42.740577+0000","last_undegraded":"2024-09-19T11:16:42.740577+0000","last_fullsized":"2024-09-19T11:16:42.740577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.241186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.999172+0000","last_change":"2024-09-19T11:13:31.365771+0000","last_active":"2024-09-19T11:16:42.999172+0000","last_peered":"2024-09-19T11:16:42.999172+0000","last_clean":"2024-09-19T11:16:42.999172+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:42.999172+0000","last_undegraded":"2024-09-19T11:16:42.999172+0000","last_fullsized":"2024-09-19T11:16:42.999172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:03.270284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586260+0000","last_change":"2024-09-19T11:13:35.355473+0000","last_active":"2024-09-19T11:14:07.586260+0000","last_peered":"2024-09-19T11:14:07.586260+0000","last_clean":"2024-09-19T11:14:07.586260+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:14:07.586260+0000","last_undegraded":"2024-09-19T11:14:07.586260+0000","last_fullsized":"2024-09-19T11:14:07.586260+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:26.695828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.339270+0000","last_change":"2024-09-19T11:13:37.367406+0000","last_active":"2024-09-19T11:15:40.339270+0000","last_peered":"2024-09-19T11:15:40.339270+0000","last_clean":"2024-09-19T11:15:40.339270+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:15:40.339270+0000","last_undegraded":"2024-09-19T11:15:40.339270+0000","last_fullsized":"2024-09-19T11:15:40.339270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.650159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":445,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.719611+0000","last_change":"2024-09-19T11:13:39.380575+0000","last_active":"2024-09-19T11:16:49.719611+0000","last_peered":"2024-09-19T11:16:49.719611+0000","last_clean":"2024-09-19T11:16:49.719611+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:16:49.719611+0000","last_undegraded":"2024-09-19T11:16:49.719611+0000","last_fullsized":"2024-09-19T11:16:49.719611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:21.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898938+0000","last_change":"2024-09-19T11:13:33.354325+0000","last_active":"2024-09-19T11:16:42.898938+0000","last_peered":"2024-09-19T11:16:42.898938+0000","last_clean":"2024-09-19T11:16:42.898938+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:16:42.898938+0000","last_undegraded":"2024-09-19T11:16:42.898938+0000","last_fullsized":"2024-09-19T11:16:42.898938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:50.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.591224+0000","last_change":"2024-09-19T11:13:31.353600+0000","last_active":"2024-09-19T11:14:07.591224+0000","last_peered":"2024-09-19T11:14:07.591224+0000","last_clean":"2024-09-19T11:14:07.591224+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:14:07.591224+0000","last_undegraded":"2024-09-19T11:14:07.591224+0000","last_fullsized":"2024-09-19T11:14:07.591224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:09.178158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593431+0000","last_change":"2024-09-19T11:13:35.356693+0000","last_active":"2024-09-19T11:14:07.593431+0000","last_peered":"2024-09-19T11:14:07.593431+0000","last_clean":"2024-09-19T11:14:07.593431+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:14:07.593431+0000","last_undegraded":"2024-09-19T11:14:07.593431+0000","last_fullsized":"2024-09-19T11:14:07.593431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:50.222469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'40","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.348918+0000","last_change":"2024-09-19T11:13:37.371444+0000","last_active":"2024-09-19T11:15:40.348918+0000","last_peered":"2024-09-19T11:15:40.348918+0000","last_clean":"2024-09-19T11:15:40.348918+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:15:40.348918+0000","last_undegraded":"2024-09-19T11:15:40.348918+0000","last_fullsized":"2024-09-19T11:15:40.348918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:45.830373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587567+0000","last_change":"2024-09-19T11:13:39.374414+0000","last_active":"2024-09-19T11:14:07.587567+0000","last_peered":"2024-09-19T11:14:07.587567+0000","last_clean":"2024-09-19T11:14:07.587567+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:14:07.587567+0000","last_undegraded":"2024-09-19T11:14:07.587567+0000","last_fullsized":"2024-09-19T11:14:07.587567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:56.581253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.937677+0000","last_change":"2024-09-19T11:13:41.391613+0000","last_active":"2024-09-19T11:14:57.937677+0000","last_peered":"2024-09-19T11:14:57.937677+0000","last_clean":"2024-09-19T11:14:57.937677+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:14:57.937677+0000","last_undegraded":"2024-09-19T11:14:57.937677+0000","last_fullsized":"2024-09-19T11:14:57.937677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:05.344146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740320+0000","last_change":"2024-09-19T11:13:33.342412+0000","last_active":"2024-09-19T11:16:42.740320+0000","last_peered":"2024-09-19T11:16:42.740320+0000","last_clean":"2024-09-19T11:16:42.740320+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:16:42.740320+0000","last_undegraded":"2024-09-19T11:16:42.740320+0000","last_fullsized":"2024-09-19T11:16:42.740320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590222+0000","last_change":"2024-09-19T11:13:31.355731+0000","last_active":"2024-09-19T11:14:07.590222+0000","last_peered":"2024-09-19T11:14:07.590222+0000","last_clean":"2024-09-19T11:14:07.590222+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:14:07.590222+0000","last_undegraded":"2024-09-19T11:14:07.590222+0000","last_fullsized":"2024-09-19T11:14:07.590222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:05.006192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586420+0000","last_change":"2024-09-19T11:13:35.352067+0000","last_active":"2024-09-19T11:14:07.586420+0000","last_peered":"2024-09-19T11:14:07.586420+0000","last_clean":"2024-09-19T11:14:07.586420+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:14:07.586420+0000","last_undegraded":"2024-09-19T11:14:07.586420+0000","last_fullsized":"2024-09-19T11:14:07.586420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:58.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.329228+0000","last_change":"2024-09-19T11:13:37.369761+0000","last_active":"2024-09-19T11:15:40.329228+0000","last_peered":"2024-09-19T11:15:40.329228+0000","last_clean":"2024-09-19T11:15:40.329228+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:15:40.329228+0000","last_undegraded":"2024-09-19T11:15:40.329228+0000","last_fullsized":"2024-09-19T11:15:40.329228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.455607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587463+0000","last_change":"2024-09-19T11:13:39.381205+0000","last_active":"2024-09-19T11:14:07.587463+0000","last_peered":"2024-09-19T11:14:07.587463+0000","last_clean":"2024-09-19T11:14:07.587463+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:14:07.587463+0000","last_undegraded":"2024-09-19T11:14:07.587463+0000","last_fullsized":"2024-09-19T11:14:07.587463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:48.612042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:52.381729+0000","last_change":"2024-09-19T11:13:41.393002+0000","last_active":"2024-09-19T11:14:52.381729+0000","last_peered":"2024-09-19T11:14:52.381729+0000","last_clean":"2024-09-19T11:14:52.381729+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:14:52.381729+0000","last_undegraded":"2024-09-19T11:14:52.381729+0000","last_fullsized":"2024-09-19T11:14:52.381729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:23.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115156+0000","last_change":"2024-09-19T11:13:33.351582+0000","last_active":"2024-09-19T11:14:58.115156+0000","last_peered":"2024-09-19T11:14:58.115156+0000","last_clean":"2024-09-19T11:14:58.115156+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:14:58.115156+0000","last_undegraded":"2024-09-19T11:14:58.115156+0000","last_fullsized":"2024-09-19T11:14:58.115156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587814+0000","last_change":"2024-09-19T11:13:31.376937+0000","last_active":"2024-09-19T11:14:07.587814+0000","last_peered":"2024-09-19T11:14:07.587814+0000","last_clean":"2024-09-19T11:14:07.587814+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:14:07.587814+0000","last_undegraded":"2024-09-19T11:14:07.587814+0000","last_fullsized":"2024-09-19T11:14:07.587814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:00.098524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587259+0000","last_change":"2024-09-19T11:13:35.349926+0000","last_active":"2024-09-19T11:14:07.587259+0000","last_peered":"2024-09-19T11:14:07.587259+0000","last_clean":"2024-09-19T11:14:07.587259+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:14:07.587259+0000","last_undegraded":"2024-09-19T11:14:07.587259+0000","last_fullsized":"2024-09-19T11:14:07.587259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:43.037527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'37","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540038+0000","last_change":"2024-09-19T11:13:37.371294+0000","last_active":"2024-09-19T11:15:48.540038+0000","last_peered":"2024-09-19T11:15:48.540038+0000","last_clean":"2024-09-19T11:15:48.540038+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:15:48.540038+0000","last_undegraded":"2024-09-19T11:15:48.540038+0000","last_fullsized":"2024-09-19T11:15:48.540038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:44.761683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":352,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.720874+0000","last_change":"2024-09-19T11:13:39.381485+0000","last_active":"2024-09-19T11:16:49.720874+0000","last_peered":"2024-09-19T11:16:49.720874+0000","last_clean":"2024-09-19T11:16:49.720874+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:16:49.720874+0000","last_undegraded":"2024-09-19T11:16:49.720874+0000","last_fullsized":"2024-09-19T11:16:49.720874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:13.407016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.028397+0000","last_change":"2024-09-19T11:13:41.390450+0000","last_active":"2024-09-19T11:14:15.028397+0000","last_peered":"2024-09-19T11:14:15.028397+0000","last_clean":"2024-09-19T11:14:15.028397+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:14:15.028397+0000","last_undegraded":"2024-09-19T11:14:15.028397+0000","last_fullsized":"2024-09-19T11:14:15.028397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.925221+0000","last_change":"2024-09-19T11:13:33.346907+0000","last_active":"2024-09-19T11:14:57.925221+0000","last_peered":"2024-09-19T11:14:57.925221+0000","last_clean":"2024-09-19T11:14:57.925221+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:14:57.925221+0000","last_undegraded":"2024-09-19T11:14:57.925221+0000","last_fullsized":"2024-09-19T11:14:57.925221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:38.606989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585782+0000","last_change":"2024-09-19T11:13:31.373736+0000","last_active":"2024-09-19T11:14:07.585782+0000","last_peered":"2024-09-19T11:14:07.585782+0000","last_clean":"2024-09-19T11:14:07.585782+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:14:07.585782+0000","last_undegraded":"2024-09-19T11:14:07.585782+0000","last_fullsized":"2024-09-19T11:14:07.585782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:35.619254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586467+0000","last_change":"2024-09-19T11:13:35.353930+0000","last_active":"2024-09-19T11:14:07.586467+0000","last_peered":"2024-09-19T11:14:07.586467+0000","last_clean":"2024-09-19T11:14:07.586467+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:14:07.586467+0000","last_undegraded":"2024-09-19T11:14:07.586467+0000","last_fullsized":"2024-09-19T11:14:07.586467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:50.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'55","reported_seq":112,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.352655+0000","last_change":"2024-09-19T11:13:37.371428+0000","last_active":"2024-09-19T11:15:40.352655+0000","last_peered":"2024-09-19T11:15:40.352655+0000","last_clean":"2024-09-19T11:15:40.352655+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:15:40.352655+0000","last_undegraded":"2024-09-19T11:15:40.352655+0000","last_fullsized":"2024-09-19T11:15:40.352655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:11.185147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586195+0000","last_change":"2024-09-19T11:13:39.369302+0000","last_active":"2024-09-19T11:14:07.586195+0000","last_peered":"2024-09-19T11:14:07.586195+0000","last_clean":"2024-09-19T11:14:07.586195+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:14:07.586195+0000","last_undegraded":"2024-09-19T11:14:07.586195+0000","last_fullsized":"2024-09-19T11:14:07.586195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:58.150298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.223256+0000","last_change":"2024-09-19T11:13:41.385457+0000","last_active":"2024-09-19T11:16:43.223256+0000","last_peered":"2024-09-19T11:16:43.223256+0000","last_clean":"2024-09-19T11:16:43.223256+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:16:43.223256+0000","last_undegraded":"2024-09-19T11:16:43.223256+0000","last_fullsized":"2024-09-19T11:16:43.223256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:04.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740486+0000","last_change":"2024-09-19T11:13:33.354021+0000","last_active":"2024-09-19T11:16:42.740486+0000","last_peered":"2024-09-19T11:16:42.740486+0000","last_clean":"2024-09-19T11:16:42.740486+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:16:42.740486+0000","last_undegraded":"2024-09-19T11:16:42.740486+0000","last_fullsized":"2024-09-19T11:16:42.740486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:06.071580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587381+0000","last_change":"2024-09-19T11:13:31.378149+0000","last_active":"2024-09-19T11:14:07.587381+0000","last_peered":"2024-09-19T11:14:07.587381+0000","last_clean":"2024-09-19T11:14:07.587381+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:14:07.587381+0000","last_undegraded":"2024-09-19T11:14:07.587381+0000","last_fullsized":"2024-09-19T11:14:07.587381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:54.799765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589532+0000","last_change":"2024-09-19T11:13:35.359219+0000","last_active":"2024-09-19T11:14:07.589532+0000","last_peered":"2024-09-19T11:14:07.589532+0000","last_clean":"2024-09-19T11:14:07.589532+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:14:07.589532+0000","last_undegraded":"2024-09-19T11:14:07.589532+0000","last_fullsized":"2024-09-19T11:14:07.589532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:43.307746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.333416+0000","last_change":"2024-09-19T11:13:37.362218+0000","last_active":"2024-09-19T11:15:40.333416+0000","last_peered":"2024-09-19T11:15:40.333416+0000","last_clean":"2024-09-19T11:15:40.333416+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:15:40.333416+0000","last_undegraded":"2024-09-19T11:15:40.333416+0000","last_fullsized":"2024-09-19T11:15:40.333416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:38.878721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589393+0000","last_change":"2024-09-19T11:13:39.378975+0000","last_active":"2024-09-19T11:14:07.589393+0000","last_peered":"2024-09-19T11:14:07.589393+0000","last_clean":"2024-09-19T11:14:07.589393+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:14:07.589393+0000","last_undegraded":"2024-09-19T11:14:07.589393+0000","last_fullsized":"2024-09-19T11:14:07.589393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:43.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:43.539247+0000","last_change":"2024-09-19T11:13:41.390986+0000","last_active":"2024-09-19T11:15:43.539247+0000","last_peered":"2024-09-19T11:15:43.539247+0000","last_clean":"2024-09-19T11:15:43.539247+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:15:43.539247+0000","last_undegraded":"2024-09-19T11:15:43.539247+0000","last_fullsized":"2024-09-19T11:15:43.539247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:29.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588444+0000","last_change":"2024-09-19T11:13:33.360955+0000","last_active":"2024-09-19T11:14:07.588444+0000","last_peered":"2024-09-19T11:14:07.588444+0000","last_clean":"2024-09-19T11:14:07.588444+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:14:07.588444+0000","last_undegraded":"2024-09-19T11:14:07.588444+0000","last_fullsized":"2024-09-19T11:14:07.588444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.739277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.595717+0000","last_change":"2024-09-19T11:13:31.378434+0000","last_active":"2024-09-19T11:14:15.595717+0000","last_peered":"2024-09-19T11:14:15.595717+0000","last_clean":"2024-09-19T11:14:15.595717+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:14:15.595717+0000","last_undegraded":"2024-09-19T11:14:15.595717+0000","last_fullsized":"2024-09-19T11:14:15.595717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:49.941394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586955+0000","last_change":"2024-09-19T11:13:35.348523+0000","last_active":"2024-09-19T11:14:07.586955+0000","last_peered":"2024-09-19T11:14:07.586955+0000","last_clean":"2024-09-19T11:14:07.586955+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:14:07.586955+0000","last_undegraded":"2024-09-19T11:14:07.586955+0000","last_fullsized":"2024-09-19T11:14:07.586955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:26.593052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.360329+0000","last_change":"2024-09-19T11:13:37.362855+0000","last_active":"2024-09-19T11:15:40.360329+0000","last_peered":"2024-09-19T11:15:40.360329+0000","last_clean":"2024-09-19T11:15:40.360329+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:15:40.360329+0000","last_undegraded":"2024-09-19T11:15:40.360329+0000","last_fullsized":"2024-09-19T11:15:40.360329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:36.268162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":432,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.227280+0000","last_change":"2024-09-19T11:13:39.381222+0000","last_active":"2024-09-19T11:16:43.227280+0000","last_peered":"2024-09-19T11:16:43.227280+0000","last_clean":"2024-09-19T11:16:43.227280+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:16:43.227280+0000","last_undegraded":"2024-09-19T11:16:43.227280+0000","last_fullsized":"2024-09-19T11:16:43.227280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:02.724027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:45.538583+0000","last_change":"2024-09-19T11:13:41.387843+0000","last_active":"2024-09-19T11:15:45.538583+0000","last_peered":"2024-09-19T11:15:45.538583+0000","last_clean":"2024-09-19T11:15:45.538583+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:15:45.538583+0000","last_undegraded":"2024-09-19T11:15:45.538583+0000","last_fullsized":"2024-09-19T11:15:45.538583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.060376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.539438+0000","last_change":"2024-09-19T11:13:33.351314+0000","last_active":"2024-09-19T11:15:48.539438+0000","last_peered":"2024-09-19T11:15:48.539438+0000","last_clean":"2024-09-19T11:15:48.539438+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:15:48.539438+0000","last_undegraded":"2024-09-19T11:15:48.539438+0000","last_fullsized":"2024-09-19T11:15:48.539438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:21.853847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.893715+0000","last_change":"2024-09-19T11:13:31.368833+0000","last_active":"2024-09-19T11:16:42.893715+0000","last_peered":"2024-09-19T11:16:42.893715+0000","last_clean":"2024-09-19T11:16:42.893715+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:16:42.893715+0000","last_undegraded":"2024-09-19T11:16:42.893715+0000","last_fullsized":"2024-09-19T11:16:42.893715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:58.341667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.444942+0000","last_change":"2024-09-19T11:13:35.352798+0000","last_active":"2024-09-19T11:15:41.444942+0000","last_peered":"2024-09-19T11:15:41.444942+0000","last_clean":"2024-09-19T11:15:41.444942+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:15:41.444942+0000","last_undegraded":"2024-09-19T11:15:41.444942+0000","last_fullsized":"2024-09-19T11:15:41.444942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:46.869358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586975+0000","last_change":"2024-09-19T11:13:37.369616+0000","last_active":"2024-09-19T11:14:07.586975+0000","last_peered":"2024-09-19T11:14:07.586975+0000","last_clean":"2024-09-19T11:14:07.586975+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:14:07.586975+0000","last_undegraded":"2024-09-19T11:14:07.586975+0000","last_fullsized":"2024-09-19T11:14:07.586975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.498959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":469,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.110426+0000","last_change":"2024-09-19T11:13:39.364476+0000","last_active":"2024-09-19T11:16:43.110426+0000","last_peered":"2024-09-19T11:16:43.110426+0000","last_clean":"2024-09-19T11:16:43.110426+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:16:43.110426+0000","last_undegraded":"2024-09-19T11:16:43.110426+0000","last_fullsized":"2024-09-19T11:16:43.110426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:05.251594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.968627+0000","last_change":"2024-09-19T11:13:41.382500+0000","last_active":"2024-09-19T11:16:42.968627+0000","last_peered":"2024-09-19T11:16:42.968627+0000","last_clean":"2024-09-19T11:16:42.968627+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:16:42.968627+0000","last_undegraded":"2024-09-19T11:16:42.968627+0000","last_fullsized":"2024-09-19T11:16:42.968627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:44.429934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.615161+0000","last_change":"2024-09-19T11:13:33.361148+0000","last_active":"2024-09-19T11:14:15.615161+0000","last_peered":"2024-09-19T11:14:15.615161+0000","last_clean":"2024-09-19T11:14:15.615161+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:14:15.615161+0000","last_undegraded":"2024-09-19T11:14:15.615161+0000","last_fullsized":"2024-09-19T11:14:15.615161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:18.909904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584784+0000","last_change":"2024-09-19T11:13:31.376571+0000","last_active":"2024-09-19T11:14:07.584784+0000","last_peered":"2024-09-19T11:14:07.584784+0000","last_clean":"2024-09-19T11:14:07.584784+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:14:07.584784+0000","last_undegraded":"2024-09-19T11:14:07.584784+0000","last_fullsized":"2024-09-19T11:14:07.584784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:21.093655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"28'1","reported_seq":219,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.445222+0000","last_change":"2024-09-19T11:13:35.359895+0000","last_active":"2024-09-19T11:15:41.445222+0000","last_peered":"2024-09-19T11:15:41.445222+0000","last_clean":"2024-09-19T11:15:41.445222+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:15:41.445222+0000","last_undegraded":"2024-09-19T11:15:41.445222+0000","last_fullsized":"2024-09-19T11:15:41.445222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:48.665046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'38","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.346012+0000","last_change":"2024-09-19T11:13:37.367380+0000","last_active":"2024-09-19T11:15:40.346012+0000","last_peered":"2024-09-19T11:15:40.346012+0000","last_clean":"2024-09-19T11:15:40.346012+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:15:40.346012+0000","last_undegraded":"2024-09-19T11:15:40.346012+0000","last_fullsized":"2024-09-19T11:15:40.346012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:44.610147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587829+0000","last_change":"2024-09-19T11:13:39.381930+0000","last_active":"2024-09-19T11:14:07.587829+0000","last_peered":"2024-09-19T11:14:07.587829+0000","last_clean":"2024-09-19T11:14:07.587829+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:14:07.587829+0000","last_undegraded":"2024-09-19T11:14:07.587829+0000","last_fullsized":"2024-09-19T11:14:07.587829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:20.757672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'8","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.224963+0000","last_change":"2024-09-19T11:13:41.383036+0000","last_active":"2024-09-19T11:16:43.224963+0000","last_peered":"2024-09-19T11:16:43.224963+0000","last_clean":"2024-09-19T11:16:43.224963+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:16:43.224963+0000","last_undegraded":"2024-09-19T11:16:43.224963+0000","last_fullsized":"2024-09-19T11:16:43.224963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:22.046963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004072+0000","last_change":"2024-09-19T11:13:33.360700+0000","last_active":"2024-09-19T11:16:43.004072+0000","last_peered":"2024-09-19T11:16:43.004072+0000","last_clean":"2024-09-19T11:16:43.004072+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:16:43.004072+0000","last_undegraded":"2024-09-19T11:16:43.004072+0000","last_fullsized":"2024-09-19T11:16:43.004072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:38.890842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593057+0000","last_change":"2024-09-19T11:13:16.796669+0000","last_active":"2024-09-19T11:14:07.593057+0000","last_peered":"2024-09-19T11:14:07.593057+0000","last_clean":"2024-09-19T11:14:07.593057+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:14:07.593057+0000","last_undegraded":"2024-09-19T11:14:07.593057+0000","last_fullsized":"2024-09-19T11:14:07.593057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_clean_scrub_stamp":"2024-09-19T11:13:15.217500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:15.868833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586588+0000","last_change":"2024-09-19T11:13:21.254644+0000","last_active":"2024-09-19T11:14:07.586588+0000","last_peered":"2024-09-19T11:14:07.586588+0000","last_clean":"2024-09-19T11:14:07.586588+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:14:07.586588+0000","last_undegraded":"2024-09-19T11:14:07.586588+0000","last_fullsized":"2024-09-19T11:14:07.586588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:09.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585255+0000","last_change":"2024-09-19T11:13:31.378802+0000","last_active":"2024-09-19T11:14:07.585255+0000","last_peered":"2024-09-19T11:14:07.585255+0000","last_clean":"2024-09-19T11:14:07.585255+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:14:07.585255+0000","last_undegraded":"2024-09-19T11:14:07.585255+0000","last_fullsized":"2024-09-19T11:14:07.585255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:21.545126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598099+0000","last_change":"2024-09-19T11:14:07.597443+0000","last_active":"2024-09-19T11:14:07.598099+0000","last_peered":"2024-09-19T11:14:07.598099+0000","last_clean":"2024-09-19T11:14:07.598099+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:14:07.598099+0000","last_undegraded":"2024-09-19T11:14:07.598099+0000","last_fullsized":"2024-09-19T11:14:07.598099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:01.646429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'76","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.357806+0000","last_change":"2024-09-19T11:13:37.369113+0000","last_active":"2024-09-19T11:15:40.357806+0000","last_peered":"2024-09-19T11:15:40.357806+0000","last_clean":"2024-09-19T11:15:40.357806+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:15:40.357806+0000","last_undegraded":"2024-09-19T11:15:40.357806+0000","last_fullsized":"2024-09-19T11:15:40.357806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:17.600400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588503+0000","last_change":"2024-09-19T11:13:39.381749+0000","last_active":"2024-09-19T11:14:07.588503+0000","last_peered":"2024-09-19T11:14:07.588503+0000","last_clean":"2024-09-19T11:14:07.588503+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:14:07.588503+0000","last_undegraded":"2024-09-19T11:14:07.588503+0000","last_fullsized":"2024-09-19T11:14:07.588503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:31.206255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.012984+0000","last_change":"2024-09-19T11:13:41.382469+0000","last_active":"2024-09-19T11:16:43.012984+0000","last_peered":"2024-09-19T11:16:43.012984+0000","last_clean":"2024-09-19T11:16:43.012984+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:16:43.012984+0000","last_undegraded":"2024-09-19T11:16:43.012984+0000","last_fullsized":"2024-09-19T11:16:43.012984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:23.490546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096383+0000","last_change":"2024-09-19T11:13:33.352593+0000","last_active":"2024-09-19T11:15:42.096383+0000","last_peered":"2024-09-19T11:15:42.096383+0000","last_clean":"2024-09-19T11:15:42.096383+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:15:42.096383+0000","last_undegraded":"2024-09-19T11:15:42.096383+0000","last_fullsized":"2024-09-19T11:15:42.096383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:32.858735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584255+0000","last_change":"2024-09-19T11:13:21.254355+0000","last_active":"2024-09-19T11:14:07.584255+0000","last_peered":"2024-09-19T11:14:07.584255+0000","last_clean":"2024-09-19T11:14:07.584255+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:14:07.584255+0000","last_undegraded":"2024-09-19T11:14:07.584255+0000","last_fullsized":"2024-09-19T11:14:07.584255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:49.014710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.542565+0000","last_change":"2024-09-19T11:13:31.364094+0000","last_active":"2024-09-19T11:16:42.542565+0000","last_peered":"2024-09-19T11:16:42.542565+0000","last_clean":"2024-09-19T11:16:42.542565+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:16:42.542565+0000","last_undegraded":"2024-09-19T11:16:42.542565+0000","last_fullsized":"2024-09-19T11:16:42.542565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.487218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589544+0000","last_change":"2024-09-19T11:13:35.355733+0000","last_active":"2024-09-19T11:14:07.589544+0000","last_peered":"2024-09-19T11:14:07.589544+0000","last_clean":"2024-09-19T11:14:07.589544+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:14:07.589544+0000","last_undegraded":"2024-09-19T11:14:07.589544+0000","last_fullsized":"2024-09-19T11:14:07.589544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:16.022467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'273","reported_seq":477,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437573+0000","last_change":"2024-09-19T11:13:37.365037+0000","last_active":"2024-09-19T11:16:40.437573+0000","last_peered":"2024-09-19T11:16:40.437573+0000","last_clean":"2024-09-19T11:16:40.437573+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:16:40.437573+0000","last_undegraded":"2024-09-19T11:16:40.437573+0000","last_fullsized":"2024-09-19T11:16:40.437573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:00.713713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585295+0000","last_change":"2024-09-19T11:13:39.379958+0000","last_active":"2024-09-19T11:14:07.585295+0000","last_peered":"2024-09-19T11:14:07.585295+0000","last_clean":"2024-09-19T11:14:07.585295+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:14:07.585295+0000","last_undegraded":"2024-09-19T11:14:07.585295+0000","last_fullsized":"2024-09-19T11:14:07.585295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.435708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.934138+0000","last_change":"2024-09-19T11:13:41.394316+0000","last_active":"2024-09-19T11:14:57.934138+0000","last_peered":"2024-09-19T11:14:57.934138+0000","last_clean":"2024-09-19T11:14:57.934138+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:14:57.934138+0000","last_undegraded":"2024-09-19T11:14:57.934138+0000","last_fullsized":"2024-09-19T11:14:57.934138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:54.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589975+0000","last_change":"2024-09-19T11:13:33.348762+0000","last_active":"2024-09-19T11:14:07.589975+0000","last_peered":"2024-09-19T11:14:07.589975+0000","last_clean":"2024-09-19T11:14:07.589975+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:14:07.589975+0000","last_undegraded":"2024-09-19T11:14:07.589975+0000","last_fullsized":"2024-09-19T11:14:07.589975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:36:09.372432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589222+0000","last_change":"2024-09-19T11:13:21.252701+0000","last_active":"2024-09-19T11:14:07.589222+0000","last_peered":"2024-09-19T11:14:07.589222+0000","last_clean":"2024-09-19T11:14:07.589222+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:14:07.589222+0000","last_undegraded":"2024-09-19T11:14:07.589222+0000","last_fullsized":"2024-09-19T11:14:07.589222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:32.819428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585864+0000","last_change":"2024-09-19T11:13:31.377758+0000","last_active":"2024-09-19T11:14:07.585864+0000","last_peered":"2024-09-19T11:14:07.585864+0000","last_clean":"2024-09-19T11:14:07.585864+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:14:07.585864+0000","last_undegraded":"2024-09-19T11:14:07.585864+0000","last_fullsized":"2024-09-19T11:14:07.585864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:51.569099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589942+0000","last_change":"2024-09-19T11:13:35.350142+0000","last_active":"2024-09-19T11:14:07.589942+0000","last_peered":"2024-09-19T11:14:07.589942+0000","last_clean":"2024-09-19T11:14:07.589942+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:14:07.589942+0000","last_undegraded":"2024-09-19T11:14:07.589942+0000","last_fullsized":"2024-09-19T11:14:07.589942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:13.732591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437418+0000","last_change":"2024-09-19T11:13:37.369777+0000","last_active":"2024-09-19T11:16:40.437418+0000","last_peered":"2024-09-19T11:16:40.437418+0000","last_clean":"2024-09-19T11:16:40.437418+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:16:40.437418+0000","last_undegraded":"2024-09-19T11:16:40.437418+0000","last_fullsized":"2024-09-19T11:16:40.437418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:09.642366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587165+0000","last_change":"2024-09-19T11:13:39.382026+0000","last_active":"2024-09-19T11:14:07.587165+0000","last_peered":"2024-09-19T11:14:07.587165+0000","last_clean":"2024-09-19T11:14:07.587165+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:14:07.587165+0000","last_undegraded":"2024-09-19T11:14:07.587165+0000","last_fullsized":"2024-09-19T11:14:07.587165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:05.351431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.301235+0000","last_change":"2024-09-19T11:13:41.390159+0000","last_active":"2024-09-19T11:16:42.301235+0000","last_peered":"2024-09-19T11:16:42.301235+0000","last_clean":"2024-09-19T11:16:42.301235+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:16:42.301235+0000","last_undegraded":"2024-09-19T11:16:42.301235+0000","last_fullsized":"2024-09-19T11:16:42.301235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:47.188979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112810+0000","last_change":"2024-09-19T11:13:33.352483+0000","last_active":"2024-09-19T11:14:58.112810+0000","last_peered":"2024-09-19T11:14:58.112810+0000","last_clean":"2024-09-19T11:14:58.112810+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:14:58.112810+0000","last_undegraded":"2024-09-19T11:14:58.112810+0000","last_fullsized":"2024-09-19T11:14:58.112810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:17.063492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584626+0000","last_change":"2024-09-19T11:13:21.254900+0000","last_active":"2024-09-19T11:14:07.584626+0000","last_peered":"2024-09-19T11:14:07.584626+0000","last_clean":"2024-09-19T11:14:07.584626+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:14:07.584626+0000","last_undegraded":"2024-09-19T11:14:07.584626+0000","last_fullsized":"2024-09-19T11:14:07.584626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:06.693190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.563187+0000","last_change":"2024-09-19T11:13:31.370903+0000","last_active":"2024-09-19T11:15:38.563187+0000","last_peered":"2024-09-19T11:15:38.563187+0000","last_clean":"2024-09-19T11:15:38.563187+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:15:38.563187+0000","last_undegraded":"2024-09-19T11:15:38.563187+0000","last_fullsized":"2024-09-19T11:15:38.563187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:36.343297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.680755+0000","last_change":"2024-09-19T11:13:35.357655+0000","last_active":"2024-09-19T11:16:49.680755+0000","last_peered":"2024-09-19T11:16:49.680755+0000","last_clean":"2024-09-19T11:16:49.680755+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:16:49.680755+0000","last_undegraded":"2024-09-19T11:16:49.680755+0000","last_fullsized":"2024-09-19T11:16:49.680755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:09.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'14","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.146449+0000","last_change":"2024-09-19T11:13:37.369199+0000","last_active":"2024-09-19T11:16:42.146449+0000","last_peered":"2024-09-19T11:16:42.146449+0000","last_clean":"2024-09-19T11:16:42.146449+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:16:42.146449+0000","last_undegraded":"2024-09-19T11:16:42.146449+0000","last_fullsized":"2024-09-19T11:16:42.146449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:43.083589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589764+0000","last_change":"2024-09-19T11:13:39.379563+0000","last_active":"2024-09-19T11:14:07.589764+0000","last_peered":"2024-09-19T11:14:07.589764+0000","last_clean":"2024-09-19T11:14:07.589764+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:14:07.589764+0000","last_undegraded":"2024-09-19T11:14:07.589764+0000","last_fullsized":"2024-09-19T11:14:07.589764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:20.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.946285+0000","last_change":"2024-09-19T11:13:41.395412+0000","last_active":"2024-09-19T11:16:42.946285+0000","last_peered":"2024-09-19T11:16:42.946285+0000","last_clean":"2024-09-19T11:16:42.946285+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:16:42.946285+0000","last_undegraded":"2024-09-19T11:16:42.946285+0000","last_fullsized":"2024-09-19T11:16:42.946285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:05.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.967341+0000","last_change":"2024-09-19T11:13:33.356242+0000","last_active":"2024-09-19T11:16:42.967341+0000","last_peered":"2024-09-19T11:16:42.967341+0000","last_clean":"2024-09-19T11:16:42.967341+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:16:42.967341+0000","last_undegraded":"2024-09-19T11:16:42.967341+0000","last_fullsized":"2024-09-19T11:16:42.967341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588322+0000","last_change":"2024-09-19T11:13:31.374247+0000","last_active":"2024-09-19T11:14:07.588322+0000","last_peered":"2024-09-19T11:14:07.588322+0000","last_clean":"2024-09-19T11:14:07.588322+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:14:07.588322+0000","last_undegraded":"2024-09-19T11:14:07.588322+0000","last_fullsized":"2024-09-19T11:14:07.588322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:36.456865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587109+0000","last_change":"2024-09-19T11:13:21.259380+0000","last_active":"2024-09-19T11:14:07.587109+0000","last_peered":"2024-09-19T11:14:07.587109+0000","last_clean":"2024-09-19T11:14:07.587109+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:14:07.587109+0000","last_undegraded":"2024-09-19T11:14:07.587109+0000","last_fullsized":"2024-09-19T11:14:07.587109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:46.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.279961+0000","last_change":"2024-09-19T11:13:35.354864+0000","last_active":"2024-09-19T11:16:43.279961+0000","last_peered":"2024-09-19T11:16:43.279961+0000","last_clean":"2024-09-19T11:16:43.279961+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:16:43.279961+0000","last_undegraded":"2024-09-19T11:16:43.279961+0000","last_fullsized":"2024-09-19T11:16:43.279961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:59.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'69","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.846451+0000","last_change":"2024-09-19T11:13:37.366497+0000","last_active":"2024-09-19T11:16:49.846451+0000","last_peered":"2024-09-19T11:16:49.846451+0000","last_clean":"2024-09-19T11:16:49.846451+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:16:49.846451+0000","last_undegraded":"2024-09-19T11:16:49.846451+0000","last_fullsized":"2024-09-19T11:16:49.846451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:05.665285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586753+0000","last_change":"2024-09-19T11:13:39.380023+0000","last_active":"2024-09-19T11:14:07.586753+0000","last_peered":"2024-09-19T11:14:07.586753+0000","last_clean":"2024-09-19T11:14:07.586753+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:14:07.586753+0000","last_undegraded":"2024-09-19T11:14:07.586753+0000","last_fullsized":"2024-09-19T11:14:07.586753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.513854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.002199+0000","last_change":"2024-09-19T11:13:41.384779+0000","last_active":"2024-09-19T11:15:42.002199+0000","last_peered":"2024-09-19T11:15:42.002199+0000","last_clean":"2024-09-19T11:15:42.002199+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:15:42.002199+0000","last_undegraded":"2024-09-19T11:15:42.002199+0000","last_fullsized":"2024-09-19T11:15:42.002199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:01.181785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003973+0000","last_change":"2024-09-19T11:13:33.355203+0000","last_active":"2024-09-19T11:16:43.003973+0000","last_peered":"2024-09-19T11:16:43.003973+0000","last_clean":"2024-09-19T11:16:43.003973+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:16:43.003973+0000","last_undegraded":"2024-09-19T11:16:43.003973+0000","last_fullsized":"2024-09-19T11:16:43.003973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:39.888974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.523511+0000","last_change":"2024-09-19T11:13:31.363980+0000","last_active":"2024-09-19T11:14:14.523511+0000","last_peered":"2024-09-19T11:14:14.523511+0000","last_clean":"2024-09-19T11:14:14.523511+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:14:14.523511+0000","last_undegraded":"2024-09-19T11:14:14.523511+0000","last_fullsized":"2024-09-19T11:14:14.523511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:08.281382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587424+0000","last_change":"2024-09-19T11:13:21.254921+0000","last_active":"2024-09-19T11:14:07.587424+0000","last_peered":"2024-09-19T11:14:07.587424+0000","last_clean":"2024-09-19T11:14:07.587424+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:14:07.587424+0000","last_undegraded":"2024-09-19T11:14:07.587424+0000","last_fullsized":"2024-09-19T11:14:07.587424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:50.538143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584330+0000","last_change":"2024-09-19T11:13:35.355937+0000","last_active":"2024-09-19T11:14:07.584330+0000","last_peered":"2024-09-19T11:14:07.584330+0000","last_clean":"2024-09-19T11:14:07.584330+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:14:07.584330+0000","last_undegraded":"2024-09-19T11:14:07.584330+0000","last_fullsized":"2024-09-19T11:14:07.584330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:41.799805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593910+0000","last_change":"2024-09-19T11:13:37.367919+0000","last_active":"2024-09-19T11:14:07.593910+0000","last_peered":"2024-09-19T11:14:07.593910+0000","last_clean":"2024-09-19T11:14:07.593910+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:14:07.593910+0000","last_undegraded":"2024-09-19T11:14:07.593910+0000","last_fullsized":"2024-09-19T11:14:07.593910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:53.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437340+0000","last_change":"2024-09-19T11:13:39.370313+0000","last_active":"2024-09-19T11:16:40.437340+0000","last_peered":"2024-09-19T11:16:40.437340+0000","last_clean":"2024-09-19T11:16:40.437340+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:16:40.437340+0000","last_undegraded":"2024-09-19T11:16:40.437340+0000","last_fullsized":"2024-09-19T11:16:40.437340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:56.937960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.649914+0000","last_change":"2024-09-19T11:13:41.391610+0000","last_active":"2024-09-19T11:16:42.649914+0000","last_peered":"2024-09-19T11:16:42.649914+0000","last_clean":"2024-09-19T11:16:42.649914+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:16:42.649914+0000","last_undegraded":"2024-09-19T11:16:42.649914+0000","last_fullsized":"2024-09-19T11:16:42.649914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.303997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096636+0000","last_change":"2024-09-19T11:14:07.601620+0000","last_active":"2024-09-19T11:15:42.096636+0000","last_peered":"2024-09-19T11:15:42.096636+0000","last_clean":"2024-09-19T11:15:42.096636+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:15:42.096636+0000","last_undegraded":"2024-09-19T11:15:42.096636+0000","last_fullsized":"2024-09-19T11:15:42.096636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:56.955418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.879840+0000","last_change":"2024-09-19T11:13:31.367766+0000","last_active":"2024-09-19T11:16:42.879840+0000","last_peered":"2024-09-19T11:16:42.879840+0000","last_clean":"2024-09-19T11:16:42.879840+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:16:42.879840+0000","last_undegraded":"2024-09-19T11:16:42.879840+0000","last_fullsized":"2024-09-19T11:16:42.879840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:46.005854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588837+0000","last_change":"2024-09-19T11:13:21.259371+0000","last_active":"2024-09-19T11:14:07.588837+0000","last_peered":"2024-09-19T11:14:07.588837+0000","last_clean":"2024-09-19T11:14:07.588837+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:14:07.588837+0000","last_undegraded":"2024-09-19T11:14:07.588837+0000","last_fullsized":"2024-09-19T11:14:07.588837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:58.914941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584240+0000","last_change":"2024-09-19T11:13:35.355501+0000","last_active":"2024-09-19T11:14:07.584240+0000","last_peered":"2024-09-19T11:14:07.584240+0000","last_clean":"2024-09-19T11:14:07.584240+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:14:07.584240+0000","last_undegraded":"2024-09-19T11:14:07.584240+0000","last_fullsized":"2024-09-19T11:14:07.584240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:17.393322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585599+0000","last_change":"2024-09-19T11:13:37.371529+0000","last_active":"2024-09-19T11:14:07.585599+0000","last_peered":"2024-09-19T11:14:07.585599+0000","last_clean":"2024-09-19T11:14:07.585599+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:14:07.585599+0000","last_undegraded":"2024-09-19T11:14:07.585599+0000","last_fullsized":"2024-09-19T11:14:07.585599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.201187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":403,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.718255+0000","last_change":"2024-09-19T11:13:39.374381+0000","last_active":"2024-09-19T11:16:49.718255+0000","last_peered":"2024-09-19T11:16:49.718255+0000","last_clean":"2024-09-19T11:16:49.718255+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:16:49.718255+0000","last_undegraded":"2024-09-19T11:16:49.718255+0000","last_fullsized":"2024-09-19T11:16:49.718255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:52.357745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.093870+0000","last_change":"2024-09-19T11:13:41.392744+0000","last_active":"2024-09-19T11:15:42.093870+0000","last_peered":"2024-09-19T11:15:42.093870+0000","last_clean":"2024-09-19T11:15:42.093870+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:15:42.093870+0000","last_undegraded":"2024-09-19T11:15:42.093870+0000","last_fullsized":"2024-09-19T11:15:42.093870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:06.085455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.967344+0000","last_change":"2024-09-19T11:13:33.350528+0000","last_active":"2024-09-19T11:16:42.967344+0000","last_peered":"2024-09-19T11:16:42.967344+0000","last_clean":"2024-09-19T11:16:42.967344+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:16:42.967344+0000","last_undegraded":"2024-09-19T11:16:42.967344+0000","last_fullsized":"2024-09-19T11:16:42.967344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:39.714383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.525531+0000","last_change":"2024-09-19T11:13:31.363581+0000","last_active":"2024-09-19T11:14:14.525531+0000","last_peered":"2024-09-19T11:14:14.525531+0000","last_clean":"2024-09-19T11:14:14.525531+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:14:14.525531+0000","last_undegraded":"2024-09-19T11:14:14.525531+0000","last_fullsized":"2024-09-19T11:14:14.525531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:35.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590511+0000","last_change":"2024-09-19T11:13:21.254352+0000","last_active":"2024-09-19T11:14:07.590511+0000","last_peered":"2024-09-19T11:14:07.590511+0000","last_clean":"2024-09-19T11:14:07.590511+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:14:07.590511+0000","last_undegraded":"2024-09-19T11:14:07.590511+0000","last_fullsized":"2024-09-19T11:14:07.590511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:50.082399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584254+0000","last_change":"2024-09-19T11:13:35.355920+0000","last_active":"2024-09-19T11:14:07.584254+0000","last_peered":"2024-09-19T11:14:07.584254+0000","last_clean":"2024-09-19T11:14:07.584254+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:14:07.584254+0000","last_undegraded":"2024-09-19T11:14:07.584254+0000","last_fullsized":"2024-09-19T11:14:07.584254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:38.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'82","reported_seq":155,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.344082+0000","last_change":"2024-09-19T11:13:37.367000+0000","last_active":"2024-09-19T11:15:40.344082+0000","last_peered":"2024-09-19T11:15:40.344082+0000","last_clean":"2024-09-19T11:15:40.344082+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:15:40.344082+0000","last_undegraded":"2024-09-19T11:15:40.344082+0000","last_fullsized":"2024-09-19T11:15:40.344082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.428269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586150+0000","last_change":"2024-09-19T11:13:39.369482+0000","last_active":"2024-09-19T11:14:07.586150+0000","last_peered":"2024-09-19T11:14:07.586150+0000","last_clean":"2024-09-19T11:14:07.586150+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:14:07.586150+0000","last_undegraded":"2024-09-19T11:14:07.586150+0000","last_fullsized":"2024-09-19T11:14:07.586150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:52.197649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.742094+0000","last_change":"2024-09-19T11:13:41.387841+0000","last_active":"2024-09-19T11:16:42.742094+0000","last_peered":"2024-09-19T11:16:42.742094+0000","last_clean":"2024-09-19T11:16:42.742094+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:16:42.742094+0000","last_undegraded":"2024-09-19T11:16:42.742094+0000","last_fullsized":"2024-09-19T11:16:42.742094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:41.664645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589320+0000","last_change":"2024-09-19T11:13:41.387407+0000","last_active":"2024-09-19T11:14:07.589320+0000","last_peered":"2024-09-19T11:14:07.589320+0000","last_clean":"2024-09-19T11:14:07.589320+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:14:07.589320+0000","last_undegraded":"2024-09-19T11:14:07.589320+0000","last_fullsized":"2024-09-19T11:14:07.589320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:24.850379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899053+0000","last_change":"2024-09-19T11:13:33.353234+0000","last_active":"2024-09-19T11:16:42.899053+0000","last_peered":"2024-09-19T11:16:42.899053+0000","last_clean":"2024-09-19T11:16:42.899053+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:16:42.899053+0000","last_undegraded":"2024-09-19T11:16:42.899053+0000","last_fullsized":"2024-09-19T11:16:42.899053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.889699+0000","last_change":"2024-09-19T11:13:31.373496+0000","last_active":"2024-09-19T11:16:42.889699+0000","last_peered":"2024-09-19T11:16:42.889699+0000","last_clean":"2024-09-19T11:16:42.889699+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:16:42.889699+0000","last_undegraded":"2024-09-19T11:16:42.889699+0000","last_fullsized":"2024-09-19T11:16:42.889699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:04.061207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593909+0000","last_change":"2024-09-19T11:13:35.353000+0000","last_active":"2024-09-19T11:14:07.593909+0000","last_peered":"2024-09-19T11:14:07.593909+0000","last_clean":"2024-09-19T11:14:07.593909+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:14:07.593909+0000","last_undegraded":"2024-09-19T11:14:07.593909+0000","last_fullsized":"2024-09-19T11:14:07.593909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:23.618637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'33","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.349850+0000","last_change":"2024-09-19T11:13:37.369688+0000","last_active":"2024-09-19T11:15:40.349850+0000","last_peered":"2024-09-19T11:15:40.349850+0000","last_clean":"2024-09-19T11:15:40.349850+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:15:40.349850+0000","last_undegraded":"2024-09-19T11:15:40.349850+0000","last_fullsized":"2024-09-19T11:15:40.349850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:22.810135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585707+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.585707+0000","last_peered":"2024-09-19T11:14:07.585707+0000","last_clean":"2024-09-19T11:14:07.585707+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:14:07.585707+0000","last_undegraded":"2024-09-19T11:14:07.585707+0000","last_fullsized":"2024-09-19T11:14:07.585707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:32.078155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.049603+0000","last_change":"2024-09-19T11:13:41.388648+0000","last_active":"2024-09-19T11:15:40.049603+0000","last_peered":"2024-09-19T11:15:40.049603+0000","last_clean":"2024-09-19T11:15:40.049603+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:15:40.049603+0000","last_undegraded":"2024-09-19T11:15:40.049603+0000","last_fullsized":"2024-09-19T11:15:40.049603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:00.390668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899095+0000","last_change":"2024-09-19T11:13:33.356046+0000","last_active":"2024-09-19T11:16:42.899095+0000","last_peered":"2024-09-19T11:16:42.899095+0000","last_clean":"2024-09-19T11:16:42.899095+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:16:42.899095+0000","last_undegraded":"2024-09-19T11:16:42.899095+0000","last_fullsized":"2024-09-19T11:16:42.899095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:32.352474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.580671+0000","last_change":"2024-09-19T11:13:31.371002+0000","last_active":"2024-09-19T11:16:42.580671+0000","last_peered":"2024-09-19T11:16:42.580671+0000","last_clean":"2024-09-19T11:16:42.580671+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:42.580671+0000","last_undegraded":"2024-09-19T11:16:42.580671+0000","last_fullsized":"2024-09-19T11:16:42.580671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:54.573687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584591+0000","last_change":"2024-09-19T11:13:35.353851+0000","last_active":"2024-09-19T11:14:07.584591+0000","last_peered":"2024-09-19T11:14:07.584591+0000","last_clean":"2024-09-19T11:14:07.584591+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:14:07.584591+0000","last_undegraded":"2024-09-19T11:14:07.584591+0000","last_fullsized":"2024-09-19T11:14:07.584591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:37.329718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.125107+0000","last_change":"2024-09-19T11:13:37.361748+0000","last_active":"2024-09-19T11:16:42.125107+0000","last_peered":"2024-09-19T11:16:42.125107+0000","last_clean":"2024-09-19T11:16:42.125107+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:16:42.125107+0000","last_undegraded":"2024-09-19T11:16:42.125107+0000","last_fullsized":"2024-09-19T11:16:42.125107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:52.506674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588151+0000","last_change":"2024-09-19T11:13:39.381924+0000","last_active":"2024-09-19T11:14:07.588151+0000","last_peered":"2024-09-19T11:14:07.588151+0000","last_clean":"2024-09-19T11:14:07.588151+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:14:07.588151+0000","last_undegraded":"2024-09-19T11:14:07.588151+0000","last_fullsized":"2024-09-19T11:14:07.588151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:37.700824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587758+0000","last_change":"2024-09-19T11:13:41.381057+0000","last_active":"2024-09-19T11:14:07.587758+0000","last_peered":"2024-09-19T11:14:07.587758+0000","last_clean":"2024-09-19T11:14:07.587758+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:14:07.587758+0000","last_undegraded":"2024-09-19T11:14:07.587758+0000","last_fullsized":"2024-09-19T11:14:07.587758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:11.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003956+0000","last_change":"2024-09-19T11:13:33.350098+0000","last_active":"2024-09-19T11:16:43.003956+0000","last_peered":"2024-09-19T11:16:43.003956+0000","last_clean":"2024-09-19T11:16:43.003956+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:16:43.003956+0000","last_undegraded":"2024-09-19T11:16:43.003956+0000","last_fullsized":"2024-09-19T11:16:43.003956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:02.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590332+0000","last_change":"2024-09-19T11:13:31.356268+0000","last_active":"2024-09-19T11:14:07.590332+0000","last_peered":"2024-09-19T11:14:07.590332+0000","last_clean":"2024-09-19T11:14:07.590332+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:14:07.590332+0000","last_undegraded":"2024-09-19T11:14:07.590332+0000","last_fullsized":"2024-09-19T11:14:07.590332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:33.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587433+0000","last_change":"2024-09-19T11:13:35.356889+0000","last_active":"2024-09-19T11:14:07.587433+0000","last_peered":"2024-09-19T11:14:07.587433+0000","last_clean":"2024-09-19T11:14:07.587433+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:14:07.587433+0000","last_undegraded":"2024-09-19T11:14:07.587433+0000","last_fullsized":"2024-09-19T11:14:07.587433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:48.945891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'47","reported_seq":111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.769850+0000","last_change":"2024-09-19T11:13:37.358517+0000","last_active":"2024-09-19T11:16:49.769850+0000","last_peered":"2024-09-19T11:16:49.769850+0000","last_clean":"2024-09-19T11:16:49.769850+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:16:49.769850+0000","last_undegraded":"2024-09-19T11:16:49.769850+0000","last_fullsized":"2024-09-19T11:16:49.769850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.932100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593589+0000","last_change":"2024-09-19T11:13:39.368887+0000","last_active":"2024-09-19T11:14:07.593589+0000","last_peered":"2024-09-19T11:14:07.593589+0000","last_clean":"2024-09-19T11:14:07.593589+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:14:07.593589+0000","last_undegraded":"2024-09-19T11:14:07.593589+0000","last_fullsized":"2024-09-19T11:14:07.593589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:59.906873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585207+0000","last_change":"2024-09-19T11:13:41.390580+0000","last_active":"2024-09-19T11:14:07.585207+0000","last_peered":"2024-09-19T11:14:07.585207+0000","last_clean":"2024-09-19T11:14:07.585207+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:14:07.585207+0000","last_undegraded":"2024-09-19T11:14:07.585207+0000","last_fullsized":"2024-09-19T11:14:07.585207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:00.635835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.628513+0000","last_change":"2024-09-19T11:13:33.359154+0000","last_active":"2024-09-19T11:16:42.628513+0000","last_peered":"2024-09-19T11:16:42.628513+0000","last_clean":"2024-09-19T11:16:42.628513+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:16:42.628513+0000","last_undegraded":"2024-09-19T11:16:42.628513+0000","last_fullsized":"2024-09-19T11:16:42.628513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.291758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.525594+0000","last_change":"2024-09-19T11:13:31.362807+0000","last_active":"2024-09-19T11:14:14.525594+0000","last_peered":"2024-09-19T11:14:14.525594+0000","last_clean":"2024-09-19T11:14:14.525594+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:14:14.525594+0000","last_undegraded":"2024-09-19T11:14:14.525594+0000","last_fullsized":"2024-09-19T11:14:14.525594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:56.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584231+0000","last_change":"2024-09-19T11:13:35.356852+0000","last_active":"2024-09-19T11:14:07.584231+0000","last_peered":"2024-09-19T11:14:07.584231+0000","last_clean":"2024-09-19T11:14:07.584231+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:14:07.584231+0000","last_undegraded":"2024-09-19T11:14:07.584231+0000","last_fullsized":"2024-09-19T11:14:07.584231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:35.050288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.335466+0000","last_change":"2024-09-19T11:13:37.360189+0000","last_active":"2024-09-19T11:15:40.335466+0000","last_peered":"2024-09-19T11:15:40.335466+0000","last_clean":"2024-09-19T11:15:40.335466+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:15:40.335466+0000","last_undegraded":"2024-09-19T11:15:40.335466+0000","last_fullsized":"2024-09-19T11:15:40.335466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:54.329596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587792+0000","last_change":"2024-09-19T11:13:39.375493+0000","last_active":"2024-09-19T11:14:07.587792+0000","last_peered":"2024-09-19T11:14:07.587792+0000","last_clean":"2024-09-19T11:14:07.587792+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:14:07.587792+0000","last_undegraded":"2024-09-19T11:14:07.587792+0000","last_fullsized":"2024-09-19T11:14:07.587792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:12.594777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.568582+0000","last_change":"2024-09-19T11:13:33.354025+0000","last_active":"2024-09-19T11:15:38.568582+0000","last_peered":"2024-09-19T11:15:38.568582+0000","last_clean":"2024-09-19T11:15:38.568582+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:15:38.568582+0000","last_undegraded":"2024-09-19T11:15:38.568582+0000","last_fullsized":"2024-09-19T11:15:38.568582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:42.535989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.541620+0000","last_change":"2024-09-19T11:13:31.376331+0000","last_active":"2024-09-19T11:15:58.541620+0000","last_peered":"2024-09-19T11:15:58.541620+0000","last_clean":"2024-09-19T11:15:58.541620+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:15:58.541620+0000","last_undegraded":"2024-09-19T11:15:58.541620+0000","last_fullsized":"2024-09-19T11:15:58.541620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:08.223724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588717+0000","last_change":"2024-09-19T11:13:35.357178+0000","last_active":"2024-09-19T11:14:07.588717+0000","last_peered":"2024-09-19T11:14:07.588717+0000","last_clean":"2024-09-19T11:14:07.588717+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:14:07.588717+0000","last_undegraded":"2024-09-19T11:14:07.588717+0000","last_fullsized":"2024-09-19T11:14:07.588717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:59.098976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'63","reported_seq":128,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.874425+0000","last_change":"2024-09-19T11:13:37.363593+0000","last_active":"2024-09-19T11:16:49.874425+0000","last_peered":"2024-09-19T11:16:49.874425+0000","last_clean":"2024-09-19T11:16:49.874425+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:16:49.874425+0000","last_undegraded":"2024-09-19T11:16:49.874425+0000","last_fullsized":"2024-09-19T11:16:49.874425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:57.886776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587378+0000","last_change":"2024-09-19T11:13:39.375431+0000","last_active":"2024-09-19T11:14:07.587378+0000","last_peered":"2024-09-19T11:14:07.587378+0000","last_clean":"2024-09-19T11:14:07.587378+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:14:07.587378+0000","last_undegraded":"2024-09-19T11:14:07.587378+0000","last_fullsized":"2024-09-19T11:14:07.587378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:55.629772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.998936+0000","last_change":"2024-09-19T11:13:41.387630+0000","last_active":"2024-09-19T11:15:41.998936+0000","last_peered":"2024-09-19T11:15:41.998936+0000","last_clean":"2024-09-19T11:15:41.998936+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:15:41.998936+0000","last_undegraded":"2024-09-19T11:15:41.998936+0000","last_fullsized":"2024-09-19T11:15:41.998936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:27.480898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004030+0000","last_change":"2024-09-19T11:13:33.342352+0000","last_active":"2024-09-19T11:16:43.004030+0000","last_peered":"2024-09-19T11:16:43.004030+0000","last_clean":"2024-09-19T11:16:43.004030+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:16:43.004030+0000","last_undegraded":"2024-09-19T11:16:43.004030+0000","last_fullsized":"2024-09-19T11:16:43.004030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:09.205289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.543575+0000","last_change":"2024-09-19T11:13:31.360617+0000","last_active":"2024-09-19T11:15:58.543575+0000","last_peered":"2024-09-19T11:15:58.543575+0000","last_clean":"2024-09-19T11:15:58.543575+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:15:58.543575+0000","last_undegraded":"2024-09-19T11:15:58.543575+0000","last_fullsized":"2024-09-19T11:15:58.543575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:26.660836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590449+0000","last_change":"2024-09-19T11:13:35.350569+0000","last_active":"2024-09-19T11:14:07.590449+0000","last_peered":"2024-09-19T11:14:07.590449+0000","last_clean":"2024-09-19T11:14:07.590449+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:14:07.590449+0000","last_undegraded":"2024-09-19T11:14:07.590449+0000","last_fullsized":"2024-09-19T11:14:07.590449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:44.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.336398+0000","last_change":"2024-09-19T11:13:37.368372+0000","last_active":"2024-09-19T11:15:40.336398+0000","last_peered":"2024-09-19T11:15:40.336398+0000","last_clean":"2024-09-19T11:15:40.336398+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:15:40.336398+0000","last_undegraded":"2024-09-19T11:15:40.336398+0000","last_fullsized":"2024-09-19T11:15:40.336398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:42.470532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595510+0000","last_change":"2024-09-19T11:13:39.377106+0000","last_active":"2024-09-19T11:14:07.595510+0000","last_peered":"2024-09-19T11:14:07.595510+0000","last_clean":"2024-09-19T11:14:07.595510+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:14:07.595510+0000","last_undegraded":"2024-09-19T11:14:07.595510+0000","last_fullsized":"2024-09-19T11:14:07.595510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:40.364349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584320+0000","last_change":"2024-09-19T11:13:41.395172+0000","last_active":"2024-09-19T11:14:07.584320+0000","last_peered":"2024-09-19T11:14:07.584320+0000","last_clean":"2024-09-19T11:14:07.584320+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:14:07.584320+0000","last_undegraded":"2024-09-19T11:14:07.584320+0000","last_fullsized":"2024-09-19T11:14:07.584320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:31.640115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115025+0000","last_change":"2024-09-19T11:13:33.361006+0000","last_active":"2024-09-19T11:14:58.115025+0000","last_peered":"2024-09-19T11:14:58.115025+0000","last_clean":"2024-09-19T11:14:58.115025+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:14:58.115025+0000","last_undegraded":"2024-09-19T11:14:58.115025+0000","last_fullsized":"2024-09-19T11:14:58.115025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:15.458106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.074402+0000","last_change":"2024-09-19T11:13:31.369805+0000","last_active":"2024-09-19T11:15:42.074402+0000","last_peered":"2024-09-19T11:15:42.074402+0000","last_clean":"2024-09-19T11:15:42.074402+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:15:42.074402+0000","last_undegraded":"2024-09-19T11:15:42.074402+0000","last_fullsized":"2024-09-19T11:15:42.074402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:31.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588215+0000","last_change":"2024-09-19T11:13:35.351248+0000","last_active":"2024-09-19T11:14:07.588215+0000","last_peered":"2024-09-19T11:14:07.588215+0000","last_clean":"2024-09-19T11:14:07.588215+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:14:07.588215+0000","last_undegraded":"2024-09-19T11:14:07.588215+0000","last_fullsized":"2024-09-19T11:14:07.588215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:06.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.833988+0000","last_change":"2024-09-19T11:13:37.358368+0000","last_active":"2024-09-19T11:16:49.833988+0000","last_peered":"2024-09-19T11:16:49.833988+0000","last_clean":"2024-09-19T11:16:49.833988+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:16:49.833988+0000","last_undegraded":"2024-09-19T11:16:49.833988+0000","last_fullsized":"2024-09-19T11:16:49.833988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:44.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588427+0000","last_change":"2024-09-19T11:13:39.380360+0000","last_active":"2024-09-19T11:14:07.588427+0000","last_peered":"2024-09-19T11:14:07.588427+0000","last_clean":"2024-09-19T11:14:07.588427+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:14:07.588427+0000","last_undegraded":"2024-09-19T11:14:07.588427+0000","last_fullsized":"2024-09-19T11:14:07.588427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:19.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.092425+0000","last_change":"2024-09-19T11:13:41.392005+0000","last_active":"2024-09-19T11:15:42.092425+0000","last_peered":"2024-09-19T11:15:42.092425+0000","last_clean":"2024-09-19T11:15:42.092425+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:15:42.092425+0000","last_undegraded":"2024-09-19T11:15:42.092425+0000","last_fullsized":"2024-09-19T11:15:42.092425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:49.976836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003882+0000","last_change":"2024-09-19T11:13:33.352824+0000","last_active":"2024-09-19T11:16:43.003882+0000","last_peered":"2024-09-19T11:16:43.003882+0000","last_clean":"2024-09-19T11:16:43.003882+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:16:43.003882+0000","last_undegraded":"2024-09-19T11:16:43.003882+0000","last_fullsized":"2024-09-19T11:16:43.003882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:01.378601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587054+0000","last_change":"2024-09-19T11:13:31.377732+0000","last_active":"2024-09-19T11:14:07.587054+0000","last_peered":"2024-09-19T11:14:07.587054+0000","last_clean":"2024-09-19T11:14:07.587054+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:14:07.587054+0000","last_undegraded":"2024-09-19T11:14:07.587054+0000","last_fullsized":"2024-09-19T11:14:07.587054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:21:08.712618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598624+0000","last_change":"2024-09-19T11:14:07.597921+0000","last_active":"2024-09-19T11:14:07.598624+0000","last_peered":"2024-09-19T11:14:07.598624+0000","last_clean":"2024-09-19T11:14:07.598624+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:14:07.598624+0000","last_undegraded":"2024-09-19T11:14:07.598624+0000","last_fullsized":"2024-09-19T11:14:07.598624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:55.324299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586647+0000","last_change":"2024-09-19T11:13:37.371652+0000","last_active":"2024-09-19T11:14:07.586647+0000","last_peered":"2024-09-19T11:14:07.586647+0000","last_clean":"2024-09-19T11:14:07.586647+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:14:07.586647+0000","last_undegraded":"2024-09-19T11:14:07.586647+0000","last_fullsized":"2024-09-19T11:14:07.586647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:28.501389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":367,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437335+0000","last_change":"2024-09-19T11:13:39.382597+0000","last_active":"2024-09-19T11:16:40.437335+0000","last_peered":"2024-09-19T11:16:40.437335+0000","last_clean":"2024-09-19T11:16:40.437335+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:16:40.437335+0000","last_undegraded":"2024-09-19T11:16:40.437335+0000","last_fullsized":"2024-09-19T11:16:40.437335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:46.620461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.583768+0000","last_change":"2024-09-19T11:13:41.390206+0000","last_active":"2024-09-19T11:14:07.583768+0000","last_peered":"2024-09-19T11:14:07.583768+0000","last_clean":"2024-09-19T11:14:07.583768+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:14:07.583768+0000","last_undegraded":"2024-09-19T11:14:07.583768+0000","last_fullsized":"2024-09-19T11:14:07.583768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:11.171587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003933+0000","last_change":"2024-09-19T11:13:33.345970+0000","last_active":"2024-09-19T11:16:43.003933+0000","last_peered":"2024-09-19T11:16:43.003933+0000","last_clean":"2024-09-19T11:16:43.003933+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:16:43.003933+0000","last_undegraded":"2024-09-19T11:16:43.003933+0000","last_fullsized":"2024-09-19T11:16:43.003933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:42.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596073+0000","last_change":"2024-09-19T11:13:31.363961+0000","last_active":"2024-09-19T11:14:07.596073+0000","last_peered":"2024-09-19T11:14:07.596073+0000","last_clean":"2024-09-19T11:14:07.596073+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:14:07.596073+0000","last_undegraded":"2024-09-19T11:14:07.596073+0000","last_fullsized":"2024-09-19T11:14:07.596073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:09.178158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593781+0000","last_change":"2024-09-19T11:13:35.355437+0000","last_active":"2024-09-19T11:14:07.593781+0000","last_peered":"2024-09-19T11:14:07.593781+0000","last_clean":"2024-09-19T11:14:07.593781+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:14:07.593781+0000","last_undegraded":"2024-09-19T11:14:07.593781+0000","last_fullsized":"2024-09-19T11:14:07.593781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.209336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.327235+0000","last_change":"2024-09-19T11:13:37.367049+0000","last_active":"2024-09-19T11:15:40.327235+0000","last_peered":"2024-09-19T11:15:40.327235+0000","last_clean":"2024-09-19T11:15:40.327235+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:15:40.327235+0000","last_undegraded":"2024-09-19T11:15:40.327235+0000","last_fullsized":"2024-09-19T11:15:40.327235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:18.747358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586010+0000","last_change":"2024-09-19T11:13:39.381142+0000","last_active":"2024-09-19T11:14:07.586010+0000","last_peered":"2024-09-19T11:14:07.586010+0000","last_clean":"2024-09-19T11:14:07.586010+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:14:07.586010+0000","last_undegraded":"2024-09-19T11:14:07.586010+0000","last_fullsized":"2024-09-19T11:14:07.586010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:40.981200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.110163+0000","last_change":"2024-09-19T11:13:41.388869+0000","last_active":"2024-09-19T11:14:58.110163+0000","last_peered":"2024-09-19T11:14:58.110163+0000","last_clean":"2024-09-19T11:14:58.110163+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:14:58.110163+0000","last_undegraded":"2024-09-19T11:14:58.110163+0000","last_fullsized":"2024-09-19T11:14:58.110163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:20.834731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739953+0000","last_change":"2024-09-19T11:13:33.347043+0000","last_active":"2024-09-19T11:16:42.739953+0000","last_peered":"2024-09-19T11:16:42.739953+0000","last_clean":"2024-09-19T11:16:42.739953+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:16:42.739953+0000","last_undegraded":"2024-09-19T11:16:42.739953+0000","last_fullsized":"2024-09-19T11:16:42.739953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587518+0000","last_change":"2024-09-19T11:13:31.371968+0000","last_active":"2024-09-19T11:14:07.587518+0000","last_peered":"2024-09-19T11:14:07.587518+0000","last_clean":"2024-09-19T11:14:07.587518+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:14:07.587518+0000","last_undegraded":"2024-09-19T11:14:07.587518+0000","last_fullsized":"2024-09-19T11:14:07.587518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:11.662633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589719+0000","last_change":"2024-09-19T11:13:35.357430+0000","last_active":"2024-09-19T11:14:07.589719+0000","last_peered":"2024-09-19T11:14:07.589719+0000","last_clean":"2024-09-19T11:14:07.589719+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:14:07.589719+0000","last_undegraded":"2024-09-19T11:14:07.589719+0000","last_fullsized":"2024-09-19T11:14:07.589719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:37.024755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.856771+0000","last_change":"2024-09-19T11:13:37.365759+0000","last_active":"2024-09-19T11:16:49.856771+0000","last_peered":"2024-09-19T11:16:49.856771+0000","last_clean":"2024-09-19T11:16:49.856771+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:16:49.856771+0000","last_undegraded":"2024-09-19T11:16:49.856771+0000","last_fullsized":"2024-09-19T11:16:49.856771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:56.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584006+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.584006+0000","last_peered":"2024-09-19T11:14:07.584006+0000","last_clean":"2024-09-19T11:14:07.584006+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:14:07.584006+0000","last_undegraded":"2024-09-19T11:14:07.584006+0000","last_fullsized":"2024-09-19T11:14:07.584006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:21.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586387+0000","last_change":"2024-09-19T11:13:41.394164+0000","last_active":"2024-09-19T11:14:07.586387+0000","last_peered":"2024-09-19T11:14:07.586387+0000","last_clean":"2024-09-19T11:14:07.586387+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:14:07.586387+0000","last_undegraded":"2024-09-19T11:14:07.586387+0000","last_fullsized":"2024-09-19T11:14:07.586387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.249643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.105117+0000","last_change":"2024-09-19T11:13:33.349183+0000","last_active":"2024-09-19T11:16:43.105117+0000","last_peered":"2024-09-19T11:16:43.105117+0000","last_clean":"2024-09-19T11:16:43.105117+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:16:43.105117+0000","last_undegraded":"2024-09-19T11:16:43.105117+0000","last_fullsized":"2024-09-19T11:16:43.105117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:16.760506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588874+0000","last_change":"2024-09-19T11:13:31.364611+0000","last_active":"2024-09-19T11:14:07.588874+0000","last_peered":"2024-09-19T11:14:07.588874+0000","last_clean":"2024-09-19T11:14:07.588874+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:14:07.588874+0000","last_undegraded":"2024-09-19T11:14:07.588874+0000","last_fullsized":"2024-09-19T11:14:07.588874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:03.025212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.592890+0000","last_change":"2024-09-19T11:13:35.359098+0000","last_active":"2024-09-19T11:14:07.592890+0000","last_peered":"2024-09-19T11:14:07.592890+0000","last_clean":"2024-09-19T11:14:07.592890+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:14:07.592890+0000","last_undegraded":"2024-09-19T11:14:07.592890+0000","last_fullsized":"2024-09-19T11:14:07.592890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.137473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'26","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.351671+0000","last_change":"2024-09-19T11:13:37.368500+0000","last_active":"2024-09-19T11:15:40.351671+0000","last_peered":"2024-09-19T11:15:40.351671+0000","last_clean":"2024-09-19T11:15:40.351671+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:15:40.351671+0000","last_undegraded":"2024-09-19T11:15:40.351671+0000","last_fullsized":"2024-09-19T11:15:40.351671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:42.855744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584628+0000","last_change":"2024-09-19T11:13:39.375517+0000","last_active":"2024-09-19T11:14:07.584628+0000","last_peered":"2024-09-19T11:14:07.584628+0000","last_clean":"2024-09-19T11:14:07.584628+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:14:07.584628+0000","last_undegraded":"2024-09-19T11:14:07.584628+0000","last_fullsized":"2024-09-19T11:14:07.584628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:42.881775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.362489+0000","last_change":"2024-09-19T11:13:41.393750+0000","last_active":"2024-09-19T11:15:40.362489+0000","last_peered":"2024-09-19T11:15:40.362489+0000","last_clean":"2024-09-19T11:15:40.362489+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:15:40.362489+0000","last_undegraded":"2024-09-19T11:15:40.362489+0000","last_fullsized":"2024-09-19T11:15:40.362489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:29.365114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739944+0000","last_change":"2024-09-19T11:13:33.342298+0000","last_active":"2024-09-19T11:16:42.739944+0000","last_peered":"2024-09-19T11:16:42.739944+0000","last_clean":"2024-09-19T11:16:42.739944+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:16:42.739944+0000","last_undegraded":"2024-09-19T11:16:42.739944+0000","last_fullsized":"2024-09-19T11:16:42.739944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:30.192043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.609055+0000","last_change":"2024-09-19T11:13:31.364730+0000","last_active":"2024-09-19T11:16:42.609055+0000","last_peered":"2024-09-19T11:16:42.609055+0000","last_clean":"2024-09-19T11:16:42.609055+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:42.609055+0000","last_undegraded":"2024-09-19T11:16:42.609055+0000","last_fullsized":"2024-09-19T11:16:42.609055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:42.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.945426+0000","last_change":"2024-09-19T11:13:35.357671+0000","last_active":"2024-09-19T11:15:38.945426+0000","last_peered":"2024-09-19T11:15:38.945426+0000","last_clean":"2024-09-19T11:15:38.945426+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:15:38.945426+0000","last_undegraded":"2024-09-19T11:15:38.945426+0000","last_fullsized":"2024-09-19T11:15:38.945426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:03.047743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'34","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.151584+0000","last_change":"2024-09-19T11:13:37.371443+0000","last_active":"2024-09-19T11:16:42.151584+0000","last_peered":"2024-09-19T11:16:42.151584+0000","last_clean":"2024-09-19T11:16:42.151584+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:16:42.151584+0000","last_undegraded":"2024-09-19T11:16:42.151584+0000","last_fullsized":"2024-09-19T11:16:42.151584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.734955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586898+0000","last_change":"2024-09-19T11:13:39.381795+0000","last_active":"2024-09-19T11:14:07.586898+0000","last_peered":"2024-09-19T11:14:07.586898+0000","last_clean":"2024-09-19T11:14:07.586898+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:14:07.586898+0000","last_undegraded":"2024-09-19T11:14:07.586898+0000","last_fullsized":"2024-09-19T11:14:07.586898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:05.918916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.365479+0000","last_change":"2024-09-19T11:13:41.392101+0000","last_active":"2024-09-19T11:15:40.365479+0000","last_peered":"2024-09-19T11:15:40.365479+0000","last_clean":"2024-09-19T11:15:40.365479+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:15:40.365479+0000","last_undegraded":"2024-09-19T11:15:40.365479+0000","last_fullsized":"2024-09-19T11:15:40.365479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:25.270293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.930575+0000","last_change":"2024-09-19T11:13:33.361155+0000","last_active":"2024-09-19T11:14:57.930575+0000","last_peered":"2024-09-19T11:14:57.930575+0000","last_clean":"2024-09-19T11:14:57.930575+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:14:57.930575+0000","last_undegraded":"2024-09-19T11:14:57.930575+0000","last_fullsized":"2024-09-19T11:14:57.930575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:51.951767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.589542+0000","last_change":"2024-09-19T11:13:31.372398+0000","last_active":"2024-09-19T11:14:15.589542+0000","last_peered":"2024-09-19T11:14:15.589542+0000","last_clean":"2024-09-19T11:14:15.589542+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:14:15.589542+0000","last_undegraded":"2024-09-19T11:14:15.589542+0000","last_fullsized":"2024-09-19T11:14:15.589542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:31.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899012+0000","last_change":"2024-09-19T11:13:33.352614+0000","last_active":"2024-09-19T11:16:42.899012+0000","last_peered":"2024-09-19T11:16:42.899012+0000","last_clean":"2024-09-19T11:16:42.899012+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:16:42.899012+0000","last_undegraded":"2024-09-19T11:16:42.899012+0000","last_fullsized":"2024-09-19T11:16:42.899012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:26.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585940+0000","last_change":"2024-09-19T11:13:31.363757+0000","last_active":"2024-09-19T11:14:07.585940+0000","last_peered":"2024-09-19T11:14:07.585940+0000","last_clean":"2024-09-19T11:14:07.585940+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:14:07.585940+0000","last_undegraded":"2024-09-19T11:14:07.585940+0000","last_fullsized":"2024-09-19T11:14:07.585940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:15.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.614216+0000","last_change":"2024-09-19T11:13:33.352551+0000","last_active":"2024-09-19T11:14:15.614216+0000","last_peered":"2024-09-19T11:14:15.614216+0000","last_clean":"2024-09-19T11:14:15.614216+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:14:15.614216+0000","last_undegraded":"2024-09-19T11:14:15.614216+0000","last_fullsized":"2024-09-19T11:14:15.614216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:30.759232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584809+0000","last_change":"2024-09-19T11:13:31.379078+0000","last_active":"2024-09-19T11:14:07.584809+0000","last_peered":"2024-09-19T11:14:07.584809+0000","last_clean":"2024-09-19T11:14:07.584809+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:14:07.584809+0000","last_undegraded":"2024-09-19T11:14:07.584809+0000","last_fullsized":"2024-09-19T11:14:07.584809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.899531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'19","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.972405+0000","last_change":"2024-09-19T11:13:33.352928+0000","last_active":"2024-09-19T11:16:42.972405+0000","last_peered":"2024-09-19T11:16:42.972405+0000","last_clean":"2024-09-19T11:16:42.972405+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:16:42.972405+0000","last_undegraded":"2024-09-19T11:16:42.972405+0000","last_fullsized":"2024-09-19T11:16:42.972405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:48.077538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587528+0000","last_change":"2024-09-19T11:13:31.379320+0000","last_active":"2024-09-19T11:14:07.587528+0000","last_peered":"2024-09-19T11:14:07.587528+0000","last_clean":"2024-09-19T11:14:07.587528+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:14:07.587528+0000","last_undegraded":"2024-09-19T11:14:07.587528+0000","last_fullsized":"2024-09-19T11:14:07.587528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:03.713851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974126+0000","last_change":"2024-09-19T11:13:33.350710+0000","last_active":"2024-09-19T11:16:42.974126+0000","last_peered":"2024-09-19T11:16:42.974126+0000","last_clean":"2024-09-19T11:16:42.974126+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:16:42.974126+0000","last_undegraded":"2024-09-19T11:16:42.974126+0000","last_fullsized":"2024-09-19T11:16:42.974126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:39.016549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587371+0000","last_change":"2024-09-19T11:13:31.364930+0000","last_active":"2024-09-19T11:14:07.587371+0000","last_peered":"2024-09-19T11:14:07.587371+0000","last_clean":"2024-09-19T11:14:07.587371+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:14:07.587371+0000","last_undegraded":"2024-09-19T11:14:07.587371+0000","last_fullsized":"2024-09-19T11:14:07.587371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:12.851669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740563+0000","last_change":"2024-09-19T11:13:33.356293+0000","last_active":"2024-09-19T11:16:42.740563+0000","last_peered":"2024-09-19T11:16:42.740563+0000","last_clean":"2024-09-19T11:16:42.740563+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:16:42.740563+0000","last_undegraded":"2024-09-19T11:16:42.740563+0000","last_fullsized":"2024-09-19T11:16:42.740563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:41.299802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.883059+0000","last_change":"2024-09-19T11:13:31.365707+0000","last_active":"2024-09-19T11:16:42.883059+0000","last_peered":"2024-09-19T11:16:42.883059+0000","last_clean":"2024-09-19T11:16:42.883059+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:16:42.883059+0000","last_undegraded":"2024-09-19T11:16:42.883059+0000","last_fullsized":"2024-09-19T11:16:42.883059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:40.080906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899087+0000","last_change":"2024-09-19T11:13:33.342404+0000","last_active":"2024-09-19T11:16:42.899087+0000","last_peered":"2024-09-19T11:16:42.899087+0000","last_clean":"2024-09-19T11:16:42.899087+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:16:42.899087+0000","last_undegraded":"2024-09-19T11:16:42.899087+0000","last_fullsized":"2024-09-19T11:16:42.899087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:34.386826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.592506+0000","last_change":"2024-09-19T11:13:31.357124+0000","last_active":"2024-09-19T11:14:15.592506+0000","last_peered":"2024-09-19T11:14:15.592506+0000","last_clean":"2024-09-19T11:14:15.592506+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:14:15.592506+0000","last_undegraded":"2024-09-19T11:14:15.592506+0000","last_fullsized":"2024-09-19T11:14:15.592506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:00.612209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114647+0000","last_change":"2024-09-19T11:13:33.350433+0000","last_active":"2024-09-19T11:14:58.114647+0000","last_peered":"2024-09-19T11:14:58.114647+0000","last_clean":"2024-09-19T11:14:58.114647+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:14:58.114647+0000","last_undegraded":"2024-09-19T11:14:58.114647+0000","last_fullsized":"2024-09-19T11:14:58.114647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:46.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.604436+0000","last_change":"2024-09-19T11:13:31.377880+0000","last_active":"2024-09-19T11:14:15.604436+0000","last_peered":"2024-09-19T11:14:15.604436+0000","last_clean":"2024-09-19T11:14:15.604436+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:14:15.604436+0000","last_undegraded":"2024-09-19T11:14:15.604436+0000","last_fullsized":"2024-09-19T11:14:15.604436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:33.996472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.627034+0000","last_change":"2024-09-19T11:13:33.359004+0000","last_active":"2024-09-19T11:16:42.627034+0000","last_peered":"2024-09-19T11:16:42.627034+0000","last_clean":"2024-09-19T11:16:42.627034+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:16:42.627034+0000","last_undegraded":"2024-09-19T11:16:42.627034+0000","last_fullsized":"2024-09-19T11:16:42.627034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:23.555499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584642+0000","last_change":"2024-09-19T11:13:31.375014+0000","last_active":"2024-09-19T11:14:07.584642+0000","last_peered":"2024-09-19T11:14:07.584642+0000","last_clean":"2024-09-19T11:14:07.584642+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:14:07.584642+0000","last_undegraded":"2024-09-19T11:14:07.584642+0000","last_fullsized":"2024-09-19T11:14:07.584642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:40.622834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974025+0000","last_change":"2024-09-19T11:13:33.353505+0000","last_active":"2024-09-19T11:16:42.974025+0000","last_peered":"2024-09-19T11:16:42.974025+0000","last_clean":"2024-09-19T11:16:42.974025+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:16:42.974025+0000","last_undegraded":"2024-09-19T11:16:42.974025+0000","last_fullsized":"2024-09-19T11:16:42.974025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:00.609441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.886205+0000","last_change":"2024-09-19T11:13:31.378087+0000","last_active":"2024-09-19T11:16:42.886205+0000","last_peered":"2024-09-19T11:16:42.886205+0000","last_clean":"2024-09-19T11:16:42.886205+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:16:42.886205+0000","last_undegraded":"2024-09-19T11:16:42.886205+0000","last_fullsized":"2024-09-19T11:16:42.886205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:38.991849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'11","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:50.539564+0000","last_change":"2024-09-19T11:13:33.355120+0000","last_active":"2024-09-19T11:15:50.539564+0000","last_peered":"2024-09-19T11:15:50.539564+0000","last_clean":"2024-09-19T11:15:50.539564+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:15:50.539564+0000","last_undegraded":"2024-09-19T11:15:50.539564+0000","last_fullsized":"2024-09-19T11:15:50.539564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:31.601366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542095+0000","last_change":"2024-09-19T11:13:31.369529+0000","last_active":"2024-09-19T11:15:48.542095+0000","last_peered":"2024-09-19T11:15:48.542095+0000","last_clean":"2024-09-19T11:15:48.542095+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:15:48.542095+0000","last_undegraded":"2024-09-19T11:15:48.542095+0000","last_fullsized":"2024-09-19T11:15:48.542095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:19.935588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003913+0000","last_change":"2024-09-19T11:13:33.343642+0000","last_active":"2024-09-19T11:16:43.003913+0000","last_peered":"2024-09-19T11:16:43.003913+0000","last_clean":"2024-09-19T11:16:43.003913+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:16:43.003913+0000","last_undegraded":"2024-09-19T11:16:43.003913+0000","last_fullsized":"2024-09-19T11:16:43.003913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:53.472377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594243+0000","last_change":"2024-09-19T11:13:31.367046+0000","last_active":"2024-09-19T11:14:07.594243+0000","last_peered":"2024-09-19T11:14:07.594243+0000","last_clean":"2024-09-19T11:14:07.594243+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:14:07.594243+0000","last_undegraded":"2024-09-19T11:14:07.594243+0000","last_fullsized":"2024-09-19T11:14:07.594243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.073704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:14:07.601382+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:18:56.799598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586433+0000","last_change":"2024-09-19T11:13:31.368567+0000","last_active":"2024-09-19T11:14:07.586433+0000","last_peered":"2024-09-19T11:14:07.586433+0000","last_clean":"2024-09-19T11:14:07.586433+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:14:07.586433+0000","last_undegraded":"2024-09-19T11:14:07.586433+0000","last_fullsized":"2024-09-19T11:14:07.586433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:54.576708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'11","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542111+0000","last_change":"2024-09-19T11:13:33.358374+0000","last_active":"2024-09-19T11:15:48.542111+0000","last_peered":"2024-09-19T11:15:48.542111+0000","last_clean":"2024-09-19T11:15:48.542111+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:15:48.542111+0000","last_undegraded":"2024-09-19T11:15:48.542111+0000","last_fullsized":"2024-09-19T11:15:48.542111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:51.284800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587720+0000","last_change":"2024-09-19T11:13:31.368596+0000","last_active":"2024-09-19T11:14:07.587720+0000","last_peered":"2024-09-19T11:14:07.587720+0000","last_clean":"2024-09-19T11:14:07.587720+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:14:07.587720+0000","last_undegraded":"2024-09-19T11:14:07.587720+0000","last_fullsized":"2024-09-19T11:14:07.587720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540107+0000","last_change":"2024-09-19T11:13:33.348514+0000","last_active":"2024-09-19T11:15:48.540107+0000","last_peered":"2024-09-19T11:15:48.540107+0000","last_clean":"2024-09-19T11:15:48.540107+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:15:48.540107+0000","last_undegraded":"2024-09-19T11:15:48.540107+0000","last_fullsized":"2024-09-19T11:15:48.540107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:09.293276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590777+0000","last_change":"2024-09-19T11:13:31.358674+0000","last_active":"2024-09-19T11:14:07.590777+0000","last_peered":"2024-09-19T11:14:07.590777+0000","last_clean":"2024-09-19T11:14:07.590777+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:14:07.590777+0000","last_undegraded":"2024-09-19T11:14:07.590777+0000","last_fullsized":"2024-09-19T11:14:07.590777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:33.620173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380975+0000","last_change":"2024-09-19T11:13:33.349772+0000","last_active":"2024-09-19T11:14:15.380975+0000","last_peered":"2024-09-19T11:14:15.380975+0000","last_clean":"2024-09-19T11:14:15.380975+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:14:15.380975+0000","last_undegraded":"2024-09-19T11:14:15.380975+0000","last_fullsized":"2024-09-19T11:14:15.380975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:19.296584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:53.541138+0000","last_change":"2024-09-19T11:13:31.367744+0000","last_active":"2024-09-19T11:15:53.541138+0000","last_peered":"2024-09-19T11:15:53.541138+0000","last_clean":"2024-09-19T11:15:53.541138+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:15:53.541138+0000","last_undegraded":"2024-09-19T11:15:53.541138+0000","last_fullsized":"2024-09-19T11:15:53.541138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:00.738468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585297+0000","last_change":"2024-09-19T11:13:31.375358+0000","last_active":"2024-09-19T11:14:07.585297+0000","last_peered":"2024-09-19T11:14:07.585297+0000","last_clean":"2024-09-19T11:14:07.585297+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:14:07.585297+0000","last_undegraded":"2024-09-19T11:14:07.585297+0000","last_fullsized":"2024-09-19T11:14:07.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:48:05.720807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898876+0000","last_change":"2024-09-19T11:13:33.349130+0000","last_active":"2024-09-19T11:16:42.898876+0000","last_peered":"2024-09-19T11:16:42.898876+0000","last_clean":"2024-09-19T11:16:42.898876+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:16:42.898876+0000","last_undegraded":"2024-09-19T11:16:42.898876+0000","last_fullsized":"2024-09-19T11:16:42.898876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:05.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.565754+0000","last_change":"2024-09-19T11:13:31.378883+0000","last_active":"2024-09-19T11:16:42.565754+0000","last_peered":"2024-09-19T11:16:42.565754+0000","last_clean":"2024-09-19T11:16:42.565754+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:16:42.565754+0000","last_undegraded":"2024-09-19T11:16:42.565754+0000","last_fullsized":"2024-09-19T11:16:42.565754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:53.943968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740036+0000","last_change":"2024-09-19T11:13:33.353238+0000","last_active":"2024-09-19T11:16:42.740036+0000","last_peered":"2024-09-19T11:16:42.740036+0000","last_clean":"2024-09-19T11:16:42.740036+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:16:42.740036+0000","last_undegraded":"2024-09-19T11:16:42.740036+0000","last_fullsized":"2024-09-19T11:16:42.740036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:02.108897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1448,"num_read_kb":1245,"num_write":549,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1298,"ondisk_log_size":1298,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":17429376,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":87,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25817088,"data_stored":25817088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44252,"kb_used_data":8908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327588,"statfs":{"total":96636764160,"available":96591450112,"internally_reserved":0,"allocated":9121792,"data_stored":8769388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44756,"kb_used_data":9412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327084,"statfs":{"total":96636764160,"available":96590934016,"internally_reserved":0,"allocated":9637888,"data_stored":9354762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640304,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44780,"kb_used_data":9436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327060,"statfs":{"total":96636764160,"available":96590909440,"internally_reserved":0,"allocated":9662464,"data_stored":9355091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8768369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:16:50.972 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd dump --format=json 2024-09-19T11:16:51.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.097+0000 7ff6b96cd640 1 Processor -- start 2024-09-19T11:16:51.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.097+0000 7ff6b96cd640 1 -- start start 2024-09-19T11:16:51.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.098+0000 7ff6b96cd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6b412c0b0 0x7ff6b412c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:51.100 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.098+0000 7ff6b96cd640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff6b409a290 con 0x7ff6b412c9d0 2024-09-19T11:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.098+0000 7ff6b96cd640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff6b4071860 con 0x7ff6b412c0b0 2024-09-19T11:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.098+0000 7ff6b2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff6b412c0b0 0x7ff6b412c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.098+0000 7ff6abfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff6b412c9d0 0x7ff6b4097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57678/0 (socket says 172.21.15.37:57678) 2024-09-19T11:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.098+0000 7ff6abfff640 1 -- 172.21.15.37:0/3876800932 learned_addr learned my addr 172.21.15.37:0/3876800932 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.098+0000 7ff6b2ffd640 1 -- 172.21.15.37:0/3876800932 >> v1:172.21.15.37:6789/0 conn(0x7ff6b412c9d0 legacy=0x7ff6b4097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:51.101 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.098+0000 7ff6b2ffd640 1 -- 172.21.15.37:0/3876800932 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b4099e20 con 0x7ff6b412c0b0 2024-09-19T11:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.099+0000 7ff6b2ffd640 1 --2- 172.21.15.37:0/3876800932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b412c490 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009750 tx=0x7ff6a402a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=16b9dcaeada7b08d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.099+0000 7ff6b27fc640 1 -- 172.21.15.37:0/3876800932 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4037070 con 0x7ff6b412c0b0 2024-09-19T11:16:51.102 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.099+0000 7ff6b27fc640 1 -- 172.21.15.37:0/3876800932 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a402ad80 con 0x7ff6b412c0b0 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.099+0000 7ff6b27fc640 1 -- 172.21.15.37:0/3876800932 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4032590 con 0x7ff6b412c0b0 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.099+0000 7ff6b96cd640 1 -- 172.21.15.37:0/3876800932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 msgr2=0x7ff6b412c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.099+0000 7ff6b96cd640 1 --2- 172.21.15.37:0/3876800932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b412c490 secure :-1 s=READY pgs=860 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009750 tx=0x7ff6a402a140 comp rx=0 tx=0).stop 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.100+0000 7ff6b96cd640 1 -- 172.21.15.37:0/3876800932 shutdown_connections 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.100+0000 7ff6b96cd640 1 --2- 172.21.15.37:0/3876800932 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b412c490 unknown :-1 s=CLOSED pgs=860 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.100+0000 7ff6b96cd640 1 -- 172.21.15.37:0/3876800932 >> 172.21.15.37:0/3876800932 conn(0x7ff6b409abc0 msgr2=0x7ff6b4098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.100+0000 7ff6b96cd640 1 -- 172.21.15.37:0/3876800932 shutdown_connections 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.100+0000 7ff6b96cd640 1 -- 172.21.15.37:0/3876800932 wait complete. 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.100+0000 7ff6b96cd640 1 Processor -- start 2024-09-19T11:16:51.103 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.100+0000 7ff6b96cd640 1 -- start start 2024-09-19T11:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6b96cd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b41bc860 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6b96cd640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff6b412ce00 con 0x7ff6b412c0b0 2024-09-19T11:16:51.105 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6b2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b41bc860 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6b2ffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b41bc860 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55130/0 (socket says 172.21.15.37:55130) 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6b2ffd640 1 -- 172.21.15.37:0/2716615193 learned_addr learned my addr 172.21.15.37:0/2716615193 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6b2ffd640 1 -- 172.21.15.37:0/2716615193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff6b4128330 con 0x7ff6b412c0b0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6b2ffd640 1 --2- 172.21.15.37:0/2716615193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b41bc860 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009750 tx=0x7ff6a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6ab7fe640 1 -- 172.21.15.37:0/2716615193 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4041070 con 0x7ff6b412c0b0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6ab7fe640 1 -- 172.21.15.37:0/2716615193 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff6a403c590 con 0x7ff6b412c0b0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.101+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff6b41286f0 con 0x7ff6b412c0b0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.102+0000 7ff6ab7fe640 1 -- 172.21.15.37:0/2716615193 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff6a4037040 con 0x7ff6b412c0b0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.102+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff6b41bcda0 con 0x7ff6b412c0b0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.102+0000 7ff6ab7fe640 1 -- 172.21.15.37:0/2716615193 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff6a4044070 con 0x7ff6b412c0b0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.102+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff6b4127510 con 0x7ff6b412c0b0 2024-09-19T11:16:51.106 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.103+0000 7ff6ab7fe640 1 --2- 172.21.15.37:0/2716615193 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff69403e710 0x7ff694040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.103+0000 7ff6ab7fe640 1 -- 172.21.15.37:0/2716615193 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff6a4074190 con 0x7ff6b412c0b0 2024-09-19T11:16:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.103+0000 7ff6abfff640 1 --2- 172.21.15.37:0/2716615193 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff69403e710 0x7ff694040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:51.107 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.104+0000 7ff6abfff640 1 --2- 172.21.15.37:0/2716615193 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff69403e710 0x7ff694040bd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff69c007fd0 tx=0x7ff69c007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:51.109 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.108+0000 7ff6ab7fe640 1 -- 172.21.15.37:0/2716615193 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7ff6a402ad10 con 0x7ff6b412c0b0 2024-09-19T11:16:51.298 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.296+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "osd dump", "format": "json"} v 0) -- 0x7ff6b4127a80 con 0x7ff6b412c0b0 2024-09-19T11:16:51.299 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.297+0000 7ff6ab7fe640 1 -- 172.21.15.37:0/2716615193 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{"prefix": "osd dump", "format": "json"}]=0 v37) ==== 74+0+21187 (secure 0 0 0) 0x7ff6a4045dc0 con 0x7ff6b412c0b0 2024-09-19T11:16:51.300 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:16:51.300 INFO:teuthology.orchestra.run.smithi037.stdout:{"epoch":37,"fsid":"ea40044b-acee-4485-a78a-0f4c700e12ca","created":"2024-09-19T11:13:02.138535+0000","modified":"2024-09-19T11:14:07.580143+0000","last_up_change":"2024-09-19T11:13:13.212621+0000","last_in_change":"2024-09-19T11:13:03.266089+0000","flags":"sortbitwise,recovery_deletes,purged_snapdirs,pglog_hardlimit","flags_num":5799936,"flags_set":["pglog_hardlimit","purged_snapdirs","recovery_deletes","sortbitwise"],"crush_version":6,"full_ratio":0.94999998807907104,"backfillfull_ratio":0.89999997615814209,"nearfull_ratio":0.85000002384185791,"cluster_snapshot":"","pool_max":8,"max_osd":4,"require_min_compat_client":"luminous","min_compat_client":"luminous","require_osd_release":"squid","allow_crimson":false,"pools":[{"pool":1,"pool_name":".mgr","create_time":"2024-09-19T11:13:14.523581+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":1,"pg_placement_num":1,"pg_placement_num_target":1,"pg_num_target":1,"pg_num_pending":1,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"15","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_num_max":32,"pg_num_min":1},"application_metadata":{"mgr":{}},"read_balance":{"score_type":"Fair distribution","score_acting":4,"score_stable":4,"optimal_score":0.5,"raw_score_acting":2,"raw_score_stable":2,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":2,"pool_name":"rbd","create_time":"2024-09-19T11:13:17.782082+0000","flags":8193,"flags_names":"hashpspool,selfmanaged_snaps","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":8,"pg_placement_num":8,"pg_placement_num_target":8,"pg_num_target":8,"pg_num_pending":8,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"19","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":2,"snap_epoch":19,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rbd":{}},"read_balance":{"score_type":"Fair distribution","score_acting":2.5,"score_stable":2.5,"optimal_score":1,"raw_score_acting":2.5,"raw_score_stable":2.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":3,"pool_name":"default.rgw.buckets.data","create_time":"2024-09-19T11:13:29.318308+0000","flags":1,"flags_names":"hashpspool","type":3,"size":4,"min_size":3,"crush_rule":1,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"25","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"client.0","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":12288,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}}},{"pool":4,"pool_name":"default.rgw.buckets.index","create_time":"2024-09-19T11:13:31.657934+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":64,"pg_placement_num":64,"pg_placement_num_target":64,"pg_num_target":64,"pg_num_pending":64,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"27","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":5,"pool_name":".rgw.root","create_time":"2024-09-19T11:13:33.648879+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"29","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.1299999952316284,"score_stable":1.1299999952316284,"optimal_score":1,"raw_score_acting":1.1299999952316284,"raw_score_stable":1.1299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":6,"pool_name":"default.rgw.log","create_time":"2024-09-19T11:13:35.426243+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"31","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.6299999952316284,"score_stable":1.6299999952316284,"optimal_score":1,"raw_score_acting":1.6299999952316284,"raw_score_stable":1.6299999952316284,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":7,"pool_name":"default.rgw.control","create_time":"2024-09-19T11:13:37.376562+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"33","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.5,"score_stable":1.5,"optimal_score":1,"raw_score_acting":1.5,"raw_score_stable":1.5,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}},{"pool":8,"pool_name":"default.rgw.meta","create_time":"2024-09-19T11:13:39.438999+0000","flags":1,"flags_names":"hashpspool","type":1,"size":2,"min_size":1,"crush_rule":0,"peering_crush_bucket_count":0,"peering_crush_bucket_target":0,"peering_crush_bucket_barrier":0,"peering_crush_bucket_mandatory_member":2147483647,"is_stretch_pool":false,"object_hash":2,"pg_autoscale_mode":"off","pg_num":32,"pg_placement_num":32,"pg_placement_num_target":32,"pg_num_target":32,"pg_num_pending":32,"last_pg_merge_meta":{"source_pgid":"0.0","ready_epoch":0,"last_epoch_started":0,"last_epoch_clean":0,"source_version":"0'0","target_version":"0'0"},"last_change":"35","last_force_op_resend":"0","last_force_op_resend_prenautilus":"0","last_force_op_resend_preluminous":"0","auid":0,"snap_mode":"selfmanaged","snap_seq":0,"snap_epoch":0,"pool_snaps":[],"removed_snaps":"[]","quota_max_bytes":0,"quota_max_objects":0,"tiers":[],"tier_of":-1,"read_tier":-1,"write_tier":-1,"cache_mode":"none","target_max_bytes":0,"target_max_objects":0,"cache_target_dirty_ratio_micro":400000,"cache_target_dirty_high_ratio_micro":600000,"cache_target_full_ratio_micro":800000,"cache_min_flush_age":0,"cache_min_evict_age":0,"erasure_code_profile":"","hit_set_params":{"type":"none"},"hit_set_period":0,"hit_set_count":0,"use_gmt_hitset":true,"min_read_recency_for_promote":0,"min_write_recency_for_promote":0,"hit_set_grade_decay_rate":0,"hit_set_search_last_n":0,"grade_table":[],"stripe_width":0,"expected_num_objects":0,"fast_read":false,"options":{"pg_autoscale_bias":4},"application_metadata":{"rgw":{}},"read_balance":{"score_type":"Fair distribution","score_acting":1.25,"score_stable":1.25,"optimal_score":1,"raw_score_acting":1.25,"raw_score_stable":1.25,"primary_affinity_weighted":1,"average_primary_affinity":1,"average_primary_affinity_weighted":1}}],"osds":[{"osd":0,"uuid":"e66bdbac-cb32-42b2-ba97-3f71c62b28d9","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":9,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6800","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6801","nonce":394652614}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6802","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6803","nonce":394652614}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6806","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6807","nonce":394652614}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.37:6804","nonce":394652614},{"type":"v1","addr":"172.21.15.37:6805","nonce":394652614}]},"public_addr":"172.21.15.37:6801/394652614","cluster_addr":"172.21.15.37:6803/394652614","heartbeat_back_addr":"172.21.15.37:6807/394652614","heartbeat_front_addr":"172.21.15.37:6805/394652614","state":["exists","up"]},{"osd":1,"uuid":"409932a6-2604-46e6-9f50-587cd693a846","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6816","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6817","nonce":3609322588}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6818","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6819","nonce":3609322588}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6822","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6823","nonce":3609322588}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6820","nonce":3609322588},{"type":"v1","addr":"172.21.15.102:6821","nonce":3609322588}]},"public_addr":"172.21.15.102:6817/3609322588","cluster_addr":"172.21.15.102:6819/3609322588","heartbeat_back_addr":"172.21.15.102:6823/3609322588","heartbeat_front_addr":"172.21.15.102:6821/3609322588","state":["exists","up"]},{"osd":2,"uuid":"4fb4fb22-028c-4cc7-a259-ac630af33e99","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":36,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6808","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6809","nonce":525557096}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6810","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6811","nonce":525557096}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6814","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6815","nonce":525557096}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6812","nonce":525557096},{"type":"v1","addr":"172.21.15.102:6813","nonce":525557096}]},"public_addr":"172.21.15.102:6809/525557096","cluster_addr":"172.21.15.102:6811/525557096","heartbeat_back_addr":"172.21.15.102:6815/525557096","heartbeat_front_addr":"172.21.15.102:6813/525557096","state":["exists","up"]},{"osd":3,"uuid":"e0242238-a3ce-4288-93eb-e2aafa589662","up":1,"in":1,"weight":1,"primary_affinity":1,"last_clean_begin":0,"last_clean_end":0,"up_from":11,"up_thru":33,"down_at":0,"lost_at":0,"public_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6800","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6801","nonce":3957239017}]},"cluster_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6802","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6803","nonce":3957239017}]},"heartbeat_back_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6806","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6807","nonce":3957239017}]},"heartbeat_front_addrs":{"addrvec":[{"type":"v2","addr":"172.21.15.102:6804","nonce":3957239017},{"type":"v1","addr":"172.21.15.102:6805","nonce":3957239017}]},"public_addr":"172.21.15.102:6801/3957239017","cluster_addr":"172.21.15.102:6803/3957239017","heartbeat_back_addr":"172.21.15.102:6807/3957239017","heartbeat_front_addr":"172.21.15.102:6805/3957239017","state":["exists","up"]}],"osd_xinfo":[{"osd":0,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:08.941516+0000","dead_epoch":0},{"osd":1,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.998554+0000","dead_epoch":0},{"osd":2,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.777857+0000","dead_epoch":0},{"osd":3,"down_stamp":"0.000000","laggy_probability":0,"laggy_interval":0,"features":4540719139924082687,"old_weight":0,"last_purged_snaps_scrub":"2024-09-19T11:13:09.565216+0000","dead_epoch":0}],"pg_upmap":[],"pg_upmap_items":[{"pgid":"4.0","mappings":[{"from":3,"to":2}]},{"pgid":"4.2b","mappings":[{"from":3,"to":2}]},{"pgid":"4.3a","mappings":[{"from":3,"to":0}]},{"pgid":"4.3d","mappings":[{"from":3,"to":2}]},{"pgid":"5.4","mappings":[{"from":0,"to":2}]},{"pgid":"5.17","mappings":[{"from":0,"to":2}]},{"pgid":"5.1d","mappings":[{"from":0,"to":2}]}],"pg_upmap_primaries":[],"pg_temp":[],"primary_temp":[],"blocklist":{},"range_blocklist":{},"erasure_code_profiles":{"client.0":{"crush-device-class":"","crush-failure-domain":"osd","crush-num-failure-domains":"0","crush-osds-per-failure-domain":"0","crush-root":"default","jerasure-per-chunk-alignment":"false","k":"3","m":"1","name":"testprofile","plugin":"jerasure","technique":"reed_sol_van","w":"8"},"default":{"crush-failure-domain":"osd","k":"2","m":"1","plugin":"jerasure","technique":"reed_sol_van"}},"removed_snaps_queue":[],"new_removed_snaps":[],"new_purged_snaps":[],"crush_node_flags":{},"device_class_flags":{},"stretch_mode":{"stretch_mode_enabled":false,"stretch_bucket_count":0,"degraded_stretch_mode":0,"recovering_stretch_mode":0,"stretch_mode_bucket":0}} 2024-09-19T11:16:51.302 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff69403e710 msgr2=0x7ff694040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 --2- 172.21.15.37:0/2716615193 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff69403e710 0x7ff694040bd0 secure :-1 s=READY pgs=359 cs=0 l=1 rev1=1 crypto rx=0x7ff69c007fd0 tx=0x7ff69c007aa0 comp rx=0 tx=0).stop 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 msgr2=0x7ff6b41bc860 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 --2- 172.21.15.37:0/2716615193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b41bc860 secure :-1 s=READY pgs=861 cs=0 l=1 rev1=1 crypto rx=0x7ff6a4009750 tx=0x7ff6a40046c0 comp rx=0 tx=0).stop 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 shutdown_connections 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 --2- 172.21.15.37:0/2716615193 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff69403e710 0x7ff694040bd0 unknown :-1 s=CLOSED pgs=359 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 --2- 172.21.15.37:0/2716615193 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff6b412c0b0 0x7ff6b41bc860 unknown :-1 s=CLOSED pgs=861 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 >> 172.21.15.37:0/2716615193 conn(0x7ff6b409abc0 msgr2=0x7ff6b4071b00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 shutdown_connections 2024-09-19T11:16:51.303 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:51.300+0000 7ff6b96cd640 1 -- 172.21.15.37:0/2716615193 wait complete. 2024-09-19T11:16:52.314 INFO:tasks.ceph:Scrubbing osd.0 2024-09-19T11:16:52.315 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.0 config set osd_debug_deep_scrub_sleep 0 2024-09-19T11:16:52.437 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.435+0000 7f8c12753640 1 Processor -- start 2024-09-19T11:16:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c12753640 1 -- start start 2024-09-19T11:16:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c12753640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c0c06e260 0x7f8c0c06e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.470 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c12753640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8c0c06f6b0 con 0x7f8c0c06eb80 2024-09-19T11:16:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c12753640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8c0c06f350 con 0x7f8c0c06e260 2024-09-19T11:16:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c0bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8c0c06e260 0x7f8c0c06e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c0b7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8c0c06eb80 0x7f8c0c12f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57680/0 (socket says 172.21.15.37:57680) 2024-09-19T11:16:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c0b7fe640 1 -- 172.21.15.37:0/2917553673 learned_addr learned my addr 172.21.15.37:0/2917553673 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c0bfff640 1 -- 172.21.15.37:0/2917553673 >> v1:172.21.15.37:6789/0 conn(0x7f8c0c06eb80 legacy=0x7f8c0c12f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.437+0000 7f8c0bfff640 1 -- 172.21.15.37:0/2917553673 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c06fba0 con 0x7f8c0c06e260 2024-09-19T11:16:52.471 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.436+0000 7f8c0affd640 1 -- 172.21.15.37:0/2917553673 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 191995759 0 0) 0x7f8c0c06f6b0 con 0x7f8c0c06eb80 2024-09-19T11:16:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.437+0000 7f8c0bfff640 1 --2- 172.21.15.37:0/2917553673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c06e640 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009720 tx=0x7f8bfc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eaf7efdacb6be7d0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.437+0000 7f8c0affd640 1 -- 172.21.15.37:0/2917553673 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bfc037070 con 0x7f8c0c06e260 2024-09-19T11:16:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.437+0000 7f8c0affd640 1 -- 172.21.15.37:0/2917553673 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc02ad90 con 0x7f8c0c06e260 2024-09-19T11:16:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.437+0000 7f8c0affd640 1 -- 172.21.15.37:0/2917553673 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bfc032590 con 0x7f8c0c06e260 2024-09-19T11:16:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.438+0000 7f8c12753640 1 -- 172.21.15.37:0/2917553673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 msgr2=0x7f8c0c06e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.438+0000 7f8c12753640 1 --2- 172.21.15.37:0/2917553673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c06e640 secure :-1 s=READY pgs=863 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009720 tx=0x7f8bfc02a110 comp rx=0 tx=0).stop 2024-09-19T11:16:52.475 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.438+0000 7f8c12753640 1 -- 172.21.15.37:0/2917553673 shutdown_connections 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.438+0000 7f8c12753640 1 --2- 172.21.15.37:0/2917553673 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c06e640 unknown :-1 s=CLOSED pgs=863 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.438+0000 7f8c12753640 1 -- 172.21.15.37:0/2917553673 >> 172.21.15.37:0/2917553673 conn(0x7f8c0c0a20f0 msgr2=0x7f8c0c0a2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.438+0000 7f8c12753640 1 -- 172.21.15.37:0/2917553673 shutdown_connections 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.438+0000 7f8c12753640 1 -- 172.21.15.37:0/2917553673 wait complete. 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.439+0000 7f8c12753640 1 Processor -- start 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.439+0000 7f8c12753640 1 -- start start 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c12753640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c1c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c12753640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8c0c06fef0 con 0x7f8c0c06e260 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c1c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c0bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c1c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55154/0 (socket says 172.21.15.37:55154) 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c0bfff640 1 -- 172.21.15.37:0/1282599589 learned_addr learned my addr 172.21.15.37:0/1282599589 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c0bfff640 1 -- 172.21.15.37:0/1282599589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8c0c092b00 con 0x7f8c0c06e260 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c0bfff640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c1c4340 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009720 tx=0x7f8bfc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.476 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bfc041070 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8bfc03c460 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8c0c092d30 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8bfc037040 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.440+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8c0c1c4a60 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.441+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f8c0c12d2f0 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.441+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8bfc044070 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.442+0000 7f8c08ff9640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8bf803e710 0x7f8bf8040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.442+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8bfc074080 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.442+0000 7f8c08ff9640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f8bf804ab80 0x7f8bf804d020 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.442+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f8bfc04be80 con 0x7f8bf804ab80 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.442+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f8bfc07b050 con 0x7f8c0c06e260 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.442+0000 7f8c10cf0640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f8bf804ab80 0x7f8bf804d020 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.477 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.442+0000 7f8c0b7fe640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8bf803e710 0x7f8bf8040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.442+0000 7f8c10cf0640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f8bf804ab80 0x7f8bf804d020 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.443+0000 7f8c0b7fe640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8bf803e710 0x7f8bf8040bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8c00000c00 tx=0x7f8c000078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.443+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 <== osd.0 v2:172.21.15.37:6800/394652614 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f8bfc04be80 con 0x7f8bf804ab80 2024-09-19T11:16:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 --> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f8c0c0926f0 con 0x7f8bf804ab80 2024-09-19T11:16:52.478 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c08ff9640 1 -- 172.21.15.37:0/1282599589 <== osd.0 v2:172.21.15.37:6800/394652614 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f8c0400ad10 con 0x7f8bf804ab80 2024-09-19T11:16:52.478 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T11:16:52.478 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T11:16:52.478 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f8bf804ab80 msgr2=0x7f8bf804d020 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f8bf804ab80 0x7f8bf804d020 crc :-1 s=READY pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8bf803e710 msgr2=0x7f8bf8040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8bf803e710 0x7f8bf8040bd0 secure :-1 s=READY pgs=360 cs=0 l=1 rev1=1 crypto rx=0x7f8c00000c00 tx=0x7f8c000078f0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 msgr2=0x7f8c0c1c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c1c4340 secure :-1 s=READY pgs=864 cs=0 l=1 rev1=1 crypto rx=0x7f8bfc009720 tx=0x7f8bfc0046c0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 shutdown_connections 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:6800/394652614,v1:172.21.15.37:6801/394652614] conn(0x7f8bf804ab80 0x7f8bf804d020 unknown :-1 s=CLOSED pgs=201 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.480 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8bf803e710 0x7f8bf8040bd0 unknown :-1 s=CLOSED pgs=360 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 --2- 172.21.15.37:0/1282599589 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8c0c06e260 0x7f8c0c1c4340 unknown :-1 s=CLOSED pgs=864 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 >> 172.21.15.37:0/1282599589 conn(0x7f8c0c0a20f0 msgr2=0x7f8c0c072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 shutdown_connections 2024-09-19T11:16:52.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.456+0000 7f8c12753640 1 -- 172.21.15.37:0/1282599589 wait complete. 2024-09-19T11:16:52.481 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 0 2024-09-19T11:16:52.586 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.582+0000 7fd621216640 1 Processor -- start 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.582+0000 7fd621216640 1 -- start start 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd621216640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd61c06fab0 0x7fd61c134820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd621216640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd61c070330 con 0x7fd61c06efc0 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd621216640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd61c09f310 con 0x7fd61c06fab0 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd61a59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd61c06fab0 0x7fd61c134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd61ad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd61c06efc0 0x7fd61c06f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57694/0 (socket says 172.21.15.37:57694) 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd61ad9d640 1 -- 172.21.15.37:0/508131820 learned_addr learned my addr 172.21.15.37:0/508131820 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd61a59c640 1 -- 172.21.15.37:0/508131820 >> v1:172.21.15.37:6789/0 conn(0x7fd61c06efc0 legacy=0x7fd61c06f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd61a59c640 1 -- 172.21.15.37:0/508131820 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c070640 con 0x7fd61c06fab0 2024-09-19T11:16:52.587 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.583+0000 7fd619d9b640 1 -- 172.21.15.37:0/508131820 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 2014579565 0 0) 0x7fd61c070330 con 0x7fd61c06efc0 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.584+0000 7fd61a59c640 1 --2- 172.21.15.37:0/508131820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06fab0 0x7fd61c134820 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd604009720 tx=0x7fd60402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=f67429d6af00ec16 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.584+0000 7fd619d9b640 1 -- 172.21.15.37:0/508131820 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd604037070 con 0x7fd61c06fab0 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.584+0000 7fd619d9b640 1 -- 172.21.15.37:0/508131820 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60402ad90 con 0x7fd61c06fab0 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.584+0000 7fd619d9b640 1 -- 172.21.15.37:0/508131820 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd604032590 con 0x7fd61c06fab0 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.584+0000 7fd621216640 1 -- 172.21.15.37:0/508131820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06fab0 msgr2=0x7fd61c134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.584+0000 7fd621216640 1 --2- 172.21.15.37:0/508131820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06fab0 0x7fd61c134820 secure :-1 s=READY pgs=866 cs=0 l=1 rev1=1 crypto rx=0x7fd604009720 tx=0x7fd60402a110 comp rx=0 tx=0).stop 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.585+0000 7fd621216640 1 -- 172.21.15.37:0/508131820 shutdown_connections 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.585+0000 7fd621216640 1 --2- 172.21.15.37:0/508131820 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06fab0 0x7fd61c134820 unknown :-1 s=CLOSED pgs=866 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.585+0000 7fd621216640 1 -- 172.21.15.37:0/508131820 >> 172.21.15.37:0/508131820 conn(0x7fd61c0a2460 msgr2=0x7fd61c09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.585+0000 7fd621216640 1 -- 172.21.15.37:0/508131820 shutdown_connections 2024-09-19T11:16:52.588 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.585+0000 7fd621216640 1 -- 172.21.15.37:0/508131820 wait complete. 2024-09-19T11:16:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.586+0000 7fd621216640 1 Processor -- start 2024-09-19T11:16:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.586+0000 7fd621216640 1 -- start start 2024-09-19T11:16:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.586+0000 7fd621216640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06efc0 0x7fd61c1279f0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.591 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.586+0000 7fd621216640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd61c134ee0 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.586+0000 7fd61ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06efc0 0x7fd61c1279f0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.586+0000 7fd61ad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06efc0 0x7fd61c1279f0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55170/0 (socket says 172.21.15.37:55170) 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.586+0000 7fd61ad9d640 1 -- 172.21.15.37:0/3893480866 learned_addr learned my addr 172.21.15.37:0/3893480866 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.587+0000 7fd61ad9d640 1 -- 172.21.15.37:0/3893480866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd61c12ccf0 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.587+0000 7fd61ad9d640 1 --2- 172.21.15.37:0/3893480866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06efc0 0x7fd61c1279f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00c7c0 tx=0x7fd60c00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.587+0000 7fd6137fe640 1 -- 172.21.15.37:0/3893480866 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c018070 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.587+0000 7fd6137fe640 1 -- 172.21.15.37:0/3893480866 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd60c004d70 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.587+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd61c127f30 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.587+0000 7fd6137fe640 1 -- 172.21.15.37:0/3893480866 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd60c00a710 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.587+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd61c128400 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.588+0000 7fd6137fe640 1 -- 172.21.15.37:0/3893480866 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd60c01b070 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.588+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd61c06f3a0 con 0x7fd61c06efc0 2024-09-19T11:16:52.592 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.588+0000 7fd6137fe640 1 --2- 172.21.15.37:0/3893480866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd5fc03e710 0x7fd5fc040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.588+0000 7fd6137fe640 1 -- 172.21.15.37:0/3893480866 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fd60c052e50 con 0x7fd61c06efc0 2024-09-19T11:16:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.588+0000 7fd61a59c640 1 --2- 172.21.15.37:0/3893480866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd5fc03e710 0x7fd5fc040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.589+0000 7fd61a59c640 1 --2- 172.21.15.37:0/3893480866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd5fc03e710 0x7fd5fc040bd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd604034000 tx=0x7fd60402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.593+0000 7fd6137fe640 1 -- 172.21.15.37:0/3893480866 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fd60c011db0 con 0x7fd61c06efc0 2024-09-19T11:16:52.778 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.776+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "0", "target": ["mon-mgr", ""]}) -- 0x7fd61c073fe0 con 0x7fd5fc03e710 2024-09-19T11:16:52.779 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.777+0000 7fd6137fe640 1 -- 172.21.15.37:0/3893480866 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 0 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd604032740 con 0x7fd5fc03e710 2024-09-19T11:16:52.779 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 0 to deep-scrub 2024-09-19T11:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd5fc03e710 msgr2=0x7fd5fc040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.781 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 --2- 172.21.15.37:0/3893480866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd5fc03e710 0x7fd5fc040bd0 secure :-1 s=READY pgs=361 cs=0 l=1 rev1=1 crypto rx=0x7fd604034000 tx=0x7fd60402e000 comp rx=0 tx=0).stop 2024-09-19T11:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06efc0 msgr2=0x7fd61c1279f0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 --2- 172.21.15.37:0/3893480866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06efc0 0x7fd61c1279f0 secure :-1 s=READY pgs=867 cs=0 l=1 rev1=1 crypto rx=0x7fd60c00c7c0 tx=0x7fd60c00cc80 comp rx=0 tx=0).stop 2024-09-19T11:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 shutdown_connections 2024-09-19T11:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 --2- 172.21.15.37:0/3893480866 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd5fc03e710 0x7fd5fc040bd0 unknown :-1 s=CLOSED pgs=361 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 --2- 172.21.15.37:0/3893480866 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd61c06efc0 0x7fd61c1279f0 unknown :-1 s=CLOSED pgs=867 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 >> 172.21.15.37:0/3893480866 conn(0x7fd61c0a2460 msgr2=0x7fd61c072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 shutdown_connections 2024-09-19T11:16:52.782 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.780+0000 7fd621216640 1 -- 172.21.15.37:0/3893480866 wait complete. 2024-09-19T11:16:52.792 INFO:tasks.ceph:Scrubbing osd.1 2024-09-19T11:16:52.792 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.1 config set osd_debug_deep_scrub_sleep 0 2024-09-19T11:16:52.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.897+0000 7f1552685640 1 Processor -- start 2024-09-19T11:16:52.898 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.897+0000 7f1552685640 1 -- start start 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.897+0000 7f1552685640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f154c06e260 0x7f154c06e640 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.897+0000 7f1552685640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f154c06f6b0 con 0x7f154c06eb80 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.897+0000 7f1552685640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f154c06f350 con 0x7f154c06e260 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.897+0000 7f154bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f154c06e260 0x7f154c06e640 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.897+0000 7f1543fff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f154c06eb80 0x7f154c12f440 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57702/0 (socket says 172.21.15.37:57702) 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.897+0000 7f1543fff640 1 -- 172.21.15.37:0/3926425984 learned_addr learned my addr 172.21.15.37:0/3926425984 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.898+0000 7f154bfff640 1 -- 172.21.15.37:0/3926425984 >> v1:172.21.15.37:6789/0 conn(0x7f154c06eb80 legacy=0x7f154c12f440 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.898+0000 7f154b7fe640 1 -- 172.21.15.37:0/3926425984 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 119743217 0 0) 0x7f154c06f6b0 con 0x7f154c06eb80 2024-09-19T11:16:52.899 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.898+0000 7f154bfff640 1 -- 172.21.15.37:0/3926425984 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c06fba0 con 0x7f154c06e260 2024-09-19T11:16:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.898+0000 7f154bfff640 1 --2- 172.21.15.37:0/3926425984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c06e640 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f153c009720 tx=0x7f153c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=e4d7e415a022ab96 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.898+0000 7f154b7fe640 1 -- 172.21.15.37:0/3926425984 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f153c037070 con 0x7f154c06e260 2024-09-19T11:16:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f154b7fe640 1 -- 172.21.15.37:0/3926425984 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153c02ad90 con 0x7f154c06e260 2024-09-19T11:16:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f154b7fe640 1 -- 172.21.15.37:0/3926425984 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f153c032590 con 0x7f154c06e260 2024-09-19T11:16:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f1552685640 1 -- 172.21.15.37:0/3926425984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 msgr2=0x7f154c06e640 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f1552685640 1 --2- 172.21.15.37:0/3926425984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c06e640 secure :-1 s=READY pgs=869 cs=0 l=1 rev1=1 crypto rx=0x7f153c009720 tx=0x7f153c02a110 comp rx=0 tx=0).stop 2024-09-19T11:16:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f1552685640 1 -- 172.21.15.37:0/3926425984 shutdown_connections 2024-09-19T11:16:52.901 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f1552685640 1 --2- 172.21.15.37:0/3926425984 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c06e640 unknown :-1 s=CLOSED pgs=869 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f1552685640 1 -- 172.21.15.37:0/3926425984 >> 172.21.15.37:0/3926425984 conn(0x7f154c0a20f0 msgr2=0x7f154c0a2500 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:52.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f1552685640 1 -- 172.21.15.37:0/3926425984 shutdown_connections 2024-09-19T11:16:52.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.899+0000 7f1552685640 1 -- 172.21.15.37:0/3926425984 wait complete. 2024-09-19T11:16:52.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.900+0000 7f1552685640 1 Processor -- start 2024-09-19T11:16:52.902 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.900+0000 7f1552685640 1 -- start start 2024-09-19T11:16:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.900+0000 7f1552685640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c1c4340 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.900+0000 7f1552685640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f154c06fef0 con 0x7f154c06e260 2024-09-19T11:16:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f154bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c1c4340 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f154bfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c1c4340 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55196/0 (socket says 172.21.15.37:55196) 2024-09-19T11:16:52.904 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f154bfff640 1 -- 172.21.15.37:0/914899180 learned_addr learned my addr 172.21.15.37:0/914899180 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f154bfff640 1 -- 172.21.15.37:0/914899180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f154c093080 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f154bfff640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c1c4340 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f153c035040 tx=0x7f153c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f153c037040 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f153c004160 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f154c0934c0 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f153c004440 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.901+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f154c1c4880 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.902+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7f154c1300c0 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.902+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f153c003610 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.902+0000 7f15497fa640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f152c03e710 0x7f152c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.903+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f153c074790 con 0x7f154c06e260 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.903+0000 7f15497fa640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7f152c04abe0 0x7f152c04d080 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:52.905 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.903+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7f152c04d750 con 0x7f152c04abe0 2024-09-19T11:16:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.903+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7f153c07b050 con 0x7f154c06e260 2024-09-19T11:16:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.903+0000 7f1543fff640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f152c03e710 0x7f152c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.903+0000 7f1550c22640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7f152c04abe0 0x7f152c04d080 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.903+0000 7f1543fff640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f152c03e710 0x7f152c040bd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1534000c00 tx=0x7f15340078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.903+0000 7f1550c22640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7f152c04abe0 0x7f152c04d080 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.1 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:52.906 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.904+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 <== osd.1 v2:172.21.15.102:6816/3609322588 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7f152c04d750 con 0x7f152c04abe0 2024-09-19T11:16:52.917 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 --> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7f154c092670 con 0x7f152c04abe0 2024-09-19T11:16:52.918 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f15497fa640 1 -- 172.21.15.37:0/914899180 <== osd.1 v2:172.21.15.102:6816/3609322588 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7f154c092670 con 0x7f152c04abe0 2024-09-19T11:16:52.918 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T11:16:52.918 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T11:16:52.919 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T11:16:52.919 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7f152c04abe0 msgr2=0x7f152c04d080 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7f152c04abe0 0x7f152c04d080 crc :-1 s=READY pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f152c03e710 msgr2=0x7f152c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f152c03e710 0x7f152c040bd0 secure :-1 s=READY pgs=362 cs=0 l=1 rev1=1 crypto rx=0x7f1534000c00 tx=0x7f15340078f0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 msgr2=0x7f154c1c4340 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c1c4340 secure :-1 s=READY pgs=870 cs=0 l=1 rev1=1 crypto rx=0x7f153c035040 tx=0x7f153c0046c0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 shutdown_connections 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6816/3609322588,v1:172.21.15.102:6817/3609322588] conn(0x7f152c04abe0 0x7f152c04d080 unknown :-1 s=CLOSED pgs=206 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f152c03e710 0x7f152c040bd0 unknown :-1 s=CLOSED pgs=362 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 --2- 172.21.15.37:0/914899180 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f154c06e260 0x7f154c1c4340 unknown :-1 s=CLOSED pgs=870 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 >> 172.21.15.37:0/914899180 conn(0x7f154c0a20f0 msgr2=0x7f154c072a70 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 shutdown_connections 2024-09-19T11:16:52.920 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:52.917+0000 7f1552685640 1 -- 172.21.15.37:0/914899180 wait complete. 2024-09-19T11:16:52.929 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 1 2024-09-19T11:16:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.029+0000 7f0c41eb8640 1 Processor -- start 2024-09-19T11:16:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.029+0000 7f0c41eb8640 1 -- start start 2024-09-19T11:16:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.030+0000 7f0c41eb8640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c3c09b4a0 0x7f0c3c09b880 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.031 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.030+0000 7f0c41eb8640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f0c3c0706a0 con 0x7f0c3c09bdc0 2024-09-19T11:16:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.030+0000 7f0c41eb8640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f0c3c09f400 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.030+0000 7f0c3b7fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f0c3c09b4a0 0x7f0c3c09b880 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.030+0000 7f0c3affd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f0c3c09bdc0 0x7f0c3c06efc0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57710/0 (socket says 172.21.15.37:57710) 2024-09-19T11:16:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.030+0000 7f0c3affd640 1 -- 172.21.15.37:0/2991756046 learned_addr learned my addr 172.21.15.37:0/2991756046 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.030+0000 7f0c3b7fe640 1 -- 172.21.15.37:0/2991756046 >> v1:172.21.15.37:6789/0 conn(0x7f0c3c09bdc0 legacy=0x7f0c3c06efc0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.032 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.030+0000 7f0c3b7fe640 1 -- 172.21.15.37:0/2991756046 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c09f950 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.031+0000 7f0c3b7fe640 1 --2- 172.21.15.37:0/2991756046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c09b880 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009720 tx=0x7f0c2c02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=c655023cd4baf6ea server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.033 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.031+0000 7f0c3a7fc640 1 -- 172.21.15.37:0/2991756046 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c2c037070 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.031+0000 7f0c3a7fc640 1 -- 172.21.15.37:0/2991756046 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c02ad90 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.031+0000 7f0c3a7fc640 1 -- 172.21.15.37:0/2991756046 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c2c032590 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.032+0000 7f0c41eb8640 1 -- 172.21.15.37:0/2991756046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 msgr2=0x7f0c3c09b880 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.032+0000 7f0c41eb8640 1 --2- 172.21.15.37:0/2991756046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c09b880 secure :-1 s=READY pgs=872 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009720 tx=0x7f0c2c02a110 comp rx=0 tx=0).stop 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.032+0000 7f0c41eb8640 1 -- 172.21.15.37:0/2991756046 shutdown_connections 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.032+0000 7f0c41eb8640 1 --2- 172.21.15.37:0/2991756046 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c09b880 unknown :-1 s=CLOSED pgs=872 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.032+0000 7f0c41eb8640 1 -- 172.21.15.37:0/2991756046 >> 172.21.15.37:0/2991756046 conn(0x7f0c3c0a25b0 msgr2=0x7f0c3c09ea80 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.032+0000 7f0c41eb8640 1 -- 172.21.15.37:0/2991756046 shutdown_connections 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.032+0000 7f0c41eb8640 1 -- 172.21.15.37:0/2991756046 wait complete. 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.032+0000 7f0c41eb8640 1 Processor -- start 2024-09-19T11:16:53.034 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.033+0000 7f0c41eb8640 1 -- start start 2024-09-19T11:16:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.033+0000 7f0c41eb8640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c0724e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.033+0000 7f0c41eb8640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f0c3c06f6d0 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.033+0000 7f0c3b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c0724e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.033+0000 7f0c3b7fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c0724e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55212/0 (socket says 172.21.15.37:55212) 2024-09-19T11:16:53.036 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.033+0000 7f0c3b7fe640 1 -- 172.21.15.37:0/1717885316 learned_addr learned my addr 172.21.15.37:0/1717885316 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.033+0000 7f0c3b7fe640 1 -- 172.21.15.37:0/1717885316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f0c3c12a030 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.034+0000 7f0c3b7fe640 1 --2- 172.21.15.37:0/1717885316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c0724e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009840 tx=0x7f0c2c0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.034+0000 7f0c23fff640 1 -- 172.21.15.37:0/1717885316 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c2c041020 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.034+0000 7f0c23fff640 1 -- 172.21.15.37:0/1717885316 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f0c2c03d550 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.034+0000 7f0c23fff640 1 -- 172.21.15.37:0/1717885316 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f0c2c037040 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.034+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f0c3c0911a0 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.034+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f0c3c072c00 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.035+0000 7f0c23fff640 1 -- 172.21.15.37:0/1717885316 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f0c2c044020 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.035+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f0c3c0008d0 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.035+0000 7f0c23fff640 1 --2- 172.21.15.37:0/1717885316 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0c2803e710 0x7f0c28040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.035+0000 7f0c23fff640 1 -- 172.21.15.37:0/1717885316 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f0c2c073e90 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.037 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.035+0000 7f0c3affd640 1 --2- 172.21.15.37:0/1717885316 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0c2803e710 0x7f0c28040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.038 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.036+0000 7f0c3affd640 1 --2- 172.21.15.37:0/1717885316 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0c2803e710 0x7f0c28040bd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0c30007fd0 tx=0x7f0c30007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.040 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.040+0000 7f0c23fff640 1 -- 172.21.15.37:0/1717885316 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f0c2c04b030 con 0x7f0c3c09b4a0 2024-09-19T11:16:53.227 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.226+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "1", "target": ["mon-mgr", ""]}) -- 0x7f0c3c0904c0 con 0x7f0c2803e710 2024-09-19T11:16:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.227+0000 7f0c23fff640 1 -- 172.21.15.37:0/1717885316 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 1 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f0c300058b0 con 0x7f0c2803e710 2024-09-19T11:16:53.228 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 1 to deep-scrub 2024-09-19T11:16:53.230 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0c2803e710 msgr2=0x7f0c28040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 --2- 172.21.15.37:0/1717885316 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0c2803e710 0x7f0c28040bd0 secure :-1 s=READY pgs=363 cs=0 l=1 rev1=1 crypto rx=0x7f0c30007fd0 tx=0x7f0c30007aa0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 msgr2=0x7f0c3c0724e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 --2- 172.21.15.37:0/1717885316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c0724e0 secure :-1 s=READY pgs=873 cs=0 l=1 rev1=1 crypto rx=0x7f0c2c009840 tx=0x7f0c2c0046c0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 shutdown_connections 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 --2- 172.21.15.37:0/1717885316 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f0c2803e710 0x7f0c28040bd0 unknown :-1 s=CLOSED pgs=363 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 --2- 172.21.15.37:0/1717885316 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f0c3c09b4a0 0x7f0c3c0724e0 unknown :-1 s=CLOSED pgs=873 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 >> 172.21.15.37:0/1717885316 conn(0x7f0c3c0a25b0 msgr2=0x7f0c3c12c290 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 shutdown_connections 2024-09-19T11:16:53.231 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.229+0000 7f0c41eb8640 1 -- 172.21.15.37:0/1717885316 wait complete. 2024-09-19T11:16:53.241 INFO:tasks.ceph:Scrubbing osd.2 2024-09-19T11:16:53.241 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.2 config set osd_debug_deep_scrub_sleep 0 2024-09-19T11:16:53.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.345+0000 7fabf248c640 1 Processor -- start 2024-09-19T11:16:53.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.345+0000 7fabf248c640 1 -- start start 2024-09-19T11:16:53.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.346+0000 7fabf248c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabec0974e0 0x7fabec0978c0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.346+0000 7fabf248c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fabec071e80 con 0x7fabec097e00 2024-09-19T11:16:53.347 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.346+0000 7fabf248c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fabec0715f0 con 0x7fabec0974e0 2024-09-19T11:16:53.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.346+0000 7fabebfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fabec0974e0 0x7fabec0978c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.346+0000 7fabeb7fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fabec097e00 0x7fabec06dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57714/0 (socket says 172.21.15.37:57714) 2024-09-19T11:16:53.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.346+0000 7fabeb7fe640 1 -- 172.21.15.37:0/2187450568 learned_addr learned my addr 172.21.15.37:0/2187450568 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:53.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.346+0000 7fabebfff640 1 -- 172.21.15.37:0/2187450568 >> v1:172.21.15.37:6789/0 conn(0x7fabec097e00 legacy=0x7fabec06dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.348 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.346+0000 7fabebfff640 1 -- 172.21.15.37:0/2187450568 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec099ba0 con 0x7fabec0974e0 2024-09-19T11:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.347+0000 7fabebfff640 1 --2- 172.21.15.37:0/2187450568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec0978c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009720 tx=0x7fabdc02a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=83cb894cc01a2858 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.347+0000 7fabeaffd640 1 -- 172.21.15.37:0/2187450568 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabdc037070 con 0x7fabec0974e0 2024-09-19T11:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.347+0000 7fabeaffd640 1 -- 172.21.15.37:0/2187450568 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabdc02ad90 con 0x7fabec0974e0 2024-09-19T11:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.347+0000 7fabeaffd640 1 -- 172.21.15.37:0/2187450568 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabdc032590 con 0x7fabec0974e0 2024-09-19T11:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.348+0000 7fabf248c640 1 -- 172.21.15.37:0/2187450568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 msgr2=0x7fabec0978c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.349 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.348+0000 7fabf248c640 1 --2- 172.21.15.37:0/2187450568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec0978c0 secure :-1 s=READY pgs=875 cs=0 l=1 rev1=1 crypto rx=0x7fabdc009720 tx=0x7fabdc02a110 comp rx=0 tx=0).stop 2024-09-19T11:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.348+0000 7fabf248c640 1 -- 172.21.15.37:0/2187450568 shutdown_connections 2024-09-19T11:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.348+0000 7fabf248c640 1 --2- 172.21.15.37:0/2187450568 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec0978c0 unknown :-1 s=CLOSED pgs=875 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.348+0000 7fabf248c640 1 -- 172.21.15.37:0/2187450568 >> 172.21.15.37:0/2187450568 conn(0x7fabec09a9f0 msgr2=0x7fabec09ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.348+0000 7fabf248c640 1 -- 172.21.15.37:0/2187450568 shutdown_connections 2024-09-19T11:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.348+0000 7fabf248c640 1 -- 172.21.15.37:0/2187450568 wait complete. 2024-09-19T11:16:53.350 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.348+0000 7fabf248c640 1 Processor -- start 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.349+0000 7fabf248c640 1 -- start start 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.349+0000 7fabf248c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec08c2c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.349+0000 7fabf248c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fabec06e6c0 con 0x7fabec0974e0 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.349+0000 7fabebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec08c2c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.349+0000 7fabebfff640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec08c2c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55218/0 (socket says 172.21.15.37:55218) 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.349+0000 7fabebfff640 1 -- 172.21.15.37:0/1949249218 learned_addr learned my addr 172.21.15.37:0/1949249218 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.349+0000 7fabebfff640 1 -- 172.21.15.37:0/1949249218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fabec08d860 con 0x7fabec0974e0 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.350+0000 7fabebfff640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec08c2c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fabdc02a150 tx=0x7fabdc0046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.350+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabdc041070 con 0x7fabec0974e0 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.350+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fabdc032e30 con 0x7fabec0974e0 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.350+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fabec08e4f0 con 0x7fabec0974e0 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.350+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fabdc037040 con 0x7fabec0974e0 2024-09-19T11:16:53.354 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.350+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fabec08c9e0 con 0x7fabec0974e0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7fabec08d420 con 0x7fabec0974e0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fabdc044070 con 0x7fabec0974e0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabe8ff9640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fabd803e740 0x7fabd8040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fabdc0740e0 con 0x7fabec0974e0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabeb7fe640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fabd803e740 0x7fabd8040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabe8ff9640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fabd804abb0 0x7fabd804d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7fabdc001d30 con 0x7fabd804abb0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7fabdc07b050 con 0x7fabec0974e0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.351+0000 7fabf0a29640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fabd804abb0 0x7fabd804d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.352+0000 7fabeb7fe640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fabd803e740 0x7fabd8040c00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fabe0007fd0 tx=0x7fabe0007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.352+0000 7fabf0a29640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fabd804abb0 0x7fabd804d050 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.2 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.355 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.353+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 <== osd.2 v2:172.21.15.102:6808/525557096 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7fabdc001d30 con 0x7fabd804abb0 2024-09-19T11:16:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 --> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7fabec073fd0 con 0x7fabd804abb0 2024-09-19T11:16:53.367 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabe8ff9640 1 -- 172.21.15.37:0/1949249218 <== osd.2 v2:172.21.15.102:6808/525557096 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7fabe400ad10 con 0x7fabd804abb0 2024-09-19T11:16:53.367 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T11:16:53.367 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T11:16:53.367 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T11:16:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fabd804abb0 msgr2=0x7fabd804d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fabd804abb0 0x7fabd804d050 crc :-1 s=READY pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.368 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fabd803e740 msgr2=0x7fabd8040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fabd803e740 0x7fabd8040c00 secure :-1 s=READY pgs=364 cs=0 l=1 rev1=1 crypto rx=0x7fabe0007fd0 tx=0x7fabe0007aa0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 msgr2=0x7fabec08c2c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec08c2c0 secure :-1 s=READY pgs=876 cs=0 l=1 rev1=1 crypto rx=0x7fabdc02a150 tx=0x7fabdc0046c0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 shutdown_connections 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6808/525557096,v1:172.21.15.102:6809/525557096] conn(0x7fabd804abb0 0x7fabd804d050 unknown :-1 s=CLOSED pgs=106 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fabd803e740 0x7fabd8040c00 unknown :-1 s=CLOSED pgs=364 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 --2- 172.21.15.37:0/1949249218 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fabec0974e0 0x7fabec08c2c0 unknown :-1 s=CLOSED pgs=876 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 >> 172.21.15.37:0/1949249218 conn(0x7fabec09a9f0 msgr2=0x7fabec12b6e0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 shutdown_connections 2024-09-19T11:16:53.369 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.366+0000 7fabf248c640 1 -- 172.21.15.37:0/1949249218 wait complete. 2024-09-19T11:16:53.377 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 2 2024-09-19T11:16:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.479+0000 7fd519c65640 1 Processor -- start 2024-09-19T11:16:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.479+0000 7fd519c65640 1 -- start start 2024-09-19T11:16:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.479+0000 7fd519c65640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd51406eaa0 0x7fd5141326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.479+0000 7fd519c65640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7fd514071660 con 0x7fd51406dfb0 2024-09-19T11:16:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.479+0000 7fd519c65640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7fd514072550 con 0x7fd51406eaa0 2024-09-19T11:16:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.480+0000 7fd50bfff640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7fd51406eaa0 0x7fd5141326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.480+0000 7fd5137fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7fd51406dfb0 0x7fd51406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:57728/0 (socket says 172.21.15.37:57728) 2024-09-19T11:16:53.481 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.480+0000 7fd5137fe640 1 -- 172.21.15.37:0/2994165435 learned_addr learned my addr 172.21.15.37:0/2994165435 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:53.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.480+0000 7fd50bfff640 1 -- 172.21.15.37:0/2994165435 >> v1:172.21.15.37:6789/0 conn(0x7fd51406dfb0 legacy=0x7fd51406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.482 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.480+0000 7fd50bfff640 1 -- 172.21.15.37:0/2994165435 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd514099e20 con 0x7fd51406eaa0 2024-09-19T11:16:53.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd50bfff640 1 --2- 172.21.15.37:0/2994165435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406eaa0 0x7fd5141326d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009720 tx=0x7fd4fc02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=cc44f23153e0b8d4 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd512ffd640 1 -- 172.21.15.37:0/2994165435 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4fc037070 con 0x7fd51406eaa0 2024-09-19T11:16:53.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd512ffd640 1 -- 172.21.15.37:0/2994165435 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd4fc02ae20 con 0x7fd51406eaa0 2024-09-19T11:16:53.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd512ffd640 1 -- 172.21.15.37:0/2994165435 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd4fc032590 con 0x7fd51406eaa0 2024-09-19T11:16:53.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd519c65640 1 -- 172.21.15.37:0/2994165435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406eaa0 msgr2=0x7fd5141326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd519c65640 1 --2- 172.21.15.37:0/2994165435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406eaa0 0x7fd5141326d0 secure :-1 s=READY pgs=878 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc009720 tx=0x7fd4fc02a1a0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.483 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd519c65640 1 -- 172.21.15.37:0/2994165435 shutdown_connections 2024-09-19T11:16:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd519c65640 1 --2- 172.21.15.37:0/2994165435 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406eaa0 0x7fd5141326d0 unknown :-1 s=CLOSED pgs=878 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd519c65640 1 -- 172.21.15.37:0/2994165435 >> 172.21.15.37:0/2994165435 conn(0x7fd51409abc0 msgr2=0x7fd514098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd519c65640 1 -- 172.21.15.37:0/2994165435 shutdown_connections 2024-09-19T11:16:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.481+0000 7fd519c65640 1 -- 172.21.15.37:0/2994165435 wait complete. 2024-09-19T11:16:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.482+0000 7fd519c65640 1 Processor -- start 2024-09-19T11:16:53.484 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.482+0000 7fd519c65640 1 -- start start 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd519c65640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406dfb0 0x7fd51406f0c0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd519c65640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7fd5140712d0 con 0x7fd51406dfb0 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd5137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406dfb0 0x7fd51406f0c0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd5137fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406dfb0 0x7fd51406f0c0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55234/0 (socket says 172.21.15.37:55234) 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd5137fe640 1 -- 172.21.15.37:0/2068783763 learned_addr learned my addr 172.21.15.37:0/2068783763 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd5137fe640 1 -- 172.21.15.37:0/2068783763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7fd514070880 con 0x7fd51406dfb0 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd5137fe640 1 --2- 172.21.15.37:0/2068783763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406dfb0 0x7fd51406f0c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c450 tx=0x7fd50400c910 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd510ff9640 1 -- 172.21.15.37:0/2068783763 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd504017070 con 0x7fd51406dfb0 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd510ff9640 1 -- 172.21.15.37:0/2068783763 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7fd504005c10 con 0x7fd51406dfb0 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd510ff9640 1 -- 172.21.15.37:0/2068783763 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7fd5040070d0 con 0x7fd51406dfb0 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7fd514070640 con 0x7fd51406dfb0 2024-09-19T11:16:53.486 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.483+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7fd51412a560 con 0x7fd51406dfb0 2024-09-19T11:16:53.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.484+0000 7fd510ff9640 1 -- 172.21.15.37:0/2068783763 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7fd50401a070 con 0x7fd51406dfb0 2024-09-19T11:16:53.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.484+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7fd5140732e0 con 0x7fd51406dfb0 2024-09-19T11:16:53.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.485+0000 7fd510ff9640 1 --2- 172.21.15.37:0/2068783763 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f403e710 0x7fd4f4040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.485+0000 7fd510ff9640 1 -- 172.21.15.37:0/2068783763 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7fd504052af0 con 0x7fd51406dfb0 2024-09-19T11:16:53.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.485+0000 7fd50bfff640 1 --2- 172.21.15.37:0/2068783763 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f403e710 0x7fd4f4040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.487 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.485+0000 7fd50bfff640 1 --2- 172.21.15.37:0/2068783763 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f403e710 0x7fd4f4040bd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc034000 tx=0x7fd4fc02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.490 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.489+0000 7fd510ff9640 1 -- 172.21.15.37:0/2068783763 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7fd5140732e0 con 0x7fd51406dfb0 2024-09-19T11:16:53.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.676+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "2", "target": ["mon-mgr", ""]}) -- 0x7fd51406e390 con 0x7fd4f403e710 2024-09-19T11:16:53.677 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.677+0000 7fd510ff9640 1 -- 172.21.15.37:0/2068783763 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 2 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7fd51406e390 con 0x7fd4f403e710 2024-09-19T11:16:53.678 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 2 to deep-scrub 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.678+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f403e710 msgr2=0x7fd4f4040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.678+0000 7fd519c65640 1 --2- 172.21.15.37:0/2068783763 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f403e710 0x7fd4f4040bd0 secure :-1 s=READY pgs=365 cs=0 l=1 rev1=1 crypto rx=0x7fd4fc034000 tx=0x7fd4fc02e000 comp rx=0 tx=0).stop 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.678+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406dfb0 msgr2=0x7fd51406f0c0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.678+0000 7fd519c65640 1 --2- 172.21.15.37:0/2068783763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406dfb0 0x7fd51406f0c0 secure :-1 s=READY pgs=879 cs=0 l=1 rev1=1 crypto rx=0x7fd50400c450 tx=0x7fd50400c910 comp rx=0 tx=0).stop 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.678+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 shutdown_connections 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.678+0000 7fd519c65640 1 --2- 172.21.15.37:0/2068783763 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7fd4f403e710 0x7fd4f4040bd0 unknown :-1 s=CLOSED pgs=365 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.678+0000 7fd519c65640 1 --2- 172.21.15.37:0/2068783763 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7fd51406dfb0 0x7fd51406f0c0 unknown :-1 s=CLOSED pgs=879 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.679+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 >> 172.21.15.37:0/2068783763 conn(0x7fd51409abc0 msgr2=0x7fd51412e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.680 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.679+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 shutdown_connections 2024-09-19T11:16:53.681 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.679+0000 7fd519c65640 1 -- 172.21.15.37:0/2068783763 wait complete. 2024-09-19T11:16:53.690 INFO:tasks.ceph:Scrubbing osd.3 2024-09-19T11:16:53.690 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph tell osd.3 config set osd_debug_deep_scrub_sleep 0 2024-09-19T11:16:53.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.796+0000 7facf0271640 1 Processor -- start 2024-09-19T11:16:53.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.796+0000 7facf0271640 1 -- start start 2024-09-19T11:16:53.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.796+0000 7facf0271640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7face806f4f0 0x7face806f8d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.796+0000 7facf0271640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7face806f0c0 con 0x7face8070b40 2024-09-19T11:16:53.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.796+0000 7facf0271640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7face8099ba0 con 0x7face806f4f0 2024-09-19T11:16:53.798 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.797+0000 7facee00d640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7face806f4f0 0x7face806f8d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.797+0000 7faced80c640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7face8070b40 0x7face812bfd0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33782/0 (socket says 172.21.15.37:33782) 2024-09-19T11:16:53.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.797+0000 7faced80c640 1 -- 172.21.15.37:0/1821066068 learned_addr learned my addr 172.21.15.37:0/1821066068 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:53.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.797+0000 7facee00d640 1 -- 172.21.15.37:0/1821066068 >> v1:172.21.15.37:6789/0 conn(0x7face8070b40 legacy=0x7face812bfd0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.797+0000 7faced00b640 1 -- 172.21.15.37:0/1821066068 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 1329034641 0 0) 0x7face806f0c0 con 0x7face8070b40 2024-09-19T11:16:53.799 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.797+0000 7facee00d640 1 -- 172.21.15.37:0/1821066068 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face80712b0 con 0x7face806f4f0 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7facee00d640 1 --2- 172.21.15.37:0/1821066068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face806f8d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7face4009720 tx=0x7face402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=893f18ddf5f9227f server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7faced00b640 1 -- 172.21.15.37:0/1821066068 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7face4037070 con 0x7face806f4f0 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7faced00b640 1 -- 172.21.15.37:0/1821066068 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face402ad90 con 0x7face806f4f0 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7faced00b640 1 -- 172.21.15.37:0/1821066068 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7face4032590 con 0x7face806f4f0 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7facf0271640 1 -- 172.21.15.37:0/1821066068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 msgr2=0x7face806f8d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7facf0271640 1 --2- 172.21.15.37:0/1821066068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face806f8d0 secure :-1 s=READY pgs=881 cs=0 l=1 rev1=1 crypto rx=0x7face4009720 tx=0x7face402a110 comp rx=0 tx=0).stop 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7facf0271640 1 -- 172.21.15.37:0/1821066068 shutdown_connections 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7facf0271640 1 --2- 172.21.15.37:0/1821066068 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face806f8d0 unknown :-1 s=CLOSED pgs=881 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.802 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7facf0271640 1 -- 172.21.15.37:0/1821066068 >> 172.21.15.37:0/1821066068 conn(0x7face809a9f0 msgr2=0x7face809ae00 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7facf0271640 1 -- 172.21.15.37:0/1821066068 shutdown_connections 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.798+0000 7facf0271640 1 -- 172.21.15.37:0/1821066068 wait complete. 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.799+0000 7facf0271640 1 Processor -- start 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.799+0000 7facf0271640 1 -- start start 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facf0271640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face81c20a0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facf0271640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7face80701a0 con 0x7face806f4f0 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facee00d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face81c20a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facee00d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face81c20a0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57386/0 (socket says 172.21.15.37:57386) 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facee00d640 1 -- 172.21.15.37:0/2422075991 learned_addr learned my addr 172.21.15.37:0/2422075991 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facee00d640 1 -- 172.21.15.37:0/2422075991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7face808ea50 con 0x7face806f4f0 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facee00d640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face81c20a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7face4035040 tx=0x7face40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.803 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7face4037040 con 0x7face806f4f0 2024-09-19T11:16:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7face4004160 con 0x7face806f4f0 2024-09-19T11:16:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7face808f4a0 con 0x7face806f4f0 2024-09-19T11:16:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7face4004440 con 0x7face806f4f0 2024-09-19T11:16:53.804 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.800+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7face81c27c0 con 0x7face806f4f0 2024-09-19T11:16:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.801+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7face4003610 con 0x7face806f4f0 2024-09-19T11:16:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.801+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_get_version(what=osdmap handle=1) -- 0x7face8073e60 con 0x7face806f4f0 2024-09-19T11:16:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.801+0000 7facdeffd640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faccc03e740 0x7faccc040c00 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.805 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.801+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7face40747c0 con 0x7face806f4f0 2024-09-19T11:16:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.802+0000 7facdeffd640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7faccc04abb0 0x7faccc04d050 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.802+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- command(tid 1: {"prefix": "get_command_descriptions"}) -- 0x7faccc04d720 con 0x7faccc04abb0 2024-09-19T11:16:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.802+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_get_version_reply(handle=1 version=37) ==== 24+0+0 (secure 0 0 0) 0x7face40792a0 con 0x7face806f4f0 2024-09-19T11:16:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.802+0000 7faced80c640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faccc03e740 0x7faccc040c00 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.802+0000 7facee80e640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7faccc04abb0 0x7faccc04d050 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.802+0000 7faced80c640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faccc03e740 0x7faccc040c00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7facd8000c00 tx=0x7facd80078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.802+0000 7facee80e640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7faccc04abb0 0x7faccc04d050 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).ready entity=osd.3 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.806 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.803+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 <== osd.3 v2:172.21.15.102:6800/3957239017 1 ==== command_reply(tid 1: 0 ) ==== 8+0+27193 (crc 0 0 0) 0x7faccc04d720 con 0x7faccc04abb0 2024-09-19T11:16:53.816 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.815+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 --> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] -- command(tid 2: {"prefix": "config set", "var": "osd_debug_deep_scrub_sleep", "val": ["0"]}) -- 0x7face808f790 con 0x7faccc04abb0 2024-09-19T11:16:53.817 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.816+0000 7facdeffd640 1 -- 172.21.15.37:0/2422075991 <== osd.3 v2:172.21.15.102:6800/3957239017 2 ==== command_reply(tid 2: 0 ) ==== 8+0+97 (crc 0 0 0) 0x7face808f790 con 0x7faccc04abb0 2024-09-19T11:16:53.818 INFO:teuthology.orchestra.run.smithi037.stdout:{ 2024-09-19T11:16:53.818 INFO:teuthology.orchestra.run.smithi037.stdout: "success": "osd_debug_deep_scrub_sleep = '' (not observed, change may require restart) " 2024-09-19T11:16:53.818 INFO:teuthology.orchestra.run.smithi037.stdout:} 2024-09-19T11:16:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7faccc04abb0 msgr2=0x7faccc04d050 crc :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7faccc04abb0 0x7faccc04d050 crc :-1 s=READY pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faccc03e740 msgr2=0x7faccc040c00 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faccc03e740 0x7faccc040c00 secure :-1 s=READY pgs=366 cs=0 l=1 rev1=1 crypto rx=0x7facd8000c00 tx=0x7facd80078f0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 msgr2=0x7face81c20a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face81c20a0 secure :-1 s=READY pgs=882 cs=0 l=1 rev1=1 crypto rx=0x7face4035040 tx=0x7face40046c0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 shutdown_connections 2024-09-19T11:16:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7faccc03e740 0x7faccc040c00 unknown :-1 s=CLOSED pgs=366 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.102:6800/3957239017,v1:172.21.15.102:6801/3957239017] conn(0x7faccc04abb0 0x7faccc04d050 unknown :-1 s=CLOSED pgs=202 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 --2- 172.21.15.37:0/2422075991 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7face806f4f0 0x7face81c20a0 unknown :-1 s=CLOSED pgs=882 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 >> 172.21.15.37:0/2422075991 conn(0x7face809a9f0 msgr2=0x7face8071f40 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 shutdown_connections 2024-09-19T11:16:53.820 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.817+0000 7facf0271640 1 -- 172.21.15.37:0/2422075991 wait complete. 2024-09-19T11:16:53.828 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph osd deep-scrub 3 2024-09-19T11:16:53.864 INFO:tasks.daemonwatchdog.daemon_watchdog:daemon ceph.rgw.client.0 has been restored 2024-09-19T11:16:53.930 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.929+0000 7f8f93647640 1 Processor -- start 2024-09-19T11:16:53.931 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.929+0000 7f8f93647640 1 -- start start 2024-09-19T11:16:53.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f93647640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f8c06eaa0 0x7f8f8c1326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f93647640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f8f8c071660 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f93647640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f8f8c072550 con 0x7f8f8c06eaa0 2024-09-19T11:16:53.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f90be2640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f8f8c06eaa0 0x7f8f8c1326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f913e3640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f8f8c06dfb0 0x7f8f8c06e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33786/0 (socket says 172.21.15.37:33786) 2024-09-19T11:16:53.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f913e3640 1 -- 172.21.15.37:0/425652282 learned_addr learned my addr 172.21.15.37:0/425652282 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:53.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f83fff640 1 -- 172.21.15.37:0/425652282 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4163859106 0 0) 0x7f8f8c071660 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.936 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f83fff640 1 -- 172.21.15.37:0/425652282 --> v1:172.21.15.37:6789/0 -- auth(proto 2 36 bytes epoch 0) -- 0x7f8f78003520 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f90be2640 1 -- 172.21.15.37:0/425652282 >> v1:172.21.15.37:6789/0 conn(0x7f8f8c06dfb0 legacy=0x7f8f8c06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.930+0000 7f8f90be2640 1 -- 172.21.15.37:0/425652282 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c099e20 con 0x7f8f8c06eaa0 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.931+0000 7f8f90be2640 1 --2- 172.21.15.37:0/425652282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06eaa0 0x7f8f8c1326d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009720 tx=0x7f8f7c02a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=a0bd18ef3a6e3427 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.931+0000 7f8f83fff640 1 -- 172.21.15.37:0/425652282 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7c037070 con 0x7f8f8c06eaa0 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.931+0000 7f8f83fff640 1 -- 172.21.15.37:0/425652282 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f7c02ae20 con 0x7f8f8c06eaa0 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.931+0000 7f8f83fff640 1 -- 172.21.15.37:0/425652282 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f7c032590 con 0x7f8f8c06eaa0 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.932+0000 7f8f93647640 1 -- 172.21.15.37:0/425652282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06eaa0 msgr2=0x7f8f8c1326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.932+0000 7f8f93647640 1 --2- 172.21.15.37:0/425652282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06eaa0 0x7f8f8c1326d0 secure :-1 s=READY pgs=884 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c009720 tx=0x7f8f7c02a1a0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.932+0000 7f8f93647640 1 -- 172.21.15.37:0/425652282 shutdown_connections 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.932+0000 7f8f93647640 1 --2- 172.21.15.37:0/425652282 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06eaa0 0x7f8f8c1326d0 unknown :-1 s=CLOSED pgs=884 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.932+0000 7f8f93647640 1 -- 172.21.15.37:0/425652282 >> 172.21.15.37:0/425652282 conn(0x7f8f8c09abc0 msgr2=0x7f8f8c098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.932+0000 7f8f93647640 1 -- 172.21.15.37:0/425652282 shutdown_connections 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.932+0000 7f8f93647640 1 -- 172.21.15.37:0/425652282 wait complete. 2024-09-19T11:16:53.937 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f93647640 1 Processor -- start 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f93647640 1 -- start start 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f93647640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06dfb0 0x7f8f8c129970 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f93647640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f8f8c0712d0 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f913e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06dfb0 0x7f8f8c129970 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f913e3640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06dfb0 0x7f8f8c129970 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57406/0 (socket says 172.21.15.37:57406) 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f913e3640 1 -- 172.21.15.37:0/1896686001 learned_addr learned my addr 172.21.15.37:0/1896686001 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f913e3640 1 -- 172.21.15.37:0/1896686001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f8f8c129530 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.933+0000 7f8f913e3640 1 --2- 172.21.15.37:0/1896686001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06dfb0 0x7f8f8c129970 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c480 tx=0x7f8f8800c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.934+0000 7f8f81ffb640 1 -- 172.21.15.37:0/1896686001 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f88017070 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.934+0000 7f8f81ffb640 1 -- 172.21.15.37:0/1896686001 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f8f88005cd0 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.934+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f8f8c127f60 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.934+0000 7f8f81ffb640 1 -- 172.21.15.37:0/1896686001 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f8f88007200 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.934+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f8f8c128fb0 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.938 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.935+0000 7f8f81ffb640 1 -- 172.21.15.37:0/1896686001 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f8f8801a070 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.935+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f8f8c126d10 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.935+0000 7f8f81ffb640 1 --2- 172.21.15.37:0/1896686001 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8f7003e710 0x7f8f70040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.935+0000 7f8f81ffb640 1 -- 172.21.15.37:0/1896686001 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f8f88052a90 con 0x7f8f8c06dfb0 2024-09-19T11:16:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.935+0000 7f8f90be2640 1 --2- 172.21.15.37:0/1896686001 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8f7003e710 0x7f8f70040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:53.939 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.936+0000 7f8f90be2640 1 --2- 172.21.15.37:0/1896686001 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8f7003e710 0x7f8f70040bd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c034000 tx=0x7f8f7c02e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:53.941 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:53.940+0000 7f8f81ffb640 1 -- 172.21.15.37:0/1896686001 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f8f8801b3b0 con 0x7f8f8c06dfb0 2024-09-19T11:16:54.129 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.128+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "osd deep-scrub", "who": "3", "target": ["mon-mgr", ""]}) -- 0x7f8f8c06e390 con 0x7f8f7003e710 2024-09-19T11:16:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.129+0000 7f8f81ffb640 1 -- 172.21.15.37:0/1896686001 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 instructed osd(s) 3 to deep-scrub) ==== 41+0+0 (secure 0 0 0) 0x7f8f8c06e390 con 0x7f8f7003e710 2024-09-19T11:16:54.130 INFO:teuthology.orchestra.run.smithi037.stderr:instructed osd(s) 3 to deep-scrub 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.131+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8f7003e710 msgr2=0x7f8f70040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.131+0000 7f8f93647640 1 --2- 172.21.15.37:0/1896686001 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8f7003e710 0x7f8f70040bd0 secure :-1 s=READY pgs=367 cs=0 l=1 rev1=1 crypto rx=0x7f8f7c034000 tx=0x7f8f7c02e000 comp rx=0 tx=0).stop 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.131+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06dfb0 msgr2=0x7f8f8c129970 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.131+0000 7f8f93647640 1 --2- 172.21.15.37:0/1896686001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06dfb0 0x7f8f8c129970 secure :-1 s=READY pgs=885 cs=0 l=1 rev1=1 crypto rx=0x7f8f8800c480 tx=0x7f8f8800c940 comp rx=0 tx=0).stop 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.132+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 shutdown_connections 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.132+0000 7f8f93647640 1 --2- 172.21.15.37:0/1896686001 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f8f7003e710 0x7f8f70040bd0 unknown :-1 s=CLOSED pgs=367 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.132+0000 7f8f93647640 1 --2- 172.21.15.37:0/1896686001 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f8f8c06dfb0 0x7f8f8c129970 unknown :-1 s=CLOSED pgs=885 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.132+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 >> 172.21.15.37:0/1896686001 conn(0x7f8f8c09abc0 msgr2=0x7f8f8c09b990 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:54.133 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.132+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 shutdown_connections 2024-09-19T11:16:54.134 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.132+0000 7f8f93647640 1 -- 172.21.15.37:0/1896686001 wait complete. 2024-09-19T11:16:54.143 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:16:54.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.243+0000 7ff943f94640 1 Processor -- start 2024-09-19T11:16:54.244 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.243+0000 7ff943f94640 1 -- start start 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.243+0000 7ff943f94640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff93c12c0b0 0x7ff93c12c490 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.243+0000 7ff943f94640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7ff93c099e20 con 0x7ff93c12c9d0 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.243+0000 7ff943f94640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7ff93c0715a0 con 0x7ff93c12c0b0 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.244+0000 7ff941d30640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7ff93c12c0b0 0x7ff93c12c490 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.244+0000 7ff94152f640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7ff93c12c9d0 0x7ff93c097100 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:33800/0 (socket says 172.21.15.37:33800) 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.244+0000 7ff94152f640 1 -- 172.21.15.37:0/2117345292 learned_addr learned my addr 172.21.15.37:0/2117345292 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.244+0000 7ff941d30640 1 -- 172.21.15.37:0/2117345292 >> v1:172.21.15.37:6789/0 conn(0x7ff93c12c9d0 legacy=0x7ff93c097100 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.244+0000 7ff940d2e640 1 -- 172.21.15.37:0/2117345292 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 3514442694 0 0) 0x7ff93c099e20 con 0x7ff93c12c9d0 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.244+0000 7ff941d30640 1 -- 172.21.15.37:0/2117345292 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c0705b0 con 0x7ff93c12c0b0 2024-09-19T11:16:54.246 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff941d30640 1 --2- 172.21.15.37:0/2117345292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c12c490 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff938009750 tx=0x7ff93802a140 comp rx=0 tx=0).ready entity=mon.0 client_cookie=859279e310b8b92c server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff940d2e640 1 -- 172.21.15.37:0/2117345292 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff938037070 con 0x7ff93c12c0b0 2024-09-19T11:16:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff940d2e640 1 -- 172.21.15.37:0/2117345292 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff93802ad80 con 0x7ff93c12c0b0 2024-09-19T11:16:54.247 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff940d2e640 1 -- 172.21.15.37:0/2117345292 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff938032590 con 0x7ff93c12c0b0 2024-09-19T11:16:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff943f94640 1 -- 172.21.15.37:0/2117345292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 msgr2=0x7ff93c12c490 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff943f94640 1 --2- 172.21.15.37:0/2117345292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c12c490 secure :-1 s=READY pgs=887 cs=0 l=1 rev1=1 crypto rx=0x7ff938009750 tx=0x7ff93802a140 comp rx=0 tx=0).stop 2024-09-19T11:16:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff943f94640 1 -- 172.21.15.37:0/2117345292 shutdown_connections 2024-09-19T11:16:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff943f94640 1 --2- 172.21.15.37:0/2117345292 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c12c490 unknown :-1 s=CLOSED pgs=887 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff943f94640 1 -- 172.21.15.37:0/2117345292 >> 172.21.15.37:0/2117345292 conn(0x7ff93c09abc0 msgr2=0x7ff93c098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff943f94640 1 -- 172.21.15.37:0/2117345292 shutdown_connections 2024-09-19T11:16:54.249 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.245+0000 7ff943f94640 1 -- 172.21.15.37:0/2117345292 wait complete. 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.246+0000 7ff943f94640 1 Processor -- start 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.246+0000 7ff943f94640 1 -- start start 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff943f94640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c1284e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff943f94640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7ff93c12ce60 con 0x7ff93c12c0b0 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff941d30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c1284e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff941d30640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c1284e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:57432/0 (socket says 172.21.15.37:57432) 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff941d30640 1 -- 172.21.15.37:0/2203672079 learned_addr learned my addr 172.21.15.37:0/2203672079 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff941d30640 1 -- 172.21.15.37:0/2203672079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7ff93c08dd80 con 0x7ff93c12c0b0 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff941d30640 1 --2- 172.21.15.37:0/2203672079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c1284e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff938035040 tx=0x7ff9380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff9327fc640 1 -- 172.21.15.37:0/2203672079 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff938037040 con 0x7ff93c12c0b0 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff9327fc640 1 -- 172.21.15.37:0/2203672079 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7ff938004030 con 0x7ff93c12c0b0 2024-09-19T11:16:54.250 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7ff93c08da50 con 0x7ff93c12c0b0 2024-09-19T11:16:54.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff9327fc640 1 -- 172.21.15.37:0/2203672079 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7ff938004310 con 0x7ff93c12c0b0 2024-09-19T11:16:54.251 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.247+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7ff93c08d160 con 0x7ff93c12c0b0 2024-09-19T11:16:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.248+0000 7ff9327fc640 1 -- 172.21.15.37:0/2203672079 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7ff93803a040 con 0x7ff93c12c0b0 2024-09-19T11:16:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.248+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7ff93c097df0 con 0x7ff93c12c0b0 2024-09-19T11:16:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.248+0000 7ff9327fc640 1 --2- 172.21.15.37:0/2203672079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff92003e710 0x7ff920040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:16:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.249+0000 7ff9327fc640 1 -- 172.21.15.37:0/2203672079 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7ff9380741b0 con 0x7ff93c12c0b0 2024-09-19T11:16:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.249+0000 7ff94152f640 1 --2- 172.21.15.37:0/2203672079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff92003e710 0x7ff920040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:16:54.252 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.249+0000 7ff94152f640 1 --2- 172.21.15.37:0/2203672079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff92003e710 0x7ff920040bd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff92c000c00 tx=0x7ff92c0078d0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:16:54.254 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.253+0000 7ff9327fc640 1 -- 172.21.15.37:0/2203672079 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7ff938042020 con 0x7ff93c12c0b0 2024-09-19T11:16:54.436 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.434+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7ff93c08cca0 con 0x7ff92003e710 2024-09-19T11:16:54.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.445+0000 7ff9327fc640 1 -- 172.21.15.37:0/2203672079 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666036 (secure 0 0 0) 0x7ff93c08cca0 con 0x7ff92003e710 2024-09-19T11:16:54.453 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:16:54.458 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:16:54.460 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff92003e710 msgr2=0x7ff920040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 --2- 172.21.15.37:0/2203672079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff92003e710 0x7ff920040bd0 secure :-1 s=READY pgs=368 cs=0 l=1 rev1=1 crypto rx=0x7ff92c000c00 tx=0x7ff92c0078d0 comp rx=0 tx=0).stop 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 msgr2=0x7ff93c1284e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 --2- 172.21.15.37:0/2203672079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c1284e0 secure :-1 s=READY pgs=888 cs=0 l=1 rev1=1 crypto rx=0x7ff938035040 tx=0x7ff9380046c0 comp rx=0 tx=0).stop 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 shutdown_connections 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 --2- 172.21.15.37:0/2203672079 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7ff92003e710 0x7ff920040bd0 unknown :-1 s=CLOSED pgs=368 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 --2- 172.21.15.37:0/2203672079 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7ff93c12c0b0 0x7ff93c1284e0 unknown :-1 s=CLOSED pgs=888 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 >> 172.21.15.37:0/2203672079 conn(0x7ff93c09abc0 msgr2=0x7ff93c09c900 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 shutdown_connections 2024-09-19T11:16:54.461 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:16:54.450+0000 7ff943f94640 1 -- 172.21.15.37:0/2203672079 wait complete. 2024-09-19T11:16:54.462 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":145,"stamp":"2024-09-19T11:16:52.580803+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":18034786,"num_objects":227,"num_object_clones":0,"num_object_copies":464,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":227,"num_whiteouts":0,"num_read":5018,"num_read_kb":4565,"num_write":2070,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4469,"ondisk_log_size":4469,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":182168,"kb_used_data":36632,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377305192,"statfs":{"total":386547056640,"available":386360516608,"internally_reserved":0,"allocated":37511168,"data_stored":36247610,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":17433657,"num_objects":7,"num_object_clones":0,"num_object_copies":24,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":599,"num_read_kb":551,"num_write":406,"num_write_kb":29375,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.009174"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.894957+0000","last_change":"2024-09-19T11:13:31.355447+0000","last_active":"2024-09-19T11:15:41.894957+0000","last_peered":"2024-09-19T11:15:41.894957+0000","last_clean":"2024-09-19T11:15:41.894957+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:15:41.894957+0000","last_undegraded":"2024-09-19T11:15:41.894957+0000","last_fullsized":"2024-09-19T11:15:41.894957+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:32:10.862799+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114848+0000","last_change":"2024-09-19T11:13:33.358262+0000","last_active":"2024-09-19T11:14:58.114848+0000","last_peered":"2024-09-19T11:14:58.114848+0000","last_clean":"2024-09-19T11:14:58.114848+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:14:58.114848+0000","last_undegraded":"2024-09-19T11:14:58.114848+0000","last_fullsized":"2024-09-19T11:14:58.114848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:04.357110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589370+0000","last_change":"2024-09-19T11:13:31.378145+0000","last_active":"2024-09-19T11:14:07.589370+0000","last_peered":"2024-09-19T11:14:07.589370+0000","last_clean":"2024-09-19T11:14:07.589370+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:14:07.589370+0000","last_undegraded":"2024-09-19T11:14:07.589370+0000","last_fullsized":"2024-09-19T11:14:07.589370+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:25:12.937182+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.010386+0000","last_change":"2024-09-19T11:13:33.353250+0000","last_active":"2024-09-19T11:16:43.010386+0000","last_peered":"2024-09-19T11:16:43.010386+0000","last_clean":"2024-09-19T11:16:43.010386+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:16:43.010386+0000","last_undegraded":"2024-09-19T11:16:43.010386+0000","last_fullsized":"2024-09-19T11:16:43.010386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:36.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588134+0000","last_change":"2024-09-19T11:13:31.373399+0000","last_active":"2024-09-19T11:14:07.588134+0000","last_peered":"2024-09-19T11:14:07.588134+0000","last_clean":"2024-09-19T11:14:07.588134+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:14:07.588134+0000","last_undegraded":"2024-09-19T11:14:07.588134+0000","last_fullsized":"2024-09-19T11:14:07.588134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:37.878601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740541+0000","last_change":"2024-09-19T11:14:07.595868+0000","last_active":"2024-09-19T11:16:42.740541+0000","last_peered":"2024-09-19T11:16:42.740541+0000","last_clean":"2024-09-19T11:16:42.740541+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:16:42.740541+0000","last_undegraded":"2024-09-19T11:16:42.740541+0000","last_fullsized":"2024-09-19T11:16:42.740541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:59.387595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588085+0000","last_change":"2024-09-19T11:13:31.369527+0000","last_active":"2024-09-19T11:14:07.588085+0000","last_peered":"2024-09-19T11:14:07.588085+0000","last_clean":"2024-09-19T11:14:07.588085+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:14:07.588085+0000","last_undegraded":"2024-09-19T11:14:07.588085+0000","last_fullsized":"2024-09-19T11:14:07.588085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:42.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.965800+0000","last_change":"2024-09-19T11:13:33.349816+0000","last_active":"2024-09-19T11:16:42.965800+0000","last_peered":"2024-09-19T11:16:42.965800+0000","last_clean":"2024-09-19T11:16:42.965800+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:16:42.965800+0000","last_undegraded":"2024-09-19T11:16:42.965800+0000","last_fullsized":"2024-09-19T11:16:42.965800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:57.078087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586339+0000","last_change":"2024-09-19T11:13:31.373460+0000","last_active":"2024-09-19T11:14:07.586339+0000","last_peered":"2024-09-19T11:14:07.586339+0000","last_clean":"2024-09-19T11:14:07.586339+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:14:07.586339+0000","last_undegraded":"2024-09-19T11:14:07.586339+0000","last_fullsized":"2024-09-19T11:14:07.586339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:25.708826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003992+0000","last_change":"2024-09-19T11:13:33.347020+0000","last_active":"2024-09-19T11:16:43.003992+0000","last_peered":"2024-09-19T11:16:43.003992+0000","last_clean":"2024-09-19T11:16:43.003992+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:16:43.003992+0000","last_undegraded":"2024-09-19T11:16:43.003992+0000","last_fullsized":"2024-09-19T11:16:43.003992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:10.234097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588864+0000","last_change":"2024-09-19T11:13:31.359276+0000","last_active":"2024-09-19T11:14:07.588864+0000","last_peered":"2024-09-19T11:14:07.588864+0000","last_clean":"2024-09-19T11:14:07.588864+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:14:07.588864+0000","last_undegraded":"2024-09-19T11:14:07.588864+0000","last_fullsized":"2024-09-19T11:14:07.588864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.682041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'21","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:13.543344+0000","last_change":"2024-09-19T11:14:07.607174+0000","last_active":"2024-09-19T11:16:13.543344+0000","last_peered":"2024-09-19T11:16:13.543344+0000","last_clean":"2024-09-19T11:16:13.543344+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:16:13.543344+0000","last_undegraded":"2024-09-19T11:16:13.543344+0000","last_fullsized":"2024-09-19T11:16:13.543344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:02.443641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585495+0000","last_change":"2024-09-19T11:13:31.366931+0000","last_active":"2024-09-19T11:14:07.585495+0000","last_peered":"2024-09-19T11:14:07.585495+0000","last_clean":"2024-09-19T11:14:07.585495+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:14:07.585495+0000","last_undegraded":"2024-09-19T11:14:07.585495+0000","last_fullsized":"2024-09-19T11:14:07.585495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:34.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966174+0000","last_change":"2024-09-19T11:13:33.347406+0000","last_active":"2024-09-19T11:16:42.966174+0000","last_peered":"2024-09-19T11:16:42.966174+0000","last_clean":"2024-09-19T11:16:42.966174+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:16:42.966174+0000","last_undegraded":"2024-09-19T11:16:42.966174+0000","last_fullsized":"2024-09-19T11:16:42.966174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:53.972293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.853085+0000","last_change":"2024-09-19T11:13:31.364605+0000","last_active":"2024-09-19T11:15:41.853085+0000","last_peered":"2024-09-19T11:15:41.853085+0000","last_clean":"2024-09-19T11:15:41.853085+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:15:41.853085+0000","last_undegraded":"2024-09-19T11:15:41.853085+0000","last_fullsized":"2024-09-19T11:15:41.853085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:22:34.677119+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:13:33.353995+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:03.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096691+0000","last_change":"2024-09-19T11:13:33.353058+0000","last_active":"2024-09-19T11:15:42.096691+0000","last_peered":"2024-09-19T11:15:42.096691+0000","last_clean":"2024-09-19T11:15:42.096691+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:15:42.096691+0000","last_undegraded":"2024-09-19T11:15:42.096691+0000","last_fullsized":"2024-09-19T11:15:42.096691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:02.922700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.597092+0000","last_change":"2024-09-19T11:13:31.365956+0000","last_active":"2024-09-19T11:14:07.597092+0000","last_peered":"2024-09-19T11:14:07.597092+0000","last_clean":"2024-09-19T11:14:07.597092+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:14:07.597092+0000","last_undegraded":"2024-09-19T11:14:07.597092+0000","last_fullsized":"2024-09-19T11:14:07.597092+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:41.205308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594343+0000","last_change":"2024-09-19T11:13:33.357169+0000","last_active":"2024-09-19T11:14:07.594343+0000","last_peered":"2024-09-19T11:14:07.594343+0000","last_clean":"2024-09-19T11:14:07.594343+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:14:07.594343+0000","last_undegraded":"2024-09-19T11:14:07.594343+0000","last_fullsized":"2024-09-19T11:14:07.594343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'3","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.541252+0000","last_change":"2024-09-19T11:13:31.372373+0000","last_active":"2024-09-19T11:15:58.541252+0000","last_peered":"2024-09-19T11:15:58.541252+0000","last_clean":"2024-09-19T11:15:58.541252+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:15:58.541252+0000","last_undegraded":"2024-09-19T11:15:58.541252+0000","last_fullsized":"2024-09-19T11:15:58.541252+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.073704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":3,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595274+0000","last_change":"2024-09-19T11:13:33.359507+0000","last_active":"2024-09-19T11:14:07.595274+0000","last_peered":"2024-09-19T11:14:07.595274+0000","last_clean":"2024-09-19T11:14:07.595274+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:14:07.595274+0000","last_undegraded":"2024-09-19T11:14:07.595274+0000","last_fullsized":"2024-09-19T11:14:07.595274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.272518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.103060+0000","last_change":"2024-09-19T11:13:31.365136+0000","last_active":"2024-09-19T11:14:58.103060+0000","last_peered":"2024-09-19T11:14:58.103060+0000","last_clean":"2024-09-19T11:14:58.103060+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:14:58.103060+0000","last_undegraded":"2024-09-19T11:14:58.103060+0000","last_fullsized":"2024-09-19T11:14:58.103060+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:21:29.682041+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966073+0000","last_change":"2024-09-19T11:13:33.350242+0000","last_active":"2024-09-19T11:16:42.966073+0000","last_peered":"2024-09-19T11:16:42.966073+0000","last_clean":"2024-09-19T11:16:42.966073+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:16:42.966073+0000","last_undegraded":"2024-09-19T11:16:42.966073+0000","last_fullsized":"2024-09-19T11:16:42.966073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:29.796543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595616+0000","last_change":"2024-09-19T11:13:31.364143+0000","last_active":"2024-09-19T11:14:07.595616+0000","last_peered":"2024-09-19T11:14:07.595616+0000","last_clean":"2024-09-19T11:14:07.595616+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:14:07.595616+0000","last_undegraded":"2024-09-19T11:14:07.595616+0000","last_fullsized":"2024-09-19T11:14:07.595616+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:04:37.328576+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004192+0000","last_change":"2024-09-19T11:13:33.354404+0000","last_active":"2024-09-19T11:16:43.004192+0000","last_peered":"2024-09-19T11:16:43.004192+0000","last_clean":"2024-09-19T11:16:43.004192+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:16:43.004192+0000","last_undegraded":"2024-09-19T11:16:43.004192+0000","last_fullsized":"2024-09-19T11:16:43.004192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.704309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.524833+0000","last_change":"2024-09-19T11:13:31.379619+0000","last_active":"2024-09-19T11:14:14.524833+0000","last_peered":"2024-09-19T11:14:14.524833+0000","last_clean":"2024-09-19T11:14:14.524833+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:14:14.524833+0000","last_undegraded":"2024-09-19T11:14:14.524833+0000","last_fullsized":"2024-09-19T11:14:14.524833+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:44.219899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380970+0000","last_change":"2024-09-19T11:13:33.345480+0000","last_active":"2024-09-19T11:14:15.380970+0000","last_peered":"2024-09-19T11:14:15.380970+0000","last_clean":"2024-09-19T11:14:15.380970+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:14:15.380970+0000","last_undegraded":"2024-09-19T11:14:15.380970+0000","last_fullsized":"2024-09-19T11:14:15.380970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:37.629627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585477+0000","last_change":"2024-09-19T11:13:31.368987+0000","last_active":"2024-09-19T11:14:07.585477+0000","last_peered":"2024-09-19T11:14:07.585477+0000","last_clean":"2024-09-19T11:14:07.585477+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:14:07.585477+0000","last_undegraded":"2024-09-19T11:14:07.585477+0000","last_fullsized":"2024-09-19T11:14:07.585477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:51.462004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.938013+0000","last_change":"2024-09-19T11:13:41.395109+0000","last_active":"2024-09-19T11:16:42.938013+0000","last_peered":"2024-09-19T11:16:42.938013+0000","last_clean":"2024-09-19T11:16:42.938013+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:16:42.938013+0000","last_undegraded":"2024-09-19T11:16:42.938013+0000","last_fullsized":"2024-09-19T11:16:42.938013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:41.943528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.635691+0000","last_change":"2024-09-19T11:13:33.348565+0000","last_active":"2024-09-19T11:16:42.635691+0000","last_peered":"2024-09-19T11:16:42.635691+0000","last_clean":"2024-09-19T11:16:42.635691+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:16:42.635691+0000","last_undegraded":"2024-09-19T11:16:42.635691+0000","last_fullsized":"2024-09-19T11:16:42.635691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:09.744080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585089+0000","last_change":"2024-09-19T11:13:31.378052+0000","last_active":"2024-09-19T11:14:07.585089+0000","last_peered":"2024-09-19T11:14:07.585089+0000","last_clean":"2024-09-19T11:14:07.585089+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:14:07.585089+0000","last_undegraded":"2024-09-19T11:14:07.585089+0000","last_fullsized":"2024-09-19T11:14:07.585089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:57.883105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586243+0000","last_change":"2024-09-19T11:13:35.358078+0000","last_active":"2024-09-19T11:14:07.586243+0000","last_peered":"2024-09-19T11:14:07.586243+0000","last_clean":"2024-09-19T11:14:07.586243+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:14:07.586243+0000","last_undegraded":"2024-09-19T11:14:07.586243+0000","last_fullsized":"2024-09-19T11:14:07.586243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:59.783214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.344946+0000","last_change":"2024-09-19T11:13:37.368405+0000","last_active":"2024-09-19T11:15:40.344946+0000","last_peered":"2024-09-19T11:15:40.344946+0000","last_clean":"2024-09-19T11:15:40.344946+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:15:40.344946+0000","last_undegraded":"2024-09-19T11:15:40.344946+0000","last_fullsized":"2024-09-19T11:15:40.344946+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:09.867739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596623+0000","last_change":"2024-09-19T11:13:39.376399+0000","last_active":"2024-09-19T11:14:07.596623+0000","last_peered":"2024-09-19T11:14:07.596623+0000","last_clean":"2024-09-19T11:14:07.596623+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:14:07.596623+0000","last_undegraded":"2024-09-19T11:14:07.596623+0000","last_fullsized":"2024-09-19T11:14:07.596623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:16.668274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.935993+0000","last_change":"2024-09-19T11:13:41.393295+0000","last_active":"2024-09-19T11:14:57.935993+0000","last_peered":"2024-09-19T11:14:57.935993+0000","last_clean":"2024-09-19T11:14:57.935993+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:14:57.935993+0000","last_undegraded":"2024-09-19T11:14:57.935993+0000","last_fullsized":"2024-09-19T11:14:57.935993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:48.199857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112515+0000","last_change":"2024-09-19T11:13:33.353288+0000","last_active":"2024-09-19T11:14:58.112515+0000","last_peered":"2024-09-19T11:14:58.112515+0000","last_clean":"2024-09-19T11:14:58.112515+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:14:58.112515+0000","last_undegraded":"2024-09-19T11:14:58.112515+0000","last_fullsized":"2024-09-19T11:14:58.112515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.684931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.037595+0000","last_change":"2024-09-19T11:13:31.359853+0000","last_active":"2024-09-19T11:15:42.037595+0000","last_peered":"2024-09-19T11:15:42.037595+0000","last_clean":"2024-09-19T11:15:42.037595+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:15:42.037595+0000","last_undegraded":"2024-09-19T11:15:42.037595+0000","last_fullsized":"2024-09-19T11:15:42.037595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:35.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586880+0000","last_change":"2024-09-19T11:13:35.350079+0000","last_active":"2024-09-19T11:14:07.586880+0000","last_peered":"2024-09-19T11:14:07.586880+0000","last_clean":"2024-09-19T11:14:07.586880+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:14:07.586880+0000","last_undegraded":"2024-09-19T11:14:07.586880+0000","last_fullsized":"2024-09-19T11:14:07.586880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:28.629336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596198+0000","last_change":"2024-09-19T11:13:37.365209+0000","last_active":"2024-09-19T11:14:07.596198+0000","last_peered":"2024-09-19T11:14:07.596198+0000","last_clean":"2024-09-19T11:14:07.596198+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:14:07.596198+0000","last_undegraded":"2024-09-19T11:14:07.596198+0000","last_fullsized":"2024-09-19T11:14:07.596198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:11.593458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595746+0000","last_change":"2024-09-19T11:13:39.377776+0000","last_active":"2024-09-19T11:14:07.595746+0000","last_peered":"2024-09-19T11:14:07.595746+0000","last_clean":"2024-09-19T11:14:07.595746+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:14:07.595746+0000","last_undegraded":"2024-09-19T11:14:07.595746+0000","last_fullsized":"2024-09-19T11:14:07.595746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:02.688553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586216+0000","last_change":"2024-09-19T11:13:41.387845+0000","last_active":"2024-09-19T11:14:07.586216+0000","last_peered":"2024-09-19T11:14:07.586216+0000","last_clean":"2024-09-19T11:14:07.586216+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:14:07.586216+0000","last_undegraded":"2024-09-19T11:14:07.586216+0000","last_fullsized":"2024-09-19T11:14:07.586216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:01.782452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004066+0000","last_change":"2024-09-19T11:13:33.354310+0000","last_active":"2024-09-19T11:16:43.004066+0000","last_peered":"2024-09-19T11:16:43.004066+0000","last_clean":"2024-09-19T11:16:43.004066+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:16:43.004066+0000","last_undegraded":"2024-09-19T11:16:43.004066+0000","last_fullsized":"2024-09-19T11:16:43.004066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.803193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584449+0000","last_change":"2024-09-19T11:13:31.367163+0000","last_active":"2024-09-19T11:14:07.584449+0000","last_peered":"2024-09-19T11:14:07.584449+0000","last_clean":"2024-09-19T11:14:07.584449+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:14:07.584449+0000","last_undegraded":"2024-09-19T11:14:07.584449+0000","last_fullsized":"2024-09-19T11:14:07.584449+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:05.930286+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:08.524886+0000","last_change":"2024-09-19T11:14:07.594305+0000","last_active":"2024-09-19T11:14:08.524886+0000","last_peered":"2024-09-19T11:14:08.524886+0000","last_clean":"2024-09-19T11:14:08.524886+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:14:08.524886+0000","last_undegraded":"2024-09-19T11:14:08.524886+0000","last_fullsized":"2024-09-19T11:14:08.524886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:34.741293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587760+0000","last_change":"2024-09-19T11:13:37.365423+0000","last_active":"2024-09-19T11:14:07.587760+0000","last_peered":"2024-09-19T11:14:07.587760+0000","last_clean":"2024-09-19T11:14:07.587760+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:14:07.587760+0000","last_undegraded":"2024-09-19T11:14:07.587760+0000","last_fullsized":"2024-09-19T11:14:07.587760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:05.026614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'282","reported_seq":382,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437367+0000","last_change":"2024-09-19T11:13:39.380724+0000","last_active":"2024-09-19T11:16:40.437367+0000","last_peered":"2024-09-19T11:16:40.437367+0000","last_clean":"2024-09-19T11:16:40.437367+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:16:40.437367+0000","last_undegraded":"2024-09-19T11:16:40.437367+0000","last_fullsized":"2024-09-19T11:16:40.437367+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587647+0000","last_change":"2024-09-19T11:13:41.387332+0000","last_active":"2024-09-19T11:14:07.587647+0000","last_peered":"2024-09-19T11:14:07.587647+0000","last_clean":"2024-09-19T11:14:07.587647+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:14:07.587647+0000","last_undegraded":"2024-09-19T11:14:07.587647+0000","last_fullsized":"2024-09-19T11:14:07.587647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:45.206952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740577+0000","last_change":"2024-09-19T11:13:33.349800+0000","last_active":"2024-09-19T11:16:42.740577+0000","last_peered":"2024-09-19T11:16:42.740577+0000","last_clean":"2024-09-19T11:16:42.740577+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:16:42.740577+0000","last_undegraded":"2024-09-19T11:16:42.740577+0000","last_fullsized":"2024-09-19T11:16:42.740577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.241186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.999172+0000","last_change":"2024-09-19T11:13:31.365771+0000","last_active":"2024-09-19T11:16:42.999172+0000","last_peered":"2024-09-19T11:16:42.999172+0000","last_clean":"2024-09-19T11:16:42.999172+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:42.999172+0000","last_undegraded":"2024-09-19T11:16:42.999172+0000","last_fullsized":"2024-09-19T11:16:42.999172+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:03.270284+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586260+0000","last_change":"2024-09-19T11:13:35.355473+0000","last_active":"2024-09-19T11:14:07.586260+0000","last_peered":"2024-09-19T11:14:07.586260+0000","last_clean":"2024-09-19T11:14:07.586260+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:14:07.586260+0000","last_undegraded":"2024-09-19T11:14:07.586260+0000","last_fullsized":"2024-09-19T11:14:07.586260+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:26.695828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.339270+0000","last_change":"2024-09-19T11:13:37.367406+0000","last_active":"2024-09-19T11:15:40.339270+0000","last_peered":"2024-09-19T11:15:40.339270+0000","last_clean":"2024-09-19T11:15:40.339270+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:15:40.339270+0000","last_undegraded":"2024-09-19T11:15:40.339270+0000","last_fullsized":"2024-09-19T11:15:40.339270+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.650159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":445,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.719611+0000","last_change":"2024-09-19T11:13:39.380575+0000","last_active":"2024-09-19T11:16:49.719611+0000","last_peered":"2024-09-19T11:16:49.719611+0000","last_clean":"2024-09-19T11:16:49.719611+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:16:49.719611+0000","last_undegraded":"2024-09-19T11:16:49.719611+0000","last_fullsized":"2024-09-19T11:16:49.719611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:21.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898938+0000","last_change":"2024-09-19T11:13:33.354325+0000","last_active":"2024-09-19T11:16:42.898938+0000","last_peered":"2024-09-19T11:16:42.898938+0000","last_clean":"2024-09-19T11:16:42.898938+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:16:42.898938+0000","last_undegraded":"2024-09-19T11:16:42.898938+0000","last_fullsized":"2024-09-19T11:16:42.898938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:50.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.591224+0000","last_change":"2024-09-19T11:13:31.353600+0000","last_active":"2024-09-19T11:14:07.591224+0000","last_peered":"2024-09-19T11:14:07.591224+0000","last_clean":"2024-09-19T11:14:07.591224+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:14:07.591224+0000","last_undegraded":"2024-09-19T11:14:07.591224+0000","last_fullsized":"2024-09-19T11:14:07.591224+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:09.178158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593431+0000","last_change":"2024-09-19T11:13:35.356693+0000","last_active":"2024-09-19T11:14:07.593431+0000","last_peered":"2024-09-19T11:14:07.593431+0000","last_clean":"2024-09-19T11:14:07.593431+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:14:07.593431+0000","last_undegraded":"2024-09-19T11:14:07.593431+0000","last_fullsized":"2024-09-19T11:14:07.593431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:50.222469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'40","reported_seq":88,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.348918+0000","last_change":"2024-09-19T11:13:37.371444+0000","last_active":"2024-09-19T11:15:40.348918+0000","last_peered":"2024-09-19T11:15:40.348918+0000","last_clean":"2024-09-19T11:15:40.348918+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:15:40.348918+0000","last_undegraded":"2024-09-19T11:15:40.348918+0000","last_fullsized":"2024-09-19T11:15:40.348918+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:45.830373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":44,"num_read_kb":33,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587567+0000","last_change":"2024-09-19T11:13:39.374414+0000","last_active":"2024-09-19T11:14:07.587567+0000","last_peered":"2024-09-19T11:14:07.587567+0000","last_clean":"2024-09-19T11:14:07.587567+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:14:07.587567+0000","last_undegraded":"2024-09-19T11:14:07.587567+0000","last_fullsized":"2024-09-19T11:14:07.587567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:56.581253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.937677+0000","last_change":"2024-09-19T11:13:41.391613+0000","last_active":"2024-09-19T11:14:57.937677+0000","last_peered":"2024-09-19T11:14:57.937677+0000","last_clean":"2024-09-19T11:14:57.937677+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:14:57.937677+0000","last_undegraded":"2024-09-19T11:14:57.937677+0000","last_fullsized":"2024-09-19T11:14:57.937677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:05.344146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740320+0000","last_change":"2024-09-19T11:13:33.342412+0000","last_active":"2024-09-19T11:16:42.740320+0000","last_peered":"2024-09-19T11:16:42.740320+0000","last_clean":"2024-09-19T11:16:42.740320+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:16:42.740320+0000","last_undegraded":"2024-09-19T11:16:42.740320+0000","last_fullsized":"2024-09-19T11:16:42.740320+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590222+0000","last_change":"2024-09-19T11:13:31.355731+0000","last_active":"2024-09-19T11:14:07.590222+0000","last_peered":"2024-09-19T11:14:07.590222+0000","last_clean":"2024-09-19T11:14:07.590222+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:14:07.590222+0000","last_undegraded":"2024-09-19T11:14:07.590222+0000","last_fullsized":"2024-09-19T11:14:07.590222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:16:05.006192+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586420+0000","last_change":"2024-09-19T11:13:35.352067+0000","last_active":"2024-09-19T11:14:07.586420+0000","last_peered":"2024-09-19T11:14:07.586420+0000","last_clean":"2024-09-19T11:14:07.586420+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:14:07.586420+0000","last_undegraded":"2024-09-19T11:14:07.586420+0000","last_fullsized":"2024-09-19T11:14:07.586420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:58.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.329228+0000","last_change":"2024-09-19T11:13:37.369761+0000","last_active":"2024-09-19T11:15:40.329228+0000","last_peered":"2024-09-19T11:15:40.329228+0000","last_clean":"2024-09-19T11:15:40.329228+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:15:40.329228+0000","last_undegraded":"2024-09-19T11:15:40.329228+0000","last_fullsized":"2024-09-19T11:15:40.329228+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.455607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587463+0000","last_change":"2024-09-19T11:13:39.381205+0000","last_active":"2024-09-19T11:14:07.587463+0000","last_peered":"2024-09-19T11:14:07.587463+0000","last_clean":"2024-09-19T11:14:07.587463+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:14:07.587463+0000","last_undegraded":"2024-09-19T11:14:07.587463+0000","last_fullsized":"2024-09-19T11:14:07.587463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:48.612042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:52.381729+0000","last_change":"2024-09-19T11:13:41.393002+0000","last_active":"2024-09-19T11:14:52.381729+0000","last_peered":"2024-09-19T11:14:52.381729+0000","last_clean":"2024-09-19T11:14:52.381729+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:14:52.381729+0000","last_undegraded":"2024-09-19T11:14:52.381729+0000","last_fullsized":"2024-09-19T11:14:52.381729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:23.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115156+0000","last_change":"2024-09-19T11:13:33.351582+0000","last_active":"2024-09-19T11:14:58.115156+0000","last_peered":"2024-09-19T11:14:58.115156+0000","last_clean":"2024-09-19T11:14:58.115156+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:14:58.115156+0000","last_undegraded":"2024-09-19T11:14:58.115156+0000","last_fullsized":"2024-09-19T11:14:58.115156+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587814+0000","last_change":"2024-09-19T11:13:31.376937+0000","last_active":"2024-09-19T11:14:07.587814+0000","last_peered":"2024-09-19T11:14:07.587814+0000","last_clean":"2024-09-19T11:14:07.587814+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:14:07.587814+0000","last_undegraded":"2024-09-19T11:14:07.587814+0000","last_fullsized":"2024-09-19T11:14:07.587814+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:00.098524+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587259+0000","last_change":"2024-09-19T11:13:35.349926+0000","last_active":"2024-09-19T11:14:07.587259+0000","last_peered":"2024-09-19T11:14:07.587259+0000","last_clean":"2024-09-19T11:14:07.587259+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:14:07.587259+0000","last_undegraded":"2024-09-19T11:14:07.587259+0000","last_fullsized":"2024-09-19T11:14:07.587259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:43.037527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'37","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540038+0000","last_change":"2024-09-19T11:13:37.371294+0000","last_active":"2024-09-19T11:15:48.540038+0000","last_peered":"2024-09-19T11:15:48.540038+0000","last_clean":"2024-09-19T11:15:48.540038+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:15:48.540038+0000","last_undegraded":"2024-09-19T11:15:48.540038+0000","last_fullsized":"2024-09-19T11:15:48.540038+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:44.761683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":352,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.720874+0000","last_change":"2024-09-19T11:13:39.381485+0000","last_active":"2024-09-19T11:16:49.720874+0000","last_peered":"2024-09-19T11:16:49.720874+0000","last_clean":"2024-09-19T11:16:49.720874+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:16:49.720874+0000","last_undegraded":"2024-09-19T11:16:49.720874+0000","last_fullsized":"2024-09-19T11:16:49.720874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:13.407016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.028397+0000","last_change":"2024-09-19T11:13:41.390450+0000","last_active":"2024-09-19T11:14:15.028397+0000","last_peered":"2024-09-19T11:14:15.028397+0000","last_clean":"2024-09-19T11:14:15.028397+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:14:15.028397+0000","last_undegraded":"2024-09-19T11:14:15.028397+0000","last_fullsized":"2024-09-19T11:14:15.028397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.925221+0000","last_change":"2024-09-19T11:13:33.346907+0000","last_active":"2024-09-19T11:14:57.925221+0000","last_peered":"2024-09-19T11:14:57.925221+0000","last_clean":"2024-09-19T11:14:57.925221+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:14:57.925221+0000","last_undegraded":"2024-09-19T11:14:57.925221+0000","last_fullsized":"2024-09-19T11:14:57.925221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:42:38.606989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585782+0000","last_change":"2024-09-19T11:13:31.373736+0000","last_active":"2024-09-19T11:14:07.585782+0000","last_peered":"2024-09-19T11:14:07.585782+0000","last_clean":"2024-09-19T11:14:07.585782+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:14:07.585782+0000","last_undegraded":"2024-09-19T11:14:07.585782+0000","last_fullsized":"2024-09-19T11:14:07.585782+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:35.619254+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586467+0000","last_change":"2024-09-19T11:13:35.353930+0000","last_active":"2024-09-19T11:14:07.586467+0000","last_peered":"2024-09-19T11:14:07.586467+0000","last_clean":"2024-09-19T11:14:07.586467+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:14:07.586467+0000","last_undegraded":"2024-09-19T11:14:07.586467+0000","last_fullsized":"2024-09-19T11:14:07.586467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:50.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'55","reported_seq":112,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.352655+0000","last_change":"2024-09-19T11:13:37.371428+0000","last_active":"2024-09-19T11:15:40.352655+0000","last_peered":"2024-09-19T11:15:40.352655+0000","last_clean":"2024-09-19T11:15:40.352655+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:15:40.352655+0000","last_undegraded":"2024-09-19T11:15:40.352655+0000","last_fullsized":"2024-09-19T11:15:40.352655+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":55,"log_dups_size":0,"ondisk_log_size":55,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:11.185147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":49,"num_read_kb":40,"num_write":18,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586195+0000","last_change":"2024-09-19T11:13:39.369302+0000","last_active":"2024-09-19T11:14:07.586195+0000","last_peered":"2024-09-19T11:14:07.586195+0000","last_clean":"2024-09-19T11:14:07.586195+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:14:07.586195+0000","last_undegraded":"2024-09-19T11:14:07.586195+0000","last_fullsized":"2024-09-19T11:14:07.586195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:58.150298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.223256+0000","last_change":"2024-09-19T11:13:41.385457+0000","last_active":"2024-09-19T11:16:43.223256+0000","last_peered":"2024-09-19T11:16:43.223256+0000","last_clean":"2024-09-19T11:16:43.223256+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:16:43.223256+0000","last_undegraded":"2024-09-19T11:16:43.223256+0000","last_fullsized":"2024-09-19T11:16:43.223256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:04.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740486+0000","last_change":"2024-09-19T11:13:33.354021+0000","last_active":"2024-09-19T11:16:42.740486+0000","last_peered":"2024-09-19T11:16:42.740486+0000","last_clean":"2024-09-19T11:16:42.740486+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:16:42.740486+0000","last_undegraded":"2024-09-19T11:16:42.740486+0000","last_fullsized":"2024-09-19T11:16:42.740486+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:06.071580+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587381+0000","last_change":"2024-09-19T11:13:31.378149+0000","last_active":"2024-09-19T11:14:07.587381+0000","last_peered":"2024-09-19T11:14:07.587381+0000","last_clean":"2024-09-19T11:14:07.587381+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:14:07.587381+0000","last_undegraded":"2024-09-19T11:14:07.587381+0000","last_fullsized":"2024-09-19T11:14:07.587381+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:54.799765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589532+0000","last_change":"2024-09-19T11:13:35.359219+0000","last_active":"2024-09-19T11:14:07.589532+0000","last_peered":"2024-09-19T11:14:07.589532+0000","last_clean":"2024-09-19T11:14:07.589532+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:14:07.589532+0000","last_undegraded":"2024-09-19T11:14:07.589532+0000","last_fullsized":"2024-09-19T11:14:07.589532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:43.307746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'32","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.333416+0000","last_change":"2024-09-19T11:13:37.362218+0000","last_active":"2024-09-19T11:15:40.333416+0000","last_peered":"2024-09-19T11:15:40.333416+0000","last_clean":"2024-09-19T11:15:40.333416+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:15:40.333416+0000","last_undegraded":"2024-09-19T11:15:40.333416+0000","last_fullsized":"2024-09-19T11:15:40.333416+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":32,"log_dups_size":0,"ondisk_log_size":32,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:38.878721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589393+0000","last_change":"2024-09-19T11:13:39.378975+0000","last_active":"2024-09-19T11:14:07.589393+0000","last_peered":"2024-09-19T11:14:07.589393+0000","last_clean":"2024-09-19T11:14:07.589393+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:14:07.589393+0000","last_undegraded":"2024-09-19T11:14:07.589393+0000","last_fullsized":"2024-09-19T11:14:07.589393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:43.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:43.539247+0000","last_change":"2024-09-19T11:13:41.390986+0000","last_active":"2024-09-19T11:15:43.539247+0000","last_peered":"2024-09-19T11:15:43.539247+0000","last_clean":"2024-09-19T11:15:43.539247+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:15:43.539247+0000","last_undegraded":"2024-09-19T11:15:43.539247+0000","last_fullsized":"2024-09-19T11:15:43.539247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:29.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588444+0000","last_change":"2024-09-19T11:13:33.360955+0000","last_active":"2024-09-19T11:14:07.588444+0000","last_peered":"2024-09-19T11:14:07.588444+0000","last_clean":"2024-09-19T11:14:07.588444+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:14:07.588444+0000","last_undegraded":"2024-09-19T11:14:07.588444+0000","last_fullsized":"2024-09-19T11:14:07.588444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.739277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.595717+0000","last_change":"2024-09-19T11:13:31.378434+0000","last_active":"2024-09-19T11:14:15.595717+0000","last_peered":"2024-09-19T11:14:15.595717+0000","last_clean":"2024-09-19T11:14:15.595717+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:14:15.595717+0000","last_undegraded":"2024-09-19T11:14:15.595717+0000","last_fullsized":"2024-09-19T11:14:15.595717+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:49.941394+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586955+0000","last_change":"2024-09-19T11:13:35.348523+0000","last_active":"2024-09-19T11:14:07.586955+0000","last_peered":"2024-09-19T11:14:07.586955+0000","last_clean":"2024-09-19T11:14:07.586955+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:14:07.586955+0000","last_undegraded":"2024-09-19T11:14:07.586955+0000","last_fullsized":"2024-09-19T11:14:07.586955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:26.593052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.360329+0000","last_change":"2024-09-19T11:13:37.362855+0000","last_active":"2024-09-19T11:15:40.360329+0000","last_peered":"2024-09-19T11:15:40.360329+0000","last_clean":"2024-09-19T11:15:40.360329+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:15:40.360329+0000","last_undegraded":"2024-09-19T11:15:40.360329+0000","last_fullsized":"2024-09-19T11:15:40.360329+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:36.268162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'282","reported_seq":432,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.227280+0000","last_change":"2024-09-19T11:13:39.381222+0000","last_active":"2024-09-19T11:16:43.227280+0000","last_peered":"2024-09-19T11:16:43.227280+0000","last_clean":"2024-09-19T11:16:43.227280+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:16:43.227280+0000","last_undegraded":"2024-09-19T11:16:43.227280+0000","last_fullsized":"2024-09-19T11:16:43.227280+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:02.724027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:45.538583+0000","last_change":"2024-09-19T11:13:41.387843+0000","last_active":"2024-09-19T11:15:45.538583+0000","last_peered":"2024-09-19T11:15:45.538583+0000","last_clean":"2024-09-19T11:15:45.538583+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:15:45.538583+0000","last_undegraded":"2024-09-19T11:15:45.538583+0000","last_fullsized":"2024-09-19T11:15:45.538583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.060376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.539438+0000","last_change":"2024-09-19T11:13:33.351314+0000","last_active":"2024-09-19T11:15:48.539438+0000","last_peered":"2024-09-19T11:15:48.539438+0000","last_clean":"2024-09-19T11:15:48.539438+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:15:48.539438+0000","last_undegraded":"2024-09-19T11:15:48.539438+0000","last_fullsized":"2024-09-19T11:15:48.539438+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:21.853847+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.893715+0000","last_change":"2024-09-19T11:13:31.368833+0000","last_active":"2024-09-19T11:16:42.893715+0000","last_peered":"2024-09-19T11:16:42.893715+0000","last_clean":"2024-09-19T11:16:42.893715+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:16:42.893715+0000","last_undegraded":"2024-09-19T11:16:42.893715+0000","last_fullsized":"2024-09-19T11:16:42.893715+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:16:58.341667+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":414,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.444942+0000","last_change":"2024-09-19T11:13:35.352798+0000","last_active":"2024-09-19T11:15:41.444942+0000","last_peered":"2024-09-19T11:15:41.444942+0000","last_clean":"2024-09-19T11:15:41.444942+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:15:41.444942+0000","last_undegraded":"2024-09-19T11:15:41.444942+0000","last_fullsized":"2024-09-19T11:15:41.444942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:46.869358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":381,"num_read_kb":381,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586975+0000","last_change":"2024-09-19T11:13:37.369616+0000","last_active":"2024-09-19T11:14:07.586975+0000","last_peered":"2024-09-19T11:14:07.586975+0000","last_clean":"2024-09-19T11:14:07.586975+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:14:07.586975+0000","last_undegraded":"2024-09-19T11:14:07.586975+0000","last_fullsized":"2024-09-19T11:14:07.586975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.498959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'282","reported_seq":469,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.110426+0000","last_change":"2024-09-19T11:13:39.364476+0000","last_active":"2024-09-19T11:16:43.110426+0000","last_peered":"2024-09-19T11:16:43.110426+0000","last_clean":"2024-09-19T11:16:43.110426+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:16:43.110426+0000","last_undegraded":"2024-09-19T11:16:43.110426+0000","last_fullsized":"2024-09-19T11:16:43.110426+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:05.251594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.968627+0000","last_change":"2024-09-19T11:13:41.382500+0000","last_active":"2024-09-19T11:16:42.968627+0000","last_peered":"2024-09-19T11:16:42.968627+0000","last_clean":"2024-09-19T11:16:42.968627+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:16:42.968627+0000","last_undegraded":"2024-09-19T11:16:42.968627+0000","last_fullsized":"2024-09-19T11:16:42.968627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:44.429934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.615161+0000","last_change":"2024-09-19T11:13:33.361148+0000","last_active":"2024-09-19T11:14:15.615161+0000","last_peered":"2024-09-19T11:14:15.615161+0000","last_clean":"2024-09-19T11:14:15.615161+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:14:15.615161+0000","last_undegraded":"2024-09-19T11:14:15.615161+0000","last_fullsized":"2024-09-19T11:14:15.615161+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:18.909904+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584784+0000","last_change":"2024-09-19T11:13:31.376571+0000","last_active":"2024-09-19T11:14:07.584784+0000","last_peered":"2024-09-19T11:14:07.584784+0000","last_clean":"2024-09-19T11:14:07.584784+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:14:07.584784+0000","last_undegraded":"2024-09-19T11:14:07.584784+0000","last_fullsized":"2024-09-19T11:14:07.584784+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:01:21.093655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"28'1","reported_seq":219,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.445222+0000","last_change":"2024-09-19T11:13:35.359895+0000","last_active":"2024-09-19T11:15:41.445222+0000","last_peered":"2024-09-19T11:15:41.445222+0000","last_clean":"2024-09-19T11:15:41.445222+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:15:41.445222+0000","last_undegraded":"2024-09-19T11:15:41.445222+0000","last_fullsized":"2024-09-19T11:15:41.445222+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:48.665046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":282,"num_read_kb":282,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'38","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.346012+0000","last_change":"2024-09-19T11:13:37.367380+0000","last_active":"2024-09-19T11:15:40.346012+0000","last_peered":"2024-09-19T11:15:40.346012+0000","last_clean":"2024-09-19T11:15:40.346012+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:15:40.346012+0000","last_undegraded":"2024-09-19T11:15:40.346012+0000","last_fullsized":"2024-09-19T11:15:40.346012+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":38,"log_dups_size":0,"ondisk_log_size":38,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:44.610147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":41,"num_read_kb":31,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587829+0000","last_change":"2024-09-19T11:13:39.381930+0000","last_active":"2024-09-19T11:14:07.587829+0000","last_peered":"2024-09-19T11:14:07.587829+0000","last_clean":"2024-09-19T11:14:07.587829+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:14:07.587829+0000","last_undegraded":"2024-09-19T11:14:07.587829+0000","last_fullsized":"2024-09-19T11:14:07.587829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:20.757672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'8","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.224963+0000","last_change":"2024-09-19T11:13:41.383036+0000","last_active":"2024-09-19T11:16:43.224963+0000","last_peered":"2024-09-19T11:16:43.224963+0000","last_clean":"2024-09-19T11:16:43.224963+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:16:43.224963+0000","last_undegraded":"2024-09-19T11:16:43.224963+0000","last_fullsized":"2024-09-19T11:16:43.224963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:22.046963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004072+0000","last_change":"2024-09-19T11:13:33.360700+0000","last_active":"2024-09-19T11:16:43.004072+0000","last_peered":"2024-09-19T11:16:43.004072+0000","last_clean":"2024-09-19T11:16:43.004072+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:16:43.004072+0000","last_undegraded":"2024-09-19T11:16:43.004072+0000","last_fullsized":"2024-09-19T11:16:43.004072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:38.890842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"14'72","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593057+0000","last_change":"2024-09-19T11:13:16.796669+0000","last_active":"2024-09-19T11:14:07.593057+0000","last_peered":"2024-09-19T11:14:07.593057+0000","last_clean":"2024-09-19T11:14:07.593057+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:14:07.593057+0000","last_undegraded":"2024-09-19T11:14:07.593057+0000","last_fullsized":"2024-09-19T11:14:07.593057+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:15.217500+0000","last_clean_scrub_stamp":"2024-09-19T11:13:15.217500+0000","objects_scrubbed":0,"log_size":72,"log_dups_size":0,"ondisk_log_size":72,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:15.868833+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"17'1","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586588+0000","last_change":"2024-09-19T11:13:21.254644+0000","last_active":"2024-09-19T11:14:07.586588+0000","last_peered":"2024-09-19T11:14:07.586588+0000","last_clean":"2024-09-19T11:14:07.586588+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:14:07.586588+0000","last_undegraded":"2024-09-19T11:14:07.586588+0000","last_fullsized":"2024-09-19T11:14:07.586588+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:09.780975+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585255+0000","last_change":"2024-09-19T11:13:31.378802+0000","last_active":"2024-09-19T11:14:07.585255+0000","last_peered":"2024-09-19T11:14:07.585255+0000","last_clean":"2024-09-19T11:14:07.585255+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:14:07.585255+0000","last_undegraded":"2024-09-19T11:14:07.585255+0000","last_fullsized":"2024-09-19T11:14:07.585255+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:21.545126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598099+0000","last_change":"2024-09-19T11:14:07.597443+0000","last_active":"2024-09-19T11:14:07.598099+0000","last_peered":"2024-09-19T11:14:07.598099+0000","last_clean":"2024-09-19T11:14:07.598099+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:14:07.598099+0000","last_undegraded":"2024-09-19T11:14:07.598099+0000","last_fullsized":"2024-09-19T11:14:07.598099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:01.646429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'76","reported_seq":146,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.357806+0000","last_change":"2024-09-19T11:13:37.369113+0000","last_active":"2024-09-19T11:15:40.357806+0000","last_peered":"2024-09-19T11:15:40.357806+0000","last_clean":"2024-09-19T11:15:40.357806+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:15:40.357806+0000","last_undegraded":"2024-09-19T11:15:40.357806+0000","last_fullsized":"2024-09-19T11:15:40.357806+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":76,"log_dups_size":0,"ondisk_log_size":76,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:17.600400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":22,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588503+0000","last_change":"2024-09-19T11:13:39.381749+0000","last_active":"2024-09-19T11:14:07.588503+0000","last_peered":"2024-09-19T11:14:07.588503+0000","last_clean":"2024-09-19T11:14:07.588503+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:14:07.588503+0000","last_undegraded":"2024-09-19T11:14:07.588503+0000","last_fullsized":"2024-09-19T11:14:07.588503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:31.206255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.012984+0000","last_change":"2024-09-19T11:13:41.382469+0000","last_active":"2024-09-19T11:16:43.012984+0000","last_peered":"2024-09-19T11:16:43.012984+0000","last_clean":"2024-09-19T11:16:43.012984+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:16:43.012984+0000","last_undegraded":"2024-09-19T11:16:43.012984+0000","last_fullsized":"2024-09-19T11:16:43.012984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:23.490546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096383+0000","last_change":"2024-09-19T11:13:33.352593+0000","last_active":"2024-09-19T11:15:42.096383+0000","last_peered":"2024-09-19T11:15:42.096383+0000","last_clean":"2024-09-19T11:15:42.096383+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:15:42.096383+0000","last_undegraded":"2024-09-19T11:15:42.096383+0000","last_fullsized":"2024-09-19T11:15:42.096383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:32.858735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584255+0000","last_change":"2024-09-19T11:13:21.254355+0000","last_active":"2024-09-19T11:14:07.584255+0000","last_peered":"2024-09-19T11:14:07.584255+0000","last_clean":"2024-09-19T11:14:07.584255+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:14:07.584255+0000","last_undegraded":"2024-09-19T11:14:07.584255+0000","last_fullsized":"2024-09-19T11:14:07.584255+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:35:49.014710+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.542565+0000","last_change":"2024-09-19T11:13:31.364094+0000","last_active":"2024-09-19T11:16:42.542565+0000","last_peered":"2024-09-19T11:16:42.542565+0000","last_clean":"2024-09-19T11:16:42.542565+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:16:42.542565+0000","last_undegraded":"2024-09-19T11:16:42.542565+0000","last_fullsized":"2024-09-19T11:16:42.542565+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.487218+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589544+0000","last_change":"2024-09-19T11:13:35.355733+0000","last_active":"2024-09-19T11:14:07.589544+0000","last_peered":"2024-09-19T11:14:07.589544+0000","last_clean":"2024-09-19T11:14:07.589544+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:14:07.589544+0000","last_undegraded":"2024-09-19T11:14:07.589544+0000","last_fullsized":"2024-09-19T11:14:07.589544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:16.022467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'273","reported_seq":477,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437573+0000","last_change":"2024-09-19T11:13:37.365037+0000","last_active":"2024-09-19T11:16:40.437573+0000","last_peered":"2024-09-19T11:16:40.437573+0000","last_clean":"2024-09-19T11:16:40.437573+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:16:40.437573+0000","last_undegraded":"2024-09-19T11:16:40.437573+0000","last_fullsized":"2024-09-19T11:16:40.437573+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":273,"log_dups_size":0,"ondisk_log_size":273,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:00.713713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":357,"num_read_kb":342,"num_write":32,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585295+0000","last_change":"2024-09-19T11:13:39.379958+0000","last_active":"2024-09-19T11:14:07.585295+0000","last_peered":"2024-09-19T11:14:07.585295+0000","last_clean":"2024-09-19T11:14:07.585295+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:14:07.585295+0000","last_undegraded":"2024-09-19T11:14:07.585295+0000","last_fullsized":"2024-09-19T11:14:07.585295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.435708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.934138+0000","last_change":"2024-09-19T11:13:41.394316+0000","last_active":"2024-09-19T11:14:57.934138+0000","last_peered":"2024-09-19T11:14:57.934138+0000","last_clean":"2024-09-19T11:14:57.934138+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:14:57.934138+0000","last_undegraded":"2024-09-19T11:14:57.934138+0000","last_fullsized":"2024-09-19T11:14:57.934138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:54.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589975+0000","last_change":"2024-09-19T11:13:33.348762+0000","last_active":"2024-09-19T11:14:07.589975+0000","last_peered":"2024-09-19T11:14:07.589975+0000","last_clean":"2024-09-19T11:14:07.589975+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:14:07.589975+0000","last_undegraded":"2024-09-19T11:14:07.589975+0000","last_fullsized":"2024-09-19T11:14:07.589975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:36:09.372432+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589222+0000","last_change":"2024-09-19T11:13:21.252701+0000","last_active":"2024-09-19T11:14:07.589222+0000","last_peered":"2024-09-19T11:14:07.589222+0000","last_clean":"2024-09-19T11:14:07.589222+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:14:07.589222+0000","last_undegraded":"2024-09-19T11:14:07.589222+0000","last_fullsized":"2024-09-19T11:14:07.589222+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:32.819428+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585864+0000","last_change":"2024-09-19T11:13:31.377758+0000","last_active":"2024-09-19T11:14:07.585864+0000","last_peered":"2024-09-19T11:14:07.585864+0000","last_clean":"2024-09-19T11:14:07.585864+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:14:07.585864+0000","last_undegraded":"2024-09-19T11:14:07.585864+0000","last_fullsized":"2024-09-19T11:14:07.585864+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:40:51.569099+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589942+0000","last_change":"2024-09-19T11:13:35.350142+0000","last_active":"2024-09-19T11:14:07.589942+0000","last_peered":"2024-09-19T11:14:07.589942+0000","last_clean":"2024-09-19T11:14:07.589942+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:14:07.589942+0000","last_undegraded":"2024-09-19T11:14:07.589942+0000","last_fullsized":"2024-09-19T11:14:07.589942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:13.732591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437418+0000","last_change":"2024-09-19T11:13:37.369777+0000","last_active":"2024-09-19T11:16:40.437418+0000","last_peered":"2024-09-19T11:16:40.437418+0000","last_clean":"2024-09-19T11:16:40.437418+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:16:40.437418+0000","last_undegraded":"2024-09-19T11:16:40.437418+0000","last_fullsized":"2024-09-19T11:16:40.437418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:09.642366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587165+0000","last_change":"2024-09-19T11:13:39.382026+0000","last_active":"2024-09-19T11:14:07.587165+0000","last_peered":"2024-09-19T11:14:07.587165+0000","last_clean":"2024-09-19T11:14:07.587165+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:14:07.587165+0000","last_undegraded":"2024-09-19T11:14:07.587165+0000","last_fullsized":"2024-09-19T11:14:07.587165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:05.351431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.301235+0000","last_change":"2024-09-19T11:13:41.390159+0000","last_active":"2024-09-19T11:16:42.301235+0000","last_peered":"2024-09-19T11:16:42.301235+0000","last_clean":"2024-09-19T11:16:42.301235+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:16:42.301235+0000","last_undegraded":"2024-09-19T11:16:42.301235+0000","last_fullsized":"2024-09-19T11:16:42.301235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:47.188979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112810+0000","last_change":"2024-09-19T11:13:33.352483+0000","last_active":"2024-09-19T11:14:58.112810+0000","last_peered":"2024-09-19T11:14:58.112810+0000","last_clean":"2024-09-19T11:14:58.112810+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:14:58.112810+0000","last_undegraded":"2024-09-19T11:14:58.112810+0000","last_fullsized":"2024-09-19T11:14:58.112810+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:20:17.063492+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"19'2","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584626+0000","last_change":"2024-09-19T11:13:21.254900+0000","last_active":"2024-09-19T11:14:07.584626+0000","last_peered":"2024-09-19T11:14:07.584626+0000","last_clean":"2024-09-19T11:14:07.584626+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:14:07.584626+0000","last_undegraded":"2024-09-19T11:14:07.584626+0000","last_fullsized":"2024-09-19T11:14:07.584626+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:06.693190+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.563187+0000","last_change":"2024-09-19T11:13:31.370903+0000","last_active":"2024-09-19T11:15:38.563187+0000","last_peered":"2024-09-19T11:15:38.563187+0000","last_clean":"2024-09-19T11:15:38.563187+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:15:38.563187+0000","last_undegraded":"2024-09-19T11:15:38.563187+0000","last_fullsized":"2024-09-19T11:15:38.563187+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:36.343297+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.680755+0000","last_change":"2024-09-19T11:13:35.357655+0000","last_active":"2024-09-19T11:16:49.680755+0000","last_peered":"2024-09-19T11:16:49.680755+0000","last_clean":"2024-09-19T11:16:49.680755+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:16:49.680755+0000","last_undegraded":"2024-09-19T11:16:49.680755+0000","last_fullsized":"2024-09-19T11:16:49.680755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:09.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'14","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.146449+0000","last_change":"2024-09-19T11:13:37.369199+0000","last_active":"2024-09-19T11:16:42.146449+0000","last_peered":"2024-09-19T11:16:42.146449+0000","last_clean":"2024-09-19T11:16:42.146449+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:16:42.146449+0000","last_undegraded":"2024-09-19T11:16:42.146449+0000","last_fullsized":"2024-09-19T11:16:42.146449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:43.083589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589764+0000","last_change":"2024-09-19T11:13:39.379563+0000","last_active":"2024-09-19T11:14:07.589764+0000","last_peered":"2024-09-19T11:14:07.589764+0000","last_clean":"2024-09-19T11:14:07.589764+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:14:07.589764+0000","last_undegraded":"2024-09-19T11:14:07.589764+0000","last_fullsized":"2024-09-19T11:14:07.589764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:20.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.946285+0000","last_change":"2024-09-19T11:13:41.395412+0000","last_active":"2024-09-19T11:16:42.946285+0000","last_peered":"2024-09-19T11:16:42.946285+0000","last_clean":"2024-09-19T11:16:42.946285+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:16:42.946285+0000","last_undegraded":"2024-09-19T11:16:42.946285+0000","last_fullsized":"2024-09-19T11:16:42.946285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:05.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.967341+0000","last_change":"2024-09-19T11:13:33.356242+0000","last_active":"2024-09-19T11:16:42.967341+0000","last_peered":"2024-09-19T11:16:42.967341+0000","last_clean":"2024-09-19T11:16:42.967341+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:16:42.967341+0000","last_undegraded":"2024-09-19T11:16:42.967341+0000","last_fullsized":"2024-09-19T11:16:42.967341+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588322+0000","last_change":"2024-09-19T11:13:31.374247+0000","last_active":"2024-09-19T11:14:07.588322+0000","last_peered":"2024-09-19T11:14:07.588322+0000","last_clean":"2024-09-19T11:14:07.588322+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:14:07.588322+0000","last_undegraded":"2024-09-19T11:14:07.588322+0000","last_fullsized":"2024-09-19T11:14:07.588322+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:13:36.456865+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587109+0000","last_change":"2024-09-19T11:13:21.259380+0000","last_active":"2024-09-19T11:14:07.587109+0000","last_peered":"2024-09-19T11:14:07.587109+0000","last_clean":"2024-09-19T11:14:07.587109+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:14:07.587109+0000","last_undegraded":"2024-09-19T11:14:07.587109+0000","last_fullsized":"2024-09-19T11:14:07.587109+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:46.602467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.279961+0000","last_change":"2024-09-19T11:13:35.354864+0000","last_active":"2024-09-19T11:16:43.279961+0000","last_peered":"2024-09-19T11:16:43.279961+0000","last_clean":"2024-09-19T11:16:43.279961+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:16:43.279961+0000","last_undegraded":"2024-09-19T11:16:43.279961+0000","last_fullsized":"2024-09-19T11:16:43.279961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:59.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'69","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.846451+0000","last_change":"2024-09-19T11:13:37.366497+0000","last_active":"2024-09-19T11:16:49.846451+0000","last_peered":"2024-09-19T11:16:49.846451+0000","last_clean":"2024-09-19T11:16:49.846451+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:16:49.846451+0000","last_undegraded":"2024-09-19T11:16:49.846451+0000","last_fullsized":"2024-09-19T11:16:49.846451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:05.665285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586753+0000","last_change":"2024-09-19T11:13:39.380023+0000","last_active":"2024-09-19T11:14:07.586753+0000","last_peered":"2024-09-19T11:14:07.586753+0000","last_clean":"2024-09-19T11:14:07.586753+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:14:07.586753+0000","last_undegraded":"2024-09-19T11:14:07.586753+0000","last_fullsized":"2024-09-19T11:14:07.586753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.513854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.002199+0000","last_change":"2024-09-19T11:13:41.384779+0000","last_active":"2024-09-19T11:15:42.002199+0000","last_peered":"2024-09-19T11:15:42.002199+0000","last_clean":"2024-09-19T11:15:42.002199+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:15:42.002199+0000","last_undegraded":"2024-09-19T11:15:42.002199+0000","last_fullsized":"2024-09-19T11:15:42.002199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:01.181785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003973+0000","last_change":"2024-09-19T11:13:33.355203+0000","last_active":"2024-09-19T11:16:43.003973+0000","last_peered":"2024-09-19T11:16:43.003973+0000","last_clean":"2024-09-19T11:16:43.003973+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:16:43.003973+0000","last_undegraded":"2024-09-19T11:16:43.003973+0000","last_fullsized":"2024-09-19T11:16:43.003973+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:39.888974+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.523511+0000","last_change":"2024-09-19T11:13:31.363980+0000","last_active":"2024-09-19T11:14:14.523511+0000","last_peered":"2024-09-19T11:14:14.523511+0000","last_clean":"2024-09-19T11:14:14.523511+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:14:14.523511+0000","last_undegraded":"2024-09-19T11:14:14.523511+0000","last_fullsized":"2024-09-19T11:14:14.523511+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:16:08.281382+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587424+0000","last_change":"2024-09-19T11:13:21.254921+0000","last_active":"2024-09-19T11:14:07.587424+0000","last_peered":"2024-09-19T11:14:07.587424+0000","last_clean":"2024-09-19T11:14:07.587424+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:14:07.587424+0000","last_undegraded":"2024-09-19T11:14:07.587424+0000","last_fullsized":"2024-09-19T11:14:07.587424+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:50.538143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584330+0000","last_change":"2024-09-19T11:13:35.355937+0000","last_active":"2024-09-19T11:14:07.584330+0000","last_peered":"2024-09-19T11:14:07.584330+0000","last_clean":"2024-09-19T11:14:07.584330+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:14:07.584330+0000","last_undegraded":"2024-09-19T11:14:07.584330+0000","last_fullsized":"2024-09-19T11:14:07.584330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:41.799805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593910+0000","last_change":"2024-09-19T11:13:37.367919+0000","last_active":"2024-09-19T11:14:07.593910+0000","last_peered":"2024-09-19T11:14:07.593910+0000","last_clean":"2024-09-19T11:14:07.593910+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:14:07.593910+0000","last_undegraded":"2024-09-19T11:14:07.593910+0000","last_fullsized":"2024-09-19T11:14:07.593910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:53.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'282","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437340+0000","last_change":"2024-09-19T11:13:39.370313+0000","last_active":"2024-09-19T11:16:40.437340+0000","last_peered":"2024-09-19T11:16:40.437340+0000","last_clean":"2024-09-19T11:16:40.437340+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:16:40.437340+0000","last_undegraded":"2024-09-19T11:16:40.437340+0000","last_fullsized":"2024-09-19T11:16:40.437340+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:56.937960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.649914+0000","last_change":"2024-09-19T11:13:41.391610+0000","last_active":"2024-09-19T11:16:42.649914+0000","last_peered":"2024-09-19T11:16:42.649914+0000","last_clean":"2024-09-19T11:16:42.649914+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:16:42.649914+0000","last_undegraded":"2024-09-19T11:16:42.649914+0000","last_fullsized":"2024-09-19T11:16:42.649914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.303997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096636+0000","last_change":"2024-09-19T11:14:07.601620+0000","last_active":"2024-09-19T11:15:42.096636+0000","last_peered":"2024-09-19T11:15:42.096636+0000","last_clean":"2024-09-19T11:15:42.096636+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:15:42.096636+0000","last_undegraded":"2024-09-19T11:15:42.096636+0000","last_fullsized":"2024-09-19T11:15:42.096636+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:07:56.955418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.879840+0000","last_change":"2024-09-19T11:13:31.367766+0000","last_active":"2024-09-19T11:16:42.879840+0000","last_peered":"2024-09-19T11:16:42.879840+0000","last_clean":"2024-09-19T11:16:42.879840+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:16:42.879840+0000","last_undegraded":"2024-09-19T11:16:42.879840+0000","last_fullsized":"2024-09-19T11:16:42.879840+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:42:46.005854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588837+0000","last_change":"2024-09-19T11:13:21.259371+0000","last_active":"2024-09-19T11:14:07.588837+0000","last_peered":"2024-09-19T11:14:07.588837+0000","last_clean":"2024-09-19T11:14:07.588837+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:14:07.588837+0000","last_undegraded":"2024-09-19T11:14:07.588837+0000","last_fullsized":"2024-09-19T11:14:07.588837+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:58.914941+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584240+0000","last_change":"2024-09-19T11:13:35.355501+0000","last_active":"2024-09-19T11:14:07.584240+0000","last_peered":"2024-09-19T11:14:07.584240+0000","last_clean":"2024-09-19T11:14:07.584240+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:14:07.584240+0000","last_undegraded":"2024-09-19T11:14:07.584240+0000","last_fullsized":"2024-09-19T11:14:07.584240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:17.393322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585599+0000","last_change":"2024-09-19T11:13:37.371529+0000","last_active":"2024-09-19T11:14:07.585599+0000","last_peered":"2024-09-19T11:14:07.585599+0000","last_clean":"2024-09-19T11:14:07.585599+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:14:07.585599+0000","last_undegraded":"2024-09-19T11:14:07.585599+0000","last_fullsized":"2024-09-19T11:14:07.585599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.201187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":403,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.718255+0000","last_change":"2024-09-19T11:13:39.374381+0000","last_active":"2024-09-19T11:16:49.718255+0000","last_peered":"2024-09-19T11:16:49.718255+0000","last_clean":"2024-09-19T11:16:49.718255+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:16:49.718255+0000","last_undegraded":"2024-09-19T11:16:49.718255+0000","last_fullsized":"2024-09-19T11:16:49.718255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:52.357745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.093870+0000","last_change":"2024-09-19T11:13:41.392744+0000","last_active":"2024-09-19T11:15:42.093870+0000","last_peered":"2024-09-19T11:15:42.093870+0000","last_clean":"2024-09-19T11:15:42.093870+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:15:42.093870+0000","last_undegraded":"2024-09-19T11:15:42.093870+0000","last_fullsized":"2024-09-19T11:15:42.093870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:06.085455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.967344+0000","last_change":"2024-09-19T11:13:33.350528+0000","last_active":"2024-09-19T11:16:42.967344+0000","last_peered":"2024-09-19T11:16:42.967344+0000","last_clean":"2024-09-19T11:16:42.967344+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:16:42.967344+0000","last_undegraded":"2024-09-19T11:16:42.967344+0000","last_fullsized":"2024-09-19T11:16:42.967344+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:15:39.714383+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.525531+0000","last_change":"2024-09-19T11:13:31.363581+0000","last_active":"2024-09-19T11:14:14.525531+0000","last_peered":"2024-09-19T11:14:14.525531+0000","last_clean":"2024-09-19T11:14:14.525531+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:14:14.525531+0000","last_undegraded":"2024-09-19T11:14:14.525531+0000","last_fullsized":"2024-09-19T11:14:14.525531+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:56:35.175022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590511+0000","last_change":"2024-09-19T11:13:21.254352+0000","last_active":"2024-09-19T11:14:07.590511+0000","last_peered":"2024-09-19T11:14:07.590511+0000","last_clean":"2024-09-19T11:14:07.590511+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:14:07.590511+0000","last_undegraded":"2024-09-19T11:14:07.590511+0000","last_fullsized":"2024-09-19T11:14:07.590511+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:18.232817+0000","last_clean_scrub_stamp":"2024-09-19T11:13:18.232817+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:08:50.082399+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584254+0000","last_change":"2024-09-19T11:13:35.355920+0000","last_active":"2024-09-19T11:14:07.584254+0000","last_peered":"2024-09-19T11:14:07.584254+0000","last_clean":"2024-09-19T11:14:07.584254+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:14:07.584254+0000","last_undegraded":"2024-09-19T11:14:07.584254+0000","last_fullsized":"2024-09-19T11:14:07.584254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:38.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'82","reported_seq":155,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.344082+0000","last_change":"2024-09-19T11:13:37.367000+0000","last_active":"2024-09-19T11:15:40.344082+0000","last_peered":"2024-09-19T11:15:40.344082+0000","last_clean":"2024-09-19T11:15:40.344082+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:15:40.344082+0000","last_undegraded":"2024-09-19T11:15:40.344082+0000","last_fullsized":"2024-09-19T11:15:40.344082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.428269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":75,"num_read_kb":61,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586150+0000","last_change":"2024-09-19T11:13:39.369482+0000","last_active":"2024-09-19T11:14:07.586150+0000","last_peered":"2024-09-19T11:14:07.586150+0000","last_clean":"2024-09-19T11:14:07.586150+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:14:07.586150+0000","last_undegraded":"2024-09-19T11:14:07.586150+0000","last_fullsized":"2024-09-19T11:14:07.586150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:52.197649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.742094+0000","last_change":"2024-09-19T11:13:41.387841+0000","last_active":"2024-09-19T11:16:42.742094+0000","last_peered":"2024-09-19T11:16:42.742094+0000","last_clean":"2024-09-19T11:16:42.742094+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:16:42.742094+0000","last_undegraded":"2024-09-19T11:16:42.742094+0000","last_fullsized":"2024-09-19T11:16:42.742094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:41.664645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589320+0000","last_change":"2024-09-19T11:13:41.387407+0000","last_active":"2024-09-19T11:14:07.589320+0000","last_peered":"2024-09-19T11:14:07.589320+0000","last_clean":"2024-09-19T11:14:07.589320+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:14:07.589320+0000","last_undegraded":"2024-09-19T11:14:07.589320+0000","last_fullsized":"2024-09-19T11:14:07.589320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:24.850379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899053+0000","last_change":"2024-09-19T11:13:33.353234+0000","last_active":"2024-09-19T11:16:42.899053+0000","last_peered":"2024-09-19T11:16:42.899053+0000","last_clean":"2024-09-19T11:16:42.899053+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:16:42.899053+0000","last_undegraded":"2024-09-19T11:16:42.899053+0000","last_fullsized":"2024-09-19T11:16:42.899053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.889699+0000","last_change":"2024-09-19T11:13:31.373496+0000","last_active":"2024-09-19T11:16:42.889699+0000","last_peered":"2024-09-19T11:16:42.889699+0000","last_clean":"2024-09-19T11:16:42.889699+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:16:42.889699+0000","last_undegraded":"2024-09-19T11:16:42.889699+0000","last_fullsized":"2024-09-19T11:16:42.889699+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:04.061207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593909+0000","last_change":"2024-09-19T11:13:35.353000+0000","last_active":"2024-09-19T11:14:07.593909+0000","last_peered":"2024-09-19T11:14:07.593909+0000","last_clean":"2024-09-19T11:14:07.593909+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:14:07.593909+0000","last_undegraded":"2024-09-19T11:14:07.593909+0000","last_fullsized":"2024-09-19T11:14:07.593909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:23.618637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'33","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.349850+0000","last_change":"2024-09-19T11:13:37.369688+0000","last_active":"2024-09-19T11:15:40.349850+0000","last_peered":"2024-09-19T11:15:40.349850+0000","last_clean":"2024-09-19T11:15:40.349850+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:15:40.349850+0000","last_undegraded":"2024-09-19T11:15:40.349850+0000","last_fullsized":"2024-09-19T11:15:40.349850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:22.810135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":32,"num_read_kb":25,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585707+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.585707+0000","last_peered":"2024-09-19T11:14:07.585707+0000","last_clean":"2024-09-19T11:14:07.585707+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:14:07.585707+0000","last_undegraded":"2024-09-19T11:14:07.585707+0000","last_fullsized":"2024-09-19T11:14:07.585707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:32.078155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.049603+0000","last_change":"2024-09-19T11:13:41.388648+0000","last_active":"2024-09-19T11:15:40.049603+0000","last_peered":"2024-09-19T11:15:40.049603+0000","last_clean":"2024-09-19T11:15:40.049603+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:15:40.049603+0000","last_undegraded":"2024-09-19T11:15:40.049603+0000","last_fullsized":"2024-09-19T11:15:40.049603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:00.390668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899095+0000","last_change":"2024-09-19T11:13:33.356046+0000","last_active":"2024-09-19T11:16:42.899095+0000","last_peered":"2024-09-19T11:16:42.899095+0000","last_clean":"2024-09-19T11:16:42.899095+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:16:42.899095+0000","last_undegraded":"2024-09-19T11:16:42.899095+0000","last_fullsized":"2024-09-19T11:16:42.899095+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:02:32.352474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.580671+0000","last_change":"2024-09-19T11:13:31.371002+0000","last_active":"2024-09-19T11:16:42.580671+0000","last_peered":"2024-09-19T11:16:42.580671+0000","last_clean":"2024-09-19T11:16:42.580671+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:42.580671+0000","last_undegraded":"2024-09-19T11:16:42.580671+0000","last_fullsized":"2024-09-19T11:16:42.580671+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:54.573687+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584591+0000","last_change":"2024-09-19T11:13:35.353851+0000","last_active":"2024-09-19T11:14:07.584591+0000","last_peered":"2024-09-19T11:14:07.584591+0000","last_clean":"2024-09-19T11:14:07.584591+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:14:07.584591+0000","last_undegraded":"2024-09-19T11:14:07.584591+0000","last_fullsized":"2024-09-19T11:14:07.584591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:37.329718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.125107+0000","last_change":"2024-09-19T11:13:37.361748+0000","last_active":"2024-09-19T11:16:42.125107+0000","last_peered":"2024-09-19T11:16:42.125107+0000","last_clean":"2024-09-19T11:16:42.125107+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:16:42.125107+0000","last_undegraded":"2024-09-19T11:16:42.125107+0000","last_fullsized":"2024-09-19T11:16:42.125107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:52.506674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588151+0000","last_change":"2024-09-19T11:13:39.381924+0000","last_active":"2024-09-19T11:14:07.588151+0000","last_peered":"2024-09-19T11:14:07.588151+0000","last_clean":"2024-09-19T11:14:07.588151+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:14:07.588151+0000","last_undegraded":"2024-09-19T11:14:07.588151+0000","last_fullsized":"2024-09-19T11:14:07.588151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:37.700824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587758+0000","last_change":"2024-09-19T11:13:41.381057+0000","last_active":"2024-09-19T11:14:07.587758+0000","last_peered":"2024-09-19T11:14:07.587758+0000","last_clean":"2024-09-19T11:14:07.587758+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:14:07.587758+0000","last_undegraded":"2024-09-19T11:14:07.587758+0000","last_fullsized":"2024-09-19T11:14:07.587758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:11.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003956+0000","last_change":"2024-09-19T11:13:33.350098+0000","last_active":"2024-09-19T11:16:43.003956+0000","last_peered":"2024-09-19T11:16:43.003956+0000","last_clean":"2024-09-19T11:16:43.003956+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:16:43.003956+0000","last_undegraded":"2024-09-19T11:16:43.003956+0000","last_fullsized":"2024-09-19T11:16:43.003956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:02.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590332+0000","last_change":"2024-09-19T11:13:31.356268+0000","last_active":"2024-09-19T11:14:07.590332+0000","last_peered":"2024-09-19T11:14:07.590332+0000","last_clean":"2024-09-19T11:14:07.590332+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:14:07.590332+0000","last_undegraded":"2024-09-19T11:14:07.590332+0000","last_fullsized":"2024-09-19T11:14:07.590332+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:33.031622+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587433+0000","last_change":"2024-09-19T11:13:35.356889+0000","last_active":"2024-09-19T11:14:07.587433+0000","last_peered":"2024-09-19T11:14:07.587433+0000","last_clean":"2024-09-19T11:14:07.587433+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:14:07.587433+0000","last_undegraded":"2024-09-19T11:14:07.587433+0000","last_fullsized":"2024-09-19T11:14:07.587433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:48.945891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'47","reported_seq":111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.769850+0000","last_change":"2024-09-19T11:13:37.358517+0000","last_active":"2024-09-19T11:16:49.769850+0000","last_peered":"2024-09-19T11:16:49.769850+0000","last_clean":"2024-09-19T11:16:49.769850+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:16:49.769850+0000","last_undegraded":"2024-09-19T11:16:49.769850+0000","last_fullsized":"2024-09-19T11:16:49.769850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.932100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593589+0000","last_change":"2024-09-19T11:13:39.368887+0000","last_active":"2024-09-19T11:14:07.593589+0000","last_peered":"2024-09-19T11:14:07.593589+0000","last_clean":"2024-09-19T11:14:07.593589+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:14:07.593589+0000","last_undegraded":"2024-09-19T11:14:07.593589+0000","last_fullsized":"2024-09-19T11:14:07.593589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:59.906873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585207+0000","last_change":"2024-09-19T11:13:41.390580+0000","last_active":"2024-09-19T11:14:07.585207+0000","last_peered":"2024-09-19T11:14:07.585207+0000","last_clean":"2024-09-19T11:14:07.585207+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:14:07.585207+0000","last_undegraded":"2024-09-19T11:14:07.585207+0000","last_fullsized":"2024-09-19T11:14:07.585207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:00.635835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.628513+0000","last_change":"2024-09-19T11:13:33.359154+0000","last_active":"2024-09-19T11:16:42.628513+0000","last_peered":"2024-09-19T11:16:42.628513+0000","last_clean":"2024-09-19T11:16:42.628513+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:16:42.628513+0000","last_undegraded":"2024-09-19T11:16:42.628513+0000","last_fullsized":"2024-09-19T11:16:42.628513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.291758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:14.525594+0000","last_change":"2024-09-19T11:13:31.362807+0000","last_active":"2024-09-19T11:14:14.525594+0000","last_peered":"2024-09-19T11:14:14.525594+0000","last_clean":"2024-09-19T11:14:14.525594+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:14:14.525594+0000","last_undegraded":"2024-09-19T11:14:14.525594+0000","last_fullsized":"2024-09-19T11:14:14.525594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:56.374755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584231+0000","last_change":"2024-09-19T11:13:35.356852+0000","last_active":"2024-09-19T11:14:07.584231+0000","last_peered":"2024-09-19T11:14:07.584231+0000","last_clean":"2024-09-19T11:14:07.584231+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:14:07.584231+0000","last_undegraded":"2024-09-19T11:14:07.584231+0000","last_fullsized":"2024-09-19T11:14:07.584231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:35.050288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'30","reported_seq":73,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.335466+0000","last_change":"2024-09-19T11:13:37.360189+0000","last_active":"2024-09-19T11:15:40.335466+0000","last_peered":"2024-09-19T11:15:40.335466+0000","last_clean":"2024-09-19T11:15:40.335466+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:15:40.335466+0000","last_undegraded":"2024-09-19T11:15:40.335466+0000","last_fullsized":"2024-09-19T11:15:40.335466+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":30,"log_dups_size":0,"ondisk_log_size":30,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:54.329596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":29,"num_read_kb":23,"num_write":12,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587792+0000","last_change":"2024-09-19T11:13:39.375493+0000","last_active":"2024-09-19T11:14:07.587792+0000","last_peered":"2024-09-19T11:14:07.587792+0000","last_clean":"2024-09-19T11:14:07.587792+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:14:07.587792+0000","last_undegraded":"2024-09-19T11:14:07.587792+0000","last_fullsized":"2024-09-19T11:14:07.587792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:12.594777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.568582+0000","last_change":"2024-09-19T11:13:33.354025+0000","last_active":"2024-09-19T11:15:38.568582+0000","last_peered":"2024-09-19T11:15:38.568582+0000","last_clean":"2024-09-19T11:15:38.568582+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:15:38.568582+0000","last_undegraded":"2024-09-19T11:15:38.568582+0000","last_fullsized":"2024-09-19T11:15:38.568582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:42.535989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.541620+0000","last_change":"2024-09-19T11:13:31.376331+0000","last_active":"2024-09-19T11:15:58.541620+0000","last_peered":"2024-09-19T11:15:58.541620+0000","last_clean":"2024-09-19T11:15:58.541620+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:15:58.541620+0000","last_undegraded":"2024-09-19T11:15:58.541620+0000","last_fullsized":"2024-09-19T11:15:58.541620+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:08.223724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":668544,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588717+0000","last_change":"2024-09-19T11:13:35.357178+0000","last_active":"2024-09-19T11:14:07.588717+0000","last_peered":"2024-09-19T11:14:07.588717+0000","last_clean":"2024-09-19T11:14:07.588717+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:14:07.588717+0000","last_undegraded":"2024-09-19T11:14:07.588717+0000","last_fullsized":"2024-09-19T11:14:07.588717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:59.098976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'63","reported_seq":128,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.874425+0000","last_change":"2024-09-19T11:13:37.363593+0000","last_active":"2024-09-19T11:16:49.874425+0000","last_peered":"2024-09-19T11:16:49.874425+0000","last_clean":"2024-09-19T11:16:49.874425+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:16:49.874425+0000","last_undegraded":"2024-09-19T11:16:49.874425+0000","last_fullsized":"2024-09-19T11:16:49.874425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:57.886776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587378+0000","last_change":"2024-09-19T11:13:39.375431+0000","last_active":"2024-09-19T11:14:07.587378+0000","last_peered":"2024-09-19T11:14:07.587378+0000","last_clean":"2024-09-19T11:14:07.587378+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:14:07.587378+0000","last_undegraded":"2024-09-19T11:14:07.587378+0000","last_fullsized":"2024-09-19T11:14:07.587378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:55.629772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.998936+0000","last_change":"2024-09-19T11:13:41.387630+0000","last_active":"2024-09-19T11:15:41.998936+0000","last_peered":"2024-09-19T11:15:41.998936+0000","last_clean":"2024-09-19T11:15:41.998936+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:15:41.998936+0000","last_undegraded":"2024-09-19T11:15:41.998936+0000","last_fullsized":"2024-09-19T11:15:41.998936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:27.480898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004030+0000","last_change":"2024-09-19T11:13:33.342352+0000","last_active":"2024-09-19T11:16:43.004030+0000","last_peered":"2024-09-19T11:16:43.004030+0000","last_clean":"2024-09-19T11:16:43.004030+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:16:43.004030+0000","last_undegraded":"2024-09-19T11:16:43.004030+0000","last_fullsized":"2024-09-19T11:16:43.004030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:09.205289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:58.543575+0000","last_change":"2024-09-19T11:13:31.360617+0000","last_active":"2024-09-19T11:15:58.543575+0000","last_peered":"2024-09-19T11:15:58.543575+0000","last_clean":"2024-09-19T11:15:58.543575+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:15:58.543575+0000","last_undegraded":"2024-09-19T11:15:58.543575+0000","last_fullsized":"2024-09-19T11:15:58.543575+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:23:26.660836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590449+0000","last_change":"2024-09-19T11:13:35.350569+0000","last_active":"2024-09-19T11:14:07.590449+0000","last_peered":"2024-09-19T11:14:07.590449+0000","last_clean":"2024-09-19T11:14:07.590449+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:14:07.590449+0000","last_undegraded":"2024-09-19T11:14:07.590449+0000","last_fullsized":"2024-09-19T11:14:07.590449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:44.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.336398+0000","last_change":"2024-09-19T11:13:37.368372+0000","last_active":"2024-09-19T11:15:40.336398+0000","last_peered":"2024-09-19T11:15:40.336398+0000","last_clean":"2024-09-19T11:15:40.336398+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:15:40.336398+0000","last_undegraded":"2024-09-19T11:15:40.336398+0000","last_fullsized":"2024-09-19T11:15:40.336398+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:42.470532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595510+0000","last_change":"2024-09-19T11:13:39.377106+0000","last_active":"2024-09-19T11:14:07.595510+0000","last_peered":"2024-09-19T11:14:07.595510+0000","last_clean":"2024-09-19T11:14:07.595510+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:14:07.595510+0000","last_undegraded":"2024-09-19T11:14:07.595510+0000","last_fullsized":"2024-09-19T11:14:07.595510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:40.364349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584320+0000","last_change":"2024-09-19T11:13:41.395172+0000","last_active":"2024-09-19T11:14:07.584320+0000","last_peered":"2024-09-19T11:14:07.584320+0000","last_clean":"2024-09-19T11:14:07.584320+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:14:07.584320+0000","last_undegraded":"2024-09-19T11:14:07.584320+0000","last_fullsized":"2024-09-19T11:14:07.584320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:31.640115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115025+0000","last_change":"2024-09-19T11:13:33.361006+0000","last_active":"2024-09-19T11:14:58.115025+0000","last_peered":"2024-09-19T11:14:58.115025+0000","last_clean":"2024-09-19T11:14:58.115025+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:14:58.115025+0000","last_undegraded":"2024-09-19T11:14:58.115025+0000","last_fullsized":"2024-09-19T11:14:58.115025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:15.458106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.074402+0000","last_change":"2024-09-19T11:13:31.369805+0000","last_active":"2024-09-19T11:15:42.074402+0000","last_peered":"2024-09-19T11:15:42.074402+0000","last_clean":"2024-09-19T11:15:42.074402+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:15:42.074402+0000","last_undegraded":"2024-09-19T11:15:42.074402+0000","last_fullsized":"2024-09-19T11:15:42.074402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:31.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588215+0000","last_change":"2024-09-19T11:13:35.351248+0000","last_active":"2024-09-19T11:14:07.588215+0000","last_peered":"2024-09-19T11:14:07.588215+0000","last_clean":"2024-09-19T11:14:07.588215+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:14:07.588215+0000","last_undegraded":"2024-09-19T11:14:07.588215+0000","last_fullsized":"2024-09-19T11:14:07.588215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:06.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.833988+0000","last_change":"2024-09-19T11:13:37.358368+0000","last_active":"2024-09-19T11:16:49.833988+0000","last_peered":"2024-09-19T11:16:49.833988+0000","last_clean":"2024-09-19T11:16:49.833988+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:16:49.833988+0000","last_undegraded":"2024-09-19T11:16:49.833988+0000","last_fullsized":"2024-09-19T11:16:49.833988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:44.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588427+0000","last_change":"2024-09-19T11:13:39.380360+0000","last_active":"2024-09-19T11:14:07.588427+0000","last_peered":"2024-09-19T11:14:07.588427+0000","last_clean":"2024-09-19T11:14:07.588427+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:14:07.588427+0000","last_undegraded":"2024-09-19T11:14:07.588427+0000","last_fullsized":"2024-09-19T11:14:07.588427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:19.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.092425+0000","last_change":"2024-09-19T11:13:41.392005+0000","last_active":"2024-09-19T11:15:42.092425+0000","last_peered":"2024-09-19T11:15:42.092425+0000","last_clean":"2024-09-19T11:15:42.092425+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:15:42.092425+0000","last_undegraded":"2024-09-19T11:15:42.092425+0000","last_fullsized":"2024-09-19T11:15:42.092425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:49.976836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003882+0000","last_change":"2024-09-19T11:13:33.352824+0000","last_active":"2024-09-19T11:16:43.003882+0000","last_peered":"2024-09-19T11:16:43.003882+0000","last_clean":"2024-09-19T11:16:43.003882+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:16:43.003882+0000","last_undegraded":"2024-09-19T11:16:43.003882+0000","last_fullsized":"2024-09-19T11:16:43.003882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:01.378601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587054+0000","last_change":"2024-09-19T11:13:31.377732+0000","last_active":"2024-09-19T11:14:07.587054+0000","last_peered":"2024-09-19T11:14:07.587054+0000","last_clean":"2024-09-19T11:14:07.587054+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:14:07.587054+0000","last_undegraded":"2024-09-19T11:14:07.587054+0000","last_fullsized":"2024-09-19T11:14:07.587054+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:21:08.712618+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598624+0000","last_change":"2024-09-19T11:14:07.597921+0000","last_active":"2024-09-19T11:14:07.598624+0000","last_peered":"2024-09-19T11:14:07.598624+0000","last_clean":"2024-09-19T11:14:07.598624+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:14:07.598624+0000","last_undegraded":"2024-09-19T11:14:07.598624+0000","last_fullsized":"2024-09-19T11:14:07.598624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:55.324299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586647+0000","last_change":"2024-09-19T11:13:37.371652+0000","last_active":"2024-09-19T11:14:07.586647+0000","last_peered":"2024-09-19T11:14:07.586647+0000","last_clean":"2024-09-19T11:14:07.586647+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:14:07.586647+0000","last_undegraded":"2024-09-19T11:14:07.586647+0000","last_fullsized":"2024-09-19T11:14:07.586647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:28.501389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'282","reported_seq":367,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437335+0000","last_change":"2024-09-19T11:13:39.382597+0000","last_active":"2024-09-19T11:16:40.437335+0000","last_peered":"2024-09-19T11:16:40.437335+0000","last_clean":"2024-09-19T11:16:40.437335+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:16:40.437335+0000","last_undegraded":"2024-09-19T11:16:40.437335+0000","last_fullsized":"2024-09-19T11:16:40.437335+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":282,"log_dups_size":0,"ondisk_log_size":282,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:46.620461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.583768+0000","last_change":"2024-09-19T11:13:41.390206+0000","last_active":"2024-09-19T11:14:07.583768+0000","last_peered":"2024-09-19T11:14:07.583768+0000","last_clean":"2024-09-19T11:14:07.583768+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:14:07.583768+0000","last_undegraded":"2024-09-19T11:14:07.583768+0000","last_fullsized":"2024-09-19T11:14:07.583768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:11.171587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003933+0000","last_change":"2024-09-19T11:13:33.345970+0000","last_active":"2024-09-19T11:16:43.003933+0000","last_peered":"2024-09-19T11:16:43.003933+0000","last_clean":"2024-09-19T11:16:43.003933+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:16:43.003933+0000","last_undegraded":"2024-09-19T11:16:43.003933+0000","last_fullsized":"2024-09-19T11:16:43.003933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:42.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596073+0000","last_change":"2024-09-19T11:13:31.363961+0000","last_active":"2024-09-19T11:14:07.596073+0000","last_peered":"2024-09-19T11:14:07.596073+0000","last_clean":"2024-09-19T11:14:07.596073+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:14:07.596073+0000","last_undegraded":"2024-09-19T11:14:07.596073+0000","last_fullsized":"2024-09-19T11:14:07.596073+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:00:09.178158+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593781+0000","last_change":"2024-09-19T11:13:35.355437+0000","last_active":"2024-09-19T11:14:07.593781+0000","last_peered":"2024-09-19T11:14:07.593781+0000","last_clean":"2024-09-19T11:14:07.593781+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:14:07.593781+0000","last_undegraded":"2024-09-19T11:14:07.593781+0000","last_fullsized":"2024-09-19T11:14:07.593781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.209336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'36","reported_seq":82,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.327235+0000","last_change":"2024-09-19T11:13:37.367049+0000","last_active":"2024-09-19T11:15:40.327235+0000","last_peered":"2024-09-19T11:15:40.327235+0000","last_clean":"2024-09-19T11:15:40.327235+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:15:40.327235+0000","last_undegraded":"2024-09-19T11:15:40.327235+0000","last_fullsized":"2024-09-19T11:15:40.327235+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:18.747358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":38,"num_read_kb":29,"num_write":18,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586010+0000","last_change":"2024-09-19T11:13:39.381142+0000","last_active":"2024-09-19T11:14:07.586010+0000","last_peered":"2024-09-19T11:14:07.586010+0000","last_clean":"2024-09-19T11:14:07.586010+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:14:07.586010+0000","last_undegraded":"2024-09-19T11:14:07.586010+0000","last_fullsized":"2024-09-19T11:14:07.586010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:40.981200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.110163+0000","last_change":"2024-09-19T11:13:41.388869+0000","last_active":"2024-09-19T11:14:58.110163+0000","last_peered":"2024-09-19T11:14:58.110163+0000","last_clean":"2024-09-19T11:14:58.110163+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:14:58.110163+0000","last_undegraded":"2024-09-19T11:14:58.110163+0000","last_fullsized":"2024-09-19T11:14:58.110163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:20.834731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739953+0000","last_change":"2024-09-19T11:13:33.347043+0000","last_active":"2024-09-19T11:16:42.739953+0000","last_peered":"2024-09-19T11:16:42.739953+0000","last_clean":"2024-09-19T11:16:42.739953+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:16:42.739953+0000","last_undegraded":"2024-09-19T11:16:42.739953+0000","last_fullsized":"2024-09-19T11:16:42.739953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587518+0000","last_change":"2024-09-19T11:13:31.371968+0000","last_active":"2024-09-19T11:14:07.587518+0000","last_peered":"2024-09-19T11:14:07.587518+0000","last_clean":"2024-09-19T11:14:07.587518+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:14:07.587518+0000","last_undegraded":"2024-09-19T11:14:07.587518+0000","last_fullsized":"2024-09-19T11:14:07.587518+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:25:11.662633+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589719+0000","last_change":"2024-09-19T11:13:35.357430+0000","last_active":"2024-09-19T11:14:07.589719+0000","last_peered":"2024-09-19T11:14:07.589719+0000","last_clean":"2024-09-19T11:14:07.589719+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:14:07.589719+0000","last_undegraded":"2024-09-19T11:14:07.589719+0000","last_fullsized":"2024-09-19T11:14:07.589719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:37.024755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.856771+0000","last_change":"2024-09-19T11:13:37.365759+0000","last_active":"2024-09-19T11:16:49.856771+0000","last_peered":"2024-09-19T11:16:49.856771+0000","last_clean":"2024-09-19T11:16:49.856771+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:16:49.856771+0000","last_undegraded":"2024-09-19T11:16:49.856771+0000","last_fullsized":"2024-09-19T11:16:49.856771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:56.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584006+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.584006+0000","last_peered":"2024-09-19T11:14:07.584006+0000","last_clean":"2024-09-19T11:14:07.584006+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:14:07.584006+0000","last_undegraded":"2024-09-19T11:14:07.584006+0000","last_fullsized":"2024-09-19T11:14:07.584006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:21.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586387+0000","last_change":"2024-09-19T11:13:41.394164+0000","last_active":"2024-09-19T11:14:07.586387+0000","last_peered":"2024-09-19T11:14:07.586387+0000","last_clean":"2024-09-19T11:14:07.586387+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:14:07.586387+0000","last_undegraded":"2024-09-19T11:14:07.586387+0000","last_fullsized":"2024-09-19T11:14:07.586387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.249643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.105117+0000","last_change":"2024-09-19T11:13:33.349183+0000","last_active":"2024-09-19T11:16:43.105117+0000","last_peered":"2024-09-19T11:16:43.105117+0000","last_clean":"2024-09-19T11:16:43.105117+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:16:43.105117+0000","last_undegraded":"2024-09-19T11:16:43.105117+0000","last_fullsized":"2024-09-19T11:16:43.105117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:16.760506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588874+0000","last_change":"2024-09-19T11:13:31.364611+0000","last_active":"2024-09-19T11:14:07.588874+0000","last_peered":"2024-09-19T11:14:07.588874+0000","last_clean":"2024-09-19T11:14:07.588874+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:14:07.588874+0000","last_undegraded":"2024-09-19T11:14:07.588874+0000","last_fullsized":"2024-09-19T11:14:07.588874+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:03.025212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.592890+0000","last_change":"2024-09-19T11:13:35.359098+0000","last_active":"2024-09-19T11:14:07.592890+0000","last_peered":"2024-09-19T11:14:07.592890+0000","last_clean":"2024-09-19T11:14:07.592890+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:14:07.592890+0000","last_undegraded":"2024-09-19T11:14:07.592890+0000","last_fullsized":"2024-09-19T11:14:07.592890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.137473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'26","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.351671+0000","last_change":"2024-09-19T11:13:37.368500+0000","last_active":"2024-09-19T11:15:40.351671+0000","last_peered":"2024-09-19T11:15:40.351671+0000","last_clean":"2024-09-19T11:15:40.351671+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:15:40.351671+0000","last_undegraded":"2024-09-19T11:15:40.351671+0000","last_fullsized":"2024-09-19T11:15:40.351671+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":26,"log_dups_size":0,"ondisk_log_size":26,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:42.855744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":23,"num_read_kb":19,"num_write":8,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584628+0000","last_change":"2024-09-19T11:13:39.375517+0000","last_active":"2024-09-19T11:14:07.584628+0000","last_peered":"2024-09-19T11:14:07.584628+0000","last_clean":"2024-09-19T11:14:07.584628+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:14:07.584628+0000","last_undegraded":"2024-09-19T11:14:07.584628+0000","last_fullsized":"2024-09-19T11:14:07.584628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:42.881775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.362489+0000","last_change":"2024-09-19T11:13:41.393750+0000","last_active":"2024-09-19T11:15:40.362489+0000","last_peered":"2024-09-19T11:15:40.362489+0000","last_clean":"2024-09-19T11:15:40.362489+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:15:40.362489+0000","last_undegraded":"2024-09-19T11:15:40.362489+0000","last_fullsized":"2024-09-19T11:15:40.362489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:29.365114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739944+0000","last_change":"2024-09-19T11:13:33.342298+0000","last_active":"2024-09-19T11:16:42.739944+0000","last_peered":"2024-09-19T11:16:42.739944+0000","last_clean":"2024-09-19T11:16:42.739944+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:16:42.739944+0000","last_undegraded":"2024-09-19T11:16:42.739944+0000","last_fullsized":"2024-09-19T11:16:42.739944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:30.192043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.609055+0000","last_change":"2024-09-19T11:13:31.364730+0000","last_active":"2024-09-19T11:16:42.609055+0000","last_peered":"2024-09-19T11:16:42.609055+0000","last_clean":"2024-09-19T11:16:42.609055+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:42.609055+0000","last_undegraded":"2024-09-19T11:16:42.609055+0000","last_fullsized":"2024-09-19T11:16:42.609055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:42.588516+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.945426+0000","last_change":"2024-09-19T11:13:35.357671+0000","last_active":"2024-09-19T11:15:38.945426+0000","last_peered":"2024-09-19T11:15:38.945426+0000","last_clean":"2024-09-19T11:15:38.945426+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:15:38.945426+0000","last_undegraded":"2024-09-19T11:15:38.945426+0000","last_fullsized":"2024-09-19T11:15:38.945426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:03.047743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'34","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.151584+0000","last_change":"2024-09-19T11:13:37.371443+0000","last_active":"2024-09-19T11:16:42.151584+0000","last_peered":"2024-09-19T11:16:42.151584+0000","last_clean":"2024-09-19T11:16:42.151584+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:16:42.151584+0000","last_undegraded":"2024-09-19T11:16:42.151584+0000","last_fullsized":"2024-09-19T11:16:42.151584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":34,"log_dups_size":0,"ondisk_log_size":34,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.734955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":34,"num_read_kb":30,"num_write":18,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586898+0000","last_change":"2024-09-19T11:13:39.381795+0000","last_active":"2024-09-19T11:14:07.586898+0000","last_peered":"2024-09-19T11:14:07.586898+0000","last_clean":"2024-09-19T11:14:07.586898+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:14:07.586898+0000","last_undegraded":"2024-09-19T11:14:07.586898+0000","last_fullsized":"2024-09-19T11:14:07.586898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:05.918916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.365479+0000","last_change":"2024-09-19T11:13:41.392101+0000","last_active":"2024-09-19T11:15:40.365479+0000","last_peered":"2024-09-19T11:15:40.365479+0000","last_clean":"2024-09-19T11:15:40.365479+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:15:40.365479+0000","last_undegraded":"2024-09-19T11:15:40.365479+0000","last_fullsized":"2024-09-19T11:15:40.365479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:25.270293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.930575+0000","last_change":"2024-09-19T11:13:33.361155+0000","last_active":"2024-09-19T11:14:57.930575+0000","last_peered":"2024-09-19T11:14:57.930575+0000","last_clean":"2024-09-19T11:14:57.930575+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:14:57.930575+0000","last_undegraded":"2024-09-19T11:14:57.930575+0000","last_fullsized":"2024-09-19T11:14:57.930575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:51.951767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.589542+0000","last_change":"2024-09-19T11:13:31.372398+0000","last_active":"2024-09-19T11:14:15.589542+0000","last_peered":"2024-09-19T11:14:15.589542+0000","last_clean":"2024-09-19T11:14:15.589542+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:14:15.589542+0000","last_undegraded":"2024-09-19T11:14:15.589542+0000","last_fullsized":"2024-09-19T11:14:15.589542+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:45:31.237589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899012+0000","last_change":"2024-09-19T11:13:33.352614+0000","last_active":"2024-09-19T11:16:42.899012+0000","last_peered":"2024-09-19T11:16:42.899012+0000","last_clean":"2024-09-19T11:16:42.899012+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:16:42.899012+0000","last_undegraded":"2024-09-19T11:16:42.899012+0000","last_fullsized":"2024-09-19T11:16:42.899012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:26.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585940+0000","last_change":"2024-09-19T11:13:31.363757+0000","last_active":"2024-09-19T11:14:07.585940+0000","last_peered":"2024-09-19T11:14:07.585940+0000","last_clean":"2024-09-19T11:14:07.585940+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:14:07.585940+0000","last_undegraded":"2024-09-19T11:14:07.585940+0000","last_fullsized":"2024-09-19T11:14:07.585940+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:15.610236+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.614216+0000","last_change":"2024-09-19T11:13:33.352551+0000","last_active":"2024-09-19T11:14:15.614216+0000","last_peered":"2024-09-19T11:14:15.614216+0000","last_clean":"2024-09-19T11:14:15.614216+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:14:15.614216+0000","last_undegraded":"2024-09-19T11:14:15.614216+0000","last_fullsized":"2024-09-19T11:14:15.614216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:30.759232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584809+0000","last_change":"2024-09-19T11:13:31.379078+0000","last_active":"2024-09-19T11:14:07.584809+0000","last_peered":"2024-09-19T11:14:07.584809+0000","last_clean":"2024-09-19T11:14:07.584809+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:14:07.584809+0000","last_undegraded":"2024-09-19T11:14:07.584809+0000","last_fullsized":"2024-09-19T11:14:07.584809+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:16.899531+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'19","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.972405+0000","last_change":"2024-09-19T11:13:33.352928+0000","last_active":"2024-09-19T11:16:42.972405+0000","last_peered":"2024-09-19T11:16:42.972405+0000","last_clean":"2024-09-19T11:16:42.972405+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:16:42.972405+0000","last_undegraded":"2024-09-19T11:16:42.972405+0000","last_fullsized":"2024-09-19T11:16:42.972405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:48.077538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587528+0000","last_change":"2024-09-19T11:13:31.379320+0000","last_active":"2024-09-19T11:14:07.587528+0000","last_peered":"2024-09-19T11:14:07.587528+0000","last_clean":"2024-09-19T11:14:07.587528+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:14:07.587528+0000","last_undegraded":"2024-09-19T11:14:07.587528+0000","last_fullsized":"2024-09-19T11:14:07.587528+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:03.713851+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974126+0000","last_change":"2024-09-19T11:13:33.350710+0000","last_active":"2024-09-19T11:16:42.974126+0000","last_peered":"2024-09-19T11:16:42.974126+0000","last_clean":"2024-09-19T11:16:42.974126+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:16:42.974126+0000","last_undegraded":"2024-09-19T11:16:42.974126+0000","last_fullsized":"2024-09-19T11:16:42.974126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:39.016549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587371+0000","last_change":"2024-09-19T11:13:31.364930+0000","last_active":"2024-09-19T11:14:07.587371+0000","last_peered":"2024-09-19T11:14:07.587371+0000","last_clean":"2024-09-19T11:14:07.587371+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:14:07.587371+0000","last_undegraded":"2024-09-19T11:14:07.587371+0000","last_fullsized":"2024-09-19T11:14:07.587371+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:02:12.851669+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740563+0000","last_change":"2024-09-19T11:13:33.356293+0000","last_active":"2024-09-19T11:16:42.740563+0000","last_peered":"2024-09-19T11:16:42.740563+0000","last_clean":"2024-09-19T11:16:42.740563+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:16:42.740563+0000","last_undegraded":"2024-09-19T11:16:42.740563+0000","last_fullsized":"2024-09-19T11:16:42.740563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:41.299802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.883059+0000","last_change":"2024-09-19T11:13:31.365707+0000","last_active":"2024-09-19T11:16:42.883059+0000","last_peered":"2024-09-19T11:16:42.883059+0000","last_clean":"2024-09-19T11:16:42.883059+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:16:42.883059+0000","last_undegraded":"2024-09-19T11:16:42.883059+0000","last_fullsized":"2024-09-19T11:16:42.883059+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:09:40.080906+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899087+0000","last_change":"2024-09-19T11:13:33.342404+0000","last_active":"2024-09-19T11:16:42.899087+0000","last_peered":"2024-09-19T11:16:42.899087+0000","last_clean":"2024-09-19T11:16:42.899087+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:16:42.899087+0000","last_undegraded":"2024-09-19T11:16:42.899087+0000","last_fullsized":"2024-09-19T11:16:42.899087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:34.386826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.592506+0000","last_change":"2024-09-19T11:13:31.357124+0000","last_active":"2024-09-19T11:14:15.592506+0000","last_peered":"2024-09-19T11:14:15.592506+0000","last_clean":"2024-09-19T11:14:15.592506+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:14:15.592506+0000","last_undegraded":"2024-09-19T11:14:15.592506+0000","last_fullsized":"2024-09-19T11:14:15.592506+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:04:00.612209+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114647+0000","last_change":"2024-09-19T11:13:33.350433+0000","last_active":"2024-09-19T11:14:58.114647+0000","last_peered":"2024-09-19T11:14:58.114647+0000","last_clean":"2024-09-19T11:14:58.114647+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:14:58.114647+0000","last_undegraded":"2024-09-19T11:14:58.114647+0000","last_fullsized":"2024-09-19T11:14:58.114647+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:44:46.209831+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.604436+0000","last_change":"2024-09-19T11:13:31.377880+0000","last_active":"2024-09-19T11:14:15.604436+0000","last_peered":"2024-09-19T11:14:15.604436+0000","last_clean":"2024-09-19T11:14:15.604436+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:14:15.604436+0000","last_undegraded":"2024-09-19T11:14:15.604436+0000","last_fullsized":"2024-09-19T11:14:15.604436+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:21:33.996472+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.627034+0000","last_change":"2024-09-19T11:13:33.359004+0000","last_active":"2024-09-19T11:16:42.627034+0000","last_peered":"2024-09-19T11:16:42.627034+0000","last_clean":"2024-09-19T11:16:42.627034+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:16:42.627034+0000","last_undegraded":"2024-09-19T11:16:42.627034+0000","last_fullsized":"2024-09-19T11:16:42.627034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:23.555499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584642+0000","last_change":"2024-09-19T11:13:31.375014+0000","last_active":"2024-09-19T11:14:07.584642+0000","last_peered":"2024-09-19T11:14:07.584642+0000","last_clean":"2024-09-19T11:14:07.584642+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:14:07.584642+0000","last_undegraded":"2024-09-19T11:14:07.584642+0000","last_fullsized":"2024-09-19T11:14:07.584642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:40.622834+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974025+0000","last_change":"2024-09-19T11:13:33.353505+0000","last_active":"2024-09-19T11:16:42.974025+0000","last_peered":"2024-09-19T11:16:42.974025+0000","last_clean":"2024-09-19T11:16:42.974025+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:16:42.974025+0000","last_undegraded":"2024-09-19T11:16:42.974025+0000","last_fullsized":"2024-09-19T11:16:42.974025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:00.609441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.886205+0000","last_change":"2024-09-19T11:13:31.378087+0000","last_active":"2024-09-19T11:16:42.886205+0000","last_peered":"2024-09-19T11:16:42.886205+0000","last_clean":"2024-09-19T11:16:42.886205+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:16:42.886205+0000","last_undegraded":"2024-09-19T11:16:42.886205+0000","last_fullsized":"2024-09-19T11:16:42.886205+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:33:38.991849+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'11","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:50.539564+0000","last_change":"2024-09-19T11:13:33.355120+0000","last_active":"2024-09-19T11:15:50.539564+0000","last_peered":"2024-09-19T11:15:50.539564+0000","last_clean":"2024-09-19T11:15:50.539564+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:15:50.539564+0000","last_undegraded":"2024-09-19T11:15:50.539564+0000","last_fullsized":"2024-09-19T11:15:50.539564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:31.601366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542095+0000","last_change":"2024-09-19T11:13:31.369529+0000","last_active":"2024-09-19T11:15:48.542095+0000","last_peered":"2024-09-19T11:15:48.542095+0000","last_clean":"2024-09-19T11:15:48.542095+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:15:48.542095+0000","last_undegraded":"2024-09-19T11:15:48.542095+0000","last_fullsized":"2024-09-19T11:15:48.542095+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:19.935588+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003913+0000","last_change":"2024-09-19T11:13:33.343642+0000","last_active":"2024-09-19T11:16:43.003913+0000","last_peered":"2024-09-19T11:16:43.003913+0000","last_clean":"2024-09-19T11:16:43.003913+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:16:43.003913+0000","last_undegraded":"2024-09-19T11:16:43.003913+0000","last_fullsized":"2024-09-19T11:16:43.003913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:53.472377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594243+0000","last_change":"2024-09-19T11:13:31.367046+0000","last_active":"2024-09-19T11:14:07.594243+0000","last_peered":"2024-09-19T11:14:07.594243+0000","last_clean":"2024-09-19T11:14:07.594243+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:14:07.594243+0000","last_undegraded":"2024-09-19T11:14:07.594243+0000","last_fullsized":"2024-09-19T11:14:07.594243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:45.073704+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:14:07.601382+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:18:56.799598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586433+0000","last_change":"2024-09-19T11:13:31.368567+0000","last_active":"2024-09-19T11:14:07.586433+0000","last_peered":"2024-09-19T11:14:07.586433+0000","last_clean":"2024-09-19T11:14:07.586433+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:14:07.586433+0000","last_undegraded":"2024-09-19T11:14:07.586433+0000","last_fullsized":"2024-09-19T11:14:07.586433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:54.576708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'11","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542111+0000","last_change":"2024-09-19T11:13:33.358374+0000","last_active":"2024-09-19T11:15:48.542111+0000","last_peered":"2024-09-19T11:15:48.542111+0000","last_clean":"2024-09-19T11:15:48.542111+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:15:48.542111+0000","last_undegraded":"2024-09-19T11:15:48.542111+0000","last_fullsized":"2024-09-19T11:15:48.542111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:51.284800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587720+0000","last_change":"2024-09-19T11:13:31.368596+0000","last_active":"2024-09-19T11:14:07.587720+0000","last_peered":"2024-09-19T11:14:07.587720+0000","last_clean":"2024-09-19T11:14:07.587720+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:14:07.587720+0000","last_undegraded":"2024-09-19T11:14:07.587720+0000","last_fullsized":"2024-09-19T11:14:07.587720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540107+0000","last_change":"2024-09-19T11:13:33.348514+0000","last_active":"2024-09-19T11:15:48.540107+0000","last_peered":"2024-09-19T11:15:48.540107+0000","last_clean":"2024-09-19T11:15:48.540107+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:15:48.540107+0000","last_undegraded":"2024-09-19T11:15:48.540107+0000","last_fullsized":"2024-09-19T11:15:48.540107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:09.293276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590777+0000","last_change":"2024-09-19T11:13:31.358674+0000","last_active":"2024-09-19T11:14:07.590777+0000","last_peered":"2024-09-19T11:14:07.590777+0000","last_clean":"2024-09-19T11:14:07.590777+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:14:07.590777+0000","last_undegraded":"2024-09-19T11:14:07.590777+0000","last_fullsized":"2024-09-19T11:14:07.590777+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:02:33.620173+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380975+0000","last_change":"2024-09-19T11:13:33.349772+0000","last_active":"2024-09-19T11:14:15.380975+0000","last_peered":"2024-09-19T11:14:15.380975+0000","last_clean":"2024-09-19T11:14:15.380975+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:14:15.380975+0000","last_undegraded":"2024-09-19T11:14:15.380975+0000","last_fullsized":"2024-09-19T11:14:15.380975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:19.296584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'1","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:53.541138+0000","last_change":"2024-09-19T11:13:31.367744+0000","last_active":"2024-09-19T11:15:53.541138+0000","last_peered":"2024-09-19T11:15:53.541138+0000","last_clean":"2024-09-19T11:15:53.541138+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:15:53.541138+0000","last_undegraded":"2024-09-19T11:15:53.541138+0000","last_fullsized":"2024-09-19T11:15:53.541138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:00.738468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4190208,"num_objects":1,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585297+0000","last_change":"2024-09-19T11:13:31.375358+0000","last_active":"2024-09-19T11:14:07.585297+0000","last_peered":"2024-09-19T11:14:07.585297+0000","last_clean":"2024-09-19T11:14:07.585297+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:14:07.585297+0000","last_undegraded":"2024-09-19T11:14:07.585297+0000","last_fullsized":"2024-09-19T11:14:07.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:48:05.720807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898876+0000","last_change":"2024-09-19T11:13:33.349130+0000","last_active":"2024-09-19T11:16:42.898876+0000","last_peered":"2024-09-19T11:16:42.898876+0000","last_clean":"2024-09-19T11:16:42.898876+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:16:42.898876+0000","last_undegraded":"2024-09-19T11:16:42.898876+0000","last_fullsized":"2024-09-19T11:16:42.898876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:05.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.565754+0000","last_change":"2024-09-19T11:13:31.378883+0000","last_active":"2024-09-19T11:16:42.565754+0000","last_peered":"2024-09-19T11:16:42.565754+0000","last_clean":"2024-09-19T11:16:42.565754+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:16:42.565754+0000","last_undegraded":"2024-09-19T11:16:42.565754+0000","last_fullsized":"2024-09-19T11:16:42.565754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:48:53.943968+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740036+0000","last_change":"2024-09-19T11:13:33.353238+0000","last_active":"2024-09-19T11:16:42.740036+0000","last_peered":"2024-09-19T11:16:42.740036+0000","last_clean":"2024-09-19T11:16:42.740036+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:16:42.740036+0000","last_undegraded":"2024-09-19T11:16:42.740036+0000","last_fullsized":"2024-09-19T11:16:42.740036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:02.108897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2265,"ondisk_log_size":2265,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1448,"num_read_kb":1245,"num_write":549,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":282624,"data_stored":9115,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1298,"ondisk_log_size":1298,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":965,"num_read_kb":965,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":17429376,"num_objects":5,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":184,"num_read_kb":87,"num_write":311,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":25817088,"data_stored":25817088,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":78,"ondisk_log_size":78,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":3,"ondisk_log_size":3,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":72,"ondisk_log_size":72,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640303,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44252,"kb_used_data":8908,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327588,"statfs":{"total":96636764160,"available":96591450112,"internally_reserved":0,"allocated":9121792,"data_stored":8769388,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":36174279},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640304,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44756,"kb_used_data":9412,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327084,"statfs":{"total":96636764160,"available":96590934016,"internally_reserved":0,"allocated":9637888,"data_stored":9354762,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640304,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44780,"kb_used_data":9436,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94327060,"statfs":{"total":96636764160,"available":96590909440,"internally_reserved":0,"allocated":9662464,"data_stored":9355091,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705711,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":48380,"kb_used_data":8876,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94323460,"statfs":{"total":96636764160,"available":96587223040,"internally_reserved":0,"allocated":9089024,"data_stored":8768369,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":8605696,"data_stored":8605696,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":102400,"data_stored":4269,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:16:54.473 INFO:tasks.ceph:pgid 3.3f last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.473 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.474 INFO:tasks.ceph:pgid 3.3e last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.474 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.474 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.474 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.474 INFO:tasks.ceph:pgid 3.3c last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.474 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.474 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.474 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.475 INFO:tasks.ceph:pgid 3.3a last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.475 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.475 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.475 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.475 INFO:tasks.ceph:pgid 3.38 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.475 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.475 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.475 INFO:tasks.ceph:pgid 3.37 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 3.36 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 3.35 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 3.34 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 3.33 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.476 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 3.13 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.477 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.478 INFO:tasks.ceph:pgid 3.12 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.478 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.478 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.478 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.478 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.478 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.478 INFO:tasks.ceph:pgid 3.11 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.479 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.479 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.479 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.479 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.479 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.479 INFO:tasks.ceph:pgid 3.10 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.479 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.479 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.480 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.480 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.480 INFO:tasks.ceph:pgid 3.f last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.480 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.480 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.480 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.480 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.480 INFO:tasks.ceph:pgid 4.9 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 3.e last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 4.a last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 3.d last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.481 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 4.b last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 3.c last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.482 INFO:tasks.ceph:pgid 4.c last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.483 INFO:tasks.ceph:pgid 3.b last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.483 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.483 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.483 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.483 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.483 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.483 INFO:tasks.ceph:pgid 3.a last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.483 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.484 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.484 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.484 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.484 INFO:tasks.ceph:pgid 4.e last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.484 INFO:tasks.ceph:pgid 3.9 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.484 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.484 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.484 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.485 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.485 INFO:tasks.ceph:pgid 4.f last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.485 INFO:tasks.ceph:pgid 3.8 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.485 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.485 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.485 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.485 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.485 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.486 INFO:tasks.ceph:pgid 1.0 last_scrub_stamp 2024-09-19T11:13:15.217500+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=15, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.486 INFO:tasks.ceph:pgid 2.3 last_scrub_stamp 2024-09-19T11:13:18.232817+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.486 INFO:tasks.ceph:pgid 3.2 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.486 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.486 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.486 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.486 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 2.0 last_scrub_stamp 2024-09-19T11:13:18.232817+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 3.1 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 4.7 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.487 INFO:tasks.ceph:pgid 2.1 last_scrub_stamp 2024-09-19T11:13:18.232817+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.488 INFO:tasks.ceph:pgid 3.0 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.488 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.488 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.488 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.488 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.488 INFO:tasks.ceph:pgid 4.4 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.488 INFO:tasks.ceph:pgid 2.2 last_scrub_stamp 2024-09-19T11:13:18.232817+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.488 INFO:tasks.ceph:pgid 3.3 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.489 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.489 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.489 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.489 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.489 INFO:tasks.ceph:pgid 4.2 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.489 INFO:tasks.ceph:pgid 3.5 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.489 INFO:tasks.ceph:pgid 2.4 last_scrub_stamp 2024-09-19T11:13:18.232817+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.489 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 4.3 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 3.4 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 2.5 last_scrub_stamp 2024-09-19T11:13:18.232817+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.490 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.491 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.491 INFO:tasks.ceph:pgid 4.0 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.491 INFO:tasks.ceph:pgid 3.7 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.491 INFO:tasks.ceph:pgid 2.6 last_scrub_stamp 2024-09-19T11:13:18.232817+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.491 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.491 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.491 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.491 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 4.1 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 3.6 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 2.7 last_scrub_stamp 2024-09-19T11:13:18.232817+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=18, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.492 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.493 INFO:tasks.ceph:pgid 3.14 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.493 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.493 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.493 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.493 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.493 INFO:tasks.ceph:pgid 4.12 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.493 INFO:tasks.ceph:pgid 3.15 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.493 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 3.16 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.494 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.495 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.495 INFO:tasks.ceph:pgid 3.17 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.495 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.495 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.495 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.495 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.495 INFO:tasks.ceph:pgid 3.18 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.495 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 3.19 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.496 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.497 INFO:tasks.ceph:pgid 3.1a last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.497 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.497 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.497 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.497 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.497 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.497 INFO:tasks.ceph:pgid 3.1b last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.497 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.498 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.498 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.498 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.498 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.498 INFO:tasks.ceph:pgid 3.1c last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.498 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.498 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.498 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.499 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.499 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.499 INFO:tasks.ceph:pgid 3.1d last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.499 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.499 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.499 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.499 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.499 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.500 INFO:tasks.ceph:pgid 3.1e last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.500 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.500 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.500 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.500 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.500 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.500 INFO:tasks.ceph:pgid 3.1f last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.500 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.501 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.501 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.501 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.501 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.501 INFO:tasks.ceph:pgid 3.20 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.501 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.501 INFO:tasks.ceph:pgid 3.21 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.501 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 3.22 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 3.23 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 3.24 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 3.25 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.502 INFO:tasks.ceph:pgid 3.26 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.503 INFO:tasks.ceph:pgid 4.20 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.503 INFO:tasks.ceph:pgid 3.27 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.503 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.503 INFO:tasks.ceph:pgid 3.28 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.503 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.503 INFO:tasks.ceph:pgid 3.29 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.503 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.503 INFO:tasks.ceph:pgid 3.2a last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.504 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.504 INFO:tasks.ceph:pgid 3.2b last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.504 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.504 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.504 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.504 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.504 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.505 INFO:tasks.ceph:pgid 3.2e last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.505 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.505 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.505 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.505 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.505 INFO:tasks.ceph:pgid 3.31 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.505 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:16:54.506 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T11:17:14.507 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.621+0000 7f50d103c640 1 Processor -- start 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.621+0000 7f50d103c640 1 -- start start 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.621+0000 7f50d103c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50cc06eaa0 0x7f50cc1326d0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.621+0000 7f50d103c640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f50cc071660 con 0x7f50cc06dfb0 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.621+0000 7f50d103c640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f50cc072550 con 0x7f50cc06eaa0 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.621+0000 7f50ca59c640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f50cc06eaa0 0x7f50cc1326d0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.621+0000 7f50cad9d640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f50cc06dfb0 0x7f50cc06e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:55086/0 (socket says 172.21.15.37:55086) 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.621+0000 7f50cad9d640 1 -- 172.21.15.37:0/1970569745 learned_addr learned my addr 172.21.15.37:0/1970569745 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.622+0000 7f50ca59c640 1 -- 172.21.15.37:0/1970569745 >> v1:172.21.15.37:6789/0 conn(0x7f50cc06dfb0 legacy=0x7f50cc06e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:14.623 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.622+0000 7f50ca59c640 1 -- 172.21.15.37:0/1970569745 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50cc099e20 con 0x7f50cc06eaa0 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.622+0000 7f50ca59c640 1 --2- 172.21.15.37:0/1970569745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06eaa0 0x7f50cc1326d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009720 tx=0x7f50c002a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=9ddf3ebadfa44089 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50c9d9b640 1 -- 172.21.15.37:0/1970569745 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c0037070 con 0x7f50cc06eaa0 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50c9d9b640 1 -- 172.21.15.37:0/1970569745 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50c002ae20 con 0x7f50cc06eaa0 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50c9d9b640 1 -- 172.21.15.37:0/1970569745 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50c0032590 con 0x7f50cc06eaa0 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50d103c640 1 -- 172.21.15.37:0/1970569745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06eaa0 msgr2=0x7f50cc1326d0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50d103c640 1 --2- 172.21.15.37:0/1970569745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06eaa0 0x7f50cc1326d0 secure :-1 s=READY pgs=890 cs=0 l=1 rev1=1 crypto rx=0x7f50c0009720 tx=0x7f50c002a1a0 comp rx=0 tx=0).stop 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50d103c640 1 -- 172.21.15.37:0/1970569745 shutdown_connections 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50d103c640 1 --2- 172.21.15.37:0/1970569745 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06eaa0 0x7f50cc1326d0 unknown :-1 s=CLOSED pgs=890 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50d103c640 1 -- 172.21.15.37:0/1970569745 >> 172.21.15.37:0/1970569745 conn(0x7f50cc09abc0 msgr2=0x7f50cc098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50d103c640 1 -- 172.21.15.37:0/1970569745 shutdown_connections 2024-09-19T11:17:14.625 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.623+0000 7f50d103c640 1 -- 172.21.15.37:0/1970569745 wait complete. 2024-09-19T11:17:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.624+0000 7f50d103c640 1 Processor -- start 2024-09-19T11:17:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.624+0000 7f50d103c640 1 -- start start 2024-09-19T11:17:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.625+0000 7f50d103c640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06dfb0 0x7f50cc1299e0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.625+0000 7f50d103c640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f50cc0712d0 con 0x7f50cc06dfb0 2024-09-19T11:17:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.625+0000 7f50cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06dfb0 0x7f50cc1299e0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.625+0000 7f50cad9d640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06dfb0 0x7f50cc1299e0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:40770/0 (socket says 172.21.15.37:40770) 2024-09-19T11:17:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.625+0000 7f50cad9d640 1 -- 172.21.15.37:0/1073816892 learned_addr learned my addr 172.21.15.37:0/1073816892 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:17:14.627 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.625+0000 7f50cad9d640 1 -- 172.21.15.37:0/1073816892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f50cc128380 con 0x7f50cc06dfb0 2024-09-19T11:17:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.625+0000 7f50cad9d640 1 --2- 172.21.15.37:0/1073816892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06dfb0 0x7f50cc1299e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00c480 tx=0x7f50bc00c940 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.626+0000 7f50b37fe640 1 -- 172.21.15.37:0/1073816892 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50bc017070 con 0x7f50cc06dfb0 2024-09-19T11:17:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.626+0000 7f50b37fe640 1 -- 172.21.15.37:0/1073816892 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f50bc005c10 con 0x7f50cc06dfb0 2024-09-19T11:17:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.626+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f50cc129460 con 0x7f50cc06dfb0 2024-09-19T11:17:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.626+0000 7f50b37fe640 1 -- 172.21.15.37:0/1073816892 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f50bc007070 con 0x7f50cc06dfb0 2024-09-19T11:17:14.628 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.626+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f50cc129f20 con 0x7f50cc06dfb0 2024-09-19T11:17:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.627+0000 7f50b37fe640 1 -- 172.21.15.37:0/1073816892 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f50bc01a070 con 0x7f50cc06dfb0 2024-09-19T11:17:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.627+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f50cc1271d0 con 0x7f50cc06dfb0 2024-09-19T11:17:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.627+0000 7f50b37fe640 1 --2- 172.21.15.37:0/1073816892 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f50b803e710 0x7f50b8040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.627+0000 7f50b37fe640 1 -- 172.21.15.37:0/1073816892 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f50bc052a40 con 0x7f50cc06dfb0 2024-09-19T11:17:14.629 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.627+0000 7f50ca59c640 1 --2- 172.21.15.37:0/1073816892 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f50b803e710 0x7f50b8040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:14.630 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.628+0000 7f50ca59c640 1 --2- 172.21.15.37:0/1073816892 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f50b803e710 0x7f50b8040bd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f50c0034000 tx=0x7f50c002e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:14.633 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.632+0000 7f50b37fe640 1 -- 172.21.15.37:0/1073816892 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f50bc01ac60 con 0x7f50cc06dfb0 2024-09-19T11:17:14.819 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.818+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f50cc128c20 con 0x7f50b803e710 2024-09-19T11:17:14.830 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.829+0000 7f50b37fe640 1 -- 172.21.15.37:0/1073816892 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666020 (secure 0 0 0) 0x7f50cc128c20 con 0x7f50b803e710 2024-09-19T11:17:14.838 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:17:14.844 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f50b803e710 msgr2=0x7f50b8040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 --2- 172.21.15.37:0/1073816892 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f50b803e710 0x7f50b8040bd0 secure :-1 s=READY pgs=369 cs=0 l=1 rev1=1 crypto rx=0x7f50c0034000 tx=0x7f50c002e000 comp rx=0 tx=0).stop 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06dfb0 msgr2=0x7f50cc1299e0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 --2- 172.21.15.37:0/1073816892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06dfb0 0x7f50cc1299e0 secure :-1 s=READY pgs=891 cs=0 l=1 rev1=1 crypto rx=0x7f50bc00c480 tx=0x7f50bc00c940 comp rx=0 tx=0).stop 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 shutdown_connections 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 --2- 172.21.15.37:0/1073816892 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f50b803e710 0x7f50b8040bd0 unknown :-1 s=CLOSED pgs=369 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 --2- 172.21.15.37:0/1073816892 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f50cc06dfb0 0x7f50cc1299e0 unknown :-1 s=CLOSED pgs=891 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 >> 172.21.15.37:0/1073816892 conn(0x7f50cc09abc0 msgr2=0x7f50cc12e6b0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:17:14.847 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 shutdown_connections 2024-09-19T11:17:14.848 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:14.834+0000 7f50d103c640 1 -- 172.21.15.37:0/1073816892 wait complete. 2024-09-19T11:17:14.849 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":156,"stamp":"2024-09-19T11:17:14.588296+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5183,"num_read_kb":4725,"num_write":2125,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4570,"ondisk_log_size":4570,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":152704,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":149625,"kb_avail":377334656,"statfs":{"total":386547056640,"available":386390687744,"internally_reserved":0,"allocated":3080192,"data_stored":1821404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":153216790},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003954"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.185503+0000","last_change":"2024-09-19T11:17:09.185503+0000","last_active":"2024-09-19T11:17:09.185503+0000","last_peered":"2024-09-19T11:17:09.185503+0000","last_clean":"2024-09-19T11:17:09.185503+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:17:09.185503+0000","last_undegraded":"2024-09-19T11:17:09.185503+0000","last_fullsized":"2024-09-19T11:17:09.185503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.185421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:28.271527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.114848+0000","last_change":"2024-09-19T11:13:33.358262+0000","last_active":"2024-09-19T11:14:58.114848+0000","last_peered":"2024-09-19T11:14:58.114848+0000","last_clean":"2024-09-19T11:14:58.114848+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:14:58.114848+0000","last_undegraded":"2024-09-19T11:14:58.114848+0000","last_fullsized":"2024-09-19T11:14:58.114848+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:56:04.357110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.722223+0000","last_change":"2024-09-19T11:17:07.722223+0000","last_active":"2024-09-19T11:17:07.722223+0000","last_peered":"2024-09-19T11:17:07.722223+0000","last_clean":"2024-09-19T11:17:07.722223+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:17:07.722223+0000","last_undegraded":"2024-09-19T11:17:07.722223+0000","last_fullsized":"2024-09-19T11:17:07.722223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.722137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:30.023844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.010386+0000","last_change":"2024-09-19T11:13:33.353250+0000","last_active":"2024-09-19T11:16:43.010386+0000","last_peered":"2024-09-19T11:16:43.010386+0000","last_clean":"2024-09-19T11:16:43.010386+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:16:43.010386+0000","last_undegraded":"2024-09-19T11:16:43.010386+0000","last_fullsized":"2024-09-19T11:16:43.010386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:36.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588134+0000","last_change":"2024-09-19T11:13:31.373399+0000","last_active":"2024-09-19T11:14:07.588134+0000","last_peered":"2024-09-19T11:14:07.588134+0000","last_clean":"2024-09-19T11:14:07.588134+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:14:07.588134+0000","last_undegraded":"2024-09-19T11:14:07.588134+0000","last_fullsized":"2024-09-19T11:14:07.588134+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:37:37.878601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740541+0000","last_change":"2024-09-19T11:14:07.595868+0000","last_active":"2024-09-19T11:16:42.740541+0000","last_peered":"2024-09-19T11:16:42.740541+0000","last_clean":"2024-09-19T11:16:42.740541+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:16:42.740541+0000","last_undegraded":"2024-09-19T11:16:42.740541+0000","last_fullsized":"2024-09-19T11:16:42.740541+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:59.387595+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.203719+0000","last_change":"2024-09-19T11:17:07.203719+0000","last_active":"2024-09-19T11:17:07.203719+0000","last_peered":"2024-09-19T11:17:07.203719+0000","last_clean":"2024-09-19T11:17:07.203719+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:07.203719+0000","last_undegraded":"2024-09-19T11:17:07.203719+0000","last_fullsized":"2024-09-19T11:17:07.203719+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.203629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:11.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.965800+0000","last_change":"2024-09-19T11:13:33.349816+0000","last_active":"2024-09-19T11:16:42.965800+0000","last_peered":"2024-09-19T11:16:42.965800+0000","last_clean":"2024-09-19T11:16:42.965800+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:16:42.965800+0000","last_undegraded":"2024-09-19T11:16:42.965800+0000","last_fullsized":"2024-09-19T11:16:42.965800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:57.078087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586339+0000","last_change":"2024-09-19T11:13:31.373460+0000","last_active":"2024-09-19T11:14:07.586339+0000","last_peered":"2024-09-19T11:14:07.586339+0000","last_clean":"2024-09-19T11:14:07.586339+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:14:07.586339+0000","last_undegraded":"2024-09-19T11:14:07.586339+0000","last_fullsized":"2024-09-19T11:14:07.586339+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:41:25.708826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003992+0000","last_change":"2024-09-19T11:13:33.347020+0000","last_active":"2024-09-19T11:16:43.003992+0000","last_peered":"2024-09-19T11:16:43.003992+0000","last_clean":"2024-09-19T11:16:43.003992+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:16:43.003992+0000","last_undegraded":"2024-09-19T11:16:43.003992+0000","last_fullsized":"2024-09-19T11:16:43.003992+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:10.234097+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.173145+0000","last_change":"2024-09-19T11:17:06.173145+0000","last_active":"2024-09-19T11:17:06.173145+0000","last_peered":"2024-09-19T11:17:06.173145+0000","last_clean":"2024-09-19T11:17:06.173145+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:17:06.173145+0000","last_undegraded":"2024-09-19T11:17:06.173145+0000","last_fullsized":"2024-09-19T11:17:06.173145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.173052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:49.733204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'21","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:13.543344+0000","last_change":"2024-09-19T11:14:07.607174+0000","last_active":"2024-09-19T11:16:13.543344+0000","last_peered":"2024-09-19T11:16:13.543344+0000","last_clean":"2024-09-19T11:16:13.543344+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:16:13.543344+0000","last_undegraded":"2024-09-19T11:16:13.543344+0000","last_fullsized":"2024-09-19T11:16:13.543344+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:11:02.443641+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585495+0000","last_change":"2024-09-19T11:13:31.366931+0000","last_active":"2024-09-19T11:14:07.585495+0000","last_peered":"2024-09-19T11:14:07.585495+0000","last_clean":"2024-09-19T11:14:07.585495+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:14:07.585495+0000","last_undegraded":"2024-09-19T11:14:07.585495+0000","last_fullsized":"2024-09-19T11:14:07.585495+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:34.986032+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966174+0000","last_change":"2024-09-19T11:13:33.347406+0000","last_active":"2024-09-19T11:16:42.966174+0000","last_peered":"2024-09-19T11:16:42.966174+0000","last_clean":"2024-09-19T11:16:42.966174+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:16:42.966174+0000","last_undegraded":"2024-09-19T11:16:42.966174+0000","last_fullsized":"2024-09-19T11:16:42.966174+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:53.972293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.735731+0000","last_change":"2024-09-19T11:17:05.735731+0000","last_active":"2024-09-19T11:17:05.735731+0000","last_peered":"2024-09-19T11:17:05.735731+0000","last_clean":"2024-09-19T11:17:05.735731+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:17:05.735731+0000","last_undegraded":"2024-09-19T11:17:05.735731+0000","last_fullsized":"2024-09-19T11:17:05.735731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.735639+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:45.185308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:13:33.353995+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:06:03.658589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096691+0000","last_change":"2024-09-19T11:13:33.353058+0000","last_active":"2024-09-19T11:15:42.096691+0000","last_peered":"2024-09-19T11:15:42.096691+0000","last_clean":"2024-09-19T11:15:42.096691+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:15:42.096691+0000","last_undegraded":"2024-09-19T11:15:42.096691+0000","last_fullsized":"2024-09-19T11:15:42.096691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:02.922700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.728105+0000","last_change":"2024-09-19T11:17:03.728105+0000","last_active":"2024-09-19T11:17:03.728105+0000","last_peered":"2024-09-19T11:17:03.728105+0000","last_clean":"2024-09-19T11:17:03.728105+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:17:03.728105+0000","last_undegraded":"2024-09-19T11:17:03.728105+0000","last_fullsized":"2024-09-19T11:17:03.728105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.728013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:50.046423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.594343+0000","last_change":"2024-09-19T11:13:33.357169+0000","last_active":"2024-09-19T11:14:07.594343+0000","last_peered":"2024-09-19T11:14:07.594343+0000","last_clean":"2024-09-19T11:14:07.594343+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:14:07.594343+0000","last_undegraded":"2024-09-19T11:14:07.594343+0000","last_fullsized":"2024-09-19T11:14:07.594343+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:54.145525+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.201897+0000","last_change":"2024-09-19T11:17:05.201897+0000","last_active":"2024-09-19T11:17:05.201897+0000","last_peered":"2024-09-19T11:17:05.201897+0000","last_clean":"2024-09-19T11:17:05.201897+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:17:05.201897+0000","last_undegraded":"2024-09-19T11:17:05.201897+0000","last_fullsized":"2024-09-19T11:17:05.201897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.201777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:39.204473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595274+0000","last_change":"2024-09-19T11:13:33.359507+0000","last_active":"2024-09-19T11:14:07.595274+0000","last_peered":"2024-09-19T11:14:07.595274+0000","last_clean":"2024-09-19T11:14:07.595274+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:14:07.595274+0000","last_undegraded":"2024-09-19T11:14:07.595274+0000","last_fullsized":"2024-09-19T11:14:07.595274+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:18.272518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.571584+0000","last_change":"2024-09-19T11:17:10.571584+0000","last_active":"2024-09-19T11:17:10.571584+0000","last_peered":"2024-09-19T11:17:10.571584+0000","last_clean":"2024-09-19T11:17:10.571584+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:17:10.571584+0000","last_undegraded":"2024-09-19T11:17:10.571584+0000","last_fullsized":"2024-09-19T11:17:10.571584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.571487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:05.033249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966073+0000","last_change":"2024-09-19T11:13:33.350242+0000","last_active":"2024-09-19T11:16:42.966073+0000","last_peered":"2024-09-19T11:16:42.966073+0000","last_clean":"2024-09-19T11:16:42.966073+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:16:42.966073+0000","last_undegraded":"2024-09-19T11:16:42.966073+0000","last_fullsized":"2024-09-19T11:16:42.966073+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:29.796543+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.677222+0000","last_change":"2024-09-19T11:17:06.677222+0000","last_active":"2024-09-19T11:17:06.677222+0000","last_peered":"2024-09-19T11:17:06.677222+0000","last_clean":"2024-09-19T11:17:06.677222+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:17:06.677222+0000","last_undegraded":"2024-09-19T11:17:06.677222+0000","last_fullsized":"2024-09-19T11:17:06.677222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.677123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:51.934638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":61,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004192+0000","last_change":"2024-09-19T11:13:33.354404+0000","last_active":"2024-09-19T11:16:43.004192+0000","last_peered":"2024-09-19T11:16:43.004192+0000","last_clean":"2024-09-19T11:16:43.004192+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:16:43.004192+0000","last_undegraded":"2024-09-19T11:16:43.004192+0000","last_fullsized":"2024-09-19T11:16:43.004192+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:18.704309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.749724+0000","last_change":"2024-09-19T11:17:03.749724+0000","last_active":"2024-09-19T11:17:03.749724+0000","last_peered":"2024-09-19T11:17:03.749724+0000","last_clean":"2024-09-19T11:17:03.749724+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:17:03.749724+0000","last_undegraded":"2024-09-19T11:17:03.749724+0000","last_fullsized":"2024-09-19T11:17:03.749724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.749624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:09.231023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380970+0000","last_change":"2024-09-19T11:13:33.345480+0000","last_active":"2024-09-19T11:14:15.380970+0000","last_peered":"2024-09-19T11:14:15.380970+0000","last_clean":"2024-09-19T11:14:15.380970+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:14:15.380970+0000","last_undegraded":"2024-09-19T11:14:15.380970+0000","last_fullsized":"2024-09-19T11:14:15.380970+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:37.629627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585477+0000","last_change":"2024-09-19T11:13:31.368987+0000","last_active":"2024-09-19T11:14:07.585477+0000","last_peered":"2024-09-19T11:14:07.585477+0000","last_clean":"2024-09-19T11:14:07.585477+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:14:07.585477+0000","last_undegraded":"2024-09-19T11:14:07.585477+0000","last_fullsized":"2024-09-19T11:14:07.585477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:51.462004+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.938013+0000","last_change":"2024-09-19T11:13:41.395109+0000","last_active":"2024-09-19T11:16:42.938013+0000","last_peered":"2024-09-19T11:16:42.938013+0000","last_clean":"2024-09-19T11:16:42.938013+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:16:42.938013+0000","last_undegraded":"2024-09-19T11:16:42.938013+0000","last_fullsized":"2024-09-19T11:16:42.938013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:41.943528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.635691+0000","last_change":"2024-09-19T11:13:33.348565+0000","last_active":"2024-09-19T11:16:42.635691+0000","last_peered":"2024-09-19T11:16:42.635691+0000","last_clean":"2024-09-19T11:16:42.635691+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:16:42.635691+0000","last_undegraded":"2024-09-19T11:16:42.635691+0000","last_fullsized":"2024-09-19T11:16:42.635691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:33:09.744080+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.339744+0000","last_change":"2024-09-19T11:17:08.339744+0000","last_active":"2024-09-19T11:17:08.339744+0000","last_peered":"2024-09-19T11:17:08.339744+0000","last_clean":"2024-09-19T11:17:08.339744+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:17:08.339744+0000","last_undegraded":"2024-09-19T11:17:08.339744+0000","last_fullsized":"2024-09-19T11:17:08.339744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.339654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:36.909793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586243+0000","last_change":"2024-09-19T11:13:35.358078+0000","last_active":"2024-09-19T11:14:07.586243+0000","last_peered":"2024-09-19T11:14:07.586243+0000","last_clean":"2024-09-19T11:14:07.586243+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:14:07.586243+0000","last_undegraded":"2024-09-19T11:14:07.586243+0000","last_fullsized":"2024-09-19T11:14:07.586243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:59.783214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.803962+0000","last_change":"2024-09-19T11:13:37.368405+0000","last_active":"2024-09-19T11:16:49.803962+0000","last_peered":"2024-09-19T11:16:49.803962+0000","last_clean":"2024-09-19T11:16:49.803962+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:16:49.803962+0000","last_undegraded":"2024-09-19T11:16:49.803962+0000","last_fullsized":"2024-09-19T11:16:49.803962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:09.867739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596623+0000","last_change":"2024-09-19T11:13:39.376399+0000","last_active":"2024-09-19T11:14:07.596623+0000","last_peered":"2024-09-19T11:14:07.596623+0000","last_clean":"2024-09-19T11:14:07.596623+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:14:07.596623+0000","last_undegraded":"2024-09-19T11:14:07.596623+0000","last_fullsized":"2024-09-19T11:14:07.596623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:16.668274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.935993+0000","last_change":"2024-09-19T11:13:41.393295+0000","last_active":"2024-09-19T11:14:57.935993+0000","last_peered":"2024-09-19T11:14:57.935993+0000","last_clean":"2024-09-19T11:14:57.935993+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:14:57.935993+0000","last_undegraded":"2024-09-19T11:14:57.935993+0000","last_fullsized":"2024-09-19T11:14:57.935993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:48.199857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.112515+0000","last_change":"2024-09-19T11:13:33.353288+0000","last_active":"2024-09-19T11:14:58.112515+0000","last_peered":"2024-09-19T11:14:58.112515+0000","last_clean":"2024-09-19T11:14:58.112515+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:14:58.112515+0000","last_undegraded":"2024-09-19T11:14:58.112515+0000","last_fullsized":"2024-09-19T11:14:58.112515+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:41:13.684931+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.229925+0000","last_change":"2024-09-19T11:16:59.229925+0000","last_active":"2024-09-19T11:16:59.229925+0000","last_peered":"2024-09-19T11:16:59.229925+0000","last_clean":"2024-09-19T11:16:59.229925+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:16:59.229925+0000","last_undegraded":"2024-09-19T11:16:59.229925+0000","last_fullsized":"2024-09-19T11:16:59.229925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.229836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.835840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586880+0000","last_change":"2024-09-19T11:13:35.350079+0000","last_active":"2024-09-19T11:14:07.586880+0000","last_peered":"2024-09-19T11:14:07.586880+0000","last_clean":"2024-09-19T11:14:07.586880+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:14:07.586880+0000","last_undegraded":"2024-09-19T11:14:07.586880+0000","last_fullsized":"2024-09-19T11:14:07.586880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:28.629336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596198+0000","last_change":"2024-09-19T11:13:37.365209+0000","last_active":"2024-09-19T11:14:07.596198+0000","last_peered":"2024-09-19T11:14:07.596198+0000","last_clean":"2024-09-19T11:14:07.596198+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:14:07.596198+0000","last_undegraded":"2024-09-19T11:14:07.596198+0000","last_fullsized":"2024-09-19T11:14:07.596198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:11.593458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595746+0000","last_change":"2024-09-19T11:13:39.377776+0000","last_active":"2024-09-19T11:14:07.595746+0000","last_peered":"2024-09-19T11:14:07.595746+0000","last_clean":"2024-09-19T11:14:07.595746+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:14:07.595746+0000","last_undegraded":"2024-09-19T11:14:07.595746+0000","last_fullsized":"2024-09-19T11:14:07.595746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:02.688553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586216+0000","last_change":"2024-09-19T11:13:41.387845+0000","last_active":"2024-09-19T11:14:07.586216+0000","last_peered":"2024-09-19T11:14:07.586216+0000","last_clean":"2024-09-19T11:14:07.586216+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:14:07.586216+0000","last_undegraded":"2024-09-19T11:14:07.586216+0000","last_fullsized":"2024-09-19T11:14:07.586216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:01.782452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":107,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004066+0000","last_change":"2024-09-19T11:13:33.354310+0000","last_active":"2024-09-19T11:16:43.004066+0000","last_peered":"2024-09-19T11:16:43.004066+0000","last_clean":"2024-09-19T11:16:43.004066+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:16:43.004066+0000","last_undegraded":"2024-09-19T11:16:43.004066+0000","last_fullsized":"2024-09-19T11:16:43.004066+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:14.803193+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.361981+0000","last_change":"2024-09-19T11:17:06.361981+0000","last_active":"2024-09-19T11:17:06.361981+0000","last_peered":"2024-09-19T11:17:06.361981+0000","last_clean":"2024-09-19T11:17:06.361981+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:17:06.361981+0000","last_undegraded":"2024-09-19T11:17:06.361981+0000","last_fullsized":"2024-09-19T11:17:06.361981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.361895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.368884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":12,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:08.524886+0000","last_change":"2024-09-19T11:14:07.594305+0000","last_active":"2024-09-19T11:14:08.524886+0000","last_peered":"2024-09-19T11:14:08.524886+0000","last_clean":"2024-09-19T11:14:08.524886+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:14:08.524886+0000","last_undegraded":"2024-09-19T11:14:08.524886+0000","last_fullsized":"2024-09-19T11:14:08.524886+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:34.741293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"35'11","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587760+0000","last_change":"2024-09-19T11:13:37.365423+0000","last_active":"2024-09-19T11:14:07.587760+0000","last_peered":"2024-09-19T11:14:07.587760+0000","last_clean":"2024-09-19T11:14:07.587760+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:14:07.587760+0000","last_undegraded":"2024-09-19T11:14:07.587760+0000","last_fullsized":"2024-09-19T11:14:07.587760+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:05.026614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":385,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.714648+0000","last_change":"2024-09-19T11:13:39.380724+0000","last_active":"2024-09-19T11:16:49.714648+0000","last_peered":"2024-09-19T11:16:49.714648+0000","last_clean":"2024-09-19T11:16:49.714648+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:16:49.714648+0000","last_undegraded":"2024-09-19T11:16:49.714648+0000","last_fullsized":"2024-09-19T11:16:49.714648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587647+0000","last_change":"2024-09-19T11:13:41.387332+0000","last_active":"2024-09-19T11:14:07.587647+0000","last_peered":"2024-09-19T11:14:07.587647+0000","last_clean":"2024-09-19T11:14:07.587647+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:14:07.587647+0000","last_undegraded":"2024-09-19T11:14:07.587647+0000","last_fullsized":"2024-09-19T11:14:07.587647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:45.206952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740577+0000","last_change":"2024-09-19T11:13:33.349800+0000","last_active":"2024-09-19T11:16:42.740577+0000","last_peered":"2024-09-19T11:16:42.740577+0000","last_clean":"2024-09-19T11:16:42.740577+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:16:42.740577+0000","last_undegraded":"2024-09-19T11:16:42.740577+0000","last_fullsized":"2024-09-19T11:16:42.740577+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:01:07.241186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.839089+0000","last_change":"2024-09-19T11:16:55.839089+0000","last_active":"2024-09-19T11:16:55.839089+0000","last_peered":"2024-09-19T11:16:55.839089+0000","last_clean":"2024-09-19T11:16:55.839089+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:55.839089+0000","last_undegraded":"2024-09-19T11:16:55.839089+0000","last_fullsized":"2024-09-19T11:16:55.839089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.839001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.925106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586260+0000","last_change":"2024-09-19T11:13:35.355473+0000","last_active":"2024-09-19T11:14:07.586260+0000","last_peered":"2024-09-19T11:14:07.586260+0000","last_clean":"2024-09-19T11:14:07.586260+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:14:07.586260+0000","last_undegraded":"2024-09-19T11:14:07.586260+0000","last_fullsized":"2024-09-19T11:14:07.586260+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:26.695828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.772995+0000","last_change":"2024-09-19T11:13:37.367406+0000","last_active":"2024-09-19T11:16:49.772995+0000","last_peered":"2024-09-19T11:16:49.772995+0000","last_clean":"2024-09-19T11:16:49.772995+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:16:49.772995+0000","last_undegraded":"2024-09-19T11:16:49.772995+0000","last_fullsized":"2024-09-19T11:16:49.772995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.650159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":445,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.719611+0000","last_change":"2024-09-19T11:13:39.380575+0000","last_active":"2024-09-19T11:16:49.719611+0000","last_peered":"2024-09-19T11:16:49.719611+0000","last_clean":"2024-09-19T11:16:49.719611+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:16:49.719611+0000","last_undegraded":"2024-09-19T11:16:49.719611+0000","last_fullsized":"2024-09-19T11:16:49.719611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:21.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898938+0000","last_change":"2024-09-19T11:13:33.354325+0000","last_active":"2024-09-19T11:16:42.898938+0000","last_peered":"2024-09-19T11:16:42.898938+0000","last_clean":"2024-09-19T11:16:42.898938+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:16:42.898938+0000","last_undegraded":"2024-09-19T11:16:42.898938+0000","last_fullsized":"2024-09-19T11:16:42.898938+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:50.753957+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.263964+0000","last_change":"2024-09-19T11:16:57.263964+0000","last_active":"2024-09-19T11:16:57.263964+0000","last_peered":"2024-09-19T11:16:57.263964+0000","last_clean":"2024-09-19T11:16:57.263964+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:16:57.263964+0000","last_undegraded":"2024-09-19T11:16:57.263964+0000","last_fullsized":"2024-09-19T11:16:57.263964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.263877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:17.532651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593431+0000","last_change":"2024-09-19T11:13:35.356693+0000","last_active":"2024-09-19T11:14:07.593431+0000","last_peered":"2024-09-19T11:14:07.593431+0000","last_clean":"2024-09-19T11:14:07.593431+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:14:07.593431+0000","last_undegraded":"2024-09-19T11:14:07.593431+0000","last_fullsized":"2024-09-19T11:14:07.593431+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:47:50.222469+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'43","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.816985+0000","last_change":"2024-09-19T11:13:37.371444+0000","last_active":"2024-09-19T11:16:49.816985+0000","last_peered":"2024-09-19T11:16:49.816985+0000","last_clean":"2024-09-19T11:16:49.816985+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:16:49.816985+0000","last_undegraded":"2024-09-19T11:16:49.816985+0000","last_fullsized":"2024-09-19T11:16:49.816985+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":43,"log_dups_size":0,"ondisk_log_size":43,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:02:45.830373+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587567+0000","last_change":"2024-09-19T11:13:39.374414+0000","last_active":"2024-09-19T11:14:07.587567+0000","last_peered":"2024-09-19T11:14:07.587567+0000","last_clean":"2024-09-19T11:14:07.587567+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:14:07.587567+0000","last_undegraded":"2024-09-19T11:14:07.587567+0000","last_fullsized":"2024-09-19T11:14:07.587567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:56.581253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.937677+0000","last_change":"2024-09-19T11:13:41.391613+0000","last_active":"2024-09-19T11:14:57.937677+0000","last_peered":"2024-09-19T11:14:57.937677+0000","last_clean":"2024-09-19T11:14:57.937677+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:14:57.937677+0000","last_undegraded":"2024-09-19T11:14:57.937677+0000","last_fullsized":"2024-09-19T11:14:57.937677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:05.344146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.628983+0000","last_change":"2024-09-19T11:17:07.628983+0000","last_active":"2024-09-19T11:17:07.628983+0000","last_peered":"2024-09-19T11:17:07.628983+0000","last_clean":"2024-09-19T11:17:07.628983+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:17:07.628983+0000","last_undegraded":"2024-09-19T11:17:07.628983+0000","last_fullsized":"2024-09-19T11:17:07.628983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.628902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:57.737242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.261648+0000","last_change":"2024-09-19T11:16:56.261648+0000","last_active":"2024-09-19T11:16:56.261648+0000","last_peered":"2024-09-19T11:16:56.261648+0000","last_clean":"2024-09-19T11:16:56.261648+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:16:56.261648+0000","last_undegraded":"2024-09-19T11:16:56.261648+0000","last_fullsized":"2024-09-19T11:16:56.261648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.261557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:54.106719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586420+0000","last_change":"2024-09-19T11:13:35.352067+0000","last_active":"2024-09-19T11:14:07.586420+0000","last_peered":"2024-09-19T11:14:07.586420+0000","last_clean":"2024-09-19T11:14:07.586420+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:14:07.586420+0000","last_undegraded":"2024-09-19T11:14:07.586420+0000","last_fullsized":"2024-09-19T11:14:07.586420+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:01:58.648797+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.859823+0000","last_change":"2024-09-19T11:13:37.369761+0000","last_active":"2024-09-19T11:16:49.859823+0000","last_peered":"2024-09-19T11:16:49.859823+0000","last_clean":"2024-09-19T11:16:49.859823+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:16:49.859823+0000","last_undegraded":"2024-09-19T11:16:49.859823+0000","last_fullsized":"2024-09-19T11:16:49.859823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.455607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587463+0000","last_change":"2024-09-19T11:13:39.381205+0000","last_active":"2024-09-19T11:14:07.587463+0000","last_peered":"2024-09-19T11:14:07.587463+0000","last_clean":"2024-09-19T11:14:07.587463+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:14:07.587463+0000","last_undegraded":"2024-09-19T11:14:07.587463+0000","last_fullsized":"2024-09-19T11:14:07.587463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:48.612042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:52.381729+0000","last_change":"2024-09-19T11:13:41.393002+0000","last_active":"2024-09-19T11:14:52.381729+0000","last_peered":"2024-09-19T11:14:52.381729+0000","last_clean":"2024-09-19T11:14:52.381729+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:14:52.381729+0000","last_undegraded":"2024-09-19T11:14:52.381729+0000","last_fullsized":"2024-09-19T11:14:52.381729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:23.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.203698+0000","last_change":"2024-09-19T11:17:11.203698+0000","last_active":"2024-09-19T11:17:11.203698+0000","last_peered":"2024-09-19T11:17:11.203698+0000","last_clean":"2024-09-19T11:17:11.203698+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:17:11.203698+0000","last_undegraded":"2024-09-19T11:17:11.203698+0000","last_fullsized":"2024-09-19T11:17:11.203698+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.203591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:37.021206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.352287+0000","last_change":"2024-09-19T11:17:05.352287+0000","last_active":"2024-09-19T11:17:05.352287+0000","last_peered":"2024-09-19T11:17:05.352287+0000","last_clean":"2024-09-19T11:17:05.352287+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:17:05.352287+0000","last_undegraded":"2024-09-19T11:17:05.352287+0000","last_fullsized":"2024-09-19T11:17:05.352287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.352205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:29.817735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587259+0000","last_change":"2024-09-19T11:13:35.349926+0000","last_active":"2024-09-19T11:14:07.587259+0000","last_peered":"2024-09-19T11:14:07.587259+0000","last_clean":"2024-09-19T11:14:07.587259+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:14:07.587259+0000","last_undegraded":"2024-09-19T11:14:07.587259+0000","last_fullsized":"2024-09-19T11:14:07.587259+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:44:43.037527+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'40","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.824513+0000","last_change":"2024-09-19T11:13:37.371294+0000","last_active":"2024-09-19T11:16:49.824513+0000","last_peered":"2024-09-19T11:16:49.824513+0000","last_clean":"2024-09-19T11:16:49.824513+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:16:49.824513+0000","last_undegraded":"2024-09-19T11:16:49.824513+0000","last_fullsized":"2024-09-19T11:16:49.824513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:44.761683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":352,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.720874+0000","last_change":"2024-09-19T11:13:39.381485+0000","last_active":"2024-09-19T11:16:49.720874+0000","last_peered":"2024-09-19T11:16:49.720874+0000","last_clean":"2024-09-19T11:16:49.720874+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:16:49.720874+0000","last_undegraded":"2024-09-19T11:16:49.720874+0000","last_fullsized":"2024-09-19T11:16:49.720874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:13.407016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.028397+0000","last_change":"2024-09-19T11:13:41.390450+0000","last_active":"2024-09-19T11:14:15.028397+0000","last_peered":"2024-09-19T11:14:15.028397+0000","last_clean":"2024-09-19T11:14:15.028397+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:14:15.028397+0000","last_undegraded":"2024-09-19T11:14:15.028397+0000","last_fullsized":"2024-09-19T11:14:15.028397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.152751+0000","last_change":"2024-09-19T11:17:13.152751+0000","last_active":"2024-09-19T11:17:13.152751+0000","last_peered":"2024-09-19T11:17:13.152751+0000","last_clean":"2024-09-19T11:17:13.152751+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:17:13.152751+0000","last_undegraded":"2024-09-19T11:17:13.152751+0000","last_fullsized":"2024-09-19T11:17:13.152751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.152663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:40.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.373483+0000","last_change":"2024-09-19T11:17:04.373483+0000","last_active":"2024-09-19T11:17:04.373483+0000","last_peered":"2024-09-19T11:17:04.373483+0000","last_clean":"2024-09-19T11:17:04.373483+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:17:04.373483+0000","last_undegraded":"2024-09-19T11:17:04.373483+0000","last_fullsized":"2024-09-19T11:17:04.373483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.373373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:15.731395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586467+0000","last_change":"2024-09-19T11:13:35.353930+0000","last_active":"2024-09-19T11:14:07.586467+0000","last_peered":"2024-09-19T11:14:07.586467+0000","last_clean":"2024-09-19T11:14:07.586467+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:14:07.586467+0000","last_undegraded":"2024-09-19T11:14:07.586467+0000","last_fullsized":"2024-09-19T11:14:07.586467+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:43:50.952240+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'61","reported_seq":126,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.868030+0000","last_change":"2024-09-19T11:13:37.371428+0000","last_active":"2024-09-19T11:16:49.868030+0000","last_peered":"2024-09-19T11:16:49.868030+0000","last_clean":"2024-09-19T11:16:49.868030+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:16:49.868030+0000","last_undegraded":"2024-09-19T11:16:49.868030+0000","last_fullsized":"2024-09-19T11:16:49.868030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:11.185147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586195+0000","last_change":"2024-09-19T11:13:39.369302+0000","last_active":"2024-09-19T11:14:07.586195+0000","last_peered":"2024-09-19T11:14:07.586195+0000","last_clean":"2024-09-19T11:14:07.586195+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:14:07.586195+0000","last_undegraded":"2024-09-19T11:14:07.586195+0000","last_fullsized":"2024-09-19T11:14:07.586195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:58.150298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.223256+0000","last_change":"2024-09-19T11:13:41.385457+0000","last_active":"2024-09-19T11:16:43.223256+0000","last_peered":"2024-09-19T11:16:43.223256+0000","last_clean":"2024-09-19T11:16:43.223256+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:16:43.223256+0000","last_undegraded":"2024-09-19T11:16:43.223256+0000","last_fullsized":"2024-09-19T11:16:43.223256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:04.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.621448+0000","last_change":"2024-09-19T11:17:11.621448+0000","last_active":"2024-09-19T11:17:11.621448+0000","last_peered":"2024-09-19T11:17:11.621448+0000","last_clean":"2024-09-19T11:17:11.621448+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:17:11.621448+0000","last_undegraded":"2024-09-19T11:17:11.621448+0000","last_fullsized":"2024-09-19T11:17:11.621448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.621356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:31.900753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.780765+0000","last_change":"2024-09-19T11:16:57.780765+0000","last_active":"2024-09-19T11:16:57.780765+0000","last_peered":"2024-09-19T11:16:57.780765+0000","last_clean":"2024-09-19T11:16:57.780765+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:16:57.780765+0000","last_undegraded":"2024-09-19T11:16:57.780765+0000","last_fullsized":"2024-09-19T11:16:57.780765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.780677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:08.322449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589532+0000","last_change":"2024-09-19T11:13:35.359219+0000","last_active":"2024-09-19T11:14:07.589532+0000","last_peered":"2024-09-19T11:14:07.589532+0000","last_clean":"2024-09-19T11:14:07.589532+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:14:07.589532+0000","last_undegraded":"2024-09-19T11:14:07.589532+0000","last_fullsized":"2024-09-19T11:14:07.589532+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:43.307746+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.871083+0000","last_change":"2024-09-19T11:13:37.362218+0000","last_active":"2024-09-19T11:16:49.871083+0000","last_peered":"2024-09-19T11:16:49.871083+0000","last_clean":"2024-09-19T11:16:49.871083+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:16:49.871083+0000","last_undegraded":"2024-09-19T11:16:49.871083+0000","last_fullsized":"2024-09-19T11:16:49.871083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:38.878721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589393+0000","last_change":"2024-09-19T11:13:39.378975+0000","last_active":"2024-09-19T11:14:07.589393+0000","last_peered":"2024-09-19T11:14:07.589393+0000","last_clean":"2024-09-19T11:14:07.589393+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:14:07.589393+0000","last_undegraded":"2024-09-19T11:14:07.589393+0000","last_fullsized":"2024-09-19T11:14:07.589393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:43.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:43.539247+0000","last_change":"2024-09-19T11:13:41.390986+0000","last_active":"2024-09-19T11:15:43.539247+0000","last_peered":"2024-09-19T11:15:43.539247+0000","last_clean":"2024-09-19T11:15:43.539247+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:15:43.539247+0000","last_undegraded":"2024-09-19T11:15:43.539247+0000","last_fullsized":"2024-09-19T11:15:43.539247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:29.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588444+0000","last_change":"2024-09-19T11:13:33.360955+0000","last_active":"2024-09-19T11:14:07.588444+0000","last_peered":"2024-09-19T11:14:07.588444+0000","last_clean":"2024-09-19T11:14:07.588444+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:14:07.588444+0000","last_undegraded":"2024-09-19T11:14:07.588444+0000","last_fullsized":"2024-09-19T11:14:07.588444+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:49:38.739277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.388243+0000","last_change":"2024-09-19T11:17:03.388243+0000","last_active":"2024-09-19T11:17:03.388243+0000","last_peered":"2024-09-19T11:17:03.388243+0000","last_clean":"2024-09-19T11:17:03.388243+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:17:03.388243+0000","last_undegraded":"2024-09-19T11:17:03.388243+0000","last_fullsized":"2024-09-19T11:17:03.388243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.388155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:34.409511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586955+0000","last_change":"2024-09-19T11:13:35.348523+0000","last_active":"2024-09-19T11:14:07.586955+0000","last_peered":"2024-09-19T11:14:07.586955+0000","last_clean":"2024-09-19T11:14:07.586955+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:14:07.586955+0000","last_undegraded":"2024-09-19T11:14:07.586955+0000","last_fullsized":"2024-09-19T11:14:07.586955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:26.593052+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.849618+0000","last_change":"2024-09-19T11:13:37.362855+0000","last_active":"2024-09-19T11:16:49.849618+0000","last_peered":"2024-09-19T11:16:49.849618+0000","last_clean":"2024-09-19T11:16:49.849618+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:16:49.849618+0000","last_undegraded":"2024-09-19T11:16:49.849618+0000","last_fullsized":"2024-09-19T11:16:49.849618+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:34:36.268162+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'285","reported_seq":435,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.715545+0000","last_change":"2024-09-19T11:13:39.381222+0000","last_active":"2024-09-19T11:16:49.715545+0000","last_peered":"2024-09-19T11:16:49.715545+0000","last_clean":"2024-09-19T11:16:49.715545+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:16:49.715545+0000","last_undegraded":"2024-09-19T11:16:49.715545+0000","last_fullsized":"2024-09-19T11:16:49.715545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:02.724027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:45.538583+0000","last_change":"2024-09-19T11:13:41.387843+0000","last_active":"2024-09-19T11:15:45.538583+0000","last_peered":"2024-09-19T11:15:45.538583+0000","last_clean":"2024-09-19T11:15:45.538583+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:15:45.538583+0000","last_undegraded":"2024-09-19T11:15:45.538583+0000","last_fullsized":"2024-09-19T11:15:45.538583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.060376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.194292+0000","last_change":"2024-09-19T11:17:12.194292+0000","last_active":"2024-09-19T11:17:12.194292+0000","last_peered":"2024-09-19T11:17:12.194292+0000","last_clean":"2024-09-19T11:17:12.194292+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:17:12.194292+0000","last_undegraded":"2024-09-19T11:17:12.194292+0000","last_fullsized":"2024-09-19T11:17:12.194292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.194188+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:19.272935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.338513+0000","last_change":"2024-09-19T11:17:02.338513+0000","last_active":"2024-09-19T11:17:02.338513+0000","last_peered":"2024-09-19T11:17:02.338513+0000","last_clean":"2024-09-19T11:17:02.338513+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:17:02.338513+0000","last_undegraded":"2024-09-19T11:17:02.338513+0000","last_fullsized":"2024-09-19T11:17:02.338513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.338404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:05.736888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'3","reported_seq":418,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.694346+0000","last_change":"2024-09-19T11:13:35.352798+0000","last_active":"2024-09-19T11:16:49.694346+0000","last_peered":"2024-09-19T11:16:49.694346+0000","last_clean":"2024-09-19T11:16:49.694346+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:16:49.694346+0000","last_undegraded":"2024-09-19T11:16:49.694346+0000","last_fullsized":"2024-09-19T11:16:49.694346+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:46.869358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586975+0000","last_change":"2024-09-19T11:13:37.369616+0000","last_active":"2024-09-19T11:14:07.586975+0000","last_peered":"2024-09-19T11:14:07.586975+0000","last_clean":"2024-09-19T11:14:07.586975+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:14:07.586975+0000","last_undegraded":"2024-09-19T11:14:07.586975+0000","last_fullsized":"2024-09-19T11:14:07.586975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.498959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'285","reported_seq":472,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.716872+0000","last_change":"2024-09-19T11:13:39.364476+0000","last_active":"2024-09-19T11:16:49.716872+0000","last_peered":"2024-09-19T11:16:49.716872+0000","last_clean":"2024-09-19T11:16:49.716872+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:16:49.716872+0000","last_undegraded":"2024-09-19T11:16:49.716872+0000","last_fullsized":"2024-09-19T11:16:49.716872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:05.251594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.968627+0000","last_change":"2024-09-19T11:13:41.382500+0000","last_active":"2024-09-19T11:16:42.968627+0000","last_peered":"2024-09-19T11:16:42.968627+0000","last_clean":"2024-09-19T11:16:42.968627+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:16:42.968627+0000","last_undegraded":"2024-09-19T11:16:42.968627+0000","last_fullsized":"2024-09-19T11:16:42.968627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:44.429934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.578446+0000","last_change":"2024-09-19T11:17:09.578446+0000","last_active":"2024-09-19T11:17:09.578446+0000","last_peered":"2024-09-19T11:17:09.578446+0000","last_clean":"2024-09-19T11:17:09.578446+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:17:09.578446+0000","last_undegraded":"2024-09-19T11:17:09.578446+0000","last_fullsized":"2024-09-19T11:17:09.578446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.578340+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:59.479596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.332945+0000","last_change":"2024-09-19T11:16:59.332945+0000","last_active":"2024-09-19T11:16:59.332945+0000","last_peered":"2024-09-19T11:16:59.332945+0000","last_clean":"2024-09-19T11:16:59.332945+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:16:59.332945+0000","last_undegraded":"2024-09-19T11:16:59.332945+0000","last_fullsized":"2024-09-19T11:16:59.332945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.332858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:10.200721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"28'1","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.682184+0000","last_change":"2024-09-19T11:13:35.359895+0000","last_active":"2024-09-19T11:16:49.682184+0000","last_peered":"2024-09-19T11:16:49.682184+0000","last_clean":"2024-09-19T11:16:49.682184+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:16:49.682184+0000","last_undegraded":"2024-09-19T11:16:49.682184+0000","last_fullsized":"2024-09-19T11:16:49.682184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:48.665046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'41","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.807401+0000","last_change":"2024-09-19T11:13:37.367380+0000","last_active":"2024-09-19T11:16:49.807401+0000","last_peered":"2024-09-19T11:16:49.807401+0000","last_clean":"2024-09-19T11:16:49.807401+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:16:49.807401+0000","last_undegraded":"2024-09-19T11:16:49.807401+0000","last_fullsized":"2024-09-19T11:16:49.807401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:44.610147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587829+0000","last_change":"2024-09-19T11:13:39.381930+0000","last_active":"2024-09-19T11:14:07.587829+0000","last_peered":"2024-09-19T11:14:07.587829+0000","last_clean":"2024-09-19T11:14:07.587829+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:14:07.587829+0000","last_undegraded":"2024-09-19T11:14:07.587829+0000","last_fullsized":"2024-09-19T11:14:07.587829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:20.757672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'8","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.224963+0000","last_change":"2024-09-19T11:13:41.383036+0000","last_active":"2024-09-19T11:16:43.224963+0000","last_peered":"2024-09-19T11:16:43.224963+0000","last_clean":"2024-09-19T11:16:43.224963+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:16:43.224963+0000","last_undegraded":"2024-09-19T11:16:43.224963+0000","last_fullsized":"2024-09-19T11:16:43.224963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:22.046963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004072+0000","last_change":"2024-09-19T11:13:33.360700+0000","last_active":"2024-09-19T11:16:43.004072+0000","last_peered":"2024-09-19T11:16:43.004072+0000","last_clean":"2024-09-19T11:16:43.004072+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:16:43.004072+0000","last_undegraded":"2024-09-19T11:16:43.004072+0000","last_fullsized":"2024-09-19T11:16:43.004072+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:26:38.890842+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":156,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.790826+0000","last_change":"2024-09-19T11:16:53.790826+0000","last_active":"2024-09-19T11:16:53.790826+0000","last_peered":"2024-09-19T11:16:53.790826+0000","last_clean":"2024-09-19T11:16:53.790826+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:16:53.790826+0000","last_undegraded":"2024-09-19T11:16:53.790826+0000","last_fullsized":"2024-09-19T11:16:53.790826+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.790697+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:58.322869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.307111+0000","last_change":"2024-09-19T11:16:57.307111+0000","last_active":"2024-09-19T11:16:57.307111+0000","last_peered":"2024-09-19T11:16:57.307111+0000","last_clean":"2024-09-19T11:16:57.307111+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:16:57.307111+0000","last_undegraded":"2024-09-19T11:16:57.307111+0000","last_fullsized":"2024-09-19T11:16:57.307111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.307030+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:57.423065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.333402+0000","last_change":"2024-09-19T11:17:01.333402+0000","last_active":"2024-09-19T11:17:01.333402+0000","last_peered":"2024-09-19T11:17:01.333402+0000","last_clean":"2024-09-19T11:17:01.333402+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:17:01.333402+0000","last_undegraded":"2024-09-19T11:17:01.333402+0000","last_fullsized":"2024-09-19T11:17:01.333402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.333297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:01.707856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598099+0000","last_change":"2024-09-19T11:14:07.597443+0000","last_active":"2024-09-19T11:14:07.598099+0000","last_peered":"2024-09-19T11:14:07.598099+0000","last_clean":"2024-09-19T11:14:07.598099+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:14:07.598099+0000","last_undegraded":"2024-09-19T11:14:07.598099+0000","last_fullsized":"2024-09-19T11:14:07.598099+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:33:01.646429+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.843332+0000","last_change":"2024-09-19T11:13:37.369113+0000","last_active":"2024-09-19T11:16:49.843332+0000","last_peered":"2024-09-19T11:16:49.843332+0000","last_clean":"2024-09-19T11:16:49.843332+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:16:49.843332+0000","last_undegraded":"2024-09-19T11:16:49.843332+0000","last_fullsized":"2024-09-19T11:16:49.843332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:17.600400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588503+0000","last_change":"2024-09-19T11:13:39.381749+0000","last_active":"2024-09-19T11:14:07.588503+0000","last_peered":"2024-09-19T11:14:07.588503+0000","last_clean":"2024-09-19T11:14:07.588503+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:14:07.588503+0000","last_undegraded":"2024-09-19T11:14:07.588503+0000","last_fullsized":"2024-09-19T11:14:07.588503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:31.206255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.012984+0000","last_change":"2024-09-19T11:13:41.382469+0000","last_active":"2024-09-19T11:16:43.012984+0000","last_peered":"2024-09-19T11:16:43.012984+0000","last_clean":"2024-09-19T11:16:43.012984+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:16:43.012984+0000","last_undegraded":"2024-09-19T11:16:43.012984+0000","last_fullsized":"2024-09-19T11:16:43.012984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:23.490546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096383+0000","last_change":"2024-09-19T11:13:33.352593+0000","last_active":"2024-09-19T11:15:42.096383+0000","last_peered":"2024-09-19T11:15:42.096383+0000","last_clean":"2024-09-19T11:15:42.096383+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:15:42.096383+0000","last_undegraded":"2024-09-19T11:15:42.096383+0000","last_fullsized":"2024-09-19T11:15:42.096383+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:57:32.858735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.377268+0000","last_change":"2024-09-19T11:16:54.377268+0000","last_active":"2024-09-19T11:16:54.377268+0000","last_peered":"2024-09-19T11:16:54.377268+0000","last_clean":"2024-09-19T11:16:54.377268+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:16:54.377268+0000","last_undegraded":"2024-09-19T11:16:54.377268+0000","last_fullsized":"2024-09-19T11:16:54.377268+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.377134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:21.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.869737+0000","last_change":"2024-09-19T11:16:55.869737+0000","last_active":"2024-09-19T11:16:55.869737+0000","last_peered":"2024-09-19T11:16:55.869737+0000","last_clean":"2024-09-19T11:16:55.869737+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:16:55.869737+0000","last_undegraded":"2024-09-19T11:16:55.869737+0000","last_fullsized":"2024-09-19T11:16:55.869737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.869650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:29.264317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589544+0000","last_change":"2024-09-19T11:13:35.355733+0000","last_active":"2024-09-19T11:14:07.589544+0000","last_peered":"2024-09-19T11:14:07.589544+0000","last_clean":"2024-09-19T11:14:07.589544+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:14:07.589544+0000","last_undegraded":"2024-09-19T11:14:07.589544+0000","last_fullsized":"2024-09-19T11:14:07.589544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:16.022467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'284","reported_seq":501,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.863480+0000","last_change":"2024-09-19T11:13:37.365037+0000","last_active":"2024-09-19T11:16:49.863480+0000","last_peered":"2024-09-19T11:16:49.863480+0000","last_clean":"2024-09-19T11:16:49.863480+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:16:49.863480+0000","last_undegraded":"2024-09-19T11:16:49.863480+0000","last_fullsized":"2024-09-19T11:16:49.863480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:00.713713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585295+0000","last_change":"2024-09-19T11:13:39.379958+0000","last_active":"2024-09-19T11:14:07.585295+0000","last_peered":"2024-09-19T11:14:07.585295+0000","last_clean":"2024-09-19T11:14:07.585295+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:14:07.585295+0000","last_undegraded":"2024-09-19T11:14:07.585295+0000","last_fullsized":"2024-09-19T11:14:07.585295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.435708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.934138+0000","last_change":"2024-09-19T11:13:41.394316+0000","last_active":"2024-09-19T11:14:57.934138+0000","last_peered":"2024-09-19T11:14:57.934138+0000","last_clean":"2024-09-19T11:14:57.934138+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:14:57.934138+0000","last_undegraded":"2024-09-19T11:14:57.934138+0000","last_fullsized":"2024-09-19T11:14:57.934138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:54.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.718806+0000","last_change":"2024-09-19T11:17:09.718806+0000","last_active":"2024-09-19T11:17:09.718806+0000","last_peered":"2024-09-19T11:17:09.718806+0000","last_clean":"2024-09-19T11:17:09.718806+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:17:09.718806+0000","last_undegraded":"2024-09-19T11:17:09.718806+0000","last_fullsized":"2024-09-19T11:17:09.718806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.718720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:37.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.199057+0000","last_change":"2024-09-19T11:17:00.199057+0000","last_active":"2024-09-19T11:17:00.199057+0000","last_peered":"2024-09-19T11:17:00.199057+0000","last_clean":"2024-09-19T11:17:00.199057+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:17:00.199057+0000","last_undegraded":"2024-09-19T11:17:00.199057+0000","last_fullsized":"2024-09-19T11:17:00.199057+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.198970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:17.702619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.862568+0000","last_change":"2024-09-19T11:16:54.862568+0000","last_active":"2024-09-19T11:16:54.862568+0000","last_peered":"2024-09-19T11:16:54.862568+0000","last_clean":"2024-09-19T11:16:54.862568+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:16:54.862568+0000","last_undegraded":"2024-09-19T11:16:54.862568+0000","last_fullsized":"2024-09-19T11:16:54.862568+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.862494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:12.037986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"28'1","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589942+0000","last_change":"2024-09-19T11:13:35.350142+0000","last_active":"2024-09-19T11:14:07.589942+0000","last_peered":"2024-09-19T11:14:07.589942+0000","last_clean":"2024-09-19T11:14:07.589942+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:14:07.589942+0000","last_undegraded":"2024-09-19T11:14:07.589942+0000","last_fullsized":"2024-09-19T11:14:07.589942+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:13.732591+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437418+0000","last_change":"2024-09-19T11:13:37.369777+0000","last_active":"2024-09-19T11:16:40.437418+0000","last_peered":"2024-09-19T11:16:40.437418+0000","last_clean":"2024-09-19T11:16:40.437418+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:16:40.437418+0000","last_undegraded":"2024-09-19T11:16:40.437418+0000","last_fullsized":"2024-09-19T11:16:40.437418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:09.642366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587165+0000","last_change":"2024-09-19T11:13:39.382026+0000","last_active":"2024-09-19T11:14:07.587165+0000","last_peered":"2024-09-19T11:14:07.587165+0000","last_clean":"2024-09-19T11:14:07.587165+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:14:07.587165+0000","last_undegraded":"2024-09-19T11:14:07.587165+0000","last_fullsized":"2024-09-19T11:14:07.587165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:05.351431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.301235+0000","last_change":"2024-09-19T11:13:41.390159+0000","last_active":"2024-09-19T11:16:42.301235+0000","last_peered":"2024-09-19T11:16:42.301235+0000","last_clean":"2024-09-19T11:16:42.301235+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:16:42.301235+0000","last_undegraded":"2024-09-19T11:16:42.301235+0000","last_fullsized":"2024-09-19T11:16:42.301235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:47.188979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.741731+0000","last_change":"2024-09-19T11:17:08.741731+0000","last_active":"2024-09-19T11:17:08.741731+0000","last_peered":"2024-09-19T11:17:08.741731+0000","last_clean":"2024-09-19T11:17:08.741731+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:17:08.741731+0000","last_undegraded":"2024-09-19T11:17:08.741731+0000","last_fullsized":"2024-09-19T11:17:08.741731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.741641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:41.893880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.316669+0000","last_change":"2024-09-19T11:16:58.316669+0000","last_active":"2024-09-19T11:16:58.316669+0000","last_peered":"2024-09-19T11:16:58.316669+0000","last_clean":"2024-09-19T11:16:58.316669+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:16:58.316669+0000","last_undegraded":"2024-09-19T11:16:58.316669+0000","last_fullsized":"2024-09-19T11:16:58.316669+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.316534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:33.887561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.307594+0000","last_change":"2024-09-19T11:16:55.307594+0000","last_active":"2024-09-19T11:16:55.307594+0000","last_peered":"2024-09-19T11:16:55.307594+0000","last_clean":"2024-09-19T11:16:55.307594+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:16:55.307594+0000","last_undegraded":"2024-09-19T11:16:55.307594+0000","last_fullsized":"2024-09-19T11:16:55.307594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.307489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:24.095008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'4","reported_seq":229,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.680755+0000","last_change":"2024-09-19T11:13:35.357655+0000","last_active":"2024-09-19T11:16:49.680755+0000","last_peered":"2024-09-19T11:16:49.680755+0000","last_clean":"2024-09-19T11:16:49.680755+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:16:49.680755+0000","last_undegraded":"2024-09-19T11:16:49.680755+0000","last_fullsized":"2024-09-19T11:16:49.680755+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:05:09.079178+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'14","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.146449+0000","last_change":"2024-09-19T11:13:37.369199+0000","last_active":"2024-09-19T11:16:42.146449+0000","last_peered":"2024-09-19T11:16:42.146449+0000","last_clean":"2024-09-19T11:16:42.146449+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:16:42.146449+0000","last_undegraded":"2024-09-19T11:16:42.146449+0000","last_fullsized":"2024-09-19T11:16:42.146449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:43.083589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589764+0000","last_change":"2024-09-19T11:13:39.379563+0000","last_active":"2024-09-19T11:14:07.589764+0000","last_peered":"2024-09-19T11:14:07.589764+0000","last_clean":"2024-09-19T11:14:07.589764+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:14:07.589764+0000","last_undegraded":"2024-09-19T11:14:07.589764+0000","last_fullsized":"2024-09-19T11:14:07.589764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:20.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.946285+0000","last_change":"2024-09-19T11:13:41.395412+0000","last_active":"2024-09-19T11:16:42.946285+0000","last_peered":"2024-09-19T11:16:42.946285+0000","last_clean":"2024-09-19T11:16:42.946285+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:16:42.946285+0000","last_undegraded":"2024-09-19T11:16:42.946285+0000","last_fullsized":"2024-09-19T11:16:42.946285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:05.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.597259+0000","last_change":"2024-09-19T11:17:08.597259+0000","last_active":"2024-09-19T11:17:08.597259+0000","last_peered":"2024-09-19T11:17:08.597259+0000","last_clean":"2024-09-19T11:17:08.597259+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:17:08.597259+0000","last_undegraded":"2024-09-19T11:17:08.597259+0000","last_fullsized":"2024-09-19T11:17:08.597259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.597174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:37.364781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.263916+0000","last_change":"2024-09-19T11:16:54.263916+0000","last_active":"2024-09-19T11:16:54.263916+0000","last_peered":"2024-09-19T11:16:54.263916+0000","last_clean":"2024-09-19T11:16:54.263916+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:16:54.263916+0000","last_undegraded":"2024-09-19T11:16:54.263916+0000","last_fullsized":"2024-09-19T11:16:54.263916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.263815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:48.536224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:52.839753+0000","last_change":"2024-09-19T11:16:52.839753+0000","last_active":"2024-09-19T11:16:52.839753+0000","last_peered":"2024-09-19T11:16:52.839753+0000","last_clean":"2024-09-19T11:16:52.839753+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:16:52.839753+0000","last_undegraded":"2024-09-19T11:16:52.839753+0000","last_fullsized":"2024-09-19T11:16:52.839753+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_clean_scrub_stamp":"2024-09-19T11:16:52.839679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:51.504665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'1","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.279961+0000","last_change":"2024-09-19T11:13:35.354864+0000","last_active":"2024-09-19T11:16:43.279961+0000","last_peered":"2024-09-19T11:16:43.279961+0000","last_clean":"2024-09-19T11:16:43.279961+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:16:43.279961+0000","last_undegraded":"2024-09-19T11:16:43.279961+0000","last_fullsized":"2024-09-19T11:16:43.279961+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:59.068872+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'69","reported_seq":137,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.846451+0000","last_change":"2024-09-19T11:13:37.366497+0000","last_active":"2024-09-19T11:16:49.846451+0000","last_peered":"2024-09-19T11:16:49.846451+0000","last_clean":"2024-09-19T11:16:49.846451+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:16:49.846451+0000","last_undegraded":"2024-09-19T11:16:49.846451+0000","last_fullsized":"2024-09-19T11:16:49.846451+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":69,"log_dups_size":0,"ondisk_log_size":69,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:11:05.665285+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586753+0000","last_change":"2024-09-19T11:13:39.380023+0000","last_active":"2024-09-19T11:14:07.586753+0000","last_peered":"2024-09-19T11:14:07.586753+0000","last_clean":"2024-09-19T11:14:07.586753+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:14:07.586753+0000","last_undegraded":"2024-09-19T11:14:07.586753+0000","last_fullsized":"2024-09-19T11:14:07.586753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.513854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.002199+0000","last_change":"2024-09-19T11:13:41.384779+0000","last_active":"2024-09-19T11:15:42.002199+0000","last_peered":"2024-09-19T11:15:42.002199+0000","last_clean":"2024-09-19T11:15:42.002199+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:15:42.002199+0000","last_undegraded":"2024-09-19T11:15:42.002199+0000","last_fullsized":"2024-09-19T11:15:42.002199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:01.181785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.725498+0000","last_change":"2024-09-19T11:17:05.725498+0000","last_active":"2024-09-19T11:17:05.725498+0000","last_peered":"2024-09-19T11:17:05.725498+0000","last_clean":"2024-09-19T11:17:05.725498+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:17:05.725498+0000","last_undegraded":"2024-09-19T11:17:05.725498+0000","last_fullsized":"2024-09-19T11:17:05.725498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.725349+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:53.167095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.823573+0000","last_change":"2024-09-19T11:16:56.823573+0000","last_active":"2024-09-19T11:16:56.823573+0000","last_peered":"2024-09-19T11:16:56.823573+0000","last_clean":"2024-09-19T11:16:56.823573+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:16:56.823573+0000","last_undegraded":"2024-09-19T11:16:56.823573+0000","last_fullsized":"2024-09-19T11:16:56.823573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.823458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:43.789933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.328783+0000","last_change":"2024-09-19T11:16:55.328783+0000","last_active":"2024-09-19T11:16:55.328783+0000","last_peered":"2024-09-19T11:16:55.328783+0000","last_clean":"2024-09-19T11:16:55.328783+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:16:55.328783+0000","last_undegraded":"2024-09-19T11:16:55.328783+0000","last_fullsized":"2024-09-19T11:16:55.328783+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.328699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:16.068678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584330+0000","last_change":"2024-09-19T11:13:35.355937+0000","last_active":"2024-09-19T11:14:07.584330+0000","last_peered":"2024-09-19T11:14:07.584330+0000","last_clean":"2024-09-19T11:14:07.584330+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:14:07.584330+0000","last_undegraded":"2024-09-19T11:14:07.584330+0000","last_fullsized":"2024-09-19T11:14:07.584330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:41.799805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593910+0000","last_change":"2024-09-19T11:13:37.367919+0000","last_active":"2024-09-19T11:14:07.593910+0000","last_peered":"2024-09-19T11:14:07.593910+0000","last_clean":"2024-09-19T11:14:07.593910+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:14:07.593910+0000","last_undegraded":"2024-09-19T11:14:07.593910+0000","last_fullsized":"2024-09-19T11:14:07.593910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:53.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'285","reported_seq":373,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.712786+0000","last_change":"2024-09-19T11:13:39.370313+0000","last_active":"2024-09-19T11:16:49.712786+0000","last_peered":"2024-09-19T11:16:49.712786+0000","last_clean":"2024-09-19T11:16:49.712786+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:16:49.712786+0000","last_undegraded":"2024-09-19T11:16:49.712786+0000","last_fullsized":"2024-09-19T11:16:49.712786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:56.937960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.649914+0000","last_change":"2024-09-19T11:13:41.391610+0000","last_active":"2024-09-19T11:16:42.649914+0000","last_peered":"2024-09-19T11:16:42.649914+0000","last_clean":"2024-09-19T11:16:42.649914+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:16:42.649914+0000","last_undegraded":"2024-09-19T11:16:42.649914+0000","last_fullsized":"2024-09-19T11:16:42.649914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.303997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.233251+0000","last_change":"2024-09-19T11:17:08.233251+0000","last_active":"2024-09-19T11:17:08.233251+0000","last_peered":"2024-09-19T11:17:08.233251+0000","last_clean":"2024-09-19T11:17:08.233251+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:17:08.233251+0000","last_undegraded":"2024-09-19T11:17:08.233251+0000","last_fullsized":"2024-09-19T11:17:08.233251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.233135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.372051+0000","last_change":"2024-09-19T11:17:00.372051+0000","last_active":"2024-09-19T11:17:00.372051+0000","last_peered":"2024-09-19T11:17:00.372051+0000","last_clean":"2024-09-19T11:17:00.372051+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:17:00.372051+0000","last_undegraded":"2024-09-19T11:17:00.372051+0000","last_fullsized":"2024-09-19T11:17:00.372051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.371942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:44.482502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.828131+0000","last_change":"2024-09-19T11:16:53.828131+0000","last_active":"2024-09-19T11:16:53.828131+0000","last_peered":"2024-09-19T11:16:53.828131+0000","last_clean":"2024-09-19T11:16:53.828131+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:16:53.828131+0000","last_undegraded":"2024-09-19T11:16:53.828131+0000","last_fullsized":"2024-09-19T11:16:53.828131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.828060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:16.144293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584240+0000","last_change":"2024-09-19T11:13:35.355501+0000","last_active":"2024-09-19T11:14:07.584240+0000","last_peered":"2024-09-19T11:14:07.584240+0000","last_clean":"2024-09-19T11:14:07.584240+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:14:07.584240+0000","last_undegraded":"2024-09-19T11:14:07.584240+0000","last_fullsized":"2024-09-19T11:14:07.584240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:17.393322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585599+0000","last_change":"2024-09-19T11:13:37.371529+0000","last_active":"2024-09-19T11:14:07.585599+0000","last_peered":"2024-09-19T11:14:07.585599+0000","last_clean":"2024-09-19T11:14:07.585599+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:14:07.585599+0000","last_undegraded":"2024-09-19T11:14:07.585599+0000","last_fullsized":"2024-09-19T11:14:07.585599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.201187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":403,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.718255+0000","last_change":"2024-09-19T11:13:39.374381+0000","last_active":"2024-09-19T11:16:49.718255+0000","last_peered":"2024-09-19T11:16:49.718255+0000","last_clean":"2024-09-19T11:16:49.718255+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:16:49.718255+0000","last_undegraded":"2024-09-19T11:16:49.718255+0000","last_fullsized":"2024-09-19T11:16:49.718255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:52.357745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.093870+0000","last_change":"2024-09-19T11:13:41.392744+0000","last_active":"2024-09-19T11:15:42.093870+0000","last_peered":"2024-09-19T11:15:42.093870+0000","last_clean":"2024-09-19T11:15:42.093870+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:15:42.093870+0000","last_undegraded":"2024-09-19T11:15:42.093870+0000","last_fullsized":"2024-09-19T11:15:42.093870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:06.085455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.156983+0000","last_change":"2024-09-19T11:17:10.156983+0000","last_active":"2024-09-19T11:17:10.156983+0000","last_peered":"2024-09-19T11:17:10.156983+0000","last_clean":"2024-09-19T11:17:10.156983+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:17:10.156983+0000","last_undegraded":"2024-09-19T11:17:10.156983+0000","last_fullsized":"2024-09-19T11:17:10.156983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.156870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:27.088137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.792079+0000","last_change":"2024-09-19T11:16:54.792079+0000","last_active":"2024-09-19T11:16:54.792079+0000","last_peered":"2024-09-19T11:16:54.792079+0000","last_clean":"2024-09-19T11:16:54.792079+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:16:54.792079+0000","last_undegraded":"2024-09-19T11:16:54.792079+0000","last_fullsized":"2024-09-19T11:16:54.792079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.791976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:48.520529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.281102+0000","last_change":"2024-09-19T11:16:56.281102+0000","last_active":"2024-09-19T11:16:56.281102+0000","last_peered":"2024-09-19T11:16:56.281102+0000","last_clean":"2024-09-19T11:16:56.281102+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:16:56.281102+0000","last_undegraded":"2024-09-19T11:16:56.281102+0000","last_fullsized":"2024-09-19T11:16:56.281102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.281013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:47.506937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584254+0000","last_change":"2024-09-19T11:13:35.355920+0000","last_active":"2024-09-19T11:14:07.584254+0000","last_peered":"2024-09-19T11:14:07.584254+0000","last_clean":"2024-09-19T11:14:07.584254+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:14:07.584254+0000","last_undegraded":"2024-09-19T11:14:07.584254+0000","last_fullsized":"2024-09-19T11:14:07.584254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:38.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'91","reported_seq":176,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.865306+0000","last_change":"2024-09-19T11:13:37.367000+0000","last_active":"2024-09-19T11:16:49.865306+0000","last_peered":"2024-09-19T11:16:49.865306+0000","last_clean":"2024-09-19T11:16:49.865306+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:16:49.865306+0000","last_undegraded":"2024-09-19T11:16:49.865306+0000","last_fullsized":"2024-09-19T11:16:49.865306+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":91,"log_dups_size":0,"ondisk_log_size":91,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:41:32.428269+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586150+0000","last_change":"2024-09-19T11:13:39.369482+0000","last_active":"2024-09-19T11:14:07.586150+0000","last_peered":"2024-09-19T11:14:07.586150+0000","last_clean":"2024-09-19T11:14:07.586150+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:14:07.586150+0000","last_undegraded":"2024-09-19T11:14:07.586150+0000","last_fullsized":"2024-09-19T11:14:07.586150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:52.197649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.742094+0000","last_change":"2024-09-19T11:13:41.387841+0000","last_active":"2024-09-19T11:16:42.742094+0000","last_peered":"2024-09-19T11:16:42.742094+0000","last_clean":"2024-09-19T11:16:42.742094+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:16:42.742094+0000","last_undegraded":"2024-09-19T11:16:42.742094+0000","last_fullsized":"2024-09-19T11:16:42.742094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:41.664645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589320+0000","last_change":"2024-09-19T11:13:41.387407+0000","last_active":"2024-09-19T11:14:07.589320+0000","last_peered":"2024-09-19T11:14:07.589320+0000","last_clean":"2024-09-19T11:14:07.589320+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:14:07.589320+0000","last_undegraded":"2024-09-19T11:14:07.589320+0000","last_fullsized":"2024-09-19T11:14:07.589320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:24.850379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899053+0000","last_change":"2024-09-19T11:13:33.353234+0000","last_active":"2024-09-19T11:16:42.899053+0000","last_peered":"2024-09-19T11:16:42.899053+0000","last_clean":"2024-09-19T11:16:42.899053+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:16:42.899053+0000","last_undegraded":"2024-09-19T11:16:42.899053+0000","last_fullsized":"2024-09-19T11:16:42.899053+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:08:52.951845+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.379535+0000","last_change":"2024-09-19T11:17:07.379535+0000","last_active":"2024-09-19T11:17:07.379535+0000","last_peered":"2024-09-19T11:17:07.379535+0000","last_clean":"2024-09-19T11:17:07.379535+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:17:07.379535+0000","last_undegraded":"2024-09-19T11:17:07.379535+0000","last_fullsized":"2024-09-19T11:17:07.379535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.379424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:42.734681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593909+0000","last_change":"2024-09-19T11:13:35.353000+0000","last_active":"2024-09-19T11:14:07.593909+0000","last_peered":"2024-09-19T11:14:07.593909+0000","last_clean":"2024-09-19T11:14:07.593909+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:14:07.593909+0000","last_undegraded":"2024-09-19T11:14:07.593909+0000","last_fullsized":"2024-09-19T11:14:07.593909+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:23.618637+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'36","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.819925+0000","last_change":"2024-09-19T11:13:37.369688+0000","last_active":"2024-09-19T11:16:49.819925+0000","last_peered":"2024-09-19T11:16:49.819925+0000","last_clean":"2024-09-19T11:16:49.819925+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:16:49.819925+0000","last_undegraded":"2024-09-19T11:16:49.819925+0000","last_fullsized":"2024-09-19T11:16:49.819925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:22.810135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585707+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.585707+0000","last_peered":"2024-09-19T11:14:07.585707+0000","last_clean":"2024-09-19T11:14:07.585707+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:14:07.585707+0000","last_undegraded":"2024-09-19T11:14:07.585707+0000","last_fullsized":"2024-09-19T11:14:07.585707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:32.078155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.049603+0000","last_change":"2024-09-19T11:13:41.388648+0000","last_active":"2024-09-19T11:15:40.049603+0000","last_peered":"2024-09-19T11:15:40.049603+0000","last_clean":"2024-09-19T11:15:40.049603+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:15:40.049603+0000","last_undegraded":"2024-09-19T11:15:40.049603+0000","last_fullsized":"2024-09-19T11:15:40.049603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:00.390668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.581118+0000","last_change":"2024-09-19T11:17:12.581118+0000","last_active":"2024-09-19T11:17:12.581118+0000","last_peered":"2024-09-19T11:17:12.581118+0000","last_clean":"2024-09-19T11:17:12.581118+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:17:12.581118+0000","last_undegraded":"2024-09-19T11:17:12.581118+0000","last_fullsized":"2024-09-19T11:17:12.581118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.581034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:57.494890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.268509+0000","last_change":"2024-09-19T11:16:58.268509+0000","last_active":"2024-09-19T11:16:58.268509+0000","last_peered":"2024-09-19T11:16:58.268509+0000","last_clean":"2024-09-19T11:16:58.268509+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:58.268509+0000","last_undegraded":"2024-09-19T11:16:58.268509+0000","last_fullsized":"2024-09-19T11:16:58.268509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.268398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:22.542212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584591+0000","last_change":"2024-09-19T11:13:35.353851+0000","last_active":"2024-09-19T11:14:07.584591+0000","last_peered":"2024-09-19T11:14:07.584591+0000","last_clean":"2024-09-19T11:14:07.584591+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:14:07.584591+0000","last_undegraded":"2024-09-19T11:14:07.584591+0000","last_fullsized":"2024-09-19T11:14:07.584591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:37.329718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.125107+0000","last_change":"2024-09-19T11:13:37.361748+0000","last_active":"2024-09-19T11:16:42.125107+0000","last_peered":"2024-09-19T11:16:42.125107+0000","last_clean":"2024-09-19T11:16:42.125107+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:16:42.125107+0000","last_undegraded":"2024-09-19T11:16:42.125107+0000","last_fullsized":"2024-09-19T11:16:42.125107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:52.506674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588151+0000","last_change":"2024-09-19T11:13:39.381924+0000","last_active":"2024-09-19T11:14:07.588151+0000","last_peered":"2024-09-19T11:14:07.588151+0000","last_clean":"2024-09-19T11:14:07.588151+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:14:07.588151+0000","last_undegraded":"2024-09-19T11:14:07.588151+0000","last_fullsized":"2024-09-19T11:14:07.588151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:37.700824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587758+0000","last_change":"2024-09-19T11:13:41.381057+0000","last_active":"2024-09-19T11:14:07.587758+0000","last_peered":"2024-09-19T11:14:07.587758+0000","last_clean":"2024-09-19T11:14:07.587758+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:14:07.587758+0000","last_undegraded":"2024-09-19T11:14:07.587758+0000","last_fullsized":"2024-09-19T11:14:07.587758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:11.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":87,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003956+0000","last_change":"2024-09-19T11:13:33.350098+0000","last_active":"2024-09-19T11:16:43.003956+0000","last_peered":"2024-09-19T11:16:43.003956+0000","last_clean":"2024-09-19T11:16:43.003956+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:16:43.003956+0000","last_undegraded":"2024-09-19T11:16:43.003956+0000","last_fullsized":"2024-09-19T11:16:43.003956+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:00:02.776230+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.156246+0000","last_change":"2024-09-19T11:17:01.156246+0000","last_active":"2024-09-19T11:17:01.156246+0000","last_peered":"2024-09-19T11:17:01.156246+0000","last_clean":"2024-09-19T11:17:01.156246+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:17:01.156246+0000","last_undegraded":"2024-09-19T11:17:01.156246+0000","last_fullsized":"2024-09-19T11:17:01.156246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.156158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:03.371804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587433+0000","last_change":"2024-09-19T11:13:35.356889+0000","last_active":"2024-09-19T11:14:07.587433+0000","last_peered":"2024-09-19T11:14:07.587433+0000","last_clean":"2024-09-19T11:14:07.587433+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:14:07.587433+0000","last_undegraded":"2024-09-19T11:14:07.587433+0000","last_fullsized":"2024-09-19T11:14:07.587433+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:51:48.945891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'47","reported_seq":111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.769850+0000","last_change":"2024-09-19T11:13:37.358517+0000","last_active":"2024-09-19T11:16:49.769850+0000","last_peered":"2024-09-19T11:16:49.769850+0000","last_clean":"2024-09-19T11:16:49.769850+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:16:49.769850+0000","last_undegraded":"2024-09-19T11:16:49.769850+0000","last_fullsized":"2024-09-19T11:16:49.769850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.932100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593589+0000","last_change":"2024-09-19T11:13:39.368887+0000","last_active":"2024-09-19T11:14:07.593589+0000","last_peered":"2024-09-19T11:14:07.593589+0000","last_clean":"2024-09-19T11:14:07.593589+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:14:07.593589+0000","last_undegraded":"2024-09-19T11:14:07.593589+0000","last_fullsized":"2024-09-19T11:14:07.593589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:59.906873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585207+0000","last_change":"2024-09-19T11:13:41.390580+0000","last_active":"2024-09-19T11:14:07.585207+0000","last_peered":"2024-09-19T11:14:07.585207+0000","last_clean":"2024-09-19T11:14:07.585207+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:14:07.585207+0000","last_undegraded":"2024-09-19T11:14:07.585207+0000","last_fullsized":"2024-09-19T11:14:07.585207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:00.635835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":62,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.628513+0000","last_change":"2024-09-19T11:13:33.359154+0000","last_active":"2024-09-19T11:16:42.628513+0000","last_peered":"2024-09-19T11:16:42.628513+0000","last_clean":"2024-09-19T11:16:42.628513+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:16:42.628513+0000","last_undegraded":"2024-09-19T11:16:42.628513+0000","last_fullsized":"2024-09-19T11:16:42.628513+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:34:07.291758+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.807882+0000","last_change":"2024-09-19T11:16:56.807882+0000","last_active":"2024-09-19T11:16:56.807882+0000","last_peered":"2024-09-19T11:16:56.807882+0000","last_clean":"2024-09-19T11:16:56.807882+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:16:56.807882+0000","last_undegraded":"2024-09-19T11:16:56.807882+0000","last_fullsized":"2024-09-19T11:16:56.807882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.807762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:02.356623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584231+0000","last_change":"2024-09-19T11:13:35.356852+0000","last_active":"2024-09-19T11:14:07.584231+0000","last_peered":"2024-09-19T11:14:07.584231+0000","last_clean":"2024-09-19T11:14:07.584231+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:14:07.584231+0000","last_undegraded":"2024-09-19T11:14:07.584231+0000","last_fullsized":"2024-09-19T11:14:07.584231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:35.050288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.877215+0000","last_change":"2024-09-19T11:13:37.360189+0000","last_active":"2024-09-19T11:16:49.877215+0000","last_peered":"2024-09-19T11:16:49.877215+0000","last_clean":"2024-09-19T11:16:49.877215+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:16:49.877215+0000","last_undegraded":"2024-09-19T11:16:49.877215+0000","last_fullsized":"2024-09-19T11:16:49.877215+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:51:54.329596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587792+0000","last_change":"2024-09-19T11:13:39.375493+0000","last_active":"2024-09-19T11:14:07.587792+0000","last_peered":"2024-09-19T11:14:07.587792+0000","last_clean":"2024-09-19T11:14:07.587792+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:14:07.587792+0000","last_undegraded":"2024-09-19T11:14:07.587792+0000","last_fullsized":"2024-09-19T11:14:07.587792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:12.594777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.568582+0000","last_change":"2024-09-19T11:13:33.354025+0000","last_active":"2024-09-19T11:15:38.568582+0000","last_peered":"2024-09-19T11:15:38.568582+0000","last_clean":"2024-09-19T11:15:38.568582+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:15:38.568582+0000","last_undegraded":"2024-09-19T11:15:38.568582+0000","last_fullsized":"2024-09-19T11:15:38.568582+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:07:42.535989+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.296208+0000","last_change":"2024-09-19T11:17:09.296208+0000","last_active":"2024-09-19T11:17:09.296208+0000","last_peered":"2024-09-19T11:17:09.296208+0000","last_clean":"2024-09-19T11:17:09.296208+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:17:09.296208+0000","last_undegraded":"2024-09-19T11:17:09.296208+0000","last_fullsized":"2024-09-19T11:17:09.296208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.296106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:23.893467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588717+0000","last_change":"2024-09-19T11:13:35.357178+0000","last_active":"2024-09-19T11:14:07.588717+0000","last_peered":"2024-09-19T11:14:07.588717+0000","last_clean":"2024-09-19T11:14:07.588717+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:14:07.588717+0000","last_undegraded":"2024-09-19T11:14:07.588717+0000","last_fullsized":"2024-09-19T11:14:07.588717+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:23:59.098976+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'63","reported_seq":128,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.874425+0000","last_change":"2024-09-19T11:13:37.363593+0000","last_active":"2024-09-19T11:16:49.874425+0000","last_peered":"2024-09-19T11:16:49.874425+0000","last_clean":"2024-09-19T11:16:49.874425+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:16:49.874425+0000","last_undegraded":"2024-09-19T11:16:49.874425+0000","last_fullsized":"2024-09-19T11:16:49.874425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:57.886776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587378+0000","last_change":"2024-09-19T11:13:39.375431+0000","last_active":"2024-09-19T11:14:07.587378+0000","last_peered":"2024-09-19T11:14:07.587378+0000","last_clean":"2024-09-19T11:14:07.587378+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:14:07.587378+0000","last_undegraded":"2024-09-19T11:14:07.587378+0000","last_fullsized":"2024-09-19T11:14:07.587378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:55.629772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.998936+0000","last_change":"2024-09-19T11:13:41.387630+0000","last_active":"2024-09-19T11:15:41.998936+0000","last_peered":"2024-09-19T11:15:41.998936+0000","last_clean":"2024-09-19T11:15:41.998936+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:15:41.998936+0000","last_undegraded":"2024-09-19T11:15:41.998936+0000","last_fullsized":"2024-09-19T11:15:41.998936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:27.480898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.004030+0000","last_change":"2024-09-19T11:13:33.342352+0000","last_active":"2024-09-19T11:16:43.004030+0000","last_peered":"2024-09-19T11:16:43.004030+0000","last_clean":"2024-09-19T11:16:43.004030+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:16:43.004030+0000","last_undegraded":"2024-09-19T11:16:43.004030+0000","last_fullsized":"2024-09-19T11:16:43.004030+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:16:09.205289+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.838965+0000","last_change":"2024-09-19T11:16:57.838965+0000","last_active":"2024-09-19T11:16:57.838965+0000","last_peered":"2024-09-19T11:16:57.838965+0000","last_clean":"2024-09-19T11:16:57.838965+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:16:57.838965+0000","last_undegraded":"2024-09-19T11:16:57.838965+0000","last_fullsized":"2024-09-19T11:16:57.838965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.838852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:23.656467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.590449+0000","last_change":"2024-09-19T11:13:35.350569+0000","last_active":"2024-09-19T11:14:07.590449+0000","last_peered":"2024-09-19T11:14:07.590449+0000","last_clean":"2024-09-19T11:14:07.590449+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:14:07.590449+0000","last_undegraded":"2024-09-19T11:14:07.590449+0000","last_fullsized":"2024-09-19T11:14:07.590449+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:23:44.072755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.763368+0000","last_change":"2024-09-19T11:13:37.368372+0000","last_active":"2024-09-19T11:16:49.763368+0000","last_peered":"2024-09-19T11:16:49.763368+0000","last_clean":"2024-09-19T11:16:49.763368+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:16:49.763368+0000","last_undegraded":"2024-09-19T11:16:49.763368+0000","last_fullsized":"2024-09-19T11:16:49.763368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:42.470532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595510+0000","last_change":"2024-09-19T11:13:39.377106+0000","last_active":"2024-09-19T11:14:07.595510+0000","last_peered":"2024-09-19T11:14:07.595510+0000","last_clean":"2024-09-19T11:14:07.595510+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:14:07.595510+0000","last_undegraded":"2024-09-19T11:14:07.595510+0000","last_fullsized":"2024-09-19T11:14:07.595510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:40.364349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584320+0000","last_change":"2024-09-19T11:13:41.395172+0000","last_active":"2024-09-19T11:14:07.584320+0000","last_peered":"2024-09-19T11:14:07.584320+0000","last_clean":"2024-09-19T11:14:07.584320+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:14:07.584320+0000","last_undegraded":"2024-09-19T11:14:07.584320+0000","last_fullsized":"2024-09-19T11:14:07.584320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:31.640115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.115025+0000","last_change":"2024-09-19T11:13:33.361006+0000","last_active":"2024-09-19T11:14:58.115025+0000","last_peered":"2024-09-19T11:14:58.115025+0000","last_clean":"2024-09-19T11:14:58.115025+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:14:58.115025+0000","last_undegraded":"2024-09-19T11:14:58.115025+0000","last_fullsized":"2024-09-19T11:14:58.115025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:15.458106+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.764477+0000","last_change":"2024-09-19T11:17:00.764477+0000","last_active":"2024-09-19T11:17:00.764477+0000","last_peered":"2024-09-19T11:17:00.764477+0000","last_clean":"2024-09-19T11:17:00.764477+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:00.764477+0000","last_undegraded":"2024-09-19T11:17:00.764477+0000","last_fullsized":"2024-09-19T11:17:00.764477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.764391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:38.964980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588215+0000","last_change":"2024-09-19T11:13:35.351248+0000","last_active":"2024-09-19T11:14:07.588215+0000","last_peered":"2024-09-19T11:14:07.588215+0000","last_clean":"2024-09-19T11:14:07.588215+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:14:07.588215+0000","last_undegraded":"2024-09-19T11:14:07.588215+0000","last_fullsized":"2024-09-19T11:14:07.588215+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:06.912453+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.833988+0000","last_change":"2024-09-19T11:13:37.358368+0000","last_active":"2024-09-19T11:16:49.833988+0000","last_peered":"2024-09-19T11:16:49.833988+0000","last_clean":"2024-09-19T11:16:49.833988+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:16:49.833988+0000","last_undegraded":"2024-09-19T11:16:49.833988+0000","last_fullsized":"2024-09-19T11:16:49.833988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:44.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588427+0000","last_change":"2024-09-19T11:13:39.380360+0000","last_active":"2024-09-19T11:14:07.588427+0000","last_peered":"2024-09-19T11:14:07.588427+0000","last_clean":"2024-09-19T11:14:07.588427+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:14:07.588427+0000","last_undegraded":"2024-09-19T11:14:07.588427+0000","last_fullsized":"2024-09-19T11:14:07.588427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:19.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.092425+0000","last_change":"2024-09-19T11:13:41.392005+0000","last_active":"2024-09-19T11:15:42.092425+0000","last_peered":"2024-09-19T11:15:42.092425+0000","last_clean":"2024-09-19T11:15:42.092425+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:15:42.092425+0000","last_undegraded":"2024-09-19T11:15:42.092425+0000","last_fullsized":"2024-09-19T11:15:42.092425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:49.976836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003882+0000","last_change":"2024-09-19T11:13:33.352824+0000","last_active":"2024-09-19T11:16:43.003882+0000","last_peered":"2024-09-19T11:16:43.003882+0000","last_clean":"2024-09-19T11:16:43.003882+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:16:43.003882+0000","last_undegraded":"2024-09-19T11:16:43.003882+0000","last_fullsized":"2024-09-19T11:16:43.003882+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:35:01.378601+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.268148+0000","last_change":"2024-09-19T11:17:10.268148+0000","last_active":"2024-09-19T11:17:10.268148+0000","last_peered":"2024-09-19T11:17:10.268148+0000","last_clean":"2024-09-19T11:17:10.268148+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:17:10.268148+0000","last_undegraded":"2024-09-19T11:17:10.268148+0000","last_fullsized":"2024-09-19T11:17:10.268148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.268062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:30.958036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.598624+0000","last_change":"2024-09-19T11:14:07.597921+0000","last_active":"2024-09-19T11:14:07.598624+0000","last_peered":"2024-09-19T11:14:07.598624+0000","last_clean":"2024-09-19T11:14:07.598624+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:14:07.598624+0000","last_undegraded":"2024-09-19T11:14:07.598624+0000","last_fullsized":"2024-09-19T11:14:07.598624+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:31:55.324299+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586647+0000","last_change":"2024-09-19T11:13:37.371652+0000","last_active":"2024-09-19T11:14:07.586647+0000","last_peered":"2024-09-19T11:14:07.586647+0000","last_clean":"2024-09-19T11:14:07.586647+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:14:07.586647+0000","last_undegraded":"2024-09-19T11:14:07.586647+0000","last_fullsized":"2024-09-19T11:14:07.586647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:28.501389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'285","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.711152+0000","last_change":"2024-09-19T11:13:39.382597+0000","last_active":"2024-09-19T11:16:49.711152+0000","last_peered":"2024-09-19T11:16:49.711152+0000","last_clean":"2024-09-19T11:16:49.711152+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:16:49.711152+0000","last_undegraded":"2024-09-19T11:16:49.711152+0000","last_fullsized":"2024-09-19T11:16:49.711152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:46.620461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.583768+0000","last_change":"2024-09-19T11:13:41.390206+0000","last_active":"2024-09-19T11:14:07.583768+0000","last_peered":"2024-09-19T11:14:07.583768+0000","last_clean":"2024-09-19T11:14:07.583768+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:14:07.583768+0000","last_undegraded":"2024-09-19T11:14:07.583768+0000","last_fullsized":"2024-09-19T11:14:07.583768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:11.171587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003933+0000","last_change":"2024-09-19T11:13:33.345970+0000","last_active":"2024-09-19T11:16:43.003933+0000","last_peered":"2024-09-19T11:16:43.003933+0000","last_clean":"2024-09-19T11:16:43.003933+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:16:43.003933+0000","last_undegraded":"2024-09-19T11:16:43.003933+0000","last_fullsized":"2024-09-19T11:16:43.003933+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:42.633207+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.807595+0000","last_change":"2024-09-19T11:16:59.807595+0000","last_active":"2024-09-19T11:16:59.807595+0000","last_peered":"2024-09-19T11:16:59.807595+0000","last_clean":"2024-09-19T11:16:59.807595+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:16:59.807595+0000","last_undegraded":"2024-09-19T11:16:59.807595+0000","last_fullsized":"2024-09-19T11:16:59.807595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.807508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:27.508908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593781+0000","last_change":"2024-09-19T11:13:35.355437+0000","last_active":"2024-09-19T11:14:07.593781+0000","last_peered":"2024-09-19T11:14:07.593781+0000","last_clean":"2024-09-19T11:14:07.593781+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:14:07.593781+0000","last_undegraded":"2024-09-19T11:14:07.593781+0000","last_fullsized":"2024-09-19T11:14:07.593781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.209336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.853385+0000","last_change":"2024-09-19T11:13:37.367049+0000","last_active":"2024-09-19T11:16:49.853385+0000","last_peered":"2024-09-19T11:16:49.853385+0000","last_clean":"2024-09-19T11:16:49.853385+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:16:49.853385+0000","last_undegraded":"2024-09-19T11:16:49.853385+0000","last_fullsized":"2024-09-19T11:16:49.853385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:18.747358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586010+0000","last_change":"2024-09-19T11:13:39.381142+0000","last_active":"2024-09-19T11:14:07.586010+0000","last_peered":"2024-09-19T11:14:07.586010+0000","last_clean":"2024-09-19T11:14:07.586010+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:14:07.586010+0000","last_undegraded":"2024-09-19T11:14:07.586010+0000","last_fullsized":"2024-09-19T11:14:07.586010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:40.981200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.110163+0000","last_change":"2024-09-19T11:13:41.388869+0000","last_active":"2024-09-19T11:14:58.110163+0000","last_peered":"2024-09-19T11:14:58.110163+0000","last_clean":"2024-09-19T11:14:58.110163+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:14:58.110163+0000","last_undegraded":"2024-09-19T11:14:58.110163+0000","last_fullsized":"2024-09-19T11:14:58.110163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:20.834731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739953+0000","last_change":"2024-09-19T11:13:33.347043+0000","last_active":"2024-09-19T11:16:42.739953+0000","last_peered":"2024-09-19T11:16:42.739953+0000","last_clean":"2024-09-19T11:16:42.739953+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:16:42.739953+0000","last_undegraded":"2024-09-19T11:16:42.739953+0000","last_fullsized":"2024-09-19T11:16:42.739953+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:36.469017+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.243754+0000","last_change":"2024-09-19T11:17:11.243754+0000","last_active":"2024-09-19T11:17:11.243754+0000","last_peered":"2024-09-19T11:17:11.243754+0000","last_clean":"2024-09-19T11:17:11.243754+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:17:11.243754+0000","last_undegraded":"2024-09-19T11:17:11.243754+0000","last_fullsized":"2024-09-19T11:17:11.243754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.243640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.224247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589719+0000","last_change":"2024-09-19T11:13:35.357430+0000","last_active":"2024-09-19T11:14:07.589719+0000","last_peered":"2024-09-19T11:14:07.589719+0000","last_clean":"2024-09-19T11:14:07.589719+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:14:07.589719+0000","last_undegraded":"2024-09-19T11:14:07.589719+0000","last_fullsized":"2024-09-19T11:14:07.589719+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:37.024755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.856771+0000","last_change":"2024-09-19T11:13:37.365759+0000","last_active":"2024-09-19T11:16:49.856771+0000","last_peered":"2024-09-19T11:16:49.856771+0000","last_clean":"2024-09-19T11:16:49.856771+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:16:49.856771+0000","last_undegraded":"2024-09-19T11:16:49.856771+0000","last_fullsized":"2024-09-19T11:16:49.856771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:56.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584006+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.584006+0000","last_peered":"2024-09-19T11:14:07.584006+0000","last_clean":"2024-09-19T11:14:07.584006+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:14:07.584006+0000","last_undegraded":"2024-09-19T11:14:07.584006+0000","last_fullsized":"2024-09-19T11:14:07.584006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:21.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586387+0000","last_change":"2024-09-19T11:13:41.394164+0000","last_active":"2024-09-19T11:14:07.586387+0000","last_peered":"2024-09-19T11:14:07.586387+0000","last_clean":"2024-09-19T11:14:07.586387+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:14:07.586387+0000","last_undegraded":"2024-09-19T11:14:07.586387+0000","last_fullsized":"2024-09-19T11:14:07.586387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.249643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'4","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.105117+0000","last_change":"2024-09-19T11:13:33.349183+0000","last_active":"2024-09-19T11:16:43.105117+0000","last_peered":"2024-09-19T11:16:43.105117+0000","last_clean":"2024-09-19T11:16:43.105117+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:16:43.105117+0000","last_undegraded":"2024-09-19T11:16:43.105117+0000","last_fullsized":"2024-09-19T11:16:43.105117+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:56:16.760506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.736025+0000","last_change":"2024-09-19T11:16:58.736025+0000","last_active":"2024-09-19T11:16:58.736025+0000","last_peered":"2024-09-19T11:16:58.736025+0000","last_clean":"2024-09-19T11:16:58.736025+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:16:58.736025+0000","last_undegraded":"2024-09-19T11:16:58.736025+0000","last_fullsized":"2024-09-19T11:16:58.736025+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.735931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:08.584806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.592890+0000","last_change":"2024-09-19T11:13:35.359098+0000","last_active":"2024-09-19T11:14:07.592890+0000","last_peered":"2024-09-19T11:14:07.592890+0000","last_clean":"2024-09-19T11:14:07.592890+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:14:07.592890+0000","last_undegraded":"2024-09-19T11:14:07.592890+0000","last_fullsized":"2024-09-19T11:14:07.592890+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:11:56.137473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'29","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.827236+0000","last_change":"2024-09-19T11:13:37.368500+0000","last_active":"2024-09-19T11:16:49.827236+0000","last_peered":"2024-09-19T11:16:49.827236+0000","last_clean":"2024-09-19T11:16:49.827236+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:16:49.827236+0000","last_undegraded":"2024-09-19T11:16:49.827236+0000","last_fullsized":"2024-09-19T11:16:49.827236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:42.855744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584628+0000","last_change":"2024-09-19T11:13:39.375517+0000","last_active":"2024-09-19T11:14:07.584628+0000","last_peered":"2024-09-19T11:14:07.584628+0000","last_clean":"2024-09-19T11:14:07.584628+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:14:07.584628+0000","last_undegraded":"2024-09-19T11:14:07.584628+0000","last_fullsized":"2024-09-19T11:14:07.584628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:42.881775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.362489+0000","last_change":"2024-09-19T11:13:41.393750+0000","last_active":"2024-09-19T11:15:40.362489+0000","last_peered":"2024-09-19T11:15:40.362489+0000","last_clean":"2024-09-19T11:15:40.362489+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:15:40.362489+0000","last_undegraded":"2024-09-19T11:15:40.362489+0000","last_fullsized":"2024-09-19T11:15:40.362489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:29.365114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.739944+0000","last_change":"2024-09-19T11:13:33.342298+0000","last_active":"2024-09-19T11:16:42.739944+0000","last_peered":"2024-09-19T11:16:42.739944+0000","last_clean":"2024-09-19T11:16:42.739944+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:16:42.739944+0000","last_undegraded":"2024-09-19T11:16:42.739944+0000","last_fullsized":"2024-09-19T11:16:42.739944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:12:30.192043+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.841145+0000","last_change":"2024-09-19T11:16:58.841145+0000","last_active":"2024-09-19T11:16:58.841145+0000","last_peered":"2024-09-19T11:16:58.841145+0000","last_clean":"2024-09-19T11:16:58.841145+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:58.841145+0000","last_undegraded":"2024-09-19T11:16:58.841145+0000","last_fullsized":"2024-09-19T11:16:58.841145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.841052+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:37.793058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'2","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.945426+0000","last_change":"2024-09-19T11:13:35.357671+0000","last_active":"2024-09-19T11:15:38.945426+0000","last_peered":"2024-09-19T11:15:38.945426+0000","last_clean":"2024-09-19T11:15:38.945426+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:15:38.945426+0000","last_undegraded":"2024-09-19T11:15:38.945426+0000","last_fullsized":"2024-09-19T11:15:38.945426+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:03.047743+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'37","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.837082+0000","last_change":"2024-09-19T11:13:37.371443+0000","last_active":"2024-09-19T11:16:49.837082+0000","last_peered":"2024-09-19T11:16:49.837082+0000","last_clean":"2024-09-19T11:16:49.837082+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:16:49.837082+0000","last_undegraded":"2024-09-19T11:16:49.837082+0000","last_fullsized":"2024-09-19T11:16:49.837082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.734955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586898+0000","last_change":"2024-09-19T11:13:39.381795+0000","last_active":"2024-09-19T11:14:07.586898+0000","last_peered":"2024-09-19T11:14:07.586898+0000","last_clean":"2024-09-19T11:14:07.586898+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:14:07.586898+0000","last_undegraded":"2024-09-19T11:14:07.586898+0000","last_fullsized":"2024-09-19T11:14:07.586898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:05.918916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.365479+0000","last_change":"2024-09-19T11:13:41.392101+0000","last_active":"2024-09-19T11:15:40.365479+0000","last_peered":"2024-09-19T11:15:40.365479+0000","last_clean":"2024-09-19T11:15:40.365479+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:15:40.365479+0000","last_undegraded":"2024-09-19T11:15:40.365479+0000","last_fullsized":"2024-09-19T11:15:40.365479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:25.270293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.930575+0000","last_change":"2024-09-19T11:13:33.361155+0000","last_active":"2024-09-19T11:14:57.930575+0000","last_peered":"2024-09-19T11:14:57.930575+0000","last_clean":"2024-09-19T11:14:57.930575+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:14:57.930575+0000","last_undegraded":"2024-09-19T11:14:57.930575+0000","last_fullsized":"2024-09-19T11:14:57.930575+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:51.951767+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.122899+0000","last_change":"2024-09-19T11:17:02.122899+0000","last_active":"2024-09-19T11:17:02.122899+0000","last_peered":"2024-09-19T11:17:02.122899+0000","last_clean":"2024-09-19T11:17:02.122899+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:17:02.122899+0000","last_undegraded":"2024-09-19T11:17:02.122899+0000","last_fullsized":"2024-09-19T11:17:02.122899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.122788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:56.217100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899012+0000","last_change":"2024-09-19T11:13:33.352614+0000","last_active":"2024-09-19T11:16:42.899012+0000","last_peered":"2024-09-19T11:16:42.899012+0000","last_clean":"2024-09-19T11:16:42.899012+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:16:42.899012+0000","last_undegraded":"2024-09-19T11:16:42.899012+0000","last_fullsized":"2024-09-19T11:16:42.899012+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:26.192496+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.729547+0000","last_change":"2024-09-19T11:17:00.729547+0000","last_active":"2024-09-19T11:17:00.729547+0000","last_peered":"2024-09-19T11:17:00.729547+0000","last_clean":"2024-09-19T11:17:00.729547+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:17:00.729547+0000","last_undegraded":"2024-09-19T11:17:00.729547+0000","last_fullsized":"2024-09-19T11:17:00.729547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.729447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:20.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.614216+0000","last_change":"2024-09-19T11:13:33.352551+0000","last_active":"2024-09-19T11:14:15.614216+0000","last_peered":"2024-09-19T11:14:15.614216+0000","last_clean":"2024-09-19T11:14:15.614216+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:14:15.614216+0000","last_undegraded":"2024-09-19T11:14:15.614216+0000","last_fullsized":"2024-09-19T11:14:15.614216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:55:30.759232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.280573+0000","last_change":"2024-09-19T11:17:12.280573+0000","last_active":"2024-09-19T11:17:12.280573+0000","last_peered":"2024-09-19T11:17:12.280573+0000","last_clean":"2024-09-19T11:17:12.280573+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:17:12.280573+0000","last_undegraded":"2024-09-19T11:17:12.280573+0000","last_fullsized":"2024-09-19T11:17:12.280573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.280488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:06.626222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'19","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.972405+0000","last_change":"2024-09-19T11:13:33.352928+0000","last_active":"2024-09-19T11:16:42.972405+0000","last_peered":"2024-09-19T11:16:42.972405+0000","last_clean":"2024-09-19T11:16:42.972405+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:16:42.972405+0000","last_undegraded":"2024-09-19T11:16:42.972405+0000","last_fullsized":"2024-09-19T11:16:42.972405+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":19,"log_dups_size":0,"ondisk_log_size":19,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:38:48.077538+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.750132+0000","last_change":"2024-09-19T11:17:01.750132+0000","last_active":"2024-09-19T11:17:01.750132+0000","last_peered":"2024-09-19T11:17:01.750132+0000","last_clean":"2024-09-19T11:17:01.750132+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:17:01.750132+0000","last_undegraded":"2024-09-19T11:17:01.750132+0000","last_fullsized":"2024-09-19T11:17:01.750132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.750039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:21.882909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'5","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974126+0000","last_change":"2024-09-19T11:13:33.350710+0000","last_active":"2024-09-19T11:16:42.974126+0000","last_peered":"2024-09-19T11:16:42.974126+0000","last_clean":"2024-09-19T11:16:42.974126+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:16:42.974126+0000","last_undegraded":"2024-09-19T11:16:42.974126+0000","last_fullsized":"2024-09-19T11:16:42.974126+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:39.016549+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.719201+0000","last_change":"2024-09-19T11:16:59.719201+0000","last_active":"2024-09-19T11:16:59.719201+0000","last_peered":"2024-09-19T11:16:59.719201+0000","last_clean":"2024-09-19T11:16:59.719201+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:16:59.719201+0000","last_undegraded":"2024-09-19T11:16:59.719201+0000","last_fullsized":"2024-09-19T11:16:59.719201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.719107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:52.014566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740563+0000","last_change":"2024-09-19T11:13:33.356293+0000","last_active":"2024-09-19T11:16:42.740563+0000","last_peered":"2024-09-19T11:16:42.740563+0000","last_clean":"2024-09-19T11:16:42.740563+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:16:42.740563+0000","last_undegraded":"2024-09-19T11:16:42.740563+0000","last_fullsized":"2024-09-19T11:16:42.740563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:02:41.299802+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.712688+0000","last_change":"2024-09-19T11:17:04.712688+0000","last_active":"2024-09-19T11:17:04.712688+0000","last_peered":"2024-09-19T11:17:04.712688+0000","last_clean":"2024-09-19T11:17:04.712688+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:17:04.712688+0000","last_undegraded":"2024-09-19T11:17:04.712688+0000","last_fullsized":"2024-09-19T11:17:04.712688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.712601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:18.151651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.899087+0000","last_change":"2024-09-19T11:13:33.342404+0000","last_active":"2024-09-19T11:16:42.899087+0000","last_peered":"2024-09-19T11:16:42.899087+0000","last_clean":"2024-09-19T11:16:42.899087+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:16:42.899087+0000","last_undegraded":"2024-09-19T11:16:42.899087+0000","last_fullsized":"2024-09-19T11:16:42.899087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:34.386826+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.127471+0000","last_change":"2024-09-19T11:17:03.127471+0000","last_active":"2024-09-19T11:17:03.127471+0000","last_peered":"2024-09-19T11:17:03.127471+0000","last_clean":"2024-09-19T11:17:03.127471+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:17:03.127471+0000","last_undegraded":"2024-09-19T11:17:03.127471+0000","last_fullsized":"2024-09-19T11:17:03.127471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.127373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:45.319191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.542620+0000","last_change":"2024-09-19T11:17:13.542620+0000","last_active":"2024-09-19T11:17:13.542620+0000","last_peered":"2024-09-19T11:17:13.542620+0000","last_clean":"2024-09-19T11:17:13.542620+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:17:13.542620+0000","last_undegraded":"2024-09-19T11:17:13.542620+0000","last_fullsized":"2024-09-19T11:17:13.542620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.542491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:23.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.719810+0000","last_change":"2024-09-19T11:17:02.719810+0000","last_active":"2024-09-19T11:17:02.719810+0000","last_peered":"2024-09-19T11:17:02.719810+0000","last_clean":"2024-09-19T11:17:02.719810+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:17:02.719810+0000","last_undegraded":"2024-09-19T11:17:02.719810+0000","last_fullsized":"2024-09-19T11:17:02.719810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.719684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:09.105342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.627034+0000","last_change":"2024-09-19T11:13:33.359004+0000","last_active":"2024-09-19T11:16:42.627034+0000","last_peered":"2024-09-19T11:16:42.627034+0000","last_clean":"2024-09-19T11:16:42.627034+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:16:42.627034+0000","last_undegraded":"2024-09-19T11:16:42.627034+0000","last_fullsized":"2024-09-19T11:16:42.627034+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:28:23.555499+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.324790+0000","last_change":"2024-09-19T11:17:13.324790+0000","last_active":"2024-09-19T11:17:13.324790+0000","last_peered":"2024-09-19T11:17:13.324790+0000","last_clean":"2024-09-19T11:17:13.324790+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:17:13.324790+0000","last_undegraded":"2024-09-19T11:17:13.324790+0000","last_fullsized":"2024-09-19T11:17:13.324790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.324688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:10.883666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974025+0000","last_change":"2024-09-19T11:13:33.353505+0000","last_active":"2024-09-19T11:16:42.974025+0000","last_peered":"2024-09-19T11:16:42.974025+0000","last_clean":"2024-09-19T11:16:42.974025+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:16:42.974025+0000","last_undegraded":"2024-09-19T11:16:42.974025+0000","last_fullsized":"2024-09-19T11:16:42.974025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:00.609441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.735210+0000","last_change":"2024-09-19T11:17:04.735210+0000","last_active":"2024-09-19T11:17:04.735210+0000","last_peered":"2024-09-19T11:17:04.735210+0000","last_clean":"2024-09-19T11:17:04.735210+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:17:04.735210+0000","last_undegraded":"2024-09-19T11:17:04.735210+0000","last_fullsized":"2024-09-19T11:17:04.735210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.735127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:17.771568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'11","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:50.539564+0000","last_change":"2024-09-19T11:13:33.355120+0000","last_active":"2024-09-19T11:15:50.539564+0000","last_peered":"2024-09-19T11:15:50.539564+0000","last_clean":"2024-09-19T11:15:50.539564+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:15:50.539564+0000","last_undegraded":"2024-09-19T11:15:50.539564+0000","last_fullsized":"2024-09-19T11:15:50.539564+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:34:31.601366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.744045+0000","last_change":"2024-09-19T11:17:02.744045+0000","last_active":"2024-09-19T11:17:02.744045+0000","last_peered":"2024-09-19T11:17:02.744045+0000","last_clean":"2024-09-19T11:17:02.744045+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:17:02.744045+0000","last_undegraded":"2024-09-19T11:17:02.744045+0000","last_fullsized":"2024-09-19T11:17:02.744045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.743932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:55.116235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.003913+0000","last_change":"2024-09-19T11:13:33.343642+0000","last_active":"2024-09-19T11:16:43.003913+0000","last_peered":"2024-09-19T11:16:43.003913+0000","last_clean":"2024-09-19T11:16:43.003913+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:16:43.003913+0000","last_undegraded":"2024-09-19T11:16:43.003913+0000","last_fullsized":"2024-09-19T11:16:43.003913+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:40:53.472377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.781064+0000","last_change":"2024-09-19T11:17:01.781064+0000","last_active":"2024-09-19T11:17:01.781064+0000","last_peered":"2024-09-19T11:17:01.781064+0000","last_clean":"2024-09-19T11:17:01.781064+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:17:01.781064+0000","last_undegraded":"2024-09-19T11:17:01.781064+0000","last_fullsized":"2024-09-19T11:17:01.781064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.780976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:25.647175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":72,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.966006+0000","last_change":"2024-09-19T11:14:07.601382+0000","last_active":"2024-09-19T11:16:42.966006+0000","last_peered":"2024-09-19T11:16:42.966006+0000","last_clean":"2024-09-19T11:16:42.966006+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:16:42.966006+0000","last_undegraded":"2024-09-19T11:16:42.966006+0000","last_fullsized":"2024-09-19T11:16:42.966006+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:18:56.799598+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586433+0000","last_change":"2024-09-19T11:13:31.368567+0000","last_active":"2024-09-19T11:14:07.586433+0000","last_peered":"2024-09-19T11:14:07.586433+0000","last_clean":"2024-09-19T11:14:07.586433+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:14:07.586433+0000","last_undegraded":"2024-09-19T11:14:07.586433+0000","last_fullsized":"2024-09-19T11:14:07.586433+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:54.576708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'11","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.542111+0000","last_change":"2024-09-19T11:13:33.358374+0000","last_active":"2024-09-19T11:15:48.542111+0000","last_peered":"2024-09-19T11:15:48.542111+0000","last_clean":"2024-09-19T11:15:48.542111+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:15:48.542111+0000","last_undegraded":"2024-09-19T11:15:48.542111+0000","last_fullsized":"2024-09-19T11:15:48.542111+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":11,"log_dups_size":0,"ondisk_log_size":11,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:35:51.284800+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587720+0000","last_change":"2024-09-19T11:13:31.368596+0000","last_active":"2024-09-19T11:14:07.587720+0000","last_peered":"2024-09-19T11:14:07.587720+0000","last_clean":"2024-09-19T11:14:07.587720+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:14:07.587720+0000","last_undegraded":"2024-09-19T11:14:07.587720+0000","last_fullsized":"2024-09-19T11:14:07.587720+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:56:55.723268+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540107+0000","last_change":"2024-09-19T11:13:33.348514+0000","last_active":"2024-09-19T11:15:48.540107+0000","last_peered":"2024-09-19T11:15:48.540107+0000","last_clean":"2024-09-19T11:15:48.540107+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:15:48.540107+0000","last_undegraded":"2024-09-19T11:15:48.540107+0000","last_fullsized":"2024-09-19T11:15:48.540107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:09.293276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.153242+0000","last_change":"2024-09-19T11:17:04.153242+0000","last_active":"2024-09-19T11:17:04.153242+0000","last_peered":"2024-09-19T11:17:04.153242+0000","last_clean":"2024-09-19T11:17:04.153242+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:17:04.153242+0000","last_undegraded":"2024-09-19T11:17:04.153242+0000","last_fullsized":"2024-09-19T11:17:04.153242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.153146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:23.740652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.380975+0000","last_change":"2024-09-19T11:13:33.349772+0000","last_active":"2024-09-19T11:14:15.380975+0000","last_peered":"2024-09-19T11:14:15.380975+0000","last_clean":"2024-09-19T11:14:15.380975+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:14:15.380975+0000","last_undegraded":"2024-09-19T11:14:15.380975+0000","last_fullsized":"2024-09-19T11:14:15.380975+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:19.296584+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.496128+0000","last_change":"2024-09-19T11:13:31.367744+0000","last_active":"2024-09-19T11:16:42.496128+0000","last_peered":"2024-09-19T11:16:42.496128+0000","last_clean":"2024-09-19T11:16:42.496128+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:16:42.496128+0000","last_undegraded":"2024-09-19T11:16:42.496128+0000","last_fullsized":"2024-09-19T11:16:42.496128+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:00.738468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585297+0000","last_change":"2024-09-19T11:13:31.375358+0000","last_active":"2024-09-19T11:14:07.585297+0000","last_peered":"2024-09-19T11:14:07.585297+0000","last_clean":"2024-09-19T11:14:07.585297+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:14:07.585297+0000","last_undegraded":"2024-09-19T11:14:07.585297+0000","last_fullsized":"2024-09-19T11:14:07.585297+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:30.313624+0000","last_clean_scrub_stamp":"2024-09-19T11:13:30.313624+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:48:05.720807+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.898876+0000","last_change":"2024-09-19T11:13:33.349130+0000","last_active":"2024-09-19T11:16:42.898876+0000","last_peered":"2024-09-19T11:16:42.898876+0000","last_clean":"2024-09-19T11:16:42.898876+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:16:42.898876+0000","last_undegraded":"2024-09-19T11:16:42.898876+0000","last_fullsized":"2024-09-19T11:16:42.898876+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:05.045203+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.699792+0000","last_change":"2024-09-19T11:17:06.699792+0000","last_active":"2024-09-19T11:17:06.699792+0000","last_peered":"2024-09-19T11:17:06.699792+0000","last_clean":"2024-09-19T11:17:06.699792+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:17:06.699792+0000","last_undegraded":"2024-09-19T11:17:06.699792+0000","last_fullsized":"2024-09-19T11:17:06.699792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.699710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:06.685184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.740036+0000","last_change":"2024-09-19T11:13:33.353238+0000","last_active":"2024-09-19T11:16:42.740036+0000","last_peered":"2024-09-19T11:16:42.740036+0000","last_clean":"2024-09-19T11:16:42.740036+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:16:42.740036+0000","last_undegraded":"2024-09-19T11:16:42.740036+0000","last_fullsized":"2024-09-19T11:16:42.740036+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:02.108897+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1375,"ondisk_log_size":1375,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":12,"ondisk_log_size":12,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":473,"ondisk_log_size":473,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640308,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":512000,"data_stored":161981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640309,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36352,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335488,"statfs":{"total":96636764160,"available":96599539712,"internally_reserved":0,"allocated":1032192,"data_stored":749066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640309,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1056768,"data_stored":749395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705715,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":39972,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331868,"statfs":{"total":96636764160,"available":96595832832,"internally_reserved":0,"allocated":479232,"data_stored":160962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:17:14.862 INFO:tasks.ceph:pgid 4.38 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.863 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.863 INFO:tasks.ceph:pgid 3.3d last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.863 INFO:tasks.ceph:pgid 4.3a last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.863 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.863 INFO:tasks.ceph:pgid 3.3b last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.863 INFO:tasks.ceph:pgid 4.3c last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.863 INFO:tasks.ceph:pgid 4.3d last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.864 INFO:tasks.ceph:pgid 3.39 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.864 INFO:tasks.ceph:pgid 4.3e last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.864 INFO:tasks.ceph:pgid 4.3f last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.864 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.864 INFO:tasks.ceph:pgid 4.31 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.864 INFO:tasks.ceph:pgid 4.32 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.864 INFO:tasks.ceph:pgid 4.33 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.864 INFO:tasks.ceph:pgid 4.34 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.865 INFO:tasks.ceph:pgid 4.35 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.865 INFO:tasks.ceph:pgid 3.32 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.865 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.865 INFO:tasks.ceph:pgid 4.14 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.865 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.865 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.865 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.865 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.866 INFO:tasks.ceph:pgid 4.15 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.866 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.866 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.866 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.866 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.866 INFO:tasks.ceph:pgid 4.16 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.866 INFO:tasks.ceph:pgid 5.17 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.867 INFO:tasks.ceph:pgid 6.14 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.867 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.867 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.867 INFO:tasks.ceph:pgid 4.17 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.867 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.867 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.867 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.867 INFO:tasks.ceph:pgid 4.8 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.868 INFO:tasks.ceph:pgid 5.9 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.868 INFO:tasks.ceph:pgid 6.a last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.868 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.868 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.868 INFO:tasks.ceph:pgid 5.8 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.868 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.868 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.868 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.869 INFO:tasks.ceph:pgid 5.b last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.869 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.869 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.869 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.869 INFO:tasks.ceph:pgid 5.a last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.869 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.869 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.869 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 5.d last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 4.d last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 5.c last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 6.f last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.870 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.871 INFO:tasks.ceph:pgid 5.f last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.871 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.871 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.871 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.871 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.871 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.871 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.871 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.872 INFO:tasks.ceph:pgid 4.5 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.872 INFO:tasks.ceph:pgid 5.4 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.872 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.872 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.872 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.872 INFO:tasks.ceph:pgid 4.6 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.872 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.872 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.873 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.873 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.873 INFO:tasks.ceph:pgid 5.6 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.873 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.873 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.873 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.873 INFO:tasks.ceph:pgid 5.5 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.873 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.874 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.874 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.874 INFO:tasks.ceph:pgid 5.3 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.874 INFO:tasks.ceph:pgid 6.0 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.874 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.874 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.874 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.874 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 6.3 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.875 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.876 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.876 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.876 INFO:tasks.ceph:pgid 4.13 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.876 INFO:tasks.ceph:pgid 5.12 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.876 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.876 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.876 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.876 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 4.11 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 5.10 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.877 INFO:tasks.ceph:pgid 4.10 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 6.12 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 4.1f last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 5.1e last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.878 INFO:tasks.ceph:pgid 4.1e last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 5.1f last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 4.1d last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 5.1c last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.879 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.880 INFO:tasks.ceph:pgid 4.1c last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.880 INFO:tasks.ceph:pgid 5.1d last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.880 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.880 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.880 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.880 INFO:tasks.ceph:pgid 4.1b last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.880 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 4.1a last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 5.1b last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.881 INFO:tasks.ceph:pgid 4.19 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 5.18 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 4.18 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 5.19 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.882 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.883 INFO:tasks.ceph:pgid 4.27 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.883 INFO:tasks.ceph:pgid 4.26 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.883 INFO:tasks.ceph:pgid 4.25 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.883 INFO:tasks.ceph:pgid 4.24 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.883 INFO:tasks.ceph:pgid 4.23 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.883 INFO:tasks.ceph:pgid 4.22 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.883 INFO:tasks.ceph:pgid 4.21 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 4.2f last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 4.2d last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 4.2c last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 4.2b last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 3.2c last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 4.2a last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 3.2d last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.884 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.885 INFO:tasks.ceph:pgid 4.28 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.885 INFO:tasks.ceph:pgid 3.2f last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.885 INFO:tasks.ceph:pgid 3.30 last_scrub_stamp 2024-09-19T11:13:30.313624+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=30, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.885 INFO:tasks.ceph:pgid 4.37 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.885 INFO:tasks.ceph:pgid 4.36 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:14.885 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T11:17:34.886 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:17:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:34.999+0000 7f16603c6640 1 Processor -- start 2024-09-19T11:17:35.001 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:34.999+0000 7f16603c6640 1 -- start start 2024-09-19T11:17:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.000+0000 7f16603c6640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f165806efc0 0x7f165806f3a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.000+0000 7f16603c6640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f1658070330 con 0x7f165806f8e0 2024-09-19T11:17:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.000+0000 7f16603c6640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f165809f310 con 0x7f165806efc0 2024-09-19T11:17:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.000+0000 7f165e162640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f165806efc0 0x7f165806f3a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.000+0000 7f165d961640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f165806f8e0 0x7f165809b4a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:40098/0 (socket says 172.21.15.37:40098) 2024-09-19T11:17:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.000+0000 7f165d961640 1 -- 172.21.15.37:0/1500648637 learned_addr learned my addr 172.21.15.37:0/1500648637 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:17:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.000+0000 7f165e162640 1 -- 172.21.15.37:0/1500648637 >> v1:172.21.15.37:6789/0 conn(0x7f165806f8e0 legacy=0x7f165809b4a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:35.002 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.001+0000 7f165e162640 1 -- 172.21.15.37:0/1500648637 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1658070640 con 0x7f165806efc0 2024-09-19T11:17:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.001+0000 7f165e162640 1 --2- 172.21.15.37:0/1500648637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165806f3a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f1654009d90 tx=0x7f165402a660 comp rx=0 tx=0).ready entity=mon.0 client_cookie=eafb3e17fd69fe1b server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.001+0000 7f165d160640 1 -- 172.21.15.37:0/1500648637 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1654007670 con 0x7f165806efc0 2024-09-19T11:17:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.001+0000 7f165d160640 1 -- 172.21.15.37:0/1500648637 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f1654007810 con 0x7f165806efc0 2024-09-19T11:17:35.004 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.001+0000 7f165d160640 1 -- 172.21.15.37:0/1500648637 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1654007b10 con 0x7f165806efc0 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.002+0000 7f16603c6640 1 -- 172.21.15.37:0/1500648637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 msgr2=0x7f165806f3a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.002+0000 7f16603c6640 1 --2- 172.21.15.37:0/1500648637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165806f3a0 secure :-1 s=READY pgs=893 cs=0 l=1 rev1=1 crypto rx=0x7f1654009d90 tx=0x7f165402a660 comp rx=0 tx=0).stop 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.002+0000 7f16603c6640 1 -- 172.21.15.37:0/1500648637 shutdown_connections 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.002+0000 7f16603c6640 1 --2- 172.21.15.37:0/1500648637 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165806f3a0 unknown :-1 s=CLOSED pgs=893 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.002+0000 7f16603c6640 1 -- 172.21.15.37:0/1500648637 >> 172.21.15.37:0/1500648637 conn(0x7f16580a2460 msgr2=0x7f165809e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.002+0000 7f16603c6640 1 -- 172.21.15.37:0/1500648637 shutdown_connections 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.002+0000 7f16603c6640 1 -- 172.21.15.37:0/1500648637 wait complete. 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.003+0000 7f16603c6640 1 Processor -- start 2024-09-19T11:17:35.005 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.003+0000 7f16603c6640 1 -- start start 2024-09-19T11:17:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.003+0000 7f16603c6640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165812ba10 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.003+0000 7f16603c6640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f165809f870 con 0x7f165806efc0 2024-09-19T11:17:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f165e162640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165812ba10 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f165e162640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165812ba10 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:43966/0 (socket says 172.21.15.37:43966) 2024-09-19T11:17:35.007 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f165e162640 1 -- 172.21.15.37:0/1133533416 learned_addr learned my addr 172.21.15.37:0/1133533416 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f165e162640 1 -- 172.21.15.37:0/1133533416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f1658091690 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f165e162640 1 --2- 172.21.15.37:0/1133533416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165812ba10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f1654009eb0 tx=0x7f1654004a40 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f164effd640 1 -- 172.21.15.37:0/1133533416 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f1654040070 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f164effd640 1 -- 172.21.15.37:0/1133533416 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f16540079c0 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f1658091980 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f164effd640 1 -- 172.21.15.37:0/1133533416 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f165403c420 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.004+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f165812c130 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.005+0000 7f164effd640 1 -- 172.21.15.37:0/1133533416 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f1654039040 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.005+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f165806f3a0 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.006+0000 7f164effd640 1 --2- 172.21.15.37:0/1133533416 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f163c03e710 0x7f163c040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.006+0000 7f164effd640 1 -- 172.21.15.37:0/1133533416 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f165402ae00 con 0x7f165806efc0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.006+0000 7f165d961640 1 --2- 172.21.15.37:0/1133533416 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f163c03e710 0x7f163c040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:35.008 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.006+0000 7f165d961640 1 --2- 172.21.15.37:0/1133533416 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f163c03e710 0x7f163c040bd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1648007fd0 tx=0x7f1648007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:35.011 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.010+0000 7f164effd640 1 -- 172.21.15.37:0/1133533416 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f1654038d60 con 0x7f165806efc0 2024-09-19T11:17:35.198 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.197+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f1658073fe0 con 0x7f163c03e710 2024-09-19T11:17:35.208 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.207+0000 7f164effd640 1 -- 172.21.15.37:0/1133533416 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666174 (secure 0 0 0) 0x7f1658073fe0 con 0x7f163c03e710 2024-09-19T11:17:35.215 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:17:35.221 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:17:35.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f163c03e710 msgr2=0x7f163c040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:35.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 --2- 172.21.15.37:0/1133533416 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f163c03e710 0x7f163c040bd0 secure :-1 s=READY pgs=370 cs=0 l=1 rev1=1 crypto rx=0x7f1648007fd0 tx=0x7f1648007aa0 comp rx=0 tx=0).stop 2024-09-19T11:17:35.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 msgr2=0x7f165812ba10 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:35.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 --2- 172.21.15.37:0/1133533416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165812ba10 secure :-1 s=READY pgs=894 cs=0 l=1 rev1=1 crypto rx=0x7f1654009eb0 tx=0x7f1654004a40 comp rx=0 tx=0).stop 2024-09-19T11:17:35.223 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 shutdown_connections 2024-09-19T11:17:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 --2- 172.21.15.37:0/1133533416 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f163c03e710 0x7f163c040bd0 unknown :-1 s=CLOSED pgs=370 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 --2- 172.21.15.37:0/1133533416 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f165806efc0 0x7f165812ba10 unknown :-1 s=CLOSED pgs=894 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 >> 172.21.15.37:0/1133533416 conn(0x7f16580a2460 msgr2=0x7f165809d4c0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:17:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 shutdown_connections 2024-09-19T11:17:35.224 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:35.212+0000 7f16603c6640 1 -- 172.21.15.37:0/1133533416 wait complete. 2024-09-19T11:17:35.225 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":166,"stamp":"2024-09-19T11:17:34.595242+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5183,"num_read_kb":4725,"num_write":2125,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4625,"ondisk_log_size":4625,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":161024,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":157945,"kb_avail":377326336,"statfs":{"total":386547056640,"available":386382168064,"internally_reserved":0,"allocated":3080192,"data_stored":1821404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":161736470},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003843"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.185503+0000","last_change":"2024-09-19T11:17:09.185503+0000","last_active":"2024-09-19T11:17:09.185503+0000","last_peered":"2024-09-19T11:17:09.185503+0000","last_clean":"2024-09-19T11:17:09.185503+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:17:09.185503+0000","last_undegraded":"2024-09-19T11:17:09.185503+0000","last_fullsized":"2024-09-19T11:17:09.185503+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.185421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:28.271527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.428109+0000","last_change":"2024-09-19T11:17:24.428109+0000","last_active":"2024-09-19T11:17:24.428109+0000","last_peered":"2024-09-19T11:17:24.428109+0000","last_clean":"2024-09-19T11:17:24.428109+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:17:24.428109+0000","last_undegraded":"2024-09-19T11:17:24.428109+0000","last_fullsized":"2024-09-19T11:17:24.428109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:24.428032+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:24.428032+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.428032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:15:35.180377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.722223+0000","last_change":"2024-09-19T11:17:07.722223+0000","last_active":"2024-09-19T11:17:07.722223+0000","last_peered":"2024-09-19T11:17:07.722223+0000","last_clean":"2024-09-19T11:17:07.722223+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:17:07.722223+0000","last_undegraded":"2024-09-19T11:17:07.722223+0000","last_fullsized":"2024-09-19T11:17:07.722223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.722137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:30.023844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'7","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.010386+0000","last_change":"2024-09-19T11:13:33.353250+0000","last_active":"2024-09-19T11:16:43.010386+0000","last_peered":"2024-09-19T11:16:43.010386+0000","last_clean":"2024-09-19T11:16:43.010386+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:16:43.010386+0000","last_undegraded":"2024-09-19T11:16:43.010386+0000","last_fullsized":"2024-09-19T11:16:43.010386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:26:36.293949+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.305534+0000","last_change":"2024-09-19T11:17:20.305534+0000","last_active":"2024-09-19T11:17:20.305534+0000","last_peered":"2024-09-19T11:17:20.305534+0000","last_clean":"2024-09-19T11:17:20.305534+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:17:20.305534+0000","last_undegraded":"2024-09-19T11:17:20.305534+0000","last_fullsized":"2024-09-19T11:17:20.305534+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:20.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:20.305449+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:26.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.707910+0000","last_change":"2024-09-19T11:17:19.707910+0000","last_active":"2024-09-19T11:17:19.707910+0000","last_peered":"2024-09-19T11:17:19.707910+0000","last_clean":"2024-09-19T11:17:19.707910+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:17:19.707910+0000","last_undegraded":"2024-09-19T11:17:19.707910+0000","last_fullsized":"2024-09-19T11:17:19.707910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:19.707815+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:19.707815+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.707815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:44.051682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.203776+0000","last_change":"2024-09-19T11:17:07.203719+0000","last_active":"2024-09-19T11:17:07.203776+0000","last_peered":"2024-09-19T11:17:07.203776+0000","last_clean":"2024-09-19T11:17:07.203776+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:07.203776+0000","last_undegraded":"2024-09-19T11:17:07.203776+0000","last_fullsized":"2024-09-19T11:17:07.203776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.203629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:11.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.965800+0000","last_change":"2024-09-19T11:13:33.349816+0000","last_active":"2024-09-19T11:16:42.965800+0000","last_peered":"2024-09-19T11:16:42.965800+0000","last_clean":"2024-09-19T11:16:42.965800+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:16:42.965800+0000","last_undegraded":"2024-09-19T11:16:42.965800+0000","last_fullsized":"2024-09-19T11:16:42.965800+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:40:57.078087+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.273303+0000","last_change":"2024-09-19T11:17:21.273303+0000","last_active":"2024-09-19T11:17:21.273303+0000","last_peered":"2024-09-19T11:17:21.273303+0000","last_clean":"2024-09-19T11:17:21.273303+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:17:21.273303+0000","last_undegraded":"2024-09-19T11:17:21.273303+0000","last_fullsized":"2024-09-19T11:17:21.273303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:21.273210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:21.273210+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.273210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:17.566575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.419946+0000","last_change":"2024-09-19T11:17:25.419858+0000","last_active":"2024-09-19T11:17:25.419946+0000","last_peered":"2024-09-19T11:17:25.419946+0000","last_clean":"2024-09-19T11:17:25.419946+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:17:25.419946+0000","last_undegraded":"2024-09-19T11:17:25.419946+0000","last_fullsized":"2024-09-19T11:17:25.419946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:25.419735+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:25.419735+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.419735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:25.095539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.173145+0000","last_change":"2024-09-19T11:17:06.173145+0000","last_active":"2024-09-19T11:17:06.173145+0000","last_peered":"2024-09-19T11:17:06.173145+0000","last_clean":"2024-09-19T11:17:06.173145+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:17:06.173145+0000","last_undegraded":"2024-09-19T11:17:06.173145+0000","last_fullsized":"2024-09-19T11:17:06.173145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.173052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:49.733204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'22","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.178486+0000","last_change":"2024-09-19T11:17:24.178486+0000","last_active":"2024-09-19T11:17:24.178486+0000","last_peered":"2024-09-19T11:17:24.178486+0000","last_clean":"2024-09-19T11:17:24.178486+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:17:24.178486+0000","last_undegraded":"2024-09-19T11:17:24.178486+0000","last_fullsized":"2024-09-19T11:17:24.178486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:24.178395+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:24.178395+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.178395+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:32:31.010938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.336034+0000","last_change":"2024-09-19T11:17:19.336034+0000","last_active":"2024-09-19T11:17:19.336034+0000","last_peered":"2024-09-19T11:17:19.336034+0000","last_clean":"2024-09-19T11:17:19.336034+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:17:19.336034+0000","last_undegraded":"2024-09-19T11:17:19.336034+0000","last_fullsized":"2024-09-19T11:17:19.336034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:19.335927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:19.335927+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.335927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:24.741509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.176944+0000","last_change":"2024-09-19T11:17:19.176944+0000","last_active":"2024-09-19T11:17:19.176944+0000","last_peered":"2024-09-19T11:17:19.176944+0000","last_clean":"2024-09-19T11:17:19.176944+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:17:19.176944+0000","last_undegraded":"2024-09-19T11:17:19.176944+0000","last_fullsized":"2024-09-19T11:17:19.176944+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:19.176853+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:19.176853+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.176853+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:04.753042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.735731+0000","last_change":"2024-09-19T11:17:05.735731+0000","last_active":"2024-09-19T11:17:05.735731+0000","last_peered":"2024-09-19T11:17:05.735731+0000","last_clean":"2024-09-19T11:17:05.735731+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:17:05.735731+0000","last_undegraded":"2024-09-19T11:17:05.735731+0000","last_fullsized":"2024-09-19T11:17:05.735731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.735639+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:45.185308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.161499+0000","last_change":"2024-09-19T11:17:20.161499+0000","last_active":"2024-09-19T11:17:20.161499+0000","last_peered":"2024-09-19T11:17:20.161499+0000","last_clean":"2024-09-19T11:17:20.161499+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:17:20.161499+0000","last_undegraded":"2024-09-19T11:17:20.161499+0000","last_fullsized":"2024-09-19T11:17:20.161499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:20.161414+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:20.161414+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.161414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:55.200468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.096691+0000","last_change":"2024-09-19T11:13:33.353058+0000","last_active":"2024-09-19T11:15:42.096691+0000","last_peered":"2024-09-19T11:15:42.096691+0000","last_clean":"2024-09-19T11:15:42.096691+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:15:42.096691+0000","last_undegraded":"2024-09-19T11:15:42.096691+0000","last_fullsized":"2024-09-19T11:15:42.096691+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:02.922700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.728105+0000","last_change":"2024-09-19T11:17:03.728105+0000","last_active":"2024-09-19T11:17:03.728105+0000","last_peered":"2024-09-19T11:17:03.728105+0000","last_clean":"2024-09-19T11:17:03.728105+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:17:03.728105+0000","last_undegraded":"2024-09-19T11:17:03.728105+0000","last_fullsized":"2024-09-19T11:17:03.728105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.728013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:50.046423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.546410+0000","last_change":"2024-09-19T11:17:21.546410+0000","last_active":"2024-09-19T11:17:21.546410+0000","last_peered":"2024-09-19T11:17:21.546410+0000","last_clean":"2024-09-19T11:17:21.546410+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:17:21.546410+0000","last_undegraded":"2024-09-19T11:17:21.546410+0000","last_fullsized":"2024-09-19T11:17:21.546410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:21.546297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:21.546297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.546297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:35.564864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.201897+0000","last_change":"2024-09-19T11:17:05.201897+0000","last_active":"2024-09-19T11:17:05.201897+0000","last_peered":"2024-09-19T11:17:05.201897+0000","last_clean":"2024-09-19T11:17:05.201897+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:17:05.201897+0000","last_undegraded":"2024-09-19T11:17:05.201897+0000","last_fullsized":"2024-09-19T11:17:05.201897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.201777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:39.204473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.461723+0000","last_change":"2024-09-19T11:17:23.461723+0000","last_active":"2024-09-19T11:17:23.461723+0000","last_peered":"2024-09-19T11:17:23.461723+0000","last_clean":"2024-09-19T11:17:23.461723+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:17:23.461723+0000","last_undegraded":"2024-09-19T11:17:23.461723+0000","last_fullsized":"2024-09-19T11:17:23.461723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:23.461640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:23.461640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.461640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:44.860304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.571584+0000","last_change":"2024-09-19T11:17:10.571584+0000","last_active":"2024-09-19T11:17:10.571584+0000","last_peered":"2024-09-19T11:17:10.571584+0000","last_clean":"2024-09-19T11:17:10.571584+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:17:10.571584+0000","last_undegraded":"2024-09-19T11:17:10.571584+0000","last_fullsized":"2024-09-19T11:17:10.571584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.571487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:05.033249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.700307+0000","last_change":"2024-09-19T11:17:21.700307+0000","last_active":"2024-09-19T11:17:21.700307+0000","last_peered":"2024-09-19T11:17:21.700307+0000","last_clean":"2024-09-19T11:17:21.700307+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:17:21.700307+0000","last_undegraded":"2024-09-19T11:17:21.700307+0000","last_fullsized":"2024-09-19T11:17:21.700307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:21.700211+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:21.700211+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.700211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.309406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.677222+0000","last_change":"2024-09-19T11:17:06.677222+0000","last_active":"2024-09-19T11:17:06.677222+0000","last_peered":"2024-09-19T11:17:06.677222+0000","last_clean":"2024-09-19T11:17:06.677222+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:17:06.677222+0000","last_undegraded":"2024-09-19T11:17:06.677222+0000","last_fullsized":"2024-09-19T11:17:06.677222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.677123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:51.934638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.191519+0000","last_change":"2024-09-19T11:17:18.191519+0000","last_active":"2024-09-19T11:17:18.191519+0000","last_peered":"2024-09-19T11:17:18.191519+0000","last_clean":"2024-09-19T11:17:18.191519+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:17:18.191519+0000","last_undegraded":"2024-09-19T11:17:18.191519+0000","last_fullsized":"2024-09-19T11:17:18.191519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:18.191426+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:18.191426+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.191426+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:24.097341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.749724+0000","last_change":"2024-09-19T11:17:03.749724+0000","last_active":"2024-09-19T11:17:03.749724+0000","last_peered":"2024-09-19T11:17:03.749724+0000","last_clean":"2024-09-19T11:17:03.749724+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:17:03.749724+0000","last_undegraded":"2024-09-19T11:17:03.749724+0000","last_fullsized":"2024-09-19T11:17:03.749724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.749624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:09.231023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.498306+0000","last_change":"2024-09-19T11:17:22.498306+0000","last_active":"2024-09-19T11:17:22.498306+0000","last_peered":"2024-09-19T11:17:22.498306+0000","last_clean":"2024-09-19T11:17:22.498306+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:17:22.498306+0000","last_undegraded":"2024-09-19T11:17:22.498306+0000","last_fullsized":"2024-09-19T11:17:22.498306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:22.498193+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:22.498193+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.498193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:31.267529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.314533+0000","last_change":"2024-09-19T11:17:18.314533+0000","last_active":"2024-09-19T11:17:18.314533+0000","last_peered":"2024-09-19T11:17:18.314533+0000","last_clean":"2024-09-19T11:17:18.314533+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:17:18.314533+0000","last_undegraded":"2024-09-19T11:17:18.314533+0000","last_fullsized":"2024-09-19T11:17:18.314533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:18.314426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:18.314426+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.314426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:36.967813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'35","reported_seq":100,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.938013+0000","last_change":"2024-09-19T11:13:41.395109+0000","last_active":"2024-09-19T11:16:42.938013+0000","last_peered":"2024-09-19T11:16:42.938013+0000","last_clean":"2024-09-19T11:16:42.938013+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:16:42.938013+0000","last_undegraded":"2024-09-19T11:16:42.938013+0000","last_fullsized":"2024-09-19T11:16:42.938013+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:26:41.943528+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.319705+0000","last_change":"2024-09-19T11:17:26.319705+0000","last_active":"2024-09-19T11:17:26.319705+0000","last_peered":"2024-09-19T11:17:26.319705+0000","last_clean":"2024-09-19T11:17:26.319705+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:17:26.319705+0000","last_undegraded":"2024-09-19T11:17:26.319705+0000","last_fullsized":"2024-09-19T11:17:26.319705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:26.319597+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:26.319597+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.319597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:32.580506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.339744+0000","last_change":"2024-09-19T11:17:08.339744+0000","last_active":"2024-09-19T11:17:08.339744+0000","last_peered":"2024-09-19T11:17:08.339744+0000","last_clean":"2024-09-19T11:17:08.339744+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:17:08.339744+0000","last_undegraded":"2024-09-19T11:17:08.339744+0000","last_fullsized":"2024-09-19T11:17:08.339744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.339654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:36.909793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586243+0000","last_change":"2024-09-19T11:13:35.358078+0000","last_active":"2024-09-19T11:14:07.586243+0000","last_peered":"2024-09-19T11:14:07.586243+0000","last_clean":"2024-09-19T11:14:07.586243+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:14:07.586243+0000","last_undegraded":"2024-09-19T11:14:07.586243+0000","last_fullsized":"2024-09-19T11:14:07.586243+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:59.783214+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.803962+0000","last_change":"2024-09-19T11:13:37.368405+0000","last_active":"2024-09-19T11:16:49.803962+0000","last_peered":"2024-09-19T11:16:49.803962+0000","last_clean":"2024-09-19T11:16:49.803962+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:16:49.803962+0000","last_undegraded":"2024-09-19T11:16:49.803962+0000","last_fullsized":"2024-09-19T11:16:49.803962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:09.867739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596623+0000","last_change":"2024-09-19T11:13:39.376399+0000","last_active":"2024-09-19T11:14:07.596623+0000","last_peered":"2024-09-19T11:14:07.596623+0000","last_clean":"2024-09-19T11:14:07.596623+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:14:07.596623+0000","last_undegraded":"2024-09-19T11:14:07.596623+0000","last_fullsized":"2024-09-19T11:14:07.596623+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:25:16.668274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.935993+0000","last_change":"2024-09-19T11:13:41.393295+0000","last_active":"2024-09-19T11:14:57.935993+0000","last_peered":"2024-09-19T11:14:57.935993+0000","last_clean":"2024-09-19T11:14:57.935993+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:14:57.935993+0000","last_undegraded":"2024-09-19T11:14:57.935993+0000","last_fullsized":"2024-09-19T11:14:57.935993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:48.199857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.211803+0000","last_change":"2024-09-19T11:17:29.211803+0000","last_active":"2024-09-19T11:17:29.211803+0000","last_peered":"2024-09-19T11:17:29.211803+0000","last_clean":"2024-09-19T11:17:29.211803+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:17:29.211803+0000","last_undegraded":"2024-09-19T11:17:29.211803+0000","last_fullsized":"2024-09-19T11:17:29.211803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:29.211683+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:29.211683+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.211683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:00.455274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.229925+0000","last_change":"2024-09-19T11:16:59.229925+0000","last_active":"2024-09-19T11:16:59.229925+0000","last_peered":"2024-09-19T11:16:59.229925+0000","last_clean":"2024-09-19T11:16:59.229925+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:16:59.229925+0000","last_undegraded":"2024-09-19T11:16:59.229925+0000","last_fullsized":"2024-09-19T11:16:59.229925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.229836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.835840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586880+0000","last_change":"2024-09-19T11:13:35.350079+0000","last_active":"2024-09-19T11:14:07.586880+0000","last_peered":"2024-09-19T11:14:07.586880+0000","last_clean":"2024-09-19T11:14:07.586880+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:14:07.586880+0000","last_undegraded":"2024-09-19T11:14:07.586880+0000","last_fullsized":"2024-09-19T11:14:07.586880+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:28.629336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"35'6","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.596198+0000","last_change":"2024-09-19T11:13:37.365209+0000","last_active":"2024-09-19T11:14:07.596198+0000","last_peered":"2024-09-19T11:14:07.596198+0000","last_clean":"2024-09-19T11:14:07.596198+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:14:07.596198+0000","last_undegraded":"2024-09-19T11:14:07.596198+0000","last_fullsized":"2024-09-19T11:14:07.596198+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:11.593458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595746+0000","last_change":"2024-09-19T11:13:39.377776+0000","last_active":"2024-09-19T11:14:07.595746+0000","last_peered":"2024-09-19T11:14:07.595746+0000","last_clean":"2024-09-19T11:14:07.595746+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:14:07.595746+0000","last_undegraded":"2024-09-19T11:14:07.595746+0000","last_fullsized":"2024-09-19T11:14:07.595746+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:56:02.688553+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586216+0000","last_change":"2024-09-19T11:13:41.387845+0000","last_active":"2024-09-19T11:14:07.586216+0000","last_peered":"2024-09-19T11:14:07.586216+0000","last_clean":"2024-09-19T11:14:07.586216+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:14:07.586216+0000","last_undegraded":"2024-09-19T11:14:07.586216+0000","last_fullsized":"2024-09-19T11:14:07.586216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:01.782452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":115,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.236476+0000","last_change":"2024-09-19T11:17:28.236476+0000","last_active":"2024-09-19T11:17:28.236476+0000","last_peered":"2024-09-19T11:17:28.236476+0000","last_clean":"2024-09-19T11:17:28.236476+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:17:28.236476+0000","last_undegraded":"2024-09-19T11:17:28.236476+0000","last_fullsized":"2024-09-19T11:17:28.236476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:28.236388+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:28.236388+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.236388+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:08.350408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.361981+0000","last_change":"2024-09-19T11:17:06.361981+0000","last_active":"2024-09-19T11:17:06.361981+0000","last_peered":"2024-09-19T11:17:06.361981+0000","last_clean":"2024-09-19T11:17:06.361981+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:17:06.361981+0000","last_undegraded":"2024-09-19T11:17:06.361981+0000","last_fullsized":"2024-09-19T11:17:06.361981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.361895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.368884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.221087+0000","last_change":"2024-09-19T11:17:23.221087+0000","last_active":"2024-09-19T11:17:23.221087+0000","last_peered":"2024-09-19T11:17:23.221087+0000","last_clean":"2024-09-19T11:17:23.221087+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:17:23.221087+0000","last_undegraded":"2024-09-19T11:17:23.221087+0000","last_fullsized":"2024-09-19T11:17:23.221087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:23.221010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:23.221010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.221010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:14.504688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"37'16","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.193229+0000","last_change":"2024-09-19T11:17:32.193229+0000","last_active":"2024-09-19T11:17:32.193229+0000","last_peered":"2024-09-19T11:17:32.193229+0000","last_clean":"2024-09-19T11:17:32.193229+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:17:32.193229+0000","last_undegraded":"2024-09-19T11:17:32.193229+0000","last_fullsized":"2024-09-19T11:17:32.193229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-19T11:17:32.193122+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-19T11:17:32.193122+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.193122+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:16.365007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":385,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.714648+0000","last_change":"2024-09-19T11:13:39.380724+0000","last_active":"2024-09-19T11:16:49.714648+0000","last_peered":"2024-09-19T11:16:49.714648+0000","last_clean":"2024-09-19T11:16:49.714648+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:16:49.714648+0000","last_undegraded":"2024-09-19T11:16:49.714648+0000","last_fullsized":"2024-09-19T11:16:49.714648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587647+0000","last_change":"2024-09-19T11:13:41.387332+0000","last_active":"2024-09-19T11:14:07.587647+0000","last_peered":"2024-09-19T11:14:07.587647+0000","last_clean":"2024-09-19T11:14:07.587647+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:14:07.587647+0000","last_undegraded":"2024-09-19T11:14:07.587647+0000","last_fullsized":"2024-09-19T11:14:07.587647+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:31:45.206952+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.747257+0000","last_change":"2024-09-19T11:17:11.747257+0000","last_active":"2024-09-19T11:17:11.747257+0000","last_peered":"2024-09-19T11:17:11.747257+0000","last_clean":"2024-09-19T11:17:11.747257+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:17:11.747257+0000","last_undegraded":"2024-09-19T11:17:11.747257+0000","last_fullsized":"2024-09-19T11:17:11.747257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:11.747153+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:11.747153+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.747153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:25.029210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.839089+0000","last_change":"2024-09-19T11:16:55.839089+0000","last_active":"2024-09-19T11:16:55.839089+0000","last_peered":"2024-09-19T11:16:55.839089+0000","last_clean":"2024-09-19T11:16:55.839089+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:55.839089+0000","last_undegraded":"2024-09-19T11:16:55.839089+0000","last_fullsized":"2024-09-19T11:16:55.839089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.839001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.925106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586260+0000","last_change":"2024-09-19T11:13:35.355473+0000","last_active":"2024-09-19T11:14:07.586260+0000","last_peered":"2024-09-19T11:14:07.586260+0000","last_clean":"2024-09-19T11:14:07.586260+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:14:07.586260+0000","last_undegraded":"2024-09-19T11:14:07.586260+0000","last_fullsized":"2024-09-19T11:14:07.586260+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:54:26.695828+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.772995+0000","last_change":"2024-09-19T11:13:37.367406+0000","last_active":"2024-09-19T11:16:49.772995+0000","last_peered":"2024-09-19T11:16:49.772995+0000","last_clean":"2024-09-19T11:16:49.772995+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:16:49.772995+0000","last_undegraded":"2024-09-19T11:16:49.772995+0000","last_fullsized":"2024-09-19T11:16:49.772995+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:16.650159+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'285","reported_seq":445,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.719611+0000","last_change":"2024-09-19T11:13:39.380575+0000","last_active":"2024-09-19T11:16:49.719611+0000","last_peered":"2024-09-19T11:16:49.719611+0000","last_clean":"2024-09-19T11:16:49.719611+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:16:49.719611+0000","last_undegraded":"2024-09-19T11:16:49.719611+0000","last_fullsized":"2024-09-19T11:16:49.719611+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:21.136508+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.274193+0000","last_change":"2024-09-19T11:17:27.274193+0000","last_active":"2024-09-19T11:17:27.274193+0000","last_peered":"2024-09-19T11:17:27.274193+0000","last_clean":"2024-09-19T11:17:27.274193+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:17:27.274193+0000","last_undegraded":"2024-09-19T11:17:27.274193+0000","last_fullsized":"2024-09-19T11:17:27.274193+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:27.274106+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:27.274106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.274106+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:39.287747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.263964+0000","last_change":"2024-09-19T11:16:57.263964+0000","last_active":"2024-09-19T11:16:57.263964+0000","last_peered":"2024-09-19T11:16:57.263964+0000","last_clean":"2024-09-19T11:16:57.263964+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:16:57.263964+0000","last_undegraded":"2024-09-19T11:16:57.263964+0000","last_fullsized":"2024-09-19T11:16:57.263964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.263877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:17.532651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.362748+0000","last_change":"2024-09-19T11:17:28.362748+0000","last_active":"2024-09-19T11:17:28.362748+0000","last_peered":"2024-09-19T11:17:28.362748+0000","last_clean":"2024-09-19T11:17:28.362748+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:17:28.362748+0000","last_undegraded":"2024-09-19T11:17:28.362748+0000","last_fullsized":"2024-09-19T11:17:28.362748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:28.362667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:28.362667+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.362667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:04.145457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'52","reported_seq":112,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.186611+0000","last_change":"2024-09-19T11:17:29.186611+0000","last_active":"2024-09-19T11:17:29.186611+0000","last_peered":"2024-09-19T11:17:29.186611+0000","last_clean":"2024-09-19T11:17:29.186611+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:17:29.186611+0000","last_undegraded":"2024-09-19T11:17:29.186611+0000","last_fullsized":"2024-09-19T11:17:29.186611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'52","last_scrub_stamp":"2024-09-19T11:17:29.186505+0000","last_deep_scrub":"37'52","last_deep_scrub_stamp":"2024-09-19T11:17:29.186505+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.186505+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:21.134065+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587567+0000","last_change":"2024-09-19T11:13:39.374414+0000","last_active":"2024-09-19T11:14:07.587567+0000","last_peered":"2024-09-19T11:14:07.587567+0000","last_clean":"2024-09-19T11:14:07.587567+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:14:07.587567+0000","last_undegraded":"2024-09-19T11:14:07.587567+0000","last_fullsized":"2024-09-19T11:14:07.587567+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:03:56.581253+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.937677+0000","last_change":"2024-09-19T11:13:41.391613+0000","last_active":"2024-09-19T11:14:57.937677+0000","last_peered":"2024-09-19T11:14:57.937677+0000","last_clean":"2024-09-19T11:14:57.937677+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:14:57.937677+0000","last_undegraded":"2024-09-19T11:14:57.937677+0000","last_fullsized":"2024-09-19T11:14:57.937677+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:05.344146+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.628983+0000","last_change":"2024-09-19T11:17:07.628983+0000","last_active":"2024-09-19T11:17:07.628983+0000","last_peered":"2024-09-19T11:17:07.628983+0000","last_clean":"2024-09-19T11:17:07.628983+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:17:07.628983+0000","last_undegraded":"2024-09-19T11:17:07.628983+0000","last_fullsized":"2024-09-19T11:17:07.628983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.628902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:57.737242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.261648+0000","last_change":"2024-09-19T11:16:56.261648+0000","last_active":"2024-09-19T11:16:56.261648+0000","last_peered":"2024-09-19T11:16:56.261648+0000","last_clean":"2024-09-19T11:16:56.261648+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:16:56.261648+0000","last_undegraded":"2024-09-19T11:16:56.261648+0000","last_fullsized":"2024-09-19T11:16:56.261648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.261557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:54.106719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.638557+0000","last_change":"2024-09-19T11:17:24.638557+0000","last_active":"2024-09-19T11:17:24.638557+0000","last_peered":"2024-09-19T11:17:24.638557+0000","last_clean":"2024-09-19T11:17:24.638557+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:17:24.638557+0000","last_undegraded":"2024-09-19T11:17:24.638557+0000","last_fullsized":"2024-09-19T11:17:24.638557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:24.638460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:24.638460+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.638460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.911135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.859823+0000","last_change":"2024-09-19T11:13:37.369761+0000","last_active":"2024-09-19T11:16:49.859823+0000","last_peered":"2024-09-19T11:16:49.859823+0000","last_clean":"2024-09-19T11:16:49.859823+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:16:49.859823+0000","last_undegraded":"2024-09-19T11:16:49.859823+0000","last_fullsized":"2024-09-19T11:16:49.859823+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:36:09.455607+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587463+0000","last_change":"2024-09-19T11:13:39.381205+0000","last_active":"2024-09-19T11:14:07.587463+0000","last_peered":"2024-09-19T11:14:07.587463+0000","last_clean":"2024-09-19T11:14:07.587463+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:14:07.587463+0000","last_undegraded":"2024-09-19T11:14:07.587463+0000","last_fullsized":"2024-09-19T11:14:07.587463+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:33:48.612042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'5","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:52.381729+0000","last_change":"2024-09-19T11:13:41.393002+0000","last_active":"2024-09-19T11:14:52.381729+0000","last_peered":"2024-09-19T11:14:52.381729+0000","last_clean":"2024-09-19T11:14:52.381729+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:14:52.381729+0000","last_undegraded":"2024-09-19T11:14:52.381729+0000","last_fullsized":"2024-09-19T11:14:52.381729+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:23.043559+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.203698+0000","last_change":"2024-09-19T11:17:11.203698+0000","last_active":"2024-09-19T11:17:11.203698+0000","last_peered":"2024-09-19T11:17:11.203698+0000","last_clean":"2024-09-19T11:17:11.203698+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:17:11.203698+0000","last_undegraded":"2024-09-19T11:17:11.203698+0000","last_fullsized":"2024-09-19T11:17:11.203698+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.203591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:37.021206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.352287+0000","last_change":"2024-09-19T11:17:05.352287+0000","last_active":"2024-09-19T11:17:05.352287+0000","last_peered":"2024-09-19T11:17:05.352287+0000","last_clean":"2024-09-19T11:17:05.352287+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:17:05.352287+0000","last_undegraded":"2024-09-19T11:17:05.352287+0000","last_fullsized":"2024-09-19T11:17:05.352287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.352205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:29.817735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.637805+0000","last_change":"2024-09-19T11:17:25.637805+0000","last_active":"2024-09-19T11:17:25.637805+0000","last_peered":"2024-09-19T11:17:25.637805+0000","last_clean":"2024-09-19T11:17:25.637805+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:17:25.637805+0000","last_undegraded":"2024-09-19T11:17:25.637805+0000","last_fullsized":"2024-09-19T11:17:25.637805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:25.637701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:25.637701+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.637701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:53.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'40","reported_seq":90,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.824513+0000","last_change":"2024-09-19T11:13:37.371294+0000","last_active":"2024-09-19T11:16:49.824513+0000","last_peered":"2024-09-19T11:16:49.824513+0000","last_clean":"2024-09-19T11:16:49.824513+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:16:49.824513+0000","last_undegraded":"2024-09-19T11:16:49.824513+0000","last_fullsized":"2024-09-19T11:16:49.824513+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:55:44.761683+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'285","reported_seq":352,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.720874+0000","last_change":"2024-09-19T11:13:39.381485+0000","last_active":"2024-09-19T11:16:49.720874+0000","last_peered":"2024-09-19T11:16:49.720874+0000","last_clean":"2024-09-19T11:16:49.720874+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:16:49.720874+0000","last_undegraded":"2024-09-19T11:16:49.720874+0000","last_fullsized":"2024-09-19T11:16:49.720874+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:09:13.407016+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:15.028397+0000","last_change":"2024-09-19T11:13:41.390450+0000","last_active":"2024-09-19T11:14:15.028397+0000","last_peered":"2024-09-19T11:14:15.028397+0000","last_clean":"2024-09-19T11:14:15.028397+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:14:15.028397+0000","last_undegraded":"2024-09-19T11:14:15.028397+0000","last_fullsized":"2024-09-19T11:14:15.028397+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:05:48.882700+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.152751+0000","last_change":"2024-09-19T11:17:13.152751+0000","last_active":"2024-09-19T11:17:13.152751+0000","last_peered":"2024-09-19T11:17:13.152751+0000","last_clean":"2024-09-19T11:17:13.152751+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:17:13.152751+0000","last_undegraded":"2024-09-19T11:17:13.152751+0000","last_fullsized":"2024-09-19T11:17:13.152751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.152663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:40.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.373483+0000","last_change":"2024-09-19T11:17:04.373483+0000","last_active":"2024-09-19T11:17:04.373483+0000","last_peered":"2024-09-19T11:17:04.373483+0000","last_clean":"2024-09-19T11:17:04.373483+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:17:04.373483+0000","last_undegraded":"2024-09-19T11:17:04.373483+0000","last_fullsized":"2024-09-19T11:17:04.373483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.373373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:15.731395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.616866+0000","last_change":"2024-09-19T11:17:26.616866+0000","last_active":"2024-09-19T11:17:26.616866+0000","last_peered":"2024-09-19T11:17:26.616866+0000","last_clean":"2024-09-19T11:17:26.616866+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:17:26.616866+0000","last_undegraded":"2024-09-19T11:17:26.616866+0000","last_fullsized":"2024-09-19T11:17:26.616866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:26.616770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:26.616770+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.616770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:29.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'61","reported_seq":126,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.868030+0000","last_change":"2024-09-19T11:13:37.371428+0000","last_active":"2024-09-19T11:16:49.868030+0000","last_peered":"2024-09-19T11:16:49.868030+0000","last_clean":"2024-09-19T11:16:49.868030+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:16:49.868030+0000","last_undegraded":"2024-09-19T11:16:49.868030+0000","last_fullsized":"2024-09-19T11:16:49.868030+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":61,"log_dups_size":0,"ondisk_log_size":61,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:28:11.185147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586195+0000","last_change":"2024-09-19T11:13:39.369302+0000","last_active":"2024-09-19T11:14:07.586195+0000","last_peered":"2024-09-19T11:14:07.586195+0000","last_clean":"2024-09-19T11:14:07.586195+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:14:07.586195+0000","last_undegraded":"2024-09-19T11:14:07.586195+0000","last_fullsized":"2024-09-19T11:14:07.586195+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:49:58.150298+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'18","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.223256+0000","last_change":"2024-09-19T11:13:41.385457+0000","last_active":"2024-09-19T11:16:43.223256+0000","last_peered":"2024-09-19T11:16:43.223256+0000","last_clean":"2024-09-19T11:16:43.223256+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:16:43.223256+0000","last_undegraded":"2024-09-19T11:16:43.223256+0000","last_fullsized":"2024-09-19T11:16:43.223256+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":18,"log_dups_size":0,"ondisk_log_size":18,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:04.551953+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.621448+0000","last_change":"2024-09-19T11:17:11.621448+0000","last_active":"2024-09-19T11:17:11.621448+0000","last_peered":"2024-09-19T11:17:11.621448+0000","last_clean":"2024-09-19T11:17:11.621448+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:17:11.621448+0000","last_undegraded":"2024-09-19T11:17:11.621448+0000","last_fullsized":"2024-09-19T11:17:11.621448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.621356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:31.900753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.780765+0000","last_change":"2024-09-19T11:16:57.780765+0000","last_active":"2024-09-19T11:16:57.780765+0000","last_peered":"2024-09-19T11:16:57.780765+0000","last_clean":"2024-09-19T11:16:57.780765+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:16:57.780765+0000","last_undegraded":"2024-09-19T11:16:57.780765+0000","last_fullsized":"2024-09-19T11:16:57.780765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.780677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:08.322449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.193130+0000","last_change":"2024-09-19T11:17:30.193130+0000","last_active":"2024-09-19T11:17:30.193130+0000","last_peered":"2024-09-19T11:17:30.193130+0000","last_clean":"2024-09-19T11:17:30.193130+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:17:30.193130+0000","last_undegraded":"2024-09-19T11:17:30.193130+0000","last_fullsized":"2024-09-19T11:17:30.193130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.193023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.193023+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.193023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:55.620571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.871083+0000","last_change":"2024-09-19T11:13:37.362218+0000","last_active":"2024-09-19T11:16:49.871083+0000","last_peered":"2024-09-19T11:16:49.871083+0000","last_clean":"2024-09-19T11:16:49.871083+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:16:49.871083+0000","last_undegraded":"2024-09-19T11:16:49.871083+0000","last_fullsized":"2024-09-19T11:16:49.871083+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:00:38.878721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589393+0000","last_change":"2024-09-19T11:13:39.378975+0000","last_active":"2024-09-19T11:14:07.589393+0000","last_peered":"2024-09-19T11:14:07.589393+0000","last_clean":"2024-09-19T11:14:07.589393+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:14:07.589393+0000","last_undegraded":"2024-09-19T11:14:07.589393+0000","last_fullsized":"2024-09-19T11:14:07.589393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:43.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:43.539247+0000","last_change":"2024-09-19T11:13:41.390986+0000","last_active":"2024-09-19T11:15:43.539247+0000","last_peered":"2024-09-19T11:15:43.539247+0000","last_clean":"2024-09-19T11:15:43.539247+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:15:43.539247+0000","last_undegraded":"2024-09-19T11:15:43.539247+0000","last_fullsized":"2024-09-19T11:15:43.539247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:29.269359+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.351536+0000","last_change":"2024-09-19T11:17:24.351536+0000","last_active":"2024-09-19T11:17:24.351536+0000","last_peered":"2024-09-19T11:17:24.351536+0000","last_clean":"2024-09-19T11:17:24.351536+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:17:24.351536+0000","last_undegraded":"2024-09-19T11:17:24.351536+0000","last_fullsized":"2024-09-19T11:17:24.351536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:24.351451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:24.351451+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.351451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:00.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.388243+0000","last_change":"2024-09-19T11:17:03.388243+0000","last_active":"2024-09-19T11:17:03.388243+0000","last_peered":"2024-09-19T11:17:03.388243+0000","last_clean":"2024-09-19T11:17:03.388243+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:17:03.388243+0000","last_undegraded":"2024-09-19T11:17:03.388243+0000","last_fullsized":"2024-09-19T11:17:03.388243+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.388155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:34.409511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.599833+0000","last_change":"2024-09-19T11:17:27.599833+0000","last_active":"2024-09-19T11:17:27.599833+0000","last_peered":"2024-09-19T11:17:27.599833+0000","last_clean":"2024-09-19T11:17:27.599833+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:17:27.599833+0000","last_undegraded":"2024-09-19T11:17:27.599833+0000","last_fullsized":"2024-09-19T11:17:27.599833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.599747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.599747+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.599747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.745233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.207279+0000","last_change":"2024-09-19T11:17:31.207279+0000","last_active":"2024-09-19T11:17:31.207279+0000","last_peered":"2024-09-19T11:17:31.207279+0000","last_clean":"2024-09-19T11:17:31.207279+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:17:31.207279+0000","last_undegraded":"2024-09-19T11:17:31.207279+0000","last_fullsized":"2024-09-19T11:17:31.207279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:31.207126+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:31.207126+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.207126+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:27.455684+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'285","reported_seq":435,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.715545+0000","last_change":"2024-09-19T11:13:39.381222+0000","last_active":"2024-09-19T11:16:49.715545+0000","last_peered":"2024-09-19T11:16:49.715545+0000","last_clean":"2024-09-19T11:16:49.715545+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:16:49.715545+0000","last_undegraded":"2024-09-19T11:16:49.715545+0000","last_fullsized":"2024-09-19T11:16:49.715545+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:02.724027+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'14","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:45.538583+0000","last_change":"2024-09-19T11:13:41.387843+0000","last_active":"2024-09-19T11:15:45.538583+0000","last_peered":"2024-09-19T11:15:45.538583+0000","last_clean":"2024-09-19T11:15:45.538583+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:15:45.538583+0000","last_undegraded":"2024-09-19T11:15:45.538583+0000","last_fullsized":"2024-09-19T11:15:45.538583+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:35:31.060376+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.194292+0000","last_change":"2024-09-19T11:17:12.194292+0000","last_active":"2024-09-19T11:17:12.194292+0000","last_peered":"2024-09-19T11:17:12.194292+0000","last_clean":"2024-09-19T11:17:12.194292+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:17:12.194292+0000","last_undegraded":"2024-09-19T11:17:12.194292+0000","last_fullsized":"2024-09-19T11:17:12.194292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.194188+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:19.272935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.338513+0000","last_change":"2024-09-19T11:17:02.338513+0000","last_active":"2024-09-19T11:17:02.338513+0000","last_peered":"2024-09-19T11:17:02.338513+0000","last_clean":"2024-09-19T11:17:02.338513+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:17:02.338513+0000","last_undegraded":"2024-09-19T11:17:02.338513+0000","last_fullsized":"2024-09-19T11:17:02.338513+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.338404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:05.736888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":428,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.361930+0000","last_change":"2024-09-19T11:17:29.361930+0000","last_active":"2024-09-19T11:17:29.361930+0000","last_peered":"2024-09-19T11:17:29.361930+0000","last_clean":"2024-09-19T11:17:29.361930+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:17:29.361930+0000","last_undegraded":"2024-09-19T11:17:29.361930+0000","last_fullsized":"2024-09-19T11:17:29.361930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:29.361811+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:29.361811+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.361811+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:18.426521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586975+0000","last_change":"2024-09-19T11:13:37.369616+0000","last_active":"2024-09-19T11:14:07.586975+0000","last_peered":"2024-09-19T11:14:07.586975+0000","last_clean":"2024-09-19T11:14:07.586975+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:14:07.586975+0000","last_undegraded":"2024-09-19T11:14:07.586975+0000","last_fullsized":"2024-09-19T11:14:07.586975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.498959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'285","reported_seq":472,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.716872+0000","last_change":"2024-09-19T11:13:39.364476+0000","last_active":"2024-09-19T11:16:49.716872+0000","last_peered":"2024-09-19T11:16:49.716872+0000","last_clean":"2024-09-19T11:16:49.716872+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:16:49.716872+0000","last_undegraded":"2024-09-19T11:16:49.716872+0000","last_fullsized":"2024-09-19T11:16:49.716872+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:05.251594+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.968627+0000","last_change":"2024-09-19T11:13:41.382500+0000","last_active":"2024-09-19T11:16:42.968627+0000","last_peered":"2024-09-19T11:16:42.968627+0000","last_clean":"2024-09-19T11:16:42.968627+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:16:42.968627+0000","last_undegraded":"2024-09-19T11:16:42.968627+0000","last_fullsized":"2024-09-19T11:16:42.968627+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:08:44.429934+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.578446+0000","last_change":"2024-09-19T11:17:09.578446+0000","last_active":"2024-09-19T11:17:09.578446+0000","last_peered":"2024-09-19T11:17:09.578446+0000","last_clean":"2024-09-19T11:17:09.578446+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:17:09.578446+0000","last_undegraded":"2024-09-19T11:17:09.578446+0000","last_fullsized":"2024-09-19T11:17:09.578446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.578340+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:59.479596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.332945+0000","last_change":"2024-09-19T11:16:59.332945+0000","last_active":"2024-09-19T11:16:59.332945+0000","last_peered":"2024-09-19T11:16:59.332945+0000","last_clean":"2024-09-19T11:16:59.332945+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:16:59.332945+0000","last_undegraded":"2024-09-19T11:16:59.332945+0000","last_fullsized":"2024-09-19T11:16:59.332945+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.332858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:10.200721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"28'1","reported_seq":221,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.682184+0000","last_change":"2024-09-19T11:13:35.359895+0000","last_active":"2024-09-19T11:16:49.682184+0000","last_peered":"2024-09-19T11:16:49.682184+0000","last_clean":"2024-09-19T11:16:49.682184+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:16:49.682184+0000","last_undegraded":"2024-09-19T11:16:49.682184+0000","last_fullsized":"2024-09-19T11:16:49.682184+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":1,"log_dups_size":0,"ondisk_log_size":1,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:48.665046+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'41","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.807401+0000","last_change":"2024-09-19T11:13:37.367380+0000","last_active":"2024-09-19T11:16:49.807401+0000","last_peered":"2024-09-19T11:16:49.807401+0000","last_clean":"2024-09-19T11:16:49.807401+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:16:49.807401+0000","last_undegraded":"2024-09-19T11:16:49.807401+0000","last_fullsized":"2024-09-19T11:16:49.807401+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:44.610147+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587829+0000","last_change":"2024-09-19T11:13:39.381930+0000","last_active":"2024-09-19T11:14:07.587829+0000","last_peered":"2024-09-19T11:14:07.587829+0000","last_clean":"2024-09-19T11:14:07.587829+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:14:07.587829+0000","last_undegraded":"2024-09-19T11:14:07.587829+0000","last_fullsized":"2024-09-19T11:14:07.587829+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:20.757672+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'8","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.224963+0000","last_change":"2024-09-19T11:13:41.383036+0000","last_active":"2024-09-19T11:16:43.224963+0000","last_peered":"2024-09-19T11:16:43.224963+0000","last_clean":"2024-09-19T11:16:43.224963+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:16:43.224963+0000","last_undegraded":"2024-09-19T11:16:43.224963+0000","last_fullsized":"2024-09-19T11:16:43.224963+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:22.046963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.321969+0000","last_change":"2024-09-19T11:17:22.321969+0000","last_active":"2024-09-19T11:17:22.321969+0000","last_peered":"2024-09-19T11:17:22.321969+0000","last_clean":"2024-09-19T11:17:22.321969+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:17:22.321969+0000","last_undegraded":"2024-09-19T11:17:22.321969+0000","last_fullsized":"2024-09-19T11:17:22.321969+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:22.321856+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:22.321856+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.321856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:33.212561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.790923+0000","last_change":"2024-09-19T11:16:53.790826+0000","last_active":"2024-09-19T11:16:53.790923+0000","last_peered":"2024-09-19T11:16:53.790923+0000","last_clean":"2024-09-19T11:16:53.790923+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:16:53.790923+0000","last_undegraded":"2024-09-19T11:16:53.790923+0000","last_fullsized":"2024-09-19T11:16:53.790923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.790697+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:58.322869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.307176+0000","last_change":"2024-09-19T11:16:57.307111+0000","last_active":"2024-09-19T11:16:57.307176+0000","last_peered":"2024-09-19T11:16:57.307176+0000","last_clean":"2024-09-19T11:16:57.307176+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:16:57.307176+0000","last_undegraded":"2024-09-19T11:16:57.307176+0000","last_fullsized":"2024-09-19T11:16:57.307176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.307030+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:57.423065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.333402+0000","last_change":"2024-09-19T11:17:01.333402+0000","last_active":"2024-09-19T11:17:01.333402+0000","last_peered":"2024-09-19T11:17:01.333402+0000","last_clean":"2024-09-19T11:17:01.333402+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:17:01.333402+0000","last_undegraded":"2024-09-19T11:17:01.333402+0000","last_fullsized":"2024-09-19T11:17:01.333402+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.333297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:01.707856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.404242+0000","last_change":"2024-09-19T11:17:27.404242+0000","last_active":"2024-09-19T11:17:27.404242+0000","last_peered":"2024-09-19T11:17:27.404242+0000","last_clean":"2024-09-19T11:17:27.404242+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:17:27.404242+0000","last_undegraded":"2024-09-19T11:17:27.404242+0000","last_fullsized":"2024-09-19T11:17:27.404242+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.404158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.404158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.404158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:07.281435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'85","reported_seq":167,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.843332+0000","last_change":"2024-09-19T11:13:37.369113+0000","last_active":"2024-09-19T11:16:49.843332+0000","last_peered":"2024-09-19T11:16:49.843332+0000","last_clean":"2024-09-19T11:16:49.843332+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:16:49.843332+0000","last_undegraded":"2024-09-19T11:16:49.843332+0000","last_fullsized":"2024-09-19T11:16:49.843332+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":85,"log_dups_size":0,"ondisk_log_size":85,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:17.600400+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588503+0000","last_change":"2024-09-19T11:13:39.381749+0000","last_active":"2024-09-19T11:14:07.588503+0000","last_peered":"2024-09-19T11:14:07.588503+0000","last_clean":"2024-09-19T11:14:07.588503+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:14:07.588503+0000","last_undegraded":"2024-09-19T11:14:07.588503+0000","last_fullsized":"2024-09-19T11:14:07.588503+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:22:31.206255+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":164,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.012984+0000","last_change":"2024-09-19T11:13:41.382469+0000","last_active":"2024-09-19T11:16:43.012984+0000","last_peered":"2024-09-19T11:16:43.012984+0000","last_clean":"2024-09-19T11:16:43.012984+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:16:43.012984+0000","last_undegraded":"2024-09-19T11:16:43.012984+0000","last_fullsized":"2024-09-19T11:16:43.012984+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:23.490546+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.320770+0000","last_change":"2024-09-19T11:17:23.320770+0000","last_active":"2024-09-19T11:17:23.320770+0000","last_peered":"2024-09-19T11:17:23.320770+0000","last_clean":"2024-09-19T11:17:23.320770+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:17:23.320770+0000","last_undegraded":"2024-09-19T11:17:23.320770+0000","last_fullsized":"2024-09-19T11:17:23.320770+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:23.320681+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:23.320681+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.320681+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:45.331495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.377364+0000","last_change":"2024-09-19T11:16:54.377268+0000","last_active":"2024-09-19T11:16:54.377364+0000","last_peered":"2024-09-19T11:16:54.377364+0000","last_clean":"2024-09-19T11:16:54.377364+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:16:54.377364+0000","last_undegraded":"2024-09-19T11:16:54.377364+0000","last_fullsized":"2024-09-19T11:16:54.377364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.377134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:21.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.869737+0000","last_change":"2024-09-19T11:16:55.869737+0000","last_active":"2024-09-19T11:16:55.869737+0000","last_peered":"2024-09-19T11:16:55.869737+0000","last_clean":"2024-09-19T11:16:55.869737+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:16:55.869737+0000","last_undegraded":"2024-09-19T11:16:55.869737+0000","last_fullsized":"2024-09-19T11:16:55.869737+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.869650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:29.264317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589544+0000","last_change":"2024-09-19T11:13:35.355733+0000","last_active":"2024-09-19T11:14:07.589544+0000","last_peered":"2024-09-19T11:14:07.589544+0000","last_clean":"2024-09-19T11:14:07.589544+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:14:07.589544+0000","last_undegraded":"2024-09-19T11:14:07.589544+0000","last_fullsized":"2024-09-19T11:14:07.589544+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:13:16.022467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'284","reported_seq":501,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.863480+0000","last_change":"2024-09-19T11:13:37.365037+0000","last_active":"2024-09-19T11:16:49.863480+0000","last_peered":"2024-09-19T11:16:49.863480+0000","last_clean":"2024-09-19T11:16:49.863480+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:16:49.863480+0000","last_undegraded":"2024-09-19T11:16:49.863480+0000","last_fullsized":"2024-09-19T11:16:49.863480+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":284,"log_dups_size":0,"ondisk_log_size":284,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:00.713713+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585295+0000","last_change":"2024-09-19T11:13:39.379958+0000","last_active":"2024-09-19T11:14:07.585295+0000","last_peered":"2024-09-19T11:14:07.585295+0000","last_clean":"2024-09-19T11:14:07.585295+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:14:07.585295+0000","last_undegraded":"2024-09-19T11:14:07.585295+0000","last_fullsized":"2024-09-19T11:14:07.585295+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:20:57.435708+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.934138+0000","last_change":"2024-09-19T11:13:41.394316+0000","last_active":"2024-09-19T11:14:57.934138+0000","last_peered":"2024-09-19T11:14:57.934138+0000","last_clean":"2024-09-19T11:14:57.934138+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:14:57.934138+0000","last_undegraded":"2024-09-19T11:14:57.934138+0000","last_fullsized":"2024-09-19T11:14:57.934138+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:54.689542+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.718806+0000","last_change":"2024-09-19T11:17:09.718806+0000","last_active":"2024-09-19T11:17:09.718806+0000","last_peered":"2024-09-19T11:17:09.718806+0000","last_clean":"2024-09-19T11:17:09.718806+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:17:09.718806+0000","last_undegraded":"2024-09-19T11:17:09.718806+0000","last_fullsized":"2024-09-19T11:17:09.718806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.718720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:37.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.199111+0000","last_change":"2024-09-19T11:17:00.199057+0000","last_active":"2024-09-19T11:17:00.199111+0000","last_peered":"2024-09-19T11:17:00.199111+0000","last_clean":"2024-09-19T11:17:00.199111+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:17:00.199111+0000","last_undegraded":"2024-09-19T11:17:00.199111+0000","last_fullsized":"2024-09-19T11:17:00.199111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.198970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:17.702619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.862627+0000","last_change":"2024-09-19T11:16:54.862568+0000","last_active":"2024-09-19T11:16:54.862627+0000","last_peered":"2024-09-19T11:16:54.862627+0000","last_clean":"2024-09-19T11:16:54.862627+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:16:54.862627+0000","last_undegraded":"2024-09-19T11:16:54.862627+0000","last_fullsized":"2024-09-19T11:16:54.862627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.862494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:12.037986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.196383+0000","last_change":"2024-09-19T11:17:21.196383+0000","last_active":"2024-09-19T11:17:21.196383+0000","last_peered":"2024-09-19T11:17:21.196383+0000","last_clean":"2024-09-19T11:17:21.196383+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:17:21.196383+0000","last_undegraded":"2024-09-19T11:17:21.196383+0000","last_fullsized":"2024-09-19T11:17:21.196383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:21.196295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:21.196295+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.196295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:52.011445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'16","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:40.437418+0000","last_change":"2024-09-19T11:13:37.369777+0000","last_active":"2024-09-19T11:16:40.437418+0000","last_peered":"2024-09-19T11:16:40.437418+0000","last_clean":"2024-09-19T11:16:40.437418+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:16:40.437418+0000","last_undegraded":"2024-09-19T11:16:40.437418+0000","last_fullsized":"2024-09-19T11:16:40.437418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:44:09.642366+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587165+0000","last_change":"2024-09-19T11:13:39.382026+0000","last_active":"2024-09-19T11:14:07.587165+0000","last_peered":"2024-09-19T11:14:07.587165+0000","last_clean":"2024-09-19T11:14:07.587165+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:14:07.587165+0000","last_undegraded":"2024-09-19T11:14:07.587165+0000","last_fullsized":"2024-09-19T11:14:07.587165+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:06:05.351431+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.301235+0000","last_change":"2024-09-19T11:13:41.390159+0000","last_active":"2024-09-19T11:16:42.301235+0000","last_peered":"2024-09-19T11:16:42.301235+0000","last_clean":"2024-09-19T11:16:42.301235+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:16:42.301235+0000","last_undegraded":"2024-09-19T11:16:42.301235+0000","last_fullsized":"2024-09-19T11:16:42.301235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:47.188979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.741731+0000","last_change":"2024-09-19T11:17:08.741731+0000","last_active":"2024-09-19T11:17:08.741731+0000","last_peered":"2024-09-19T11:17:08.741731+0000","last_clean":"2024-09-19T11:17:08.741731+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:17:08.741731+0000","last_undegraded":"2024-09-19T11:17:08.741731+0000","last_fullsized":"2024-09-19T11:17:08.741731+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.741641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:41.893880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.316760+0000","last_change":"2024-09-19T11:16:58.316669+0000","last_active":"2024-09-19T11:16:58.316760+0000","last_peered":"2024-09-19T11:16:58.316760+0000","last_clean":"2024-09-19T11:16:58.316760+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:16:58.316760+0000","last_undegraded":"2024-09-19T11:16:58.316760+0000","last_fullsized":"2024-09-19T11:16:58.316760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.316534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:33.887561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.307594+0000","last_change":"2024-09-19T11:16:55.307594+0000","last_active":"2024-09-19T11:16:55.307594+0000","last_peered":"2024-09-19T11:16:55.307594+0000","last_clean":"2024-09-19T11:16:55.307594+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:16:55.307594+0000","last_undegraded":"2024-09-19T11:16:55.307594+0000","last_fullsized":"2024-09-19T11:16:55.307594+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.307489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:24.095008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'5","reported_seq":238,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.685079+0000","last_change":"2024-09-19T11:17:23.685079+0000","last_active":"2024-09-19T11:17:23.685079+0000","last_peered":"2024-09-19T11:17:23.685079+0000","last_clean":"2024-09-19T11:17:23.685079+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:17:23.685079+0000","last_undegraded":"2024-09-19T11:17:23.685079+0000","last_fullsized":"2024-09-19T11:17:23.685079+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:23.684978+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:23.684978+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.684978+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:01.177727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'14","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.146449+0000","last_change":"2024-09-19T11:13:37.369199+0000","last_active":"2024-09-19T11:16:42.146449+0000","last_peered":"2024-09-19T11:16:42.146449+0000","last_clean":"2024-09-19T11:16:42.146449+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:16:42.146449+0000","last_undegraded":"2024-09-19T11:16:42.146449+0000","last_fullsized":"2024-09-19T11:16:42.146449+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:07:43.083589+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589764+0000","last_change":"2024-09-19T11:13:39.379563+0000","last_active":"2024-09-19T11:14:07.589764+0000","last_peered":"2024-09-19T11:14:07.589764+0000","last_clean":"2024-09-19T11:14:07.589764+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:14:07.589764+0000","last_undegraded":"2024-09-19T11:14:07.589764+0000","last_fullsized":"2024-09-19T11:14:07.589764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:20.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.946285+0000","last_change":"2024-09-19T11:13:41.395412+0000","last_active":"2024-09-19T11:16:42.946285+0000","last_peered":"2024-09-19T11:16:42.946285+0000","last_clean":"2024-09-19T11:16:42.946285+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:16:42.946285+0000","last_undegraded":"2024-09-19T11:16:42.946285+0000","last_fullsized":"2024-09-19T11:16:42.946285+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:12:05.807709+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.597259+0000","last_change":"2024-09-19T11:17:08.597259+0000","last_active":"2024-09-19T11:17:08.597259+0000","last_peered":"2024-09-19T11:17:08.597259+0000","last_clean":"2024-09-19T11:17:08.597259+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:17:08.597259+0000","last_undegraded":"2024-09-19T11:17:08.597259+0000","last_fullsized":"2024-09-19T11:17:08.597259+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.597174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:37.364781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.263916+0000","last_change":"2024-09-19T11:16:54.263916+0000","last_active":"2024-09-19T11:16:54.263916+0000","last_peered":"2024-09-19T11:16:54.263916+0000","last_clean":"2024-09-19T11:16:54.263916+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:16:54.263916+0000","last_undegraded":"2024-09-19T11:16:54.263916+0000","last_fullsized":"2024-09-19T11:16:54.263916+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.263815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:48.536224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:52.839804+0000","last_change":"2024-09-19T11:16:52.839753+0000","last_active":"2024-09-19T11:16:52.839804+0000","last_peered":"2024-09-19T11:16:52.839804+0000","last_clean":"2024-09-19T11:16:52.839804+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:16:52.839804+0000","last_undegraded":"2024-09-19T11:16:52.839804+0000","last_fullsized":"2024-09-19T11:16:52.839804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_clean_scrub_stamp":"2024-09-19T11:16:52.839679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:51.504665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.721197+0000","last_change":"2024-09-19T11:17:22.721197+0000","last_active":"2024-09-19T11:17:22.721197+0000","last_peered":"2024-09-19T11:17:22.721197+0000","last_clean":"2024-09-19T11:17:22.721197+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:17:22.721197+0000","last_undegraded":"2024-09-19T11:17:22.721197+0000","last_fullsized":"2024-09-19T11:17:22.721197+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:22.721097+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:22.721097+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.721097+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:23:27.112253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'78","reported_seq":154,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.586553+0000","last_change":"2024-09-19T11:17:29.586553+0000","last_active":"2024-09-19T11:17:29.586553+0000","last_peered":"2024-09-19T11:17:29.586553+0000","last_clean":"2024-09-19T11:17:29.586553+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:17:29.586553+0000","last_undegraded":"2024-09-19T11:17:29.586553+0000","last_fullsized":"2024-09-19T11:17:29.586553+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'78","last_scrub_stamp":"2024-09-19T11:17:29.586456+0000","last_deep_scrub":"37'78","last_deep_scrub_stamp":"2024-09-19T11:17:29.586456+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.586456+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:17.660323+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586753+0000","last_change":"2024-09-19T11:13:39.380023+0000","last_active":"2024-09-19T11:14:07.586753+0000","last_peered":"2024-09-19T11:14:07.586753+0000","last_clean":"2024-09-19T11:14:07.586753+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:14:07.586753+0000","last_undegraded":"2024-09-19T11:14:07.586753+0000","last_fullsized":"2024-09-19T11:14:07.586753+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:35.513854+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.002199+0000","last_change":"2024-09-19T11:13:41.384779+0000","last_active":"2024-09-19T11:15:42.002199+0000","last_peered":"2024-09-19T11:15:42.002199+0000","last_clean":"2024-09-19T11:15:42.002199+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:15:42.002199+0000","last_undegraded":"2024-09-19T11:15:42.002199+0000","last_fullsized":"2024-09-19T11:15:42.002199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:01.181785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.725498+0000","last_change":"2024-09-19T11:17:05.725498+0000","last_active":"2024-09-19T11:17:05.725498+0000","last_peered":"2024-09-19T11:17:05.725498+0000","last_clean":"2024-09-19T11:17:05.725498+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:17:05.725498+0000","last_undegraded":"2024-09-19T11:17:05.725498+0000","last_fullsized":"2024-09-19T11:17:05.725498+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.725349+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:53.167095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.823573+0000","last_change":"2024-09-19T11:16:56.823573+0000","last_active":"2024-09-19T11:16:56.823573+0000","last_peered":"2024-09-19T11:16:56.823573+0000","last_clean":"2024-09-19T11:16:56.823573+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:16:56.823573+0000","last_undegraded":"2024-09-19T11:16:56.823573+0000","last_fullsized":"2024-09-19T11:16:56.823573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.823458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:43.789933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.328867+0000","last_change":"2024-09-19T11:16:55.328783+0000","last_active":"2024-09-19T11:16:55.328867+0000","last_peered":"2024-09-19T11:16:55.328867+0000","last_clean":"2024-09-19T11:16:55.328867+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:16:55.328867+0000","last_undegraded":"2024-09-19T11:16:55.328867+0000","last_fullsized":"2024-09-19T11:16:55.328867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.328699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:16.068678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584330+0000","last_change":"2024-09-19T11:13:35.355937+0000","last_active":"2024-09-19T11:14:07.584330+0000","last_peered":"2024-09-19T11:14:07.584330+0000","last_clean":"2024-09-19T11:14:07.584330+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:14:07.584330+0000","last_undegraded":"2024-09-19T11:14:07.584330+0000","last_fullsized":"2024-09-19T11:14:07.584330+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:31:41.799805+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"35'14","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593910+0000","last_change":"2024-09-19T11:13:37.367919+0000","last_active":"2024-09-19T11:14:07.593910+0000","last_peered":"2024-09-19T11:14:07.593910+0000","last_clean":"2024-09-19T11:14:07.593910+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:14:07.593910+0000","last_undegraded":"2024-09-19T11:14:07.593910+0000","last_fullsized":"2024-09-19T11:14:07.593910+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:53.619458+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'285","reported_seq":373,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.712786+0000","last_change":"2024-09-19T11:13:39.370313+0000","last_active":"2024-09-19T11:16:49.712786+0000","last_peered":"2024-09-19T11:16:49.712786+0000","last_clean":"2024-09-19T11:16:49.712786+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:16:49.712786+0000","last_undegraded":"2024-09-19T11:16:49.712786+0000","last_fullsized":"2024-09-19T11:16:49.712786+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:56.937960+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.649914+0000","last_change":"2024-09-19T11:13:41.391610+0000","last_active":"2024-09-19T11:16:42.649914+0000","last_peered":"2024-09-19T11:16:42.649914+0000","last_clean":"2024-09-19T11:16:42.649914+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:16:42.649914+0000","last_undegraded":"2024-09-19T11:16:42.649914+0000","last_fullsized":"2024-09-19T11:16:42.649914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.303997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.233251+0000","last_change":"2024-09-19T11:17:08.233251+0000","last_active":"2024-09-19T11:17:08.233251+0000","last_peered":"2024-09-19T11:17:08.233251+0000","last_clean":"2024-09-19T11:17:08.233251+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:17:08.233251+0000","last_undegraded":"2024-09-19T11:17:08.233251+0000","last_fullsized":"2024-09-19T11:17:08.233251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.233135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.372051+0000","last_change":"2024-09-19T11:17:00.372051+0000","last_active":"2024-09-19T11:17:00.372051+0000","last_peered":"2024-09-19T11:17:00.372051+0000","last_clean":"2024-09-19T11:17:00.372051+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:17:00.372051+0000","last_undegraded":"2024-09-19T11:17:00.372051+0000","last_fullsized":"2024-09-19T11:17:00.372051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.371942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:44.482502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.828131+0000","last_change":"2024-09-19T11:16:53.828131+0000","last_active":"2024-09-19T11:16:53.828131+0000","last_peered":"2024-09-19T11:16:53.828131+0000","last_clean":"2024-09-19T11:16:53.828131+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:16:53.828131+0000","last_undegraded":"2024-09-19T11:16:53.828131+0000","last_fullsized":"2024-09-19T11:16:53.828131+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.828060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:16.144293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584240+0000","last_change":"2024-09-19T11:13:35.355501+0000","last_active":"2024-09-19T11:14:07.584240+0000","last_peered":"2024-09-19T11:14:07.584240+0000","last_clean":"2024-09-19T11:14:07.584240+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:14:07.584240+0000","last_undegraded":"2024-09-19T11:14:07.584240+0000","last_fullsized":"2024-09-19T11:14:07.584240+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:29:17.393322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585599+0000","last_change":"2024-09-19T11:13:37.371529+0000","last_active":"2024-09-19T11:14:07.585599+0000","last_peered":"2024-09-19T11:14:07.585599+0000","last_clean":"2024-09-19T11:14:07.585599+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:14:07.585599+0000","last_undegraded":"2024-09-19T11:14:07.585599+0000","last_fullsized":"2024-09-19T11:14:07.585599+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:01.201187+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'285","reported_seq":403,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.718255+0000","last_change":"2024-09-19T11:13:39.374381+0000","last_active":"2024-09-19T11:16:49.718255+0000","last_peered":"2024-09-19T11:16:49.718255+0000","last_clean":"2024-09-19T11:16:49.718255+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:16:49.718255+0000","last_undegraded":"2024-09-19T11:16:49.718255+0000","last_fullsized":"2024-09-19T11:16:49.718255+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:03:52.357745+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.093870+0000","last_change":"2024-09-19T11:13:41.392744+0000","last_active":"2024-09-19T11:15:42.093870+0000","last_peered":"2024-09-19T11:15:42.093870+0000","last_clean":"2024-09-19T11:15:42.093870+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:15:42.093870+0000","last_undegraded":"2024-09-19T11:15:42.093870+0000","last_fullsized":"2024-09-19T11:15:42.093870+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:13:06.085455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.156983+0000","last_change":"2024-09-19T11:17:10.156983+0000","last_active":"2024-09-19T11:17:10.156983+0000","last_peered":"2024-09-19T11:17:10.156983+0000","last_clean":"2024-09-19T11:17:10.156983+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:17:10.156983+0000","last_undegraded":"2024-09-19T11:17:10.156983+0000","last_fullsized":"2024-09-19T11:17:10.156983+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.156870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:27.088137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.792079+0000","last_change":"2024-09-19T11:16:54.792079+0000","last_active":"2024-09-19T11:16:54.792079+0000","last_peered":"2024-09-19T11:16:54.792079+0000","last_clean":"2024-09-19T11:16:54.792079+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:16:54.792079+0000","last_undegraded":"2024-09-19T11:16:54.792079+0000","last_fullsized":"2024-09-19T11:16:54.792079+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.791976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:48.520529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.281102+0000","last_change":"2024-09-19T11:16:56.281102+0000","last_active":"2024-09-19T11:16:56.281102+0000","last_peered":"2024-09-19T11:16:56.281102+0000","last_clean":"2024-09-19T11:16:56.281102+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:16:56.281102+0000","last_undegraded":"2024-09-19T11:16:56.281102+0000","last_fullsized":"2024-09-19T11:16:56.281102+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.281013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:47.506937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584254+0000","last_change":"2024-09-19T11:13:35.355920+0000","last_active":"2024-09-19T11:14:07.584254+0000","last_peered":"2024-09-19T11:14:07.584254+0000","last_clean":"2024-09-19T11:14:07.584254+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:14:07.584254+0000","last_undegraded":"2024-09-19T11:14:07.584254+0000","last_fullsized":"2024-09-19T11:14:07.584254+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:20:38.711265+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'99","reported_seq":192,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.208941+0000","last_change":"2024-09-19T11:17:28.208941+0000","last_active":"2024-09-19T11:17:28.208941+0000","last_peered":"2024-09-19T11:17:28.208941+0000","last_clean":"2024-09-19T11:17:28.208941+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:17:28.208941+0000","last_undegraded":"2024-09-19T11:17:28.208941+0000","last_fullsized":"2024-09-19T11:17:28.208941+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'99","last_scrub_stamp":"2024-09-19T11:17:28.208805+0000","last_deep_scrub":"37'99","last_deep_scrub_stamp":"2024-09-19T11:17:28.208805+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.208805+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:39.102011+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586150+0000","last_change":"2024-09-19T11:13:39.369482+0000","last_active":"2024-09-19T11:14:07.586150+0000","last_peered":"2024-09-19T11:14:07.586150+0000","last_clean":"2024-09-19T11:14:07.586150+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:14:07.586150+0000","last_undegraded":"2024-09-19T11:14:07.586150+0000","last_fullsized":"2024-09-19T11:14:07.586150+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:18:52.197649+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.742094+0000","last_change":"2024-09-19T11:13:41.387841+0000","last_active":"2024-09-19T11:16:42.742094+0000","last_peered":"2024-09-19T11:16:42.742094+0000","last_clean":"2024-09-19T11:16:42.742094+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:16:42.742094+0000","last_undegraded":"2024-09-19T11:16:42.742094+0000","last_fullsized":"2024-09-19T11:16:42.742094+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:34:41.664645+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589320+0000","last_change":"2024-09-19T11:13:41.387407+0000","last_active":"2024-09-19T11:14:07.589320+0000","last_peered":"2024-09-19T11:14:07.589320+0000","last_clean":"2024-09-19T11:14:07.589320+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:14:07.589320+0000","last_undegraded":"2024-09-19T11:14:07.589320+0000","last_fullsized":"2024-09-19T11:14:07.589320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:24.850379+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.153164+0000","last_change":"2024-09-19T11:17:14.153164+0000","last_active":"2024-09-19T11:17:14.153164+0000","last_peered":"2024-09-19T11:17:14.153164+0000","last_clean":"2024-09-19T11:17:14.153164+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:17:14.153164+0000","last_undegraded":"2024-09-19T11:17:14.153164+0000","last_fullsized":"2024-09-19T11:17:14.153164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.153066+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.153066+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.153066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:52.353655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.379535+0000","last_change":"2024-09-19T11:17:07.379535+0000","last_active":"2024-09-19T11:17:07.379535+0000","last_peered":"2024-09-19T11:17:07.379535+0000","last_clean":"2024-09-19T11:17:07.379535+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:17:07.379535+0000","last_undegraded":"2024-09-19T11:17:07.379535+0000","last_fullsized":"2024-09-19T11:17:07.379535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.379424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:42.734681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.407910+0000","last_change":"2024-09-19T11:17:30.407910+0000","last_active":"2024-09-19T11:17:30.407910+0000","last_peered":"2024-09-19T11:17:30.407910+0000","last_clean":"2024-09-19T11:17:30.407910+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:17:30.407910+0000","last_undegraded":"2024-09-19T11:17:30.407910+0000","last_fullsized":"2024-09-19T11:17:30.407910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.407786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.407786+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.407786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:57.738466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'36","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.819925+0000","last_change":"2024-09-19T11:13:37.369688+0000","last_active":"2024-09-19T11:16:49.819925+0000","last_peered":"2024-09-19T11:16:49.819925+0000","last_clean":"2024-09-19T11:16:49.819925+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:16:49.819925+0000","last_undegraded":"2024-09-19T11:16:49.819925+0000","last_fullsized":"2024-09-19T11:16:49.819925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:22.810135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585707+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.585707+0000","last_peered":"2024-09-19T11:14:07.585707+0000","last_clean":"2024-09-19T11:14:07.585707+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:14:07.585707+0000","last_undegraded":"2024-09-19T11:14:07.585707+0000","last_fullsized":"2024-09-19T11:14:07.585707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:32.078155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.049603+0000","last_change":"2024-09-19T11:13:41.388648+0000","last_active":"2024-09-19T11:15:40.049603+0000","last_peered":"2024-09-19T11:15:40.049603+0000","last_clean":"2024-09-19T11:15:40.049603+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:15:40.049603+0000","last_undegraded":"2024-09-19T11:15:40.049603+0000","last_fullsized":"2024-09-19T11:15:40.049603+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:55:00.390668+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.581118+0000","last_change":"2024-09-19T11:17:12.581118+0000","last_active":"2024-09-19T11:17:12.581118+0000","last_peered":"2024-09-19T11:17:12.581118+0000","last_clean":"2024-09-19T11:17:12.581118+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:17:12.581118+0000","last_undegraded":"2024-09-19T11:17:12.581118+0000","last_fullsized":"2024-09-19T11:17:12.581118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.581034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:57.494890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.268509+0000","last_change":"2024-09-19T11:16:58.268509+0000","last_active":"2024-09-19T11:16:58.268509+0000","last_peered":"2024-09-19T11:16:58.268509+0000","last_clean":"2024-09-19T11:16:58.268509+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:58.268509+0000","last_undegraded":"2024-09-19T11:16:58.268509+0000","last_fullsized":"2024-09-19T11:16:58.268509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.268398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:22.542212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584591+0000","last_change":"2024-09-19T11:13:35.353851+0000","last_active":"2024-09-19T11:14:07.584591+0000","last_peered":"2024-09-19T11:14:07.584591+0000","last_clean":"2024-09-19T11:14:07.584591+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:14:07.584591+0000","last_undegraded":"2024-09-19T11:14:07.584591+0000","last_fullsized":"2024-09-19T11:14:07.584591+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:10:37.329718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'6","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.125107+0000","last_change":"2024-09-19T11:13:37.361748+0000","last_active":"2024-09-19T11:16:42.125107+0000","last_peered":"2024-09-19T11:16:42.125107+0000","last_clean":"2024-09-19T11:16:42.125107+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:16:42.125107+0000","last_undegraded":"2024-09-19T11:16:42.125107+0000","last_fullsized":"2024-09-19T11:16:42.125107+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:14:52.506674+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588151+0000","last_change":"2024-09-19T11:13:39.381924+0000","last_active":"2024-09-19T11:14:07.588151+0000","last_peered":"2024-09-19T11:14:07.588151+0000","last_clean":"2024-09-19T11:14:07.588151+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:14:07.588151+0000","last_undegraded":"2024-09-19T11:14:07.588151+0000","last_fullsized":"2024-09-19T11:14:07.588151+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:37.700824+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587758+0000","last_change":"2024-09-19T11:13:41.381057+0000","last_active":"2024-09-19T11:14:07.587758+0000","last_peered":"2024-09-19T11:14:07.587758+0000","last_clean":"2024-09-19T11:14:07.587758+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:14:07.587758+0000","last_undegraded":"2024-09-19T11:14:07.587758+0000","last_fullsized":"2024-09-19T11:14:07.587758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:11.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.725166+0000","last_change":"2024-09-19T11:17:10.725166+0000","last_active":"2024-09-19T11:17:10.725166+0000","last_peered":"2024-09-19T11:17:10.725166+0000","last_clean":"2024-09-19T11:17:10.725166+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:17:10.725166+0000","last_undegraded":"2024-09-19T11:17:10.725166+0000","last_fullsized":"2024-09-19T11:17:10.725166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'28","last_scrub_stamp":"2024-09-19T11:17:10.725079+0000","last_deep_scrub":"37'28","last_deep_scrub_stamp":"2024-09-19T11:17:10.725079+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.725079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.826693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.156246+0000","last_change":"2024-09-19T11:17:01.156246+0000","last_active":"2024-09-19T11:17:01.156246+0000","last_peered":"2024-09-19T11:17:01.156246+0000","last_clean":"2024-09-19T11:17:01.156246+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:17:01.156246+0000","last_undegraded":"2024-09-19T11:17:01.156246+0000","last_fullsized":"2024-09-19T11:17:01.156246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.156158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:03.371804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.188298+0000","last_change":"2024-09-19T11:17:22.188298+0000","last_active":"2024-09-19T11:17:22.188298+0000","last_peered":"2024-09-19T11:17:22.188298+0000","last_clean":"2024-09-19T11:17:22.188298+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:17:22.188298+0000","last_undegraded":"2024-09-19T11:17:22.188298+0000","last_fullsized":"2024-09-19T11:17:22.188298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:22.188209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:22.188209+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.188209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:11.101131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'47","reported_seq":111,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.769850+0000","last_change":"2024-09-19T11:13:37.358517+0000","last_active":"2024-09-19T11:16:49.769850+0000","last_peered":"2024-09-19T11:16:49.769850+0000","last_clean":"2024-09-19T11:16:49.769850+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:16:49.769850+0000","last_undegraded":"2024-09-19T11:16:49.769850+0000","last_fullsized":"2024-09-19T11:16:49.769850+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:27:04.932100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593589+0000","last_change":"2024-09-19T11:13:39.368887+0000","last_active":"2024-09-19T11:14:07.593589+0000","last_peered":"2024-09-19T11:14:07.593589+0000","last_clean":"2024-09-19T11:14:07.593589+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:14:07.593589+0000","last_undegraded":"2024-09-19T11:14:07.593589+0000","last_fullsized":"2024-09-19T11:14:07.593589+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:59.906873+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585207+0000","last_change":"2024-09-19T11:13:41.390580+0000","last_active":"2024-09-19T11:14:07.585207+0000","last_peered":"2024-09-19T11:14:07.585207+0000","last_clean":"2024-09-19T11:14:07.585207+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:14:07.585207+0000","last_undegraded":"2024-09-19T11:14:07.585207+0000","last_fullsized":"2024-09-19T11:14:07.585207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:00.635835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.363346+0000","last_change":"2024-09-19T11:17:25.363346+0000","last_active":"2024-09-19T11:17:25.363346+0000","last_peered":"2024-09-19T11:17:25.363346+0000","last_clean":"2024-09-19T11:17:25.363346+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:17:25.363346+0000","last_undegraded":"2024-09-19T11:17:25.363346+0000","last_fullsized":"2024-09-19T11:17:25.363346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:25.363259+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:25.363259+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.363259+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:06.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.807882+0000","last_change":"2024-09-19T11:16:56.807882+0000","last_active":"2024-09-19T11:16:56.807882+0000","last_peered":"2024-09-19T11:16:56.807882+0000","last_clean":"2024-09-19T11:16:56.807882+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:16:56.807882+0000","last_undegraded":"2024-09-19T11:16:56.807882+0000","last_fullsized":"2024-09-19T11:16:56.807882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.807762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:02.356623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584231+0000","last_change":"2024-09-19T11:13:35.356852+0000","last_active":"2024-09-19T11:14:07.584231+0000","last_peered":"2024-09-19T11:14:07.584231+0000","last_clean":"2024-09-19T11:14:07.584231+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:14:07.584231+0000","last_undegraded":"2024-09-19T11:14:07.584231+0000","last_fullsized":"2024-09-19T11:14:07.584231+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:18:35.050288+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.160418+0000","last_change":"2024-09-19T11:17:33.160418+0000","last_active":"2024-09-19T11:17:33.160418+0000","last_peered":"2024-09-19T11:17:33.160418+0000","last_clean":"2024-09-19T11:17:33.160418+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:17:33.160418+0000","last_undegraded":"2024-09-19T11:17:33.160418+0000","last_fullsized":"2024-09-19T11:17:33.160418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:33.160294+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:33.160294+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.160294+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:02.908387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587792+0000","last_change":"2024-09-19T11:13:39.375493+0000","last_active":"2024-09-19T11:14:07.587792+0000","last_peered":"2024-09-19T11:14:07.587792+0000","last_clean":"2024-09-19T11:14:07.587792+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:14:07.587792+0000","last_undegraded":"2024-09-19T11:14:07.587792+0000","last_fullsized":"2024-09-19T11:14:07.587792+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:30:12.594777+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.176586+0000","last_change":"2024-09-19T11:17:31.176586+0000","last_active":"2024-09-19T11:17:31.176586+0000","last_peered":"2024-09-19T11:17:31.176586+0000","last_clean":"2024-09-19T11:17:31.176586+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:17:31.176586+0000","last_undegraded":"2024-09-19T11:17:31.176586+0000","last_fullsized":"2024-09-19T11:17:31.176586+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:31.176498+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:31.176498+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.176498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:33.234114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.296208+0000","last_change":"2024-09-19T11:17:09.296208+0000","last_active":"2024-09-19T11:17:09.296208+0000","last_peered":"2024-09-19T11:17:09.296208+0000","last_clean":"2024-09-19T11:17:09.296208+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:17:09.296208+0000","last_undegraded":"2024-09-19T11:17:09.296208+0000","last_fullsized":"2024-09-19T11:17:09.296208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.296106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:23.893467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.586019+0000","last_change":"2024-09-19T11:17:28.586019+0000","last_active":"2024-09-19T11:17:28.586019+0000","last_peered":"2024-09-19T11:17:28.586019+0000","last_clean":"2024-09-19T11:17:28.586019+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:17:28.586019+0000","last_undegraded":"2024-09-19T11:17:28.586019+0000","last_fullsized":"2024-09-19T11:17:28.586019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:28.585927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:28.585927+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.585927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:09.150774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'63","reported_seq":128,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.874425+0000","last_change":"2024-09-19T11:13:37.363593+0000","last_active":"2024-09-19T11:16:49.874425+0000","last_peered":"2024-09-19T11:16:49.874425+0000","last_clean":"2024-09-19T11:16:49.874425+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:16:49.874425+0000","last_undegraded":"2024-09-19T11:16:49.874425+0000","last_fullsized":"2024-09-19T11:16:49.874425+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":63,"log_dups_size":0,"ondisk_log_size":63,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:57.886776+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587378+0000","last_change":"2024-09-19T11:13:39.375431+0000","last_active":"2024-09-19T11:14:07.587378+0000","last_peered":"2024-09-19T11:14:07.587378+0000","last_clean":"2024-09-19T11:14:07.587378+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:14:07.587378+0000","last_undegraded":"2024-09-19T11:14:07.587378+0000","last_fullsized":"2024-09-19T11:14:07.587378+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:55.629772+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.998936+0000","last_change":"2024-09-19T11:13:41.387630+0000","last_active":"2024-09-19T11:15:41.998936+0000","last_peered":"2024-09-19T11:15:41.998936+0000","last_clean":"2024-09-19T11:15:41.998936+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:15:41.998936+0000","last_undegraded":"2024-09-19T11:15:41.998936+0000","last_fullsized":"2024-09-19T11:15:41.998936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:27.480898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.721487+0000","last_change":"2024-09-19T11:17:13.721487+0000","last_active":"2024-09-19T11:17:13.721487+0000","last_peered":"2024-09-19T11:17:13.721487+0000","last_clean":"2024-09-19T11:17:13.721487+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:17:13.721487+0000","last_undegraded":"2024-09-19T11:17:13.721487+0000","last_fullsized":"2024-09-19T11:17:13.721487+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:13.721403+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:13.721403+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.721403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:48.967350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.838965+0000","last_change":"2024-09-19T11:16:57.838965+0000","last_active":"2024-09-19T11:16:57.838965+0000","last_peered":"2024-09-19T11:16:57.838965+0000","last_clean":"2024-09-19T11:16:57.838965+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:16:57.838965+0000","last_undegraded":"2024-09-19T11:16:57.838965+0000","last_fullsized":"2024-09-19T11:16:57.838965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.838852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:23.656467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.187901+0000","last_change":"2024-09-19T11:17:27.187901+0000","last_active":"2024-09-19T11:17:27.187901+0000","last_peered":"2024-09-19T11:17:27.187901+0000","last_clean":"2024-09-19T11:17:27.187901+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:17:27.187901+0000","last_undegraded":"2024-09-19T11:17:27.187901+0000","last_fullsized":"2024-09-19T11:17:27.187901+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.187800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.187800+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.187800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:39.803035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.763368+0000","last_change":"2024-09-19T11:13:37.368372+0000","last_active":"2024-09-19T11:16:49.763368+0000","last_peered":"2024-09-19T11:16:49.763368+0000","last_clean":"2024-09-19T11:16:49.763368+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:16:49.763368+0000","last_undegraded":"2024-09-19T11:16:49.763368+0000","last_fullsized":"2024-09-19T11:16:49.763368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:42.470532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.595510+0000","last_change":"2024-09-19T11:13:39.377106+0000","last_active":"2024-09-19T11:14:07.595510+0000","last_peered":"2024-09-19T11:14:07.595510+0000","last_clean":"2024-09-19T11:14:07.595510+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:14:07.595510+0000","last_undegraded":"2024-09-19T11:14:07.595510+0000","last_fullsized":"2024-09-19T11:14:07.595510+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:40.364349+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584320+0000","last_change":"2024-09-19T11:13:41.395172+0000","last_active":"2024-09-19T11:14:07.584320+0000","last_peered":"2024-09-19T11:14:07.584320+0000","last_clean":"2024-09-19T11:14:07.584320+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:14:07.584320+0000","last_undegraded":"2024-09-19T11:14:07.584320+0000","last_fullsized":"2024-09-19T11:14:07.584320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:31.640115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.175615+0000","last_change":"2024-09-19T11:17:30.175615+0000","last_active":"2024-09-19T11:17:30.175615+0000","last_peered":"2024-09-19T11:17:30.175615+0000","last_clean":"2024-09-19T11:17:30.175615+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:17:30.175615+0000","last_undegraded":"2024-09-19T11:17:30.175615+0000","last_fullsized":"2024-09-19T11:17:30.175615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:30.175521+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:30.175521+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.175521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:13.579750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.764477+0000","last_change":"2024-09-19T11:17:00.764477+0000","last_active":"2024-09-19T11:17:00.764477+0000","last_peered":"2024-09-19T11:17:00.764477+0000","last_clean":"2024-09-19T11:17:00.764477+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:00.764477+0000","last_undegraded":"2024-09-19T11:17:00.764477+0000","last_fullsized":"2024-09-19T11:17:00.764477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.764391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:38.964980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.195577+0000","last_change":"2024-09-19T11:17:26.195577+0000","last_active":"2024-09-19T11:17:26.195577+0000","last_peered":"2024-09-19T11:17:26.195577+0000","last_clean":"2024-09-19T11:17:26.195577+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:17:26.195577+0000","last_undegraded":"2024-09-19T11:17:26.195577+0000","last_fullsized":"2024-09-19T11:17:26.195577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:26.195490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:26.195490+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.195490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:53.553614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'35","reported_seq":83,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.833988+0000","last_change":"2024-09-19T11:13:37.358368+0000","last_active":"2024-09-19T11:16:49.833988+0000","last_peered":"2024-09-19T11:16:49.833988+0000","last_clean":"2024-09-19T11:16:49.833988+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:16:49.833988+0000","last_undegraded":"2024-09-19T11:16:49.833988+0000","last_fullsized":"2024-09-19T11:16:49.833988+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":35,"log_dups_size":0,"ondisk_log_size":35,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:51:44.250063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.588427+0000","last_change":"2024-09-19T11:13:39.380360+0000","last_active":"2024-09-19T11:14:07.588427+0000","last_peered":"2024-09-19T11:14:07.588427+0000","last_clean":"2024-09-19T11:14:07.588427+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:14:07.588427+0000","last_undegraded":"2024-09-19T11:14:07.588427+0000","last_fullsized":"2024-09-19T11:14:07.588427+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:19.847482+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.092425+0000","last_change":"2024-09-19T11:13:41.392005+0000","last_active":"2024-09-19T11:15:42.092425+0000","last_peered":"2024-09-19T11:15:42.092425+0000","last_clean":"2024-09-19T11:15:42.092425+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:15:42.092425+0000","last_undegraded":"2024-09-19T11:15:42.092425+0000","last_fullsized":"2024-09-19T11:15:42.092425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:49.976836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.746563+0000","last_change":"2024-09-19T11:17:12.746563+0000","last_active":"2024-09-19T11:17:12.746563+0000","last_peered":"2024-09-19T11:17:12.746563+0000","last_clean":"2024-09-19T11:17:12.746563+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:17:12.746563+0000","last_undegraded":"2024-09-19T11:17:12.746563+0000","last_fullsized":"2024-09-19T11:17:12.746563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:12.746480+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:12.746480+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.746480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:26.217232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.268148+0000","last_change":"2024-09-19T11:17:10.268148+0000","last_active":"2024-09-19T11:17:10.268148+0000","last_peered":"2024-09-19T11:17:10.268148+0000","last_clean":"2024-09-19T11:17:10.268148+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:17:10.268148+0000","last_undegraded":"2024-09-19T11:17:10.268148+0000","last_fullsized":"2024-09-19T11:17:10.268148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.268062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:30.958036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.398503+0000","last_change":"2024-09-19T11:17:33.398503+0000","last_active":"2024-09-19T11:17:33.398503+0000","last_peered":"2024-09-19T11:17:33.398503+0000","last_clean":"2024-09-19T11:17:33.398503+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:17:33.398503+0000","last_undegraded":"2024-09-19T11:17:33.398503+0000","last_fullsized":"2024-09-19T11:17:33.398503+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:33.398408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:33.398408+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.398408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:14.649067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586647+0000","last_change":"2024-09-19T11:13:37.371652+0000","last_active":"2024-09-19T11:14:07.586647+0000","last_peered":"2024-09-19T11:14:07.586647+0000","last_clean":"2024-09-19T11:14:07.586647+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:14:07.586647+0000","last_undegraded":"2024-09-19T11:14:07.586647+0000","last_fullsized":"2024-09-19T11:14:07.586647+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:28.501389+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'285","reported_seq":370,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.711152+0000","last_change":"2024-09-19T11:13:39.382597+0000","last_active":"2024-09-19T11:16:49.711152+0000","last_peered":"2024-09-19T11:16:49.711152+0000","last_clean":"2024-09-19T11:16:49.711152+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:16:49.711152+0000","last_undegraded":"2024-09-19T11:16:49.711152+0000","last_fullsized":"2024-09-19T11:16:49.711152+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:46.620461+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.583768+0000","last_change":"2024-09-19T11:13:41.390206+0000","last_active":"2024-09-19T11:14:07.583768+0000","last_peered":"2024-09-19T11:14:07.583768+0000","last_clean":"2024-09-19T11:14:07.583768+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:14:07.583768+0000","last_undegraded":"2024-09-19T11:14:07.583768+0000","last_fullsized":"2024-09-19T11:14:07.583768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:11.171587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.171870+0000","last_change":"2024-09-19T11:17:17.171870+0000","last_active":"2024-09-19T11:17:17.171870+0000","last_peered":"2024-09-19T11:17:17.171870+0000","last_clean":"2024-09-19T11:17:17.171870+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:17:17.171870+0000","last_undegraded":"2024-09-19T11:17:17.171870+0000","last_fullsized":"2024-09-19T11:17:17.171870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:17.171787+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:17.171787+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.171787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:10.154837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.807595+0000","last_change":"2024-09-19T11:16:59.807595+0000","last_active":"2024-09-19T11:16:59.807595+0000","last_peered":"2024-09-19T11:16:59.807595+0000","last_clean":"2024-09-19T11:16:59.807595+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:16:59.807595+0000","last_undegraded":"2024-09-19T11:16:59.807595+0000","last_fullsized":"2024-09-19T11:16:59.807595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.807508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:27.508908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.593781+0000","last_change":"2024-09-19T11:13:35.355437+0000","last_active":"2024-09-19T11:14:07.593781+0000","last_peered":"2024-09-19T11:14:07.593781+0000","last_clean":"2024-09-19T11:14:07.593781+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:14:07.593781+0000","last_undegraded":"2024-09-19T11:14:07.593781+0000","last_fullsized":"2024-09-19T11:14:07.593781+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:34.331941+0000","last_clean_scrub_stamp":"2024-09-19T11:13:34.331941+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:05:20.209336+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.853385+0000","last_change":"2024-09-19T11:13:37.367049+0000","last_active":"2024-09-19T11:16:49.853385+0000","last_peered":"2024-09-19T11:16:49.853385+0000","last_clean":"2024-09-19T11:16:49.853385+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:16:49.853385+0000","last_undegraded":"2024-09-19T11:16:49.853385+0000","last_fullsized":"2024-09-19T11:16:49.853385+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:07:18.747358+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586010+0000","last_change":"2024-09-19T11:13:39.381142+0000","last_active":"2024-09-19T11:14:07.586010+0000","last_peered":"2024-09-19T11:14:07.586010+0000","last_clean":"2024-09-19T11:14:07.586010+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:14:07.586010+0000","last_undegraded":"2024-09-19T11:14:07.586010+0000","last_fullsized":"2024-09-19T11:14:07.586010+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:40.981200+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:58.110163+0000","last_change":"2024-09-19T11:13:41.388869+0000","last_active":"2024-09-19T11:14:58.110163+0000","last_peered":"2024-09-19T11:14:58.110163+0000","last_clean":"2024-09-19T11:14:58.110163+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:14:58.110163+0000","last_undegraded":"2024-09-19T11:14:58.110163+0000","last_fullsized":"2024-09-19T11:14:58.110163+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:06:20.834731+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.121964+0000","last_change":"2024-09-19T11:17:16.121964+0000","last_active":"2024-09-19T11:17:16.121964+0000","last_peered":"2024-09-19T11:17:16.121964+0000","last_clean":"2024-09-19T11:17:16.121964+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:17:16.121964+0000","last_undegraded":"2024-09-19T11:17:16.121964+0000","last_fullsized":"2024-09-19T11:17:16.121964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:16.121888+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:16.121888+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.121888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:08.494191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.243754+0000","last_change":"2024-09-19T11:17:11.243754+0000","last_active":"2024-09-19T11:17:11.243754+0000","last_peered":"2024-09-19T11:17:11.243754+0000","last_clean":"2024-09-19T11:17:11.243754+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:17:11.243754+0000","last_undegraded":"2024-09-19T11:17:11.243754+0000","last_fullsized":"2024-09-19T11:17:11.243754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.243640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.224247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.146894+0000","last_change":"2024-09-19T11:17:25.146894+0000","last_active":"2024-09-19T11:17:25.146894+0000","last_peered":"2024-09-19T11:17:25.146894+0000","last_clean":"2024-09-19T11:17:25.146894+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:17:25.146894+0000","last_undegraded":"2024-09-19T11:17:25.146894+0000","last_fullsized":"2024-09-19T11:17:25.146894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:25.146791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:25.146791+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.146791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:14.070250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.856771+0000","last_change":"2024-09-19T11:13:37.365759+0000","last_active":"2024-09-19T11:16:49.856771+0000","last_peered":"2024-09-19T11:16:49.856771+0000","last_clean":"2024-09-19T11:16:49.856771+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:16:49.856771+0000","last_undegraded":"2024-09-19T11:16:49.856771+0000","last_fullsized":"2024-09-19T11:16:49.856771+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:39:56.959699+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584006+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.584006+0000","last_peered":"2024-09-19T11:14:07.584006+0000","last_clean":"2024-09-19T11:14:07.584006+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:14:07.584006+0000","last_undegraded":"2024-09-19T11:14:07.584006+0000","last_fullsized":"2024-09-19T11:14:07.584006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:21.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586387+0000","last_change":"2024-09-19T11:13:41.394164+0000","last_active":"2024-09-19T11:14:07.586387+0000","last_peered":"2024-09-19T11:14:07.586387+0000","last_clean":"2024-09-19T11:14:07.586387+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:14:07.586387+0000","last_undegraded":"2024-09-19T11:14:07.586387+0000","last_fullsized":"2024-09-19T11:14:07.586387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.249643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.164729+0000","last_change":"2024-09-19T11:17:32.164729+0000","last_active":"2024-09-19T11:17:32.164729+0000","last_peered":"2024-09-19T11:17:32.164729+0000","last_clean":"2024-09-19T11:17:32.164729+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:17:32.164729+0000","last_undegraded":"2024-09-19T11:17:32.164729+0000","last_fullsized":"2024-09-19T11:17:32.164729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:32.164637+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:32.164637+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.164637+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:28.206282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.736085+0000","last_change":"2024-09-19T11:16:58.736025+0000","last_active":"2024-09-19T11:16:58.736085+0000","last_peered":"2024-09-19T11:16:58.736085+0000","last_clean":"2024-09-19T11:16:58.736085+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:16:58.736085+0000","last_undegraded":"2024-09-19T11:16:58.736085+0000","last_fullsized":"2024-09-19T11:16:58.736085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.735931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:08.584806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.437955+0000","last_change":"2024-09-19T11:17:31.437955+0000","last_active":"2024-09-19T11:17:31.437955+0000","last_peered":"2024-09-19T11:17:31.437955+0000","last_clean":"2024-09-19T11:17:31.437955+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:17:31.437955+0000","last_undegraded":"2024-09-19T11:17:31.437955+0000","last_fullsized":"2024-09-19T11:17:31.437955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:31.437866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:31.437866+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.437866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.484126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'29","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.827236+0000","last_change":"2024-09-19T11:13:37.368500+0000","last_active":"2024-09-19T11:16:49.827236+0000","last_peered":"2024-09-19T11:16:49.827236+0000","last_clean":"2024-09-19T11:16:49.827236+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:16:49.827236+0000","last_undegraded":"2024-09-19T11:16:49.827236+0000","last_fullsized":"2024-09-19T11:16:49.827236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:42.855744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584628+0000","last_change":"2024-09-19T11:13:39.375517+0000","last_active":"2024-09-19T11:14:07.584628+0000","last_peered":"2024-09-19T11:14:07.584628+0000","last_clean":"2024-09-19T11:14:07.584628+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:14:07.584628+0000","last_undegraded":"2024-09-19T11:14:07.584628+0000","last_fullsized":"2024-09-19T11:14:07.584628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:42.881775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.362489+0000","last_change":"2024-09-19T11:13:41.393750+0000","last_active":"2024-09-19T11:15:40.362489+0000","last_peered":"2024-09-19T11:15:40.362489+0000","last_clean":"2024-09-19T11:15:40.362489+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:15:40.362489+0000","last_undegraded":"2024-09-19T11:15:40.362489+0000","last_fullsized":"2024-09-19T11:15:40.362489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:29.365114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.128091+0000","last_change":"2024-09-19T11:17:15.128091+0000","last_active":"2024-09-19T11:17:15.128091+0000","last_peered":"2024-09-19T11:17:15.128091+0000","last_clean":"2024-09-19T11:17:15.128091+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:17:15.128091+0000","last_undegraded":"2024-09-19T11:17:15.128091+0000","last_fullsized":"2024-09-19T11:17:15.128091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:15.128006+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:15.128006+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.128006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:38.994206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.841145+0000","last_change":"2024-09-19T11:16:58.841145+0000","last_active":"2024-09-19T11:16:58.841145+0000","last_peered":"2024-09-19T11:16:58.841145+0000","last_clean":"2024-09-19T11:16:58.841145+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:58.841145+0000","last_undegraded":"2024-09-19T11:16:58.841145+0000","last_fullsized":"2024-09-19T11:16:58.841145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.841052+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:37.793058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.410120+0000","last_change":"2024-09-19T11:17:32.410120+0000","last_active":"2024-09-19T11:17:32.410120+0000","last_peered":"2024-09-19T11:17:32.410120+0000","last_clean":"2024-09-19T11:17:32.410120+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:17:32.410120+0000","last_undegraded":"2024-09-19T11:17:32.410120+0000","last_fullsized":"2024-09-19T11:17:32.410120+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:32.410031+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:32.410031+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.410031+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:05.652748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'37","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.837082+0000","last_change":"2024-09-19T11:13:37.371443+0000","last_active":"2024-09-19T11:16:49.837082+0000","last_peered":"2024-09-19T11:16:49.837082+0000","last_clean":"2024-09-19T11:16:49.837082+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:16:49.837082+0000","last_undegraded":"2024-09-19T11:16:49.837082+0000","last_fullsized":"2024-09-19T11:16:49.837082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.734955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586898+0000","last_change":"2024-09-19T11:13:39.381795+0000","last_active":"2024-09-19T11:14:07.586898+0000","last_peered":"2024-09-19T11:14:07.586898+0000","last_clean":"2024-09-19T11:14:07.586898+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:14:07.586898+0000","last_undegraded":"2024-09-19T11:14:07.586898+0000","last_fullsized":"2024-09-19T11:14:07.586898+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:43:05.918916+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.365479+0000","last_change":"2024-09-19T11:13:41.392101+0000","last_active":"2024-09-19T11:15:40.365479+0000","last_peered":"2024-09-19T11:15:40.365479+0000","last_clean":"2024-09-19T11:15:40.365479+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:15:40.365479+0000","last_undegraded":"2024-09-19T11:15:40.365479+0000","last_fullsized":"2024-09-19T11:15:40.365479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:25.270293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.520221+0000","last_change":"2024-09-19T11:17:15.520221+0000","last_active":"2024-09-19T11:17:15.520221+0000","last_peered":"2024-09-19T11:17:15.520221+0000","last_clean":"2024-09-19T11:17:15.520221+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:17:15.520221+0000","last_undegraded":"2024-09-19T11:17:15.520221+0000","last_fullsized":"2024-09-19T11:17:15.520221+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:15.520117+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:15.520117+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.520117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:26.413322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.122899+0000","last_change":"2024-09-19T11:17:02.122899+0000","last_active":"2024-09-19T11:17:02.122899+0000","last_peered":"2024-09-19T11:17:02.122899+0000","last_clean":"2024-09-19T11:17:02.122899+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:17:02.122899+0000","last_undegraded":"2024-09-19T11:17:02.122899+0000","last_fullsized":"2024-09-19T11:17:02.122899+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.122788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:56.217100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.704699+0000","last_change":"2024-09-19T11:17:16.704699+0000","last_active":"2024-09-19T11:17:16.704699+0000","last_peered":"2024-09-19T11:17:16.704699+0000","last_clean":"2024-09-19T11:17:16.704699+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:17:16.704699+0000","last_undegraded":"2024-09-19T11:17:16.704699+0000","last_fullsized":"2024-09-19T11:17:16.704699+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:16.704599+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:16.704599+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.704599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:48.496980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.729547+0000","last_change":"2024-09-19T11:17:00.729547+0000","last_active":"2024-09-19T11:17:00.729547+0000","last_peered":"2024-09-19T11:17:00.729547+0000","last_clean":"2024-09-19T11:17:00.729547+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:17:00.729547+0000","last_undegraded":"2024-09-19T11:17:00.729547+0000","last_fullsized":"2024-09-19T11:17:00.729547+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.729447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:20.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.128733+0000","last_change":"2024-09-19T11:17:33.128733+0000","last_active":"2024-09-19T11:17:33.128733+0000","last_peered":"2024-09-19T11:17:33.128733+0000","last_clean":"2024-09-19T11:17:33.128733+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:17:33.128733+0000","last_undegraded":"2024-09-19T11:17:33.128733+0000","last_fullsized":"2024-09-19T11:17:33.128733+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:33.128637+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:33.128637+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.128637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:01.235293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.280573+0000","last_change":"2024-09-19T11:17:12.280573+0000","last_active":"2024-09-19T11:17:12.280573+0000","last_peered":"2024-09-19T11:17:12.280573+0000","last_clean":"2024-09-19T11:17:12.280573+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:17:12.280573+0000","last_undegraded":"2024-09-19T11:17:12.280573+0000","last_fullsized":"2024-09-19T11:17:12.280573+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.280488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:06.626222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'20","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.721783+0000","last_change":"2024-09-19T11:17:15.721783+0000","last_active":"2024-09-19T11:17:15.721783+0000","last_peered":"2024-09-19T11:17:15.721783+0000","last_clean":"2024-09-19T11:17:15.721783+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:17:15.721783+0000","last_undegraded":"2024-09-19T11:17:15.721783+0000","last_fullsized":"2024-09-19T11:17:15.721783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20","last_scrub_stamp":"2024-09-19T11:17:15.721694+0000","last_deep_scrub":"37'20","last_deep_scrub_stamp":"2024-09-19T11:17:15.721694+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.721694+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:41.352334+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.750132+0000","last_change":"2024-09-19T11:17:01.750132+0000","last_active":"2024-09-19T11:17:01.750132+0000","last_peered":"2024-09-19T11:17:01.750132+0000","last_clean":"2024-09-19T11:17:01.750132+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:17:01.750132+0000","last_undegraded":"2024-09-19T11:17:01.750132+0000","last_fullsized":"2024-09-19T11:17:01.750132+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.750039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:21.882909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.747631+0000","last_change":"2024-09-19T11:17:14.747631+0000","last_active":"2024-09-19T11:17:14.747631+0000","last_peered":"2024-09-19T11:17:14.747631+0000","last_clean":"2024-09-19T11:17:14.747631+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:17:14.747631+0000","last_undegraded":"2024-09-19T11:17:14.747631+0000","last_fullsized":"2024-09-19T11:17:14.747631+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.747561+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.747561+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.747561+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:33.992563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.719201+0000","last_change":"2024-09-19T11:16:59.719201+0000","last_active":"2024-09-19T11:16:59.719201+0000","last_peered":"2024-09-19T11:16:59.719201+0000","last_clean":"2024-09-19T11:16:59.719201+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:16:59.719201+0000","last_undegraded":"2024-09-19T11:16:59.719201+0000","last_fullsized":"2024-09-19T11:16:59.719201+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.719107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:52.014566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.509403+0000","last_change":"2024-09-19T11:17:14.509403+0000","last_active":"2024-09-19T11:17:14.509403+0000","last_peered":"2024-09-19T11:17:14.509403+0000","last_clean":"2024-09-19T11:17:14.509403+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:17:14.509403+0000","last_undegraded":"2024-09-19T11:17:14.509403+0000","last_fullsized":"2024-09-19T11:17:14.509403+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.509322+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.509322+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.509322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.517999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.712688+0000","last_change":"2024-09-19T11:17:04.712688+0000","last_active":"2024-09-19T11:17:04.712688+0000","last_peered":"2024-09-19T11:17:04.712688+0000","last_clean":"2024-09-19T11:17:04.712688+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:17:04.712688+0000","last_undegraded":"2024-09-19T11:17:04.712688+0000","last_fullsized":"2024-09-19T11:17:04.712688+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.712601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:18.151651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.722908+0000","last_change":"2024-09-19T11:17:20.722908+0000","last_active":"2024-09-19T11:17:20.722908+0000","last_peered":"2024-09-19T11:17:20.722908+0000","last_clean":"2024-09-19T11:17:20.722908+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:17:20.722908+0000","last_undegraded":"2024-09-19T11:17:20.722908+0000","last_fullsized":"2024-09-19T11:17:20.722908+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:20.722811+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:20.722811+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.722811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:08.485371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.127471+0000","last_change":"2024-09-19T11:17:03.127471+0000","last_active":"2024-09-19T11:17:03.127471+0000","last_peered":"2024-09-19T11:17:03.127471+0000","last_clean":"2024-09-19T11:17:03.127471+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:17:03.127471+0000","last_undegraded":"2024-09-19T11:17:03.127471+0000","last_fullsized":"2024-09-19T11:17:03.127471+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.127373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:45.319191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.542620+0000","last_change":"2024-09-19T11:17:13.542620+0000","last_active":"2024-09-19T11:17:13.542620+0000","last_peered":"2024-09-19T11:17:13.542620+0000","last_clean":"2024-09-19T11:17:13.542620+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:17:13.542620+0000","last_undegraded":"2024-09-19T11:17:13.542620+0000","last_fullsized":"2024-09-19T11:17:13.542620+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.542491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:23.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.719810+0000","last_change":"2024-09-19T11:17:02.719810+0000","last_active":"2024-09-19T11:17:02.719810+0000","last_peered":"2024-09-19T11:17:02.719810+0000","last_clean":"2024-09-19T11:17:02.719810+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:17:02.719810+0000","last_undegraded":"2024-09-19T11:17:02.719810+0000","last_fullsized":"2024-09-19T11:17:02.719810+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.719684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:09.105342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.571852+0000","last_change":"2024-09-19T11:17:20.571852+0000","last_active":"2024-09-19T11:17:20.571852+0000","last_peered":"2024-09-19T11:17:20.571852+0000","last_clean":"2024-09-19T11:17:20.571852+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:17:20.571852+0000","last_undegraded":"2024-09-19T11:17:20.571852+0000","last_fullsized":"2024-09-19T11:17:20.571852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:20.571768+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:20.571768+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.571768+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:21.919126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.324790+0000","last_change":"2024-09-19T11:17:13.324790+0000","last_active":"2024-09-19T11:17:13.324790+0000","last_peered":"2024-09-19T11:17:13.324790+0000","last_clean":"2024-09-19T11:17:13.324790+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:17:13.324790+0000","last_undegraded":"2024-09-19T11:17:13.324790+0000","last_fullsized":"2024-09-19T11:17:13.324790+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.324688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:10.883666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.974025+0000","last_change":"2024-09-19T11:13:33.353505+0000","last_active":"2024-09-19T11:16:42.974025+0000","last_peered":"2024-09-19T11:16:42.974025+0000","last_clean":"2024-09-19T11:16:42.974025+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:16:42.974025+0000","last_undegraded":"2024-09-19T11:16:42.974025+0000","last_fullsized":"2024-09-19T11:16:42.974025+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:59:00.609441+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.735210+0000","last_change":"2024-09-19T11:17:04.735210+0000","last_active":"2024-09-19T11:17:04.735210+0000","last_peered":"2024-09-19T11:17:04.735210+0000","last_clean":"2024-09-19T11:17:04.735210+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:17:04.735210+0000","last_undegraded":"2024-09-19T11:17:04.735210+0000","last_fullsized":"2024-09-19T11:17:04.735210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.735127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:17.771568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'12","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.724380+0000","last_change":"2024-09-19T11:17:18.724380+0000","last_active":"2024-09-19T11:17:18.724380+0000","last_peered":"2024-09-19T11:17:18.724380+0000","last_clean":"2024-09-19T11:17:18.724380+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:17:18.724380+0000","last_undegraded":"2024-09-19T11:17:18.724380+0000","last_fullsized":"2024-09-19T11:17:18.724380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:18.724292+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:18.724292+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.724292+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:51.156798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.744045+0000","last_change":"2024-09-19T11:17:02.744045+0000","last_active":"2024-09-19T11:17:02.744045+0000","last_peered":"2024-09-19T11:17:02.744045+0000","last_clean":"2024-09-19T11:17:02.744045+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:17:02.744045+0000","last_undegraded":"2024-09-19T11:17:02.744045+0000","last_fullsized":"2024-09-19T11:17:02.744045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.743932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:55.116235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.556409+0000","last_change":"2024-09-19T11:17:19.556409+0000","last_active":"2024-09-19T11:17:19.556409+0000","last_peered":"2024-09-19T11:17:19.556409+0000","last_clean":"2024-09-19T11:17:19.556409+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:17:19.556409+0000","last_undegraded":"2024-09-19T11:17:19.556409+0000","last_fullsized":"2024-09-19T11:17:19.556409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:19.556323+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:19.556323+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.556323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:45.864627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.781064+0000","last_change":"2024-09-19T11:17:01.781064+0000","last_active":"2024-09-19T11:17:01.781064+0000","last_peered":"2024-09-19T11:17:01.781064+0000","last_clean":"2024-09-19T11:17:01.781064+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:17:01.781064+0000","last_undegraded":"2024-09-19T11:17:01.781064+0000","last_fullsized":"2024-09-19T11:17:01.781064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.780976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:25.647175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.509949+0000","last_change":"2024-09-19T11:17:17.509949+0000","last_active":"2024-09-19T11:17:17.509949+0000","last_peered":"2024-09-19T11:17:17.509949+0000","last_clean":"2024-09-19T11:17:17.509949+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:17:17.509949+0000","last_undegraded":"2024-09-19T11:17:17.509949+0000","last_fullsized":"2024-09-19T11:17:17.509949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:17.509860+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:17.509860+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.509860+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:13.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.362674+0000","last_change":"2024-09-19T11:17:14.362674+0000","last_active":"2024-09-19T11:17:14.362674+0000","last_peered":"2024-09-19T11:17:14.362674+0000","last_clean":"2024-09-19T11:17:14.362674+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:17:14.362674+0000","last_undegraded":"2024-09-19T11:17:14.362674+0000","last_fullsized":"2024-09-19T11:17:14.362674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:14.362585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:14.362585+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.362585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:42.088426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'12","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.482087+0000","last_change":"2024-09-19T11:17:16.482087+0000","last_active":"2024-09-19T11:17:16.482087+0000","last_peered":"2024-09-19T11:17:16.482087+0000","last_clean":"2024-09-19T11:17:16.482087+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:17:16.482087+0000","last_undegraded":"2024-09-19T11:17:16.482087+0000","last_fullsized":"2024-09-19T11:17:16.482087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:16.482004+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:16.482004+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.482004+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:19.747512+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.374545+0000","last_change":"2024-09-19T11:17:15.374545+0000","last_active":"2024-09-19T11:17:15.374545+0000","last_peered":"2024-09-19T11:17:15.374545+0000","last_clean":"2024-09-19T11:17:15.374545+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:17:15.374545+0000","last_undegraded":"2024-09-19T11:17:15.374545+0000","last_fullsized":"2024-09-19T11:17:15.374545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:15.374417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:15.374417+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.374417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:03.758631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'5","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:48.540107+0000","last_change":"2024-09-19T11:13:33.348514+0000","last_active":"2024-09-19T11:15:48.540107+0000","last_peered":"2024-09-19T11:15:48.540107+0000","last_clean":"2024-09-19T11:15:48.540107+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:15:48.540107+0000","last_undegraded":"2024-09-19T11:15:48.540107+0000","last_fullsized":"2024-09-19T11:15:48.540107+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:32.323997+0000","last_clean_scrub_stamp":"2024-09-19T11:13:32.323997+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:09.293276+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.153242+0000","last_change":"2024-09-19T11:17:04.153242+0000","last_active":"2024-09-19T11:17:04.153242+0000","last_peered":"2024-09-19T11:17:04.153242+0000","last_clean":"2024-09-19T11:17:04.153242+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:17:04.153242+0000","last_undegraded":"2024-09-19T11:17:04.153242+0000","last_fullsized":"2024-09-19T11:17:04.153242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.153146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:23.740652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.559499+0000","last_change":"2024-09-19T11:17:18.559499+0000","last_active":"2024-09-19T11:17:18.559499+0000","last_peered":"2024-09-19T11:17:18.559499+0000","last_clean":"2024-09-19T11:17:18.559499+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:17:18.559499+0000","last_undegraded":"2024-09-19T11:17:18.559499+0000","last_fullsized":"2024-09-19T11:17:18.559499+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:18.559406+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:18.559406+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.559406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:02.731291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.333631+0000","last_change":"2024-09-19T11:17:17.333631+0000","last_active":"2024-09-19T11:17:17.333631+0000","last_peered":"2024-09-19T11:17:17.333631+0000","last_clean":"2024-09-19T11:17:17.333631+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:17:17.333631+0000","last_undegraded":"2024-09-19T11:17:17.333631+0000","last_fullsized":"2024-09-19T11:17:17.333631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:17.333525+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:17.333525+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.333525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:07.331615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.360890+0000","last_change":"2024-09-19T11:17:16.360890+0000","last_active":"2024-09-19T11:17:16.360890+0000","last_peered":"2024-09-19T11:17:16.360890+0000","last_clean":"2024-09-19T11:17:16.360890+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:17:16.360890+0000","last_undegraded":"2024-09-19T11:17:16.360890+0000","last_fullsized":"2024-09-19T11:17:16.360890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:16.360792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:16.360792+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.360792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:58.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.686885+0000","last_change":"2024-09-19T11:17:17.686885+0000","last_active":"2024-09-19T11:17:17.686885+0000","last_peered":"2024-09-19T11:17:17.686885+0000","last_clean":"2024-09-19T11:17:17.686885+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:17:17.686885+0000","last_undegraded":"2024-09-19T11:17:17.686885+0000","last_fullsized":"2024-09-19T11:17:17.686885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:17.686787+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:17.686787+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.686787+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:29.308455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.699792+0000","last_change":"2024-09-19T11:17:06.699792+0000","last_active":"2024-09-19T11:17:06.699792+0000","last_peered":"2024-09-19T11:17:06.699792+0000","last_clean":"2024-09-19T11:17:06.699792+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:17:06.699792+0000","last_undegraded":"2024-09-19T11:17:06.699792+0000","last_fullsized":"2024-09-19T11:17:06.699792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.699710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:06.685184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.420123+0000","last_change":"2024-09-19T11:17:26.420123+0000","last_active":"2024-09-19T11:17:26.420123+0000","last_peered":"2024-09-19T11:17:26.420123+0000","last_clean":"2024-09-19T11:17:26.420123+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:17:26.420123+0000","last_undegraded":"2024-09-19T11:17:26.420123+0000","last_fullsized":"2024-09-19T11:17:26.420123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:26.420010+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:26.420010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.420010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:17.288611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":268,"ondisk_log_size":268,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2280,"ondisk_log_size":2280,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1417,"ondisk_log_size":1417,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":18,"ondisk_log_size":18,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":480,"ondisk_log_size":480,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640312,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":512000,"data_stored":161981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640313,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":749066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640313,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":36376,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":35326,"kb_avail":94335464,"statfs":{"total":96636764160,"available":96599515136,"internally_reserved":0,"allocated":1056768,"data_stored":749395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":36174277},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705719,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44132,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327708,"statfs":{"total":96636764160,"available":96591572992,"internally_reserved":0,"allocated":479232,"data_stored":160962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:17:35.235 INFO:tasks.ceph:pgid 4.39 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.235 INFO:tasks.ceph:pgid 4.3b last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.236 INFO:tasks.ceph:pgid 4.30 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.236 INFO:tasks.ceph:pgid 8.18 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.236 INFO:tasks.ceph:pgid 5.15 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.236 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.236 INFO:tasks.ceph:pgid 7.17 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.236 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.236 INFO:tasks.ceph:pgid 5.14 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.237 INFO:tasks.ceph:pgid 6.17 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.237 INFO:tasks.ceph:pgid 7.16 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.237 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.237 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.237 INFO:tasks.ceph:pgid 8.1b last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.237 INFO:tasks.ceph:pgid 5.16 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.237 INFO:tasks.ceph:pgid 6.15 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.237 INFO:tasks.ceph:pgid 7.14 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.238 INFO:tasks.ceph:pgid 7.b last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.238 INFO:tasks.ceph:pgid 8.4 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.238 INFO:tasks.ceph:pgid 6.b last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.238 INFO:tasks.ceph:pgid 7.a last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.238 INFO:tasks.ceph:pgid 8.5 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.238 INFO:tasks.ceph:pgid 6.8 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.238 INFO:tasks.ceph:pgid 7.9 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.239 INFO:tasks.ceph:pgid 8.6 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.239 INFO:tasks.ceph:pgid 6.9 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.239 INFO:tasks.ceph:pgid 7.8 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.239 INFO:tasks.ceph:pgid 8.7 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.239 INFO:tasks.ceph:pgid 6.e last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.239 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.239 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.239 INFO:tasks.ceph:pgid 7.e last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.240 INFO:tasks.ceph:pgid 8.1 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.240 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.240 INFO:tasks.ceph:pgid 7.d last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.240 INFO:tasks.ceph:pgid 8.2 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.240 INFO:tasks.ceph:pgid 5.e last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.240 INFO:tasks.ceph:pgid 6.d last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.240 INFO:tasks.ceph:pgid 7.c last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.240 INFO:tasks.ceph:pgid 8.3 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.241 INFO:tasks.ceph:pgid 6.7 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.241 INFO:tasks.ceph:pgid 7.6 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.241 INFO:tasks.ceph:pgid 8.9 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.241 INFO:tasks.ceph:pgid 5.7 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.241 INFO:tasks.ceph:pgid 6.4 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.241 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.241 INFO:tasks.ceph:pgid 8.a last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.242 INFO:tasks.ceph:pgid 6.5 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.242 INFO:tasks.ceph:pgid 7.4 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.242 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.242 INFO:tasks.ceph:pgid 6.6 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.242 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.242 INFO:tasks.ceph:pgid 8.8 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.242 INFO:tasks.ceph:pgid 7.1 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.242 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.243 INFO:tasks.ceph:pgid 5.2 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.243 INFO:tasks.ceph:pgid 6.1 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.243 INFO:tasks.ceph:pgid 7.0 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.243 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.243 INFO:tasks.ceph:pgid 5.1 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.243 INFO:tasks.ceph:pgid 6.2 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.243 INFO:tasks.ceph:pgid 7.3 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.243 INFO:tasks.ceph:pgid 8.c last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.244 INFO:tasks.ceph:pgid 5.0 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.244 INFO:tasks.ceph:pgid 7.2 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.244 INFO:tasks.ceph:pgid 8.d last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.244 INFO:tasks.ceph:pgid 8.1f last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.244 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.244 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.244 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.244 INFO:tasks.ceph:pgid 5.13 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.245 INFO:tasks.ceph:pgid 6.10 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.245 INFO:tasks.ceph:pgid 7.11 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.245 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.245 INFO:tasks.ceph:pgid 6.13 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.245 INFO:tasks.ceph:pgid 7.12 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.245 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.245 INFO:tasks.ceph:pgid 5.11 last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 7.13 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 6.1d last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 7.1c last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 7.1d last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 6.1f last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.246 INFO:tasks.ceph:pgid 7.1e last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.247 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.247 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.247 INFO:tasks.ceph:pgid 7.1f last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.247 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.247 INFO:tasks.ceph:pgid 5.1a last_scrub_stamp 2024-09-19T11:13:34.331941+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=34, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.247 INFO:tasks.ceph:pgid 6.19 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.247 INFO:tasks.ceph:pgid 7.18 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.247 INFO:tasks.ceph:pgid 8.17 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.248 INFO:tasks.ceph:pgid 6.18 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.248 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.248 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.248 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.248 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.248 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.248 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.248 INFO:tasks.ceph:pgid 7.1b last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.249 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.249 INFO:tasks.ceph:pgid 4.2e last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.249 INFO:tasks.ceph:pgid 4.29 last_scrub_stamp 2024-09-19T11:13:32.323997+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=32, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:35.249 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T11:17:55.251 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:17:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.368+0000 7f3f438ed640 1 Processor -- start 2024-09-19T11:17:55.370 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.368+0000 7f3f438ed640 1 -- start start 2024-09-19T11:17:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.368+0000 7f3f438ed640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f3f3c06dfb0 0x7f3f3c06e390 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.368+0000 7f3f438ed640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f3f3c071660 con 0x7f3f3c06e8d0 2024-09-19T11:17:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.368+0000 7f3f438ed640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f3f3c072550 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.369+0000 7f3f40e88640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f3f3c06e8d0 0x7f3f3c097090 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:41314/0 (socket says 172.21.15.37:41314) 2024-09-19T11:17:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.369+0000 7f3f40e88640 1 -- 172.21.15.37:0/1433959265 learned_addr learned my addr 172.21.15.37:0/1433959265 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:17:55.371 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.369+0000 7f3f41689640 1 --2- 172.21.15.37:0/1433959265 >> v2:172.21.15.37:3300/0 conn(0x7f3f3c06dfb0 0x7f3f3c06e390 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:55.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.369+0000 7f3f41689640 1 -- 172.21.15.37:0/1433959265 >> v1:172.21.15.37:6789/0 conn(0x7f3f3c06e8d0 legacy=0x7f3f3c097090 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:55.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.369+0000 7f3f41689640 1 -- 172.21.15.37:0/1433959265 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c099e20 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.372 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.369+0000 7f3f33fff640 1 -- 172.21.15.37:0/1433959265 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4266996959 0 0) 0x7f3f3c071660 con 0x7f3f3c06e8d0 2024-09-19T11:17:55.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.370+0000 7f3f41689640 1 --2- 172.21.15.37:0/1433959265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c06e390 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009720 tx=0x7f3f3802a1a0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=d4034fdd7ad6d87d server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:55.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.370+0000 7f3f33fff640 1 -- 172.21.15.37:0/1433959265 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38037070 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.370+0000 7f3f33fff640 1 -- 172.21.15.37:0/1433959265 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3802ae20 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.373 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.370+0000 7f3f33fff640 1 -- 172.21.15.37:0/1433959265 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38032590 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.371+0000 7f3f438ed640 1 -- 172.21.15.37:0/1433959265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 msgr2=0x7f3f3c06e390 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.371+0000 7f3f438ed640 1 --2- 172.21.15.37:0/1433959265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c06e390 secure :-1 s=READY pgs=896 cs=0 l=1 rev1=1 crypto rx=0x7f3f38009720 tx=0x7f3f3802a1a0 comp rx=0 tx=0).stop 2024-09-19T11:17:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.371+0000 7f3f438ed640 1 -- 172.21.15.37:0/1433959265 shutdown_connections 2024-09-19T11:17:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.371+0000 7f3f438ed640 1 --2- 172.21.15.37:0/1433959265 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c06e390 unknown :-1 s=CLOSED pgs=896 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.371+0000 7f3f438ed640 1 -- 172.21.15.37:0/1433959265 >> 172.21.15.37:0/1433959265 conn(0x7f3f3c09abc0 msgr2=0x7f3f3c098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:17:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.371+0000 7f3f438ed640 1 -- 172.21.15.37:0/1433959265 shutdown_connections 2024-09-19T11:17:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.371+0000 7f3f438ed640 1 -- 172.21.15.37:0/1433959265 wait complete. 2024-09-19T11:17:55.374 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.372+0000 7f3f438ed640 1 Processor -- start 2024-09-19T11:17:55.375 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.372+0000 7f3f438ed640 1 -- start start 2024-09-19T11:17:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.372+0000 7f3f438ed640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c129230 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.372+0000 7f3f438ed640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f3f3c06ece0 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.372+0000 7f3f41689640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c129230 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.372+0000 7f3f41689640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c129230 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:56408/0 (socket says 172.21.15.37:56408) 2024-09-19T11:17:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.372+0000 7f3f41689640 1 -- 172.21.15.37:0/3387296756 learned_addr learned my addr 172.21.15.37:0/3387296756 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:17:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.373+0000 7f3f41689640 1 -- 172.21.15.37:0/3387296756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f3f3c074110 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.376 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.373+0000 7f3f41689640 1 --2- 172.21.15.37:0/3387296756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c129230 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3f3802a1e0 tx=0x7f3f380046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.373+0000 7f3f31ffb640 1 -- 172.21.15.37:0/3387296756 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38042070 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.373+0000 7f3f31ffb640 1 -- 172.21.15.37:0/3387296756 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f3f3803e590 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.373+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f3f3c070450 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.373+0000 7f3f31ffb640 1 -- 172.21.15.37:0/3387296756 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f3f38037040 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.377 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.373+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f3f3c129770 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.374+0000 7f3f31ffb640 1 -- 172.21.15.37:0/3387296756 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f3f38045070 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.374+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f3f3c06e390 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.375+0000 7f3f31ffb640 1 --2- 172.21.15.37:0/3387296756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3f2003e710 0x7f3f20040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:17:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.375+0000 7f3f31ffb640 1 -- 172.21.15.37:0/3387296756 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f3f380740a0 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.375+0000 7f3f40e88640 1 --2- 172.21.15.37:0/3387296756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3f2003e710 0x7f3f20040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:17:55.378 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.376+0000 7f3f40e88640 1 --2- 172.21.15.37:0/3387296756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3f2003e710 0x7f3f20040bd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000c00 tx=0x7f3f2c0078f0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:17:55.382 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.380+0000 7f3f31ffb640 1 -- 172.21.15.37:0/3387296756 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f3f38045cf0 con 0x7f3f3c06dfb0 2024-09-19T11:17:55.567 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.565+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f3f3c06fcb0 con 0x7f3f2003e710 2024-09-19T11:17:55.577 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.575+0000 7f3f31ffb640 1 -- 172.21.15.37:0/3387296756 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666217 (secure 0 0 0) 0x7f3f3c06fcb0 con 0x7f3f2003e710 2024-09-19T11:17:55.585 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:17:55.591 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:17:55.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3f2003e710 msgr2=0x7f3f20040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:55.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 --2- 172.21.15.37:0/3387296756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3f2003e710 0x7f3f20040bd0 secure :-1 s=READY pgs=371 cs=0 l=1 rev1=1 crypto rx=0x7f3f2c000c00 tx=0x7f3f2c0078f0 comp rx=0 tx=0).stop 2024-09-19T11:17:55.593 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 msgr2=0x7f3f3c129230 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:17:55.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 --2- 172.21.15.37:0/3387296756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c129230 secure :-1 s=READY pgs=897 cs=0 l=1 rev1=1 crypto rx=0x7f3f3802a1e0 tx=0x7f3f380046c0 comp rx=0 tx=0).stop 2024-09-19T11:17:55.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 shutdown_connections 2024-09-19T11:17:55.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 --2- 172.21.15.37:0/3387296756 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f3f2003e710 0x7f3f20040bd0 unknown :-1 s=CLOSED pgs=371 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:55.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 --2- 172.21.15.37:0/3387296756 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f3f3c06dfb0 0x7f3f3c129230 unknown :-1 s=CLOSED pgs=897 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:17:55.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 >> 172.21.15.37:0/3387296756 conn(0x7f3f3c09abc0 msgr2=0x7f3f3c12d710 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:17:55.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 shutdown_connections 2024-09-19T11:17:55.594 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:17:55.580+0000 7f3f438ed640 1 -- 172.21.15.37:0/3387296756 wait complete. 2024-09-19T11:17:55.595 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":176,"stamp":"2024-09-19T11:17:54.601327+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5183,"num_read_kb":4725,"num_write":2125,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":2079,"num_omap_keys":10,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4752,"ondisk_log_size":4752,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":165184,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":162105,"kb_avail":377322176,"statfs":{"total":386547056640,"available":386377908224,"internally_reserved":0,"allocated":3080192,"data_stored":1821404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":165996310},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":743,"num_omap_keys":4,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003438"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.185570+0000","last_change":"2024-09-19T11:17:09.185503+0000","last_active":"2024-09-19T11:17:09.185570+0000","last_peered":"2024-09-19T11:17:09.185570+0000","last_clean":"2024-09-19T11:17:09.185570+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:17:09.185570+0000","last_undegraded":"2024-09-19T11:17:09.185570+0000","last_fullsized":"2024-09-19T11:17:09.185570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.185421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:28.271527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.428109+0000","last_change":"2024-09-19T11:17:24.428109+0000","last_active":"2024-09-19T11:17:24.428109+0000","last_peered":"2024-09-19T11:17:24.428109+0000","last_clean":"2024-09-19T11:17:24.428109+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:17:24.428109+0000","last_undegraded":"2024-09-19T11:17:24.428109+0000","last_fullsized":"2024-09-19T11:17:24.428109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:24.428032+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:24.428032+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.428032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:15:35.180377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.722324+0000","last_change":"2024-09-19T11:17:07.722223+0000","last_active":"2024-09-19T11:17:07.722324+0000","last_peered":"2024-09-19T11:17:07.722324+0000","last_clean":"2024-09-19T11:17:07.722324+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:17:07.722324+0000","last_undegraded":"2024-09-19T11:17:07.722324+0000","last_fullsized":"2024-09-19T11:17:07.722324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.722137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:30.023844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.228473+0000","last_change":"2024-09-19T11:17:39.228473+0000","last_active":"2024-09-19T11:17:39.228473+0000","last_peered":"2024-09-19T11:17:39.228473+0000","last_clean":"2024-09-19T11:17:39.228473+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:17:39.228473+0000","last_undegraded":"2024-09-19T11:17:39.228473+0000","last_fullsized":"2024-09-19T11:17:39.228473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:39.228390+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:39.228390+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.228390+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:43.727515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.305609+0000","last_change":"2024-09-19T11:17:20.305534+0000","last_active":"2024-09-19T11:17:20.305609+0000","last_peered":"2024-09-19T11:17:20.305609+0000","last_clean":"2024-09-19T11:17:20.305609+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:17:20.305609+0000","last_undegraded":"2024-09-19T11:17:20.305609+0000","last_fullsized":"2024-09-19T11:17:20.305609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:20.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:20.305449+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:26.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.707910+0000","last_change":"2024-09-19T11:17:19.707910+0000","last_active":"2024-09-19T11:17:19.707910+0000","last_peered":"2024-09-19T11:17:19.707910+0000","last_clean":"2024-09-19T11:17:19.707910+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:17:19.707910+0000","last_undegraded":"2024-09-19T11:17:19.707910+0000","last_fullsized":"2024-09-19T11:17:19.707910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:19.707815+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:19.707815+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.707815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:44.051682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.203776+0000","last_change":"2024-09-19T11:17:07.203719+0000","last_active":"2024-09-19T11:17:07.203776+0000","last_peered":"2024-09-19T11:17:07.203776+0000","last_clean":"2024-09-19T11:17:07.203776+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:07.203776+0000","last_undegraded":"2024-09-19T11:17:07.203776+0000","last_fullsized":"2024-09-19T11:17:07.203776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.203629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:11.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.181211+0000","last_change":"2024-09-19T11:17:38.181211+0000","last_active":"2024-09-19T11:17:38.181211+0000","last_peered":"2024-09-19T11:17:38.181211+0000","last_clean":"2024-09-19T11:17:38.181211+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:17:38.181211+0000","last_undegraded":"2024-09-19T11:17:38.181211+0000","last_fullsized":"2024-09-19T11:17:38.181211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:38.181092+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:38.181092+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.181092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.184562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.273303+0000","last_change":"2024-09-19T11:17:21.273303+0000","last_active":"2024-09-19T11:17:21.273303+0000","last_peered":"2024-09-19T11:17:21.273303+0000","last_clean":"2024-09-19T11:17:21.273303+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:17:21.273303+0000","last_undegraded":"2024-09-19T11:17:21.273303+0000","last_fullsized":"2024-09-19T11:17:21.273303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:21.273210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:21.273210+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.273210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:17.566575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.419946+0000","last_change":"2024-09-19T11:17:25.419858+0000","last_active":"2024-09-19T11:17:25.419946+0000","last_peered":"2024-09-19T11:17:25.419946+0000","last_clean":"2024-09-19T11:17:25.419946+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:17:25.419946+0000","last_undegraded":"2024-09-19T11:17:25.419946+0000","last_fullsized":"2024-09-19T11:17:25.419946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:25.419735+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:25.419735+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.419735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:25.095539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.173145+0000","last_change":"2024-09-19T11:17:06.173145+0000","last_active":"2024-09-19T11:17:06.173145+0000","last_peered":"2024-09-19T11:17:06.173145+0000","last_clean":"2024-09-19T11:17:06.173145+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:17:06.173145+0000","last_undegraded":"2024-09-19T11:17:06.173145+0000","last_fullsized":"2024-09-19T11:17:06.173145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.173052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:49.733204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'22","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.178486+0000","last_change":"2024-09-19T11:17:24.178486+0000","last_active":"2024-09-19T11:17:24.178486+0000","last_peered":"2024-09-19T11:17:24.178486+0000","last_clean":"2024-09-19T11:17:24.178486+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:17:24.178486+0000","last_undegraded":"2024-09-19T11:17:24.178486+0000","last_fullsized":"2024-09-19T11:17:24.178486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:24.178395+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:24.178395+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.178395+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:32:31.010938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.336034+0000","last_change":"2024-09-19T11:17:19.336034+0000","last_active":"2024-09-19T11:17:19.336034+0000","last_peered":"2024-09-19T11:17:19.336034+0000","last_clean":"2024-09-19T11:17:19.336034+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:17:19.336034+0000","last_undegraded":"2024-09-19T11:17:19.336034+0000","last_fullsized":"2024-09-19T11:17:19.336034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:19.335927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:19.335927+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.335927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:24.741509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.177004+0000","last_change":"2024-09-19T11:17:19.176944+0000","last_active":"2024-09-19T11:17:19.177004+0000","last_peered":"2024-09-19T11:17:19.177004+0000","last_clean":"2024-09-19T11:17:19.177004+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:17:19.177004+0000","last_undegraded":"2024-09-19T11:17:19.177004+0000","last_fullsized":"2024-09-19T11:17:19.177004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:19.176853+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:19.176853+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.176853+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:04.753042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.735731+0000","last_change":"2024-09-19T11:17:05.735731+0000","last_active":"2024-09-19T11:17:05.735731+0000","last_peered":"2024-09-19T11:17:05.735731+0000","last_clean":"2024-09-19T11:17:05.735731+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:17:05.735731+0000","last_undegraded":"2024-09-19T11:17:05.735731+0000","last_fullsized":"2024-09-19T11:17:05.735731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.735639+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:45.185308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.161554+0000","last_change":"2024-09-19T11:17:20.161499+0000","last_active":"2024-09-19T11:17:20.161554+0000","last_peered":"2024-09-19T11:17:20.161554+0000","last_clean":"2024-09-19T11:17:20.161554+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:17:20.161554+0000","last_undegraded":"2024-09-19T11:17:20.161554+0000","last_fullsized":"2024-09-19T11:17:20.161554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:20.161414+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:20.161414+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.161414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:55.200468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.187799+0000","last_change":"2024-09-19T11:17:36.187799+0000","last_active":"2024-09-19T11:17:36.187799+0000","last_peered":"2024-09-19T11:17:36.187799+0000","last_clean":"2024-09-19T11:17:36.187799+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:17:36.187799+0000","last_undegraded":"2024-09-19T11:17:36.187799+0000","last_fullsized":"2024-09-19T11:17:36.187799+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:36.187719+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:36.187719+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.187719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:20.713186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.728105+0000","last_change":"2024-09-19T11:17:03.728105+0000","last_active":"2024-09-19T11:17:03.728105+0000","last_peered":"2024-09-19T11:17:03.728105+0000","last_clean":"2024-09-19T11:17:03.728105+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:17:03.728105+0000","last_undegraded":"2024-09-19T11:17:03.728105+0000","last_fullsized":"2024-09-19T11:17:03.728105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.728013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:50.046423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.546410+0000","last_change":"2024-09-19T11:17:21.546410+0000","last_active":"2024-09-19T11:17:21.546410+0000","last_peered":"2024-09-19T11:17:21.546410+0000","last_clean":"2024-09-19T11:17:21.546410+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:17:21.546410+0000","last_undegraded":"2024-09-19T11:17:21.546410+0000","last_fullsized":"2024-09-19T11:17:21.546410+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:21.546297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:21.546297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.546297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:35.564864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.201897+0000","last_change":"2024-09-19T11:17:05.201897+0000","last_active":"2024-09-19T11:17:05.201897+0000","last_peered":"2024-09-19T11:17:05.201897+0000","last_clean":"2024-09-19T11:17:05.201897+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:17:05.201897+0000","last_undegraded":"2024-09-19T11:17:05.201897+0000","last_fullsized":"2024-09-19T11:17:05.201897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.201777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:39.204473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.461723+0000","last_change":"2024-09-19T11:17:23.461723+0000","last_active":"2024-09-19T11:17:23.461723+0000","last_peered":"2024-09-19T11:17:23.461723+0000","last_clean":"2024-09-19T11:17:23.461723+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:17:23.461723+0000","last_undegraded":"2024-09-19T11:17:23.461723+0000","last_fullsized":"2024-09-19T11:17:23.461723+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:23.461640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:23.461640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.461640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:44.860304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.571584+0000","last_change":"2024-09-19T11:17:10.571584+0000","last_active":"2024-09-19T11:17:10.571584+0000","last_peered":"2024-09-19T11:17:10.571584+0000","last_clean":"2024-09-19T11:17:10.571584+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:17:10.571584+0000","last_undegraded":"2024-09-19T11:17:10.571584+0000","last_fullsized":"2024-09-19T11:17:10.571584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.571487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:05.033249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.700307+0000","last_change":"2024-09-19T11:17:21.700307+0000","last_active":"2024-09-19T11:17:21.700307+0000","last_peered":"2024-09-19T11:17:21.700307+0000","last_clean":"2024-09-19T11:17:21.700307+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:17:21.700307+0000","last_undegraded":"2024-09-19T11:17:21.700307+0000","last_fullsized":"2024-09-19T11:17:21.700307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:21.700211+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:21.700211+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.700211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.309406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.677222+0000","last_change":"2024-09-19T11:17:06.677222+0000","last_active":"2024-09-19T11:17:06.677222+0000","last_peered":"2024-09-19T11:17:06.677222+0000","last_clean":"2024-09-19T11:17:06.677222+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:17:06.677222+0000","last_undegraded":"2024-09-19T11:17:06.677222+0000","last_fullsized":"2024-09-19T11:17:06.677222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.677123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:51.934638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.191519+0000","last_change":"2024-09-19T11:17:18.191519+0000","last_active":"2024-09-19T11:17:18.191519+0000","last_peered":"2024-09-19T11:17:18.191519+0000","last_clean":"2024-09-19T11:17:18.191519+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:17:18.191519+0000","last_undegraded":"2024-09-19T11:17:18.191519+0000","last_fullsized":"2024-09-19T11:17:18.191519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:18.191426+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:18.191426+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.191426+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:24.097341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.749724+0000","last_change":"2024-09-19T11:17:03.749724+0000","last_active":"2024-09-19T11:17:03.749724+0000","last_peered":"2024-09-19T11:17:03.749724+0000","last_clean":"2024-09-19T11:17:03.749724+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:17:03.749724+0000","last_undegraded":"2024-09-19T11:17:03.749724+0000","last_fullsized":"2024-09-19T11:17:03.749724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.749624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:09.231023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.498306+0000","last_change":"2024-09-19T11:17:22.498306+0000","last_active":"2024-09-19T11:17:22.498306+0000","last_peered":"2024-09-19T11:17:22.498306+0000","last_clean":"2024-09-19T11:17:22.498306+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:17:22.498306+0000","last_undegraded":"2024-09-19T11:17:22.498306+0000","last_fullsized":"2024-09-19T11:17:22.498306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:22.498193+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:22.498193+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.498193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:31.267529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.314533+0000","last_change":"2024-09-19T11:17:18.314533+0000","last_active":"2024-09-19T11:17:18.314533+0000","last_peered":"2024-09-19T11:17:18.314533+0000","last_clean":"2024-09-19T11:17:18.314533+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:17:18.314533+0000","last_undegraded":"2024-09-19T11:17:18.314533+0000","last_fullsized":"2024-09-19T11:17:18.314533+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:18.314426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:18.314426+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.314426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:36.967813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'36","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:53.526061+0000","last_change":"2024-09-19T11:17:53.526061+0000","last_active":"2024-09-19T11:17:53.526061+0000","last_peered":"2024-09-19T11:17:53.526061+0000","last_clean":"2024-09-19T11:17:53.526061+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:17:53.526061+0000","last_undegraded":"2024-09-19T11:17:53.526061+0000","last_fullsized":"2024-09-19T11:17:53.526061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'36","last_scrub_stamp":"2024-09-19T11:17:53.525955+0000","last_deep_scrub":"37'36","last_deep_scrub_stamp":"2024-09-19T11:17:53.525955+0000","last_clean_scrub_stamp":"2024-09-19T11:17:53.525955+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:22.989984+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.319705+0000","last_change":"2024-09-19T11:17:26.319705+0000","last_active":"2024-09-19T11:17:26.319705+0000","last_peered":"2024-09-19T11:17:26.319705+0000","last_clean":"2024-09-19T11:17:26.319705+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:17:26.319705+0000","last_undegraded":"2024-09-19T11:17:26.319705+0000","last_fullsized":"2024-09-19T11:17:26.319705+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:26.319597+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:26.319597+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.319597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:32.580506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.339744+0000","last_change":"2024-09-19T11:17:08.339744+0000","last_active":"2024-09-19T11:17:08.339744+0000","last_peered":"2024-09-19T11:17:08.339744+0000","last_clean":"2024-09-19T11:17:08.339744+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:17:08.339744+0000","last_undegraded":"2024-09-19T11:17:08.339744+0000","last_fullsized":"2024-09-19T11:17:08.339744+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.339654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:36.909793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.281630+0000","last_change":"2024-09-19T11:17:47.281630+0000","last_active":"2024-09-19T11:17:47.281630+0000","last_peered":"2024-09-19T11:17:47.281630+0000","last_clean":"2024-09-19T11:17:47.281630+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:17:47.281630+0000","last_undegraded":"2024-09-19T11:17:47.281630+0000","last_fullsized":"2024-09-19T11:17:47.281630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.281547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.281547+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.281547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:45.497123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'33","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.803962+0000","last_change":"2024-09-19T11:13:37.368405+0000","last_active":"2024-09-19T11:16:49.803962+0000","last_peered":"2024-09-19T11:16:49.803962+0000","last_clean":"2024-09-19T11:16:49.803962+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:16:49.803962+0000","last_undegraded":"2024-09-19T11:16:49.803962+0000","last_fullsized":"2024-09-19T11:16:49.803962+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":33,"log_dups_size":0,"ondisk_log_size":33,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:00:09.867739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.526959+0000","last_change":"2024-09-19T11:17:45.526959+0000","last_active":"2024-09-19T11:17:45.526959+0000","last_peered":"2024-09-19T11:17:45.526959+0000","last_clean":"2024-09-19T11:17:45.526959+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:17:45.526959+0000","last_undegraded":"2024-09-19T11:17:45.526959+0000","last_fullsized":"2024-09-19T11:17:45.526959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:45.526876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:45.526876+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.526876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:04.650775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:57.935993+0000","last_change":"2024-09-19T11:13:41.393295+0000","last_active":"2024-09-19T11:14:57.935993+0000","last_peered":"2024-09-19T11:14:57.935993+0000","last_clean":"2024-09-19T11:14:57.935993+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:14:57.935993+0000","last_undegraded":"2024-09-19T11:14:57.935993+0000","last_fullsized":"2024-09-19T11:14:57.935993+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:18:48.199857+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.211803+0000","last_change":"2024-09-19T11:17:29.211803+0000","last_active":"2024-09-19T11:17:29.211803+0000","last_peered":"2024-09-19T11:17:29.211803+0000","last_clean":"2024-09-19T11:17:29.211803+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:17:29.211803+0000","last_undegraded":"2024-09-19T11:17:29.211803+0000","last_fullsized":"2024-09-19T11:17:29.211803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:29.211683+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:29.211683+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.211683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:00.455274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.229925+0000","last_change":"2024-09-19T11:16:59.229925+0000","last_active":"2024-09-19T11:16:59.229925+0000","last_peered":"2024-09-19T11:16:59.229925+0000","last_clean":"2024-09-19T11:16:59.229925+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:16:59.229925+0000","last_undegraded":"2024-09-19T11:16:59.229925+0000","last_fullsized":"2024-09-19T11:16:59.229925+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.229836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.835840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.558504+0000","last_change":"2024-09-19T11:17:30.558504+0000","last_active":"2024-09-19T11:17:30.558504+0000","last_peered":"2024-09-19T11:17:30.558504+0000","last_clean":"2024-09-19T11:17:30.558504+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:17:30.558504+0000","last_undegraded":"2024-09-19T11:17:30.558504+0000","last_fullsized":"2024-09-19T11:17:30.558504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.558423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.558423+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.558423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:03.461110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'9","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.501925+0000","last_change":"2024-09-19T11:17:39.501925+0000","last_active":"2024-09-19T11:17:39.501925+0000","last_peered":"2024-09-19T11:17:39.501925+0000","last_clean":"2024-09-19T11:17:39.501925+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:17:39.501925+0000","last_undegraded":"2024-09-19T11:17:39.501925+0000","last_fullsized":"2024-09-19T11:17:39.501925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:39.501845+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:39.501845+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.501845+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:24.314455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.482311+0000","last_change":"2024-09-19T11:17:44.482311+0000","last_active":"2024-09-19T11:17:44.482311+0000","last_peered":"2024-09-19T11:17:44.482311+0000","last_clean":"2024-09-19T11:17:44.482311+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:17:44.482311+0000","last_undegraded":"2024-09-19T11:17:44.482311+0000","last_fullsized":"2024-09-19T11:17:44.482311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:44.482220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:44.482220+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.482220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:52.103555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586216+0000","last_change":"2024-09-19T11:13:41.387845+0000","last_active":"2024-09-19T11:14:07.586216+0000","last_peered":"2024-09-19T11:14:07.586216+0000","last_clean":"2024-09-19T11:14:07.586216+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:14:07.586216+0000","last_undegraded":"2024-09-19T11:14:07.586216+0000","last_fullsized":"2024-09-19T11:14:07.586216+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:01.782452+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":115,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.236476+0000","last_change":"2024-09-19T11:17:28.236476+0000","last_active":"2024-09-19T11:17:28.236476+0000","last_peered":"2024-09-19T11:17:28.236476+0000","last_clean":"2024-09-19T11:17:28.236476+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:17:28.236476+0000","last_undegraded":"2024-09-19T11:17:28.236476+0000","last_fullsized":"2024-09-19T11:17:28.236476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:28.236388+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:28.236388+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.236388+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:08.350408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.361981+0000","last_change":"2024-09-19T11:17:06.361981+0000","last_active":"2024-09-19T11:17:06.361981+0000","last_peered":"2024-09-19T11:17:06.361981+0000","last_clean":"2024-09-19T11:17:06.361981+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:17:06.361981+0000","last_undegraded":"2024-09-19T11:17:06.361981+0000","last_fullsized":"2024-09-19T11:17:06.361981+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.361895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.368884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.221087+0000","last_change":"2024-09-19T11:17:23.221087+0000","last_active":"2024-09-19T11:17:23.221087+0000","last_peered":"2024-09-19T11:17:23.221087+0000","last_clean":"2024-09-19T11:17:23.221087+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:17:23.221087+0000","last_undegraded":"2024-09-19T11:17:23.221087+0000","last_fullsized":"2024-09-19T11:17:23.221087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:23.221010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:23.221010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.221010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:14.504688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"37'16","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.193229+0000","last_change":"2024-09-19T11:17:32.193229+0000","last_active":"2024-09-19T11:17:32.193229+0000","last_peered":"2024-09-19T11:17:32.193229+0000","last_clean":"2024-09-19T11:17:32.193229+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:17:32.193229+0000","last_undegraded":"2024-09-19T11:17:32.193229+0000","last_fullsized":"2024-09-19T11:17:32.193229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-19T11:17:32.193122+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-19T11:17:32.193122+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.193122+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:16.365007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'285","reported_seq":385,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.714648+0000","last_change":"2024-09-19T11:13:39.380724+0000","last_active":"2024-09-19T11:16:49.714648+0000","last_peered":"2024-09-19T11:16:49.714648+0000","last_clean":"2024-09-19T11:16:49.714648+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:16:49.714648+0000","last_undegraded":"2024-09-19T11:16:49.714648+0000","last_fullsized":"2024-09-19T11:16:49.714648+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":285,"log_dups_size":0,"ondisk_log_size":285,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:53.027795+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.010200+0000","last_change":"2024-09-19T11:17:47.010200+0000","last_active":"2024-09-19T11:17:47.010200+0000","last_peered":"2024-09-19T11:17:47.010200+0000","last_clean":"2024-09-19T11:17:47.010200+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:17:47.010200+0000","last_undegraded":"2024-09-19T11:17:47.010200+0000","last_fullsized":"2024-09-19T11:17:47.010200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.010119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.010119+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.010119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:28.260778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.747257+0000","last_change":"2024-09-19T11:17:11.747257+0000","last_active":"2024-09-19T11:17:11.747257+0000","last_peered":"2024-09-19T11:17:11.747257+0000","last_clean":"2024-09-19T11:17:11.747257+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:17:11.747257+0000","last_undegraded":"2024-09-19T11:17:11.747257+0000","last_fullsized":"2024-09-19T11:17:11.747257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:11.747153+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:11.747153+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.747153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:25.029210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.839089+0000","last_change":"2024-09-19T11:16:55.839089+0000","last_active":"2024-09-19T11:16:55.839089+0000","last_peered":"2024-09-19T11:16:55.839089+0000","last_clean":"2024-09-19T11:16:55.839089+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:55.839089+0000","last_undegraded":"2024-09-19T11:16:55.839089+0000","last_fullsized":"2024-09-19T11:16:55.839089+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.839001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.925106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.279811+0000","last_change":"2024-09-19T11:17:46.279811+0000","last_active":"2024-09-19T11:17:46.279811+0000","last_peered":"2024-09-19T11:17:46.279811+0000","last_clean":"2024-09-19T11:17:46.279811+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:17:46.279811+0000","last_undegraded":"2024-09-19T11:17:46.279811+0000","last_fullsized":"2024-09-19T11:17:46.279811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.279731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.279731+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.279731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:20.095306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.106584+0000","last_change":"2024-09-19T11:17:35.106584+0000","last_active":"2024-09-19T11:17:35.106584+0000","last_peered":"2024-09-19T11:17:35.106584+0000","last_clean":"2024-09-19T11:17:35.106584+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:17:35.106584+0000","last_undegraded":"2024-09-19T11:17:35.106584+0000","last_fullsized":"2024-09-19T11:17:35.106584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:35.106490+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:35.106490+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.106490+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:05.221475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":454,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.362406+0000","last_change":"2024-09-19T11:17:45.362406+0000","last_active":"2024-09-19T11:17:45.362406+0000","last_peered":"2024-09-19T11:17:45.362406+0000","last_clean":"2024-09-19T11:17:45.362406+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:17:45.362406+0000","last_undegraded":"2024-09-19T11:17:45.362406+0000","last_fullsized":"2024-09-19T11:17:45.362406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:45.362319+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:45.362319+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.362319+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.433586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.274262+0000","last_change":"2024-09-19T11:17:27.274193+0000","last_active":"2024-09-19T11:17:27.274262+0000","last_peered":"2024-09-19T11:17:27.274262+0000","last_clean":"2024-09-19T11:17:27.274262+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:17:27.274262+0000","last_undegraded":"2024-09-19T11:17:27.274262+0000","last_fullsized":"2024-09-19T11:17:27.274262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:27.274106+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:27.274106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.274106+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:39.287747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.263964+0000","last_change":"2024-09-19T11:16:57.263964+0000","last_active":"2024-09-19T11:16:57.263964+0000","last_peered":"2024-09-19T11:16:57.263964+0000","last_clean":"2024-09-19T11:16:57.263964+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:16:57.263964+0000","last_undegraded":"2024-09-19T11:16:57.263964+0000","last_fullsized":"2024-09-19T11:16:57.263964+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.263877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:17.532651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.362748+0000","last_change":"2024-09-19T11:17:28.362748+0000","last_active":"2024-09-19T11:17:28.362748+0000","last_peered":"2024-09-19T11:17:28.362748+0000","last_clean":"2024-09-19T11:17:28.362748+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:17:28.362748+0000","last_undegraded":"2024-09-19T11:17:28.362748+0000","last_fullsized":"2024-09-19T11:17:28.362748+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:28.362667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:28.362667+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.362667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:04.145457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'52","reported_seq":112,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.186611+0000","last_change":"2024-09-19T11:17:29.186611+0000","last_active":"2024-09-19T11:17:29.186611+0000","last_peered":"2024-09-19T11:17:29.186611+0000","last_clean":"2024-09-19T11:17:29.186611+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:17:29.186611+0000","last_undegraded":"2024-09-19T11:17:29.186611+0000","last_fullsized":"2024-09-19T11:17:29.186611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'52","last_scrub_stamp":"2024-09-19T11:17:29.186505+0000","last_deep_scrub":"37'52","last_deep_scrub_stamp":"2024-09-19T11:17:29.186505+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.186505+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:21.134065+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.380288+0000","last_change":"2024-09-19T11:17:43.380288+0000","last_active":"2024-09-19T11:17:43.380288+0000","last_peered":"2024-09-19T11:17:43.380288+0000","last_clean":"2024-09-19T11:17:43.380288+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:17:43.380288+0000","last_undegraded":"2024-09-19T11:17:43.380288+0000","last_fullsized":"2024-09-19T11:17:43.380288+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:43.380205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:43.380205+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.380205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:30.582852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.022502+0000","last_change":"2024-09-19T11:17:44.022426+0000","last_active":"2024-09-19T11:17:44.022502+0000","last_peered":"2024-09-19T11:17:44.022502+0000","last_clean":"2024-09-19T11:17:44.022502+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:17:44.022502+0000","last_undegraded":"2024-09-19T11:17:44.022502+0000","last_fullsized":"2024-09-19T11:17:44.022502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:44.022337+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:44.022337+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.022337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:02.202019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.629046+0000","last_change":"2024-09-19T11:17:07.628983+0000","last_active":"2024-09-19T11:17:07.629046+0000","last_peered":"2024-09-19T11:17:07.629046+0000","last_clean":"2024-09-19T11:17:07.629046+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:17:07.629046+0000","last_undegraded":"2024-09-19T11:17:07.629046+0000","last_fullsized":"2024-09-19T11:17:07.629046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.628902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:57.737242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.261648+0000","last_change":"2024-09-19T11:16:56.261648+0000","last_active":"2024-09-19T11:16:56.261648+0000","last_peered":"2024-09-19T11:16:56.261648+0000","last_clean":"2024-09-19T11:16:56.261648+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:16:56.261648+0000","last_undegraded":"2024-09-19T11:16:56.261648+0000","last_fullsized":"2024-09-19T11:16:56.261648+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.261557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:54.106719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.638557+0000","last_change":"2024-09-19T11:17:24.638557+0000","last_active":"2024-09-19T11:17:24.638557+0000","last_peered":"2024-09-19T11:17:24.638557+0000","last_clean":"2024-09-19T11:17:24.638557+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:17:24.638557+0000","last_undegraded":"2024-09-19T11:17:24.638557+0000","last_fullsized":"2024-09-19T11:17:24.638557+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:24.638460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:24.638460+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.638460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.911135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:53.178861+0000","last_change":"2024-09-19T11:17:53.178861+0000","last_active":"2024-09-19T11:17:53.178861+0000","last_peered":"2024-09-19T11:17:53.178861+0000","last_clean":"2024-09-19T11:17:53.178861+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:17:53.178861+0000","last_undegraded":"2024-09-19T11:17:53.178861+0000","last_fullsized":"2024-09-19T11:17:53.178861+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:53.178746+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:53.178746+0000","last_clean_scrub_stamp":"2024-09-19T11:17:53.178746+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:51.619402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.449204+0000","last_change":"2024-09-19T11:17:40.449204+0000","last_active":"2024-09-19T11:17:40.449204+0000","last_peered":"2024-09-19T11:17:40.449204+0000","last_clean":"2024-09-19T11:17:40.449204+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:17:40.449204+0000","last_undegraded":"2024-09-19T11:17:40.449204+0000","last_fullsized":"2024-09-19T11:17:40.449204+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.449101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.449101+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.449101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:25.734676+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'6","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.588389+0000","last_change":"2024-09-19T11:17:47.588313+0000","last_active":"2024-09-19T11:17:47.588389+0000","last_peered":"2024-09-19T11:17:47.588389+0000","last_clean":"2024-09-19T11:17:47.588389+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:17:47.588389+0000","last_undegraded":"2024-09-19T11:17:47.588389+0000","last_fullsized":"2024-09-19T11:17:47.588389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:47.588229+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:47.588229+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.588229+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:48.144904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.203795+0000","last_change":"2024-09-19T11:17:11.203698+0000","last_active":"2024-09-19T11:17:11.203795+0000","last_peered":"2024-09-19T11:17:11.203795+0000","last_clean":"2024-09-19T11:17:11.203795+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:17:11.203795+0000","last_undegraded":"2024-09-19T11:17:11.203795+0000","last_fullsized":"2024-09-19T11:17:11.203795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.203591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:37.021206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.352287+0000","last_change":"2024-09-19T11:17:05.352287+0000","last_active":"2024-09-19T11:17:05.352287+0000","last_peered":"2024-09-19T11:17:05.352287+0000","last_clean":"2024-09-19T11:17:05.352287+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:17:05.352287+0000","last_undegraded":"2024-09-19T11:17:05.352287+0000","last_fullsized":"2024-09-19T11:17:05.352287+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.352205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:29.817735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.637805+0000","last_change":"2024-09-19T11:17:25.637805+0000","last_active":"2024-09-19T11:17:25.637805+0000","last_peered":"2024-09-19T11:17:25.637805+0000","last_clean":"2024-09-19T11:17:25.637805+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:17:25.637805+0000","last_undegraded":"2024-09-19T11:17:25.637805+0000","last_fullsized":"2024-09-19T11:17:25.637805+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:25.637701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:25.637701+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.637701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:53.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'47","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:51.239589+0000","last_change":"2024-09-19T11:17:51.239589+0000","last_active":"2024-09-19T11:17:51.239589+0000","last_peered":"2024-09-19T11:17:51.239589+0000","last_clean":"2024-09-19T11:17:51.239589+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:17:51.239589+0000","last_undegraded":"2024-09-19T11:17:51.239589+0000","last_fullsized":"2024-09-19T11:17:51.239589+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-19T11:17:51.239489+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-19T11:17:51.239489+0000","last_clean_scrub_stamp":"2024-09-19T11:17:51.239489+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:28.050801+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":361,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.429050+0000","last_change":"2024-09-19T11:17:41.429050+0000","last_active":"2024-09-19T11:17:41.429050+0000","last_peered":"2024-09-19T11:17:41.429050+0000","last_clean":"2024-09-19T11:17:41.429050+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:17:41.429050+0000","last_undegraded":"2024-09-19T11:17:41.429050+0000","last_fullsized":"2024-09-19T11:17:41.429050+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.428963+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.428963+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.428963+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:39.532132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.362568+0000","last_change":"2024-09-19T11:17:49.362568+0000","last_active":"2024-09-19T11:17:49.362568+0000","last_peered":"2024-09-19T11:17:49.362568+0000","last_clean":"2024-09-19T11:17:49.362568+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:17:49.362568+0000","last_undegraded":"2024-09-19T11:17:49.362568+0000","last_fullsized":"2024-09-19T11:17:49.362568+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:49.362468+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:49.362468+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.362468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:56.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.152751+0000","last_change":"2024-09-19T11:17:13.152751+0000","last_active":"2024-09-19T11:17:13.152751+0000","last_peered":"2024-09-19T11:17:13.152751+0000","last_clean":"2024-09-19T11:17:13.152751+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:17:13.152751+0000","last_undegraded":"2024-09-19T11:17:13.152751+0000","last_fullsized":"2024-09-19T11:17:13.152751+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.152663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:40.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.373483+0000","last_change":"2024-09-19T11:17:04.373483+0000","last_active":"2024-09-19T11:17:04.373483+0000","last_peered":"2024-09-19T11:17:04.373483+0000","last_clean":"2024-09-19T11:17:04.373483+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:17:04.373483+0000","last_undegraded":"2024-09-19T11:17:04.373483+0000","last_fullsized":"2024-09-19T11:17:04.373483+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.373373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:15.731395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.616866+0000","last_change":"2024-09-19T11:17:26.616866+0000","last_active":"2024-09-19T11:17:26.616866+0000","last_peered":"2024-09-19T11:17:26.616866+0000","last_clean":"2024-09-19T11:17:26.616866+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:17:26.616866+0000","last_undegraded":"2024-09-19T11:17:26.616866+0000","last_fullsized":"2024-09-19T11:17:26.616866+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:26.616770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:26.616770+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.616770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:29.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'66","reported_seq":139,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:52.209644+0000","last_change":"2024-09-19T11:17:52.209644+0000","last_active":"2024-09-19T11:17:52.209644+0000","last_peered":"2024-09-19T11:17:52.209644+0000","last_clean":"2024-09-19T11:17:52.209644+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:17:52.209644+0000","last_undegraded":"2024-09-19T11:17:52.209644+0000","last_fullsized":"2024-09-19T11:17:52.209644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'66","last_scrub_stamp":"2024-09-19T11:17:52.209547+0000","last_deep_scrub":"37'66","last_deep_scrub_stamp":"2024-09-19T11:17:52.209547+0000","last_clean_scrub_stamp":"2024-09-19T11:17:52.209547+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:41.285238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.440666+0000","last_change":"2024-09-19T11:17:39.440666+0000","last_active":"2024-09-19T11:17:39.440666+0000","last_peered":"2024-09-19T11:17:39.440666+0000","last_clean":"2024-09-19T11:17:39.440666+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:17:39.440666+0000","last_undegraded":"2024-09-19T11:17:39.440666+0000","last_fullsized":"2024-09-19T11:17:39.440666+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:39.440562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:39.440562+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.440562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:08.444651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'21","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.360270+0000","last_change":"2024-09-19T11:17:50.360270+0000","last_active":"2024-09-19T11:17:50.360270+0000","last_peered":"2024-09-19T11:17:50.360270+0000","last_clean":"2024-09-19T11:17:50.360270+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:17:50.360270+0000","last_undegraded":"2024-09-19T11:17:50.360270+0000","last_fullsized":"2024-09-19T11:17:50.360270+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:50.360181+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:50.360181+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.360181+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:39.947931+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.621448+0000","last_change":"2024-09-19T11:17:11.621448+0000","last_active":"2024-09-19T11:17:11.621448+0000","last_peered":"2024-09-19T11:17:11.621448+0000","last_clean":"2024-09-19T11:17:11.621448+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:17:11.621448+0000","last_undegraded":"2024-09-19T11:17:11.621448+0000","last_fullsized":"2024-09-19T11:17:11.621448+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.621356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:31.900753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.780765+0000","last_change":"2024-09-19T11:16:57.780765+0000","last_active":"2024-09-19T11:16:57.780765+0000","last_peered":"2024-09-19T11:16:57.780765+0000","last_clean":"2024-09-19T11:16:57.780765+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:16:57.780765+0000","last_undegraded":"2024-09-19T11:16:57.780765+0000","last_fullsized":"2024-09-19T11:16:57.780765+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.780677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:08.322449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.193130+0000","last_change":"2024-09-19T11:17:30.193130+0000","last_active":"2024-09-19T11:17:30.193130+0000","last_peered":"2024-09-19T11:17:30.193130+0000","last_clean":"2024-09-19T11:17:30.193130+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:17:30.193130+0000","last_undegraded":"2024-09-19T11:17:30.193130+0000","last_fullsized":"2024-09-19T11:17:30.193130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.193023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.193023+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.193023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:55.620571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'40","reported_seq":96,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.452625+0000","last_change":"2024-09-19T11:17:38.452625+0000","last_active":"2024-09-19T11:17:38.452625+0000","last_peered":"2024-09-19T11:17:38.452625+0000","last_clean":"2024-09-19T11:17:38.452625+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:17:38.452625+0000","last_undegraded":"2024-09-19T11:17:38.452625+0000","last_fullsized":"2024-09-19T11:17:38.452625+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-19T11:17:38.452505+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-19T11:17:38.452505+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.452505+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:22.028550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589393+0000","last_change":"2024-09-19T11:13:39.378975+0000","last_active":"2024-09-19T11:14:07.589393+0000","last_peered":"2024-09-19T11:14:07.589393+0000","last_clean":"2024-09-19T11:14:07.589393+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:14:07.589393+0000","last_undegraded":"2024-09-19T11:14:07.589393+0000","last_fullsized":"2024-09-19T11:14:07.589393+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:43.898464+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'5","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:43.109862+0000","last_change":"2024-09-19T11:13:41.390986+0000","last_active":"2024-09-19T11:16:43.109862+0000","last_peered":"2024-09-19T11:16:43.109862+0000","last_clean":"2024-09-19T11:16:43.109862+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:16:43.109862+0000","last_undegraded":"2024-09-19T11:16:43.109862+0000","last_fullsized":"2024-09-19T11:16:43.109862+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.351536+0000","last_change":"2024-09-19T11:17:24.351536+0000","last_active":"2024-09-19T11:17:24.351536+0000","last_peered":"2024-09-19T11:17:24.351536+0000","last_clean":"2024-09-19T11:17:24.351536+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:17:24.351536+0000","last_undegraded":"2024-09-19T11:17:24.351536+0000","last_fullsized":"2024-09-19T11:17:24.351536+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:24.351451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:24.351451+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.351451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:00.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.388311+0000","last_change":"2024-09-19T11:17:03.388243+0000","last_active":"2024-09-19T11:17:03.388311+0000","last_peered":"2024-09-19T11:17:03.388311+0000","last_clean":"2024-09-19T11:17:03.388311+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:17:03.388311+0000","last_undegraded":"2024-09-19T11:17:03.388311+0000","last_fullsized":"2024-09-19T11:17:03.388311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.388155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:34.409511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.599833+0000","last_change":"2024-09-19T11:17:27.599833+0000","last_active":"2024-09-19T11:17:27.599833+0000","last_peered":"2024-09-19T11:17:27.599833+0000","last_clean":"2024-09-19T11:17:27.599833+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:17:27.599833+0000","last_undegraded":"2024-09-19T11:17:27.599833+0000","last_fullsized":"2024-09-19T11:17:27.599833+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.599747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.599747+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.599747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.745233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.207279+0000","last_change":"2024-09-19T11:17:31.207279+0000","last_active":"2024-09-19T11:17:31.207279+0000","last_peered":"2024-09-19T11:17:31.207279+0000","last_clean":"2024-09-19T11:17:31.207279+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:17:31.207279+0000","last_undegraded":"2024-09-19T11:17:31.207279+0000","last_fullsized":"2024-09-19T11:17:31.207279+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:31.207126+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:31.207126+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.207126+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:27.455684+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":444,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.057407+0000","last_change":"2024-09-19T11:17:38.057407+0000","last_active":"2024-09-19T11:17:38.057407+0000","last_peered":"2024-09-19T11:17:38.057407+0000","last_clean":"2024-09-19T11:17:38.057407+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:17:38.057407+0000","last_undegraded":"2024-09-19T11:17:38.057407+0000","last_fullsized":"2024-09-19T11:17:38.057407+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:38.057316+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:38.057316+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.057316+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:05.417830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.385382+0000","last_change":"2024-09-19T11:17:48.385256+0000","last_active":"2024-09-19T11:17:48.385382+0000","last_peered":"2024-09-19T11:17:48.385382+0000","last_clean":"2024-09-19T11:17:48.385382+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:17:48.385382+0000","last_undegraded":"2024-09-19T11:17:48.385382+0000","last_fullsized":"2024-09-19T11:17:48.385382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:17:48.385151+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:17:48.385151+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.385151+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:56.785402+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":79,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.194292+0000","last_change":"2024-09-19T11:17:12.194292+0000","last_active":"2024-09-19T11:17:12.194292+0000","last_peered":"2024-09-19T11:17:12.194292+0000","last_clean":"2024-09-19T11:17:12.194292+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:17:12.194292+0000","last_undegraded":"2024-09-19T11:17:12.194292+0000","last_fullsized":"2024-09-19T11:17:12.194292+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.194188+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:19.272935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.338606+0000","last_change":"2024-09-19T11:17:02.338513+0000","last_active":"2024-09-19T11:17:02.338606+0000","last_peered":"2024-09-19T11:17:02.338606+0000","last_clean":"2024-09-19T11:17:02.338606+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:17:02.338606+0000","last_undegraded":"2024-09-19T11:17:02.338606+0000","last_fullsized":"2024-09-19T11:17:02.338606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.338404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:05.736888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":428,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.361930+0000","last_change":"2024-09-19T11:17:29.361930+0000","last_active":"2024-09-19T11:17:29.361930+0000","last_peered":"2024-09-19T11:17:29.361930+0000","last_clean":"2024-09-19T11:17:29.361930+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:17:29.361930+0000","last_undegraded":"2024-09-19T11:17:29.361930+0000","last_fullsized":"2024-09-19T11:17:29.361930+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:29.361811+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:29.361811+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.361811+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:18.426521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"35'10","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586975+0000","last_change":"2024-09-19T11:13:37.369616+0000","last_active":"2024-09-19T11:14:07.586975+0000","last_peered":"2024-09-19T11:14:07.586975+0000","last_clean":"2024-09-19T11:14:07.586975+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:14:07.586975+0000","last_undegraded":"2024-09-19T11:14:07.586975+0000","last_fullsized":"2024-09-19T11:14:07.586975+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:42:01.498959+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":481,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.472448+0000","last_change":"2024-09-19T11:17:40.472448+0000","last_active":"2024-09-19T11:17:40.472448+0000","last_peered":"2024-09-19T11:17:40.472448+0000","last_clean":"2024-09-19T11:17:40.472448+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:17:40.472448+0000","last_undegraded":"2024-09-19T11:17:40.472448+0000","last_fullsized":"2024-09-19T11:17:40.472448+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:40.472359+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:40.472359+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.472359+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:23:34.581152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.039406+0000","last_change":"2024-09-19T11:17:43.039305+0000","last_active":"2024-09-19T11:17:43.039406+0000","last_peered":"2024-09-19T11:17:43.039406+0000","last_clean":"2024-09-19T11:17:43.039406+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:17:43.039406+0000","last_undegraded":"2024-09-19T11:17:43.039406+0000","last_fullsized":"2024-09-19T11:17:43.039406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:43.039163+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:43.039163+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.039163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:32.103874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.578446+0000","last_change":"2024-09-19T11:17:09.578446+0000","last_active":"2024-09-19T11:17:09.578446+0000","last_peered":"2024-09-19T11:17:09.578446+0000","last_clean":"2024-09-19T11:17:09.578446+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:17:09.578446+0000","last_undegraded":"2024-09-19T11:17:09.578446+0000","last_fullsized":"2024-09-19T11:17:09.578446+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.578340+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:59.479596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.333003+0000","last_change":"2024-09-19T11:16:59.332945+0000","last_active":"2024-09-19T11:16:59.333003+0000","last_peered":"2024-09-19T11:16:59.333003+0000","last_clean":"2024-09-19T11:16:59.333003+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:16:59.333003+0000","last_undegraded":"2024-09-19T11:16:59.333003+0000","last_fullsized":"2024-09-19T11:16:59.333003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.332858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:10.200721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":230,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.275976+0000","last_change":"2024-09-19T11:17:43.275976+0000","last_active":"2024-09-19T11:17:43.275976+0000","last_peered":"2024-09-19T11:17:43.275976+0000","last_clean":"2024-09-19T11:17:43.275976+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:17:43.275976+0000","last_undegraded":"2024-09-19T11:17:43.275976+0000","last_fullsized":"2024-09-19T11:17:43.275976+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:43.275885+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:43.275885+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.275885+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:57.031561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'49","reported_seq":108,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.422473+0000","last_change":"2024-09-19T11:17:37.422473+0000","last_active":"2024-09-19T11:17:37.422473+0000","last_peered":"2024-09-19T11:17:37.422473+0000","last_clean":"2024-09-19T11:17:37.422473+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:17:37.422473+0000","last_undegraded":"2024-09-19T11:17:37.422473+0000","last_fullsized":"2024-09-19T11:17:37.422473+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-19T11:17:37.422376+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-19T11:17:37.422376+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.422376+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:50.529884+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.061117+0000","last_change":"2024-09-19T11:17:37.061117+0000","last_active":"2024-09-19T11:17:37.061117+0000","last_peered":"2024-09-19T11:17:37.061117+0000","last_clean":"2024-09-19T11:17:37.061117+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:17:37.061117+0000","last_undegraded":"2024-09-19T11:17:37.061117+0000","last_fullsized":"2024-09-19T11:17:37.061117+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.061010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.061010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.061010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:40.292109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'10","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.541622+0000","last_change":"2024-09-19T11:17:48.541558+0000","last_active":"2024-09-19T11:17:48.541622+0000","last_peered":"2024-09-19T11:17:48.541622+0000","last_clean":"2024-09-19T11:17:48.541622+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:17:48.541622+0000","last_undegraded":"2024-09-19T11:17:48.541622+0000","last_fullsized":"2024-09-19T11:17:48.541622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:48.541460+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:48.541460+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.541460+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:19.562815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.322063+0000","last_change":"2024-09-19T11:17:22.321969+0000","last_active":"2024-09-19T11:17:22.322063+0000","last_peered":"2024-09-19T11:17:22.322063+0000","last_clean":"2024-09-19T11:17:22.322063+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:17:22.322063+0000","last_undegraded":"2024-09-19T11:17:22.322063+0000","last_fullsized":"2024-09-19T11:17:22.322063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:22.321856+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:22.321856+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.321856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:33.212561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.790923+0000","last_change":"2024-09-19T11:16:53.790826+0000","last_active":"2024-09-19T11:16:53.790923+0000","last_peered":"2024-09-19T11:16:53.790923+0000","last_clean":"2024-09-19T11:16:53.790923+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:16:53.790923+0000","last_undegraded":"2024-09-19T11:16:53.790923+0000","last_fullsized":"2024-09-19T11:16:53.790923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.790697+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:58.322869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.307176+0000","last_change":"2024-09-19T11:16:57.307111+0000","last_active":"2024-09-19T11:16:57.307176+0000","last_peered":"2024-09-19T11:16:57.307176+0000","last_clean":"2024-09-19T11:16:57.307176+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:16:57.307176+0000","last_undegraded":"2024-09-19T11:16:57.307176+0000","last_fullsized":"2024-09-19T11:16:57.307176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.307030+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:57.423065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.333474+0000","last_change":"2024-09-19T11:17:01.333402+0000","last_active":"2024-09-19T11:17:01.333474+0000","last_peered":"2024-09-19T11:17:01.333474+0000","last_clean":"2024-09-19T11:17:01.333474+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:17:01.333474+0000","last_undegraded":"2024-09-19T11:17:01.333474+0000","last_fullsized":"2024-09-19T11:17:01.333474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.333297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:01.707856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.404308+0000","last_change":"2024-09-19T11:17:27.404242+0000","last_active":"2024-09-19T11:17:27.404308+0000","last_peered":"2024-09-19T11:17:27.404308+0000","last_clean":"2024-09-19T11:17:27.404308+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:17:27.404308+0000","last_undegraded":"2024-09-19T11:17:27.404308+0000","last_fullsized":"2024-09-19T11:17:27.404308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.404158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.404158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.404158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:07.281435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'90","reported_seq":180,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.264388+0000","last_change":"2024-09-19T11:17:50.264388+0000","last_active":"2024-09-19T11:17:50.264388+0000","last_peered":"2024-09-19T11:17:50.264388+0000","last_clean":"2024-09-19T11:17:50.264388+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:17:50.264388+0000","last_undegraded":"2024-09-19T11:17:50.264388+0000","last_fullsized":"2024-09-19T11:17:50.264388+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-19T11:17:50.264288+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-19T11:17:50.264288+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.264288+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:47.595229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.440371+0000","last_change":"2024-09-19T11:17:38.440371+0000","last_active":"2024-09-19T11:17:38.440371+0000","last_peered":"2024-09-19T11:17:38.440371+0000","last_clean":"2024-09-19T11:17:38.440371+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:17:38.440371+0000","last_undegraded":"2024-09-19T11:17:38.440371+0000","last_fullsized":"2024-09-19T11:17:38.440371+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:38.440272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:38.440272+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.440272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:01.029191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":172,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.977787+0000","last_change":"2024-09-19T11:17:44.977787+0000","last_active":"2024-09-19T11:17:44.977787+0000","last_peered":"2024-09-19T11:17:44.977787+0000","last_clean":"2024-09-19T11:17:44.977787+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:17:44.977787+0000","last_undegraded":"2024-09-19T11:17:44.977787+0000","last_fullsized":"2024-09-19T11:17:44.977787+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'82","last_scrub_stamp":"2024-09-19T11:17:44.977702+0000","last_deep_scrub":"37'82","last_deep_scrub_stamp":"2024-09-19T11:17:44.977702+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.977702+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:20.274518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.320845+0000","last_change":"2024-09-19T11:17:23.320770+0000","last_active":"2024-09-19T11:17:23.320845+0000","last_peered":"2024-09-19T11:17:23.320845+0000","last_clean":"2024-09-19T11:17:23.320845+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:17:23.320845+0000","last_undegraded":"2024-09-19T11:17:23.320845+0000","last_fullsized":"2024-09-19T11:17:23.320845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:23.320681+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:23.320681+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.320681+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:45.331495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.377364+0000","last_change":"2024-09-19T11:16:54.377268+0000","last_active":"2024-09-19T11:16:54.377364+0000","last_peered":"2024-09-19T11:16:54.377364+0000","last_clean":"2024-09-19T11:16:54.377364+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:16:54.377364+0000","last_undegraded":"2024-09-19T11:16:54.377364+0000","last_fullsized":"2024-09-19T11:16:54.377364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.377134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:21.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.869812+0000","last_change":"2024-09-19T11:16:55.869737+0000","last_active":"2024-09-19T11:16:55.869812+0000","last_peered":"2024-09-19T11:16:55.869812+0000","last_clean":"2024-09-19T11:16:55.869812+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:16:55.869812+0000","last_undegraded":"2024-09-19T11:16:55.869812+0000","last_fullsized":"2024-09-19T11:16:55.869812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.869650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:29.264317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.277380+0000","last_change":"2024-09-19T11:17:42.277380+0000","last_active":"2024-09-19T11:17:42.277380+0000","last_peered":"2024-09-19T11:17:42.277380+0000","last_clean":"2024-09-19T11:17:42.277380+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:17:42.277380+0000","last_undegraded":"2024-09-19T11:17:42.277380+0000","last_fullsized":"2024-09-19T11:17:42.277380+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.277284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.277284+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.277284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:12.628751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'294","reported_seq":520,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.465318+0000","last_change":"2024-09-19T11:17:36.465237+0000","last_active":"2024-09-19T11:17:36.465318+0000","last_peered":"2024-09-19T11:17:36.465318+0000","last_clean":"2024-09-19T11:17:36.465318+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:17:36.465318+0000","last_undegraded":"2024-09-19T11:17:36.465318+0000","last_fullsized":"2024-09-19T11:17:36.465318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'294","last_scrub_stamp":"2024-09-19T11:17:36.465109+0000","last_deep_scrub":"37'294","last_deep_scrub_stamp":"2024-09-19T11:17:36.465109+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.465109+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:10.849592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:43.539440+0000","last_change":"2024-09-19T11:13:39.379958+0000","last_active":"2024-09-19T11:15:43.539440+0000","last_peered":"2024-09-19T11:15:43.539440+0000","last_clean":"2024-09-19T11:15:43.539440+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:15:43.539440+0000","last_undegraded":"2024-09-19T11:15:43.539440+0000","last_fullsized":"2024-09-19T11:15:43.539440+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.519864+0000","last_change":"2024-09-19T11:17:50.519864+0000","last_active":"2024-09-19T11:17:50.519864+0000","last_peered":"2024-09-19T11:17:50.519864+0000","last_clean":"2024-09-19T11:17:50.519864+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:17:50.519864+0000","last_undegraded":"2024-09-19T11:17:50.519864+0000","last_fullsized":"2024-09-19T11:17:50.519864+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:50.519733+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:50.519733+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.519733+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:14.985263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.718806+0000","last_change":"2024-09-19T11:17:09.718806+0000","last_active":"2024-09-19T11:17:09.718806+0000","last_peered":"2024-09-19T11:17:09.718806+0000","last_clean":"2024-09-19T11:17:09.718806+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:17:09.718806+0000","last_undegraded":"2024-09-19T11:17:09.718806+0000","last_fullsized":"2024-09-19T11:17:09.718806+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.718720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:37.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.199111+0000","last_change":"2024-09-19T11:17:00.199057+0000","last_active":"2024-09-19T11:17:00.199111+0000","last_peered":"2024-09-19T11:17:00.199111+0000","last_clean":"2024-09-19T11:17:00.199111+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:17:00.199111+0000","last_undegraded":"2024-09-19T11:17:00.199111+0000","last_fullsized":"2024-09-19T11:17:00.199111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.198970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:17.702619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.862627+0000","last_change":"2024-09-19T11:16:54.862568+0000","last_active":"2024-09-19T11:16:54.862627+0000","last_peered":"2024-09-19T11:16:54.862627+0000","last_clean":"2024-09-19T11:16:54.862627+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:16:54.862627+0000","last_undegraded":"2024-09-19T11:16:54.862627+0000","last_fullsized":"2024-09-19T11:16:54.862627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.862494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:12.037986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":40,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.196383+0000","last_change":"2024-09-19T11:17:21.196383+0000","last_active":"2024-09-19T11:17:21.196383+0000","last_peered":"2024-09-19T11:17:21.196383+0000","last_clean":"2024-09-19T11:17:21.196383+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:17:21.196383+0000","last_undegraded":"2024-09-19T11:17:21.196383+0000","last_fullsized":"2024-09-19T11:17:21.196383+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:21.196295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:21.196295+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.196295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:52.011445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'24","reported_seq":102,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.146611+0000","last_change":"2024-09-19T11:17:34.146548+0000","last_active":"2024-09-19T11:17:34.146611+0000","last_peered":"2024-09-19T11:17:34.146611+0000","last_clean":"2024-09-19T11:17:34.146611+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:17:34.146611+0000","last_undegraded":"2024-09-19T11:17:34.146611+0000","last_fullsized":"2024-09-19T11:17:34.146611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-19T11:17:34.146438+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-19T11:17:34.146438+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.146438+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:54.002853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.419254+0000","last_change":"2024-09-19T11:17:37.419197+0000","last_active":"2024-09-19T11:17:37.419254+0000","last_peered":"2024-09-19T11:17:37.419254+0000","last_clean":"2024-09-19T11:17:37.419254+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:17:37.419254+0000","last_undegraded":"2024-09-19T11:17:37.419254+0000","last_fullsized":"2024-09-19T11:17:37.419254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.419097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.419097+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.419097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:05.801332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":24,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.301235+0000","last_change":"2024-09-19T11:13:41.390159+0000","last_active":"2024-09-19T11:16:42.301235+0000","last_peered":"2024-09-19T11:16:42.301235+0000","last_clean":"2024-09-19T11:16:42.301235+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:16:42.301235+0000","last_undegraded":"2024-09-19T11:16:42.301235+0000","last_fullsized":"2024-09-19T11:16:42.301235+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:28:47.188979+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.741787+0000","last_change":"2024-09-19T11:17:08.741731+0000","last_active":"2024-09-19T11:17:08.741787+0000","last_peered":"2024-09-19T11:17:08.741787+0000","last_clean":"2024-09-19T11:17:08.741787+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:17:08.741787+0000","last_undegraded":"2024-09-19T11:17:08.741787+0000","last_fullsized":"2024-09-19T11:17:08.741787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.741641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:41.893880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.316760+0000","last_change":"2024-09-19T11:16:58.316669+0000","last_active":"2024-09-19T11:16:58.316760+0000","last_peered":"2024-09-19T11:16:58.316760+0000","last_clean":"2024-09-19T11:16:58.316760+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:16:58.316760+0000","last_undegraded":"2024-09-19T11:16:58.316760+0000","last_fullsized":"2024-09-19T11:16:58.316760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.316534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:33.887561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.307701+0000","last_change":"2024-09-19T11:16:55.307594+0000","last_active":"2024-09-19T11:16:55.307701+0000","last_peered":"2024-09-19T11:16:55.307701+0000","last_clean":"2024-09-19T11:16:55.307701+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:16:55.307701+0000","last_undegraded":"2024-09-19T11:16:55.307701+0000","last_fullsized":"2024-09-19T11:16:55.307701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.307489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:24.095008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'5","reported_seq":239,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.685173+0000","last_change":"2024-09-19T11:17:23.685079+0000","last_active":"2024-09-19T11:17:23.685173+0000","last_peered":"2024-09-19T11:17:23.685173+0000","last_clean":"2024-09-19T11:17:23.685173+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:17:23.685173+0000","last_undegraded":"2024-09-19T11:17:23.685173+0000","last_fullsized":"2024-09-19T11:17:23.685173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:23.684978+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:23.684978+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.684978+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:01.177727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'21","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.284720+0000","last_change":"2024-09-19T11:17:48.284720+0000","last_active":"2024-09-19T11:17:48.284720+0000","last_peered":"2024-09-19T11:17:48.284720+0000","last_clean":"2024-09-19T11:17:48.284720+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:17:48.284720+0000","last_undegraded":"2024-09-19T11:17:48.284720+0000","last_fullsized":"2024-09-19T11:17:48.284720+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:48.284599+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:48.284599+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.284599+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:20.976592+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.589764+0000","last_change":"2024-09-19T11:13:39.379563+0000","last_active":"2024-09-19T11:14:07.589764+0000","last_peered":"2024-09-19T11:14:07.589764+0000","last_clean":"2024-09-19T11:14:07.589764+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:14:07.589764+0000","last_undegraded":"2024-09-19T11:14:07.589764+0000","last_fullsized":"2024-09-19T11:14:07.589764+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:20.440540+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.560631+0000","last_change":"2024-09-19T11:17:49.560631+0000","last_active":"2024-09-19T11:17:49.560631+0000","last_peered":"2024-09-19T11:17:49.560631+0000","last_clean":"2024-09-19T11:17:49.560631+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:17:49.560631+0000","last_undegraded":"2024-09-19T11:17:49.560631+0000","last_fullsized":"2024-09-19T11:17:49.560631+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:49.560534+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:49.560534+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.560534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:54.966372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.597323+0000","last_change":"2024-09-19T11:17:08.597259+0000","last_active":"2024-09-19T11:17:08.597323+0000","last_peered":"2024-09-19T11:17:08.597323+0000","last_clean":"2024-09-19T11:17:08.597323+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:17:08.597323+0000","last_undegraded":"2024-09-19T11:17:08.597323+0000","last_fullsized":"2024-09-19T11:17:08.597323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.597174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:37.364781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.263977+0000","last_change":"2024-09-19T11:16:54.263916+0000","last_active":"2024-09-19T11:16:54.263977+0000","last_peered":"2024-09-19T11:16:54.263977+0000","last_clean":"2024-09-19T11:16:54.263977+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:16:54.263977+0000","last_undegraded":"2024-09-19T11:16:54.263977+0000","last_fullsized":"2024-09-19T11:16:54.263977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.263815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:48.536224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:52.839804+0000","last_change":"2024-09-19T11:16:52.839753+0000","last_active":"2024-09-19T11:16:52.839804+0000","last_peered":"2024-09-19T11:16:52.839804+0000","last_clean":"2024-09-19T11:16:52.839804+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:16:52.839804+0000","last_undegraded":"2024-09-19T11:16:52.839804+0000","last_fullsized":"2024-09-19T11:16:52.839804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_clean_scrub_stamp":"2024-09-19T11:16:52.839679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:51.504665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.721316+0000","last_change":"2024-09-19T11:17:22.721197+0000","last_active":"2024-09-19T11:17:22.721316+0000","last_peered":"2024-09-19T11:17:22.721316+0000","last_clean":"2024-09-19T11:17:22.721316+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:17:22.721316+0000","last_undegraded":"2024-09-19T11:17:22.721316+0000","last_fullsized":"2024-09-19T11:17:22.721316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:22.721097+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:22.721097+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.721097+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:23:27.112253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'78","reported_seq":155,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.586624+0000","last_change":"2024-09-19T11:17:29.586553+0000","last_active":"2024-09-19T11:17:29.586624+0000","last_peered":"2024-09-19T11:17:29.586624+0000","last_clean":"2024-09-19T11:17:29.586624+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:17:29.586624+0000","last_undegraded":"2024-09-19T11:17:29.586624+0000","last_fullsized":"2024-09-19T11:17:29.586624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'78","last_scrub_stamp":"2024-09-19T11:17:29.586456+0000","last_deep_scrub":"37'78","last_deep_scrub_stamp":"2024-09-19T11:17:29.586456+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.586456+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:17.660323+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.057424+0000","last_change":"2024-09-19T11:17:36.057336+0000","last_active":"2024-09-19T11:17:36.057424+0000","last_peered":"2024-09-19T11:17:36.057424+0000","last_clean":"2024-09-19T11:17:36.057424+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:17:36.057424+0000","last_undegraded":"2024-09-19T11:17:36.057424+0000","last_fullsized":"2024-09-19T11:17:36.057424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:36.057220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:36.057220+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.057220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:39.977022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.002199+0000","last_change":"2024-09-19T11:13:41.384779+0000","last_active":"2024-09-19T11:15:42.002199+0000","last_peered":"2024-09-19T11:15:42.002199+0000","last_clean":"2024-09-19T11:15:42.002199+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:15:42.002199+0000","last_undegraded":"2024-09-19T11:15:42.002199+0000","last_fullsized":"2024-09-19T11:15:42.002199+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:01.181785+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.725584+0000","last_change":"2024-09-19T11:17:05.725498+0000","last_active":"2024-09-19T11:17:05.725584+0000","last_peered":"2024-09-19T11:17:05.725584+0000","last_clean":"2024-09-19T11:17:05.725584+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:17:05.725584+0000","last_undegraded":"2024-09-19T11:17:05.725584+0000","last_fullsized":"2024-09-19T11:17:05.725584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.725349+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:53.167095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.823693+0000","last_change":"2024-09-19T11:16:56.823573+0000","last_active":"2024-09-19T11:16:56.823693+0000","last_peered":"2024-09-19T11:16:56.823693+0000","last_clean":"2024-09-19T11:16:56.823693+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:16:56.823693+0000","last_undegraded":"2024-09-19T11:16:56.823693+0000","last_fullsized":"2024-09-19T11:16:56.823693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.823458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:43.789933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.328867+0000","last_change":"2024-09-19T11:16:55.328783+0000","last_active":"2024-09-19T11:16:55.328867+0000","last_peered":"2024-09-19T11:16:55.328867+0000","last_clean":"2024-09-19T11:16:55.328867+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:16:55.328867+0000","last_undegraded":"2024-09-19T11:16:55.328867+0000","last_fullsized":"2024-09-19T11:16:55.328867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.328699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:16.068678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.321552+0000","last_change":"2024-09-19T11:17:41.321469+0000","last_active":"2024-09-19T11:17:41.321552+0000","last_peered":"2024-09-19T11:17:41.321552+0000","last_clean":"2024-09-19T11:17:41.321552+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:17:41.321552+0000","last_undegraded":"2024-09-19T11:17:41.321552+0000","last_fullsized":"2024-09-19T11:17:41.321552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:41.321345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:41.321345+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.321345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:41.516171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'21","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.472055+0000","last_change":"2024-09-19T11:17:35.471998+0000","last_active":"2024-09-19T11:17:35.472055+0000","last_peered":"2024-09-19T11:17:35.472055+0000","last_clean":"2024-09-19T11:17:35.472055+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:17:35.472055+0000","last_undegraded":"2024-09-19T11:17:35.472055+0000","last_fullsized":"2024-09-19T11:17:35.472055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:35.471898+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:35.471898+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.471898+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:30.288806+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":383,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.502319+0000","last_change":"2024-09-19T11:17:41.502319+0000","last_active":"2024-09-19T11:17:41.502319+0000","last_peered":"2024-09-19T11:17:41.502319+0000","last_clean":"2024-09-19T11:17:41.502319+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:17:41.502319+0000","last_undegraded":"2024-09-19T11:17:41.502319+0000","last_fullsized":"2024-09-19T11:17:41.502319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.502183+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.502183+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.502183+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:48.866065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:42.649914+0000","last_change":"2024-09-19T11:13:41.391610+0000","last_active":"2024-09-19T11:16:42.649914+0000","last_peered":"2024-09-19T11:16:42.649914+0000","last_clean":"2024-09-19T11:16:42.649914+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:16:42.649914+0000","last_undegraded":"2024-09-19T11:16:42.649914+0000","last_fullsized":"2024-09-19T11:16:42.649914+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:32.303997+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.233251+0000","last_change":"2024-09-19T11:17:08.233251+0000","last_active":"2024-09-19T11:17:08.233251+0000","last_peered":"2024-09-19T11:17:08.233251+0000","last_clean":"2024-09-19T11:17:08.233251+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:17:08.233251+0000","last_undegraded":"2024-09-19T11:17:08.233251+0000","last_fullsized":"2024-09-19T11:17:08.233251+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.233135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.372143+0000","last_change":"2024-09-19T11:17:00.372051+0000","last_active":"2024-09-19T11:17:00.372143+0000","last_peered":"2024-09-19T11:17:00.372143+0000","last_clean":"2024-09-19T11:17:00.372143+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:17:00.372143+0000","last_undegraded":"2024-09-19T11:17:00.372143+0000","last_fullsized":"2024-09-19T11:17:00.372143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.371942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:44.482502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.828197+0000","last_change":"2024-09-19T11:16:53.828131+0000","last_active":"2024-09-19T11:16:53.828197+0000","last_peered":"2024-09-19T11:16:53.828197+0000","last_clean":"2024-09-19T11:16:53.828197+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:16:53.828197+0000","last_undegraded":"2024-09-19T11:16:53.828197+0000","last_fullsized":"2024-09-19T11:16:53.828197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.828060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:16.144293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.274921+0000","last_change":"2024-09-19T11:17:40.274866+0000","last_active":"2024-09-19T11:17:40.274921+0000","last_peered":"2024-09-19T11:17:40.274921+0000","last_clean":"2024-09-19T11:17:40.274921+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:17:40.274921+0000","last_undegraded":"2024-09-19T11:17:40.274921+0000","last_fullsized":"2024-09-19T11:17:40.274921+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.274775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.274775+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.274775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:48.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.240723+0000","last_change":"2024-09-19T11:17:49.240723+0000","last_active":"2024-09-19T11:17:49.240723+0000","last_peered":"2024-09-19T11:17:49.240723+0000","last_clean":"2024-09-19T11:17:49.240723+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:17:49.240723+0000","last_undegraded":"2024-09-19T11:17:49.240723+0000","last_fullsized":"2024-09-19T11:17:49.240723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:17:49.240613+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:17:49.240613+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.240613+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:06.458052+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":413,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.347291+0000","last_change":"2024-09-19T11:17:44.347233+0000","last_active":"2024-09-19T11:17:44.347291+0000","last_peered":"2024-09-19T11:17:44.347291+0000","last_clean":"2024-09-19T11:17:44.347291+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:17:44.347291+0000","last_undegraded":"2024-09-19T11:17:44.347291+0000","last_fullsized":"2024-09-19T11:17:44.347291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:44.347136+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:44.347136+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.347136+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:47.855799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:52.525564+0000","last_change":"2024-09-19T11:17:52.525564+0000","last_active":"2024-09-19T11:17:52.525564+0000","last_peered":"2024-09-19T11:17:52.525564+0000","last_clean":"2024-09-19T11:17:52.525564+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:17:52.525564+0000","last_undegraded":"2024-09-19T11:17:52.525564+0000","last_fullsized":"2024-09-19T11:17:52.525564+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:52.525465+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:52.525465+0000","last_clean_scrub_stamp":"2024-09-19T11:17:52.525465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:27.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.157088+0000","last_change":"2024-09-19T11:17:10.156983+0000","last_active":"2024-09-19T11:17:10.157088+0000","last_peered":"2024-09-19T11:17:10.157088+0000","last_clean":"2024-09-19T11:17:10.157088+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:17:10.157088+0000","last_undegraded":"2024-09-19T11:17:10.157088+0000","last_fullsized":"2024-09-19T11:17:10.157088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.156870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:27.088137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.792138+0000","last_change":"2024-09-19T11:16:54.792079+0000","last_active":"2024-09-19T11:16:54.792138+0000","last_peered":"2024-09-19T11:16:54.792138+0000","last_clean":"2024-09-19T11:16:54.792138+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:16:54.792138+0000","last_undegraded":"2024-09-19T11:16:54.792138+0000","last_fullsized":"2024-09-19T11:16:54.792138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.791976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:48.520529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.281155+0000","last_change":"2024-09-19T11:16:56.281102+0000","last_active":"2024-09-19T11:16:56.281155+0000","last_peered":"2024-09-19T11:16:56.281155+0000","last_clean":"2024-09-19T11:16:56.281155+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:16:56.281155+0000","last_undegraded":"2024-09-19T11:16:56.281155+0000","last_fullsized":"2024-09-19T11:16:56.281155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.281013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:47.506937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.147846+0000","last_change":"2024-09-19T11:17:37.147783+0000","last_active":"2024-09-19T11:17:37.147846+0000","last_peered":"2024-09-19T11:17:37.147846+0000","last_clean":"2024-09-19T11:17:37.147846+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:17:37.147846+0000","last_undegraded":"2024-09-19T11:17:37.147846+0000","last_fullsized":"2024-09-19T11:17:37.147846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.147688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.147688+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.147688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:12.774176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'99","reported_seq":193,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.209043+0000","last_change":"2024-09-19T11:17:28.208941+0000","last_active":"2024-09-19T11:17:28.209043+0000","last_peered":"2024-09-19T11:17:28.209043+0000","last_clean":"2024-09-19T11:17:28.209043+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:17:28.209043+0000","last_undegraded":"2024-09-19T11:17:28.209043+0000","last_fullsized":"2024-09-19T11:17:28.209043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'99","last_scrub_stamp":"2024-09-19T11:17:28.208805+0000","last_deep_scrub":"37'99","last_deep_scrub_stamp":"2024-09-19T11:17:28.208805+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.208805+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:39.102011+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.458979+0000","last_change":"2024-09-19T11:17:36.458909+0000","last_active":"2024-09-19T11:17:36.458979+0000","last_peered":"2024-09-19T11:17:36.458979+0000","last_clean":"2024-09-19T11:17:36.458979+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:17:36.458979+0000","last_undegraded":"2024-09-19T11:17:36.458979+0000","last_fullsized":"2024-09-19T11:17:36.458979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:36.458805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:36.458805+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.458805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:16.243718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.989960+0000","last_change":"2024-09-19T11:17:45.989960+0000","last_active":"2024-09-19T11:17:45.989960+0000","last_peered":"2024-09-19T11:17:45.989960+0000","last_clean":"2024-09-19T11:17:45.989960+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:17:45.989960+0000","last_undegraded":"2024-09-19T11:17:45.989960+0000","last_fullsized":"2024-09-19T11:17:45.989960+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:45.989883+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:45.989883+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.989883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:19.232601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.015387+0000","last_change":"2024-09-19T11:17:48.015330+0000","last_active":"2024-09-19T11:17:48.015387+0000","last_peered":"2024-09-19T11:17:48.015387+0000","last_clean":"2024-09-19T11:17:48.015387+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:17:48.015387+0000","last_undegraded":"2024-09-19T11:17:48.015387+0000","last_fullsized":"2024-09-19T11:17:48.015387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:48.015242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:48.015242+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.015242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:12.717185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.153164+0000","last_change":"2024-09-19T11:17:14.153164+0000","last_active":"2024-09-19T11:17:14.153164+0000","last_peered":"2024-09-19T11:17:14.153164+0000","last_clean":"2024-09-19T11:17:14.153164+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:17:14.153164+0000","last_undegraded":"2024-09-19T11:17:14.153164+0000","last_fullsized":"2024-09-19T11:17:14.153164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.153066+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.153066+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.153066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:52.353655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.379535+0000","last_change":"2024-09-19T11:17:07.379535+0000","last_active":"2024-09-19T11:17:07.379535+0000","last_peered":"2024-09-19T11:17:07.379535+0000","last_clean":"2024-09-19T11:17:07.379535+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:17:07.379535+0000","last_undegraded":"2024-09-19T11:17:07.379535+0000","last_fullsized":"2024-09-19T11:17:07.379535+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.379424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:42.734681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.407910+0000","last_change":"2024-09-19T11:17:30.407910+0000","last_active":"2024-09-19T11:17:30.407910+0000","last_peered":"2024-09-19T11:17:30.407910+0000","last_clean":"2024-09-19T11:17:30.407910+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:17:30.407910+0000","last_undegraded":"2024-09-19T11:17:30.407910+0000","last_fullsized":"2024-09-19T11:17:30.407910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.407786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.407786+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.407786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:57.738466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'36","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.819925+0000","last_change":"2024-09-19T11:13:37.369688+0000","last_active":"2024-09-19T11:16:49.819925+0000","last_peered":"2024-09-19T11:16:49.819925+0000","last_clean":"2024-09-19T11:16:49.819925+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:16:49.819925+0000","last_undegraded":"2024-09-19T11:16:49.819925+0000","last_fullsized":"2024-09-19T11:16:49.819925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:17:22.810135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585707+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.585707+0000","last_peered":"2024-09-19T11:14:07.585707+0000","last_clean":"2024-09-19T11:14:07.585707+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:14:07.585707+0000","last_undegraded":"2024-09-19T11:14:07.585707+0000","last_fullsized":"2024-09-19T11:14:07.585707+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:49:32.078155+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.538001+0000","last_change":"2024-09-19T11:13:41.388648+0000","last_active":"2024-09-19T11:15:40.538001+0000","last_peered":"2024-09-19T11:15:40.538001+0000","last_clean":"2024-09-19T11:15:40.538001+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:15:40.538001+0000","last_undegraded":"2024-09-19T11:15:40.538001+0000","last_fullsized":"2024-09-19T11:15:40.538001+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.581118+0000","last_change":"2024-09-19T11:17:12.581118+0000","last_active":"2024-09-19T11:17:12.581118+0000","last_peered":"2024-09-19T11:17:12.581118+0000","last_clean":"2024-09-19T11:17:12.581118+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:17:12.581118+0000","last_undegraded":"2024-09-19T11:17:12.581118+0000","last_fullsized":"2024-09-19T11:17:12.581118+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.581034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:57.494890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.268509+0000","last_change":"2024-09-19T11:16:58.268509+0000","last_active":"2024-09-19T11:16:58.268509+0000","last_peered":"2024-09-19T11:16:58.268509+0000","last_clean":"2024-09-19T11:16:58.268509+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:58.268509+0000","last_undegraded":"2024-09-19T11:16:58.268509+0000","last_fullsized":"2024-09-19T11:16:58.268509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.268398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:22.542212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.277952+0000","last_change":"2024-09-19T11:17:45.277952+0000","last_active":"2024-09-19T11:17:45.277952+0000","last_peered":"2024-09-19T11:17:45.277952+0000","last_clean":"2024-09-19T11:17:45.277952+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:17:45.277952+0000","last_undegraded":"2024-09-19T11:17:45.277952+0000","last_fullsized":"2024-09-19T11:17:45.277952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:45.277802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:45.277802+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.277802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:50.986720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'9","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.538677+0000","last_change":"2024-09-19T11:17:31.538677+0000","last_active":"2024-09-19T11:17:31.538677+0000","last_peered":"2024-09-19T11:17:31.538677+0000","last_clean":"2024-09-19T11:17:31.538677+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:17:31.538677+0000","last_undegraded":"2024-09-19T11:17:31.538677+0000","last_fullsized":"2024-09-19T11:17:31.538677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:31.538593+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:31.538593+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.538593+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:28.785147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.014183+0000","last_change":"2024-09-19T11:17:39.014183+0000","last_active":"2024-09-19T11:17:39.014183+0000","last_peered":"2024-09-19T11:17:39.014183+0000","last_clean":"2024-09-19T11:17:39.014183+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:17:39.014183+0000","last_undegraded":"2024-09-19T11:17:39.014183+0000","last_fullsized":"2024-09-19T11:17:39.014183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:39.014095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:39.014095+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.014095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:38.689899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.587758+0000","last_change":"2024-09-19T11:13:41.381057+0000","last_active":"2024-09-19T11:14:07.587758+0000","last_peered":"2024-09-19T11:14:07.587758+0000","last_clean":"2024-09-19T11:14:07.587758+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:14:07.587758+0000","last_undegraded":"2024-09-19T11:14:07.587758+0000","last_fullsized":"2024-09-19T11:14:07.587758+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:11.638963+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.725166+0000","last_change":"2024-09-19T11:17:10.725166+0000","last_active":"2024-09-19T11:17:10.725166+0000","last_peered":"2024-09-19T11:17:10.725166+0000","last_clean":"2024-09-19T11:17:10.725166+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:17:10.725166+0000","last_undegraded":"2024-09-19T11:17:10.725166+0000","last_fullsized":"2024-09-19T11:17:10.725166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'28","last_scrub_stamp":"2024-09-19T11:17:10.725079+0000","last_deep_scrub":"37'28","last_deep_scrub_stamp":"2024-09-19T11:17:10.725079+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.725079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.826693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.156246+0000","last_change":"2024-09-19T11:17:01.156246+0000","last_active":"2024-09-19T11:17:01.156246+0000","last_peered":"2024-09-19T11:17:01.156246+0000","last_clean":"2024-09-19T11:17:01.156246+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:17:01.156246+0000","last_undegraded":"2024-09-19T11:17:01.156246+0000","last_fullsized":"2024-09-19T11:17:01.156246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.156158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:03.371804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.188298+0000","last_change":"2024-09-19T11:17:22.188298+0000","last_active":"2024-09-19T11:17:22.188298+0000","last_peered":"2024-09-19T11:17:22.188298+0000","last_clean":"2024-09-19T11:17:22.188298+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:17:22.188298+0000","last_undegraded":"2024-09-19T11:17:22.188298+0000","last_fullsized":"2024-09-19T11:17:22.188298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:22.188209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:22.188209+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.188209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:11.101131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'53","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.565820+0000","last_change":"2024-09-19T11:17:32.565820+0000","last_active":"2024-09-19T11:17:32.565820+0000","last_peered":"2024-09-19T11:17:32.565820+0000","last_clean":"2024-09-19T11:17:32.565820+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:17:32.565820+0000","last_undegraded":"2024-09-19T11:17:32.565820+0000","last_fullsized":"2024-09-19T11:17:32.565820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'53","last_scrub_stamp":"2024-09-19T11:17:32.565716+0000","last_deep_scrub":"37'53","last_deep_scrub_stamp":"2024-09-19T11:17:32.565716+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.565716+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:51.087241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.468303+0000","last_change":"2024-09-19T11:17:43.468303+0000","last_active":"2024-09-19T11:17:43.468303+0000","last_peered":"2024-09-19T11:17:43.468303+0000","last_clean":"2024-09-19T11:17:43.468303+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:17:43.468303+0000","last_undegraded":"2024-09-19T11:17:43.468303+0000","last_fullsized":"2024-09-19T11:17:43.468303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:43.468222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:43.468222+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.468222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:19.039248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585207+0000","last_change":"2024-09-19T11:13:41.390580+0000","last_active":"2024-09-19T11:14:07.585207+0000","last_peered":"2024-09-19T11:14:07.585207+0000","last_clean":"2024-09-19T11:14:07.585207+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:14:07.585207+0000","last_undegraded":"2024-09-19T11:14:07.585207+0000","last_fullsized":"2024-09-19T11:14:07.585207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:00.635835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.363346+0000","last_change":"2024-09-19T11:17:25.363346+0000","last_active":"2024-09-19T11:17:25.363346+0000","last_peered":"2024-09-19T11:17:25.363346+0000","last_clean":"2024-09-19T11:17:25.363346+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:17:25.363346+0000","last_undegraded":"2024-09-19T11:17:25.363346+0000","last_fullsized":"2024-09-19T11:17:25.363346+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:25.363259+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:25.363259+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.363259+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:06.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.807882+0000","last_change":"2024-09-19T11:16:56.807882+0000","last_active":"2024-09-19T11:16:56.807882+0000","last_peered":"2024-09-19T11:16:56.807882+0000","last_clean":"2024-09-19T11:16:56.807882+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:16:56.807882+0000","last_undegraded":"2024-09-19T11:16:56.807882+0000","last_fullsized":"2024-09-19T11:16:56.807882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.807762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:02.356623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.230807+0000","last_change":"2024-09-19T11:17:44.230807+0000","last_active":"2024-09-19T11:17:44.230807+0000","last_peered":"2024-09-19T11:17:44.230807+0000","last_clean":"2024-09-19T11:17:44.230807+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:17:44.230807+0000","last_undegraded":"2024-09-19T11:17:44.230807+0000","last_fullsized":"2024-09-19T11:17:44.230807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:44.230727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:44.230727+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.230727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:41.189606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.160418+0000","last_change":"2024-09-19T11:17:33.160418+0000","last_active":"2024-09-19T11:17:33.160418+0000","last_peered":"2024-09-19T11:17:33.160418+0000","last_clean":"2024-09-19T11:17:33.160418+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:17:33.160418+0000","last_undegraded":"2024-09-19T11:17:33.160418+0000","last_fullsized":"2024-09-19T11:17:33.160418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:33.160294+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:33.160294+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.160294+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:02.908387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.045394+0000","last_change":"2024-09-19T11:17:40.045394+0000","last_active":"2024-09-19T11:17:40.045394+0000","last_peered":"2024-09-19T11:17:40.045394+0000","last_clean":"2024-09-19T11:17:40.045394+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:17:40.045394+0000","last_undegraded":"2024-09-19T11:17:40.045394+0000","last_fullsized":"2024-09-19T11:17:40.045394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.045302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.045302+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.045302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:49.341485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.176645+0000","last_change":"2024-09-19T11:17:31.176586+0000","last_active":"2024-09-19T11:17:31.176645+0000","last_peered":"2024-09-19T11:17:31.176645+0000","last_clean":"2024-09-19T11:17:31.176645+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:17:31.176645+0000","last_undegraded":"2024-09-19T11:17:31.176645+0000","last_fullsized":"2024-09-19T11:17:31.176645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:31.176498+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:31.176498+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.176498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:33.234114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.296208+0000","last_change":"2024-09-19T11:17:09.296208+0000","last_active":"2024-09-19T11:17:09.296208+0000","last_peered":"2024-09-19T11:17:09.296208+0000","last_clean":"2024-09-19T11:17:09.296208+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:17:09.296208+0000","last_undegraded":"2024-09-19T11:17:09.296208+0000","last_fullsized":"2024-09-19T11:17:09.296208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.296106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:23.893467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.586130+0000","last_change":"2024-09-19T11:17:28.586019+0000","last_active":"2024-09-19T11:17:28.586130+0000","last_peered":"2024-09-19T11:17:28.586130+0000","last_clean":"2024-09-19T11:17:28.586130+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:17:28.586130+0000","last_undegraded":"2024-09-19T11:17:28.586130+0000","last_fullsized":"2024-09-19T11:17:28.586130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:28.585927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:28.585927+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.585927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:09.150774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'68","reported_seq":141,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.522177+0000","last_change":"2024-09-19T11:17:33.522177+0000","last_active":"2024-09-19T11:17:33.522177+0000","last_peered":"2024-09-19T11:17:33.522177+0000","last_clean":"2024-09-19T11:17:33.522177+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:17:33.522177+0000","last_undegraded":"2024-09-19T11:17:33.522177+0000","last_fullsized":"2024-09-19T11:17:33.522177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'68","last_scrub_stamp":"2024-09-19T11:17:33.522086+0000","last_deep_scrub":"37'68","last_deep_scrub_stamp":"2024-09-19T11:17:33.522086+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.522086+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.769122+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.020270+0000","last_change":"2024-09-19T11:17:42.020270+0000","last_active":"2024-09-19T11:17:42.020270+0000","last_peered":"2024-09-19T11:17:42.020270+0000","last_clean":"2024-09-19T11:17:42.020270+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:17:42.020270+0000","last_undegraded":"2024-09-19T11:17:42.020270+0000","last_fullsized":"2024-09-19T11:17:42.020270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.020162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.020162+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.020162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:17.802952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:41.998936+0000","last_change":"2024-09-19T11:13:41.387630+0000","last_active":"2024-09-19T11:15:41.998936+0000","last_peered":"2024-09-19T11:15:41.998936+0000","last_clean":"2024-09-19T11:15:41.998936+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:15:41.998936+0000","last_undegraded":"2024-09-19T11:15:41.998936+0000","last_fullsized":"2024-09-19T11:15:41.998936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:27.480898+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.721545+0000","last_change":"2024-09-19T11:17:13.721487+0000","last_active":"2024-09-19T11:17:13.721545+0000","last_peered":"2024-09-19T11:17:13.721545+0000","last_clean":"2024-09-19T11:17:13.721545+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:17:13.721545+0000","last_undegraded":"2024-09-19T11:17:13.721545+0000","last_fullsized":"2024-09-19T11:17:13.721545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:13.721403+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:13.721403+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.721403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:48.967350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.838965+0000","last_change":"2024-09-19T11:16:57.838965+0000","last_active":"2024-09-19T11:16:57.838965+0000","last_peered":"2024-09-19T11:16:57.838965+0000","last_clean":"2024-09-19T11:16:57.838965+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:16:57.838965+0000","last_undegraded":"2024-09-19T11:16:57.838965+0000","last_fullsized":"2024-09-19T11:16:57.838965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.838852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:23.656467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.187957+0000","last_change":"2024-09-19T11:17:27.187901+0000","last_active":"2024-09-19T11:17:27.187957+0000","last_peered":"2024-09-19T11:17:27.187957+0000","last_clean":"2024-09-19T11:17:27.187957+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:17:27.187957+0000","last_undegraded":"2024-09-19T11:17:27.187957+0000","last_fullsized":"2024-09-19T11:17:27.187957+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.187800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.187800+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.187800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:39.803035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'39","reported_seq":89,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.763368+0000","last_change":"2024-09-19T11:13:37.368372+0000","last_active":"2024-09-19T11:16:49.763368+0000","last_peered":"2024-09-19T11:16:49.763368+0000","last_clean":"2024-09-19T11:16:49.763368+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:16:49.763368+0000","last_undegraded":"2024-09-19T11:16:49.763368+0000","last_fullsized":"2024-09-19T11:16:49.763368+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":39,"log_dups_size":0,"ondisk_log_size":39,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:18:42.470532+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.538807+0000","last_change":"2024-09-19T11:17:46.538807+0000","last_active":"2024-09-19T11:17:46.538807+0000","last_peered":"2024-09-19T11:17:46.538807+0000","last_clean":"2024-09-19T11:17:46.538807+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:17:46.538807+0000","last_undegraded":"2024-09-19T11:17:46.538807+0000","last_fullsized":"2024-09-19T11:17:46.538807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.538721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.538721+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.538721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:25.235263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584320+0000","last_change":"2024-09-19T11:13:41.395172+0000","last_active":"2024-09-19T11:14:07.584320+0000","last_peered":"2024-09-19T11:14:07.584320+0000","last_clean":"2024-09-19T11:14:07.584320+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:14:07.584320+0000","last_undegraded":"2024-09-19T11:14:07.584320+0000","last_fullsized":"2024-09-19T11:14:07.584320+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:17:31.640115+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.175615+0000","last_change":"2024-09-19T11:17:30.175615+0000","last_active":"2024-09-19T11:17:30.175615+0000","last_peered":"2024-09-19T11:17:30.175615+0000","last_clean":"2024-09-19T11:17:30.175615+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:17:30.175615+0000","last_undegraded":"2024-09-19T11:17:30.175615+0000","last_fullsized":"2024-09-19T11:17:30.175615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:30.175521+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:30.175521+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.175521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:13.579750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.764477+0000","last_change":"2024-09-19T11:17:00.764477+0000","last_active":"2024-09-19T11:17:00.764477+0000","last_peered":"2024-09-19T11:17:00.764477+0000","last_clean":"2024-09-19T11:17:00.764477+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:00.764477+0000","last_undegraded":"2024-09-19T11:17:00.764477+0000","last_fullsized":"2024-09-19T11:17:00.764477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.764391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:38.964980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.195577+0000","last_change":"2024-09-19T11:17:26.195577+0000","last_active":"2024-09-19T11:17:26.195577+0000","last_peered":"2024-09-19T11:17:26.195577+0000","last_clean":"2024-09-19T11:17:26.195577+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:17:26.195577+0000","last_undegraded":"2024-09-19T11:17:26.195577+0000","last_fullsized":"2024-09-19T11:17:26.195577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:26.195490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:26.195490+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.195490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:53.553614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.462354+0000","last_change":"2024-09-19T11:17:35.462297+0000","last_active":"2024-09-19T11:17:35.462354+0000","last_peered":"2024-09-19T11:17:35.462354+0000","last_clean":"2024-09-19T11:17:35.462354+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:17:35.462354+0000","last_undegraded":"2024-09-19T11:17:35.462354+0000","last_fullsized":"2024-09-19T11:17:35.462354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-19T11:17:35.462227+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-19T11:17:35.462227+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.462227+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:37.754391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.381425+0000","last_change":"2024-09-19T11:17:46.381425+0000","last_active":"2024-09-19T11:17:46.381425+0000","last_peered":"2024-09-19T11:17:46.381425+0000","last_clean":"2024-09-19T11:17:46.381425+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:17:46.381425+0000","last_undegraded":"2024-09-19T11:17:46.381425+0000","last_fullsized":"2024-09-19T11:17:46.381425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.381325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.381325+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.381325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:01.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.092425+0000","last_change":"2024-09-19T11:13:41.392005+0000","last_active":"2024-09-19T11:15:42.092425+0000","last_peered":"2024-09-19T11:15:42.092425+0000","last_clean":"2024-09-19T11:15:42.092425+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:15:42.092425+0000","last_undegraded":"2024-09-19T11:15:42.092425+0000","last_fullsized":"2024-09-19T11:15:42.092425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:49.976836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.746563+0000","last_change":"2024-09-19T11:17:12.746563+0000","last_active":"2024-09-19T11:17:12.746563+0000","last_peered":"2024-09-19T11:17:12.746563+0000","last_clean":"2024-09-19T11:17:12.746563+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:17:12.746563+0000","last_undegraded":"2024-09-19T11:17:12.746563+0000","last_fullsized":"2024-09-19T11:17:12.746563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:12.746480+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:12.746480+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.746480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:26.217232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.268148+0000","last_change":"2024-09-19T11:17:10.268148+0000","last_active":"2024-09-19T11:17:10.268148+0000","last_peered":"2024-09-19T11:17:10.268148+0000","last_clean":"2024-09-19T11:17:10.268148+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:17:10.268148+0000","last_undegraded":"2024-09-19T11:17:10.268148+0000","last_fullsized":"2024-09-19T11:17:10.268148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.268062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:30.958036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.398503+0000","last_change":"2024-09-19T11:17:33.398503+0000","last_active":"2024-09-19T11:17:33.398503+0000","last_peered":"2024-09-19T11:17:33.398503+0000","last_clean":"2024-09-19T11:17:33.398503+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:17:33.398503+0000","last_undegraded":"2024-09-19T11:17:33.398503+0000","last_fullsized":"2024-09-19T11:17:33.398503+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:33.398408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:33.398408+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.398408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:14.649067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"35'10","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:38.538733+0000","last_change":"2024-09-19T11:13:37.371652+0000","last_active":"2024-09-19T11:15:38.538733+0000","last_peered":"2024-09-19T11:15:38.538733+0000","last_clean":"2024-09-19T11:15:38.538733+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:15:38.538733+0000","last_undegraded":"2024-09-19T11:15:38.538733+0000","last_fullsized":"2024-09-19T11:15:38.538733+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"queued for deep scrub","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":380,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.066585+0000","last_change":"2024-09-19T11:17:41.066531+0000","last_active":"2024-09-19T11:17:41.066585+0000","last_peered":"2024-09-19T11:17:41.066585+0000","last_clean":"2024-09-19T11:17:41.066585+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:17:41.066585+0000","last_undegraded":"2024-09-19T11:17:41.066585+0000","last_fullsized":"2024-09-19T11:17:41.066585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.066452+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.066452+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.066452+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:20.943729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.583768+0000","last_change":"2024-09-19T11:13:41.390206+0000","last_active":"2024-09-19T11:14:07.583768+0000","last_peered":"2024-09-19T11:14:07.583768+0000","last_clean":"2024-09-19T11:14:07.583768+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:14:07.583768+0000","last_undegraded":"2024-09-19T11:14:07.583768+0000","last_fullsized":"2024-09-19T11:14:07.583768+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:05:11.171587+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.171870+0000","last_change":"2024-09-19T11:17:17.171870+0000","last_active":"2024-09-19T11:17:17.171870+0000","last_peered":"2024-09-19T11:17:17.171870+0000","last_clean":"2024-09-19T11:17:17.171870+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:17:17.171870+0000","last_undegraded":"2024-09-19T11:17:17.171870+0000","last_fullsized":"2024-09-19T11:17:17.171870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:17.171787+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:17.171787+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.171787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:10.154837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.807595+0000","last_change":"2024-09-19T11:16:59.807595+0000","last_active":"2024-09-19T11:16:59.807595+0000","last_peered":"2024-09-19T11:16:59.807595+0000","last_clean":"2024-09-19T11:16:59.807595+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:16:59.807595+0000","last_undegraded":"2024-09-19T11:16:59.807595+0000","last_fullsized":"2024-09-19T11:16:59.807595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.807508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:27.508908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.437875+0000","last_change":"2024-09-19T11:17:34.437875+0000","last_active":"2024-09-19T11:17:34.437875+0000","last_peered":"2024-09-19T11:17:34.437875+0000","last_clean":"2024-09-19T11:17:34.437875+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:17:34.437875+0000","last_undegraded":"2024-09-19T11:17:34.437875+0000","last_fullsized":"2024-09-19T11:17:34.437875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:34.437786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:34.437786+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.437786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:35.544859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.478113+0000","last_change":"2024-09-19T11:17:42.478113+0000","last_active":"2024-09-19T11:17:42.478113+0000","last_peered":"2024-09-19T11:17:42.478113+0000","last_clean":"2024-09-19T11:17:42.478113+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:17:42.478113+0000","last_undegraded":"2024-09-19T11:17:42.478113+0000","last_fullsized":"2024-09-19T11:17:42.478113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:42.478011+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:42.478011+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.478011+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:42.594047+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.424937+0000","last_change":"2024-09-19T11:17:42.424937+0000","last_active":"2024-09-19T11:17:42.424937+0000","last_peered":"2024-09-19T11:17:42.424937+0000","last_clean":"2024-09-19T11:17:42.424937+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:17:42.424937+0000","last_undegraded":"2024-09-19T11:17:42.424937+0000","last_fullsized":"2024-09-19T11:17:42.424937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.424842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.424842+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.424842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:20.215639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:51.509936+0000","last_change":"2024-09-19T11:17:51.509936+0000","last_active":"2024-09-19T11:17:51.509936+0000","last_peered":"2024-09-19T11:17:51.509936+0000","last_clean":"2024-09-19T11:17:51.509936+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:17:51.509936+0000","last_undegraded":"2024-09-19T11:17:51.509936+0000","last_fullsized":"2024-09-19T11:17:51.509936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:51.509852+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:51.509852+0000","last_clean_scrub_stamp":"2024-09-19T11:17:51.509852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:49.516841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.121964+0000","last_change":"2024-09-19T11:17:16.121964+0000","last_active":"2024-09-19T11:17:16.121964+0000","last_peered":"2024-09-19T11:17:16.121964+0000","last_clean":"2024-09-19T11:17:16.121964+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:17:16.121964+0000","last_undegraded":"2024-09-19T11:17:16.121964+0000","last_fullsized":"2024-09-19T11:17:16.121964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:16.121888+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:16.121888+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.121888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:08.494191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.243754+0000","last_change":"2024-09-19T11:17:11.243754+0000","last_active":"2024-09-19T11:17:11.243754+0000","last_peered":"2024-09-19T11:17:11.243754+0000","last_clean":"2024-09-19T11:17:11.243754+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:17:11.243754+0000","last_undegraded":"2024-09-19T11:17:11.243754+0000","last_fullsized":"2024-09-19T11:17:11.243754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.243640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.224247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.146894+0000","last_change":"2024-09-19T11:17:25.146894+0000","last_active":"2024-09-19T11:17:25.146894+0000","last_peered":"2024-09-19T11:17:25.146894+0000","last_clean":"2024-09-19T11:17:25.146894+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:17:25.146894+0000","last_undegraded":"2024-09-19T11:17:25.146894+0000","last_fullsized":"2024-09-19T11:17:25.146894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:25.146791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:25.146791+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.146791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:14.070250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.486467+0000","last_change":"2024-09-19T11:17:34.486467+0000","last_active":"2024-09-19T11:17:34.486467+0000","last_peered":"2024-09-19T11:17:34.486467+0000","last_clean":"2024-09-19T11:17:34.486467+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:17:34.486467+0000","last_undegraded":"2024-09-19T11:17:34.486467+0000","last_fullsized":"2024-09-19T11:17:34.486467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:34.486360+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:34.486360+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.486360+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:46.730904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584006+0000","last_change":"2024-09-19T11:13:39.376357+0000","last_active":"2024-09-19T11:14:07.584006+0000","last_peered":"2024-09-19T11:14:07.584006+0000","last_clean":"2024-09-19T11:14:07.584006+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:14:07.584006+0000","last_undegraded":"2024-09-19T11:14:07.584006+0000","last_fullsized":"2024-09-19T11:14:07.584006+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:07:21.909755+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586387+0000","last_change":"2024-09-19T11:13:41.394164+0000","last_active":"2024-09-19T11:14:07.586387+0000","last_peered":"2024-09-19T11:14:07.586387+0000","last_clean":"2024-09-19T11:14:07.586387+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:14:07.586387+0000","last_undegraded":"2024-09-19T11:14:07.586387+0000","last_fullsized":"2024-09-19T11:14:07.586387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.249643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.164729+0000","last_change":"2024-09-19T11:17:32.164729+0000","last_active":"2024-09-19T11:17:32.164729+0000","last_peered":"2024-09-19T11:17:32.164729+0000","last_clean":"2024-09-19T11:17:32.164729+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:17:32.164729+0000","last_undegraded":"2024-09-19T11:17:32.164729+0000","last_fullsized":"2024-09-19T11:17:32.164729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:32.164637+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:32.164637+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.164637+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:28.206282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.736085+0000","last_change":"2024-09-19T11:16:58.736025+0000","last_active":"2024-09-19T11:16:58.736085+0000","last_peered":"2024-09-19T11:16:58.736085+0000","last_clean":"2024-09-19T11:16:58.736085+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:16:58.736085+0000","last_undegraded":"2024-09-19T11:16:58.736085+0000","last_fullsized":"2024-09-19T11:16:58.736085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.735931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:08.584806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.437955+0000","last_change":"2024-09-19T11:17:31.437955+0000","last_active":"2024-09-19T11:17:31.437955+0000","last_peered":"2024-09-19T11:17:31.437955+0000","last_clean":"2024-09-19T11:17:31.437955+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:17:31.437955+0000","last_undegraded":"2024-09-19T11:17:31.437955+0000","last_fullsized":"2024-09-19T11:17:31.437955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:31.437866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:31.437866+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.437866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.484126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'29","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.827236+0000","last_change":"2024-09-19T11:13:37.368500+0000","last_active":"2024-09-19T11:16:49.827236+0000","last_peered":"2024-09-19T11:16:49.827236+0000","last_clean":"2024-09-19T11:16:49.827236+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:16:49.827236+0000","last_undegraded":"2024-09-19T11:16:49.827236+0000","last_fullsized":"2024-09-19T11:16:49.827236+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":29,"log_dups_size":0,"ondisk_log_size":29,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:56:42.855744+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.584628+0000","last_change":"2024-09-19T11:13:39.375517+0000","last_active":"2024-09-19T11:14:07.584628+0000","last_peered":"2024-09-19T11:14:07.584628+0000","last_clean":"2024-09-19T11:14:07.584628+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:14:07.584628+0000","last_undegraded":"2024-09-19T11:14:07.584628+0000","last_fullsized":"2024-09-19T11:14:07.584628+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:38.349603+0000","last_clean_scrub_stamp":"2024-09-19T11:13:38.349603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:13:42.881775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.362489+0000","last_change":"2024-09-19T11:13:41.393750+0000","last_active":"2024-09-19T11:15:40.362489+0000","last_peered":"2024-09-19T11:15:40.362489+0000","last_clean":"2024-09-19T11:15:40.362489+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:15:40.362489+0000","last_undegraded":"2024-09-19T11:15:40.362489+0000","last_fullsized":"2024-09-19T11:15:40.362489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:29.365114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.128091+0000","last_change":"2024-09-19T11:17:15.128091+0000","last_active":"2024-09-19T11:17:15.128091+0000","last_peered":"2024-09-19T11:17:15.128091+0000","last_clean":"2024-09-19T11:17:15.128091+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:17:15.128091+0000","last_undegraded":"2024-09-19T11:17:15.128091+0000","last_fullsized":"2024-09-19T11:17:15.128091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:15.128006+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:15.128006+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.128006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:38.994206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.841225+0000","last_change":"2024-09-19T11:16:58.841145+0000","last_active":"2024-09-19T11:16:58.841225+0000","last_peered":"2024-09-19T11:16:58.841225+0000","last_clean":"2024-09-19T11:16:58.841225+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:58.841225+0000","last_undegraded":"2024-09-19T11:16:58.841225+0000","last_fullsized":"2024-09-19T11:16:58.841225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.841052+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:37.793058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.410120+0000","last_change":"2024-09-19T11:17:32.410120+0000","last_active":"2024-09-19T11:17:32.410120+0000","last_peered":"2024-09-19T11:17:32.410120+0000","last_clean":"2024-09-19T11:17:32.410120+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:17:32.410120+0000","last_undegraded":"2024-09-19T11:17:32.410120+0000","last_fullsized":"2024-09-19T11:17:32.410120+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:32.410031+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:32.410031+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.410031+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:05.652748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'37","reported_seq":86,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:49.837082+0000","last_change":"2024-09-19T11:13:37.371443+0000","last_active":"2024-09-19T11:16:49.837082+0000","last_peered":"2024-09-19T11:16:49.837082+0000","last_clean":"2024-09-19T11:16:49.837082+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:16:49.837082+0000","last_undegraded":"2024-09-19T11:16:49.837082+0000","last_fullsized":"2024-09-19T11:16:49.837082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:36.339289+0000","last_clean_scrub_stamp":"2024-09-19T11:13:36.339289+0000","objects_scrubbed":0,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:38:13.734955+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.399439+0000","last_change":"2024-09-19T11:17:47.399439+0000","last_active":"2024-09-19T11:17:47.399439+0000","last_peered":"2024-09-19T11:17:47.399439+0000","last_clean":"2024-09-19T11:17:47.399439+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:17:47.399439+0000","last_undegraded":"2024-09-19T11:17:47.399439+0000","last_fullsized":"2024-09-19T11:17:47.399439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.399358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.399358+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.399358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.495314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":23,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.365479+0000","last_change":"2024-09-19T11:13:41.392101+0000","last_active":"2024-09-19T11:15:40.365479+0000","last_peered":"2024-09-19T11:15:40.365479+0000","last_clean":"2024-09-19T11:15:40.365479+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:15:40.365479+0000","last_undegraded":"2024-09-19T11:15:40.365479+0000","last_fullsized":"2024-09-19T11:15:40.365479+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:53:25.270293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.520330+0000","last_change":"2024-09-19T11:17:15.520221+0000","last_active":"2024-09-19T11:17:15.520330+0000","last_peered":"2024-09-19T11:17:15.520330+0000","last_clean":"2024-09-19T11:17:15.520330+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:17:15.520330+0000","last_undegraded":"2024-09-19T11:17:15.520330+0000","last_fullsized":"2024-09-19T11:17:15.520330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:15.520117+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:15.520117+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.520117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:26.413322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.123007+0000","last_change":"2024-09-19T11:17:02.122899+0000","last_active":"2024-09-19T11:17:02.123007+0000","last_peered":"2024-09-19T11:17:02.123007+0000","last_clean":"2024-09-19T11:17:02.123007+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:17:02.123007+0000","last_undegraded":"2024-09-19T11:17:02.123007+0000","last_fullsized":"2024-09-19T11:17:02.123007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.122788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:56.217100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.704699+0000","last_change":"2024-09-19T11:17:16.704699+0000","last_active":"2024-09-19T11:17:16.704699+0000","last_peered":"2024-09-19T11:17:16.704699+0000","last_clean":"2024-09-19T11:17:16.704699+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:17:16.704699+0000","last_undegraded":"2024-09-19T11:17:16.704699+0000","last_fullsized":"2024-09-19T11:17:16.704699+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:16.704599+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:16.704599+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.704599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:48.496980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.729664+0000","last_change":"2024-09-19T11:17:00.729547+0000","last_active":"2024-09-19T11:17:00.729664+0000","last_peered":"2024-09-19T11:17:00.729664+0000","last_clean":"2024-09-19T11:17:00.729664+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:17:00.729664+0000","last_undegraded":"2024-09-19T11:17:00.729664+0000","last_fullsized":"2024-09-19T11:17:00.729664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.729447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:20.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.128830+0000","last_change":"2024-09-19T11:17:33.128733+0000","last_active":"2024-09-19T11:17:33.128830+0000","last_peered":"2024-09-19T11:17:33.128830+0000","last_clean":"2024-09-19T11:17:33.128830+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:17:33.128830+0000","last_undegraded":"2024-09-19T11:17:33.128830+0000","last_fullsized":"2024-09-19T11:17:33.128830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:33.128637+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:33.128637+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.128637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:01.235293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.280636+0000","last_change":"2024-09-19T11:17:12.280573+0000","last_active":"2024-09-19T11:17:12.280636+0000","last_peered":"2024-09-19T11:17:12.280636+0000","last_clean":"2024-09-19T11:17:12.280636+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:17:12.280636+0000","last_undegraded":"2024-09-19T11:17:12.280636+0000","last_fullsized":"2024-09-19T11:17:12.280636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.280488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:06.626222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'20","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.721783+0000","last_change":"2024-09-19T11:17:15.721783+0000","last_active":"2024-09-19T11:17:15.721783+0000","last_peered":"2024-09-19T11:17:15.721783+0000","last_clean":"2024-09-19T11:17:15.721783+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:17:15.721783+0000","last_undegraded":"2024-09-19T11:17:15.721783+0000","last_fullsized":"2024-09-19T11:17:15.721783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20","last_scrub_stamp":"2024-09-19T11:17:15.721694+0000","last_deep_scrub":"37'20","last_deep_scrub_stamp":"2024-09-19T11:17:15.721694+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.721694+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:41.352334+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.750186+0000","last_change":"2024-09-19T11:17:01.750132+0000","last_active":"2024-09-19T11:17:01.750186+0000","last_peered":"2024-09-19T11:17:01.750186+0000","last_clean":"2024-09-19T11:17:01.750186+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:17:01.750186+0000","last_undegraded":"2024-09-19T11:17:01.750186+0000","last_fullsized":"2024-09-19T11:17:01.750186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.750039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:21.882909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.747697+0000","last_change":"2024-09-19T11:17:14.747631+0000","last_active":"2024-09-19T11:17:14.747697+0000","last_peered":"2024-09-19T11:17:14.747697+0000","last_clean":"2024-09-19T11:17:14.747697+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:17:14.747697+0000","last_undegraded":"2024-09-19T11:17:14.747697+0000","last_fullsized":"2024-09-19T11:17:14.747697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.747561+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.747561+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.747561+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:33.992563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.719263+0000","last_change":"2024-09-19T11:16:59.719201+0000","last_active":"2024-09-19T11:16:59.719263+0000","last_peered":"2024-09-19T11:16:59.719263+0000","last_clean":"2024-09-19T11:16:59.719263+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:16:59.719263+0000","last_undegraded":"2024-09-19T11:16:59.719263+0000","last_fullsized":"2024-09-19T11:16:59.719263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.719107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:52.014566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.509482+0000","last_change":"2024-09-19T11:17:14.509403+0000","last_active":"2024-09-19T11:17:14.509482+0000","last_peered":"2024-09-19T11:17:14.509482+0000","last_clean":"2024-09-19T11:17:14.509482+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:17:14.509482+0000","last_undegraded":"2024-09-19T11:17:14.509482+0000","last_fullsized":"2024-09-19T11:17:14.509482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.509322+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.509322+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.509322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.517999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.712749+0000","last_change":"2024-09-19T11:17:04.712688+0000","last_active":"2024-09-19T11:17:04.712749+0000","last_peered":"2024-09-19T11:17:04.712749+0000","last_clean":"2024-09-19T11:17:04.712749+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:17:04.712749+0000","last_undegraded":"2024-09-19T11:17:04.712749+0000","last_fullsized":"2024-09-19T11:17:04.712749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.712601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:18.151651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.722988+0000","last_change":"2024-09-19T11:17:20.722908+0000","last_active":"2024-09-19T11:17:20.722988+0000","last_peered":"2024-09-19T11:17:20.722988+0000","last_clean":"2024-09-19T11:17:20.722988+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:17:20.722988+0000","last_undegraded":"2024-09-19T11:17:20.722988+0000","last_fullsized":"2024-09-19T11:17:20.722988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:20.722811+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:20.722811+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.722811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:08.485371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.127532+0000","last_change":"2024-09-19T11:17:03.127471+0000","last_active":"2024-09-19T11:17:03.127532+0000","last_peered":"2024-09-19T11:17:03.127532+0000","last_clean":"2024-09-19T11:17:03.127532+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:17:03.127532+0000","last_undegraded":"2024-09-19T11:17:03.127532+0000","last_fullsized":"2024-09-19T11:17:03.127532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.127373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:45.319191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.542704+0000","last_change":"2024-09-19T11:17:13.542620+0000","last_active":"2024-09-19T11:17:13.542704+0000","last_peered":"2024-09-19T11:17:13.542704+0000","last_clean":"2024-09-19T11:17:13.542704+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:17:13.542704+0000","last_undegraded":"2024-09-19T11:17:13.542704+0000","last_fullsized":"2024-09-19T11:17:13.542704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.542491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:23.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.719936+0000","last_change":"2024-09-19T11:17:02.719810+0000","last_active":"2024-09-19T11:17:02.719936+0000","last_peered":"2024-09-19T11:17:02.719936+0000","last_clean":"2024-09-19T11:17:02.719936+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:17:02.719936+0000","last_undegraded":"2024-09-19T11:17:02.719936+0000","last_fullsized":"2024-09-19T11:17:02.719936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.719684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:09.105342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.571852+0000","last_change":"2024-09-19T11:17:20.571852+0000","last_active":"2024-09-19T11:17:20.571852+0000","last_peered":"2024-09-19T11:17:20.571852+0000","last_clean":"2024-09-19T11:17:20.571852+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:17:20.571852+0000","last_undegraded":"2024-09-19T11:17:20.571852+0000","last_fullsized":"2024-09-19T11:17:20.571852+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:20.571768+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:20.571768+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.571768+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:21.919126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.324856+0000","last_change":"2024-09-19T11:17:13.324790+0000","last_active":"2024-09-19T11:17:13.324856+0000","last_peered":"2024-09-19T11:17:13.324856+0000","last_clean":"2024-09-19T11:17:13.324856+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:17:13.324856+0000","last_undegraded":"2024-09-19T11:17:13.324856+0000","last_fullsized":"2024-09-19T11:17:13.324856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.324688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:10.883666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.141851+0000","last_change":"2024-09-19T11:17:35.141851+0000","last_active":"2024-09-19T11:17:35.141851+0000","last_peered":"2024-09-19T11:17:35.141851+0000","last_clean":"2024-09-19T11:17:35.141851+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:17:35.141851+0000","last_undegraded":"2024-09-19T11:17:35.141851+0000","last_fullsized":"2024-09-19T11:17:35.141851+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:35.141748+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:35.141748+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.141748+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.731724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.735210+0000","last_change":"2024-09-19T11:17:04.735210+0000","last_active":"2024-09-19T11:17:04.735210+0000","last_peered":"2024-09-19T11:17:04.735210+0000","last_clean":"2024-09-19T11:17:04.735210+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:17:04.735210+0000","last_undegraded":"2024-09-19T11:17:04.735210+0000","last_fullsized":"2024-09-19T11:17:04.735210+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.735127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:17.771568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'12","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.724380+0000","last_change":"2024-09-19T11:17:18.724380+0000","last_active":"2024-09-19T11:17:18.724380+0000","last_peered":"2024-09-19T11:17:18.724380+0000","last_clean":"2024-09-19T11:17:18.724380+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:17:18.724380+0000","last_undegraded":"2024-09-19T11:17:18.724380+0000","last_fullsized":"2024-09-19T11:17:18.724380+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:18.724292+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:18.724292+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.724292+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:51.156798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.744045+0000","last_change":"2024-09-19T11:17:02.744045+0000","last_active":"2024-09-19T11:17:02.744045+0000","last_peered":"2024-09-19T11:17:02.744045+0000","last_clean":"2024-09-19T11:17:02.744045+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:17:02.744045+0000","last_undegraded":"2024-09-19T11:17:02.744045+0000","last_fullsized":"2024-09-19T11:17:02.744045+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.743932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:55.116235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.556409+0000","last_change":"2024-09-19T11:17:19.556409+0000","last_active":"2024-09-19T11:17:19.556409+0000","last_peered":"2024-09-19T11:17:19.556409+0000","last_clean":"2024-09-19T11:17:19.556409+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:17:19.556409+0000","last_undegraded":"2024-09-19T11:17:19.556409+0000","last_fullsized":"2024-09-19T11:17:19.556409+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:19.556323+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:19.556323+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.556323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:45.864627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.781064+0000","last_change":"2024-09-19T11:17:01.781064+0000","last_active":"2024-09-19T11:17:01.781064+0000","last_peered":"2024-09-19T11:17:01.781064+0000","last_clean":"2024-09-19T11:17:01.781064+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:17:01.781064+0000","last_undegraded":"2024-09-19T11:17:01.781064+0000","last_fullsized":"2024-09-19T11:17:01.781064+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.780976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:25.647175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.509949+0000","last_change":"2024-09-19T11:17:17.509949+0000","last_active":"2024-09-19T11:17:17.509949+0000","last_peered":"2024-09-19T11:17:17.509949+0000","last_clean":"2024-09-19T11:17:17.509949+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:17:17.509949+0000","last_undegraded":"2024-09-19T11:17:17.509949+0000","last_fullsized":"2024-09-19T11:17:17.509949+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:17.509860+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:17.509860+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.509860+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:13.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.362674+0000","last_change":"2024-09-19T11:17:14.362674+0000","last_active":"2024-09-19T11:17:14.362674+0000","last_peered":"2024-09-19T11:17:14.362674+0000","last_clean":"2024-09-19T11:17:14.362674+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:17:14.362674+0000","last_undegraded":"2024-09-19T11:17:14.362674+0000","last_fullsized":"2024-09-19T11:17:14.362674+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:14.362585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:14.362585+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.362585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:42.088426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'12","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.482087+0000","last_change":"2024-09-19T11:17:16.482087+0000","last_active":"2024-09-19T11:17:16.482087+0000","last_peered":"2024-09-19T11:17:16.482087+0000","last_clean":"2024-09-19T11:17:16.482087+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:17:16.482087+0000","last_undegraded":"2024-09-19T11:17:16.482087+0000","last_fullsized":"2024-09-19T11:17:16.482087+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:16.482004+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:16.482004+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.482004+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:19.747512+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.374545+0000","last_change":"2024-09-19T11:17:15.374545+0000","last_active":"2024-09-19T11:17:15.374545+0000","last_peered":"2024-09-19T11:17:15.374545+0000","last_clean":"2024-09-19T11:17:15.374545+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:17:15.374545+0000","last_undegraded":"2024-09-19T11:17:15.374545+0000","last_fullsized":"2024-09-19T11:17:15.374545+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:15.374417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:15.374417+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.374417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:03.758631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.151411+0000","last_change":"2024-09-19T11:17:34.151411+0000","last_active":"2024-09-19T11:17:34.151411+0000","last_peered":"2024-09-19T11:17:34.151411+0000","last_clean":"2024-09-19T11:17:34.151411+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:17:34.151411+0000","last_undegraded":"2024-09-19T11:17:34.151411+0000","last_fullsized":"2024-09-19T11:17:34.151411+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:34.151316+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:34.151316+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.151316+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:29.956213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.153242+0000","last_change":"2024-09-19T11:17:04.153242+0000","last_active":"2024-09-19T11:17:04.153242+0000","last_peered":"2024-09-19T11:17:04.153242+0000","last_clean":"2024-09-19T11:17:04.153242+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:17:04.153242+0000","last_undegraded":"2024-09-19T11:17:04.153242+0000","last_fullsized":"2024-09-19T11:17:04.153242+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.153146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:23.740652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.559592+0000","last_change":"2024-09-19T11:17:18.559499+0000","last_active":"2024-09-19T11:17:18.559592+0000","last_peered":"2024-09-19T11:17:18.559592+0000","last_clean":"2024-09-19T11:17:18.559592+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:17:18.559592+0000","last_undegraded":"2024-09-19T11:17:18.559592+0000","last_fullsized":"2024-09-19T11:17:18.559592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:18.559406+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:18.559406+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.559406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:02.731291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.333631+0000","last_change":"2024-09-19T11:17:17.333631+0000","last_active":"2024-09-19T11:17:17.333631+0000","last_peered":"2024-09-19T11:17:17.333631+0000","last_clean":"2024-09-19T11:17:17.333631+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:17:17.333631+0000","last_undegraded":"2024-09-19T11:17:17.333631+0000","last_fullsized":"2024-09-19T11:17:17.333631+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:17.333525+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:17.333525+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.333525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:07.331615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.360890+0000","last_change":"2024-09-19T11:17:16.360890+0000","last_active":"2024-09-19T11:17:16.360890+0000","last_peered":"2024-09-19T11:17:16.360890+0000","last_clean":"2024-09-19T11:17:16.360890+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:17:16.360890+0000","last_undegraded":"2024-09-19T11:17:16.360890+0000","last_fullsized":"2024-09-19T11:17:16.360890+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:16.360792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:16.360792+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.360792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:58.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.686885+0000","last_change":"2024-09-19T11:17:17.686885+0000","last_active":"2024-09-19T11:17:17.686885+0000","last_peered":"2024-09-19T11:17:17.686885+0000","last_clean":"2024-09-19T11:17:17.686885+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:17:17.686885+0000","last_undegraded":"2024-09-19T11:17:17.686885+0000","last_fullsized":"2024-09-19T11:17:17.686885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:17.686787+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:17.686787+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.686787+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:29.308455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.699792+0000","last_change":"2024-09-19T11:17:06.699792+0000","last_active":"2024-09-19T11:17:06.699792+0000","last_peered":"2024-09-19T11:17:06.699792+0000","last_clean":"2024-09-19T11:17:06.699792+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:17:06.699792+0000","last_undegraded":"2024-09-19T11:17:06.699792+0000","last_fullsized":"2024-09-19T11:17:06.699792+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.699710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:06.685184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.420123+0000","last_change":"2024-09-19T11:17:26.420123+0000","last_active":"2024-09-19T11:17:26.420123+0000","last_peered":"2024-09-19T11:17:26.420123+0000","last_clean":"2024-09-19T11:17:26.420123+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:17:26.420123+0000","last_undegraded":"2024-09-19T11:17:26.420123+0000","last_fullsized":"2024-09-19T11:17:26.420123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:26.420010+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:26.420010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.420010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:17.288611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":276,"ondisk_log_size":276,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2287,"ondisk_log_size":2287,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1730,"num_omap_keys":8,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1525,"ondisk_log_size":1525,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640316,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":512000,"data_stored":161981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640317,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":749066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640317,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":749395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705723,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":44132,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":43646,"kb_avail":94327708,"statfs":{"total":96636764160,"available":96591572992,"internally_reserved":0,"allocated":479232,"data_stored":160962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":44693957},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:17:55.606 INFO:tasks.ceph:pgid 6.16 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.606 INFO:tasks.ceph:pgid 8.19 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.606 INFO:tasks.ceph:pgid 8.1a last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.606 INFO:tasks.ceph:pgid 7.15 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.607 INFO:tasks.ceph:pgid 7.f last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.607 INFO:tasks.ceph:pgid 8.0 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.607 INFO:tasks.ceph:pgid 6.c last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.608 INFO:tasks.ceph:pgid 7.5 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.608 INFO:tasks.ceph:pgid 8.b last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.608 INFO:tasks.ceph:pgid 7.7 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.608 INFO:tasks.ceph:pgid 8.e last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.608 INFO:tasks.ceph:pgid 8.f last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.609 INFO:tasks.ceph:pgid 6.11 last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.609 INFO:tasks.ceph:pgid 7.10 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.609 INFO:tasks.ceph:pgid 8.1e last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.609 INFO:tasks.ceph:pgid 8.1d last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.609 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.609 INFO:tasks.ceph:pgid 8.13 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.610 INFO:tasks.ceph:pgid 6.1c last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.610 INFO:tasks.ceph:pgid 8.12 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.610 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.610 INFO:tasks.ceph:pgid 6.1e last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.610 INFO:tasks.ceph:pgid 8.10 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.610 INFO:tasks.ceph:pgid 7.19 last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.611 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.611 INFO:tasks.ceph:pgid 6.1b last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.611 INFO:tasks.ceph:pgid 7.1a last_scrub_stamp 2024-09-19T11:13:38.349603+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=38, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.611 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.611 INFO:tasks.ceph:pgid 6.1a last_scrub_stamp 2024-09-19T11:13:36.339289+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=36, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.611 INFO:tasks.ceph:pgid 8.14 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:17:55.612 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T11:18:15.613 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:18:15.729 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.727+0000 7f5cf187f640 1 Processor -- start 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.727+0000 7f5cf187f640 1 -- start start 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5cf187f640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cec06fab0 0x7f5cec134820 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5cf187f640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f5cec070330 con 0x7f5cec06efc0 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5cf187f640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f5cec09f310 con 0x7f5cec06fab0 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5cea7fc640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f5cec06fab0 0x7f5cec134820 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5ceaffd640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f5cec06efc0 0x7f5cec06f3a0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:35492/0 (socket says 172.21.15.37:35492) 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5ceaffd640 1 -- 172.21.15.37:0/584069242 learned_addr learned my addr 172.21.15.37:0/584069242 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5cea7fc640 1 -- 172.21.15.37:0/584069242 >> v1:172.21.15.37:6789/0 conn(0x7f5cec06efc0 legacy=0x7f5cec06f3a0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5cea7fc640 1 -- 172.21.15.37:0/584069242 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec070640 con 0x7f5cec06fab0 2024-09-19T11:18:15.730 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.728+0000 7f5ce9ffb640 1 -- 172.21.15.37:0/584069242 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 127205230 0 0) 0x7f5cec070330 con 0x7f5cec06efc0 2024-09-19T11:18:15.731 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.729+0000 7f5cea7fc640 1 --2- 172.21.15.37:0/584069242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06fab0 0x7f5cec134820 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009720 tx=0x7f5cd402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=384e7a876f637eb9 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.729+0000 7f5ce9ffb640 1 -- 172.21.15.37:0/584069242 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cd4037070 con 0x7f5cec06fab0 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.729+0000 7f5ce9ffb640 1 -- 172.21.15.37:0/584069242 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cd402ad90 con 0x7f5cec06fab0 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.729+0000 7f5ce9ffb640 1 -- 172.21.15.37:0/584069242 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cd4032590 con 0x7f5cec06fab0 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.730+0000 7f5cf187f640 1 -- 172.21.15.37:0/584069242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06fab0 msgr2=0x7f5cec134820 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.730+0000 7f5cf187f640 1 --2- 172.21.15.37:0/584069242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06fab0 0x7f5cec134820 secure :-1 s=READY pgs=899 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4009720 tx=0x7f5cd402a110 comp rx=0 tx=0).stop 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.730+0000 7f5cf187f640 1 -- 172.21.15.37:0/584069242 shutdown_connections 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.730+0000 7f5cf187f640 1 --2- 172.21.15.37:0/584069242 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06fab0 0x7f5cec134820 unknown :-1 s=CLOSED pgs=899 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.730+0000 7f5cf187f640 1 -- 172.21.15.37:0/584069242 >> 172.21.15.37:0/584069242 conn(0x7f5cec0a2460 msgr2=0x7f5cec09e930 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.730+0000 7f5cf187f640 1 -- 172.21.15.37:0/584069242 shutdown_connections 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.730+0000 7f5cf187f640 1 -- 172.21.15.37:0/584069242 wait complete. 2024-09-19T11:18:15.732 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.731+0000 7f5cf187f640 1 Processor -- start 2024-09-19T11:18:15.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.731+0000 7f5cf187f640 1 -- start start 2024-09-19T11:18:15.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.731+0000 7f5cf187f640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06efc0 0x7f5cec1c8240 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:15.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.731+0000 7f5cf187f640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f5cec134ee0 con 0x7f5cec06efc0 2024-09-19T11:18:15.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06efc0 0x7f5cec1c8240 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:15.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5ceaffd640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06efc0 0x7f5cec1c8240 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:55978/0 (socket says 172.21.15.37:55978) 2024-09-19T11:18:15.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5ceaffd640 1 -- 172.21.15.37:0/3261604326 learned_addr learned my addr 172.21.15.37:0/3261604326 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:18:15.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5ceaffd640 1 -- 172.21.15.37:0/3261604326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f5cec073fe0 con 0x7f5cec06efc0 2024-09-19T11:18:15.734 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5ceaffd640 1 --2- 172.21.15.37:0/3261604326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06efc0 0x7f5cec1c8240 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c7c0 tx=0x7f5cdc00cc80 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:15.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5ce3fff640 1 -- 172.21.15.37:0/3261604326 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cdc018070 con 0x7f5cec06efc0 2024-09-19T11:18:15.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5ce3fff640 1 -- 172.21.15.37:0/3261604326 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f5cdc004d70 con 0x7f5cec06efc0 2024-09-19T11:18:15.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f5cec09abb0 con 0x7f5cec06efc0 2024-09-19T11:18:15.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5ce3fff640 1 -- 172.21.15.37:0/3261604326 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f5cdc00a710 con 0x7f5cec06efc0 2024-09-19T11:18:15.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.732+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f5cec09b7e0 con 0x7f5cec06efc0 2024-09-19T11:18:15.735 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.733+0000 7f5ce3fff640 1 -- 172.21.15.37:0/3261604326 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f5cdc01b070 con 0x7f5cec06efc0 2024-09-19T11:18:15.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.733+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f5cec06f3a0 con 0x7f5cec06efc0 2024-09-19T11:18:15.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.733+0000 7f5ce3fff640 1 --2- 172.21.15.37:0/3261604326 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ccc03e710 0x7f5ccc040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:15.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.733+0000 7f5ce3fff640 1 -- 172.21.15.37:0/3261604326 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f5cdc052f10 con 0x7f5cec06efc0 2024-09-19T11:18:15.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.734+0000 7f5cea7fc640 1 --2- 172.21.15.37:0/3261604326 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ccc03e710 0x7f5ccc040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:15.736 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.734+0000 7f5cea7fc640 1 --2- 172.21.15.37:0/3261604326 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ccc03e710 0x7f5ccc040bd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4034000 tx=0x7f5cd402e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:15.739 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.738+0000 7f5ce3fff640 1 -- 172.21.15.37:0/3261604326 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f5cdc011db0 con 0x7f5cec06efc0 2024-09-19T11:18:15.925 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.924+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f5cec090240 con 0x7f5ccc03e710 2024-09-19T11:18:15.935 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.934+0000 7f5ce3fff640 1 -- 172.21.15.37:0/3261604326 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666424 (secure 0 0 0) 0x7f5cec090240 con 0x7f5ccc03e710 2024-09-19T11:18:15.942 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:18:15.948 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:18:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ccc03e710 msgr2=0x7f5ccc040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 --2- 172.21.15.37:0/3261604326 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ccc03e710 0x7f5ccc040bd0 secure :-1 s=READY pgs=372 cs=0 l=1 rev1=1 crypto rx=0x7f5cd4034000 tx=0x7f5cd402e000 comp rx=0 tx=0).stop 2024-09-19T11:18:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06efc0 msgr2=0x7f5cec1c8240 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:15.950 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 --2- 172.21.15.37:0/3261604326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06efc0 0x7f5cec1c8240 secure :-1 s=READY pgs=900 cs=0 l=1 rev1=1 crypto rx=0x7f5cdc00c7c0 tx=0x7f5cdc00cc80 comp rx=0 tx=0).stop 2024-09-19T11:18:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 shutdown_connections 2024-09-19T11:18:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 --2- 172.21.15.37:0/3261604326 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f5ccc03e710 0x7f5ccc040bd0 unknown :-1 s=CLOSED pgs=372 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 --2- 172.21.15.37:0/3261604326 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f5cec06efc0 0x7f5cec1c8240 unknown :-1 s=CLOSED pgs=900 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 >> 172.21.15.37:0/3261604326 conn(0x7f5cec0a2460 msgr2=0x7f5cec072ee0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:18:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 shutdown_connections 2024-09-19T11:18:15.951 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:15.939+0000 7f5cf187f640 1 -- 172.21.15.37:0/3261604326 wait complete. 2024-09-19T11:18:15.952 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":186,"stamp":"2024-09-19T11:18:14.608094+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5183,"num_read_kb":4725,"num_write":2125,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148544,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338816,"statfs":{"total":386547056640,"available":386394947584,"internally_reserved":0,"allocated":3080192,"data_stored":1821404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003740"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.185570+0000","last_change":"2024-09-19T11:17:09.185503+0000","last_active":"2024-09-19T11:17:09.185570+0000","last_peered":"2024-09-19T11:17:09.185570+0000","last_clean":"2024-09-19T11:17:09.185570+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:17:09.185570+0000","last_undegraded":"2024-09-19T11:17:09.185570+0000","last_fullsized":"2024-09-19T11:17:09.185570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.185421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:28.271527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.428109+0000","last_change":"2024-09-19T11:17:24.428109+0000","last_active":"2024-09-19T11:17:24.428109+0000","last_peered":"2024-09-19T11:17:24.428109+0000","last_clean":"2024-09-19T11:17:24.428109+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:17:24.428109+0000","last_undegraded":"2024-09-19T11:17:24.428109+0000","last_fullsized":"2024-09-19T11:17:24.428109+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:24.428032+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:24.428032+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.428032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:15:35.180377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.722324+0000","last_change":"2024-09-19T11:17:07.722223+0000","last_active":"2024-09-19T11:17:07.722324+0000","last_peered":"2024-09-19T11:17:07.722324+0000","last_clean":"2024-09-19T11:17:07.722324+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:17:07.722324+0000","last_undegraded":"2024-09-19T11:17:07.722324+0000","last_fullsized":"2024-09-19T11:17:07.722324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.722137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:30.023844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'8","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.228473+0000","last_change":"2024-09-19T11:17:39.228473+0000","last_active":"2024-09-19T11:17:39.228473+0000","last_peered":"2024-09-19T11:17:39.228473+0000","last_clean":"2024-09-19T11:17:39.228473+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:17:39.228473+0000","last_undegraded":"2024-09-19T11:17:39.228473+0000","last_fullsized":"2024-09-19T11:17:39.228473+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:39.228390+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:39.228390+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.228390+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:43.727515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.305609+0000","last_change":"2024-09-19T11:17:20.305534+0000","last_active":"2024-09-19T11:17:20.305609+0000","last_peered":"2024-09-19T11:17:20.305609+0000","last_clean":"2024-09-19T11:17:20.305609+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:17:20.305609+0000","last_undegraded":"2024-09-19T11:17:20.305609+0000","last_fullsized":"2024-09-19T11:17:20.305609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:20.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:20.305449+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:26.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.707910+0000","last_change":"2024-09-19T11:17:19.707910+0000","last_active":"2024-09-19T11:17:19.707910+0000","last_peered":"2024-09-19T11:17:19.707910+0000","last_clean":"2024-09-19T11:17:19.707910+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:17:19.707910+0000","last_undegraded":"2024-09-19T11:17:19.707910+0000","last_fullsized":"2024-09-19T11:17:19.707910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:19.707815+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:19.707815+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.707815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:44.051682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.203776+0000","last_change":"2024-09-19T11:17:07.203719+0000","last_active":"2024-09-19T11:17:07.203776+0000","last_peered":"2024-09-19T11:17:07.203776+0000","last_clean":"2024-09-19T11:17:07.203776+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:07.203776+0000","last_undegraded":"2024-09-19T11:17:07.203776+0000","last_fullsized":"2024-09-19T11:17:07.203776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.203629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:11.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.181211+0000","last_change":"2024-09-19T11:17:38.181211+0000","last_active":"2024-09-19T11:17:38.181211+0000","last_peered":"2024-09-19T11:17:38.181211+0000","last_clean":"2024-09-19T11:17:38.181211+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:17:38.181211+0000","last_undegraded":"2024-09-19T11:17:38.181211+0000","last_fullsized":"2024-09-19T11:17:38.181211+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:38.181092+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:38.181092+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.181092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.184562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.273303+0000","last_change":"2024-09-19T11:17:21.273303+0000","last_active":"2024-09-19T11:17:21.273303+0000","last_peered":"2024-09-19T11:17:21.273303+0000","last_clean":"2024-09-19T11:17:21.273303+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:17:21.273303+0000","last_undegraded":"2024-09-19T11:17:21.273303+0000","last_fullsized":"2024-09-19T11:17:21.273303+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:21.273210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:21.273210+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.273210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:17.566575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.419946+0000","last_change":"2024-09-19T11:17:25.419858+0000","last_active":"2024-09-19T11:17:25.419946+0000","last_peered":"2024-09-19T11:17:25.419946+0000","last_clean":"2024-09-19T11:17:25.419946+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:17:25.419946+0000","last_undegraded":"2024-09-19T11:17:25.419946+0000","last_fullsized":"2024-09-19T11:17:25.419946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:25.419735+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:25.419735+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.419735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:25.095539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.173145+0000","last_change":"2024-09-19T11:17:06.173145+0000","last_active":"2024-09-19T11:17:06.173145+0000","last_peered":"2024-09-19T11:17:06.173145+0000","last_clean":"2024-09-19T11:17:06.173145+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:17:06.173145+0000","last_undegraded":"2024-09-19T11:17:06.173145+0000","last_fullsized":"2024-09-19T11:17:06.173145+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.173052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:49.733204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'22","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.178486+0000","last_change":"2024-09-19T11:17:24.178486+0000","last_active":"2024-09-19T11:17:24.178486+0000","last_peered":"2024-09-19T11:17:24.178486+0000","last_clean":"2024-09-19T11:17:24.178486+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:17:24.178486+0000","last_undegraded":"2024-09-19T11:17:24.178486+0000","last_fullsized":"2024-09-19T11:17:24.178486+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:24.178395+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:24.178395+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.178395+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:32:31.010938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.336034+0000","last_change":"2024-09-19T11:17:19.336034+0000","last_active":"2024-09-19T11:17:19.336034+0000","last_peered":"2024-09-19T11:17:19.336034+0000","last_clean":"2024-09-19T11:17:19.336034+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:17:19.336034+0000","last_undegraded":"2024-09-19T11:17:19.336034+0000","last_fullsized":"2024-09-19T11:17:19.336034+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:19.335927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:19.335927+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.335927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:24.741509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.177004+0000","last_change":"2024-09-19T11:17:19.176944+0000","last_active":"2024-09-19T11:17:19.177004+0000","last_peered":"2024-09-19T11:17:19.177004+0000","last_clean":"2024-09-19T11:17:19.177004+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:17:19.177004+0000","last_undegraded":"2024-09-19T11:17:19.177004+0000","last_fullsized":"2024-09-19T11:17:19.177004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:19.176853+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:19.176853+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.176853+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:04.753042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.735731+0000","last_change":"2024-09-19T11:17:05.735731+0000","last_active":"2024-09-19T11:17:05.735731+0000","last_peered":"2024-09-19T11:17:05.735731+0000","last_clean":"2024-09-19T11:17:05.735731+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:17:05.735731+0000","last_undegraded":"2024-09-19T11:17:05.735731+0000","last_fullsized":"2024-09-19T11:17:05.735731+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.735639+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:45.185308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.161554+0000","last_change":"2024-09-19T11:17:20.161499+0000","last_active":"2024-09-19T11:17:20.161554+0000","last_peered":"2024-09-19T11:17:20.161554+0000","last_clean":"2024-09-19T11:17:20.161554+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:17:20.161554+0000","last_undegraded":"2024-09-19T11:17:20.161554+0000","last_fullsized":"2024-09-19T11:17:20.161554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:20.161414+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:20.161414+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.161414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:55.200468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.187883+0000","last_change":"2024-09-19T11:17:36.187799+0000","last_active":"2024-09-19T11:17:36.187883+0000","last_peered":"2024-09-19T11:17:36.187883+0000","last_clean":"2024-09-19T11:17:36.187883+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:17:36.187883+0000","last_undegraded":"2024-09-19T11:17:36.187883+0000","last_fullsized":"2024-09-19T11:17:36.187883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:36.187719+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:36.187719+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.187719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:20.713186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.728105+0000","last_change":"2024-09-19T11:17:03.728105+0000","last_active":"2024-09-19T11:17:03.728105+0000","last_peered":"2024-09-19T11:17:03.728105+0000","last_clean":"2024-09-19T11:17:03.728105+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:17:03.728105+0000","last_undegraded":"2024-09-19T11:17:03.728105+0000","last_fullsized":"2024-09-19T11:17:03.728105+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.728013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:50.046423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.546489+0000","last_change":"2024-09-19T11:17:21.546410+0000","last_active":"2024-09-19T11:17:21.546489+0000","last_peered":"2024-09-19T11:17:21.546489+0000","last_clean":"2024-09-19T11:17:21.546489+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:17:21.546489+0000","last_undegraded":"2024-09-19T11:17:21.546489+0000","last_fullsized":"2024-09-19T11:17:21.546489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:21.546297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:21.546297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.546297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:35.564864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.201897+0000","last_change":"2024-09-19T11:17:05.201897+0000","last_active":"2024-09-19T11:17:05.201897+0000","last_peered":"2024-09-19T11:17:05.201897+0000","last_clean":"2024-09-19T11:17:05.201897+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:17:05.201897+0000","last_undegraded":"2024-09-19T11:17:05.201897+0000","last_fullsized":"2024-09-19T11:17:05.201897+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.201777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:39.204473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.461793+0000","last_change":"2024-09-19T11:17:23.461723+0000","last_active":"2024-09-19T11:17:23.461793+0000","last_peered":"2024-09-19T11:17:23.461793+0000","last_clean":"2024-09-19T11:17:23.461793+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:17:23.461793+0000","last_undegraded":"2024-09-19T11:17:23.461793+0000","last_fullsized":"2024-09-19T11:17:23.461793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:23.461640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:23.461640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.461640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:44.860304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.571584+0000","last_change":"2024-09-19T11:17:10.571584+0000","last_active":"2024-09-19T11:17:10.571584+0000","last_peered":"2024-09-19T11:17:10.571584+0000","last_clean":"2024-09-19T11:17:10.571584+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:17:10.571584+0000","last_undegraded":"2024-09-19T11:17:10.571584+0000","last_fullsized":"2024-09-19T11:17:10.571584+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.571487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:05.033249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.700307+0000","last_change":"2024-09-19T11:17:21.700307+0000","last_active":"2024-09-19T11:17:21.700307+0000","last_peered":"2024-09-19T11:17:21.700307+0000","last_clean":"2024-09-19T11:17:21.700307+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:17:21.700307+0000","last_undegraded":"2024-09-19T11:17:21.700307+0000","last_fullsized":"2024-09-19T11:17:21.700307+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:21.700211+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:21.700211+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.700211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.309406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.677222+0000","last_change":"2024-09-19T11:17:06.677222+0000","last_active":"2024-09-19T11:17:06.677222+0000","last_peered":"2024-09-19T11:17:06.677222+0000","last_clean":"2024-09-19T11:17:06.677222+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:17:06.677222+0000","last_undegraded":"2024-09-19T11:17:06.677222+0000","last_fullsized":"2024-09-19T11:17:06.677222+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.677123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:51.934638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.191519+0000","last_change":"2024-09-19T11:17:18.191519+0000","last_active":"2024-09-19T11:17:18.191519+0000","last_peered":"2024-09-19T11:17:18.191519+0000","last_clean":"2024-09-19T11:17:18.191519+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:17:18.191519+0000","last_undegraded":"2024-09-19T11:17:18.191519+0000","last_fullsized":"2024-09-19T11:17:18.191519+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:18.191426+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:18.191426+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.191426+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:24.097341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.749724+0000","last_change":"2024-09-19T11:17:03.749724+0000","last_active":"2024-09-19T11:17:03.749724+0000","last_peered":"2024-09-19T11:17:03.749724+0000","last_clean":"2024-09-19T11:17:03.749724+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:17:03.749724+0000","last_undegraded":"2024-09-19T11:17:03.749724+0000","last_fullsized":"2024-09-19T11:17:03.749724+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.749624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:09.231023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.498306+0000","last_change":"2024-09-19T11:17:22.498306+0000","last_active":"2024-09-19T11:17:22.498306+0000","last_peered":"2024-09-19T11:17:22.498306+0000","last_clean":"2024-09-19T11:17:22.498306+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:17:22.498306+0000","last_undegraded":"2024-09-19T11:17:22.498306+0000","last_fullsized":"2024-09-19T11:17:22.498306+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:22.498193+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:22.498193+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.498193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:31.267529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.314618+0000","last_change":"2024-09-19T11:17:18.314533+0000","last_active":"2024-09-19T11:17:18.314618+0000","last_peered":"2024-09-19T11:17:18.314618+0000","last_clean":"2024-09-19T11:17:18.314618+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:17:18.314618+0000","last_undegraded":"2024-09-19T11:17:18.314618+0000","last_fullsized":"2024-09-19T11:17:18.314618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:18.314426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:18.314426+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.314426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:36.967813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'36","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:53.526061+0000","last_change":"2024-09-19T11:17:53.526061+0000","last_active":"2024-09-19T11:17:53.526061+0000","last_peered":"2024-09-19T11:17:53.526061+0000","last_clean":"2024-09-19T11:17:53.526061+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:17:53.526061+0000","last_undegraded":"2024-09-19T11:17:53.526061+0000","last_fullsized":"2024-09-19T11:17:53.526061+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'36","last_scrub_stamp":"2024-09-19T11:17:53.525955+0000","last_deep_scrub":"37'36","last_deep_scrub_stamp":"2024-09-19T11:17:53.525955+0000","last_clean_scrub_stamp":"2024-09-19T11:17:53.525955+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:22.989984+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.319783+0000","last_change":"2024-09-19T11:17:26.319705+0000","last_active":"2024-09-19T11:17:26.319783+0000","last_peered":"2024-09-19T11:17:26.319783+0000","last_clean":"2024-09-19T11:17:26.319783+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:17:26.319783+0000","last_undegraded":"2024-09-19T11:17:26.319783+0000","last_fullsized":"2024-09-19T11:17:26.319783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:26.319597+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:26.319597+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.319597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:32.580506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.339807+0000","last_change":"2024-09-19T11:17:08.339744+0000","last_active":"2024-09-19T11:17:08.339807+0000","last_peered":"2024-09-19T11:17:08.339807+0000","last_clean":"2024-09-19T11:17:08.339807+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:17:08.339807+0000","last_undegraded":"2024-09-19T11:17:08.339807+0000","last_fullsized":"2024-09-19T11:17:08.339807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.339654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:36.909793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.281630+0000","last_change":"2024-09-19T11:17:47.281630+0000","last_active":"2024-09-19T11:17:47.281630+0000","last_peered":"2024-09-19T11:17:47.281630+0000","last_clean":"2024-09-19T11:17:47.281630+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:17:47.281630+0000","last_undegraded":"2024-09-19T11:17:47.281630+0000","last_fullsized":"2024-09-19T11:17:47.281630+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.281547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.281547+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.281547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:45.497123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:55.196800+0000","last_change":"2024-09-19T11:17:55.196800+0000","last_active":"2024-09-19T11:17:55.196800+0000","last_peered":"2024-09-19T11:17:55.196800+0000","last_clean":"2024-09-19T11:17:55.196800+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:17:55.196800+0000","last_undegraded":"2024-09-19T11:17:55.196800+0000","last_fullsized":"2024-09-19T11:17:55.196800+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:55.196715+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:55.196715+0000","last_clean_scrub_stamp":"2024-09-19T11:17:55.196715+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.818659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.526959+0000","last_change":"2024-09-19T11:17:45.526959+0000","last_active":"2024-09-19T11:17:45.526959+0000","last_peered":"2024-09-19T11:17:45.526959+0000","last_clean":"2024-09-19T11:17:45.526959+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:17:45.526959+0000","last_undegraded":"2024-09-19T11:17:45.526959+0000","last_fullsized":"2024-09-19T11:17:45.526959+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:45.526876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:45.526876+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.526876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:04.650775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":34,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:54.545401+0000","last_change":"2024-09-19T11:17:54.545401+0000","last_active":"2024-09-19T11:17:54.545401+0000","last_peered":"2024-09-19T11:17:54.545401+0000","last_clean":"2024-09-19T11:17:54.545401+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:17:54.545401+0000","last_undegraded":"2024-09-19T11:17:54.545401+0000","last_fullsized":"2024-09-19T11:17:54.545401+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-19T11:17:54.545328+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-19T11:17:54.545328+0000","last_clean_scrub_stamp":"2024-09-19T11:17:54.545328+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:30.479330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.211803+0000","last_change":"2024-09-19T11:17:29.211803+0000","last_active":"2024-09-19T11:17:29.211803+0000","last_peered":"2024-09-19T11:17:29.211803+0000","last_clean":"2024-09-19T11:17:29.211803+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:17:29.211803+0000","last_undegraded":"2024-09-19T11:17:29.211803+0000","last_fullsized":"2024-09-19T11:17:29.211803+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:29.211683+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:29.211683+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.211683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:00.455274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.229980+0000","last_change":"2024-09-19T11:16:59.229925+0000","last_active":"2024-09-19T11:16:59.229980+0000","last_peered":"2024-09-19T11:16:59.229980+0000","last_clean":"2024-09-19T11:16:59.229980+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:16:59.229980+0000","last_undegraded":"2024-09-19T11:16:59.229980+0000","last_fullsized":"2024-09-19T11:16:59.229980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.229836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.835840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.558504+0000","last_change":"2024-09-19T11:17:30.558504+0000","last_active":"2024-09-19T11:17:30.558504+0000","last_peered":"2024-09-19T11:17:30.558504+0000","last_clean":"2024-09-19T11:17:30.558504+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:17:30.558504+0000","last_undegraded":"2024-09-19T11:17:30.558504+0000","last_fullsized":"2024-09-19T11:17:30.558504+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.558423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.558423+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.558423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:03.461110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'9","reported_seq":46,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.501925+0000","last_change":"2024-09-19T11:17:39.501925+0000","last_active":"2024-09-19T11:17:39.501925+0000","last_peered":"2024-09-19T11:17:39.501925+0000","last_clean":"2024-09-19T11:17:39.501925+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:17:39.501925+0000","last_undegraded":"2024-09-19T11:17:39.501925+0000","last_fullsized":"2024-09-19T11:17:39.501925+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:39.501845+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:39.501845+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.501845+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:24.314455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.482311+0000","last_change":"2024-09-19T11:17:44.482311+0000","last_active":"2024-09-19T11:17:44.482311+0000","last_peered":"2024-09-19T11:17:44.482311+0000","last_clean":"2024-09-19T11:17:44.482311+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:17:44.482311+0000","last_undegraded":"2024-09-19T11:17:44.482311+0000","last_fullsized":"2024-09-19T11:17:44.482311+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:44.482220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:44.482220+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.482220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:52.103555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:52.363726+0000","last_change":"2024-09-19T11:17:52.363726+0000","last_active":"2024-09-19T11:17:52.363726+0000","last_peered":"2024-09-19T11:17:52.363726+0000","last_clean":"2024-09-19T11:17:52.363726+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:17:52.363726+0000","last_undegraded":"2024-09-19T11:17:52.363726+0000","last_fullsized":"2024-09-19T11:17:52.363726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:52.363631+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:52.363631+0000","last_clean_scrub_stamp":"2024-09-19T11:17:52.363631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:24:06.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":115,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.236476+0000","last_change":"2024-09-19T11:17:28.236476+0000","last_active":"2024-09-19T11:17:28.236476+0000","last_peered":"2024-09-19T11:17:28.236476+0000","last_clean":"2024-09-19T11:17:28.236476+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:17:28.236476+0000","last_undegraded":"2024-09-19T11:17:28.236476+0000","last_fullsized":"2024-09-19T11:17:28.236476+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:28.236388+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:28.236388+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.236388+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:08.350408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.362051+0000","last_change":"2024-09-19T11:17:06.361981+0000","last_active":"2024-09-19T11:17:06.362051+0000","last_peered":"2024-09-19T11:17:06.362051+0000","last_clean":"2024-09-19T11:17:06.362051+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:17:06.362051+0000","last_undegraded":"2024-09-19T11:17:06.362051+0000","last_fullsized":"2024-09-19T11:17:06.362051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.361895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.368884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.221087+0000","last_change":"2024-09-19T11:17:23.221087+0000","last_active":"2024-09-19T11:17:23.221087+0000","last_peered":"2024-09-19T11:17:23.221087+0000","last_clean":"2024-09-19T11:17:23.221087+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:17:23.221087+0000","last_undegraded":"2024-09-19T11:17:23.221087+0000","last_fullsized":"2024-09-19T11:17:23.221087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:23.221010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:23.221010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.221010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:14.504688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"37'16","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.193229+0000","last_change":"2024-09-19T11:17:32.193229+0000","last_active":"2024-09-19T11:17:32.193229+0000","last_peered":"2024-09-19T11:17:32.193229+0000","last_clean":"2024-09-19T11:17:32.193229+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:17:32.193229+0000","last_undegraded":"2024-09-19T11:17:32.193229+0000","last_fullsized":"2024-09-19T11:17:32.193229+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-19T11:17:32.193122+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-19T11:17:32.193122+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.193122+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:16.365007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'286","reported_seq":394,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:05.166955+0000","last_change":"2024-09-19T11:18:05.166955+0000","last_active":"2024-09-19T11:18:05.166955+0000","last_peered":"2024-09-19T11:18:05.166955+0000","last_clean":"2024-09-19T11:18:05.166955+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:18:05.166955+0000","last_undegraded":"2024-09-19T11:18:05.166955+0000","last_fullsized":"2024-09-19T11:18:05.166955+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:18:05.166831+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:18:05.166831+0000","last_clean_scrub_stamp":"2024-09-19T11:18:05.166831+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:53.562506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.010200+0000","last_change":"2024-09-19T11:17:47.010200+0000","last_active":"2024-09-19T11:17:47.010200+0000","last_peered":"2024-09-19T11:17:47.010200+0000","last_clean":"2024-09-19T11:17:47.010200+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:17:47.010200+0000","last_undegraded":"2024-09-19T11:17:47.010200+0000","last_fullsized":"2024-09-19T11:17:47.010200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.010119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.010119+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.010119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:28.260778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.747257+0000","last_change":"2024-09-19T11:17:11.747257+0000","last_active":"2024-09-19T11:17:11.747257+0000","last_peered":"2024-09-19T11:17:11.747257+0000","last_clean":"2024-09-19T11:17:11.747257+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:17:11.747257+0000","last_undegraded":"2024-09-19T11:17:11.747257+0000","last_fullsized":"2024-09-19T11:17:11.747257+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:11.747153+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:11.747153+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.747153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:25.029210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.839153+0000","last_change":"2024-09-19T11:16:55.839089+0000","last_active":"2024-09-19T11:16:55.839153+0000","last_peered":"2024-09-19T11:16:55.839153+0000","last_clean":"2024-09-19T11:16:55.839153+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:55.839153+0000","last_undegraded":"2024-09-19T11:16:55.839153+0000","last_fullsized":"2024-09-19T11:16:55.839153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.839001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.925106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.279811+0000","last_change":"2024-09-19T11:17:46.279811+0000","last_active":"2024-09-19T11:17:46.279811+0000","last_peered":"2024-09-19T11:17:46.279811+0000","last_clean":"2024-09-19T11:17:46.279811+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:17:46.279811+0000","last_undegraded":"2024-09-19T11:17:46.279811+0000","last_fullsized":"2024-09-19T11:17:46.279811+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.279731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.279731+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.279731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:20.095306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.106584+0000","last_change":"2024-09-19T11:17:35.106584+0000","last_active":"2024-09-19T11:17:35.106584+0000","last_peered":"2024-09-19T11:17:35.106584+0000","last_clean":"2024-09-19T11:17:35.106584+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:17:35.106584+0000","last_undegraded":"2024-09-19T11:17:35.106584+0000","last_fullsized":"2024-09-19T11:17:35.106584+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:35.106490+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:35.106490+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.106490+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:05.221475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":454,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.362406+0000","last_change":"2024-09-19T11:17:45.362406+0000","last_active":"2024-09-19T11:17:45.362406+0000","last_peered":"2024-09-19T11:17:45.362406+0000","last_clean":"2024-09-19T11:17:45.362406+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:17:45.362406+0000","last_undegraded":"2024-09-19T11:17:45.362406+0000","last_fullsized":"2024-09-19T11:17:45.362406+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:45.362319+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:45.362319+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.362319+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.433586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.274262+0000","last_change":"2024-09-19T11:17:27.274193+0000","last_active":"2024-09-19T11:17:27.274262+0000","last_peered":"2024-09-19T11:17:27.274262+0000","last_clean":"2024-09-19T11:17:27.274262+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:17:27.274262+0000","last_undegraded":"2024-09-19T11:17:27.274262+0000","last_fullsized":"2024-09-19T11:17:27.274262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:27.274106+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:27.274106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.274106+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:39.287747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.264020+0000","last_change":"2024-09-19T11:16:57.263964+0000","last_active":"2024-09-19T11:16:57.264020+0000","last_peered":"2024-09-19T11:16:57.264020+0000","last_clean":"2024-09-19T11:16:57.264020+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:16:57.264020+0000","last_undegraded":"2024-09-19T11:16:57.264020+0000","last_fullsized":"2024-09-19T11:16:57.264020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.263877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:17.532651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.362807+0000","last_change":"2024-09-19T11:17:28.362748+0000","last_active":"2024-09-19T11:17:28.362807+0000","last_peered":"2024-09-19T11:17:28.362807+0000","last_clean":"2024-09-19T11:17:28.362807+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:17:28.362807+0000","last_undegraded":"2024-09-19T11:17:28.362807+0000","last_fullsized":"2024-09-19T11:17:28.362807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:28.362667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:28.362667+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.362667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:04.145457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'52","reported_seq":113,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.186689+0000","last_change":"2024-09-19T11:17:29.186611+0000","last_active":"2024-09-19T11:17:29.186689+0000","last_peered":"2024-09-19T11:17:29.186689+0000","last_clean":"2024-09-19T11:17:29.186689+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:17:29.186689+0000","last_undegraded":"2024-09-19T11:17:29.186689+0000","last_fullsized":"2024-09-19T11:17:29.186689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'52","last_scrub_stamp":"2024-09-19T11:17:29.186505+0000","last_deep_scrub":"37'52","last_deep_scrub_stamp":"2024-09-19T11:17:29.186505+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.186505+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:21.134065+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.380342+0000","last_change":"2024-09-19T11:17:43.380288+0000","last_active":"2024-09-19T11:17:43.380342+0000","last_peered":"2024-09-19T11:17:43.380342+0000","last_clean":"2024-09-19T11:17:43.380342+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:17:43.380342+0000","last_undegraded":"2024-09-19T11:17:43.380342+0000","last_fullsized":"2024-09-19T11:17:43.380342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:43.380205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:43.380205+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.380205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:30.582852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.022502+0000","last_change":"2024-09-19T11:17:44.022426+0000","last_active":"2024-09-19T11:17:44.022502+0000","last_peered":"2024-09-19T11:17:44.022502+0000","last_clean":"2024-09-19T11:17:44.022502+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:17:44.022502+0000","last_undegraded":"2024-09-19T11:17:44.022502+0000","last_fullsized":"2024-09-19T11:17:44.022502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:44.022337+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:44.022337+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.022337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:02.202019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.629046+0000","last_change":"2024-09-19T11:17:07.628983+0000","last_active":"2024-09-19T11:17:07.629046+0000","last_peered":"2024-09-19T11:17:07.629046+0000","last_clean":"2024-09-19T11:17:07.629046+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:17:07.629046+0000","last_undegraded":"2024-09-19T11:17:07.629046+0000","last_fullsized":"2024-09-19T11:17:07.629046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.628902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:57.737242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.261712+0000","last_change":"2024-09-19T11:16:56.261648+0000","last_active":"2024-09-19T11:16:56.261712+0000","last_peered":"2024-09-19T11:16:56.261712+0000","last_clean":"2024-09-19T11:16:56.261712+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:16:56.261712+0000","last_undegraded":"2024-09-19T11:16:56.261712+0000","last_fullsized":"2024-09-19T11:16:56.261712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.261557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:54.106719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.638670+0000","last_change":"2024-09-19T11:17:24.638557+0000","last_active":"2024-09-19T11:17:24.638670+0000","last_peered":"2024-09-19T11:17:24.638670+0000","last_clean":"2024-09-19T11:17:24.638670+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:17:24.638670+0000","last_undegraded":"2024-09-19T11:17:24.638670+0000","last_fullsized":"2024-09-19T11:17:24.638670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:24.638460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:24.638460+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.638460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.911135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'37","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:53.178958+0000","last_change":"2024-09-19T11:17:53.178861+0000","last_active":"2024-09-19T11:17:53.178958+0000","last_peered":"2024-09-19T11:17:53.178958+0000","last_clean":"2024-09-19T11:17:53.178958+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:17:53.178958+0000","last_undegraded":"2024-09-19T11:17:53.178958+0000","last_fullsized":"2024-09-19T11:17:53.178958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:53.178746+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:53.178746+0000","last_clean_scrub_stamp":"2024-09-19T11:17:53.178746+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:51.619402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.449273+0000","last_change":"2024-09-19T11:17:40.449204+0000","last_active":"2024-09-19T11:17:40.449273+0000","last_peered":"2024-09-19T11:17:40.449273+0000","last_clean":"2024-09-19T11:17:40.449273+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:17:40.449273+0000","last_undegraded":"2024-09-19T11:17:40.449273+0000","last_fullsized":"2024-09-19T11:17:40.449273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.449101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.449101+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.449101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:25.734676+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'6","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.588389+0000","last_change":"2024-09-19T11:17:47.588313+0000","last_active":"2024-09-19T11:17:47.588389+0000","last_peered":"2024-09-19T11:17:47.588389+0000","last_clean":"2024-09-19T11:17:47.588389+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:17:47.588389+0000","last_undegraded":"2024-09-19T11:17:47.588389+0000","last_fullsized":"2024-09-19T11:17:47.588389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:47.588229+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:47.588229+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.588229+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:48.144904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.203795+0000","last_change":"2024-09-19T11:17:11.203698+0000","last_active":"2024-09-19T11:17:11.203795+0000","last_peered":"2024-09-19T11:17:11.203795+0000","last_clean":"2024-09-19T11:17:11.203795+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:17:11.203795+0000","last_undegraded":"2024-09-19T11:17:11.203795+0000","last_fullsized":"2024-09-19T11:17:11.203795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.203591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:37.021206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.352361+0000","last_change":"2024-09-19T11:17:05.352287+0000","last_active":"2024-09-19T11:17:05.352361+0000","last_peered":"2024-09-19T11:17:05.352361+0000","last_clean":"2024-09-19T11:17:05.352361+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:17:05.352361+0000","last_undegraded":"2024-09-19T11:17:05.352361+0000","last_fullsized":"2024-09-19T11:17:05.352361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.352205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:29.817735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.637911+0000","last_change":"2024-09-19T11:17:25.637805+0000","last_active":"2024-09-19T11:17:25.637911+0000","last_peered":"2024-09-19T11:17:25.637911+0000","last_clean":"2024-09-19T11:17:25.637911+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:17:25.637911+0000","last_undegraded":"2024-09-19T11:17:25.637911+0000","last_fullsized":"2024-09-19T11:17:25.637911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:25.637701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:25.637701+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.637701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:53.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'47","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:51.239646+0000","last_change":"2024-09-19T11:17:51.239589+0000","last_active":"2024-09-19T11:17:51.239646+0000","last_peered":"2024-09-19T11:17:51.239646+0000","last_clean":"2024-09-19T11:17:51.239646+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:17:51.239646+0000","last_undegraded":"2024-09-19T11:17:51.239646+0000","last_fullsized":"2024-09-19T11:17:51.239646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-19T11:17:51.239489+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-19T11:17:51.239489+0000","last_clean_scrub_stamp":"2024-09-19T11:17:51.239489+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:28.050801+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":362,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.429107+0000","last_change":"2024-09-19T11:17:41.429050+0000","last_active":"2024-09-19T11:17:41.429107+0000","last_peered":"2024-09-19T11:17:41.429107+0000","last_clean":"2024-09-19T11:17:41.429107+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:17:41.429107+0000","last_undegraded":"2024-09-19T11:17:41.429107+0000","last_fullsized":"2024-09-19T11:17:41.429107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.428963+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.428963+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.428963+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:39.532132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.362644+0000","last_change":"2024-09-19T11:17:49.362568+0000","last_active":"2024-09-19T11:17:49.362644+0000","last_peered":"2024-09-19T11:17:49.362644+0000","last_clean":"2024-09-19T11:17:49.362644+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:17:49.362644+0000","last_undegraded":"2024-09-19T11:17:49.362644+0000","last_fullsized":"2024-09-19T11:17:49.362644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:49.362468+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:49.362468+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.362468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:56.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.152871+0000","last_change":"2024-09-19T11:17:13.152751+0000","last_active":"2024-09-19T11:17:13.152871+0000","last_peered":"2024-09-19T11:17:13.152871+0000","last_clean":"2024-09-19T11:17:13.152871+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:17:13.152871+0000","last_undegraded":"2024-09-19T11:17:13.152871+0000","last_fullsized":"2024-09-19T11:17:13.152871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.152663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:40.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.373580+0000","last_change":"2024-09-19T11:17:04.373483+0000","last_active":"2024-09-19T11:17:04.373580+0000","last_peered":"2024-09-19T11:17:04.373580+0000","last_clean":"2024-09-19T11:17:04.373580+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:17:04.373580+0000","last_undegraded":"2024-09-19T11:17:04.373580+0000","last_fullsized":"2024-09-19T11:17:04.373580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.373373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:15.731395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.616990+0000","last_change":"2024-09-19T11:17:26.616866+0000","last_active":"2024-09-19T11:17:26.616990+0000","last_peered":"2024-09-19T11:17:26.616990+0000","last_clean":"2024-09-19T11:17:26.616990+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:17:26.616990+0000","last_undegraded":"2024-09-19T11:17:26.616990+0000","last_fullsized":"2024-09-19T11:17:26.616990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:26.616770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:26.616770+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.616770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:29.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'66","reported_seq":140,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:52.209702+0000","last_change":"2024-09-19T11:17:52.209644+0000","last_active":"2024-09-19T11:17:52.209702+0000","last_peered":"2024-09-19T11:17:52.209702+0000","last_clean":"2024-09-19T11:17:52.209702+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:17:52.209702+0000","last_undegraded":"2024-09-19T11:17:52.209702+0000","last_fullsized":"2024-09-19T11:17:52.209702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'66","last_scrub_stamp":"2024-09-19T11:17:52.209547+0000","last_deep_scrub":"37'66","last_deep_scrub_stamp":"2024-09-19T11:17:52.209547+0000","last_clean_scrub_stamp":"2024-09-19T11:17:52.209547+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:41.285238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.440725+0000","last_change":"2024-09-19T11:17:39.440666+0000","last_active":"2024-09-19T11:17:39.440725+0000","last_peered":"2024-09-19T11:17:39.440725+0000","last_clean":"2024-09-19T11:17:39.440725+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:17:39.440725+0000","last_undegraded":"2024-09-19T11:17:39.440725+0000","last_fullsized":"2024-09-19T11:17:39.440725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:39.440562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:39.440562+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.440562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:08.444651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'21","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.360339+0000","last_change":"2024-09-19T11:17:50.360270+0000","last_active":"2024-09-19T11:17:50.360339+0000","last_peered":"2024-09-19T11:17:50.360339+0000","last_clean":"2024-09-19T11:17:50.360339+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:17:50.360339+0000","last_undegraded":"2024-09-19T11:17:50.360339+0000","last_fullsized":"2024-09-19T11:17:50.360339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:50.360181+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:50.360181+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.360181+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:39.947931+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.621561+0000","last_change":"2024-09-19T11:17:11.621448+0000","last_active":"2024-09-19T11:17:11.621561+0000","last_peered":"2024-09-19T11:17:11.621561+0000","last_clean":"2024-09-19T11:17:11.621561+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:17:11.621561+0000","last_undegraded":"2024-09-19T11:17:11.621561+0000","last_fullsized":"2024-09-19T11:17:11.621561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.621356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:31.900753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.780826+0000","last_change":"2024-09-19T11:16:57.780765+0000","last_active":"2024-09-19T11:16:57.780826+0000","last_peered":"2024-09-19T11:16:57.780826+0000","last_clean":"2024-09-19T11:16:57.780826+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:16:57.780826+0000","last_undegraded":"2024-09-19T11:16:57.780826+0000","last_fullsized":"2024-09-19T11:16:57.780826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.780677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:08.322449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.193220+0000","last_change":"2024-09-19T11:17:30.193130+0000","last_active":"2024-09-19T11:17:30.193220+0000","last_peered":"2024-09-19T11:17:30.193220+0000","last_clean":"2024-09-19T11:17:30.193220+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:17:30.193220+0000","last_undegraded":"2024-09-19T11:17:30.193220+0000","last_fullsized":"2024-09-19T11:17:30.193220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.193023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.193023+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.193023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:55.620571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.452716+0000","last_change":"2024-09-19T11:17:38.452625+0000","last_active":"2024-09-19T11:17:38.452716+0000","last_peered":"2024-09-19T11:17:38.452716+0000","last_clean":"2024-09-19T11:17:38.452716+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:17:38.452716+0000","last_undegraded":"2024-09-19T11:17:38.452716+0000","last_fullsized":"2024-09-19T11:17:38.452716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-19T11:17:38.452505+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-19T11:17:38.452505+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.452505+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:22.028550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:03.147011+0000","last_change":"2024-09-19T11:18:03.146944+0000","last_active":"2024-09-19T11:18:03.147011+0000","last_peered":"2024-09-19T11:18:03.147011+0000","last_clean":"2024-09-19T11:18:03.147011+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:18:03.147011+0000","last_undegraded":"2024-09-19T11:18:03.147011+0000","last_fullsized":"2024-09-19T11:18:03.147011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:03.146865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:03.146865+0000","last_clean_scrub_stamp":"2024-09-19T11:18:03.146865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:32.185866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:08.060355+0000","last_change":"2024-09-19T11:18:08.060355+0000","last_active":"2024-09-19T11:18:08.060355+0000","last_peered":"2024-09-19T11:18:08.060355+0000","last_clean":"2024-09-19T11:18:08.060355+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:18:08.060355+0000","last_undegraded":"2024-09-19T11:18:08.060355+0000","last_fullsized":"2024-09-19T11:18:08.060355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:18:08.060269+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:18:08.060269+0000","last_clean_scrub_stamp":"2024-09-19T11:18:08.060269+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:33.720195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.351599+0000","last_change":"2024-09-19T11:17:24.351536+0000","last_active":"2024-09-19T11:17:24.351599+0000","last_peered":"2024-09-19T11:17:24.351599+0000","last_clean":"2024-09-19T11:17:24.351599+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:17:24.351599+0000","last_undegraded":"2024-09-19T11:17:24.351599+0000","last_fullsized":"2024-09-19T11:17:24.351599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:24.351451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:24.351451+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.351451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:00.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.388311+0000","last_change":"2024-09-19T11:17:03.388243+0000","last_active":"2024-09-19T11:17:03.388311+0000","last_peered":"2024-09-19T11:17:03.388311+0000","last_clean":"2024-09-19T11:17:03.388311+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:17:03.388311+0000","last_undegraded":"2024-09-19T11:17:03.388311+0000","last_fullsized":"2024-09-19T11:17:03.388311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.388155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:34.409511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.599908+0000","last_change":"2024-09-19T11:17:27.599833+0000","last_active":"2024-09-19T11:17:27.599908+0000","last_peered":"2024-09-19T11:17:27.599908+0000","last_clean":"2024-09-19T11:17:27.599908+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:17:27.599908+0000","last_undegraded":"2024-09-19T11:17:27.599908+0000","last_fullsized":"2024-09-19T11:17:27.599908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.599747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.599747+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.599747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.745233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'46","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.207360+0000","last_change":"2024-09-19T11:17:31.207279+0000","last_active":"2024-09-19T11:17:31.207360+0000","last_peered":"2024-09-19T11:17:31.207360+0000","last_clean":"2024-09-19T11:17:31.207360+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:17:31.207360+0000","last_undegraded":"2024-09-19T11:17:31.207360+0000","last_fullsized":"2024-09-19T11:17:31.207360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:31.207126+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:31.207126+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.207126+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:27.455684+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":445,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.057465+0000","last_change":"2024-09-19T11:17:38.057407+0000","last_active":"2024-09-19T11:17:38.057465+0000","last_peered":"2024-09-19T11:17:38.057465+0000","last_clean":"2024-09-19T11:17:38.057465+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:17:38.057465+0000","last_undegraded":"2024-09-19T11:17:38.057465+0000","last_fullsized":"2024-09-19T11:17:38.057465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:38.057316+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:38.057316+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.057316+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:05.417830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.385382+0000","last_change":"2024-09-19T11:17:48.385256+0000","last_active":"2024-09-19T11:17:48.385382+0000","last_peered":"2024-09-19T11:17:48.385382+0000","last_clean":"2024-09-19T11:17:48.385382+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:17:48.385382+0000","last_undegraded":"2024-09-19T11:17:48.385382+0000","last_fullsized":"2024-09-19T11:17:48.385382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:17:48.385151+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:17:48.385151+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.385151+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:56.785402+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.194378+0000","last_change":"2024-09-19T11:17:12.194292+0000","last_active":"2024-09-19T11:17:12.194378+0000","last_peered":"2024-09-19T11:17:12.194378+0000","last_clean":"2024-09-19T11:17:12.194378+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:17:12.194378+0000","last_undegraded":"2024-09-19T11:17:12.194378+0000","last_fullsized":"2024-09-19T11:17:12.194378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.194188+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:19.272935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.338606+0000","last_change":"2024-09-19T11:17:02.338513+0000","last_active":"2024-09-19T11:17:02.338606+0000","last_peered":"2024-09-19T11:17:02.338606+0000","last_clean":"2024-09-19T11:17:02.338606+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:17:02.338606+0000","last_undegraded":"2024-09-19T11:17:02.338606+0000","last_fullsized":"2024-09-19T11:17:02.338606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.338404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:05.736888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":429,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.362019+0000","last_change":"2024-09-19T11:17:29.361930+0000","last_active":"2024-09-19T11:17:29.362019+0000","last_peered":"2024-09-19T11:17:29.362019+0000","last_clean":"2024-09-19T11:17:29.362019+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:17:29.362019+0000","last_undegraded":"2024-09-19T11:17:29.362019+0000","last_fullsized":"2024-09-19T11:17:29.362019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:29.361811+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:29.361811+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.361811+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:18.426521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:54.209082+0000","last_change":"2024-09-19T11:17:54.209023+0000","last_active":"2024-09-19T11:17:54.209082+0000","last_peered":"2024-09-19T11:17:54.209082+0000","last_clean":"2024-09-19T11:17:54.209082+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:17:54.209082+0000","last_undegraded":"2024-09-19T11:17:54.209082+0000","last_fullsized":"2024-09-19T11:17:54.209082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:17:54.208933+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:17:54.208933+0000","last_clean_scrub_stamp":"2024-09-19T11:17:54.208933+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:04.200437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":482,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.472509+0000","last_change":"2024-09-19T11:17:40.472448+0000","last_active":"2024-09-19T11:17:40.472509+0000","last_peered":"2024-09-19T11:17:40.472509+0000","last_clean":"2024-09-19T11:17:40.472509+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:17:40.472509+0000","last_undegraded":"2024-09-19T11:17:40.472509+0000","last_fullsized":"2024-09-19T11:17:40.472509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:40.472359+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:40.472359+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.472359+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:23:34.581152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.039406+0000","last_change":"2024-09-19T11:17:43.039305+0000","last_active":"2024-09-19T11:17:43.039406+0000","last_peered":"2024-09-19T11:17:43.039406+0000","last_clean":"2024-09-19T11:17:43.039406+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:17:43.039406+0000","last_undegraded":"2024-09-19T11:17:43.039406+0000","last_fullsized":"2024-09-19T11:17:43.039406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:43.039163+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:43.039163+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.039163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:32.103874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.578535+0000","last_change":"2024-09-19T11:17:09.578446+0000","last_active":"2024-09-19T11:17:09.578535+0000","last_peered":"2024-09-19T11:17:09.578535+0000","last_clean":"2024-09-19T11:17:09.578535+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:17:09.578535+0000","last_undegraded":"2024-09-19T11:17:09.578535+0000","last_fullsized":"2024-09-19T11:17:09.578535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.578340+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:59.479596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.333003+0000","last_change":"2024-09-19T11:16:59.332945+0000","last_active":"2024-09-19T11:16:59.333003+0000","last_peered":"2024-09-19T11:16:59.333003+0000","last_clean":"2024-09-19T11:16:59.333003+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:16:59.333003+0000","last_undegraded":"2024-09-19T11:16:59.333003+0000","last_fullsized":"2024-09-19T11:16:59.333003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.332858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:10.200721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":231,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.276049+0000","last_change":"2024-09-19T11:17:43.275976+0000","last_active":"2024-09-19T11:17:43.276049+0000","last_peered":"2024-09-19T11:17:43.276049+0000","last_clean":"2024-09-19T11:17:43.276049+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:17:43.276049+0000","last_undegraded":"2024-09-19T11:17:43.276049+0000","last_fullsized":"2024-09-19T11:17:43.276049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:43.275885+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:43.275885+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.275885+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:57.031561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'49","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.422529+0000","last_change":"2024-09-19T11:17:37.422473+0000","last_active":"2024-09-19T11:17:37.422529+0000","last_peered":"2024-09-19T11:17:37.422529+0000","last_clean":"2024-09-19T11:17:37.422529+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:17:37.422529+0000","last_undegraded":"2024-09-19T11:17:37.422529+0000","last_fullsized":"2024-09-19T11:17:37.422529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-19T11:17:37.422376+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-19T11:17:37.422376+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.422376+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:50.529884+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.061166+0000","last_change":"2024-09-19T11:17:37.061117+0000","last_active":"2024-09-19T11:17:37.061166+0000","last_peered":"2024-09-19T11:17:37.061166+0000","last_clean":"2024-09-19T11:17:37.061166+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:17:37.061166+0000","last_undegraded":"2024-09-19T11:17:37.061166+0000","last_fullsized":"2024-09-19T11:17:37.061166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.061010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.061010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.061010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:40.292109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'10","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.541622+0000","last_change":"2024-09-19T11:17:48.541558+0000","last_active":"2024-09-19T11:17:48.541622+0000","last_peered":"2024-09-19T11:17:48.541622+0000","last_clean":"2024-09-19T11:17:48.541622+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:17:48.541622+0000","last_undegraded":"2024-09-19T11:17:48.541622+0000","last_fullsized":"2024-09-19T11:17:48.541622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:48.541460+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:48.541460+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.541460+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:19.562815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.322063+0000","last_change":"2024-09-19T11:17:22.321969+0000","last_active":"2024-09-19T11:17:22.322063+0000","last_peered":"2024-09-19T11:17:22.322063+0000","last_clean":"2024-09-19T11:17:22.322063+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:17:22.322063+0000","last_undegraded":"2024-09-19T11:17:22.322063+0000","last_fullsized":"2024-09-19T11:17:22.322063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:22.321856+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:22.321856+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.321856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:33.212561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.790923+0000","last_change":"2024-09-19T11:16:53.790826+0000","last_active":"2024-09-19T11:16:53.790923+0000","last_peered":"2024-09-19T11:16:53.790923+0000","last_clean":"2024-09-19T11:16:53.790923+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:16:53.790923+0000","last_undegraded":"2024-09-19T11:16:53.790923+0000","last_fullsized":"2024-09-19T11:16:53.790923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.790697+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:58.322869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.307176+0000","last_change":"2024-09-19T11:16:57.307111+0000","last_active":"2024-09-19T11:16:57.307176+0000","last_peered":"2024-09-19T11:16:57.307176+0000","last_clean":"2024-09-19T11:16:57.307176+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:16:57.307176+0000","last_undegraded":"2024-09-19T11:16:57.307176+0000","last_fullsized":"2024-09-19T11:16:57.307176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.307030+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:57.423065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.333474+0000","last_change":"2024-09-19T11:17:01.333402+0000","last_active":"2024-09-19T11:17:01.333474+0000","last_peered":"2024-09-19T11:17:01.333474+0000","last_clean":"2024-09-19T11:17:01.333474+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:17:01.333474+0000","last_undegraded":"2024-09-19T11:17:01.333474+0000","last_fullsized":"2024-09-19T11:17:01.333474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.333297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:01.707856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.404308+0000","last_change":"2024-09-19T11:17:27.404242+0000","last_active":"2024-09-19T11:17:27.404308+0000","last_peered":"2024-09-19T11:17:27.404308+0000","last_clean":"2024-09-19T11:17:27.404308+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:17:27.404308+0000","last_undegraded":"2024-09-19T11:17:27.404308+0000","last_fullsized":"2024-09-19T11:17:27.404308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.404158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.404158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.404158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:07.281435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'90","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.264453+0000","last_change":"2024-09-19T11:17:50.264388+0000","last_active":"2024-09-19T11:17:50.264453+0000","last_peered":"2024-09-19T11:17:50.264453+0000","last_clean":"2024-09-19T11:17:50.264453+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:17:50.264453+0000","last_undegraded":"2024-09-19T11:17:50.264453+0000","last_fullsized":"2024-09-19T11:17:50.264453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-19T11:17:50.264288+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-19T11:17:50.264288+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.264288+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:47.595229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.440436+0000","last_change":"2024-09-19T11:17:38.440371+0000","last_active":"2024-09-19T11:17:38.440436+0000","last_peered":"2024-09-19T11:17:38.440436+0000","last_clean":"2024-09-19T11:17:38.440436+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:17:38.440436+0000","last_undegraded":"2024-09-19T11:17:38.440436+0000","last_fullsized":"2024-09-19T11:17:38.440436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:38.440272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:38.440272+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.440272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:01.029191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":173,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.977865+0000","last_change":"2024-09-19T11:17:44.977787+0000","last_active":"2024-09-19T11:17:44.977865+0000","last_peered":"2024-09-19T11:17:44.977865+0000","last_clean":"2024-09-19T11:17:44.977865+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:17:44.977865+0000","last_undegraded":"2024-09-19T11:17:44.977865+0000","last_fullsized":"2024-09-19T11:17:44.977865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'82","last_scrub_stamp":"2024-09-19T11:17:44.977702+0000","last_deep_scrub":"37'82","last_deep_scrub_stamp":"2024-09-19T11:17:44.977702+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.977702+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:20.274518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.320845+0000","last_change":"2024-09-19T11:17:23.320770+0000","last_active":"2024-09-19T11:17:23.320845+0000","last_peered":"2024-09-19T11:17:23.320845+0000","last_clean":"2024-09-19T11:17:23.320845+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:17:23.320845+0000","last_undegraded":"2024-09-19T11:17:23.320845+0000","last_fullsized":"2024-09-19T11:17:23.320845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:23.320681+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:23.320681+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.320681+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:45.331495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.377364+0000","last_change":"2024-09-19T11:16:54.377268+0000","last_active":"2024-09-19T11:16:54.377364+0000","last_peered":"2024-09-19T11:16:54.377364+0000","last_clean":"2024-09-19T11:16:54.377364+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:16:54.377364+0000","last_undegraded":"2024-09-19T11:16:54.377364+0000","last_fullsized":"2024-09-19T11:16:54.377364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.377134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:21.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.869812+0000","last_change":"2024-09-19T11:16:55.869737+0000","last_active":"2024-09-19T11:16:55.869812+0000","last_peered":"2024-09-19T11:16:55.869812+0000","last_clean":"2024-09-19T11:16:55.869812+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:16:55.869812+0000","last_undegraded":"2024-09-19T11:16:55.869812+0000","last_fullsized":"2024-09-19T11:16:55.869812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.869650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:29.264317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.277443+0000","last_change":"2024-09-19T11:17:42.277380+0000","last_active":"2024-09-19T11:17:42.277443+0000","last_peered":"2024-09-19T11:17:42.277443+0000","last_clean":"2024-09-19T11:17:42.277443+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:17:42.277443+0000","last_undegraded":"2024-09-19T11:17:42.277443+0000","last_fullsized":"2024-09-19T11:17:42.277443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.277284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.277284+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.277284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:12.628751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'294","reported_seq":520,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.465318+0000","last_change":"2024-09-19T11:17:36.465237+0000","last_active":"2024-09-19T11:17:36.465318+0000","last_peered":"2024-09-19T11:17:36.465318+0000","last_clean":"2024-09-19T11:17:36.465318+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:17:36.465318+0000","last_undegraded":"2024-09-19T11:17:36.465318+0000","last_fullsized":"2024-09-19T11:17:36.465318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'294","last_scrub_stamp":"2024-09-19T11:17:36.465109+0000","last_deep_scrub":"37'294","last_deep_scrub_stamp":"2024-09-19T11:17:36.465109+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.465109+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:10.849592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:01.147001+0000","last_change":"2024-09-19T11:18:01.147001+0000","last_active":"2024-09-19T11:18:01.147001+0000","last_peered":"2024-09-19T11:18:01.147001+0000","last_clean":"2024-09-19T11:18:01.147001+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:18:01.147001+0000","last_undegraded":"2024-09-19T11:18:01.147001+0000","last_fullsized":"2024-09-19T11:18:01.147001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:01.146895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:01.146895+0000","last_clean_scrub_stamp":"2024-09-19T11:18:01.146895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:21.149062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.519919+0000","last_change":"2024-09-19T11:17:50.519864+0000","last_active":"2024-09-19T11:17:50.519919+0000","last_peered":"2024-09-19T11:17:50.519919+0000","last_clean":"2024-09-19T11:17:50.519919+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:17:50.519919+0000","last_undegraded":"2024-09-19T11:17:50.519919+0000","last_fullsized":"2024-09-19T11:17:50.519919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:50.519733+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:50.519733+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.519733+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:14.985263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.718875+0000","last_change":"2024-09-19T11:17:09.718806+0000","last_active":"2024-09-19T11:17:09.718875+0000","last_peered":"2024-09-19T11:17:09.718875+0000","last_clean":"2024-09-19T11:17:09.718875+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:17:09.718875+0000","last_undegraded":"2024-09-19T11:17:09.718875+0000","last_fullsized":"2024-09-19T11:17:09.718875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.718720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:37.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.199111+0000","last_change":"2024-09-19T11:17:00.199057+0000","last_active":"2024-09-19T11:17:00.199111+0000","last_peered":"2024-09-19T11:17:00.199111+0000","last_clean":"2024-09-19T11:17:00.199111+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:17:00.199111+0000","last_undegraded":"2024-09-19T11:17:00.199111+0000","last_fullsized":"2024-09-19T11:17:00.199111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.198970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:17.702619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.862627+0000","last_change":"2024-09-19T11:16:54.862568+0000","last_active":"2024-09-19T11:16:54.862627+0000","last_peered":"2024-09-19T11:16:54.862627+0000","last_clean":"2024-09-19T11:16:54.862627+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:16:54.862627+0000","last_undegraded":"2024-09-19T11:16:54.862627+0000","last_fullsized":"2024-09-19T11:16:54.862627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.862494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:12.037986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.196444+0000","last_change":"2024-09-19T11:17:21.196383+0000","last_active":"2024-09-19T11:17:21.196444+0000","last_peered":"2024-09-19T11:17:21.196444+0000","last_clean":"2024-09-19T11:17:21.196444+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:17:21.196444+0000","last_undegraded":"2024-09-19T11:17:21.196444+0000","last_fullsized":"2024-09-19T11:17:21.196444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:21.196295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:21.196295+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.196295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:52.011445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'24","reported_seq":102,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.146611+0000","last_change":"2024-09-19T11:17:34.146548+0000","last_active":"2024-09-19T11:17:34.146611+0000","last_peered":"2024-09-19T11:17:34.146611+0000","last_clean":"2024-09-19T11:17:34.146611+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:17:34.146611+0000","last_undegraded":"2024-09-19T11:17:34.146611+0000","last_fullsized":"2024-09-19T11:17:34.146611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-19T11:17:34.146438+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-19T11:17:34.146438+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.146438+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:54.002853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.419254+0000","last_change":"2024-09-19T11:17:37.419197+0000","last_active":"2024-09-19T11:17:37.419254+0000","last_peered":"2024-09-19T11:17:37.419254+0000","last_clean":"2024-09-19T11:17:37.419254+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:17:37.419254+0000","last_undegraded":"2024-09-19T11:17:37.419254+0000","last_fullsized":"2024-09-19T11:17:37.419254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.419097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.419097+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.419097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:05.801332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:09.055771+0000","last_change":"2024-09-19T11:18:09.055708+0000","last_active":"2024-09-19T11:18:09.055771+0000","last_peered":"2024-09-19T11:18:09.055771+0000","last_clean":"2024-09-19T11:18:09.055771+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:18:09.055771+0000","last_undegraded":"2024-09-19T11:18:09.055771+0000","last_fullsized":"2024-09-19T11:18:09.055771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:18:09.055601+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:18:09.055601+0000","last_clean_scrub_stamp":"2024-09-19T11:18:09.055601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:01:52.349592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.741787+0000","last_change":"2024-09-19T11:17:08.741731+0000","last_active":"2024-09-19T11:17:08.741787+0000","last_peered":"2024-09-19T11:17:08.741787+0000","last_clean":"2024-09-19T11:17:08.741787+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:17:08.741787+0000","last_undegraded":"2024-09-19T11:17:08.741787+0000","last_fullsized":"2024-09-19T11:17:08.741787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.741641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:41.893880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.316760+0000","last_change":"2024-09-19T11:16:58.316669+0000","last_active":"2024-09-19T11:16:58.316760+0000","last_peered":"2024-09-19T11:16:58.316760+0000","last_clean":"2024-09-19T11:16:58.316760+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:16:58.316760+0000","last_undegraded":"2024-09-19T11:16:58.316760+0000","last_fullsized":"2024-09-19T11:16:58.316760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.316534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:33.887561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.307701+0000","last_change":"2024-09-19T11:16:55.307594+0000","last_active":"2024-09-19T11:16:55.307701+0000","last_peered":"2024-09-19T11:16:55.307701+0000","last_clean":"2024-09-19T11:16:55.307701+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:16:55.307701+0000","last_undegraded":"2024-09-19T11:16:55.307701+0000","last_fullsized":"2024-09-19T11:16:55.307701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.307489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:24.095008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'5","reported_seq":239,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.685173+0000","last_change":"2024-09-19T11:17:23.685079+0000","last_active":"2024-09-19T11:17:23.685173+0000","last_peered":"2024-09-19T11:17:23.685173+0000","last_clean":"2024-09-19T11:17:23.685173+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:17:23.685173+0000","last_undegraded":"2024-09-19T11:17:23.685173+0000","last_fullsized":"2024-09-19T11:17:23.685173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:23.684978+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:23.684978+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.684978+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:01.177727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'21","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.284844+0000","last_change":"2024-09-19T11:17:48.284720+0000","last_active":"2024-09-19T11:17:48.284844+0000","last_peered":"2024-09-19T11:17:48.284844+0000","last_clean":"2024-09-19T11:17:48.284844+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:17:48.284844+0000","last_undegraded":"2024-09-19T11:17:48.284844+0000","last_fullsized":"2024-09-19T11:17:48.284844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:48.284599+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:48.284599+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.284599+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:20.976592+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:02.137324+0000","last_change":"2024-09-19T11:18:02.137324+0000","last_active":"2024-09-19T11:18:02.137324+0000","last_peered":"2024-09-19T11:18:02.137324+0000","last_clean":"2024-09-19T11:18:02.137324+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:18:02.137324+0000","last_undegraded":"2024-09-19T11:18:02.137324+0000","last_fullsized":"2024-09-19T11:18:02.137324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:02.137244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:02.137244+0000","last_clean_scrub_stamp":"2024-09-19T11:18:02.137244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:22.209925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.560728+0000","last_change":"2024-09-19T11:17:49.560631+0000","last_active":"2024-09-19T11:17:49.560728+0000","last_peered":"2024-09-19T11:17:49.560728+0000","last_clean":"2024-09-19T11:17:49.560728+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:17:49.560728+0000","last_undegraded":"2024-09-19T11:17:49.560728+0000","last_fullsized":"2024-09-19T11:17:49.560728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:49.560534+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:49.560534+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.560534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:54.966372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.597323+0000","last_change":"2024-09-19T11:17:08.597259+0000","last_active":"2024-09-19T11:17:08.597323+0000","last_peered":"2024-09-19T11:17:08.597323+0000","last_clean":"2024-09-19T11:17:08.597323+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:17:08.597323+0000","last_undegraded":"2024-09-19T11:17:08.597323+0000","last_fullsized":"2024-09-19T11:17:08.597323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.597174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:37.364781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.263977+0000","last_change":"2024-09-19T11:16:54.263916+0000","last_active":"2024-09-19T11:16:54.263977+0000","last_peered":"2024-09-19T11:16:54.263977+0000","last_clean":"2024-09-19T11:16:54.263977+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:16:54.263977+0000","last_undegraded":"2024-09-19T11:16:54.263977+0000","last_fullsized":"2024-09-19T11:16:54.263977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.263815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:48.536224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:52.839804+0000","last_change":"2024-09-19T11:16:52.839753+0000","last_active":"2024-09-19T11:16:52.839804+0000","last_peered":"2024-09-19T11:16:52.839804+0000","last_clean":"2024-09-19T11:16:52.839804+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:16:52.839804+0000","last_undegraded":"2024-09-19T11:16:52.839804+0000","last_fullsized":"2024-09-19T11:16:52.839804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_clean_scrub_stamp":"2024-09-19T11:16:52.839679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:51.504665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.721316+0000","last_change":"2024-09-19T11:17:22.721197+0000","last_active":"2024-09-19T11:17:22.721316+0000","last_peered":"2024-09-19T11:17:22.721316+0000","last_clean":"2024-09-19T11:17:22.721316+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:17:22.721316+0000","last_undegraded":"2024-09-19T11:17:22.721316+0000","last_fullsized":"2024-09-19T11:17:22.721316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:22.721097+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:22.721097+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.721097+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:23:27.112253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'78","reported_seq":155,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.586624+0000","last_change":"2024-09-19T11:17:29.586553+0000","last_active":"2024-09-19T11:17:29.586624+0000","last_peered":"2024-09-19T11:17:29.586624+0000","last_clean":"2024-09-19T11:17:29.586624+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:17:29.586624+0000","last_undegraded":"2024-09-19T11:17:29.586624+0000","last_fullsized":"2024-09-19T11:17:29.586624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'78","last_scrub_stamp":"2024-09-19T11:17:29.586456+0000","last_deep_scrub":"37'78","last_deep_scrub_stamp":"2024-09-19T11:17:29.586456+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.586456+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:17.660323+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.057424+0000","last_change":"2024-09-19T11:17:36.057336+0000","last_active":"2024-09-19T11:17:36.057424+0000","last_peered":"2024-09-19T11:17:36.057424+0000","last_clean":"2024-09-19T11:17:36.057424+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:17:36.057424+0000","last_undegraded":"2024-09-19T11:17:36.057424+0000","last_fullsized":"2024-09-19T11:17:36.057424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:36.057220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:36.057220+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.057220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:39.977022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:51.374737+0000","last_change":"2024-09-19T11:17:51.374677+0000","last_active":"2024-09-19T11:17:51.374737+0000","last_peered":"2024-09-19T11:17:51.374737+0000","last_clean":"2024-09-19T11:17:51.374737+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:17:51.374737+0000","last_undegraded":"2024-09-19T11:17:51.374737+0000","last_fullsized":"2024-09-19T11:17:51.374737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:51.374588+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:51.374588+0000","last_clean_scrub_stamp":"2024-09-19T11:17:51.374588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:32.670105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.725584+0000","last_change":"2024-09-19T11:17:05.725498+0000","last_active":"2024-09-19T11:17:05.725584+0000","last_peered":"2024-09-19T11:17:05.725584+0000","last_clean":"2024-09-19T11:17:05.725584+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:17:05.725584+0000","last_undegraded":"2024-09-19T11:17:05.725584+0000","last_fullsized":"2024-09-19T11:17:05.725584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.725349+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:53.167095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.823693+0000","last_change":"2024-09-19T11:16:56.823573+0000","last_active":"2024-09-19T11:16:56.823693+0000","last_peered":"2024-09-19T11:16:56.823693+0000","last_clean":"2024-09-19T11:16:56.823693+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:16:56.823693+0000","last_undegraded":"2024-09-19T11:16:56.823693+0000","last_fullsized":"2024-09-19T11:16:56.823693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.823458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:43.789933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.328867+0000","last_change":"2024-09-19T11:16:55.328783+0000","last_active":"2024-09-19T11:16:55.328867+0000","last_peered":"2024-09-19T11:16:55.328867+0000","last_clean":"2024-09-19T11:16:55.328867+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:16:55.328867+0000","last_undegraded":"2024-09-19T11:16:55.328867+0000","last_fullsized":"2024-09-19T11:16:55.328867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.328699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:16.068678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.321552+0000","last_change":"2024-09-19T11:17:41.321469+0000","last_active":"2024-09-19T11:17:41.321552+0000","last_peered":"2024-09-19T11:17:41.321552+0000","last_clean":"2024-09-19T11:17:41.321552+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:17:41.321552+0000","last_undegraded":"2024-09-19T11:17:41.321552+0000","last_fullsized":"2024-09-19T11:17:41.321552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:41.321345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:41.321345+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.321345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:41.516171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'21","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.472055+0000","last_change":"2024-09-19T11:17:35.471998+0000","last_active":"2024-09-19T11:17:35.472055+0000","last_peered":"2024-09-19T11:17:35.472055+0000","last_clean":"2024-09-19T11:17:35.472055+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:17:35.472055+0000","last_undegraded":"2024-09-19T11:17:35.472055+0000","last_fullsized":"2024-09-19T11:17:35.472055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:35.471898+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:35.471898+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.471898+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:30.288806+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":383,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.502319+0000","last_change":"2024-09-19T11:17:41.502319+0000","last_active":"2024-09-19T11:17:41.502319+0000","last_peered":"2024-09-19T11:17:41.502319+0000","last_clean":"2024-09-19T11:17:41.502319+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:17:41.502319+0000","last_undegraded":"2024-09-19T11:17:41.502319+0000","last_fullsized":"2024-09-19T11:17:41.502319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.502183+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.502183+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.502183+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:48.866065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:11.105470+0000","last_change":"2024-09-19T11:18:11.105379+0000","last_active":"2024-09-19T11:18:11.105470+0000","last_peered":"2024-09-19T11:18:11.105470+0000","last_clean":"2024-09-19T11:18:11.105470+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:18:11.105470+0000","last_undegraded":"2024-09-19T11:18:11.105470+0000","last_fullsized":"2024-09-19T11:18:11.105470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:18:11.105281+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:18:11.105281+0000","last_clean_scrub_stamp":"2024-09-19T11:18:11.105281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:29.068902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.233355+0000","last_change":"2024-09-19T11:17:08.233251+0000","last_active":"2024-09-19T11:17:08.233355+0000","last_peered":"2024-09-19T11:17:08.233355+0000","last_clean":"2024-09-19T11:17:08.233355+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:17:08.233355+0000","last_undegraded":"2024-09-19T11:17:08.233355+0000","last_fullsized":"2024-09-19T11:17:08.233355+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.233135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.372143+0000","last_change":"2024-09-19T11:17:00.372051+0000","last_active":"2024-09-19T11:17:00.372143+0000","last_peered":"2024-09-19T11:17:00.372143+0000","last_clean":"2024-09-19T11:17:00.372143+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:17:00.372143+0000","last_undegraded":"2024-09-19T11:17:00.372143+0000","last_fullsized":"2024-09-19T11:17:00.372143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.371942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:44.482502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.828197+0000","last_change":"2024-09-19T11:16:53.828131+0000","last_active":"2024-09-19T11:16:53.828197+0000","last_peered":"2024-09-19T11:16:53.828197+0000","last_clean":"2024-09-19T11:16:53.828197+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:16:53.828197+0000","last_undegraded":"2024-09-19T11:16:53.828197+0000","last_fullsized":"2024-09-19T11:16:53.828197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.828060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:16.144293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.274921+0000","last_change":"2024-09-19T11:17:40.274866+0000","last_active":"2024-09-19T11:17:40.274921+0000","last_peered":"2024-09-19T11:17:40.274921+0000","last_clean":"2024-09-19T11:17:40.274921+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:17:40.274921+0000","last_undegraded":"2024-09-19T11:17:40.274921+0000","last_fullsized":"2024-09-19T11:17:40.274921+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.274775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.274775+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.274775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:48.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.240723+0000","last_change":"2024-09-19T11:17:49.240723+0000","last_active":"2024-09-19T11:17:49.240723+0000","last_peered":"2024-09-19T11:17:49.240723+0000","last_clean":"2024-09-19T11:17:49.240723+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:17:49.240723+0000","last_undegraded":"2024-09-19T11:17:49.240723+0000","last_fullsized":"2024-09-19T11:17:49.240723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:17:49.240613+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:17:49.240613+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.240613+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:06.458052+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":413,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.347291+0000","last_change":"2024-09-19T11:17:44.347233+0000","last_active":"2024-09-19T11:17:44.347291+0000","last_peered":"2024-09-19T11:17:44.347291+0000","last_clean":"2024-09-19T11:17:44.347291+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:17:44.347291+0000","last_undegraded":"2024-09-19T11:17:44.347291+0000","last_fullsized":"2024-09-19T11:17:44.347291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:44.347136+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:44.347136+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.347136+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:47.855799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:52.525650+0000","last_change":"2024-09-19T11:17:52.525564+0000","last_active":"2024-09-19T11:17:52.525650+0000","last_peered":"2024-09-19T11:17:52.525650+0000","last_clean":"2024-09-19T11:17:52.525650+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:17:52.525650+0000","last_undegraded":"2024-09-19T11:17:52.525650+0000","last_fullsized":"2024-09-19T11:17:52.525650+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:52.525465+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:52.525465+0000","last_clean_scrub_stamp":"2024-09-19T11:17:52.525465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:27.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.157088+0000","last_change":"2024-09-19T11:17:10.156983+0000","last_active":"2024-09-19T11:17:10.157088+0000","last_peered":"2024-09-19T11:17:10.157088+0000","last_clean":"2024-09-19T11:17:10.157088+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:17:10.157088+0000","last_undegraded":"2024-09-19T11:17:10.157088+0000","last_fullsized":"2024-09-19T11:17:10.157088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.156870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:27.088137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.792138+0000","last_change":"2024-09-19T11:16:54.792079+0000","last_active":"2024-09-19T11:16:54.792138+0000","last_peered":"2024-09-19T11:16:54.792138+0000","last_clean":"2024-09-19T11:16:54.792138+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:16:54.792138+0000","last_undegraded":"2024-09-19T11:16:54.792138+0000","last_fullsized":"2024-09-19T11:16:54.792138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.791976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:48.520529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.281155+0000","last_change":"2024-09-19T11:16:56.281102+0000","last_active":"2024-09-19T11:16:56.281155+0000","last_peered":"2024-09-19T11:16:56.281155+0000","last_clean":"2024-09-19T11:16:56.281155+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:16:56.281155+0000","last_undegraded":"2024-09-19T11:16:56.281155+0000","last_fullsized":"2024-09-19T11:16:56.281155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.281013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:47.506937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.147846+0000","last_change":"2024-09-19T11:17:37.147783+0000","last_active":"2024-09-19T11:17:37.147846+0000","last_peered":"2024-09-19T11:17:37.147846+0000","last_clean":"2024-09-19T11:17:37.147846+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:17:37.147846+0000","last_undegraded":"2024-09-19T11:17:37.147846+0000","last_fullsized":"2024-09-19T11:17:37.147846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.147688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.147688+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.147688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:12.774176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'99","reported_seq":193,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.209043+0000","last_change":"2024-09-19T11:17:28.208941+0000","last_active":"2024-09-19T11:17:28.209043+0000","last_peered":"2024-09-19T11:17:28.209043+0000","last_clean":"2024-09-19T11:17:28.209043+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:17:28.209043+0000","last_undegraded":"2024-09-19T11:17:28.209043+0000","last_fullsized":"2024-09-19T11:17:28.209043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'99","last_scrub_stamp":"2024-09-19T11:17:28.208805+0000","last_deep_scrub":"37'99","last_deep_scrub_stamp":"2024-09-19T11:17:28.208805+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.208805+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:39.102011+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.458979+0000","last_change":"2024-09-19T11:17:36.458909+0000","last_active":"2024-09-19T11:17:36.458979+0000","last_peered":"2024-09-19T11:17:36.458979+0000","last_clean":"2024-09-19T11:17:36.458979+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:17:36.458979+0000","last_undegraded":"2024-09-19T11:17:36.458979+0000","last_fullsized":"2024-09-19T11:17:36.458979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:36.458805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:36.458805+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.458805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:16.243718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.990042+0000","last_change":"2024-09-19T11:17:45.989960+0000","last_active":"2024-09-19T11:17:45.990042+0000","last_peered":"2024-09-19T11:17:45.990042+0000","last_clean":"2024-09-19T11:17:45.990042+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:17:45.990042+0000","last_undegraded":"2024-09-19T11:17:45.990042+0000","last_fullsized":"2024-09-19T11:17:45.990042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:45.989883+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:45.989883+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.989883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:19.232601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.015387+0000","last_change":"2024-09-19T11:17:48.015330+0000","last_active":"2024-09-19T11:17:48.015387+0000","last_peered":"2024-09-19T11:17:48.015387+0000","last_clean":"2024-09-19T11:17:48.015387+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:17:48.015387+0000","last_undegraded":"2024-09-19T11:17:48.015387+0000","last_fullsized":"2024-09-19T11:17:48.015387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:48.015242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:48.015242+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.015242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:12.717185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.153222+0000","last_change":"2024-09-19T11:17:14.153164+0000","last_active":"2024-09-19T11:17:14.153222+0000","last_peered":"2024-09-19T11:17:14.153222+0000","last_clean":"2024-09-19T11:17:14.153222+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:17:14.153222+0000","last_undegraded":"2024-09-19T11:17:14.153222+0000","last_fullsized":"2024-09-19T11:17:14.153222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.153066+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.153066+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.153066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:52.353655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.379632+0000","last_change":"2024-09-19T11:17:07.379535+0000","last_active":"2024-09-19T11:17:07.379632+0000","last_peered":"2024-09-19T11:17:07.379632+0000","last_clean":"2024-09-19T11:17:07.379632+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:17:07.379632+0000","last_undegraded":"2024-09-19T11:17:07.379632+0000","last_fullsized":"2024-09-19T11:17:07.379632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.379424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:42.734681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.407910+0000","last_change":"2024-09-19T11:17:30.407910+0000","last_active":"2024-09-19T11:17:30.407910+0000","last_peered":"2024-09-19T11:17:30.407910+0000","last_clean":"2024-09-19T11:17:30.407910+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:17:30.407910+0000","last_undegraded":"2024-09-19T11:17:30.407910+0000","last_fullsized":"2024-09-19T11:17:30.407910+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.407786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.407786+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.407786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:57.738466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'41","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:56.189440+0000","last_change":"2024-09-19T11:17:56.189440+0000","last_active":"2024-09-19T11:17:56.189440+0000","last_peered":"2024-09-19T11:17:56.189440+0000","last_clean":"2024-09-19T11:17:56.189440+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:17:56.189440+0000","last_undegraded":"2024-09-19T11:17:56.189440+0000","last_fullsized":"2024-09-19T11:17:56.189440+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'41","last_scrub_stamp":"2024-09-19T11:17:56.189345+0000","last_deep_scrub":"37'41","last_deep_scrub_stamp":"2024-09-19T11:17:56.189345+0000","last_clean_scrub_stamp":"2024-09-19T11:17:56.189345+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:57.579583+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:04.181079+0000","last_change":"2024-09-19T11:18:04.181079+0000","last_active":"2024-09-19T11:18:04.181079+0000","last_peered":"2024-09-19T11:18:04.181079+0000","last_clean":"2024-09-19T11:18:04.181079+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:18:04.181079+0000","last_undegraded":"2024-09-19T11:18:04.181079+0000","last_fullsized":"2024-09-19T11:18:04.181079+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:04.180980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:04.180980+0000","last_clean_scrub_stamp":"2024-09-19T11:18:04.180980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:10.648765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:55.391638+0000","last_change":"2024-09-19T11:17:55.391638+0000","last_active":"2024-09-19T11:17:55.391638+0000","last_peered":"2024-09-19T11:17:55.391638+0000","last_clean":"2024-09-19T11:17:55.391638+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:17:55.391638+0000","last_undegraded":"2024-09-19T11:17:55.391638+0000","last_fullsized":"2024-09-19T11:17:55.391638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:55.391543+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:55.391543+0000","last_clean_scrub_stamp":"2024-09-19T11:17:55.391543+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:37.719121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.581182+0000","last_change":"2024-09-19T11:17:12.581118+0000","last_active":"2024-09-19T11:17:12.581182+0000","last_peered":"2024-09-19T11:17:12.581182+0000","last_clean":"2024-09-19T11:17:12.581182+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:17:12.581182+0000","last_undegraded":"2024-09-19T11:17:12.581182+0000","last_fullsized":"2024-09-19T11:17:12.581182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.581034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:57.494890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.268509+0000","last_change":"2024-09-19T11:16:58.268509+0000","last_active":"2024-09-19T11:16:58.268509+0000","last_peered":"2024-09-19T11:16:58.268509+0000","last_clean":"2024-09-19T11:16:58.268509+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:58.268509+0000","last_undegraded":"2024-09-19T11:16:58.268509+0000","last_fullsized":"2024-09-19T11:16:58.268509+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.268398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:22.542212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.277952+0000","last_change":"2024-09-19T11:17:45.277952+0000","last_active":"2024-09-19T11:17:45.277952+0000","last_peered":"2024-09-19T11:17:45.277952+0000","last_clean":"2024-09-19T11:17:45.277952+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:17:45.277952+0000","last_undegraded":"2024-09-19T11:17:45.277952+0000","last_fullsized":"2024-09-19T11:17:45.277952+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:45.277802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:45.277802+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.277802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:50.986720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'9","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.538677+0000","last_change":"2024-09-19T11:17:31.538677+0000","last_active":"2024-09-19T11:17:31.538677+0000","last_peered":"2024-09-19T11:17:31.538677+0000","last_clean":"2024-09-19T11:17:31.538677+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:17:31.538677+0000","last_undegraded":"2024-09-19T11:17:31.538677+0000","last_fullsized":"2024-09-19T11:17:31.538677+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:31.538593+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:31.538593+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.538593+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:28.785147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.014183+0000","last_change":"2024-09-19T11:17:39.014183+0000","last_active":"2024-09-19T11:17:39.014183+0000","last_peered":"2024-09-19T11:17:39.014183+0000","last_clean":"2024-09-19T11:17:39.014183+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:17:39.014183+0000","last_undegraded":"2024-09-19T11:17:39.014183+0000","last_fullsized":"2024-09-19T11:17:39.014183+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:39.014095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:39.014095+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.014095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:38.689899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:53.379329+0000","last_change":"2024-09-19T11:17:53.379329+0000","last_active":"2024-09-19T11:17:53.379329+0000","last_peered":"2024-09-19T11:17:53.379329+0000","last_clean":"2024-09-19T11:17:53.379329+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:17:53.379329+0000","last_undegraded":"2024-09-19T11:17:53.379329+0000","last_fullsized":"2024-09-19T11:17:53.379329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:53.379237+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:53.379237+0000","last_clean_scrub_stamp":"2024-09-19T11:17:53.379237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:07.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":95,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.725166+0000","last_change":"2024-09-19T11:17:10.725166+0000","last_active":"2024-09-19T11:17:10.725166+0000","last_peered":"2024-09-19T11:17:10.725166+0000","last_clean":"2024-09-19T11:17:10.725166+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:17:10.725166+0000","last_undegraded":"2024-09-19T11:17:10.725166+0000","last_fullsized":"2024-09-19T11:17:10.725166+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'28","last_scrub_stamp":"2024-09-19T11:17:10.725079+0000","last_deep_scrub":"37'28","last_deep_scrub_stamp":"2024-09-19T11:17:10.725079+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.725079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.826693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.156246+0000","last_change":"2024-09-19T11:17:01.156246+0000","last_active":"2024-09-19T11:17:01.156246+0000","last_peered":"2024-09-19T11:17:01.156246+0000","last_clean":"2024-09-19T11:17:01.156246+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:17:01.156246+0000","last_undegraded":"2024-09-19T11:17:01.156246+0000","last_fullsized":"2024-09-19T11:17:01.156246+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.156158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:03.371804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.188298+0000","last_change":"2024-09-19T11:17:22.188298+0000","last_active":"2024-09-19T11:17:22.188298+0000","last_peered":"2024-09-19T11:17:22.188298+0000","last_clean":"2024-09-19T11:17:22.188298+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:17:22.188298+0000","last_undegraded":"2024-09-19T11:17:22.188298+0000","last_fullsized":"2024-09-19T11:17:22.188298+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:22.188209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:22.188209+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.188209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:11.101131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'53","reported_seq":125,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.565820+0000","last_change":"2024-09-19T11:17:32.565820+0000","last_active":"2024-09-19T11:17:32.565820+0000","last_peered":"2024-09-19T11:17:32.565820+0000","last_clean":"2024-09-19T11:17:32.565820+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:17:32.565820+0000","last_undegraded":"2024-09-19T11:17:32.565820+0000","last_fullsized":"2024-09-19T11:17:32.565820+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'53","last_scrub_stamp":"2024-09-19T11:17:32.565716+0000","last_deep_scrub":"37'53","last_deep_scrub_stamp":"2024-09-19T11:17:32.565716+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.565716+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:51.087241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.468303+0000","last_change":"2024-09-19T11:17:43.468303+0000","last_active":"2024-09-19T11:17:43.468303+0000","last_peered":"2024-09-19T11:17:43.468303+0000","last_clean":"2024-09-19T11:17:43.468303+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:17:43.468303+0000","last_undegraded":"2024-09-19T11:17:43.468303+0000","last_fullsized":"2024-09-19T11:17:43.468303+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:43.468222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:43.468222+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.468222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:19.039248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":18,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.585207+0000","last_change":"2024-09-19T11:13:41.390580+0000","last_active":"2024-09-19T11:14:07.585207+0000","last_peered":"2024-09-19T11:14:07.585207+0000","last_clean":"2024-09-19T11:14:07.585207+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:14:07.585207+0000","last_undegraded":"2024-09-19T11:14:07.585207+0000","last_fullsized":"2024-09-19T11:14:07.585207+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:49:00.635835+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.363404+0000","last_change":"2024-09-19T11:17:25.363346+0000","last_active":"2024-09-19T11:17:25.363404+0000","last_peered":"2024-09-19T11:17:25.363404+0000","last_clean":"2024-09-19T11:17:25.363404+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:17:25.363404+0000","last_undegraded":"2024-09-19T11:17:25.363404+0000","last_fullsized":"2024-09-19T11:17:25.363404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:25.363259+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:25.363259+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.363259+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:06.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.807882+0000","last_change":"2024-09-19T11:16:56.807882+0000","last_active":"2024-09-19T11:16:56.807882+0000","last_peered":"2024-09-19T11:16:56.807882+0000","last_clean":"2024-09-19T11:16:56.807882+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:16:56.807882+0000","last_undegraded":"2024-09-19T11:16:56.807882+0000","last_fullsized":"2024-09-19T11:16:56.807882+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.807762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:02.356623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.230807+0000","last_change":"2024-09-19T11:17:44.230807+0000","last_active":"2024-09-19T11:17:44.230807+0000","last_peered":"2024-09-19T11:17:44.230807+0000","last_clean":"2024-09-19T11:17:44.230807+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:17:44.230807+0000","last_undegraded":"2024-09-19T11:17:44.230807+0000","last_fullsized":"2024-09-19T11:17:44.230807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:44.230727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:44.230727+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.230727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:41.189606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.160418+0000","last_change":"2024-09-19T11:17:33.160418+0000","last_active":"2024-09-19T11:17:33.160418+0000","last_peered":"2024-09-19T11:17:33.160418+0000","last_clean":"2024-09-19T11:17:33.160418+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:17:33.160418+0000","last_undegraded":"2024-09-19T11:17:33.160418+0000","last_fullsized":"2024-09-19T11:17:33.160418+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:33.160294+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:33.160294+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.160294+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:02.908387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.045394+0000","last_change":"2024-09-19T11:17:40.045394+0000","last_active":"2024-09-19T11:17:40.045394+0000","last_peered":"2024-09-19T11:17:40.045394+0000","last_clean":"2024-09-19T11:17:40.045394+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:17:40.045394+0000","last_undegraded":"2024-09-19T11:17:40.045394+0000","last_fullsized":"2024-09-19T11:17:40.045394+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.045302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.045302+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.045302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:49.341485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.176645+0000","last_change":"2024-09-19T11:17:31.176586+0000","last_active":"2024-09-19T11:17:31.176645+0000","last_peered":"2024-09-19T11:17:31.176645+0000","last_clean":"2024-09-19T11:17:31.176645+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:17:31.176645+0000","last_undegraded":"2024-09-19T11:17:31.176645+0000","last_fullsized":"2024-09-19T11:17:31.176645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:31.176498+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:31.176498+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.176498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:33.234114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.296208+0000","last_change":"2024-09-19T11:17:09.296208+0000","last_active":"2024-09-19T11:17:09.296208+0000","last_peered":"2024-09-19T11:17:09.296208+0000","last_clean":"2024-09-19T11:17:09.296208+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:17:09.296208+0000","last_undegraded":"2024-09-19T11:17:09.296208+0000","last_fullsized":"2024-09-19T11:17:09.296208+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.296106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:23.893467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.586130+0000","last_change":"2024-09-19T11:17:28.586019+0000","last_active":"2024-09-19T11:17:28.586130+0000","last_peered":"2024-09-19T11:17:28.586130+0000","last_clean":"2024-09-19T11:17:28.586130+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:17:28.586130+0000","last_undegraded":"2024-09-19T11:17:28.586130+0000","last_fullsized":"2024-09-19T11:17:28.586130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:28.585927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:28.585927+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.585927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:09.150774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'68","reported_seq":141,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.522177+0000","last_change":"2024-09-19T11:17:33.522177+0000","last_active":"2024-09-19T11:17:33.522177+0000","last_peered":"2024-09-19T11:17:33.522177+0000","last_clean":"2024-09-19T11:17:33.522177+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:17:33.522177+0000","last_undegraded":"2024-09-19T11:17:33.522177+0000","last_fullsized":"2024-09-19T11:17:33.522177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'68","last_scrub_stamp":"2024-09-19T11:17:33.522086+0000","last_deep_scrub":"37'68","last_deep_scrub_stamp":"2024-09-19T11:17:33.522086+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.522086+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.769122+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.020270+0000","last_change":"2024-09-19T11:17:42.020270+0000","last_active":"2024-09-19T11:17:42.020270+0000","last_peered":"2024-09-19T11:17:42.020270+0000","last_clean":"2024-09-19T11:17:42.020270+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:17:42.020270+0000","last_undegraded":"2024-09-19T11:17:42.020270+0000","last_fullsized":"2024-09-19T11:17:42.020270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.020162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.020162+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.020162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:17.802952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:54.416247+0000","last_change":"2024-09-19T11:17:54.416247+0000","last_active":"2024-09-19T11:17:54.416247+0000","last_peered":"2024-09-19T11:17:54.416247+0000","last_clean":"2024-09-19T11:17:54.416247+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:17:54.416247+0000","last_undegraded":"2024-09-19T11:17:54.416247+0000","last_fullsized":"2024-09-19T11:17:54.416247+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:54.416156+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:54.416156+0000","last_clean_scrub_stamp":"2024-09-19T11:17:54.416156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:20.882489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.721545+0000","last_change":"2024-09-19T11:17:13.721487+0000","last_active":"2024-09-19T11:17:13.721545+0000","last_peered":"2024-09-19T11:17:13.721545+0000","last_clean":"2024-09-19T11:17:13.721545+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:17:13.721545+0000","last_undegraded":"2024-09-19T11:17:13.721545+0000","last_fullsized":"2024-09-19T11:17:13.721545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:13.721403+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:13.721403+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.721403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:48.967350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'2","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.838965+0000","last_change":"2024-09-19T11:16:57.838965+0000","last_active":"2024-09-19T11:16:57.838965+0000","last_peered":"2024-09-19T11:16:57.838965+0000","last_clean":"2024-09-19T11:16:57.838965+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:16:57.838965+0000","last_undegraded":"2024-09-19T11:16:57.838965+0000","last_fullsized":"2024-09-19T11:16:57.838965+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.838852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:23.656467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.187957+0000","last_change":"2024-09-19T11:17:27.187901+0000","last_active":"2024-09-19T11:17:27.187957+0000","last_peered":"2024-09-19T11:17:27.187957+0000","last_clean":"2024-09-19T11:17:27.187957+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:17:27.187957+0000","last_undegraded":"2024-09-19T11:17:27.187957+0000","last_fullsized":"2024-09-19T11:17:27.187957+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.187800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.187800+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.187800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:39.803035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:59.155201+0000","last_change":"2024-09-19T11:17:59.155201+0000","last_active":"2024-09-19T11:17:59.155201+0000","last_peered":"2024-09-19T11:17:59.155201+0000","last_clean":"2024-09-19T11:17:59.155201+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:17:59.155201+0000","last_undegraded":"2024-09-19T11:17:59.155201+0000","last_fullsized":"2024-09-19T11:17:59.155201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:59.155111+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:59.155111+0000","last_clean_scrub_stamp":"2024-09-19T11:17:59.155111+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:15.412903+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.538807+0000","last_change":"2024-09-19T11:17:46.538807+0000","last_active":"2024-09-19T11:17:46.538807+0000","last_peered":"2024-09-19T11:17:46.538807+0000","last_clean":"2024-09-19T11:17:46.538807+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:17:46.538807+0000","last_undegraded":"2024-09-19T11:17:46.538807+0000","last_fullsized":"2024-09-19T11:17:46.538807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.538721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.538721+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.538721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:25.235263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:12.131559+0000","last_change":"2024-09-19T11:18:12.131559+0000","last_active":"2024-09-19T11:18:12.131559+0000","last_peered":"2024-09-19T11:18:12.131559+0000","last_clean":"2024-09-19T11:18:12.131559+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:18:12.131559+0000","last_undegraded":"2024-09-19T11:18:12.131559+0000","last_fullsized":"2024-09-19T11:18:12.131559+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:12.131462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:12.131462+0000","last_clean_scrub_stamp":"2024-09-19T11:18:12.131462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:18.445886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.175615+0000","last_change":"2024-09-19T11:17:30.175615+0000","last_active":"2024-09-19T11:17:30.175615+0000","last_peered":"2024-09-19T11:17:30.175615+0000","last_clean":"2024-09-19T11:17:30.175615+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:17:30.175615+0000","last_undegraded":"2024-09-19T11:17:30.175615+0000","last_fullsized":"2024-09-19T11:17:30.175615+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:30.175521+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:30.175521+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.175521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:13.579750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.764477+0000","last_change":"2024-09-19T11:17:00.764477+0000","last_active":"2024-09-19T11:17:00.764477+0000","last_peered":"2024-09-19T11:17:00.764477+0000","last_clean":"2024-09-19T11:17:00.764477+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:00.764477+0000","last_undegraded":"2024-09-19T11:17:00.764477+0000","last_fullsized":"2024-09-19T11:17:00.764477+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.764391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:38.964980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.195577+0000","last_change":"2024-09-19T11:17:26.195577+0000","last_active":"2024-09-19T11:17:26.195577+0000","last_peered":"2024-09-19T11:17:26.195577+0000","last_clean":"2024-09-19T11:17:26.195577+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:17:26.195577+0000","last_undegraded":"2024-09-19T11:17:26.195577+0000","last_fullsized":"2024-09-19T11:17:26.195577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:26.195490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:26.195490+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.195490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:53.553614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.462354+0000","last_change":"2024-09-19T11:17:35.462297+0000","last_active":"2024-09-19T11:17:35.462354+0000","last_peered":"2024-09-19T11:17:35.462354+0000","last_clean":"2024-09-19T11:17:35.462354+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:17:35.462354+0000","last_undegraded":"2024-09-19T11:17:35.462354+0000","last_fullsized":"2024-09-19T11:17:35.462354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-19T11:17:35.462227+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-19T11:17:35.462227+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.462227+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:37.754391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.381425+0000","last_change":"2024-09-19T11:17:46.381425+0000","last_active":"2024-09-19T11:17:46.381425+0000","last_peered":"2024-09-19T11:17:46.381425+0000","last_clean":"2024-09-19T11:17:46.381425+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:17:46.381425+0000","last_undegraded":"2024-09-19T11:17:46.381425+0000","last_fullsized":"2024-09-19T11:17:46.381425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.381325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.381325+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.381325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:01.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:42.092425+0000","last_change":"2024-09-19T11:13:41.392005+0000","last_active":"2024-09-19T11:15:42.092425+0000","last_peered":"2024-09-19T11:15:42.092425+0000","last_clean":"2024-09-19T11:15:42.092425+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:15:42.092425+0000","last_undegraded":"2024-09-19T11:15:42.092425+0000","last_fullsized":"2024-09-19T11:15:42.092425+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:16:49.976836+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.746563+0000","last_change":"2024-09-19T11:17:12.746563+0000","last_active":"2024-09-19T11:17:12.746563+0000","last_peered":"2024-09-19T11:17:12.746563+0000","last_clean":"2024-09-19T11:17:12.746563+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:17:12.746563+0000","last_undegraded":"2024-09-19T11:17:12.746563+0000","last_fullsized":"2024-09-19T11:17:12.746563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:12.746480+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:12.746480+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.746480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:26.217232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.268148+0000","last_change":"2024-09-19T11:17:10.268148+0000","last_active":"2024-09-19T11:17:10.268148+0000","last_peered":"2024-09-19T11:17:10.268148+0000","last_clean":"2024-09-19T11:17:10.268148+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:17:10.268148+0000","last_undegraded":"2024-09-19T11:17:10.268148+0000","last_fullsized":"2024-09-19T11:17:10.268148+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.268062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:30.958036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.398503+0000","last_change":"2024-09-19T11:17:33.398503+0000","last_active":"2024-09-19T11:17:33.398503+0000","last_peered":"2024-09-19T11:17:33.398503+0000","last_clean":"2024-09-19T11:17:33.398503+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:17:33.398503+0000","last_undegraded":"2024-09-19T11:17:33.398503+0000","last_fullsized":"2024-09-19T11:17:33.398503+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:33.398408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:33.398408+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.398408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:14.649067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:00.112617+0000","last_change":"2024-09-19T11:18:00.112617+0000","last_active":"2024-09-19T11:18:00.112617+0000","last_peered":"2024-09-19T11:18:00.112617+0000","last_clean":"2024-09-19T11:18:00.112617+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:18:00.112617+0000","last_undegraded":"2024-09-19T11:18:00.112617+0000","last_fullsized":"2024-09-19T11:18:00.112617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:18:00.112520+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:18:00.112520+0000","last_clean_scrub_stamp":"2024-09-19T11:18:00.112520+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:46.993426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":380,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.066585+0000","last_change":"2024-09-19T11:17:41.066531+0000","last_active":"2024-09-19T11:17:41.066585+0000","last_peered":"2024-09-19T11:17:41.066585+0000","last_clean":"2024-09-19T11:17:41.066585+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:17:41.066585+0000","last_undegraded":"2024-09-19T11:17:41.066585+0000","last_fullsized":"2024-09-19T11:17:41.066585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.066452+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.066452+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.066452+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:20.943729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:10.095480+0000","last_change":"2024-09-19T11:18:10.095480+0000","last_active":"2024-09-19T11:18:10.095480+0000","last_peered":"2024-09-19T11:18:10.095480+0000","last_clean":"2024-09-19T11:18:10.095480+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:18:10.095480+0000","last_undegraded":"2024-09-19T11:18:10.095480+0000","last_fullsized":"2024-09-19T11:18:10.095480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:10.095365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:10.095365+0000","last_clean_scrub_stamp":"2024-09-19T11:18:10.095365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:51.738454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.171870+0000","last_change":"2024-09-19T11:17:17.171870+0000","last_active":"2024-09-19T11:17:17.171870+0000","last_peered":"2024-09-19T11:17:17.171870+0000","last_clean":"2024-09-19T11:17:17.171870+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:17:17.171870+0000","last_undegraded":"2024-09-19T11:17:17.171870+0000","last_fullsized":"2024-09-19T11:17:17.171870+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:17.171787+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:17.171787+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.171787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:10.154837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.807595+0000","last_change":"2024-09-19T11:16:59.807595+0000","last_active":"2024-09-19T11:16:59.807595+0000","last_peered":"2024-09-19T11:16:59.807595+0000","last_clean":"2024-09-19T11:16:59.807595+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:16:59.807595+0000","last_undegraded":"2024-09-19T11:16:59.807595+0000","last_fullsized":"2024-09-19T11:16:59.807595+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.807508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:27.508908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.437875+0000","last_change":"2024-09-19T11:17:34.437875+0000","last_active":"2024-09-19T11:17:34.437875+0000","last_peered":"2024-09-19T11:17:34.437875+0000","last_clean":"2024-09-19T11:17:34.437875+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:17:34.437875+0000","last_undegraded":"2024-09-19T11:17:34.437875+0000","last_fullsized":"2024-09-19T11:17:34.437875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:34.437786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:34.437786+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.437786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:35.544859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.478113+0000","last_change":"2024-09-19T11:17:42.478113+0000","last_active":"2024-09-19T11:17:42.478113+0000","last_peered":"2024-09-19T11:17:42.478113+0000","last_clean":"2024-09-19T11:17:42.478113+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:17:42.478113+0000","last_undegraded":"2024-09-19T11:17:42.478113+0000","last_fullsized":"2024-09-19T11:17:42.478113+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:42.478011+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:42.478011+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.478011+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:42.594047+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.424937+0000","last_change":"2024-09-19T11:17:42.424937+0000","last_active":"2024-09-19T11:17:42.424937+0000","last_peered":"2024-09-19T11:17:42.424937+0000","last_clean":"2024-09-19T11:17:42.424937+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:17:42.424937+0000","last_undegraded":"2024-09-19T11:17:42.424937+0000","last_fullsized":"2024-09-19T11:17:42.424937+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.424842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.424842+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.424842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:20.215639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:51.509936+0000","last_change":"2024-09-19T11:17:51.509936+0000","last_active":"2024-09-19T11:17:51.509936+0000","last_peered":"2024-09-19T11:17:51.509936+0000","last_clean":"2024-09-19T11:17:51.509936+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:17:51.509936+0000","last_undegraded":"2024-09-19T11:17:51.509936+0000","last_fullsized":"2024-09-19T11:17:51.509936+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:51.509852+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:51.509852+0000","last_clean_scrub_stamp":"2024-09-19T11:17:51.509852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:49.516841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.121964+0000","last_change":"2024-09-19T11:17:16.121964+0000","last_active":"2024-09-19T11:17:16.121964+0000","last_peered":"2024-09-19T11:17:16.121964+0000","last_clean":"2024-09-19T11:17:16.121964+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:17:16.121964+0000","last_undegraded":"2024-09-19T11:17:16.121964+0000","last_fullsized":"2024-09-19T11:17:16.121964+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:16.121888+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:16.121888+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.121888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:08.494191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.243754+0000","last_change":"2024-09-19T11:17:11.243754+0000","last_active":"2024-09-19T11:17:11.243754+0000","last_peered":"2024-09-19T11:17:11.243754+0000","last_clean":"2024-09-19T11:17:11.243754+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:17:11.243754+0000","last_undegraded":"2024-09-19T11:17:11.243754+0000","last_fullsized":"2024-09-19T11:17:11.243754+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.243640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.224247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.146894+0000","last_change":"2024-09-19T11:17:25.146894+0000","last_active":"2024-09-19T11:17:25.146894+0000","last_peered":"2024-09-19T11:17:25.146894+0000","last_clean":"2024-09-19T11:17:25.146894+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:17:25.146894+0000","last_undegraded":"2024-09-19T11:17:25.146894+0000","last_fullsized":"2024-09-19T11:17:25.146894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:25.146791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:25.146791+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.146791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:14.070250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'37","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.486467+0000","last_change":"2024-09-19T11:17:34.486467+0000","last_active":"2024-09-19T11:17:34.486467+0000","last_peered":"2024-09-19T11:17:34.486467+0000","last_clean":"2024-09-19T11:17:34.486467+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:17:34.486467+0000","last_undegraded":"2024-09-19T11:17:34.486467+0000","last_fullsized":"2024-09-19T11:17:34.486467+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:34.486360+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:34.486360+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.486360+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:46.730904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:06.120054+0000","last_change":"2024-09-19T11:18:06.120054+0000","last_active":"2024-09-19T11:18:06.120054+0000","last_peered":"2024-09-19T11:18:06.120054+0000","last_clean":"2024-09-19T11:18:06.120054+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:18:06.120054+0000","last_undegraded":"2024-09-19T11:18:06.120054+0000","last_fullsized":"2024-09-19T11:18:06.120054+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:06.119932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:06.119932+0000","last_clean_scrub_stamp":"2024-09-19T11:18:06.119932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:21.942363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":21,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:14:07.586387+0000","last_change":"2024-09-19T11:13:41.394164+0000","last_active":"2024-09-19T11:14:07.586387+0000","last_peered":"2024-09-19T11:14:07.586387+0000","last_clean":"2024-09-19T11:14:07.586387+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:14:07.586387+0000","last_undegraded":"2024-09-19T11:14:07.586387+0000","last_fullsized":"2024-09-19T11:14:07.586387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:51.249643+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'6","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.164729+0000","last_change":"2024-09-19T11:17:32.164729+0000","last_active":"2024-09-19T11:17:32.164729+0000","last_peered":"2024-09-19T11:17:32.164729+0000","last_clean":"2024-09-19T11:17:32.164729+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:17:32.164729+0000","last_undegraded":"2024-09-19T11:17:32.164729+0000","last_fullsized":"2024-09-19T11:17:32.164729+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:32.164637+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:32.164637+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.164637+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:28.206282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.736085+0000","last_change":"2024-09-19T11:16:58.736025+0000","last_active":"2024-09-19T11:16:58.736085+0000","last_peered":"2024-09-19T11:16:58.736085+0000","last_clean":"2024-09-19T11:16:58.736085+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:16:58.736085+0000","last_undegraded":"2024-09-19T11:16:58.736085+0000","last_fullsized":"2024-09-19T11:16:58.736085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.735931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:08.584806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.437955+0000","last_change":"2024-09-19T11:17:31.437955+0000","last_active":"2024-09-19T11:17:31.437955+0000","last_peered":"2024-09-19T11:17:31.437955+0000","last_clean":"2024-09-19T11:17:31.437955+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:17:31.437955+0000","last_undegraded":"2024-09-19T11:17:31.437955+0000","last_fullsized":"2024-09-19T11:17:31.437955+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:31.437866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:31.437866+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.437866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.484126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'31","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:58.179630+0000","last_change":"2024-09-19T11:17:58.179630+0000","last_active":"2024-09-19T11:17:58.179630+0000","last_peered":"2024-09-19T11:17:58.179630+0000","last_clean":"2024-09-19T11:17:58.179630+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:17:58.179630+0000","last_undegraded":"2024-09-19T11:17:58.179630+0000","last_fullsized":"2024-09-19T11:17:58.179630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'31","last_scrub_stamp":"2024-09-19T11:17:58.179544+0000","last_deep_scrub":"37'31","last_deep_scrub_stamp":"2024-09-19T11:17:58.179544+0000","last_clean_scrub_stamp":"2024-09-19T11:17:58.179544+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:12.714793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:07.073190+0000","last_change":"2024-09-19T11:18:07.073190+0000","last_active":"2024-09-19T11:18:07.073190+0000","last_peered":"2024-09-19T11:18:07.073190+0000","last_clean":"2024-09-19T11:18:07.073190+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:18:07.073190+0000","last_undegraded":"2024-09-19T11:18:07.073190+0000","last_fullsized":"2024-09-19T11:18:07.073190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:07.073100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:07.073100+0000","last_clean_scrub_stamp":"2024-09-19T11:18:07.073100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:13.111081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":22,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:15:40.362489+0000","last_change":"2024-09-19T11:13:41.393750+0000","last_active":"2024-09-19T11:15:40.362489+0000","last_peered":"2024-09-19T11:15:40.362489+0000","last_clean":"2024-09-19T11:15:40.362489+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:15:40.362489+0000","last_undegraded":"2024-09-19T11:15:40.362489+0000","last_fullsized":"2024-09-19T11:15:40.362489+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:13:40.356437+0000","last_clean_scrub_stamp":"2024-09-19T11:13:40.356437+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:10:29.365114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":92,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.128091+0000","last_change":"2024-09-19T11:17:15.128091+0000","last_active":"2024-09-19T11:17:15.128091+0000","last_peered":"2024-09-19T11:17:15.128091+0000","last_clean":"2024-09-19T11:17:15.128091+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:17:15.128091+0000","last_undegraded":"2024-09-19T11:17:15.128091+0000","last_fullsized":"2024-09-19T11:17:15.128091+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:15.128006+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:15.128006+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.128006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:38.994206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.841225+0000","last_change":"2024-09-19T11:16:58.841145+0000","last_active":"2024-09-19T11:16:58.841225+0000","last_peered":"2024-09-19T11:16:58.841225+0000","last_clean":"2024-09-19T11:16:58.841225+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:58.841225+0000","last_undegraded":"2024-09-19T11:16:58.841225+0000","last_fullsized":"2024-09-19T11:16:58.841225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.841052+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:37.793058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.410120+0000","last_change":"2024-09-19T11:17:32.410120+0000","last_active":"2024-09-19T11:17:32.410120+0000","last_peered":"2024-09-19T11:17:32.410120+0000","last_clean":"2024-09-19T11:17:32.410120+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:17:32.410120+0000","last_undegraded":"2024-09-19T11:17:32.410120+0000","last_fullsized":"2024-09-19T11:17:32.410120+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:32.410031+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:32.410031+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.410031+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:05.652748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'42","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:57.138575+0000","last_change":"2024-09-19T11:17:57.138575+0000","last_active":"2024-09-19T11:17:57.138575+0000","last_peered":"2024-09-19T11:17:57.138575+0000","last_clean":"2024-09-19T11:17:57.138575+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:17:57.138575+0000","last_undegraded":"2024-09-19T11:17:57.138575+0000","last_fullsized":"2024-09-19T11:17:57.138575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'42","last_scrub_stamp":"2024-09-19T11:17:57.138463+0000","last_deep_scrub":"37'42","last_deep_scrub_stamp":"2024-09-19T11:17:57.138463+0000","last_clean_scrub_stamp":"2024-09-19T11:17:57.138463+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:55.487581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.399439+0000","last_change":"2024-09-19T11:17:47.399439+0000","last_active":"2024-09-19T11:17:47.399439+0000","last_peered":"2024-09-19T11:17:47.399439+0000","last_clean":"2024-09-19T11:17:47.399439+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:17:47.399439+0000","last_undegraded":"2024-09-19T11:17:47.399439+0000","last_fullsized":"2024-09-19T11:17:47.399439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.399358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.399358+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.399358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.495314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:13.157480+0000","last_change":"2024-09-19T11:18:13.157480+0000","last_active":"2024-09-19T11:18:13.157480+0000","last_peered":"2024-09-19T11:18:13.157480+0000","last_clean":"2024-09-19T11:18:13.157480+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:18:13.157480+0000","last_undegraded":"2024-09-19T11:18:13.157480+0000","last_fullsized":"2024-09-19T11:18:13.157480+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:18:13.157385+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:18:13.157385+0000","last_clean_scrub_stamp":"2024-09-19T11:18:13.157385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:56.773143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.520330+0000","last_change":"2024-09-19T11:17:15.520221+0000","last_active":"2024-09-19T11:17:15.520330+0000","last_peered":"2024-09-19T11:17:15.520330+0000","last_clean":"2024-09-19T11:17:15.520330+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:17:15.520330+0000","last_undegraded":"2024-09-19T11:17:15.520330+0000","last_fullsized":"2024-09-19T11:17:15.520330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:15.520117+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:15.520117+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.520117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:26.413322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.123007+0000","last_change":"2024-09-19T11:17:02.122899+0000","last_active":"2024-09-19T11:17:02.123007+0000","last_peered":"2024-09-19T11:17:02.123007+0000","last_clean":"2024-09-19T11:17:02.123007+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:17:02.123007+0000","last_undegraded":"2024-09-19T11:17:02.123007+0000","last_fullsized":"2024-09-19T11:17:02.123007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.122788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:56.217100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.704828+0000","last_change":"2024-09-19T11:17:16.704699+0000","last_active":"2024-09-19T11:17:16.704828+0000","last_peered":"2024-09-19T11:17:16.704828+0000","last_clean":"2024-09-19T11:17:16.704828+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:17:16.704828+0000","last_undegraded":"2024-09-19T11:17:16.704828+0000","last_fullsized":"2024-09-19T11:17:16.704828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:16.704599+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:16.704599+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.704599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:48.496980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.729664+0000","last_change":"2024-09-19T11:17:00.729547+0000","last_active":"2024-09-19T11:17:00.729664+0000","last_peered":"2024-09-19T11:17:00.729664+0000","last_clean":"2024-09-19T11:17:00.729664+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:17:00.729664+0000","last_undegraded":"2024-09-19T11:17:00.729664+0000","last_fullsized":"2024-09-19T11:17:00.729664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.729447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:20.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.128830+0000","last_change":"2024-09-19T11:17:33.128733+0000","last_active":"2024-09-19T11:17:33.128830+0000","last_peered":"2024-09-19T11:17:33.128830+0000","last_clean":"2024-09-19T11:17:33.128830+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:17:33.128830+0000","last_undegraded":"2024-09-19T11:17:33.128830+0000","last_fullsized":"2024-09-19T11:17:33.128830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:33.128637+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:33.128637+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.128637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:01.235293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.280636+0000","last_change":"2024-09-19T11:17:12.280573+0000","last_active":"2024-09-19T11:17:12.280636+0000","last_peered":"2024-09-19T11:17:12.280636+0000","last_clean":"2024-09-19T11:17:12.280636+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:17:12.280636+0000","last_undegraded":"2024-09-19T11:17:12.280636+0000","last_fullsized":"2024-09-19T11:17:12.280636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.280488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:06.626222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'20","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.721854+0000","last_change":"2024-09-19T11:17:15.721783+0000","last_active":"2024-09-19T11:17:15.721854+0000","last_peered":"2024-09-19T11:17:15.721854+0000","last_clean":"2024-09-19T11:17:15.721854+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:17:15.721854+0000","last_undegraded":"2024-09-19T11:17:15.721854+0000","last_fullsized":"2024-09-19T11:17:15.721854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20","last_scrub_stamp":"2024-09-19T11:17:15.721694+0000","last_deep_scrub":"37'20","last_deep_scrub_stamp":"2024-09-19T11:17:15.721694+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.721694+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:41.352334+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.750186+0000","last_change":"2024-09-19T11:17:01.750132+0000","last_active":"2024-09-19T11:17:01.750186+0000","last_peered":"2024-09-19T11:17:01.750186+0000","last_clean":"2024-09-19T11:17:01.750186+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:17:01.750186+0000","last_undegraded":"2024-09-19T11:17:01.750186+0000","last_fullsized":"2024-09-19T11:17:01.750186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.750039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:21.882909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.747697+0000","last_change":"2024-09-19T11:17:14.747631+0000","last_active":"2024-09-19T11:17:14.747697+0000","last_peered":"2024-09-19T11:17:14.747697+0000","last_clean":"2024-09-19T11:17:14.747697+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:17:14.747697+0000","last_undegraded":"2024-09-19T11:17:14.747697+0000","last_fullsized":"2024-09-19T11:17:14.747697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.747561+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.747561+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.747561+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:33.992563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.719263+0000","last_change":"2024-09-19T11:16:59.719201+0000","last_active":"2024-09-19T11:16:59.719263+0000","last_peered":"2024-09-19T11:16:59.719263+0000","last_clean":"2024-09-19T11:16:59.719263+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:16:59.719263+0000","last_undegraded":"2024-09-19T11:16:59.719263+0000","last_fullsized":"2024-09-19T11:16:59.719263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.719107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:52.014566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.509482+0000","last_change":"2024-09-19T11:17:14.509403+0000","last_active":"2024-09-19T11:17:14.509482+0000","last_peered":"2024-09-19T11:17:14.509482+0000","last_clean":"2024-09-19T11:17:14.509482+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:17:14.509482+0000","last_undegraded":"2024-09-19T11:17:14.509482+0000","last_fullsized":"2024-09-19T11:17:14.509482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.509322+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.509322+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.509322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.517999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.712749+0000","last_change":"2024-09-19T11:17:04.712688+0000","last_active":"2024-09-19T11:17:04.712749+0000","last_peered":"2024-09-19T11:17:04.712749+0000","last_clean":"2024-09-19T11:17:04.712749+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:17:04.712749+0000","last_undegraded":"2024-09-19T11:17:04.712749+0000","last_fullsized":"2024-09-19T11:17:04.712749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.712601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:18.151651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.722988+0000","last_change":"2024-09-19T11:17:20.722908+0000","last_active":"2024-09-19T11:17:20.722988+0000","last_peered":"2024-09-19T11:17:20.722988+0000","last_clean":"2024-09-19T11:17:20.722988+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:17:20.722988+0000","last_undegraded":"2024-09-19T11:17:20.722988+0000","last_fullsized":"2024-09-19T11:17:20.722988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:20.722811+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:20.722811+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.722811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:08.485371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.127532+0000","last_change":"2024-09-19T11:17:03.127471+0000","last_active":"2024-09-19T11:17:03.127532+0000","last_peered":"2024-09-19T11:17:03.127532+0000","last_clean":"2024-09-19T11:17:03.127532+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:17:03.127532+0000","last_undegraded":"2024-09-19T11:17:03.127532+0000","last_fullsized":"2024-09-19T11:17:03.127532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.127373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:45.319191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.542704+0000","last_change":"2024-09-19T11:17:13.542620+0000","last_active":"2024-09-19T11:17:13.542704+0000","last_peered":"2024-09-19T11:17:13.542704+0000","last_clean":"2024-09-19T11:17:13.542704+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:17:13.542704+0000","last_undegraded":"2024-09-19T11:17:13.542704+0000","last_fullsized":"2024-09-19T11:17:13.542704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.542491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:23.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.719936+0000","last_change":"2024-09-19T11:17:02.719810+0000","last_active":"2024-09-19T11:17:02.719936+0000","last_peered":"2024-09-19T11:17:02.719936+0000","last_clean":"2024-09-19T11:17:02.719936+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:17:02.719936+0000","last_undegraded":"2024-09-19T11:17:02.719936+0000","last_fullsized":"2024-09-19T11:17:02.719936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.719684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:09.105342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.571925+0000","last_change":"2024-09-19T11:17:20.571852+0000","last_active":"2024-09-19T11:17:20.571925+0000","last_peered":"2024-09-19T11:17:20.571925+0000","last_clean":"2024-09-19T11:17:20.571925+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:17:20.571925+0000","last_undegraded":"2024-09-19T11:17:20.571925+0000","last_fullsized":"2024-09-19T11:17:20.571925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:20.571768+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:20.571768+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.571768+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:21.919126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.324856+0000","last_change":"2024-09-19T11:17:13.324790+0000","last_active":"2024-09-19T11:17:13.324856+0000","last_peered":"2024-09-19T11:17:13.324856+0000","last_clean":"2024-09-19T11:17:13.324856+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:17:13.324856+0000","last_undegraded":"2024-09-19T11:17:13.324856+0000","last_fullsized":"2024-09-19T11:17:13.324856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.324688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:10.883666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.141962+0000","last_change":"2024-09-19T11:17:35.141851+0000","last_active":"2024-09-19T11:17:35.141962+0000","last_peered":"2024-09-19T11:17:35.141962+0000","last_clean":"2024-09-19T11:17:35.141962+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:17:35.141962+0000","last_undegraded":"2024-09-19T11:17:35.141962+0000","last_fullsized":"2024-09-19T11:17:35.141962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:35.141748+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:35.141748+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.141748+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.731724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.735272+0000","last_change":"2024-09-19T11:17:04.735210+0000","last_active":"2024-09-19T11:17:04.735272+0000","last_peered":"2024-09-19T11:17:04.735272+0000","last_clean":"2024-09-19T11:17:04.735272+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:17:04.735272+0000","last_undegraded":"2024-09-19T11:17:04.735272+0000","last_fullsized":"2024-09-19T11:17:04.735272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.735127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:17.771568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'12","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.724462+0000","last_change":"2024-09-19T11:17:18.724380+0000","last_active":"2024-09-19T11:17:18.724462+0000","last_peered":"2024-09-19T11:17:18.724462+0000","last_clean":"2024-09-19T11:17:18.724462+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:17:18.724462+0000","last_undegraded":"2024-09-19T11:17:18.724462+0000","last_fullsized":"2024-09-19T11:17:18.724462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:18.724292+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:18.724292+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.724292+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:51.156798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.744135+0000","last_change":"2024-09-19T11:17:02.744045+0000","last_active":"2024-09-19T11:17:02.744135+0000","last_peered":"2024-09-19T11:17:02.744135+0000","last_clean":"2024-09-19T11:17:02.744135+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:17:02.744135+0000","last_undegraded":"2024-09-19T11:17:02.744135+0000","last_fullsized":"2024-09-19T11:17:02.744135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.743932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:55.116235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.556469+0000","last_change":"2024-09-19T11:17:19.556409+0000","last_active":"2024-09-19T11:17:19.556469+0000","last_peered":"2024-09-19T11:17:19.556469+0000","last_clean":"2024-09-19T11:17:19.556469+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:17:19.556469+0000","last_undegraded":"2024-09-19T11:17:19.556469+0000","last_fullsized":"2024-09-19T11:17:19.556469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:19.556323+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:19.556323+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.556323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:45.864627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.781142+0000","last_change":"2024-09-19T11:17:01.781064+0000","last_active":"2024-09-19T11:17:01.781142+0000","last_peered":"2024-09-19T11:17:01.781142+0000","last_clean":"2024-09-19T11:17:01.781142+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:17:01.781142+0000","last_undegraded":"2024-09-19T11:17:01.781142+0000","last_fullsized":"2024-09-19T11:17:01.781142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.780976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:25.647175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.510013+0000","last_change":"2024-09-19T11:17:17.509949+0000","last_active":"2024-09-19T11:17:17.510013+0000","last_peered":"2024-09-19T11:17:17.510013+0000","last_clean":"2024-09-19T11:17:17.510013+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:17:17.510013+0000","last_undegraded":"2024-09-19T11:17:17.510013+0000","last_fullsized":"2024-09-19T11:17:17.510013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:17.509860+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:17.509860+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.509860+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:13.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.362733+0000","last_change":"2024-09-19T11:17:14.362674+0000","last_active":"2024-09-19T11:17:14.362733+0000","last_peered":"2024-09-19T11:17:14.362733+0000","last_clean":"2024-09-19T11:17:14.362733+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:17:14.362733+0000","last_undegraded":"2024-09-19T11:17:14.362733+0000","last_fullsized":"2024-09-19T11:17:14.362733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:14.362585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:14.362585+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.362585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:42.088426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'12","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.482164+0000","last_change":"2024-09-19T11:17:16.482087+0000","last_active":"2024-09-19T11:17:16.482164+0000","last_peered":"2024-09-19T11:17:16.482164+0000","last_clean":"2024-09-19T11:17:16.482164+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:17:16.482164+0000","last_undegraded":"2024-09-19T11:17:16.482164+0000","last_fullsized":"2024-09-19T11:17:16.482164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:16.482004+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:16.482004+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.482004+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:19.747512+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.374642+0000","last_change":"2024-09-19T11:17:15.374545+0000","last_active":"2024-09-19T11:17:15.374642+0000","last_peered":"2024-09-19T11:17:15.374642+0000","last_clean":"2024-09-19T11:17:15.374642+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:17:15.374642+0000","last_undegraded":"2024-09-19T11:17:15.374642+0000","last_fullsized":"2024-09-19T11:17:15.374642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:15.374417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:15.374417+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.374417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:03.758631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.151470+0000","last_change":"2024-09-19T11:17:34.151411+0000","last_active":"2024-09-19T11:17:34.151470+0000","last_peered":"2024-09-19T11:17:34.151470+0000","last_clean":"2024-09-19T11:17:34.151470+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:17:34.151470+0000","last_undegraded":"2024-09-19T11:17:34.151470+0000","last_fullsized":"2024-09-19T11:17:34.151470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:34.151316+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:34.151316+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.151316+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:29.956213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.153299+0000","last_change":"2024-09-19T11:17:04.153242+0000","last_active":"2024-09-19T11:17:04.153299+0000","last_peered":"2024-09-19T11:17:04.153299+0000","last_clean":"2024-09-19T11:17:04.153299+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:17:04.153299+0000","last_undegraded":"2024-09-19T11:17:04.153299+0000","last_fullsized":"2024-09-19T11:17:04.153299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.153146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:23.740652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.559592+0000","last_change":"2024-09-19T11:17:18.559499+0000","last_active":"2024-09-19T11:17:18.559592+0000","last_peered":"2024-09-19T11:17:18.559592+0000","last_clean":"2024-09-19T11:17:18.559592+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:17:18.559592+0000","last_undegraded":"2024-09-19T11:17:18.559592+0000","last_fullsized":"2024-09-19T11:17:18.559592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:18.559406+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:18.559406+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.559406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:02.731291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.333691+0000","last_change":"2024-09-19T11:17:17.333631+0000","last_active":"2024-09-19T11:17:17.333691+0000","last_peered":"2024-09-19T11:17:17.333691+0000","last_clean":"2024-09-19T11:17:17.333691+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:17:17.333691+0000","last_undegraded":"2024-09-19T11:17:17.333691+0000","last_fullsized":"2024-09-19T11:17:17.333691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:17.333525+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:17.333525+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.333525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:07.331615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.360953+0000","last_change":"2024-09-19T11:17:16.360890+0000","last_active":"2024-09-19T11:17:16.360953+0000","last_peered":"2024-09-19T11:17:16.360953+0000","last_clean":"2024-09-19T11:17:16.360953+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:17:16.360953+0000","last_undegraded":"2024-09-19T11:17:16.360953+0000","last_fullsized":"2024-09-19T11:17:16.360953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:16.360792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:16.360792+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.360792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:58.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":74,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.686885+0000","last_change":"2024-09-19T11:17:17.686885+0000","last_active":"2024-09-19T11:17:17.686885+0000","last_peered":"2024-09-19T11:17:17.686885+0000","last_clean":"2024-09-19T11:17:17.686885+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:17:17.686885+0000","last_undegraded":"2024-09-19T11:17:17.686885+0000","last_fullsized":"2024-09-19T11:17:17.686885+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:17.686787+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:17.686787+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.686787+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:29.308455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.699867+0000","last_change":"2024-09-19T11:17:06.699792+0000","last_active":"2024-09-19T11:17:06.699867+0000","last_peered":"2024-09-19T11:17:06.699867+0000","last_clean":"2024-09-19T11:17:06.699867+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:17:06.699867+0000","last_undegraded":"2024-09-19T11:17:06.699867+0000","last_fullsized":"2024-09-19T11:17:06.699867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.699710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:06.685184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.420123+0000","last_change":"2024-09-19T11:17:26.420123+0000","last_active":"2024-09-19T11:17:26.420123+0000","last_peered":"2024-09-19T11:17:26.420123+0000","last_clean":"2024-09-19T11:17:26.420123+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:17:26.420123+0000","last_undegraded":"2024-09-19T11:17:26.420123+0000","last_fullsized":"2024-09-19T11:17:26.420123+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:26.420010+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:26.420010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.420010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:17.288611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1558,"ondisk_log_size":1558,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640320,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":512000,"data_stored":161981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640321,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":749066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640321,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":749395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705727,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":160962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:18:15.965 INFO:tasks.ceph:pgid 8.1c last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:18:15.965 INFO:tasks.ceph:pgid 8.11 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:18:15.965 INFO:tasks.ceph:pgid 8.16 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:18:15.966 INFO:tasks.ceph:pgid 8.15 last_scrub_stamp 2024-09-19T11:13:40.356437+0000 time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=13, tm_sec=40, tm_wday=3, tm_yday=263, tm_isdst=-1) <= time.struct_time(tm_year=2024, tm_mon=9, tm_mday=19, tm_hour=11, tm_min=16, tm_sec=51, tm_wday=3, tm_yday=263, tm_isdst=0) 2024-09-19T11:18:15.966 INFO:tasks.ceph:Still waiting for all pgs to be scrubbed. 2024-09-19T11:18:35.967 DEBUG:teuthology.orchestra.run.smithi037:> sudo adjust-ulimits ceph-coverage /home/ubuntu/cephtest/archive/coverage timeout 120 ceph --cluster ceph pg dump --format=json 2024-09-19T11:18:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.081+0000 7f42d9f6b640 1 Processor -- start 2024-09-19T11:18:36.083 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.081+0000 7f42d9f6b640 1 -- start start 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d9f6b640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42d406eaa0 0x7f42d41326a0 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d9f6b640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f42d40729b0 con 0x7f42d406dfb0 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d9f6b640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f42d40714b0 con 0x7f42d406eaa0 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d2ffd640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f42d406eaa0 0x7f42d41326a0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d37fe640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f42d406dfb0 0x7f42d406e390 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52388/0 (socket says 172.21.15.37:52388) 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d37fe640 1 -- 172.21.15.37:0/1887431458 learned_addr learned my addr 172.21.15.37:0/1887431458 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d2ffd640 1 -- 172.21.15.37:0/1887431458 >> v1:172.21.15.37:6789/0 conn(0x7f42d406dfb0 legacy=0x7f42d406e390 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d2ffd640 1 -- 172.21.15.37:0/1887431458 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d40725f0 con 0x7f42d406eaa0 2024-09-19T11:18:36.084 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.082+0000 7f42d27fc640 1 -- 172.21.15.37:0/1887431458 <== mon.0 v1:172.21.15.37:6789/0 1 ==== auth_reply(proto 2 0 (0) Success) ==== 33+0+0 (unknown 4114315066 0 0) 0x7f42c4001110 con 0x7f42d406dfb0 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.083+0000 7f42d2ffd640 1 --2- 172.21.15.37:0/1887431458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406eaa0 0x7f42d41326a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009750 tx=0x7f42c802a1e0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b4b8aef93eef0730 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.083+0000 7f42d27fc640 1 -- 172.21.15.37:0/1887431458 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c8037070 con 0x7f42d406eaa0 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.083+0000 7f42d27fc640 1 -- 172.21.15.37:0/1887431458 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c802ae20 con 0x7f42d406eaa0 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.083+0000 7f42d27fc640 1 -- 172.21.15.37:0/1887431458 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c8032590 con 0x7f42d406eaa0 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.084+0000 7f42d9f6b640 1 -- 172.21.15.37:0/1887431458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406eaa0 msgr2=0x7f42d41326a0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.084+0000 7f42d9f6b640 1 --2- 172.21.15.37:0/1887431458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406eaa0 0x7f42d41326a0 secure :-1 s=READY pgs=902 cs=0 l=1 rev1=1 crypto rx=0x7f42c8009750 tx=0x7f42c802a1e0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.084+0000 7f42d9f6b640 1 -- 172.21.15.37:0/1887431458 shutdown_connections 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.084+0000 7f42d9f6b640 1 --2- 172.21.15.37:0/1887431458 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406eaa0 0x7f42d41326a0 unknown :-1 s=CLOSED pgs=902 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.084+0000 7f42d9f6b640 1 -- 172.21.15.37:0/1887431458 >> 172.21.15.37:0/1887431458 conn(0x7f42d409abc0 msgr2=0x7f42d4098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.084+0000 7f42d9f6b640 1 -- 172.21.15.37:0/1887431458 shutdown_connections 2024-09-19T11:18:36.086 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.084+0000 7f42d9f6b640 1 -- 172.21.15.37:0/1887431458 wait complete. 2024-09-19T11:18:36.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.085+0000 7f42d9f6b640 1 Processor -- start 2024-09-19T11:18:36.087 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.085+0000 7f42d9f6b640 1 -- start start 2024-09-19T11:18:36.088 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.085+0000 7f42d9f6b640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406dfb0 0x7f42d4129370 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.085+0000 7f42d9f6b640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f42d4071d70 con 0x7f42d406dfb0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.085+0000 7f42d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406dfb0 0x7f42d4129370 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.085+0000 7f42d37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406dfb0 0x7f42d4129370 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41262/0 (socket says 172.21.15.37:41262) 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.085+0000 7f42d37fe640 1 -- 172.21.15.37:0/2930578207 learned_addr learned my addr 172.21.15.37:0/2930578207 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.086+0000 7f42d37fe640 1 -- 172.21.15.37:0/2930578207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f42d4074120 con 0x7f42d406dfb0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.086+0000 7f42d37fe640 1 --2- 172.21.15.37:0/2930578207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406dfb0 0x7f42d4129370 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c6b0 tx=0x7f42c400cb70 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.086+0000 7f42bbfff640 1 -- 172.21.15.37:0/2930578207 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4018070 con 0x7f42d406dfb0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.086+0000 7f42bbfff640 1 -- 172.21.15.37:0/2930578207 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f42c4007e20 con 0x7f42d406dfb0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.086+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f42d406f830 con 0x7f42d406dfb0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.086+0000 7f42bbfff640 1 -- 172.21.15.37:0/2930578207 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f42c4007220 con 0x7f42d406dfb0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.086+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f42d4070290 con 0x7f42d406dfb0 2024-09-19T11:18:36.089 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.087+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f42d406e390 con 0x7f42d406dfb0 2024-09-19T11:18:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.087+0000 7f42bbfff640 1 -- 172.21.15.37:0/2930578207 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f42c401b070 con 0x7f42d406dfb0 2024-09-19T11:18:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.087+0000 7f42bbfff640 1 --2- 172.21.15.37:0/2930578207 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f42c003e710 0x7f42c0040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.087+0000 7f42bbfff640 1 -- 172.21.15.37:0/2930578207 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f42c4052b50 con 0x7f42d406dfb0 2024-09-19T11:18:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.088+0000 7f42d2ffd640 1 --2- 172.21.15.37:0/2930578207 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f42c003e710 0x7f42c0040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:36.090 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.088+0000 7f42d2ffd640 1 --2- 172.21.15.37:0/2930578207 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f42c003e710 0x7f42c0040bd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f42c8034000 tx=0x7f42c802e000 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:36.093 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.092+0000 7f42bbfff640 1 -- 172.21.15.37:0/2930578207 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f42d40729b0 con 0x7f42d406dfb0 2024-09-19T11:18:36.275 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.274+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 --> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] -- mgr_command(tid 0: {"prefix": "pg dump", "target": ["mon-mgr", ""], "format": "json"}) -- 0x7f42d4099e20 con 0x7f42c003e710 2024-09-19T11:18:36.285 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.284+0000 7f42bbfff640 1 -- 172.21.15.37:0/2930578207 <== mgr.4102 v2:172.21.15.102:6824/3738146565 1 ==== mgr_command_reply(tid 0: 0 dumped all) ==== 18+0+666430 (secure 0 0 0) 0x7f42d4099e20 con 0x7f42c003e710 2024-09-19T11:18:36.293 INFO:teuthology.orchestra.run.smithi037.stdout: 2024-09-19T11:18:36.299 INFO:teuthology.orchestra.run.smithi037.stderr:dumped all 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f42c003e710 msgr2=0x7f42c0040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 --2- 172.21.15.37:0/2930578207 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f42c003e710 0x7f42c0040bd0 secure :-1 s=READY pgs=373 cs=0 l=1 rev1=1 crypto rx=0x7f42c8034000 tx=0x7f42c802e000 comp rx=0 tx=0).stop 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406dfb0 msgr2=0x7f42d4129370 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 --2- 172.21.15.37:0/2930578207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406dfb0 0x7f42d4129370 secure :-1 s=READY pgs=903 cs=0 l=1 rev1=1 crypto rx=0x7f42c400c6b0 tx=0x7f42c400cb70 comp rx=0 tx=0).stop 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 shutdown_connections 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 --2- 172.21.15.37:0/2930578207 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f42c003e710 0x7f42c0040bd0 unknown :-1 s=CLOSED pgs=373 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 --2- 172.21.15.37:0/2930578207 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f42d406dfb0 0x7f42d4129370 unknown :-1 s=CLOSED pgs=903 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 >> 172.21.15.37:0/2930578207 conn(0x7f42d409abc0 msgr2=0x7f42d40972a0 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 shutdown_connections 2024-09-19T11:18:36.301 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.290+0000 7f42d9f6b640 1 -- 172.21.15.37:0/2930578207 wait complete. 2024-09-19T11:18:36.303 INFO:teuthology.orchestra.run.smithi037.stdout:{"pg_ready":true,"pg_map":{"version":196,"stamp":"2024-09-19T11:18:34.614891+0000","last_osdmap_epoch":0,"last_pg_scan":0,"pg_stats_sum":{"stat_sum":{"num_bytes":605410,"num_objects":222,"num_object_clones":0,"num_object_copies":444,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":222,"num_whiteouts":0,"num_read":5183,"num_read_kb":4725,"num_write":2125,"num_write_kb":60590,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":18,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3349,"num_omap_keys":16,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":4787,"ondisk_log_size":4787,"up":658,"acting":658,"num_store_stats":0},"osd_stats_sum":{"up_from":0,"seq":0,"num_pgs":658,"num_osds":4,"num_per_pool_osds":4,"num_per_pool_omap_osds":4,"kb":377487360,"kb_used":148544,"kb_used_data":3008,"kb_used_omap":6,"kb_used_meta":145465,"kb_avail":377338816,"statfs":{"total":386547056640,"available":386394947584,"internally_reserved":0,"allocated":3080192,"data_stored":1821404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":6378,"internal_metadata":148956950},"hb_peers":[],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[],"network_ping_times":[]},"pg_stats_delta":{"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":0,"ondisk_log_size":0,"up":0,"acting":0,"num_store_stats":0,"stamp_delta":"12.003927"},"pg_stats":[{"pgid":"3.3f","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.185570+0000","last_change":"2024-09-19T11:17:09.185503+0000","last_active":"2024-09-19T11:17:09.185570+0000","last_peered":"2024-09-19T11:17:09.185570+0000","last_clean":"2024-09-19T11:17:09.185570+0000","last_became_active":"2024-09-19T11:13:31.355066+0000","last_became_peered":"2024-09-19T11:13:31.355066+0000","last_unstale":"2024-09-19T11:17:09.185570+0000","last_undegraded":"2024-09-19T11:17:09.185570+0000","last_fullsized":"2024-09-19T11:17:09.185570+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.185421+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.185421+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:28.271527+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.38","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.428170+0000","last_change":"2024-09-19T11:17:24.428109+0000","last_active":"2024-09-19T11:17:24.428170+0000","last_peered":"2024-09-19T11:17:24.428170+0000","last_clean":"2024-09-19T11:17:24.428170+0000","last_became_active":"2024-09-19T11:13:33.358009+0000","last_became_peered":"2024-09-19T11:13:33.358009+0000","last_unstale":"2024-09-19T11:17:24.428170+0000","last_undegraded":"2024-09-19T11:17:24.428170+0000","last_fullsized":"2024-09-19T11:17:24.428170+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:24.428032+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:24.428032+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.428032+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:15:35.180377+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.722324+0000","last_change":"2024-09-19T11:17:07.722223+0000","last_active":"2024-09-19T11:17:07.722324+0000","last_peered":"2024-09-19T11:17:07.722324+0000","last_clean":"2024-09-19T11:17:07.722324+0000","last_became_active":"2024-09-19T11:13:31.377623+0000","last_became_peered":"2024-09-19T11:13:31.377623+0000","last_unstale":"2024-09-19T11:17:07.722324+0000","last_undegraded":"2024-09-19T11:17:07.722324+0000","last_fullsized":"2024-09-19T11:17:07.722324+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.722137+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.722137+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:24:30.023844+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.39","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.228529+0000","last_change":"2024-09-19T11:17:39.228473+0000","last_active":"2024-09-19T11:17:39.228529+0000","last_peered":"2024-09-19T11:17:39.228529+0000","last_clean":"2024-09-19T11:17:39.228529+0000","last_became_active":"2024-09-19T11:13:33.352980+0000","last_became_peered":"2024-09-19T11:13:33.352980+0000","last_unstale":"2024-09-19T11:17:39.228529+0000","last_undegraded":"2024-09-19T11:17:39.228529+0000","last_fullsized":"2024-09-19T11:17:39.228529+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:39.228390+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:39.228390+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.228390+0000","objects_scrubbed":1,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:27:43.727515+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":7,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.305609+0000","last_change":"2024-09-19T11:17:20.305534+0000","last_active":"2024-09-19T11:17:20.305609+0000","last_peered":"2024-09-19T11:17:20.305609+0000","last_clean":"2024-09-19T11:17:20.305609+0000","last_became_active":"2024-09-19T11:13:31.373043+0000","last_became_peered":"2024-09-19T11:13:31.373043+0000","last_unstale":"2024-09-19T11:17:20.305609+0000","last_undegraded":"2024-09-19T11:17:20.305609+0000","last_fullsized":"2024-09-19T11:17:20.305609+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:20.305449+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:20.305449+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.305449+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:38:26.794545+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3a","version":"37'8","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.707910+0000","last_change":"2024-09-19T11:17:19.707910+0000","last_active":"2024-09-19T11:17:19.707910+0000","last_peered":"2024-09-19T11:17:19.707910+0000","last_clean":"2024-09-19T11:17:19.707910+0000","last_became_active":"2024-09-19T11:14:07.591493+0000","last_became_peered":"2024-09-19T11:14:07.591493+0000","last_unstale":"2024-09-19T11:17:19.707910+0000","last_undegraded":"2024-09-19T11:17:19.707910+0000","last_fullsized":"2024-09-19T11:17:19.707910+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:19.707815+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:19.707815+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.707815+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:33:44.051682+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":1,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.3c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.203776+0000","last_change":"2024-09-19T11:17:07.203719+0000","last_active":"2024-09-19T11:17:07.203776+0000","last_peered":"2024-09-19T11:17:07.203776+0000","last_clean":"2024-09-19T11:17:07.203776+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:07.203776+0000","last_undegraded":"2024-09-19T11:17:07.203776+0000","last_fullsized":"2024-09-19T11:17:07.203776+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:07.203629+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.203629+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:17:11.735801+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3b","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.181317+0000","last_change":"2024-09-19T11:17:38.181211+0000","last_active":"2024-09-19T11:17:38.181317+0000","last_peered":"2024-09-19T11:17:38.181317+0000","last_clean":"2024-09-19T11:17:38.181317+0000","last_became_active":"2024-09-19T11:13:33.349251+0000","last_became_peered":"2024-09-19T11:13:33.349251+0000","last_unstale":"2024-09-19T11:17:38.181317+0000","last_undegraded":"2024-09-19T11:17:38.181317+0000","last_fullsized":"2024-09-19T11:17:38.181317+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:38.181092+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:38.181092+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.181092+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:04:44.184562+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.273364+0000","last_change":"2024-09-19T11:17:21.273303+0000","last_active":"2024-09-19T11:17:21.273364+0000","last_peered":"2024-09-19T11:17:21.273364+0000","last_clean":"2024-09-19T11:17:21.273364+0000","last_became_active":"2024-09-19T11:13:31.373103+0000","last_became_peered":"2024-09-19T11:13:31.373103+0000","last_unstale":"2024-09-19T11:17:21.273364+0000","last_undegraded":"2024-09-19T11:17:21.273364+0000","last_fullsized":"2024-09-19T11:17:21.273364+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:21.273210+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:21.273210+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.273210+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:17.566575+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3c","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.419946+0000","last_change":"2024-09-19T11:17:25.419858+0000","last_active":"2024-09-19T11:17:25.419946+0000","last_peered":"2024-09-19T11:17:25.419946+0000","last_clean":"2024-09-19T11:17:25.419946+0000","last_became_active":"2024-09-19T11:13:33.346767+0000","last_became_peered":"2024-09-19T11:13:33.346767+0000","last_unstale":"2024-09-19T11:17:25.419946+0000","last_undegraded":"2024-09-19T11:17:25.419946+0000","last_fullsized":"2024-09-19T11:17:25.419946+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:25.419735+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:25.419735+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.419735+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:25.095539+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.3a","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.173237+0000","last_change":"2024-09-19T11:17:06.173145+0000","last_active":"2024-09-19T11:17:06.173237+0000","last_peered":"2024-09-19T11:17:06.173237+0000","last_clean":"2024-09-19T11:17:06.173237+0000","last_became_active":"2024-09-19T11:13:31.357907+0000","last_became_peered":"2024-09-19T11:13:31.357907+0000","last_unstale":"2024-09-19T11:17:06.173237+0000","last_undegraded":"2024-09-19T11:17:06.173237+0000","last_fullsized":"2024-09-19T11:17:06.173237+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.173052+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.173052+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:10:49.733204+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.3d","version":"37'22","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.178554+0000","last_change":"2024-09-19T11:17:24.178486+0000","last_active":"2024-09-19T11:17:24.178554+0000","last_peered":"2024-09-19T11:17:24.178554+0000","last_clean":"2024-09-19T11:17:24.178554+0000","last_became_active":"2024-09-19T11:14:07.594172+0000","last_became_peered":"2024-09-19T11:14:07.594172+0000","last_unstale":"2024-09-19T11:17:24.178554+0000","last_undegraded":"2024-09-19T11:17:24.178554+0000","last_fullsized":"2024-09-19T11:17:24.178554+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:24.178395+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:24.178395+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.178395+0000","objects_scrubbed":1,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:32:31.010938+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":68,"num_read_kb":56,"num_write":27,"num_write_kb":10,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.39","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.336108+0000","last_change":"2024-09-19T11:17:19.336034+0000","last_active":"2024-09-19T11:17:19.336108+0000","last_peered":"2024-09-19T11:17:19.336108+0000","last_clean":"2024-09-19T11:17:19.336108+0000","last_became_active":"2024-09-19T11:13:31.366437+0000","last_became_peered":"2024-09-19T11:13:31.366437+0000","last_unstale":"2024-09-19T11:17:19.336108+0000","last_undegraded":"2024-09-19T11:17:19.336108+0000","last_fullsized":"2024-09-19T11:17:19.336108+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:19.335927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:19.335927+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.335927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:16:24.741509+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.3e","version":"37'14","reported_seq":76,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.177004+0000","last_change":"2024-09-19T11:17:19.176944+0000","last_active":"2024-09-19T11:17:19.177004+0000","last_peered":"2024-09-19T11:17:19.177004+0000","last_clean":"2024-09-19T11:17:19.177004+0000","last_became_active":"2024-09-19T11:13:33.346971+0000","last_became_peered":"2024-09-19T11:13:33.346971+0000","last_unstale":"2024-09-19T11:17:19.177004+0000","last_undegraded":"2024-09-19T11:17:19.177004+0000","last_fullsized":"2024-09-19T11:17:19.177004+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:19.176853+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:19.176853+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.176853+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:22:04.753042+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":47,"num_read_kb":43,"num_write":16,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.38","version":"37'5","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.735796+0000","last_change":"2024-09-19T11:17:05.735731+0000","last_active":"2024-09-19T11:17:05.735796+0000","last_peered":"2024-09-19T11:17:05.735796+0000","last_clean":"2024-09-19T11:17:05.735796+0000","last_became_active":"2024-09-19T11:13:31.363805+0000","last_became_peered":"2024-09-19T11:13:31.363805+0000","last_unstale":"2024-09-19T11:17:05.735796+0000","last_undegraded":"2024-09-19T11:17:05.735796+0000","last_fullsized":"2024-09-19T11:17:05.735796+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:05.735639+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.735639+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:26:45.185308+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":13,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3f","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.161554+0000","last_change":"2024-09-19T11:17:20.161499+0000","last_active":"2024-09-19T11:17:20.161554+0000","last_peered":"2024-09-19T11:17:20.161554+0000","last_clean":"2024-09-19T11:17:20.161554+0000","last_became_active":"2024-09-19T11:13:33.353705+0000","last_became_peered":"2024-09-19T11:13:33.353705+0000","last_unstale":"2024-09-19T11:17:20.161554+0000","last_undegraded":"2024-09-19T11:17:20.161554+0000","last_fullsized":"2024-09-19T11:17:20.161554+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:20.161414+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:20.161414+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.161414+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:55.200468+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":27,"num_read_kb":27,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.30","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.187883+0000","last_change":"2024-09-19T11:17:36.187799+0000","last_active":"2024-09-19T11:17:36.187883+0000","last_peered":"2024-09-19T11:17:36.187883+0000","last_clean":"2024-09-19T11:17:36.187883+0000","last_became_active":"2024-09-19T11:13:33.352738+0000","last_became_peered":"2024-09-19T11:13:33.352738+0000","last_unstale":"2024-09-19T11:17:36.187883+0000","last_undegraded":"2024-09-19T11:17:36.187883+0000","last_fullsized":"2024-09-19T11:17:36.187883+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:36.187719+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:36.187719+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.187719+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:20.713186+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.37","version":"35'2","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.728175+0000","last_change":"2024-09-19T11:17:03.728105+0000","last_active":"2024-09-19T11:17:03.728175+0000","last_peered":"2024-09-19T11:17:03.728175+0000","last_clean":"2024-09-19T11:17:03.728175+0000","last_became_active":"2024-09-19T11:13:31.363644+0000","last_became_peered":"2024-09-19T11:13:31.363644+0000","last_unstale":"2024-09-19T11:17:03.728175+0000","last_undegraded":"2024-09-19T11:17:03.728175+0000","last_fullsized":"2024-09-19T11:17:03.728175+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.728013+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.728013+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:50.046423+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.31","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.546489+0000","last_change":"2024-09-19T11:17:21.546410+0000","last_active":"2024-09-19T11:17:21.546489+0000","last_peered":"2024-09-19T11:17:21.546489+0000","last_clean":"2024-09-19T11:17:21.546489+0000","last_became_active":"2024-09-19T11:13:33.356931+0000","last_became_peered":"2024-09-19T11:13:33.356931+0000","last_unstale":"2024-09-19T11:17:21.546489+0000","last_undegraded":"2024-09-19T11:17:21.546489+0000","last_fullsized":"2024-09-19T11:17:21.546489+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:21.546297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:21.546297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.546297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:01:35.564864+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.36","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.201989+0000","last_change":"2024-09-19T11:17:05.201897+0000","last_active":"2024-09-19T11:17:05.201989+0000","last_peered":"2024-09-19T11:17:05.201989+0000","last_clean":"2024-09-19T11:17:05.201989+0000","last_became_active":"2024-09-19T11:13:31.370201+0000","last_became_peered":"2024-09-19T11:13:31.370201+0000","last_unstale":"2024-09-19T11:17:05.201989+0000","last_undegraded":"2024-09-19T11:17:05.201989+0000","last_fullsized":"2024-09-19T11:17:05.201989+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:05.201777+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.201777+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:32:39.204473+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.32","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.461793+0000","last_change":"2024-09-19T11:17:23.461723+0000","last_active":"2024-09-19T11:17:23.461793+0000","last_peered":"2024-09-19T11:17:23.461793+0000","last_clean":"2024-09-19T11:17:23.461793+0000","last_became_active":"2024-09-19T11:13:33.359243+0000","last_became_peered":"2024-09-19T11:13:33.359243+0000","last_unstale":"2024-09-19T11:17:23.461793+0000","last_undegraded":"2024-09-19T11:17:23.461793+0000","last_fullsized":"2024-09-19T11:17:23.461793+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:23.461640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:23.461640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.461640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:44.860304+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.35","version":"37'2","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.571669+0000","last_change":"2024-09-19T11:17:10.571584+0000","last_active":"2024-09-19T11:17:10.571669+0000","last_peered":"2024-09-19T11:17:10.571669+0000","last_clean":"2024-09-19T11:17:10.571669+0000","last_became_active":"2024-09-19T11:13:31.363934+0000","last_became_peered":"2024-09-19T11:13:31.363934+0000","last_unstale":"2024-09-19T11:17:10.571669+0000","last_undegraded":"2024-09-19T11:17:10.571669+0000","last_fullsized":"2024-09-19T11:17:10.571669+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:10.571487+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.571487+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:28:05.033249+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":5,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.33","version":"37'6","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.700374+0000","last_change":"2024-09-19T11:17:21.700307+0000","last_active":"2024-09-19T11:17:21.700374+0000","last_peered":"2024-09-19T11:17:21.700374+0000","last_clean":"2024-09-19T11:17:21.700374+0000","last_became_active":"2024-09-19T11:13:33.349751+0000","last_became_peered":"2024-09-19T11:13:33.349751+0000","last_unstale":"2024-09-19T11:17:21.700374+0000","last_undegraded":"2024-09-19T11:17:21.700374+0000","last_fullsized":"2024-09-19T11:17:21.700374+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:21.700211+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:21.700211+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.700211+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:29.309406+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":23,"num_read_kb":23,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.34","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.677320+0000","last_change":"2024-09-19T11:17:06.677222+0000","last_active":"2024-09-19T11:17:06.677320+0000","last_peered":"2024-09-19T11:17:06.677320+0000","last_clean":"2024-09-19T11:17:06.677320+0000","last_became_active":"2024-09-19T11:13:31.363483+0000","last_became_peered":"2024-09-19T11:13:31.363483+0000","last_unstale":"2024-09-19T11:17:06.677320+0000","last_undegraded":"2024-09-19T11:17:06.677320+0000","last_fullsized":"2024-09-19T11:17:06.677320+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.677123+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.677123+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:47:51.934638+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.34","version":"37'8","reported_seq":70,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.191632+0000","last_change":"2024-09-19T11:17:18.191519+0000","last_active":"2024-09-19T11:17:18.191632+0000","last_peered":"2024-09-19T11:17:18.191632+0000","last_clean":"2024-09-19T11:17:18.191632+0000","last_became_active":"2024-09-19T11:13:33.354133+0000","last_became_peered":"2024-09-19T11:13:33.354133+0000","last_unstale":"2024-09-19T11:17:18.191632+0000","last_undegraded":"2024-09-19T11:17:18.191632+0000","last_fullsized":"2024-09-19T11:17:18.191632+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:18.191426+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:18.191426+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.191426+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:55:24.097341+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":31,"num_read_kb":31,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.33","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.749847+0000","last_change":"2024-09-19T11:17:03.749724+0000","last_active":"2024-09-19T11:17:03.749847+0000","last_peered":"2024-09-19T11:17:03.749847+0000","last_clean":"2024-09-19T11:17:03.749847+0000","last_became_active":"2024-09-19T11:13:31.378791+0000","last_became_peered":"2024-09-19T11:13:31.378791+0000","last_unstale":"2024-09-19T11:17:03.749847+0000","last_undegraded":"2024-09-19T11:17:03.749847+0000","last_fullsized":"2024-09-19T11:17:03.749847+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.749624+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.749624+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:53:09.231023+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.35","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.498386+0000","last_change":"2024-09-19T11:17:22.498306+0000","last_active":"2024-09-19T11:17:22.498386+0000","last_peered":"2024-09-19T11:17:22.498386+0000","last_clean":"2024-09-19T11:17:22.498386+0000","last_became_active":"2024-09-19T11:13:33.344080+0000","last_became_peered":"2024-09-19T11:13:33.344080+0000","last_unstale":"2024-09-19T11:17:22.498386+0000","last_undegraded":"2024-09-19T11:17:22.498386+0000","last_fullsized":"2024-09-19T11:17:22.498386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:22.498193+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:22.498193+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.498193+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:36:31.267529+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.32","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.314618+0000","last_change":"2024-09-19T11:17:18.314533+0000","last_active":"2024-09-19T11:17:18.314618+0000","last_peered":"2024-09-19T11:17:18.314618+0000","last_clean":"2024-09-19T11:17:18.314618+0000","last_became_active":"2024-09-19T11:13:31.367754+0000","last_became_peered":"2024-09-19T11:13:31.367754+0000","last_unstale":"2024-09-19T11:17:18.314618+0000","last_undegraded":"2024-09-19T11:17:18.314618+0000","last_fullsized":"2024-09-19T11:17:18.314618+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:18.314426+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:18.314426+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.314426+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:03:36.967813+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.18","version":"37'36","reported_seq":110,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:53.526146+0000","last_change":"2024-09-19T11:17:53.526061+0000","last_active":"2024-09-19T11:17:53.526146+0000","last_peered":"2024-09-19T11:17:53.526146+0000","last_clean":"2024-09-19T11:17:53.526146+0000","last_became_active":"2024-09-19T11:13:41.394779+0000","last_became_peered":"2024-09-19T11:13:41.394779+0000","last_unstale":"2024-09-19T11:17:53.526146+0000","last_undegraded":"2024-09-19T11:17:53.526146+0000","last_fullsized":"2024-09-19T11:17:53.526146+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'36","last_scrub_stamp":"2024-09-19T11:17:53.525955+0000","last_deep_scrub":"37'36","last_deep_scrub_stamp":"2024-09-19T11:17:53.525955+0000","last_clean_scrub_stamp":"2024-09-19T11:17:53.525955+0000","objects_scrubbed":1,"log_size":36,"log_dups_size":0,"ondisk_log_size":36,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:22.989984+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":7,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":173,"num_read_kb":173,"num_write":97,"num_write_kb":32,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.14","version":"37'8","reported_seq":77,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.319783+0000","last_change":"2024-09-19T11:17:26.319705+0000","last_active":"2024-09-19T11:17:26.319783+0000","last_peered":"2024-09-19T11:17:26.319783+0000","last_clean":"2024-09-19T11:17:26.319783+0000","last_became_active":"2024-09-19T11:13:33.348274+0000","last_became_peered":"2024-09-19T11:13:33.348274+0000","last_unstale":"2024-09-19T11:17:26.319783+0000","last_undegraded":"2024-09-19T11:17:26.319783+0000","last_fullsized":"2024-09-19T11:17:26.319783+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:26.319597+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:26.319597+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.319597+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:21:32.580506+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":52,"num_read_kb":48,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.13","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.339807+0000","last_change":"2024-09-19T11:17:08.339744+0000","last_active":"2024-09-19T11:17:08.339807+0000","last_peered":"2024-09-19T11:17:08.339807+0000","last_clean":"2024-09-19T11:17:08.339807+0000","last_became_active":"2024-09-19T11:13:31.377400+0000","last_became_peered":"2024-09-19T11:13:31.377400+0000","last_unstale":"2024-09-19T11:17:08.339807+0000","last_undegraded":"2024-09-19T11:17:08.339807+0000","last_fullsized":"2024-09-19T11:17:08.339807+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:08.339654+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.339654+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:51:36.909793+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.15","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.281699+0000","last_change":"2024-09-19T11:17:47.281630+0000","last_active":"2024-09-19T11:17:47.281699+0000","last_peered":"2024-09-19T11:17:47.281699+0000","last_clean":"2024-09-19T11:17:47.281699+0000","last_became_active":"2024-09-19T11:13:35.357556+0000","last_became_peered":"2024-09-19T11:13:35.357556+0000","last_unstale":"2024-09-19T11:17:47.281699+0000","last_undegraded":"2024-09-19T11:17:47.281699+0000","last_fullsized":"2024-09-19T11:17:47.281699+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.281547+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.281547+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.281547+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:31:45.497123+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.16","version":"37'37","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:55.196874+0000","last_change":"2024-09-19T11:17:55.196800+0000","last_active":"2024-09-19T11:17:55.196874+0000","last_peered":"2024-09-19T11:17:55.196874+0000","last_clean":"2024-09-19T11:17:55.196874+0000","last_became_active":"2024-09-19T11:13:37.368129+0000","last_became_peered":"2024-09-19T11:13:37.368129+0000","last_unstale":"2024-09-19T11:17:55.196874+0000","last_undegraded":"2024-09-19T11:17:55.196874+0000","last_fullsized":"2024-09-19T11:17:55.196874+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:55.196715+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:55.196715+0000","last_clean_scrub_stamp":"2024-09-19T11:17:55.196715+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:39:14.818659+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.17","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.527031+0000","last_change":"2024-09-19T11:17:45.526959+0000","last_active":"2024-09-19T11:17:45.527031+0000","last_peered":"2024-09-19T11:17:45.527031+0000","last_clean":"2024-09-19T11:17:45.527031+0000","last_became_active":"2024-09-19T11:13:39.376071+0000","last_became_peered":"2024-09-19T11:13:39.376071+0000","last_unstale":"2024-09-19T11:17:45.527031+0000","last_undegraded":"2024-09-19T11:17:45.527031+0000","last_fullsized":"2024-09-19T11:17:45.527031+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:45.526876+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:45.526876+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.526876+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:15:04.650775+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.19","version":"37'7","reported_seq":35,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:54.545454+0000","last_change":"2024-09-19T11:17:54.545401+0000","last_active":"2024-09-19T11:17:54.545454+0000","last_peered":"2024-09-19T11:17:54.545454+0000","last_clean":"2024-09-19T11:17:54.545454+0000","last_became_active":"2024-09-19T11:13:41.393021+0000","last_became_peered":"2024-09-19T11:13:41.393021+0000","last_unstale":"2024-09-19T11:17:54.545454+0000","last_undegraded":"2024-09-19T11:17:54.545454+0000","last_fullsized":"2024-09-19T11:17:54.545454+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-19T11:17:54.545328+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-19T11:17:54.545328+0000","last_clean_scrub_stamp":"2024-09-19T11:17:54.545328+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:19:30.479330+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.15","version":"37'4","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.211902+0000","last_change":"2024-09-19T11:17:29.211803+0000","last_active":"2024-09-19T11:17:29.211902+0000","last_peered":"2024-09-19T11:17:29.211902+0000","last_clean":"2024-09-19T11:17:29.211902+0000","last_became_active":"2024-09-19T11:13:33.353019+0000","last_became_peered":"2024-09-19T11:13:33.353019+0000","last_unstale":"2024-09-19T11:17:29.211902+0000","last_undegraded":"2024-09-19T11:17:29.211902+0000","last_fullsized":"2024-09-19T11:17:29.211902+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:29.211683+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:29.211683+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.211683+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:57:00.455274+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.12","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.229980+0000","last_change":"2024-09-19T11:16:59.229925+0000","last_active":"2024-09-19T11:16:59.229980+0000","last_peered":"2024-09-19T11:16:59.229980+0000","last_clean":"2024-09-19T11:16:59.229980+0000","last_became_active":"2024-09-19T11:13:31.358428+0000","last_became_peered":"2024-09-19T11:13:31.358428+0000","last_unstale":"2024-09-19T11:16:59.229980+0000","last_undegraded":"2024-09-19T11:16:59.229980+0000","last_fullsized":"2024-09-19T11:16:59.229980+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:59.229836+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.229836+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:35:37.835840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.14","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.558568+0000","last_change":"2024-09-19T11:17:30.558504+0000","last_active":"2024-09-19T11:17:30.558568+0000","last_peered":"2024-09-19T11:17:30.558568+0000","last_clean":"2024-09-19T11:17:30.558568+0000","last_became_active":"2024-09-19T11:13:35.349678+0000","last_became_peered":"2024-09-19T11:13:35.349678+0000","last_unstale":"2024-09-19T11:17:30.558568+0000","last_undegraded":"2024-09-19T11:17:30.558568+0000","last_fullsized":"2024-09-19T11:17:30.558568+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.558423+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.558423+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.558423+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:39:03.461110+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.17","version":"37'9","reported_seq":47,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.501989+0000","last_change":"2024-09-19T11:17:39.501925+0000","last_active":"2024-09-19T11:17:39.501989+0000","last_peered":"2024-09-19T11:17:39.501989+0000","last_clean":"2024-09-19T11:17:39.501989+0000","last_became_active":"2024-09-19T11:13:37.363460+0000","last_became_peered":"2024-09-19T11:13:37.363460+0000","last_unstale":"2024-09-19T11:17:39.501989+0000","last_undegraded":"2024-09-19T11:17:39.501989+0000","last_fullsized":"2024-09-19T11:17:39.501989+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:39.501845+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:39.501845+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.501845+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:22:24.314455+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":9,"num_read_kb":6,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.16","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.482369+0000","last_change":"2024-09-19T11:17:44.482311+0000","last_active":"2024-09-19T11:17:44.482369+0000","last_peered":"2024-09-19T11:17:44.482369+0000","last_clean":"2024-09-19T11:17:44.482369+0000","last_became_active":"2024-09-19T11:13:39.377528+0000","last_became_peered":"2024-09-19T11:13:39.377528+0000","last_unstale":"2024-09-19T11:17:44.482369+0000","last_undegraded":"2024-09-19T11:17:44.482369+0000","last_fullsized":"2024-09-19T11:17:44.482369+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:44.482220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:44.482220+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.482220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:52.103555+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1a","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:52.363726+0000","last_change":"2024-09-19T11:17:52.363726+0000","last_active":"2024-09-19T11:17:52.363726+0000","last_peered":"2024-09-19T11:17:52.363726+0000","last_clean":"2024-09-19T11:17:52.363726+0000","last_became_active":"2024-09-19T11:13:41.387572+0000","last_became_peered":"2024-09-19T11:13:41.387572+0000","last_unstale":"2024-09-19T11:17:52.363726+0000","last_undegraded":"2024-09-19T11:17:52.363726+0000","last_fullsized":"2024-09-19T11:17:52.363726+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:52.363631+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:52.363631+0000","last_clean_scrub_stamp":"2024-09-19T11:17:52.363631+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:24:06.550871+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.16","version":"37'22","reported_seq":116,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.236574+0000","last_change":"2024-09-19T11:17:28.236476+0000","last_active":"2024-09-19T11:17:28.236574+0000","last_peered":"2024-09-19T11:17:28.236574+0000","last_clean":"2024-09-19T11:17:28.236574+0000","last_became_active":"2024-09-19T11:13:33.353982+0000","last_became_peered":"2024-09-19T11:13:33.353982+0000","last_unstale":"2024-09-19T11:17:28.236574+0000","last_undegraded":"2024-09-19T11:17:28.236574+0000","last_fullsized":"2024-09-19T11:17:28.236574+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:28.236388+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:28.236388+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.236388+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:19:08.350408+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":93,"num_read_kb":89,"num_write":24,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.11","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.362051+0000","last_change":"2024-09-19T11:17:06.361981+0000","last_active":"2024-09-19T11:17:06.362051+0000","last_peered":"2024-09-19T11:17:06.362051+0000","last_clean":"2024-09-19T11:17:06.362051+0000","last_became_active":"2024-09-19T11:13:31.366778+0000","last_became_peered":"2024-09-19T11:13:31.366778+0000","last_unstale":"2024-09-19T11:17:06.362051+0000","last_undegraded":"2024-09-19T11:17:06.362051+0000","last_fullsized":"2024-09-19T11:17:06.362051+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:06.361895+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.361895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:04.368884+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.17","version":"0'0","reported_seq":20,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.221087+0000","last_change":"2024-09-19T11:17:23.221087+0000","last_active":"2024-09-19T11:17:23.221087+0000","last_peered":"2024-09-19T11:17:23.221087+0000","last_clean":"2024-09-19T11:17:23.221087+0000","last_became_active":"2024-09-19T11:14:07.593836+0000","last_became_peered":"2024-09-19T11:14:07.593836+0000","last_unstale":"2024-09-19T11:17:23.221087+0000","last_undegraded":"2024-09-19T11:17:23.221087+0000","last_fullsized":"2024-09-19T11:17:23.221087+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:23.221010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:23.221010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.221010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:21:14.504688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.14","version":"37'16","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.193285+0000","last_change":"2024-09-19T11:17:32.193229+0000","last_active":"2024-09-19T11:17:32.193285+0000","last_peered":"2024-09-19T11:17:32.193285+0000","last_clean":"2024-09-19T11:17:32.193285+0000","last_became_active":"2024-09-19T11:13:37.365109+0000","last_became_peered":"2024-09-19T11:13:37.365109+0000","last_unstale":"2024-09-19T11:17:32.193285+0000","last_undegraded":"2024-09-19T11:17:32.193285+0000","last_fullsized":"2024-09-19T11:17:32.193285+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'16","last_scrub_stamp":"2024-09-19T11:17:32.193122+0000","last_deep_scrub":"37'16","last_deep_scrub_stamp":"2024-09-19T11:17:32.193122+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.193122+0000","objects_scrubbed":5,"log_size":16,"log_dups_size":0,"ondisk_log_size":16,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:16.365007+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.15","version":"37'286","reported_seq":395,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:05.167033+0000","last_change":"2024-09-19T11:18:05.166955+0000","last_active":"2024-09-19T11:18:05.167033+0000","last_peered":"2024-09-19T11:18:05.167033+0000","last_clean":"2024-09-19T11:18:05.167033+0000","last_became_active":"2024-09-19T11:13:39.380378+0000","last_became_peered":"2024-09-19T11:13:39.380378+0000","last_unstale":"2024-09-19T11:18:05.167033+0000","last_undegraded":"2024-09-19T11:18:05.167033+0000","last_fullsized":"2024-09-19T11:18:05.167033+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:18:05.166831+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:18:05.166831+0000","last_clean_scrub_stamp":"2024-09-19T11:18:05.166831+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:53.562506+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1b","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.010200+0000","last_change":"2024-09-19T11:17:47.010200+0000","last_active":"2024-09-19T11:17:47.010200+0000","last_peered":"2024-09-19T11:17:47.010200+0000","last_clean":"2024-09-19T11:17:47.010200+0000","last_became_active":"2024-09-19T11:13:41.387023+0000","last_became_peered":"2024-09-19T11:13:41.387023+0000","last_unstale":"2024-09-19T11:17:47.010200+0000","last_undegraded":"2024-09-19T11:17:47.010200+0000","last_fullsized":"2024-09-19T11:17:47.010200+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.010119+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.010119+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.010119+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:28.260778+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.17","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.747386+0000","last_change":"2024-09-19T11:17:11.747257+0000","last_active":"2024-09-19T11:17:11.747386+0000","last_peered":"2024-09-19T11:17:11.747386+0000","last_clean":"2024-09-19T11:17:11.747386+0000","last_became_active":"2024-09-19T11:13:33.348876+0000","last_became_peered":"2024-09-19T11:13:33.348876+0000","last_unstale":"2024-09-19T11:17:11.747386+0000","last_undegraded":"2024-09-19T11:17:11.747386+0000","last_fullsized":"2024-09-19T11:17:11.747386+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:11.747153+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:11.747153+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.747153+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:25.029210+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.10","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.839153+0000","last_change":"2024-09-19T11:16:55.839089+0000","last_active":"2024-09-19T11:16:55.839153+0000","last_peered":"2024-09-19T11:16:55.839153+0000","last_clean":"2024-09-19T11:16:55.839153+0000","last_became_active":"2024-09-19T11:13:31.364979+0000","last_became_peered":"2024-09-19T11:13:31.364979+0000","last_unstale":"2024-09-19T11:16:55.839153+0000","last_undegraded":"2024-09-19T11:16:55.839153+0000","last_fullsized":"2024-09-19T11:16:55.839153+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:55.839001+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.839001+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:14.925106+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.16","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.279898+0000","last_change":"2024-09-19T11:17:46.279811+0000","last_active":"2024-09-19T11:17:46.279898+0000","last_peered":"2024-09-19T11:17:46.279898+0000","last_clean":"2024-09-19T11:17:46.279898+0000","last_became_active":"2024-09-19T11:13:35.355054+0000","last_became_peered":"2024-09-19T11:13:35.355054+0000","last_unstale":"2024-09-19T11:17:46.279898+0000","last_undegraded":"2024-09-19T11:17:46.279898+0000","last_fullsized":"2024-09-19T11:17:46.279898+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.279731+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.279731+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.279731+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:59:20.095306+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.15","version":"37'37","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.106644+0000","last_change":"2024-09-19T11:17:35.106584+0000","last_active":"2024-09-19T11:17:35.106644+0000","last_peered":"2024-09-19T11:17:35.106644+0000","last_clean":"2024-09-19T11:17:35.106644+0000","last_became_active":"2024-09-19T11:13:37.367114+0000","last_became_peered":"2024-09-19T11:13:37.367114+0000","last_unstale":"2024-09-19T11:17:35.106644+0000","last_undegraded":"2024-09-19T11:17:35.106644+0000","last_fullsized":"2024-09-19T11:17:35.106644+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:35.106490+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:35.106490+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.106490+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:22:05.221475+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.14","version":"37'286","reported_seq":455,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.362467+0000","last_change":"2024-09-19T11:17:45.362406+0000","last_active":"2024-09-19T11:17:45.362467+0000","last_peered":"2024-09-19T11:17:45.362467+0000","last_clean":"2024-09-19T11:17:45.362467+0000","last_became_active":"2024-09-19T11:13:39.380151+0000","last_became_peered":"2024-09-19T11:13:39.380151+0000","last_unstale":"2024-09-19T11:17:45.362467+0000","last_undegraded":"2024-09-19T11:17:45.362467+0000","last_fullsized":"2024-09-19T11:17:45.362467+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:45.362319+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:45.362319+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.362319+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:48:12.433586+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.8","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.274262+0000","last_change":"2024-09-19T11:17:27.274193+0000","last_active":"2024-09-19T11:17:27.274262+0000","last_peered":"2024-09-19T11:17:27.274262+0000","last_clean":"2024-09-19T11:17:27.274262+0000","last_became_active":"2024-09-19T11:13:33.354067+0000","last_became_peered":"2024-09-19T11:13:33.354067+0000","last_unstale":"2024-09-19T11:17:27.274262+0000","last_undegraded":"2024-09-19T11:17:27.274262+0000","last_fullsized":"2024-09-19T11:17:27.274262+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:27.274106+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:27.274106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.274106+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:44:39.287747+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.f","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.264020+0000","last_change":"2024-09-19T11:16:57.263964+0000","last_active":"2024-09-19T11:16:57.264020+0000","last_peered":"2024-09-19T11:16:57.264020+0000","last_clean":"2024-09-19T11:16:57.264020+0000","last_became_active":"2024-09-19T11:13:31.353084+0000","last_became_peered":"2024-09-19T11:13:31.353084+0000","last_unstale":"2024-09-19T11:16:57.264020+0000","last_undegraded":"2024-09-19T11:16:57.264020+0000","last_fullsized":"2024-09-19T11:16:57.264020+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.263877+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.263877+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:11:17.532651+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,3,0],"acting":[2,1,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.9","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.362807+0000","last_change":"2024-09-19T11:17:28.362748+0000","last_active":"2024-09-19T11:17:28.362807+0000","last_peered":"2024-09-19T11:17:28.362807+0000","last_clean":"2024-09-19T11:17:28.362807+0000","last_became_active":"2024-09-19T11:13:35.356414+0000","last_became_peered":"2024-09-19T11:13:35.356414+0000","last_unstale":"2024-09-19T11:17:28.362807+0000","last_undegraded":"2024-09-19T11:17:28.362807+0000","last_fullsized":"2024-09-19T11:17:28.362807+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:28.362667+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:28.362667+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.362667+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:04.145457+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.a","version":"37'52","reported_seq":113,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.186689+0000","last_change":"2024-09-19T11:17:29.186611+0000","last_active":"2024-09-19T11:17:29.186689+0000","last_peered":"2024-09-19T11:17:29.186689+0000","last_clean":"2024-09-19T11:17:29.186689+0000","last_became_active":"2024-09-19T11:13:37.371152+0000","last_became_peered":"2024-09-19T11:13:37.371152+0000","last_unstale":"2024-09-19T11:17:29.186689+0000","last_undegraded":"2024-09-19T11:17:29.186689+0000","last_fullsized":"2024-09-19T11:17:29.186689+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'52","last_scrub_stamp":"2024-09-19T11:17:29.186505+0000","last_deep_scrub":"37'52","last_deep_scrub_stamp":"2024-09-19T11:17:29.186505+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.186505+0000","objects_scrubbed":9,"log_size":52,"log_dups_size":0,"ondisk_log_size":52,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:31:21.134065+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":50,"num_read_kb":39,"num_write":24,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.b","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.380342+0000","last_change":"2024-09-19T11:17:43.380288+0000","last_active":"2024-09-19T11:17:43.380342+0000","last_peered":"2024-09-19T11:17:43.380342+0000","last_clean":"2024-09-19T11:17:43.380342+0000","last_became_active":"2024-09-19T11:13:39.374107+0000","last_became_peered":"2024-09-19T11:13:39.374107+0000","last_unstale":"2024-09-19T11:17:43.380342+0000","last_undegraded":"2024-09-19T11:17:43.380342+0000","last_fullsized":"2024-09-19T11:17:43.380342+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:43.380205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:43.380205+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.380205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:52:30.582852+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.4","version":"37'3","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.022502+0000","last_change":"2024-09-19T11:17:44.022426+0000","last_active":"2024-09-19T11:17:44.022502+0000","last_peered":"2024-09-19T11:17:44.022502+0000","last_clean":"2024-09-19T11:17:44.022502+0000","last_became_active":"2024-09-19T11:13:41.391264+0000","last_became_peered":"2024-09-19T11:13:41.391264+0000","last_unstale":"2024-09-19T11:17:44.022502+0000","last_undegraded":"2024-09-19T11:17:44.022502+0000","last_fullsized":"2024-09-19T11:17:44.022502+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:44.022337+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:44.022337+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.022337+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:47:02.202019+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":7,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.9","version":"37'2","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.629046+0000","last_change":"2024-09-19T11:17:07.628983+0000","last_active":"2024-09-19T11:17:07.629046+0000","last_peered":"2024-09-19T11:17:07.629046+0000","last_clean":"2024-09-19T11:17:07.629046+0000","last_became_active":"2024-09-19T11:13:33.341442+0000","last_became_peered":"2024-09-19T11:13:33.341442+0000","last_unstale":"2024-09-19T11:17:07.629046+0000","last_undegraded":"2024-09-19T11:17:07.629046+0000","last_fullsized":"2024-09-19T11:17:07.629046+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.628902+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.628902+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:21:57.737242+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.261712+0000","last_change":"2024-09-19T11:16:56.261648+0000","last_active":"2024-09-19T11:16:56.261712+0000","last_peered":"2024-09-19T11:16:56.261712+0000","last_clean":"2024-09-19T11:16:56.261712+0000","last_became_active":"2024-09-19T11:13:31.354418+0000","last_became_peered":"2024-09-19T11:13:31.354418+0000","last_unstale":"2024-09-19T11:16:56.261712+0000","last_undegraded":"2024-09-19T11:16:56.261712+0000","last_fullsized":"2024-09-19T11:16:56.261712+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.261557+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.261557+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:25:54.106719+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.8","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.638670+0000","last_change":"2024-09-19T11:17:24.638557+0000","last_active":"2024-09-19T11:17:24.638670+0000","last_peered":"2024-09-19T11:17:24.638670+0000","last_clean":"2024-09-19T11:17:24.638670+0000","last_became_active":"2024-09-19T11:13:35.351668+0000","last_became_peered":"2024-09-19T11:13:35.351668+0000","last_unstale":"2024-09-19T11:17:24.638670+0000","last_undegraded":"2024-09-19T11:17:24.638670+0000","last_fullsized":"2024-09-19T11:17:24.638670+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:24.638460+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:24.638460+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.638460+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:33:25.911135+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.b","version":"37'37","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:53.178958+0000","last_change":"2024-09-19T11:17:53.178861+0000","last_active":"2024-09-19T11:17:53.178958+0000","last_peered":"2024-09-19T11:17:53.178958+0000","last_clean":"2024-09-19T11:17:53.178958+0000","last_became_active":"2024-09-19T11:13:37.369481+0000","last_became_peered":"2024-09-19T11:13:37.369481+0000","last_unstale":"2024-09-19T11:17:53.178958+0000","last_undegraded":"2024-09-19T11:17:53.178958+0000","last_fullsized":"2024-09-19T11:17:53.178958+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:53.178746+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:53.178746+0000","last_clean_scrub_stamp":"2024-09-19T11:17:53.178746+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:16:51.619402+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.a","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.449273+0000","last_change":"2024-09-19T11:17:40.449204+0000","last_active":"2024-09-19T11:17:40.449273+0000","last_peered":"2024-09-19T11:17:40.449273+0000","last_clean":"2024-09-19T11:17:40.449273+0000","last_became_active":"2024-09-19T11:13:39.380730+0000","last_became_peered":"2024-09-19T11:13:39.380730+0000","last_unstale":"2024-09-19T11:17:40.449273+0000","last_undegraded":"2024-09-19T11:17:40.449273+0000","last_fullsized":"2024-09-19T11:17:40.449273+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.449101+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.449101+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.449101+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:04:25.734676+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.5","version":"37'6","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.588389+0000","last_change":"2024-09-19T11:17:47.588313+0000","last_active":"2024-09-19T11:17:47.588389+0000","last_peered":"2024-09-19T11:17:47.588389+0000","last_clean":"2024-09-19T11:17:47.588389+0000","last_became_active":"2024-09-19T11:13:41.392624+0000","last_became_peered":"2024-09-19T11:13:41.392624+0000","last_unstale":"2024-09-19T11:17:47.588389+0000","last_undegraded":"2024-09-19T11:17:47.588389+0000","last_fullsized":"2024-09-19T11:17:47.588389+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:47.588229+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:47.588229+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.588229+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:24:48.144904+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":12,"num_read_kb":10,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":169,"num_omap_keys":1,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.a","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.203795+0000","last_change":"2024-09-19T11:17:11.203698+0000","last_active":"2024-09-19T11:17:11.203795+0000","last_peered":"2024-09-19T11:17:11.203795+0000","last_clean":"2024-09-19T11:17:11.203795+0000","last_became_active":"2024-09-19T11:13:33.351323+0000","last_became_peered":"2024-09-19T11:13:33.351323+0000","last_unstale":"2024-09-19T11:17:11.203795+0000","last_undegraded":"2024-09-19T11:17:11.203795+0000","last_fullsized":"2024-09-19T11:17:11.203795+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:11.203591+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.203591+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:37.021206+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.352361+0000","last_change":"2024-09-19T11:17:05.352287+0000","last_active":"2024-09-19T11:17:05.352361+0000","last_peered":"2024-09-19T11:17:05.352361+0000","last_clean":"2024-09-19T11:17:05.352361+0000","last_became_active":"2024-09-19T11:13:31.375893+0000","last_became_peered":"2024-09-19T11:13:31.375893+0000","last_unstale":"2024-09-19T11:17:05.352361+0000","last_undegraded":"2024-09-19T11:17:05.352361+0000","last_fullsized":"2024-09-19T11:17:05.352361+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:05.352205+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.352205+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:29.817735+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.b","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.637911+0000","last_change":"2024-09-19T11:17:25.637805+0000","last_active":"2024-09-19T11:17:25.637911+0000","last_peered":"2024-09-19T11:17:25.637911+0000","last_clean":"2024-09-19T11:17:25.637911+0000","last_became_active":"2024-09-19T11:13:35.349544+0000","last_became_peered":"2024-09-19T11:13:35.349544+0000","last_unstale":"2024-09-19T11:17:25.637911+0000","last_undegraded":"2024-09-19T11:17:25.637911+0000","last_fullsized":"2024-09-19T11:17:25.637911+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:25.637701+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:25.637701+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.637701+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:53.575474+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.8","version":"37'47","reported_seq":106,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:51.239646+0000","last_change":"2024-09-19T11:17:51.239589+0000","last_active":"2024-09-19T11:17:51.239646+0000","last_peered":"2024-09-19T11:17:51.239646+0000","last_clean":"2024-09-19T11:17:51.239646+0000","last_became_active":"2024-09-19T11:13:37.370874+0000","last_became_peered":"2024-09-19T11:13:37.370874+0000","last_unstale":"2024-09-19T11:17:51.239646+0000","last_undegraded":"2024-09-19T11:17:51.239646+0000","last_fullsized":"2024-09-19T11:17:51.239646+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'47","last_scrub_stamp":"2024-09-19T11:17:51.239489+0000","last_deep_scrub":"37'47","last_deep_scrub_stamp":"2024-09-19T11:17:51.239489+0000","last_clean_scrub_stamp":"2024-09-19T11:17:51.239489+0000","objects_scrubbed":7,"log_size":47,"log_dups_size":0,"ondisk_log_size":47,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:03:28.050801+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.9","version":"37'286","reported_seq":362,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.429107+0000","last_change":"2024-09-19T11:17:41.429050+0000","last_active":"2024-09-19T11:17:41.429107+0000","last_peered":"2024-09-19T11:17:41.429107+0000","last_clean":"2024-09-19T11:17:41.429107+0000","last_became_active":"2024-09-19T11:13:39.381126+0000","last_became_peered":"2024-09-19T11:13:39.381126+0000","last_unstale":"2024-09-19T11:17:41.429107+0000","last_undegraded":"2024-09-19T11:17:41.429107+0000","last_fullsized":"2024-09-19T11:17:41.429107+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.428963+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.428963+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.428963+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:50:39.532132+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.6","version":"37'8","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.362644+0000","last_change":"2024-09-19T11:17:49.362568+0000","last_active":"2024-09-19T11:17:49.362644+0000","last_peered":"2024-09-19T11:17:49.362644+0000","last_clean":"2024-09-19T11:17:49.362644+0000","last_became_active":"2024-09-19T11:13:41.390174+0000","last_became_peered":"2024-09-19T11:13:41.390174+0000","last_unstale":"2024-09-19T11:17:49.362644+0000","last_undegraded":"2024-09-19T11:17:49.362644+0000","last_fullsized":"2024-09-19T11:17:49.362644+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:49.362468+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:49.362468+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.362468+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:44:56.411840+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":80,"num_read_kb":62,"num_write":27,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.b","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.152871+0000","last_change":"2024-09-19T11:17:13.152751+0000","last_active":"2024-09-19T11:17:13.152871+0000","last_peered":"2024-09-19T11:17:13.152871+0000","last_clean":"2024-09-19T11:17:13.152871+0000","last_became_active":"2024-09-19T11:13:33.346616+0000","last_became_peered":"2024-09-19T11:13:33.346616+0000","last_unstale":"2024-09-19T11:17:13.152871+0000","last_undegraded":"2024-09-19T11:17:13.152871+0000","last_fullsized":"2024-09-19T11:17:13.152871+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.152663+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.152663+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:40.854063+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.373580+0000","last_change":"2024-09-19T11:17:04.373483+0000","last_active":"2024-09-19T11:17:04.373580+0000","last_peered":"2024-09-19T11:17:04.373580+0000","last_clean":"2024-09-19T11:17:04.373580+0000","last_became_active":"2024-09-19T11:13:31.373390+0000","last_became_peered":"2024-09-19T11:13:31.373390+0000","last_unstale":"2024-09-19T11:17:04.373580+0000","last_undegraded":"2024-09-19T11:17:04.373580+0000","last_fullsized":"2024-09-19T11:17:04.373580+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.373373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.373373+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:15.731395+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.a","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.616990+0000","last_change":"2024-09-19T11:17:26.616866+0000","last_active":"2024-09-19T11:17:26.616990+0000","last_peered":"2024-09-19T11:17:26.616990+0000","last_clean":"2024-09-19T11:17:26.616990+0000","last_became_active":"2024-09-19T11:13:35.353623+0000","last_became_peered":"2024-09-19T11:13:35.353623+0000","last_unstale":"2024-09-19T11:17:26.616990+0000","last_undegraded":"2024-09-19T11:17:26.616990+0000","last_fullsized":"2024-09-19T11:17:26.616990+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:26.616770+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:26.616770+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.616770+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:29.091964+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.9","version":"37'66","reported_seq":140,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:52.209702+0000","last_change":"2024-09-19T11:17:52.209644+0000","last_active":"2024-09-19T11:17:52.209702+0000","last_peered":"2024-09-19T11:17:52.209702+0000","last_clean":"2024-09-19T11:17:52.209702+0000","last_became_active":"2024-09-19T11:13:37.371098+0000","last_became_peered":"2024-09-19T11:13:37.371098+0000","last_unstale":"2024-09-19T11:17:52.209702+0000","last_undegraded":"2024-09-19T11:17:52.209702+0000","last_fullsized":"2024-09-19T11:17:52.209702+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'66","last_scrub_stamp":"2024-09-19T11:17:52.209547+0000","last_deep_scrub":"37'66","last_deep_scrub_stamp":"2024-09-19T11:17:52.209547+0000","last_clean_scrub_stamp":"2024-09-19T11:17:52.209547+0000","objects_scrubbed":5,"log_size":66,"log_dups_size":0,"ondisk_log_size":66,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:54:41.285238+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":220,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":61,"num_read_kb":52,"num_write":22,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.8","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.440725+0000","last_change":"2024-09-19T11:17:39.440666+0000","last_active":"2024-09-19T11:17:39.440725+0000","last_peered":"2024-09-19T11:17:39.440725+0000","last_clean":"2024-09-19T11:17:39.440725+0000","last_became_active":"2024-09-19T11:13:39.368966+0000","last_became_peered":"2024-09-19T11:13:39.368966+0000","last_unstale":"2024-09-19T11:17:39.440725+0000","last_undegraded":"2024-09-19T11:17:39.440725+0000","last_fullsized":"2024-09-19T11:17:39.440725+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:39.440562+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:39.440562+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.440562+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:37:08.444651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.7","version":"37'21","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.360339+0000","last_change":"2024-09-19T11:17:50.360270+0000","last_active":"2024-09-19T11:17:50.360339+0000","last_peered":"2024-09-19T11:17:50.360339+0000","last_clean":"2024-09-19T11:17:50.360339+0000","last_became_active":"2024-09-19T11:13:41.384976+0000","last_became_peered":"2024-09-19T11:13:41.384976+0000","last_unstale":"2024-09-19T11:17:50.360339+0000","last_undegraded":"2024-09-19T11:17:50.360339+0000","last_fullsized":"2024-09-19T11:17:50.360339+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:50.360181+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:50.360181+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.360181+0000","objects_scrubbed":3,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:50:39.947931+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":904,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":37,"num_read_kb":37,"num_write":42,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.c","version":"37'8","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.621561+0000","last_change":"2024-09-19T11:17:11.621448+0000","last_active":"2024-09-19T11:17:11.621561+0000","last_peered":"2024-09-19T11:17:11.621561+0000","last_clean":"2024-09-19T11:17:11.621561+0000","last_became_active":"2024-09-19T11:13:33.353766+0000","last_became_peered":"2024-09-19T11:13:33.353766+0000","last_unstale":"2024-09-19T11:17:11.621561+0000","last_undegraded":"2024-09-19T11:17:11.621561+0000","last_fullsized":"2024-09-19T11:17:11.621561+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:11.621356+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.621356+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:52:31.900753+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.780826+0000","last_change":"2024-09-19T11:16:57.780765+0000","last_active":"2024-09-19T11:16:57.780826+0000","last_peered":"2024-09-19T11:16:57.780826+0000","last_clean":"2024-09-19T11:16:57.780826+0000","last_became_active":"2024-09-19T11:13:31.377724+0000","last_became_peered":"2024-09-19T11:13:31.377724+0000","last_unstale":"2024-09-19T11:16:57.780826+0000","last_undegraded":"2024-09-19T11:16:57.780826+0000","last_fullsized":"2024-09-19T11:16:57.780826+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:57.780677+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.780677+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:01:08.322449+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,1,2],"acting":[0,3,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.d","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.193220+0000","last_change":"2024-09-19T11:17:30.193130+0000","last_active":"2024-09-19T11:17:30.193220+0000","last_peered":"2024-09-19T11:17:30.193220+0000","last_clean":"2024-09-19T11:17:30.193220+0000","last_became_active":"2024-09-19T11:13:35.358900+0000","last_became_peered":"2024-09-19T11:13:35.358900+0000","last_unstale":"2024-09-19T11:17:30.193220+0000","last_undegraded":"2024-09-19T11:17:30.193220+0000","last_fullsized":"2024-09-19T11:17:30.193220+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.193023+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.193023+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.193023+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:55.620571+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.e","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.452716+0000","last_change":"2024-09-19T11:17:38.452625+0000","last_active":"2024-09-19T11:17:38.452716+0000","last_peered":"2024-09-19T11:17:38.452716+0000","last_clean":"2024-09-19T11:17:38.452716+0000","last_became_active":"2024-09-19T11:13:37.361749+0000","last_became_peered":"2024-09-19T11:13:37.361749+0000","last_unstale":"2024-09-19T11:17:38.452716+0000","last_undegraded":"2024-09-19T11:17:38.452716+0000","last_fullsized":"2024-09-19T11:17:38.452716+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-19T11:17:38.452505+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-19T11:17:38.452505+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.452505+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:24:22.028550+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.f","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:03.147011+0000","last_change":"2024-09-19T11:18:03.146944+0000","last_active":"2024-09-19T11:18:03.147011+0000","last_peered":"2024-09-19T11:18:03.147011+0000","last_clean":"2024-09-19T11:18:03.147011+0000","last_became_active":"2024-09-19T11:13:39.378630+0000","last_became_peered":"2024-09-19T11:13:39.378630+0000","last_unstale":"2024-09-19T11:18:03.147011+0000","last_undegraded":"2024-09-19T11:18:03.147011+0000","last_fullsized":"2024-09-19T11:18:03.147011+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:03.146865+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:03.146865+0000","last_clean_scrub_stamp":"2024-09-19T11:18:03.146865+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:39:32.185866+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.0","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:08.060355+0000","last_change":"2024-09-19T11:18:08.060355+0000","last_active":"2024-09-19T11:18:08.060355+0000","last_peered":"2024-09-19T11:18:08.060355+0000","last_clean":"2024-09-19T11:18:08.060355+0000","last_became_active":"2024-09-19T11:13:41.390684+0000","last_became_peered":"2024-09-19T11:13:41.390684+0000","last_unstale":"2024-09-19T11:18:08.060355+0000","last_undegraded":"2024-09-19T11:18:08.060355+0000","last_fullsized":"2024-09-19T11:18:08.060355+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:18:08.060269+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:18:08.060269+0000","last_clean_scrub_stamp":"2024-09-19T11:18:08.060269+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:29:33.720195+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":199,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.d","version":"0'0","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:24.351599+0000","last_change":"2024-09-19T11:17:24.351536+0000","last_active":"2024-09-19T11:17:24.351599+0000","last_peered":"2024-09-19T11:17:24.351599+0000","last_clean":"2024-09-19T11:17:24.351599+0000","last_became_active":"2024-09-19T11:13:33.360306+0000","last_became_peered":"2024-09-19T11:13:33.360306+0000","last_unstale":"2024-09-19T11:17:24.351599+0000","last_undegraded":"2024-09-19T11:17:24.351599+0000","last_fullsized":"2024-09-19T11:17:24.351599+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:24.351451+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:24.351451+0000","last_clean_scrub_stamp":"2024-09-19T11:17:24.351451+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:11:00.037309+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.a","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.388311+0000","last_change":"2024-09-19T11:17:03.388243+0000","last_active":"2024-09-19T11:17:03.388311+0000","last_peered":"2024-09-19T11:17:03.388311+0000","last_clean":"2024-09-19T11:17:03.388311+0000","last_became_active":"2024-09-19T11:13:31.377571+0000","last_became_peered":"2024-09-19T11:13:31.377571+0000","last_unstale":"2024-09-19T11:17:03.388311+0000","last_undegraded":"2024-09-19T11:17:03.388311+0000","last_fullsized":"2024-09-19T11:17:03.388311+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.388155+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.388155+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:49:34.409511+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.c","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.599908+0000","last_change":"2024-09-19T11:17:27.599833+0000","last_active":"2024-09-19T11:17:27.599908+0000","last_peered":"2024-09-19T11:17:27.599908+0000","last_clean":"2024-09-19T11:17:27.599908+0000","last_became_active":"2024-09-19T11:13:35.348261+0000","last_became_peered":"2024-09-19T11:13:35.348261+0000","last_unstale":"2024-09-19T11:17:27.599908+0000","last_undegraded":"2024-09-19T11:17:27.599908+0000","last_fullsized":"2024-09-19T11:17:27.599908+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.599747+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.599747+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.599747+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:24.745233+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.f","version":"37'46","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.207360+0000","last_change":"2024-09-19T11:17:31.207279+0000","last_active":"2024-09-19T11:17:31.207360+0000","last_peered":"2024-09-19T11:17:31.207360+0000","last_clean":"2024-09-19T11:17:31.207360+0000","last_became_active":"2024-09-19T11:13:37.362557+0000","last_became_peered":"2024-09-19T11:13:37.362557+0000","last_unstale":"2024-09-19T11:17:31.207360+0000","last_undegraded":"2024-09-19T11:17:31.207360+0000","last_fullsized":"2024-09-19T11:17:31.207360+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:31.207126+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:31.207126+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.207126+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:27.455684+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.e","version":"37'286","reported_seq":445,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.057465+0000","last_change":"2024-09-19T11:17:38.057407+0000","last_active":"2024-09-19T11:17:38.057465+0000","last_peered":"2024-09-19T11:17:38.057465+0000","last_clean":"2024-09-19T11:17:38.057465+0000","last_became_active":"2024-09-19T11:13:39.380597+0000","last_became_peered":"2024-09-19T11:13:39.380597+0000","last_unstale":"2024-09-19T11:17:38.057465+0000","last_undegraded":"2024-09-19T11:17:38.057465+0000","last_fullsized":"2024-09-19T11:17:38.057465+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:38.057316+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:38.057316+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.057316+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:05.417830+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1","version":"37'15","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.385382+0000","last_change":"2024-09-19T11:17:48.385256+0000","last_active":"2024-09-19T11:17:48.385382+0000","last_peered":"2024-09-19T11:17:48.385382+0000","last_clean":"2024-09-19T11:17:48.385382+0000","last_became_active":"2024-09-19T11:13:41.387435+0000","last_became_peered":"2024-09-19T11:13:41.387435+0000","last_unstale":"2024-09-19T11:17:48.385382+0000","last_undegraded":"2024-09-19T11:17:48.385382+0000","last_fullsized":"2024-09-19T11:17:48.385382+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:17:48.385151+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:17:48.385151+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.385151+0000","objects_scrubbed":1,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:53:56.785402+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":32,"num_read_kb":29,"num_write":24,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":180,"num_omap_keys":1,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.e","version":"37'9","reported_seq":80,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.194378+0000","last_change":"2024-09-19T11:17:12.194292+0000","last_active":"2024-09-19T11:17:12.194378+0000","last_peered":"2024-09-19T11:17:12.194378+0000","last_clean":"2024-09-19T11:17:12.194378+0000","last_became_active":"2024-09-19T11:13:33.351047+0000","last_became_peered":"2024-09-19T11:13:33.351047+0000","last_unstale":"2024-09-19T11:17:12.194378+0000","last_undegraded":"2024-09-19T11:17:12.194378+0000","last_fullsized":"2024-09-19T11:17:12.194378+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:12.194188+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.194188+0000","objects_scrubbed":1,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:19.272935+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":56,"num_read_kb":52,"num_write":11,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.9","version":"37'4","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.338606+0000","last_change":"2024-09-19T11:17:02.338513+0000","last_active":"2024-09-19T11:17:02.338606+0000","last_peered":"2024-09-19T11:17:02.338606+0000","last_clean":"2024-09-19T11:17:02.338606+0000","last_became_active":"2024-09-19T11:13:31.368092+0000","last_became_peered":"2024-09-19T11:13:31.368092+0000","last_unstale":"2024-09-19T11:17:02.338606+0000","last_undegraded":"2024-09-19T11:17:02.338606+0000","last_fullsized":"2024-09-19T11:17:02.338606+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.338404+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.338404+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:05.736888+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":18,"num_read_kb":8,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.f","version":"37'5","reported_seq":429,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.362019+0000","last_change":"2024-09-19T11:17:29.361930+0000","last_active":"2024-09-19T11:17:29.362019+0000","last_peered":"2024-09-19T11:17:29.362019+0000","last_clean":"2024-09-19T11:17:29.362019+0000","last_became_active":"2024-09-19T11:13:35.352511+0000","last_became_peered":"2024-09-19T11:13:35.352511+0000","last_unstale":"2024-09-19T11:17:29.362019+0000","last_undegraded":"2024-09-19T11:17:29.362019+0000","last_fullsized":"2024-09-19T11:17:29.362019+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:29.361811+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:29.361811+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.361811+0000","objects_scrubbed":2,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:18.426521+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":92,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":385,"num_read_kb":385,"num_write":6,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.c","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:54.209082+0000","last_change":"2024-09-19T11:17:54.209023+0000","last_active":"2024-09-19T11:17:54.209082+0000","last_peered":"2024-09-19T11:17:54.209082+0000","last_clean":"2024-09-19T11:17:54.209082+0000","last_became_active":"2024-09-19T11:13:37.369312+0000","last_became_peered":"2024-09-19T11:13:37.369312+0000","last_unstale":"2024-09-19T11:17:54.209082+0000","last_undegraded":"2024-09-19T11:17:54.209082+0000","last_fullsized":"2024-09-19T11:17:54.209082+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:17:54.208933+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:17:54.208933+0000","last_clean_scrub_stamp":"2024-09-19T11:17:54.208933+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:41:04.200437+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.d","version":"37'286","reported_seq":482,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.472509+0000","last_change":"2024-09-19T11:17:40.472448+0000","last_active":"2024-09-19T11:17:40.472509+0000","last_peered":"2024-09-19T11:17:40.472509+0000","last_clean":"2024-09-19T11:17:40.472509+0000","last_became_active":"2024-09-19T11:13:39.364142+0000","last_became_peered":"2024-09-19T11:13:39.364142+0000","last_unstale":"2024-09-19T11:17:40.472509+0000","last_undegraded":"2024-09-19T11:17:40.472509+0000","last_fullsized":"2024-09-19T11:17:40.472509+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:40.472359+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:40.472359+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.472359+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:23:34.581152+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.2","version":"37'10","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.039406+0000","last_change":"2024-09-19T11:17:43.039305+0000","last_active":"2024-09-19T11:17:43.039406+0000","last_peered":"2024-09-19T11:17:43.039406+0000","last_clean":"2024-09-19T11:17:43.039406+0000","last_became_active":"2024-09-19T11:13:41.382207+0000","last_became_peered":"2024-09-19T11:13:41.382207+0000","last_unstale":"2024-09-19T11:17:43.039406+0000","last_undegraded":"2024-09-19T11:17:43.039406+0000","last_fullsized":"2024-09-19T11:17:43.039406+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:43.039163+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:43.039163+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.039163+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:46:32.103874+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":9,"num_write":19,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.f","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.578535+0000","last_change":"2024-09-19T11:17:09.578446+0000","last_active":"2024-09-19T11:17:09.578535+0000","last_peered":"2024-09-19T11:17:09.578535+0000","last_clean":"2024-09-19T11:17:09.578535+0000","last_became_active":"2024-09-19T11:13:33.360622+0000","last_became_peered":"2024-09-19T11:13:33.360622+0000","last_unstale":"2024-09-19T11:17:09.578535+0000","last_undegraded":"2024-09-19T11:17:09.578535+0000","last_fullsized":"2024-09-19T11:17:09.578535+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:09.578340+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.578340+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:15:59.479596+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":21,"num_read_kb":17,"num_write":8,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.8","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.333003+0000","last_change":"2024-09-19T11:16:59.332945+0000","last_active":"2024-09-19T11:16:59.333003+0000","last_peered":"2024-09-19T11:16:59.333003+0000","last_clean":"2024-09-19T11:16:59.333003+0000","last_became_active":"2024-09-19T11:13:31.375951+0000","last_became_peered":"2024-09-19T11:13:31.375951+0000","last_unstale":"2024-09-19T11:16:59.333003+0000","last_undegraded":"2024-09-19T11:16:59.333003+0000","last_fullsized":"2024-09-19T11:16:59.333003+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.332858+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.332858+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:54:10.200721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.e","version":"37'2","reported_seq":231,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.276049+0000","last_change":"2024-09-19T11:17:43.275976+0000","last_active":"2024-09-19T11:17:43.276049+0000","last_peered":"2024-09-19T11:17:43.276049+0000","last_clean":"2024-09-19T11:17:43.276049+0000","last_became_active":"2024-09-19T11:13:35.359637+0000","last_became_peered":"2024-09-19T11:13:35.359637+0000","last_unstale":"2024-09-19T11:17:43.276049+0000","last_undegraded":"2024-09-19T11:17:43.276049+0000","last_fullsized":"2024-09-19T11:17:43.276049+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:43.275885+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:43.275885+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.275885+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:48:57.031561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":436,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":285,"num_read_kb":285,"num_write":2,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.d","version":"37'49","reported_seq":109,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.422529+0000","last_change":"2024-09-19T11:17:37.422473+0000","last_active":"2024-09-19T11:17:37.422529+0000","last_peered":"2024-09-19T11:17:37.422529+0000","last_clean":"2024-09-19T11:17:37.422529+0000","last_became_active":"2024-09-19T11:13:37.367028+0000","last_became_peered":"2024-09-19T11:13:37.367028+0000","last_unstale":"2024-09-19T11:17:37.422529+0000","last_undegraded":"2024-09-19T11:17:37.422529+0000","last_fullsized":"2024-09-19T11:17:37.422529+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'49","last_scrub_stamp":"2024-09-19T11:17:37.422376+0000","last_deep_scrub":"37'49","last_deep_scrub_stamp":"2024-09-19T11:17:37.422376+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.422376+0000","objects_scrubbed":8,"log_size":49,"log_dups_size":0,"ondisk_log_size":49,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:06:50.529884+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":47,"num_read_kb":37,"num_write":22,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.c","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.061166+0000","last_change":"2024-09-19T11:17:37.061117+0000","last_active":"2024-09-19T11:17:37.061166+0000","last_peered":"2024-09-19T11:17:37.061166+0000","last_clean":"2024-09-19T11:17:37.061166+0000","last_became_active":"2024-09-19T11:13:39.381623+0000","last_became_peered":"2024-09-19T11:13:39.381623+0000","last_unstale":"2024-09-19T11:17:37.061166+0000","last_undegraded":"2024-09-19T11:17:37.061166+0000","last_fullsized":"2024-09-19T11:17:37.061166+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.061010+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.061010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.061010+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:40.292109+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.3","version":"37'10","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.541622+0000","last_change":"2024-09-19T11:17:48.541558+0000","last_active":"2024-09-19T11:17:48.541622+0000","last_peered":"2024-09-19T11:17:48.541622+0000","last_clean":"2024-09-19T11:17:48.541622+0000","last_became_active":"2024-09-19T11:13:41.381225+0000","last_became_peered":"2024-09-19T11:13:41.381225+0000","last_unstale":"2024-09-19T11:17:48.541622+0000","last_undegraded":"2024-09-19T11:17:48.541622+0000","last_fullsized":"2024-09-19T11:17:48.541622+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:48.541460+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:48.541460+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.541460+0000","objects_scrubbed":2,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:50:19.562815+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":439,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":4,"num_read_kb":3,"num_write":14,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.5","version":"37'10","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.322063+0000","last_change":"2024-09-19T11:17:22.321969+0000","last_active":"2024-09-19T11:17:22.322063+0000","last_peered":"2024-09-19T11:17:22.322063+0000","last_clean":"2024-09-19T11:17:22.322063+0000","last_became_active":"2024-09-19T11:13:33.360239+0000","last_became_peered":"2024-09-19T11:13:33.360239+0000","last_unstale":"2024-09-19T11:17:22.322063+0000","last_undegraded":"2024-09-19T11:17:22.322063+0000","last_fullsized":"2024-09-19T11:17:22.322063+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:22.321856+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:22.321856+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.321856+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:33.212561+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":22,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"1.0","version":"37'74","reported_seq":157,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.790923+0000","last_change":"2024-09-19T11:16:53.790826+0000","last_active":"2024-09-19T11:16:53.790923+0000","last_peered":"2024-09-19T11:16:53.790923+0000","last_clean":"2024-09-19T11:16:53.790923+0000","last_became_active":"2024-09-19T11:13:16.795679+0000","last_became_peered":"2024-09-19T11:13:16.795679+0000","last_unstale":"2024-09-19T11:16:53.790923+0000","last_undegraded":"2024-09-19T11:16:53.790923+0000","last_fullsized":"2024-09-19T11:16:53.790923+0000","mapping_epoch":13,"log_start":"0'0","ondisk_log_start":"0'0","created":13,"last_epoch_clean":14,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'74","last_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_deep_scrub":"37'74","last_deep_scrub_stamp":"2024-09-19T11:16:53.790697+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.790697+0000","objects_scrubbed":2,"log_size":74,"log_dups_size":0,"ondisk_log_size":74,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:16:58.322869+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.3","version":"37'2","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.307176+0000","last_change":"2024-09-19T11:16:57.307111+0000","last_active":"2024-09-19T11:16:57.307176+0000","last_peered":"2024-09-19T11:16:57.307176+0000","last_clean":"2024-09-19T11:16:57.307176+0000","last_became_active":"2024-09-19T11:13:19.243101+0000","last_became_peered":"2024-09-19T11:13:19.243101+0000","last_unstale":"2024-09-19T11:16:57.307176+0000","last_undegraded":"2024-09-19T11:16:57.307176+0000","last_fullsized":"2024-09-19T11:16:57.307176+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.307030+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.307030+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:57.423065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.00078675900000000005,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.333474+0000","last_change":"2024-09-19T11:17:01.333402+0000","last_active":"2024-09-19T11:17:01.333474+0000","last_peered":"2024-09-19T11:17:01.333474+0000","last_clean":"2024-09-19T11:17:01.333474+0000","last_became_active":"2024-09-19T11:13:31.378086+0000","last_became_peered":"2024-09-19T11:13:31.378086+0000","last_unstale":"2024-09-19T11:17:01.333474+0000","last_undegraded":"2024-09-19T11:17:01.333474+0000","last_fullsized":"2024-09-19T11:17:01.333474+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.333297+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.333297+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:36:01.707856+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.4","version":"0'0","reported_seq":45,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.404308+0000","last_change":"2024-09-19T11:17:27.404242+0000","last_active":"2024-09-19T11:17:27.404308+0000","last_peered":"2024-09-19T11:17:27.404308+0000","last_clean":"2024-09-19T11:17:27.404308+0000","last_became_active":"2024-09-19T11:14:07.596744+0000","last_became_peered":"2024-09-19T11:14:07.596744+0000","last_unstale":"2024-09-19T11:17:27.404308+0000","last_undegraded":"2024-09-19T11:17:27.404308+0000","last_fullsized":"2024-09-19T11:17:27.404308+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.404158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.404158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.404158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:07.281435+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.7","version":"37'90","reported_seq":181,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.264453+0000","last_change":"2024-09-19T11:17:50.264388+0000","last_active":"2024-09-19T11:17:50.264453+0000","last_peered":"2024-09-19T11:17:50.264453+0000","last_clean":"2024-09-19T11:17:50.264453+0000","last_became_active":"2024-09-19T11:13:37.368824+0000","last_became_peered":"2024-09-19T11:13:37.368824+0000","last_unstale":"2024-09-19T11:17:50.264453+0000","last_undegraded":"2024-09-19T11:17:50.264453+0000","last_fullsized":"2024-09-19T11:17:50.264453+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'90","last_scrub_stamp":"2024-09-19T11:17:50.264288+0000","last_deep_scrub":"37'90","last_deep_scrub_stamp":"2024-09-19T11:17:50.264288+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.264288+0000","objects_scrubbed":5,"log_size":90,"log_dups_size":0,"ondisk_log_size":90,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:41:47.595229+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":84,"num_read_kb":73,"num_write":28,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.6","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:38.440436+0000","last_change":"2024-09-19T11:17:38.440371+0000","last_active":"2024-09-19T11:17:38.440436+0000","last_peered":"2024-09-19T11:17:38.440436+0000","last_clean":"2024-09-19T11:17:38.440436+0000","last_became_active":"2024-09-19T11:13:39.380961+0000","last_became_peered":"2024-09-19T11:13:39.380961+0000","last_unstale":"2024-09-19T11:17:38.440436+0000","last_undegraded":"2024-09-19T11:17:38.440436+0000","last_fullsized":"2024-09-19T11:17:38.440436+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:38.440272+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:38.440272+0000","last_clean_scrub_stamp":"2024-09-19T11:17:38.440272+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:42:01.029191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.9","version":"37'82","reported_seq":173,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.977865+0000","last_change":"2024-09-19T11:17:44.977787+0000","last_active":"2024-09-19T11:17:44.977865+0000","last_peered":"2024-09-19T11:17:44.977865+0000","last_clean":"2024-09-19T11:17:44.977865+0000","last_became_active":"2024-09-19T11:13:41.382155+0000","last_became_peered":"2024-09-19T11:13:41.382155+0000","last_unstale":"2024-09-19T11:17:44.977865+0000","last_undegraded":"2024-09-19T11:17:44.977865+0000","last_fullsized":"2024-09-19T11:17:44.977865+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'82","last_scrub_stamp":"2024-09-19T11:17:44.977702+0000","last_deep_scrub":"37'82","last_deep_scrub_stamp":"2024-09-19T11:17:44.977702+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.977702+0000","objects_scrubbed":0,"log_size":82,"log_dups_size":0,"ondisk_log_size":82,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:44:20.274518+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":225,"num_read_kb":223,"num_write":157,"num_write_kb":52,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.6","version":"37'4","reported_seq":59,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.320845+0000","last_change":"2024-09-19T11:17:23.320770+0000","last_active":"2024-09-19T11:17:23.320845+0000","last_peered":"2024-09-19T11:17:23.320845+0000","last_clean":"2024-09-19T11:17:23.320845+0000","last_became_active":"2024-09-19T11:13:33.352293+0000","last_became_peered":"2024-09-19T11:13:33.352293+0000","last_unstale":"2024-09-19T11:17:23.320845+0000","last_undegraded":"2024-09-19T11:17:23.320845+0000","last_fullsized":"2024-09-19T11:17:23.320845+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:23.320681+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:23.320681+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.320681+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:58:45.331495+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.0","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.377364+0000","last_change":"2024-09-19T11:16:54.377268+0000","last_active":"2024-09-19T11:16:54.377364+0000","last_peered":"2024-09-19T11:16:54.377364+0000","last_clean":"2024-09-19T11:16:54.377364+0000","last_became_active":"2024-09-19T11:13:19.243782+0000","last_became_peered":"2024-09-19T11:13:19.243782+0000","last_unstale":"2024-09-19T11:16:54.377364+0000","last_undegraded":"2024-09-19T11:16:54.377364+0000","last_fullsized":"2024-09-19T11:16:54.377364+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.377134+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.377134+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:29:21.863739+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00052827699999999996,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.869812+0000","last_change":"2024-09-19T11:16:55.869737+0000","last_active":"2024-09-19T11:16:55.869812+0000","last_peered":"2024-09-19T11:16:55.869812+0000","last_clean":"2024-09-19T11:16:55.869812+0000","last_became_active":"2024-09-19T11:13:31.363294+0000","last_became_peered":"2024-09-19T11:13:31.363294+0000","last_unstale":"2024-09-19T11:16:55.869812+0000","last_undegraded":"2024-09-19T11:16:55.869812+0000","last_fullsized":"2024-09-19T11:16:55.869812+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.869650+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.869650+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:44:29.264317+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":0,"num_write":4,"num_write_kb":8184,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.7","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.277443+0000","last_change":"2024-09-19T11:17:42.277380+0000","last_active":"2024-09-19T11:17:42.277443+0000","last_peered":"2024-09-19T11:17:42.277443+0000","last_clean":"2024-09-19T11:17:42.277443+0000","last_became_active":"2024-09-19T11:13:35.355119+0000","last_became_peered":"2024-09-19T11:13:35.355119+0000","last_unstale":"2024-09-19T11:17:42.277443+0000","last_undegraded":"2024-09-19T11:17:42.277443+0000","last_fullsized":"2024-09-19T11:17:42.277443+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.277284+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.277284+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.277284+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:41:12.628751+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.4","version":"37'294","reported_seq":520,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.465318+0000","last_change":"2024-09-19T11:17:36.465237+0000","last_active":"2024-09-19T11:17:36.465318+0000","last_peered":"2024-09-19T11:17:36.465318+0000","last_clean":"2024-09-19T11:17:36.465318+0000","last_became_active":"2024-09-19T11:13:37.364771+0000","last_became_peered":"2024-09-19T11:13:37.364771+0000","last_unstale":"2024-09-19T11:17:36.465318+0000","last_undegraded":"2024-09-19T11:17:36.465318+0000","last_fullsized":"2024-09-19T11:17:36.465318+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'294","last_scrub_stamp":"2024-09-19T11:17:36.465109+0000","last_deep_scrub":"37'294","last_deep_scrub_stamp":"2024-09-19T11:17:36.465109+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.465109+0000","objects_scrubbed":10,"log_size":294,"log_dups_size":0,"ondisk_log_size":294,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:26:10.849592+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":358,"num_objects":10,"num_object_clones":0,"num_object_copies":20,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":10,"num_whiteouts":0,"num_read":378,"num_read_kb":363,"num_write":38,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.5","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:01.147001+0000","last_change":"2024-09-19T11:18:01.147001+0000","last_active":"2024-09-19T11:18:01.147001+0000","last_peered":"2024-09-19T11:18:01.147001+0000","last_clean":"2024-09-19T11:18:01.147001+0000","last_became_active":"2024-09-19T11:13:39.379652+0000","last_became_peered":"2024-09-19T11:13:39.379652+0000","last_unstale":"2024-09-19T11:18:01.147001+0000","last_undegraded":"2024-09-19T11:18:01.147001+0000","last_fullsized":"2024-09-19T11:18:01.147001+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:01.146895+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:01.146895+0000","last_clean_scrub_stamp":"2024-09-19T11:18:01.146895+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:08:21.149062+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.a","version":"37'3","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:50.519919+0000","last_change":"2024-09-19T11:17:50.519864+0000","last_active":"2024-09-19T11:17:50.519919+0000","last_peered":"2024-09-19T11:17:50.519919+0000","last_clean":"2024-09-19T11:17:50.519919+0000","last_became_active":"2024-09-19T11:13:41.393815+0000","last_became_peered":"2024-09-19T11:13:41.393815+0000","last_unstale":"2024-09-19T11:17:50.519919+0000","last_undegraded":"2024-09-19T11:17:50.519919+0000","last_fullsized":"2024-09-19T11:17:50.519919+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:50.519733+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:50.519733+0000","last_clean_scrub_stamp":"2024-09-19T11:17:50.519733+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:45:14.985263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":4,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.7","version":"35'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.718875+0000","last_change":"2024-09-19T11:17:09.718806+0000","last_active":"2024-09-19T11:17:09.718875+0000","last_peered":"2024-09-19T11:17:09.718875+0000","last_clean":"2024-09-19T11:17:09.718875+0000","last_became_active":"2024-09-19T11:13:33.348383+0000","last_became_peered":"2024-09-19T11:13:33.348383+0000","last_unstale":"2024-09-19T11:17:09.718875+0000","last_undegraded":"2024-09-19T11:17:09.718875+0000","last_fullsized":"2024-09-19T11:17:09.718875+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.718720+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.718720+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:13:37.876737+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.1","version":"0'0","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.199111+0000","last_change":"2024-09-19T11:17:00.199057+0000","last_active":"2024-09-19T11:17:00.199111+0000","last_peered":"2024-09-19T11:17:00.199111+0000","last_clean":"2024-09-19T11:17:00.199111+0000","last_became_active":"2024-09-19T11:13:19.243942+0000","last_became_peered":"2024-09-19T11:13:19.243942+0000","last_unstale":"2024-09-19T11:17:00.199111+0000","last_undegraded":"2024-09-19T11:17:00.199111+0000","last_fullsized":"2024-09-19T11:17:00.199111+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.198970+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.198970+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:24:17.702619+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00045063900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.0","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.862627+0000","last_change":"2024-09-19T11:16:54.862568+0000","last_active":"2024-09-19T11:16:54.862627+0000","last_peered":"2024-09-19T11:16:54.862627+0000","last_clean":"2024-09-19T11:16:54.862627+0000","last_became_active":"2024-09-19T11:13:31.377253+0000","last_became_peered":"2024-09-19T11:13:31.377253+0000","last_unstale":"2024-09-19T11:16:54.862627+0000","last_undegraded":"2024-09-19T11:16:54.862627+0000","last_fullsized":"2024-09-19T11:16:54.862627+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.862494+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.862494+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:43:12.037986+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.6","version":"37'2","reported_seq":41,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:21.196444+0000","last_change":"2024-09-19T11:17:21.196383+0000","last_active":"2024-09-19T11:17:21.196444+0000","last_peered":"2024-09-19T11:17:21.196444+0000","last_clean":"2024-09-19T11:17:21.196444+0000","last_became_active":"2024-09-19T11:13:35.349865+0000","last_became_peered":"2024-09-19T11:13:35.349865+0000","last_unstale":"2024-09-19T11:17:21.196444+0000","last_undegraded":"2024-09-19T11:17:21.196444+0000","last_fullsized":"2024-09-19T11:17:21.196444+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:21.196295+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:21.196295+0000","last_clean_scrub_stamp":"2024-09-19T11:17:21.196295+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:08:52.011445+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.5","version":"37'24","reported_seq":102,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.146611+0000","last_change":"2024-09-19T11:17:34.146548+0000","last_active":"2024-09-19T11:17:34.146611+0000","last_peered":"2024-09-19T11:17:34.146611+0000","last_clean":"2024-09-19T11:17:34.146611+0000","last_became_active":"2024-09-19T11:13:37.369485+0000","last_became_peered":"2024-09-19T11:13:37.369485+0000","last_unstale":"2024-09-19T11:17:34.146611+0000","last_undegraded":"2024-09-19T11:17:34.146611+0000","last_fullsized":"2024-09-19T11:17:34.146611+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'24","last_scrub_stamp":"2024-09-19T11:17:34.146438+0000","last_deep_scrub":"37'24","last_deep_scrub_stamp":"2024-09-19T11:17:34.146438+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.146438+0000","objects_scrubbed":8,"log_size":24,"log_dups_size":0,"ondisk_log_size":24,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:55:54.002853+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":154,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":21,"num_read_kb":13,"num_write":13,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.4","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.419254+0000","last_change":"2024-09-19T11:17:37.419197+0000","last_active":"2024-09-19T11:17:37.419254+0000","last_peered":"2024-09-19T11:17:37.419254+0000","last_clean":"2024-09-19T11:17:37.419254+0000","last_became_active":"2024-09-19T11:13:39.381353+0000","last_became_peered":"2024-09-19T11:13:39.381353+0000","last_unstale":"2024-09-19T11:17:37.419254+0000","last_undegraded":"2024-09-19T11:17:37.419254+0000","last_fullsized":"2024-09-19T11:17:37.419254+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.419097+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.419097+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.419097+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:23:05.801332+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.b","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:09.055771+0000","last_change":"2024-09-19T11:18:09.055708+0000","last_active":"2024-09-19T11:18:09.055771+0000","last_peered":"2024-09-19T11:18:09.055771+0000","last_clean":"2024-09-19T11:18:09.055771+0000","last_became_active":"2024-09-19T11:13:41.389858+0000","last_became_peered":"2024-09-19T11:13:41.389858+0000","last_unstale":"2024-09-19T11:18:09.055771+0000","last_undegraded":"2024-09-19T11:18:09.055771+0000","last_fullsized":"2024-09-19T11:18:09.055771+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:18:09.055601+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:18:09.055601+0000","last_clean_scrub_stamp":"2024-09-19T11:18:09.055601+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:01:52.349592+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":21,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.4","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.741787+0000","last_change":"2024-09-19T11:17:08.741731+0000","last_active":"2024-09-19T11:17:08.741787+0000","last_peered":"2024-09-19T11:17:08.741787+0000","last_clean":"2024-09-19T11:17:08.741787+0000","last_became_active":"2024-09-19T11:13:33.352165+0000","last_became_peered":"2024-09-19T11:13:33.352165+0000","last_unstale":"2024-09-19T11:17:08.741787+0000","last_undegraded":"2024-09-19T11:17:08.741787+0000","last_fullsized":"2024-09-19T11:17:08.741787+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.741641+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.741641+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:52:41.893880+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":42,"num_read_kb":38,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.2","version":"37'3","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.316760+0000","last_change":"2024-09-19T11:16:58.316669+0000","last_active":"2024-09-19T11:16:58.316760+0000","last_peered":"2024-09-19T11:16:58.316760+0000","last_clean":"2024-09-19T11:16:58.316760+0000","last_became_active":"2024-09-19T11:13:19.243041+0000","last_became_peered":"2024-09-19T11:13:19.243041+0000","last_unstale":"2024-09-19T11:16:58.316760+0000","last_undegraded":"2024-09-19T11:16:58.316760+0000","last_fullsized":"2024-09-19T11:16:58.316760+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:16:58.316534+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.316534+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:27:33.887561+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0.0010315750000000001,"stat_sum":{"num_bytes":19,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.3","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.307701+0000","last_change":"2024-09-19T11:16:55.307594+0000","last_active":"2024-09-19T11:16:55.307701+0000","last_peered":"2024-09-19T11:16:55.307701+0000","last_clean":"2024-09-19T11:16:55.307701+0000","last_became_active":"2024-09-19T11:13:31.370492+0000","last_became_peered":"2024-09-19T11:13:31.370492+0000","last_unstale":"2024-09-19T11:16:55.307701+0000","last_undegraded":"2024-09-19T11:16:55.307701+0000","last_fullsized":"2024-09-19T11:16:55.307701+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:55.307489+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.307489+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:24.095008+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1,0,3],"acting":[2,1,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.5","version":"37'5","reported_seq":239,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:23.685173+0000","last_change":"2024-09-19T11:17:23.685079+0000","last_active":"2024-09-19T11:17:23.685173+0000","last_peered":"2024-09-19T11:17:23.685173+0000","last_clean":"2024-09-19T11:17:23.685173+0000","last_became_active":"2024-09-19T11:13:35.357380+0000","last_became_peered":"2024-09-19T11:13:35.357380+0000","last_unstale":"2024-09-19T11:17:23.685173+0000","last_undegraded":"2024-09-19T11:17:23.685173+0000","last_fullsized":"2024-09-19T11:17:23.685173+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:23.684978+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:23.684978+0000","last_clean_scrub_stamp":"2024-09-19T11:17:23.684978+0000","objects_scrubbed":1,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:26:01.177727+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":993,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":301,"num_read_kb":301,"num_write":8,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.6","version":"37'21","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.284844+0000","last_change":"2024-09-19T11:17:48.284720+0000","last_active":"2024-09-19T11:17:48.284844+0000","last_peered":"2024-09-19T11:17:48.284844+0000","last_clean":"2024-09-19T11:17:48.284844+0000","last_became_active":"2024-09-19T11:13:37.368911+0000","last_became_peered":"2024-09-19T11:13:37.368911+0000","last_unstale":"2024-09-19T11:17:48.284844+0000","last_undegraded":"2024-09-19T11:17:48.284844+0000","last_fullsized":"2024-09-19T11:17:48.284844+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:48.284599+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:48.284599+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.284599+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:26:20.976592+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":15,"num_write":14,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":394,"num_omap_keys":2,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.7","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:02.137324+0000","last_change":"2024-09-19T11:18:02.137324+0000","last_active":"2024-09-19T11:18:02.137324+0000","last_peered":"2024-09-19T11:18:02.137324+0000","last_clean":"2024-09-19T11:18:02.137324+0000","last_became_active":"2024-09-19T11:13:39.379299+0000","last_became_peered":"2024-09-19T11:13:39.379299+0000","last_unstale":"2024-09-19T11:18:02.137324+0000","last_undegraded":"2024-09-19T11:18:02.137324+0000","last_fullsized":"2024-09-19T11:18:02.137324+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:02.137244+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:02.137244+0000","last_clean_scrub_stamp":"2024-09-19T11:18:02.137244+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:22.209925+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.8","version":"37'6","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.560728+0000","last_change":"2024-09-19T11:17:49.560631+0000","last_active":"2024-09-19T11:17:49.560728+0000","last_peered":"2024-09-19T11:17:49.560728+0000","last_clean":"2024-09-19T11:17:49.560728+0000","last_became_active":"2024-09-19T11:13:41.395141+0000","last_became_peered":"2024-09-19T11:13:41.395141+0000","last_unstale":"2024-09-19T11:17:49.560728+0000","last_undegraded":"2024-09-19T11:17:49.560728+0000","last_fullsized":"2024-09-19T11:17:49.560728+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:49.560534+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:49.560534+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.560534+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:58:54.966372+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":9,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2","version":"37'8","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.597323+0000","last_change":"2024-09-19T11:17:08.597259+0000","last_active":"2024-09-19T11:17:08.597323+0000","last_peered":"2024-09-19T11:17:08.597323+0000","last_clean":"2024-09-19T11:17:08.597323+0000","last_became_active":"2024-09-19T11:13:33.355496+0000","last_became_peered":"2024-09-19T11:13:33.355496+0000","last_unstale":"2024-09-19T11:17:08.597323+0000","last_undegraded":"2024-09-19T11:17:08.597323+0000","last_fullsized":"2024-09-19T11:17:08.597323+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:08.597174+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.597174+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:52:37.364781+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.5","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.263977+0000","last_change":"2024-09-19T11:16:54.263916+0000","last_active":"2024-09-19T11:16:54.263977+0000","last_peered":"2024-09-19T11:16:54.263977+0000","last_clean":"2024-09-19T11:16:54.263977+0000","last_became_active":"2024-09-19T11:13:31.371460+0000","last_became_peered":"2024-09-19T11:13:31.371460+0000","last_unstale":"2024-09-19T11:16:54.263977+0000","last_undegraded":"2024-09-19T11:16:54.263977+0000","last_fullsized":"2024-09-19T11:16:54.263977+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:54.263815+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.263815+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:52:48.536224+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,1,3],"acting":[2,0,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"2.4","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:52.839804+0000","last_change":"2024-09-19T11:16:52.839753+0000","last_active":"2024-09-19T11:16:52.839804+0000","last_peered":"2024-09-19T11:16:52.839804+0000","last_clean":"2024-09-19T11:16:52.839804+0000","last_became_active":"2024-09-19T11:13:19.244843+0000","last_became_peered":"2024-09-19T11:13:19.244843+0000","last_unstale":"2024-09-19T11:16:52.839804+0000","last_undegraded":"2024-09-19T11:16:52.839804+0000","last_fullsized":"2024-09-19T11:16:52.839804+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:52.839679+0000","last_clean_scrub_stamp":"2024-09-19T11:16:52.839679+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:51.504665+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00060074599999999998,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.3","version":"37'2","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.721316+0000","last_change":"2024-09-19T11:17:22.721197+0000","last_active":"2024-09-19T11:17:22.721316+0000","last_peered":"2024-09-19T11:17:22.721316+0000","last_clean":"2024-09-19T11:17:22.721316+0000","last_became_active":"2024-09-19T11:13:35.354503+0000","last_became_peered":"2024-09-19T11:13:35.354503+0000","last_unstale":"2024-09-19T11:17:22.721316+0000","last_undegraded":"2024-09-19T11:17:22.721316+0000","last_fullsized":"2024-09-19T11:17:22.721316+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:22.721097+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:22.721097+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.721097+0000","objects_scrubbed":1,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:23:27.112253+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":187,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":1,"num_read_kb":1,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.0","version":"37'78","reported_seq":155,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:29.586624+0000","last_change":"2024-09-19T11:17:29.586553+0000","last_active":"2024-09-19T11:17:29.586624+0000","last_peered":"2024-09-19T11:17:29.586624+0000","last_clean":"2024-09-19T11:17:29.586624+0000","last_became_active":"2024-09-19T11:13:37.366195+0000","last_became_peered":"2024-09-19T11:13:37.366195+0000","last_unstale":"2024-09-19T11:17:29.586624+0000","last_undegraded":"2024-09-19T11:17:29.586624+0000","last_fullsized":"2024-09-19T11:17:29.586624+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'78","last_scrub_stamp":"2024-09-19T11:17:29.586456+0000","last_deep_scrub":"37'78","last_deep_scrub_stamp":"2024-09-19T11:17:29.586456+0000","last_clean_scrub_stamp":"2024-09-19T11:17:29.586456+0000","objects_scrubbed":9,"log_size":78,"log_dups_size":0,"ondisk_log_size":78,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:49:17.660323+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":76,"num_read_kb":72,"num_write":34,"num_write_kb":8,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":336,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.057424+0000","last_change":"2024-09-19T11:17:36.057336+0000","last_active":"2024-09-19T11:17:36.057424+0000","last_peered":"2024-09-19T11:17:36.057424+0000","last_clean":"2024-09-19T11:17:36.057424+0000","last_became_active":"2024-09-19T11:13:39.379742+0000","last_became_peered":"2024-09-19T11:13:39.379742+0000","last_unstale":"2024-09-19T11:17:36.057424+0000","last_undegraded":"2024-09-19T11:17:36.057424+0000","last_fullsized":"2024-09-19T11:17:36.057424+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:36.057220+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:36.057220+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.057220+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:00:39.977022+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.e","version":"37'9","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:51.374737+0000","last_change":"2024-09-19T11:17:51.374677+0000","last_active":"2024-09-19T11:17:51.374737+0000","last_peered":"2024-09-19T11:17:51.374737+0000","last_clean":"2024-09-19T11:17:51.374737+0000","last_became_active":"2024-09-19T11:13:41.384567+0000","last_became_peered":"2024-09-19T11:13:41.384567+0000","last_unstale":"2024-09-19T11:17:51.374737+0000","last_undegraded":"2024-09-19T11:17:51.374737+0000","last_fullsized":"2024-09-19T11:17:51.374737+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:51.374588+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:51.374588+0000","last_clean_scrub_stamp":"2024-09-19T11:17:51.374588+0000","objects_scrubbed":0,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:00:32.670105+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":24,"num_write":15,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.3","version":"37'10","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:05.725584+0000","last_change":"2024-09-19T11:17:05.725498+0000","last_active":"2024-09-19T11:17:05.725584+0000","last_peered":"2024-09-19T11:17:05.725584+0000","last_clean":"2024-09-19T11:17:05.725584+0000","last_became_active":"2024-09-19T11:13:33.354620+0000","last_became_peered":"2024-09-19T11:13:33.354620+0000","last_unstale":"2024-09-19T11:17:05.725584+0000","last_undegraded":"2024-09-19T11:17:05.725584+0000","last_fullsized":"2024-09-19T11:17:05.725584+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:05.725349+0000","last_clean_scrub_stamp":"2024-09-19T11:17:05.725349+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:45:53.167095+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.4","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.823693+0000","last_change":"2024-09-19T11:16:56.823573+0000","last_active":"2024-09-19T11:16:56.823693+0000","last_peered":"2024-09-19T11:16:56.823693+0000","last_clean":"2024-09-19T11:16:56.823693+0000","last_became_active":"2024-09-19T11:13:31.363387+0000","last_became_peered":"2024-09-19T11:13:31.363387+0000","last_unstale":"2024-09-19T11:16:56.823693+0000","last_undegraded":"2024-09-19T11:16:56.823693+0000","last_fullsized":"2024-09-19T11:16:56.823693+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.823458+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.823458+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:58:43.789933+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"2.5","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:55.328867+0000","last_change":"2024-09-19T11:16:55.328783+0000","last_active":"2024-09-19T11:16:55.328867+0000","last_peered":"2024-09-19T11:16:55.328867+0000","last_clean":"2024-09-19T11:16:55.328867+0000","last_became_active":"2024-09-19T11:13:19.244784+0000","last_became_peered":"2024-09-19T11:13:19.244784+0000","last_unstale":"2024-09-19T11:16:55.328867+0000","last_undegraded":"2024-09-19T11:16:55.328867+0000","last_fullsized":"2024-09-19T11:16:55.328867+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:55.328699+0000","last_clean_scrub_stamp":"2024-09-19T11:16:55.328699+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:51:16.068678+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.001027242,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.2","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.321552+0000","last_change":"2024-09-19T11:17:41.321469+0000","last_active":"2024-09-19T11:17:41.321552+0000","last_peered":"2024-09-19T11:17:41.321552+0000","last_clean":"2024-09-19T11:17:41.321552+0000","last_became_active":"2024-09-19T11:13:35.355613+0000","last_became_peered":"2024-09-19T11:13:35.355613+0000","last_unstale":"2024-09-19T11:17:41.321552+0000","last_undegraded":"2024-09-19T11:17:41.321552+0000","last_fullsized":"2024-09-19T11:17:41.321552+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:41.321345+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:41.321345+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.321345+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:38:41.516171+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.1","version":"37'21","reported_seq":63,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.472055+0000","last_change":"2024-09-19T11:17:35.471998+0000","last_active":"2024-09-19T11:17:35.472055+0000","last_peered":"2024-09-19T11:17:35.472055+0000","last_clean":"2024-09-19T11:17:35.472055+0000","last_became_active":"2024-09-19T11:13:37.367622+0000","last_became_peered":"2024-09-19T11:13:37.367622+0000","last_unstale":"2024-09-19T11:17:35.472055+0000","last_undegraded":"2024-09-19T11:17:35.472055+0000","last_fullsized":"2024-09-19T11:17:35.472055+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'21","last_scrub_stamp":"2024-09-19T11:17:35.471898+0000","last_deep_scrub":"37'21","last_deep_scrub_stamp":"2024-09-19T11:17:35.471898+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.471898+0000","objects_scrubbed":7,"log_size":21,"log_dups_size":0,"ondisk_log_size":21,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:50:30.288806+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":21,"num_read_kb":14,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.0","version":"37'286","reported_seq":383,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.502319+0000","last_change":"2024-09-19T11:17:41.502319+0000","last_active":"2024-09-19T11:17:41.502319+0000","last_peered":"2024-09-19T11:17:41.502319+0000","last_clean":"2024-09-19T11:17:41.502319+0000","last_became_active":"2024-09-19T11:13:39.370051+0000","last_became_peered":"2024-09-19T11:13:39.370051+0000","last_unstale":"2024-09-19T11:17:41.502319+0000","last_undegraded":"2024-09-19T11:17:41.502319+0000","last_fullsized":"2024-09-19T11:17:41.502319+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.502183+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.502183+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.502183+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:48.866065+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.f","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:11.105470+0000","last_change":"2024-09-19T11:18:11.105379+0000","last_active":"2024-09-19T11:18:11.105470+0000","last_peered":"2024-09-19T11:18:11.105470+0000","last_clean":"2024-09-19T11:18:11.105470+0000","last_became_active":"2024-09-19T11:13:41.391316+0000","last_became_peered":"2024-09-19T11:13:41.391316+0000","last_unstale":"2024-09-19T11:18:11.105470+0000","last_undegraded":"2024-09-19T11:18:11.105470+0000","last_fullsized":"2024-09-19T11:18:11.105470+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:18:11.105281+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:18:11.105281+0000","last_clean_scrub_stamp":"2024-09-19T11:18:11.105281+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:51:29.068902+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.0","version":"37'12","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:08.233355+0000","last_change":"2024-09-19T11:17:08.233251+0000","last_active":"2024-09-19T11:17:08.233355+0000","last_peered":"2024-09-19T11:17:08.233355+0000","last_clean":"2024-09-19T11:17:08.233355+0000","last_became_active":"2024-09-19T11:14:07.593578+0000","last_became_peered":"2024-09-19T11:14:07.593578+0000","last_unstale":"2024-09-19T11:17:08.233355+0000","last_undegraded":"2024-09-19T11:17:08.233355+0000","last_fullsized":"2024-09-19T11:17:08.233355+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:08.233135+0000","last_clean_scrub_stamp":"2024-09-19T11:17:08.233135+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:01.961688+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":71,"num_read_kb":67,"num_write":14,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.7","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.372143+0000","last_change":"2024-09-19T11:17:00.372051+0000","last_active":"2024-09-19T11:17:00.372143+0000","last_peered":"2024-09-19T11:17:00.372143+0000","last_clean":"2024-09-19T11:17:00.372143+0000","last_became_active":"2024-09-19T11:13:31.367340+0000","last_became_peered":"2024-09-19T11:13:31.367340+0000","last_unstale":"2024-09-19T11:17:00.372143+0000","last_undegraded":"2024-09-19T11:17:00.372143+0000","last_fullsized":"2024-09-19T11:17:00.372143+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:00.371942+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.371942+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:42:44.482502+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,1,2],"acting":[3,0,1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"2.6","version":"0'0","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:53.828197+0000","last_change":"2024-09-19T11:16:53.828131+0000","last_active":"2024-09-19T11:16:53.828197+0000","last_peered":"2024-09-19T11:16:53.828197+0000","last_clean":"2024-09-19T11:16:53.828197+0000","last_became_active":"2024-09-19T11:13:19.244060+0000","last_became_peered":"2024-09-19T11:13:19.244060+0000","last_unstale":"2024-09-19T11:16:53.828197+0000","last_undegraded":"2024-09-19T11:16:53.828197+0000","last_fullsized":"2024-09-19T11:16:53.828197+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:53.828060+0000","last_clean_scrub_stamp":"2024-09-19T11:16:53.828060+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:47:16.144293+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0.00051501900000000002,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.1","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.274921+0000","last_change":"2024-09-19T11:17:40.274866+0000","last_active":"2024-09-19T11:17:40.274921+0000","last_peered":"2024-09-19T11:17:40.274921+0000","last_clean":"2024-09-19T11:17:40.274921+0000","last_became_active":"2024-09-19T11:13:35.355088+0000","last_became_peered":"2024-09-19T11:13:35.355088+0000","last_unstale":"2024-09-19T11:17:40.274921+0000","last_undegraded":"2024-09-19T11:17:40.274921+0000","last_fullsized":"2024-09-19T11:17:40.274921+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.274775+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.274775+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.274775+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:55:48.366891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.2","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:49.240723+0000","last_change":"2024-09-19T11:17:49.240723+0000","last_active":"2024-09-19T11:17:49.240723+0000","last_peered":"2024-09-19T11:17:49.240723+0000","last_clean":"2024-09-19T11:17:49.240723+0000","last_became_active":"2024-09-19T11:13:37.371215+0000","last_became_peered":"2024-09-19T11:13:37.371215+0000","last_unstale":"2024-09-19T11:17:49.240723+0000","last_undegraded":"2024-09-19T11:17:49.240723+0000","last_fullsized":"2024-09-19T11:17:49.240723+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:17:49.240613+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:17:49.240613+0000","last_clean_scrub_stamp":"2024-09-19T11:17:49.240613+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:31:06.458052+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.3","version":"37'286","reported_seq":413,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.347291+0000","last_change":"2024-09-19T11:17:44.347233+0000","last_active":"2024-09-19T11:17:44.347291+0000","last_peered":"2024-09-19T11:17:44.347291+0000","last_clean":"2024-09-19T11:17:44.347291+0000","last_became_active":"2024-09-19T11:13:39.373868+0000","last_became_peered":"2024-09-19T11:13:39.373868+0000","last_unstale":"2024-09-19T11:17:44.347291+0000","last_undegraded":"2024-09-19T11:17:44.347291+0000","last_fullsized":"2024-09-19T11:17:44.347291+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:44.347136+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:44.347136+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.347136+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:35:47.855799+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.c","version":"37'5","reported_seq":33,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:52.525650+0000","last_change":"2024-09-19T11:17:52.525564+0000","last_active":"2024-09-19T11:17:52.525650+0000","last_peered":"2024-09-19T11:17:52.525650+0000","last_clean":"2024-09-19T11:17:52.525650+0000","last_became_active":"2024-09-19T11:13:41.392453+0000","last_became_peered":"2024-09-19T11:13:41.392453+0000","last_unstale":"2024-09-19T11:17:52.525650+0000","last_undegraded":"2024-09-19T11:17:52.525650+0000","last_fullsized":"2024-09-19T11:17:52.525650+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'5","last_scrub_stamp":"2024-09-19T11:17:52.525465+0000","last_deep_scrub":"37'5","last_deep_scrub_stamp":"2024-09-19T11:17:52.525465+0000","last_clean_scrub_stamp":"2024-09-19T11:17:52.525465+0000","objects_scrubbed":0,"log_size":5,"log_dups_size":0,"ondisk_log_size":5,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:10:27.880721+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":10,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1","version":"37'6","reported_seq":69,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.157088+0000","last_change":"2024-09-19T11:17:10.156983+0000","last_active":"2024-09-19T11:17:10.157088+0000","last_peered":"2024-09-19T11:17:10.157088+0000","last_clean":"2024-09-19T11:17:10.157088+0000","last_became_active":"2024-09-19T11:13:33.350275+0000","last_became_peered":"2024-09-19T11:13:33.350275+0000","last_unstale":"2024-09-19T11:17:10.157088+0000","last_undegraded":"2024-09-19T11:17:10.157088+0000","last_fullsized":"2024-09-19T11:17:10.157088+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:10.156870+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.156870+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:33:27.088137+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":29,"num_read_kb":29,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.6","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:54.792138+0000","last_change":"2024-09-19T11:16:54.792079+0000","last_active":"2024-09-19T11:16:54.792138+0000","last_peered":"2024-09-19T11:16:54.792138+0000","last_clean":"2024-09-19T11:16:54.792138+0000","last_became_active":"2024-09-19T11:13:31.363035+0000","last_became_peered":"2024-09-19T11:13:31.363035+0000","last_unstale":"2024-09-19T11:16:54.792138+0000","last_undegraded":"2024-09-19T11:16:54.792138+0000","last_fullsized":"2024-09-19T11:16:54.792138+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:54.791976+0000","last_clean_scrub_stamp":"2024-09-19T11:16:54.791976+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:52:48.520529+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,3,0],"acting":[1,2,3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"2.7","version":"0'0","reported_seq":66,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.281155+0000","last_change":"2024-09-19T11:16:56.281102+0000","last_active":"2024-09-19T11:16:56.281155+0000","last_peered":"2024-09-19T11:16:56.281155+0000","last_clean":"2024-09-19T11:16:56.281155+0000","last_became_active":"2024-09-19T11:13:19.244148+0000","last_became_peered":"2024-09-19T11:13:19.244148+0000","last_unstale":"2024-09-19T11:16:56.281155+0000","last_undegraded":"2024-09-19T11:16:56.281155+0000","last_fullsized":"2024-09-19T11:16:56.281155+0000","mapping_epoch":16,"log_start":"0'0","ondisk_log_start":"0'0","created":16,"last_epoch_clean":17,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:56.281013+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.281013+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:37:47.506937+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0.00049913900000000001,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.0","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:37.147846+0000","last_change":"2024-09-19T11:17:37.147783+0000","last_active":"2024-09-19T11:17:37.147846+0000","last_peered":"2024-09-19T11:17:37.147846+0000","last_clean":"2024-09-19T11:17:37.147846+0000","last_became_active":"2024-09-19T11:13:35.355587+0000","last_became_peered":"2024-09-19T11:13:35.355587+0000","last_unstale":"2024-09-19T11:17:37.147846+0000","last_undegraded":"2024-09-19T11:17:37.147846+0000","last_fullsized":"2024-09-19T11:17:37.147846+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:37.147688+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:37.147688+0000","last_clean_scrub_stamp":"2024-09-19T11:17:37.147688+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:05:12.774176+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.3","version":"37'99","reported_seq":193,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.209043+0000","last_change":"2024-09-19T11:17:28.208941+0000","last_active":"2024-09-19T11:17:28.209043+0000","last_peered":"2024-09-19T11:17:28.209043+0000","last_clean":"2024-09-19T11:17:28.209043+0000","last_became_active":"2024-09-19T11:13:37.366699+0000","last_became_peered":"2024-09-19T11:13:37.366699+0000","last_unstale":"2024-09-19T11:17:28.209043+0000","last_undegraded":"2024-09-19T11:17:28.209043+0000","last_fullsized":"2024-09-19T11:17:28.209043+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'99","last_scrub_stamp":"2024-09-19T11:17:28.208805+0000","last_deep_scrub":"37'99","last_deep_scrub_stamp":"2024-09-19T11:17:28.208805+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.208805+0000","objects_scrubbed":8,"log_size":99,"log_dups_size":0,"ondisk_log_size":99,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:39.102011+0000","scrub_duration":4,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":330,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":93,"num_read_kb":79,"num_write":34,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.2","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:36.458979+0000","last_change":"2024-09-19T11:17:36.458909+0000","last_active":"2024-09-19T11:17:36.458979+0000","last_peered":"2024-09-19T11:17:36.458979+0000","last_clean":"2024-09-19T11:17:36.458979+0000","last_became_active":"2024-09-19T11:13:39.369163+0000","last_became_peered":"2024-09-19T11:13:39.369163+0000","last_unstale":"2024-09-19T11:17:36.458979+0000","last_undegraded":"2024-09-19T11:17:36.458979+0000","last_fullsized":"2024-09-19T11:17:36.458979+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:36.458805+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:36.458805+0000","last_clean_scrub_stamp":"2024-09-19T11:17:36.458805+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:16.243718+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.d","version":"37'2","reported_seq":29,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.990042+0000","last_change":"2024-09-19T11:17:45.989960+0000","last_active":"2024-09-19T11:17:45.990042+0000","last_peered":"2024-09-19T11:17:45.990042+0000","last_clean":"2024-09-19T11:17:45.990042+0000","last_became_active":"2024-09-19T11:13:41.387182+0000","last_became_peered":"2024-09-19T11:13:41.387182+0000","last_unstale":"2024-09-19T11:17:45.990042+0000","last_undegraded":"2024-09-19T11:17:45.990042+0000","last_fullsized":"2024-09-19T11:17:45.990042+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:45.989883+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:45.989883+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.989883+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:19.232601+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1f","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:48.015387+0000","last_change":"2024-09-19T11:17:48.015330+0000","last_active":"2024-09-19T11:17:48.015387+0000","last_peered":"2024-09-19T11:17:48.015387+0000","last_clean":"2024-09-19T11:17:48.015387+0000","last_became_active":"2024-09-19T11:13:41.387122+0000","last_became_peered":"2024-09-19T11:13:41.387122+0000","last_unstale":"2024-09-19T11:17:48.015387+0000","last_undegraded":"2024-09-19T11:17:48.015387+0000","last_fullsized":"2024-09-19T11:17:48.015387+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:48.015242+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:48.015242+0000","last_clean_scrub_stamp":"2024-09-19T11:17:48.015242+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:46:12.717185+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.13","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.153222+0000","last_change":"2024-09-19T11:17:14.153164+0000","last_active":"2024-09-19T11:17:14.153222+0000","last_peered":"2024-09-19T11:17:14.153222+0000","last_clean":"2024-09-19T11:17:14.153222+0000","last_became_active":"2024-09-19T11:13:33.352947+0000","last_became_peered":"2024-09-19T11:13:33.352947+0000","last_unstale":"2024-09-19T11:17:14.153222+0000","last_undegraded":"2024-09-19T11:17:14.153222+0000","last_fullsized":"2024-09-19T11:17:14.153222+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.153066+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.153066+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.153066+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:52.353655+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.14","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:07.379632+0000","last_change":"2024-09-19T11:17:07.379535+0000","last_active":"2024-09-19T11:17:07.379632+0000","last_peered":"2024-09-19T11:17:07.379632+0000","last_clean":"2024-09-19T11:17:07.379632+0000","last_became_active":"2024-09-19T11:13:31.372871+0000","last_became_peered":"2024-09-19T11:13:31.372871+0000","last_unstale":"2024-09-19T11:17:07.379632+0000","last_undegraded":"2024-09-19T11:17:07.379632+0000","last_fullsized":"2024-09-19T11:17:07.379632+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:07.379424+0000","last_clean_scrub_stamp":"2024-09-19T11:17:07.379424+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:09:42.734681+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.12","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.407965+0000","last_change":"2024-09-19T11:17:30.407910+0000","last_active":"2024-09-19T11:17:30.407965+0000","last_peered":"2024-09-19T11:17:30.407965+0000","last_clean":"2024-09-19T11:17:30.407965+0000","last_became_active":"2024-09-19T11:13:35.352703+0000","last_became_peered":"2024-09-19T11:13:35.352703+0000","last_unstale":"2024-09-19T11:17:30.407965+0000","last_undegraded":"2024-09-19T11:17:30.407965+0000","last_fullsized":"2024-09-19T11:17:30.407965+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:30.407786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:30.407786+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.407786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:36:57.738466+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.11","version":"37'41","reported_seq":98,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:56.189507+0000","last_change":"2024-09-19T11:17:56.189440+0000","last_active":"2024-09-19T11:17:56.189507+0000","last_peered":"2024-09-19T11:17:56.189507+0000","last_clean":"2024-09-19T11:17:56.189507+0000","last_became_active":"2024-09-19T11:13:37.369431+0000","last_became_peered":"2024-09-19T11:13:37.369431+0000","last_unstale":"2024-09-19T11:17:56.189507+0000","last_undegraded":"2024-09-19T11:17:56.189507+0000","last_fullsized":"2024-09-19T11:17:56.189507+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'41","last_scrub_stamp":"2024-09-19T11:17:56.189345+0000","last_deep_scrub":"37'41","last_deep_scrub_stamp":"2024-09-19T11:17:56.189345+0000","last_clean_scrub_stamp":"2024-09-19T11:17:56.189345+0000","objects_scrubbed":5,"log_size":41,"log_dups_size":0,"ondisk_log_size":41,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:29:57.579583+0000","scrub_duration":6,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.10","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:04.181158+0000","last_change":"2024-09-19T11:18:04.181079+0000","last_active":"2024-09-19T11:18:04.181158+0000","last_peered":"2024-09-19T11:18:04.181158+0000","last_clean":"2024-09-19T11:18:04.181158+0000","last_became_active":"2024-09-19T11:13:39.375530+0000","last_became_peered":"2024-09-19T11:13:39.375530+0000","last_unstale":"2024-09-19T11:18:04.181158+0000","last_undegraded":"2024-09-19T11:18:04.181158+0000","last_fullsized":"2024-09-19T11:18:04.181158+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:04.180980+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:04.180980+0000","last_clean_scrub_stamp":"2024-09-19T11:18:04.180980+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:51:10.648765+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.1e","version":"37'3","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:55.391638+0000","last_change":"2024-09-19T11:17:55.391638+0000","last_active":"2024-09-19T11:17:55.391638+0000","last_peered":"2024-09-19T11:17:55.391638+0000","last_clean":"2024-09-19T11:17:55.391638+0000","last_became_active":"2024-09-19T11:13:41.388444+0000","last_became_peered":"2024-09-19T11:13:41.388444+0000","last_unstale":"2024-09-19T11:17:55.391638+0000","last_undegraded":"2024-09-19T11:17:55.391638+0000","last_fullsized":"2024-09-19T11:17:55.391638+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:55.391543+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:55.391543+0000","last_clean_scrub_stamp":"2024-09-19T11:17:55.391543+0000","objects_scrubbed":0,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:13:37.719121+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.12","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.581182+0000","last_change":"2024-09-19T11:17:12.581118+0000","last_active":"2024-09-19T11:17:12.581182+0000","last_peered":"2024-09-19T11:17:12.581182+0000","last_clean":"2024-09-19T11:17:12.581182+0000","last_became_active":"2024-09-19T11:13:33.355186+0000","last_became_peered":"2024-09-19T11:13:33.355186+0000","last_unstale":"2024-09-19T11:17:12.581182+0000","last_undegraded":"2024-09-19T11:17:12.581182+0000","last_fullsized":"2024-09-19T11:17:12.581182+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:12.581034+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.581034+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:56:57.494890+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.15","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.268598+0000","last_change":"2024-09-19T11:16:58.268509+0000","last_active":"2024-09-19T11:16:58.268598+0000","last_peered":"2024-09-19T11:16:58.268598+0000","last_clean":"2024-09-19T11:16:58.268598+0000","last_became_active":"2024-09-19T11:13:31.370599+0000","last_became_peered":"2024-09-19T11:13:31.370599+0000","last_unstale":"2024-09-19T11:16:58.268598+0000","last_undegraded":"2024-09-19T11:16:58.268598+0000","last_fullsized":"2024-09-19T11:16:58.268598+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:58.268398+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.268398+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:26:22.542212+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.13","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:45.278030+0000","last_change":"2024-09-19T11:17:45.277952+0000","last_active":"2024-09-19T11:17:45.278030+0000","last_peered":"2024-09-19T11:17:45.278030+0000","last_clean":"2024-09-19T11:17:45.278030+0000","last_became_active":"2024-09-19T11:13:35.352906+0000","last_became_peered":"2024-09-19T11:13:35.352906+0000","last_unstale":"2024-09-19T11:17:45.278030+0000","last_undegraded":"2024-09-19T11:17:45.278030+0000","last_fullsized":"2024-09-19T11:17:45.278030+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:45.277802+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:45.277802+0000","last_clean_scrub_stamp":"2024-09-19T11:17:45.277802+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:12:50.986720+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.10","version":"37'9","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.538740+0000","last_change":"2024-09-19T11:17:31.538677+0000","last_active":"2024-09-19T11:17:31.538740+0000","last_peered":"2024-09-19T11:17:31.538740+0000","last_clean":"2024-09-19T11:17:31.538740+0000","last_became_active":"2024-09-19T11:13:37.361404+0000","last_became_peered":"2024-09-19T11:13:37.361404+0000","last_unstale":"2024-09-19T11:17:31.538740+0000","last_undegraded":"2024-09-19T11:17:31.538740+0000","last_fullsized":"2024-09-19T11:17:31.538740+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'9","last_scrub_stamp":"2024-09-19T11:17:31.538593+0000","last_deep_scrub":"37'9","last_deep_scrub_stamp":"2024-09-19T11:17:31.538593+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.538593+0000","objects_scrubbed":3,"log_size":9,"log_dups_size":0,"ondisk_log_size":9,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:55:28.785147+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":3,"num_object_clones":0,"num_object_copies":6,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":3,"num_whiteouts":0,"num_read":11,"num_read_kb":9,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":294,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.11","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:39.014239+0000","last_change":"2024-09-19T11:17:39.014183+0000","last_active":"2024-09-19T11:17:39.014239+0000","last_peered":"2024-09-19T11:17:39.014239+0000","last_clean":"2024-09-19T11:17:39.014239+0000","last_became_active":"2024-09-19T11:13:39.381618+0000","last_became_peered":"2024-09-19T11:13:39.381618+0000","last_unstale":"2024-09-19T11:17:39.014239+0000","last_undegraded":"2024-09-19T11:17:39.014239+0000","last_fullsized":"2024-09-19T11:17:39.014239+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:39.014095+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:39.014095+0000","last_clean_scrub_stamp":"2024-09-19T11:17:39.014095+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:15:38.689899+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.1d","version":"35'2","reported_seq":28,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:53.379329+0000","last_change":"2024-09-19T11:17:53.379329+0000","last_active":"2024-09-19T11:17:53.379329+0000","last_peered":"2024-09-19T11:17:53.379329+0000","last_clean":"2024-09-19T11:17:53.379329+0000","last_became_active":"2024-09-19T11:13:41.380632+0000","last_became_peered":"2024-09-19T11:13:41.380632+0000","last_unstale":"2024-09-19T11:17:53.379329+0000","last_undegraded":"2024-09-19T11:17:53.379329+0000","last_fullsized":"2024-09-19T11:17:53.379329+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:53.379237+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:53.379237+0000","last_clean_scrub_stamp":"2024-09-19T11:17:53.379237+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:23:07.425680+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.11","version":"37'28","reported_seq":96,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.725230+0000","last_change":"2024-09-19T11:17:10.725166+0000","last_active":"2024-09-19T11:17:10.725230+0000","last_peered":"2024-09-19T11:17:10.725230+0000","last_clean":"2024-09-19T11:17:10.725230+0000","last_became_active":"2024-09-19T11:13:33.349770+0000","last_became_peered":"2024-09-19T11:13:33.349770+0000","last_unstale":"2024-09-19T11:17:10.725230+0000","last_undegraded":"2024-09-19T11:17:10.725230+0000","last_fullsized":"2024-09-19T11:17:10.725230+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'28","last_scrub_stamp":"2024-09-19T11:17:10.725079+0000","last_deep_scrub":"37'28","last_deep_scrub_stamp":"2024-09-19T11:17:10.725079+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.725079+0000","objects_scrubbed":0,"log_size":28,"log_dups_size":0,"ondisk_log_size":28,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:19:43.826693+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":118,"num_read_kb":98,"num_write":38,"num_write_kb":16,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.16","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.156310+0000","last_change":"2024-09-19T11:17:01.156246+0000","last_active":"2024-09-19T11:17:01.156310+0000","last_peered":"2024-09-19T11:17:01.156310+0000","last_clean":"2024-09-19T11:17:01.156310+0000","last_became_active":"2024-09-19T11:13:31.355023+0000","last_became_peered":"2024-09-19T11:13:31.355023+0000","last_unstale":"2024-09-19T11:17:01.156310+0000","last_undegraded":"2024-09-19T11:17:01.156310+0000","last_fullsized":"2024-09-19T11:17:01.156310+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.156158+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.156158+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:03:03.371804+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,0,1],"acting":[2,3,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"5.10","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:22.188361+0000","last_change":"2024-09-19T11:17:22.188298+0000","last_active":"2024-09-19T11:17:22.188361+0000","last_peered":"2024-09-19T11:17:22.188361+0000","last_clean":"2024-09-19T11:17:22.188361+0000","last_became_active":"2024-09-19T11:13:35.356599+0000","last_became_peered":"2024-09-19T11:13:35.356599+0000","last_unstale":"2024-09-19T11:17:22.188361+0000","last_undegraded":"2024-09-19T11:17:22.188361+0000","last_fullsized":"2024-09-19T11:17:22.188361+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:22.188209+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:22.188209+0000","last_clean_scrub_stamp":"2024-09-19T11:17:22.188209+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:58:11.101131+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,1],"acting":[2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.13","version":"37'53","reported_seq":126,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.565879+0000","last_change":"2024-09-19T11:17:32.565820+0000","last_active":"2024-09-19T11:17:32.565879+0000","last_peered":"2024-09-19T11:17:32.565879+0000","last_clean":"2024-09-19T11:17:32.565879+0000","last_became_active":"2024-09-19T11:13:37.358246+0000","last_became_peered":"2024-09-19T11:13:37.358246+0000","last_unstale":"2024-09-19T11:17:32.565879+0000","last_undegraded":"2024-09-19T11:17:32.565879+0000","last_fullsized":"2024-09-19T11:17:32.565879+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'53","last_scrub_stamp":"2024-09-19T11:17:32.565716+0000","last_deep_scrub":"37'53","last_deep_scrub_stamp":"2024-09-19T11:17:32.565716+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.565716+0000","objects_scrubbed":6,"log_size":53,"log_dups_size":0,"ondisk_log_size":53,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:28:51.087241+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":6,"num_object_clones":0,"num_object_copies":12,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":6,"num_whiteouts":0,"num_read":68,"num_read_kb":71,"num_write":50,"num_write_kb":21,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":706,"num_omap_keys":2,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.12","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:43.468376+0000","last_change":"2024-09-19T11:17:43.468303+0000","last_active":"2024-09-19T11:17:43.468376+0000","last_peered":"2024-09-19T11:17:43.468376+0000","last_clean":"2024-09-19T11:17:43.468376+0000","last_became_active":"2024-09-19T11:13:39.368460+0000","last_became_peered":"2024-09-19T11:13:39.368460+0000","last_unstale":"2024-09-19T11:17:43.468376+0000","last_undegraded":"2024-09-19T11:17:43.468376+0000","last_fullsized":"2024-09-19T11:17:43.468376+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:43.468222+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:43.468222+0000","last_clean_scrub_stamp":"2024-09-19T11:17:43.468222+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:28:19.039248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.1c","version":"0'0","reported_seq":26,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:17.205695+0000","last_change":"2024-09-19T11:18:17.205695+0000","last_active":"2024-09-19T11:18:17.205695+0000","last_peered":"2024-09-19T11:18:17.205695+0000","last_clean":"2024-09-19T11:18:17.205695+0000","last_became_active":"2024-09-19T11:13:41.390297+0000","last_became_peered":"2024-09-19T11:13:41.390297+0000","last_unstale":"2024-09-19T11:18:17.205695+0000","last_undegraded":"2024-09-19T11:18:17.205695+0000","last_fullsized":"2024-09-19T11:18:17.205695+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:17.205603+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:17.205603+0000","last_clean_scrub_stamp":"2024-09-19T11:18:17.205603+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:48.149648+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.10","version":"37'12","reported_seq":71,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.363404+0000","last_change":"2024-09-19T11:17:25.363346+0000","last_active":"2024-09-19T11:17:25.363404+0000","last_peered":"2024-09-19T11:17:25.363404+0000","last_clean":"2024-09-19T11:17:25.363404+0000","last_became_active":"2024-09-19T11:13:33.358690+0000","last_became_peered":"2024-09-19T11:13:33.358690+0000","last_unstale":"2024-09-19T11:17:25.363404+0000","last_undegraded":"2024-09-19T11:17:25.363404+0000","last_fullsized":"2024-09-19T11:17:25.363404+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:25.363259+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:25.363259+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.363259+0000","objects_scrubbed":0,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:14:06.752248+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":55,"num_read_kb":47,"num_write":16,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.17","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:56.807976+0000","last_change":"2024-09-19T11:16:56.807882+0000","last_active":"2024-09-19T11:16:56.807976+0000","last_peered":"2024-09-19T11:16:56.807976+0000","last_clean":"2024-09-19T11:16:56.807976+0000","last_became_active":"2024-09-19T11:13:31.362293+0000","last_became_peered":"2024-09-19T11:13:31.362293+0000","last_unstale":"2024-09-19T11:16:56.807976+0000","last_undegraded":"2024-09-19T11:16:56.807976+0000","last_fullsized":"2024-09-19T11:16:56.807976+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:56.807762+0000","last_clean_scrub_stamp":"2024-09-19T11:16:56.807762+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:47:02.356623+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.11","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:44.230879+0000","last_change":"2024-09-19T11:17:44.230807+0000","last_active":"2024-09-19T11:17:44.230879+0000","last_peered":"2024-09-19T11:17:44.230879+0000","last_clean":"2024-09-19T11:17:44.230879+0000","last_became_active":"2024-09-19T11:13:35.356563+0000","last_became_peered":"2024-09-19T11:13:35.356563+0000","last_unstale":"2024-09-19T11:17:44.230879+0000","last_undegraded":"2024-09-19T11:17:44.230879+0000","last_fullsized":"2024-09-19T11:17:44.230879+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:44.230727+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:44.230727+0000","last_clean_scrub_stamp":"2024-09-19T11:17:44.230727+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:18:41.189606+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"6.12","version":"37'37","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.160471+0000","last_change":"2024-09-19T11:17:33.160418+0000","last_active":"2024-09-19T11:17:33.160471+0000","last_peered":"2024-09-19T11:17:33.160471+0000","last_clean":"2024-09-19T11:17:33.160471+0000","last_became_active":"2024-09-19T11:13:37.359796+0000","last_became_peered":"2024-09-19T11:13:37.359796+0000","last_unstale":"2024-09-19T11:17:33.160471+0000","last_undegraded":"2024-09-19T11:17:33.160471+0000","last_fullsized":"2024-09-19T11:17:33.160471+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:33.160294+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:33.160294+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.160294+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:51:02.908387+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"7.13","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:40.045456+0000","last_change":"2024-09-19T11:17:40.045394+0000","last_active":"2024-09-19T11:17:40.045456+0000","last_peered":"2024-09-19T11:17:40.045456+0000","last_clean":"2024-09-19T11:17:40.045456+0000","last_became_active":"2024-09-19T11:13:39.375208+0000","last_became_peered":"2024-09-19T11:13:39.375208+0000","last_unstale":"2024-09-19T11:17:40.045456+0000","last_undegraded":"2024-09-19T11:17:40.045456+0000","last_fullsized":"2024-09-19T11:17:40.045456+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:40.045302+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:40.045302+0000","last_clean_scrub_stamp":"2024-09-19T11:17:40.045302+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:18:49.341485+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.1f","version":"37'8","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.176645+0000","last_change":"2024-09-19T11:17:31.176586+0000","last_active":"2024-09-19T11:17:31.176645+0000","last_peered":"2024-09-19T11:17:31.176645+0000","last_clean":"2024-09-19T11:17:31.176645+0000","last_became_active":"2024-09-19T11:13:33.353748+0000","last_became_peered":"2024-09-19T11:13:33.353748+0000","last_unstale":"2024-09-19T11:17:31.176645+0000","last_undegraded":"2024-09-19T11:17:31.176645+0000","last_fullsized":"2024-09-19T11:17:31.176645+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:31.176498+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:31.176498+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.176498+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:11:33.234114+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.18","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:09.296300+0000","last_change":"2024-09-19T11:17:09.296208+0000","last_active":"2024-09-19T11:17:09.296300+0000","last_peered":"2024-09-19T11:17:09.296300+0000","last_clean":"2024-09-19T11:17:09.296300+0000","last_became_active":"2024-09-19T11:13:31.375774+0000","last_became_peered":"2024-09-19T11:13:31.375774+0000","last_unstale":"2024-09-19T11:17:09.296300+0000","last_undegraded":"2024-09-19T11:17:09.296300+0000","last_fullsized":"2024-09-19T11:17:09.296300+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:09.296106+0000","last_clean_scrub_stamp":"2024-09-19T11:17:09.296106+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:00:23.893467+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":653,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1e","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:28.586130+0000","last_change":"2024-09-19T11:17:28.586019+0000","last_active":"2024-09-19T11:17:28.586130+0000","last_peered":"2024-09-19T11:17:28.586130+0000","last_clean":"2024-09-19T11:17:28.586130+0000","last_became_active":"2024-09-19T11:13:35.356851+0000","last_became_peered":"2024-09-19T11:13:35.356851+0000","last_unstale":"2024-09-19T11:17:28.586130+0000","last_undegraded":"2024-09-19T11:17:28.586130+0000","last_fullsized":"2024-09-19T11:17:28.586130+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:28.585927+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:28.585927+0000","last_clean_scrub_stamp":"2024-09-19T11:17:28.585927+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:20:09.150774+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"6.1d","version":"37'68","reported_seq":141,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.522177+0000","last_change":"2024-09-19T11:17:33.522177+0000","last_active":"2024-09-19T11:17:33.522177+0000","last_peered":"2024-09-19T11:17:33.522177+0000","last_clean":"2024-09-19T11:17:33.522177+0000","last_became_active":"2024-09-19T11:13:37.363283+0000","last_became_peered":"2024-09-19T11:13:37.363283+0000","last_unstale":"2024-09-19T11:17:33.522177+0000","last_undegraded":"2024-09-19T11:17:33.522177+0000","last_fullsized":"2024-09-19T11:17:33.522177+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'68","last_scrub_stamp":"2024-09-19T11:17:33.522086+0000","last_deep_scrub":"37'68","last_deep_scrub_stamp":"2024-09-19T11:17:33.522086+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.522086+0000","objects_scrubbed":5,"log_size":68,"log_dups_size":0,"ondisk_log_size":68,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:46:44.769122+0000","scrub_duration":7,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":4206,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":67,"num_read_kb":76,"num_write":26,"num_write_kb":6,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1c","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.020270+0000","last_change":"2024-09-19T11:17:42.020270+0000","last_active":"2024-09-19T11:17:42.020270+0000","last_peered":"2024-09-19T11:17:42.020270+0000","last_clean":"2024-09-19T11:17:42.020270+0000","last_became_active":"2024-09-19T11:13:39.375148+0000","last_became_peered":"2024-09-19T11:13:39.375148+0000","last_unstale":"2024-09-19T11:17:42.020270+0000","last_undegraded":"2024-09-19T11:17:42.020270+0000","last_fullsized":"2024-09-19T11:17:42.020270+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.020162+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.020162+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.020162+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:12:17.802952+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.13","version":"37'14","reported_seq":43,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:54.416348+0000","last_change":"2024-09-19T11:17:54.416247+0000","last_active":"2024-09-19T11:17:54.416348+0000","last_peered":"2024-09-19T11:17:54.416348+0000","last_clean":"2024-09-19T11:17:54.416348+0000","last_became_active":"2024-09-19T11:13:41.387205+0000","last_became_peered":"2024-09-19T11:13:41.387205+0000","last_unstale":"2024-09-19T11:17:54.416348+0000","last_undegraded":"2024-09-19T11:17:54.416348+0000","last_fullsized":"2024-09-19T11:17:54.416348+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:54.416156+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:54.416156+0000","last_clean_scrub_stamp":"2024-09-19T11:17:54.416156+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:21:20.882489+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":8,"num_read_kb":8,"num_write":16,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.1e","version":"37'8","reported_seq":67,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.721545+0000","last_change":"2024-09-19T11:17:13.721487+0000","last_active":"2024-09-19T11:17:13.721545+0000","last_peered":"2024-09-19T11:17:13.721545+0000","last_clean":"2024-09-19T11:17:13.721545+0000","last_became_active":"2024-09-19T11:13:33.342040+0000","last_became_peered":"2024-09-19T11:13:33.342040+0000","last_unstale":"2024-09-19T11:17:13.721545+0000","last_undegraded":"2024-09-19T11:17:13.721545+0000","last_fullsized":"2024-09-19T11:17:13.721545+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:13.721403+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:13.721403+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.721403+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:13:48.967350+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":26,"num_read_kb":26,"num_write":8,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.19","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:57.839055+0000","last_change":"2024-09-19T11:16:57.838965+0000","last_active":"2024-09-19T11:16:57.839055+0000","last_peered":"2024-09-19T11:16:57.839055+0000","last_clean":"2024-09-19T11:16:57.839055+0000","last_became_active":"2024-09-19T11:13:31.360250+0000","last_became_peered":"2024-09-19T11:13:31.360250+0000","last_unstale":"2024-09-19T11:16:57.839055+0000","last_undegraded":"2024-09-19T11:16:57.839055+0000","last_fullsized":"2024-09-19T11:16:57.839055+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:16:57.838852+0000","last_clean_scrub_stamp":"2024-09-19T11:16:57.838852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:41:23.656467+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,0,2],"acting":[1,3,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1f","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:27.187957+0000","last_change":"2024-09-19T11:17:27.187901+0000","last_active":"2024-09-19T11:17:27.187957+0000","last_peered":"2024-09-19T11:17:27.187957+0000","last_clean":"2024-09-19T11:17:27.187957+0000","last_became_active":"2024-09-19T11:13:35.350269+0000","last_became_peered":"2024-09-19T11:13:35.350269+0000","last_unstale":"2024-09-19T11:17:27.187957+0000","last_undegraded":"2024-09-19T11:17:27.187957+0000","last_fullsized":"2024-09-19T11:17:27.187957+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:27.187800+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:27.187800+0000","last_clean_scrub_stamp":"2024-09-19T11:17:27.187800+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:34:39.803035+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1c","version":"37'46","reported_seq":104,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:59.155201+0000","last_change":"2024-09-19T11:17:59.155201+0000","last_active":"2024-09-19T11:17:59.155201+0000","last_peered":"2024-09-19T11:17:59.155201+0000","last_clean":"2024-09-19T11:17:59.155201+0000","last_became_active":"2024-09-19T11:13:37.368083+0000","last_became_peered":"2024-09-19T11:13:37.368083+0000","last_unstale":"2024-09-19T11:17:59.155201+0000","last_undegraded":"2024-09-19T11:17:59.155201+0000","last_fullsized":"2024-09-19T11:17:59.155201+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:59.155111+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:59.155111+0000","last_clean_scrub_stamp":"2024-09-19T11:17:59.155111+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:29:15.412903+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1d","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.538807+0000","last_change":"2024-09-19T11:17:46.538807+0000","last_active":"2024-09-19T11:17:46.538807+0000","last_peered":"2024-09-19T11:17:46.538807+0000","last_clean":"2024-09-19T11:17:46.538807+0000","last_became_active":"2024-09-19T11:13:39.376613+0000","last_became_peered":"2024-09-19T11:13:39.376613+0000","last_unstale":"2024-09-19T11:17:46.538807+0000","last_undegraded":"2024-09-19T11:17:46.538807+0000","last_fullsized":"2024-09-19T11:17:46.538807+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.538721+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.538721+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.538721+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:25:25.235263+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"8.12","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:12.131620+0000","last_change":"2024-09-19T11:18:12.131559+0000","last_active":"2024-09-19T11:18:12.131620+0000","last_peered":"2024-09-19T11:18:12.131620+0000","last_clean":"2024-09-19T11:18:12.131620+0000","last_became_active":"2024-09-19T11:13:41.394311+0000","last_became_peered":"2024-09-19T11:13:41.394311+0000","last_unstale":"2024-09-19T11:18:12.131620+0000","last_undegraded":"2024-09-19T11:18:12.131620+0000","last_fullsized":"2024-09-19T11:18:12.131620+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:12.131462+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:12.131462+0000","last_clean_scrub_stamp":"2024-09-19T11:18:12.131462+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:53:18.445886+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1d","version":"37'2","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:30.175707+0000","last_change":"2024-09-19T11:17:30.175615+0000","last_active":"2024-09-19T11:17:30.175707+0000","last_peered":"2024-09-19T11:17:30.175707+0000","last_clean":"2024-09-19T11:17:30.175707+0000","last_became_active":"2024-09-19T11:13:33.360678+0000","last_became_peered":"2024-09-19T11:13:33.360678+0000","last_unstale":"2024-09-19T11:17:30.175707+0000","last_undegraded":"2024-09-19T11:17:30.175707+0000","last_fullsized":"2024-09-19T11:17:30.175707+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:30.175521+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:30.175521+0000","last_clean_scrub_stamp":"2024-09-19T11:17:30.175521+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:25:13.579750+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":6,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1a","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.764541+0000","last_change":"2024-09-19T11:17:00.764477+0000","last_active":"2024-09-19T11:17:00.764541+0000","last_peered":"2024-09-19T11:17:00.764541+0000","last_clean":"2024-09-19T11:17:00.764541+0000","last_became_active":"2024-09-19T11:13:31.369152+0000","last_became_peered":"2024-09-19T11:13:31.369152+0000","last_unstale":"2024-09-19T11:17:00.764541+0000","last_undegraded":"2024-09-19T11:17:00.764541+0000","last_fullsized":"2024-09-19T11:17:00.764541+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:00.764391+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.764391+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:27:38.964980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":3,"num_write":12,"num_write_kb":4093,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0,3,2],"acting":[1,0,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1c","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.195577+0000","last_change":"2024-09-19T11:17:26.195577+0000","last_active":"2024-09-19T11:17:26.195577+0000","last_peered":"2024-09-19T11:17:26.195577+0000","last_clean":"2024-09-19T11:17:26.195577+0000","last_became_active":"2024-09-19T11:13:35.350973+0000","last_became_peered":"2024-09-19T11:13:35.350973+0000","last_unstale":"2024-09-19T11:17:26.195577+0000","last_undegraded":"2024-09-19T11:17:26.195577+0000","last_fullsized":"2024-09-19T11:17:26.195577+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:26.195490+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:26.195490+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.195490+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:29:53.553614+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.1f","version":"37'40","reported_seq":97,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.462354+0000","last_change":"2024-09-19T11:17:35.462297+0000","last_active":"2024-09-19T11:17:35.462354+0000","last_peered":"2024-09-19T11:17:35.462354+0000","last_clean":"2024-09-19T11:17:35.462354+0000","last_became_active":"2024-09-19T11:13:37.358068+0000","last_became_peered":"2024-09-19T11:13:37.358068+0000","last_unstale":"2024-09-19T11:17:35.462354+0000","last_undegraded":"2024-09-19T11:17:35.462354+0000","last_fullsized":"2024-09-19T11:17:35.462354+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'40","last_scrub_stamp":"2024-09-19T11:17:35.462227+0000","last_deep_scrub":"37'40","last_deep_scrub_stamp":"2024-09-19T11:17:35.462227+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.462227+0000","objects_scrubbed":5,"log_size":40,"log_dups_size":0,"ondisk_log_size":40,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:35:37.754391+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":38,"num_read_kb":31,"num_write":16,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.1e","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:46.381425+0000","last_change":"2024-09-19T11:17:46.381425+0000","last_active":"2024-09-19T11:17:46.381425+0000","last_peered":"2024-09-19T11:17:46.381425+0000","last_clean":"2024-09-19T11:17:46.381425+0000","last_became_active":"2024-09-19T11:13:39.380068+0000","last_became_peered":"2024-09-19T11:13:39.380068+0000","last_unstale":"2024-09-19T11:17:46.381425+0000","last_undegraded":"2024-09-19T11:17:46.381425+0000","last_fullsized":"2024-09-19T11:17:46.381425+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:46.381325+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:46.381325+0000","last_clean_scrub_stamp":"2024-09-19T11:17:46.381325+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:25:01.358340+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.11","version":"37'7","reported_seq":36,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:15.140812+0000","last_change":"2024-09-19T11:18:15.140749+0000","last_active":"2024-09-19T11:18:15.140812+0000","last_peered":"2024-09-19T11:18:15.140812+0000","last_clean":"2024-09-19T11:18:15.140812+0000","last_became_active":"2024-09-19T11:13:41.391444+0000","last_became_peered":"2024-09-19T11:13:41.391444+0000","last_unstale":"2024-09-19T11:18:15.140812+0000","last_undegraded":"2024-09-19T11:18:15.140812+0000","last_fullsized":"2024-09-19T11:18:15.140812+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'7","last_scrub_stamp":"2024-09-19T11:18:15.140656+0000","last_deep_scrub":"37'7","last_deep_scrub_stamp":"2024-09-19T11:18:15.140656+0000","last_clean_scrub_stamp":"2024-09-19T11:18:15.140656+0000","objects_scrubbed":0,"log_size":7,"log_dups_size":0,"ondisk_log_size":7,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:40:28.094140+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":16,"num_read_kb":14,"num_write":17,"num_write_kb":4,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1c","version":"37'4","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.746563+0000","last_change":"2024-09-19T11:17:12.746563+0000","last_active":"2024-09-19T11:17:12.746563+0000","last_peered":"2024-09-19T11:17:12.746563+0000","last_clean":"2024-09-19T11:17:12.746563+0000","last_became_active":"2024-09-19T11:13:33.352201+0000","last_became_peered":"2024-09-19T11:13:33.352201+0000","last_unstale":"2024-09-19T11:17:12.746563+0000","last_undegraded":"2024-09-19T11:17:12.746563+0000","last_fullsized":"2024-09-19T11:17:12.746563+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:12.746480+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:12.746480+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.746480+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:04:26.217232+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.1b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:10.268223+0000","last_change":"2024-09-19T11:17:10.268148+0000","last_active":"2024-09-19T11:17:10.268223+0000","last_peered":"2024-09-19T11:17:10.268223+0000","last_clean":"2024-09-19T11:17:10.268223+0000","last_became_active":"2024-09-19T11:13:31.376847+0000","last_became_peered":"2024-09-19T11:13:31.376847+0000","last_unstale":"2024-09-19T11:17:10.268223+0000","last_undegraded":"2024-09-19T11:17:10.268223+0000","last_fullsized":"2024-09-19T11:17:10.268223+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:10.268062+0000","last_clean_scrub_stamp":"2024-09-19T11:17:10.268062+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:36:30.958036+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,2,0],"acting":[3,1,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1d","version":"0'0","reported_seq":44,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.398503+0000","last_change":"2024-09-19T11:17:33.398503+0000","last_active":"2024-09-19T11:17:33.398503+0000","last_peered":"2024-09-19T11:17:33.398503+0000","last_clean":"2024-09-19T11:17:33.398503+0000","last_became_active":"2024-09-19T11:14:07.597570+0000","last_became_peered":"2024-09-19T11:14:07.597570+0000","last_unstale":"2024-09-19T11:17:33.398503+0000","last_undegraded":"2024-09-19T11:17:33.398503+0000","last_fullsized":"2024-09-19T11:17:33.398503+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:33.398408+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:33.398408+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.398408+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:39:14.649067+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1e","version":"37'15","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:00.112617+0000","last_change":"2024-09-19T11:18:00.112617+0000","last_active":"2024-09-19T11:18:00.112617+0000","last_peered":"2024-09-19T11:18:00.112617+0000","last_clean":"2024-09-19T11:18:00.112617+0000","last_became_active":"2024-09-19T11:13:37.370864+0000","last_became_peered":"2024-09-19T11:13:37.370864+0000","last_unstale":"2024-09-19T11:18:00.112617+0000","last_undegraded":"2024-09-19T11:18:00.112617+0000","last_fullsized":"2024-09-19T11:18:00.112617+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'15","last_scrub_stamp":"2024-09-19T11:18:00.112520+0000","last_deep_scrub":"37'15","last_deep_scrub_stamp":"2024-09-19T11:18:00.112520+0000","last_clean_scrub_stamp":"2024-09-19T11:18:00.112520+0000","objects_scrubbed":5,"log_size":15,"log_dups_size":0,"ondisk_log_size":15,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:11:46.993426+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":15,"num_read_kb":10,"num_write":10,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1f","version":"37'286","reported_seq":380,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:41.066585+0000","last_change":"2024-09-19T11:17:41.066531+0000","last_active":"2024-09-19T11:17:41.066585+0000","last_peered":"2024-09-19T11:17:41.066585+0000","last_clean":"2024-09-19T11:17:41.066585+0000","last_became_active":"2024-09-19T11:13:39.381711+0000","last_became_peered":"2024-09-19T11:13:39.381711+0000","last_unstale":"2024-09-19T11:17:41.066585+0000","last_undegraded":"2024-09-19T11:17:41.066585+0000","last_fullsized":"2024-09-19T11:17:41.066585+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'286","last_scrub_stamp":"2024-09-19T11:17:41.066452+0000","last_deep_scrub":"37'286","last_deep_scrub_stamp":"2024-09-19T11:17:41.066452+0000","last_clean_scrub_stamp":"2024-09-19T11:17:41.066452+0000","objects_scrubbed":1,"log_size":286,"log_dups_size":0,"ondisk_log_size":286,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:20.943729+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"8.10","version":"0'0","reported_seq":27,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:10.095547+0000","last_change":"2024-09-19T11:18:10.095480+0000","last_active":"2024-09-19T11:18:10.095547+0000","last_peered":"2024-09-19T11:18:10.095547+0000","last_clean":"2024-09-19T11:18:10.095547+0000","last_became_active":"2024-09-19T11:13:41.389952+0000","last_became_peered":"2024-09-19T11:13:41.389952+0000","last_unstale":"2024-09-19T11:18:10.095547+0000","last_undegraded":"2024-09-19T11:18:10.095547+0000","last_fullsized":"2024-09-19T11:18:10.095547+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:10.095365+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:10.095365+0000","last_clean_scrub_stamp":"2024-09-19T11:18:10.095365+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:14:51.738454+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.1b","version":"37'4","reported_seq":50,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.171960+0000","last_change":"2024-09-19T11:17:17.171870+0000","last_active":"2024-09-19T11:17:17.171960+0000","last_peered":"2024-09-19T11:17:17.171960+0000","last_clean":"2024-09-19T11:17:17.171960+0000","last_became_active":"2024-09-19T11:13:33.345697+0000","last_became_peered":"2024-09-19T11:13:33.345697+0000","last_unstale":"2024-09-19T11:17:17.171960+0000","last_undegraded":"2024-09-19T11:17:17.171960+0000","last_fullsized":"2024-09-19T11:17:17.171960+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:17.171787+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:17.171787+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.171787+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:15:10.154837+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.807664+0000","last_change":"2024-09-19T11:16:59.807595+0000","last_active":"2024-09-19T11:16:59.807664+0000","last_peered":"2024-09-19T11:16:59.807664+0000","last_clean":"2024-09-19T11:16:59.807664+0000","last_became_active":"2024-09-19T11:13:31.363188+0000","last_became_peered":"2024-09-19T11:13:31.363188+0000","last_unstale":"2024-09-19T11:16:59.807664+0000","last_undegraded":"2024-09-19T11:16:59.807664+0000","last_fullsized":"2024-09-19T11:16:59.807664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.807508+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.807508+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:54:27.508908+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.1a","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.437875+0000","last_change":"2024-09-19T11:17:34.437875+0000","last_active":"2024-09-19T11:17:34.437875+0000","last_peered":"2024-09-19T11:17:34.437875+0000","last_clean":"2024-09-19T11:17:34.437875+0000","last_became_active":"2024-09-19T11:13:35.355167+0000","last_became_peered":"2024-09-19T11:13:35.355167+0000","last_unstale":"2024-09-19T11:17:34.437875+0000","last_undegraded":"2024-09-19T11:17:34.437875+0000","last_fullsized":"2024-09-19T11:17:34.437875+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:34.437786+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:34.437786+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.437786+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:17:35.544859+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.19","version":"37'46","reported_seq":105,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.478173+0000","last_change":"2024-09-19T11:17:42.478113+0000","last_active":"2024-09-19T11:17:42.478173+0000","last_peered":"2024-09-19T11:17:42.478173+0000","last_clean":"2024-09-19T11:17:42.478173+0000","last_became_active":"2024-09-19T11:13:37.365276+0000","last_became_peered":"2024-09-19T11:13:37.365276+0000","last_unstale":"2024-09-19T11:17:42.478173+0000","last_undegraded":"2024-09-19T11:17:42.478173+0000","last_fullsized":"2024-09-19T11:17:42.478173+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'46","last_scrub_stamp":"2024-09-19T11:17:42.478011+0000","last_deep_scrub":"37'46","last_deep_scrub_stamp":"2024-09-19T11:17:42.478011+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.478011+0000","objects_scrubbed":7,"log_size":46,"log_dups_size":0,"ondisk_log_size":46,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:26:42.594047+0000","scrub_duration":5,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":44,"num_read_kb":35,"num_write":20,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"7.18","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:42.425002+0000","last_change":"2024-09-19T11:17:42.424937+0000","last_active":"2024-09-19T11:17:42.425002+0000","last_peered":"2024-09-19T11:17:42.425002+0000","last_clean":"2024-09-19T11:17:42.425002+0000","last_became_active":"2024-09-19T11:13:39.380755+0000","last_became_peered":"2024-09-19T11:13:39.380755+0000","last_unstale":"2024-09-19T11:17:42.425002+0000","last_undegraded":"2024-09-19T11:17:42.425002+0000","last_fullsized":"2024-09-19T11:17:42.425002+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:42.424842+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:42.424842+0000","last_clean_scrub_stamp":"2024-09-19T11:17:42.424842+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:48:20.215639+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.17","version":"37'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:51.510009+0000","last_change":"2024-09-19T11:17:51.509936+0000","last_active":"2024-09-19T11:17:51.510009+0000","last_peered":"2024-09-19T11:17:51.510009+0000","last_clean":"2024-09-19T11:17:51.510009+0000","last_became_active":"2024-09-19T11:13:41.388571+0000","last_became_peered":"2024-09-19T11:13:41.388571+0000","last_unstale":"2024-09-19T11:17:51.510009+0000","last_undegraded":"2024-09-19T11:17:51.510009+0000","last_fullsized":"2024-09-19T11:17:51.510009+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:51.509852+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:51.509852+0000","last_clean_scrub_stamp":"2024-09-19T11:17:51.509852+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:14:49.516841+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":5,"num_write":5,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.1a","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.122017+0000","last_change":"2024-09-19T11:17:16.121964+0000","last_active":"2024-09-19T11:17:16.122017+0000","last_peered":"2024-09-19T11:17:16.122017+0000","last_clean":"2024-09-19T11:17:16.122017+0000","last_became_active":"2024-09-19T11:13:33.346799+0000","last_became_peered":"2024-09-19T11:13:33.346799+0000","last_unstale":"2024-09-19T11:17:16.122017+0000","last_undegraded":"2024-09-19T11:17:16.122017+0000","last_fullsized":"2024-09-19T11:17:16.122017+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:16.121888+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:16.121888+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.121888+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:32:08.494191+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:11.243856+0000","last_change":"2024-09-19T11:17:11.243754+0000","last_active":"2024-09-19T11:17:11.243856+0000","last_peered":"2024-09-19T11:17:11.243856+0000","last_clean":"2024-09-19T11:17:11.243856+0000","last_became_active":"2024-09-19T11:13:31.371543+0000","last_became_peered":"2024-09-19T11:13:31.371543+0000","last_unstale":"2024-09-19T11:17:11.243856+0000","last_undegraded":"2024-09-19T11:17:11.243856+0000","last_fullsized":"2024-09-19T11:17:11.243856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:11.243640+0000","last_clean_scrub_stamp":"2024-09-19T11:17:11.243640+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:26:12.224247+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"5.1b","version":"0'0","reported_seq":38,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:25.146894+0000","last_change":"2024-09-19T11:17:25.146894+0000","last_active":"2024-09-19T11:17:25.146894+0000","last_peered":"2024-09-19T11:17:25.146894+0000","last_clean":"2024-09-19T11:17:25.146894+0000","last_became_active":"2024-09-19T11:13:35.357070+0000","last_became_peered":"2024-09-19T11:13:35.357070+0000","last_unstale":"2024-09-19T11:17:25.146894+0000","last_undegraded":"2024-09-19T11:17:25.146894+0000","last_fullsized":"2024-09-19T11:17:25.146894+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:25.146791+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:25.146791+0000","last_clean_scrub_stamp":"2024-09-19T11:17:25.146791+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:14.070250+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3],"acting":[2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"6.18","version":"37'37","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.486598+0000","last_change":"2024-09-19T11:17:34.486467+0000","last_active":"2024-09-19T11:17:34.486598+0000","last_peered":"2024-09-19T11:17:34.486598+0000","last_clean":"2024-09-19T11:17:34.486598+0000","last_became_active":"2024-09-19T11:13:37.365452+0000","last_became_peered":"2024-09-19T11:13:37.365452+0000","last_unstale":"2024-09-19T11:17:34.486598+0000","last_undegraded":"2024-09-19T11:17:34.486598+0000","last_fullsized":"2024-09-19T11:17:34.486598+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'37","last_scrub_stamp":"2024-09-19T11:17:34.486360+0000","last_deep_scrub":"37'37","last_deep_scrub_stamp":"2024-09-19T11:17:34.486360+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.486360+0000","objects_scrubbed":4,"log_size":37,"log_dups_size":0,"ondisk_log_size":37,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:44:46.730904+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":4,"num_object_clones":0,"num_object_copies":8,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":4,"num_whiteouts":0,"num_read":35,"num_read_kb":29,"num_write":14,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"7.19","version":"0'0","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:06.120132+0000","last_change":"2024-09-19T11:18:06.120054+0000","last_active":"2024-09-19T11:18:06.120132+0000","last_peered":"2024-09-19T11:18:06.120132+0000","last_clean":"2024-09-19T11:18:06.120132+0000","last_became_active":"2024-09-19T11:13:39.375624+0000","last_became_peered":"2024-09-19T11:13:39.375624+0000","last_unstale":"2024-09-19T11:18:06.120132+0000","last_undegraded":"2024-09-19T11:18:06.120132+0000","last_fullsized":"2024-09-19T11:18:06.120132+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:06.119932+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:06.119932+0000","last_clean_scrub_stamp":"2024-09-19T11:18:06.119932+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:03:21.942363+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.16","version":"35'2","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:16.191281+0000","last_change":"2024-09-19T11:18:16.191175+0000","last_active":"2024-09-19T11:18:16.191281+0000","last_peered":"2024-09-19T11:18:16.191281+0000","last_clean":"2024-09-19T11:18:16.191281+0000","last_became_active":"2024-09-19T11:13:41.393855+0000","last_became_peered":"2024-09-19T11:13:41.393855+0000","last_unstale":"2024-09-19T11:18:16.191281+0000","last_undegraded":"2024-09-19T11:18:16.191281+0000","last_fullsized":"2024-09-19T11:18:16.191281+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:18:16.191067+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:18:16.191067+0000","last_clean_scrub_stamp":"2024-09-19T11:18:16.191067+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:10:20.025054+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":6,"num_read_kb":4,"num_write":6,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.19","version":"37'6","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.164804+0000","last_change":"2024-09-19T11:17:32.164729+0000","last_active":"2024-09-19T11:17:32.164804+0000","last_peered":"2024-09-19T11:17:32.164804+0000","last_clean":"2024-09-19T11:17:32.164804+0000","last_became_active":"2024-09-19T11:13:33.348933+0000","last_became_peered":"2024-09-19T11:13:33.348933+0000","last_unstale":"2024-09-19T11:17:32.164804+0000","last_undegraded":"2024-09-19T11:17:32.164804+0000","last_fullsized":"2024-09-19T11:17:32.164804+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:32.164637+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:32.164637+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.164637+0000","objects_scrubbed":2,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:43:28.206282+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.1e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.736085+0000","last_change":"2024-09-19T11:16:58.736025+0000","last_active":"2024-09-19T11:16:58.736085+0000","last_peered":"2024-09-19T11:16:58.736085+0000","last_clean":"2024-09-19T11:16:58.736085+0000","last_became_active":"2024-09-19T11:13:31.364071+0000","last_became_peered":"2024-09-19T11:13:31.364071+0000","last_unstale":"2024-09-19T11:16:58.736085+0000","last_undegraded":"2024-09-19T11:16:58.736085+0000","last_fullsized":"2024-09-19T11:16:58.736085+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:58.735931+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.735931+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:27:08.584806+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"5.18","version":"0'0","reported_seq":39,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:31.438024+0000","last_change":"2024-09-19T11:17:31.437955+0000","last_active":"2024-09-19T11:17:31.438024+0000","last_peered":"2024-09-19T11:17:31.438024+0000","last_clean":"2024-09-19T11:17:31.438024+0000","last_became_active":"2024-09-19T11:13:35.358682+0000","last_became_peered":"2024-09-19T11:13:35.358682+0000","last_unstale":"2024-09-19T11:17:31.438024+0000","last_undegraded":"2024-09-19T11:17:31.438024+0000","last_fullsized":"2024-09-19T11:17:31.438024+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:31.437866+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:31.437866+0000","last_clean_scrub_stamp":"2024-09-19T11:17:31.437866+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:47:28.484126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1b","version":"37'31","reported_seq":84,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:58.179630+0000","last_change":"2024-09-19T11:17:58.179630+0000","last_active":"2024-09-19T11:17:58.179630+0000","last_peered":"2024-09-19T11:17:58.179630+0000","last_clean":"2024-09-19T11:17:58.179630+0000","last_became_active":"2024-09-19T11:13:37.368209+0000","last_became_peered":"2024-09-19T11:13:37.368209+0000","last_unstale":"2024-09-19T11:17:58.179630+0000","last_undegraded":"2024-09-19T11:17:58.179630+0000","last_fullsized":"2024-09-19T11:17:58.179630+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'31","last_scrub_stamp":"2024-09-19T11:17:58.179544+0000","last_deep_scrub":"37'31","last_deep_scrub_stamp":"2024-09-19T11:17:58.179544+0000","last_clean_scrub_stamp":"2024-09-19T11:17:58.179544+0000","objects_scrubbed":2,"log_size":31,"log_dups_size":0,"ondisk_log_size":31,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:38:12.714793+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":29,"num_read_kb":25,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1a","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:07.073190+0000","last_change":"2024-09-19T11:18:07.073190+0000","last_active":"2024-09-19T11:18:07.073190+0000","last_peered":"2024-09-19T11:18:07.073190+0000","last_clean":"2024-09-19T11:18:07.073190+0000","last_became_active":"2024-09-19T11:13:39.375223+0000","last_became_peered":"2024-09-19T11:13:39.375223+0000","last_unstale":"2024-09-19T11:18:07.073190+0000","last_undegraded":"2024-09-19T11:18:07.073190+0000","last_fullsized":"2024-09-19T11:18:07.073190+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:18:07.073100+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:18:07.073100+0000","last_clean_scrub_stamp":"2024-09-19T11:18:07.073100+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T18:08:13.111081+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"8.15","version":"37'4","reported_seq":31,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:14.117672+0000","last_change":"2024-09-19T11:18:14.117609+0000","last_active":"2024-09-19T11:18:14.117672+0000","last_peered":"2024-09-19T11:18:14.117672+0000","last_clean":"2024-09-19T11:18:14.117672+0000","last_became_active":"2024-09-19T11:13:41.393019+0000","last_became_peered":"2024-09-19T11:13:41.393019+0000","last_unstale":"2024-09-19T11:18:14.117672+0000","last_undegraded":"2024-09-19T11:18:14.117672+0000","last_fullsized":"2024-09-19T11:18:14.117672+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:18:14.117493+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:18:14.117493+0000","last_clean_scrub_stamp":"2024-09-19T11:18:14.117493+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:38:53.993277+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":2,"num_read_kb":2,"num_write":6,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.18","version":"37'22","reported_seq":93,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.128171+0000","last_change":"2024-09-19T11:17:15.128091+0000","last_active":"2024-09-19T11:17:15.128171+0000","last_peered":"2024-09-19T11:17:15.128171+0000","last_clean":"2024-09-19T11:17:15.128171+0000","last_became_active":"2024-09-19T11:13:33.341999+0000","last_became_peered":"2024-09-19T11:13:33.341999+0000","last_unstale":"2024-09-19T11:17:15.128171+0000","last_undegraded":"2024-09-19T11:17:15.128171+0000","last_fullsized":"2024-09-19T11:17:15.128171+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'22","last_scrub_stamp":"2024-09-19T11:17:15.128006+0000","last_deep_scrub":"37'22","last_deep_scrub_stamp":"2024-09-19T11:17:15.128006+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.128006+0000","objects_scrubbed":0,"log_size":22,"log_dups_size":0,"ondisk_log_size":22,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:38.994206+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":91,"num_read_kb":79,"num_write":28,"num_write_kb":9,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0],"acting":[2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"3.1f","version":"37'4","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:58.841225+0000","last_change":"2024-09-19T11:16:58.841145+0000","last_active":"2024-09-19T11:16:58.841225+0000","last_peered":"2024-09-19T11:16:58.841225+0000","last_clean":"2024-09-19T11:16:58.841225+0000","last_became_active":"2024-09-19T11:13:31.364360+0000","last_became_peered":"2024-09-19T11:13:31.364360+0000","last_unstale":"2024-09-19T11:16:58.841225+0000","last_undegraded":"2024-09-19T11:16:58.841225+0000","last_fullsized":"2024-09-19T11:16:58.841225+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:16:58.841052+0000","last_clean_scrub_stamp":"2024-09-19T11:16:58.841052+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:39:37.793058+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":5,"num_write":20,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"5.19","version":"37'3","reported_seq":42,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:32.410178+0000","last_change":"2024-09-19T11:17:32.410120+0000","last_active":"2024-09-19T11:17:32.410178+0000","last_peered":"2024-09-19T11:17:32.410178+0000","last_clean":"2024-09-19T11:17:32.410178+0000","last_became_active":"2024-09-19T11:13:35.357375+0000","last_became_peered":"2024-09-19T11:13:35.357375+0000","last_unstale":"2024-09-19T11:17:32.410178+0000","last_undegraded":"2024-09-19T11:17:32.410178+0000","last_fullsized":"2024-09-19T11:17:32.410178+0000","mapping_epoch":27,"log_start":"0'0","ondisk_log_start":"0'0","created":27,"last_epoch_clean":28,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'3","last_scrub_stamp":"2024-09-19T11:17:32.410031+0000","last_deep_scrub":"37'3","last_deep_scrub_stamp":"2024-09-19T11:17:32.410031+0000","last_clean_scrub_stamp":"2024-09-19T11:17:32.410031+0000","objects_scrubbed":1,"log_size":3,"log_dups_size":0,"ondisk_log_size":3,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:06:05.652748+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":46,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":1,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"6.1a","version":"37'42","reported_seq":99,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:57.138575+0000","last_change":"2024-09-19T11:17:57.138575+0000","last_active":"2024-09-19T11:17:57.138575+0000","last_peered":"2024-09-19T11:17:57.138575+0000","last_clean":"2024-09-19T11:17:57.138575+0000","last_became_active":"2024-09-19T11:13:37.371177+0000","last_became_peered":"2024-09-19T11:13:37.371177+0000","last_unstale":"2024-09-19T11:17:57.138575+0000","last_undegraded":"2024-09-19T11:17:57.138575+0000","last_fullsized":"2024-09-19T11:17:57.138575+0000","mapping_epoch":29,"log_start":"0'0","ondisk_log_start":"0'0","created":29,"last_epoch_clean":30,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'42","last_scrub_stamp":"2024-09-19T11:17:57.138463+0000","last_deep_scrub":"37'42","last_deep_scrub_stamp":"2024-09-19T11:17:57.138463+0000","last_clean_scrub_stamp":"2024-09-19T11:17:57.138463+0000","objects_scrubbed":5,"log_size":42,"log_dups_size":0,"ondisk_log_size":42,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:30:55.487581+0000","scrub_duration":3,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":110,"num_objects":5,"num_object_clones":0,"num_object_copies":10,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":5,"num_whiteouts":0,"num_read":40,"num_read_kb":36,"num_write":20,"num_write_kb":7,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":1270,"num_omap_keys":6,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"7.1b","version":"0'0","reported_seq":30,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:47.399439+0000","last_change":"2024-09-19T11:17:47.399439+0000","last_active":"2024-09-19T11:17:47.399439+0000","last_peered":"2024-09-19T11:17:47.399439+0000","last_clean":"2024-09-19T11:17:47.399439+0000","last_became_active":"2024-09-19T11:13:39.380930+0000","last_became_peered":"2024-09-19T11:13:39.380930+0000","last_unstale":"2024-09-19T11:17:47.399439+0000","last_undegraded":"2024-09-19T11:17:47.399439+0000","last_fullsized":"2024-09-19T11:17:47.399439+0000","mapping_epoch":31,"log_start":"0'0","ondisk_log_start":"0'0","created":31,"last_epoch_clean":32,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:47.399358+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:47.399358+0000","last_clean_scrub_stamp":"2024-09-19T11:17:47.399358+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:55:41.495314+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"8.14","version":"37'4","reported_seq":32,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:18:13.157575+0000","last_change":"2024-09-19T11:18:13.157480+0000","last_active":"2024-09-19T11:18:13.157575+0000","last_peered":"2024-09-19T11:18:13.157575+0000","last_clean":"2024-09-19T11:18:13.157575+0000","last_became_active":"2024-09-19T11:13:41.391597+0000","last_became_peered":"2024-09-19T11:13:41.391597+0000","last_unstale":"2024-09-19T11:18:13.157575+0000","last_undegraded":"2024-09-19T11:18:13.157575+0000","last_fullsized":"2024-09-19T11:18:13.157575+0000","mapping_epoch":33,"log_start":"0'0","ondisk_log_start":"0'0","created":33,"last_epoch_clean":34,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:18:13.157385+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:18:13.157385+0000","last_clean_scrub_stamp":"2024-09-19T11:18:13.157385+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:50:56.773143+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":7,"num_read_kb":7,"num_write":9,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.27","version":"37'8","reported_seq":57,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.520330+0000","last_change":"2024-09-19T11:17:15.520221+0000","last_active":"2024-09-19T11:17:15.520330+0000","last_peered":"2024-09-19T11:17:15.520330+0000","last_clean":"2024-09-19T11:17:15.520330+0000","last_became_active":"2024-09-19T11:13:33.360500+0000","last_became_peered":"2024-09-19T11:13:33.360500+0000","last_unstale":"2024-09-19T11:17:15.520330+0000","last_undegraded":"2024-09-19T11:17:15.520330+0000","last_fullsized":"2024-09-19T11:17:15.520330+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:15.520117+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:15.520117+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.520117+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:49:26.413322+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":33,"num_read_kb":27,"num_write":11,"num_write_kb":5,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.20","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.123007+0000","last_change":"2024-09-19T11:17:02.122899+0000","last_active":"2024-09-19T11:17:02.123007+0000","last_peered":"2024-09-19T11:17:02.123007+0000","last_clean":"2024-09-19T11:17:02.123007+0000","last_became_active":"2024-09-19T11:13:31.371308+0000","last_became_peered":"2024-09-19T11:13:31.371308+0000","last_unstale":"2024-09-19T11:17:02.123007+0000","last_undegraded":"2024-09-19T11:17:02.123007+0000","last_fullsized":"2024-09-19T11:17:02.123007+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.122788+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.122788+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:16:56.217100+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.26","version":"37'2","reported_seq":48,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.704828+0000","last_change":"2024-09-19T11:17:16.704699+0000","last_active":"2024-09-19T11:17:16.704828+0000","last_peered":"2024-09-19T11:17:16.704828+0000","last_clean":"2024-09-19T11:17:16.704828+0000","last_became_active":"2024-09-19T11:13:33.352256+0000","last_became_peered":"2024-09-19T11:13:33.352256+0000","last_unstale":"2024-09-19T11:17:16.704828+0000","last_undegraded":"2024-09-19T11:17:16.704828+0000","last_fullsized":"2024-09-19T11:17:16.704828+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:16.704599+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:16.704599+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.704599+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:48.496980+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":5,"num_write":2,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.21","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:00.729664+0000","last_change":"2024-09-19T11:17:00.729547+0000","last_active":"2024-09-19T11:17:00.729664+0000","last_peered":"2024-09-19T11:17:00.729664+0000","last_clean":"2024-09-19T11:17:00.729664+0000","last_became_active":"2024-09-19T11:13:31.363277+0000","last_became_peered":"2024-09-19T11:13:31.363277+0000","last_unstale":"2024-09-19T11:17:00.729664+0000","last_undegraded":"2024-09-19T11:17:00.729664+0000","last_fullsized":"2024-09-19T11:17:00.729664+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:00.729447+0000","last_clean_scrub_stamp":"2024-09-19T11:17:00.729447+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:50:20.004002+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,3,2],"acting":[0,1,3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.25","version":"37'6","reported_seq":64,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:33.128830+0000","last_change":"2024-09-19T11:17:33.128733+0000","last_active":"2024-09-19T11:17:33.128830+0000","last_peered":"2024-09-19T11:17:33.128830+0000","last_clean":"2024-09-19T11:17:33.128830+0000","last_became_active":"2024-09-19T11:13:33.352300+0000","last_became_peered":"2024-09-19T11:13:33.352300+0000","last_unstale":"2024-09-19T11:17:33.128830+0000","last_undegraded":"2024-09-19T11:17:33.128830+0000","last_fullsized":"2024-09-19T11:17:33.128830+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:33.128637+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:33.128637+0000","last_clean_scrub_stamp":"2024-09-19T11:17:33.128637+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:01.235293+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":25,"num_read_kb":25,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0],"acting":[3,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.22","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:12.280636+0000","last_change":"2024-09-19T11:17:12.280573+0000","last_active":"2024-09-19T11:17:12.280636+0000","last_peered":"2024-09-19T11:17:12.280636+0000","last_clean":"2024-09-19T11:17:12.280636+0000","last_became_active":"2024-09-19T11:13:31.376271+0000","last_became_peered":"2024-09-19T11:13:31.376271+0000","last_unstale":"2024-09-19T11:17:12.280636+0000","last_undegraded":"2024-09-19T11:17:12.280636+0000","last_fullsized":"2024-09-19T11:17:12.280636+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:12.280488+0000","last_clean_scrub_stamp":"2024-09-19T11:17:12.280488+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:06:06.626222+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.24","version":"37'20","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.721854+0000","last_change":"2024-09-19T11:17:15.721783+0000","last_active":"2024-09-19T11:17:15.721854+0000","last_peered":"2024-09-19T11:17:15.721854+0000","last_clean":"2024-09-19T11:17:15.721854+0000","last_became_active":"2024-09-19T11:13:33.352618+0000","last_became_peered":"2024-09-19T11:13:33.352618+0000","last_unstale":"2024-09-19T11:17:15.721854+0000","last_undegraded":"2024-09-19T11:17:15.721854+0000","last_fullsized":"2024-09-19T11:17:15.721854+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'20","last_scrub_stamp":"2024-09-19T11:17:15.721694+0000","last_deep_scrub":"37'20","last_deep_scrub_stamp":"2024-09-19T11:17:15.721694+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.721694+0000","objects_scrubbed":1,"log_size":20,"log_dups_size":0,"ondisk_log_size":20,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:41:41.352334+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":45,"num_read_kb":41,"num_write":21,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2],"acting":[0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.23","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.750186+0000","last_change":"2024-09-19T11:17:01.750132+0000","last_active":"2024-09-19T11:17:01.750186+0000","last_peered":"2024-09-19T11:17:01.750186+0000","last_clean":"2024-09-19T11:17:01.750186+0000","last_became_active":"2024-09-19T11:13:31.378654+0000","last_became_peered":"2024-09-19T11:13:31.378654+0000","last_unstale":"2024-09-19T11:17:01.750186+0000","last_undegraded":"2024-09-19T11:17:01.750186+0000","last_fullsized":"2024-09-19T11:17:01.750186+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.750039+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.750039+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:10:21.882909+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3,2,1],"acting":[0,3,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.23","version":"37'6","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.747697+0000","last_change":"2024-09-19T11:17:14.747631+0000","last_active":"2024-09-19T11:17:14.747697+0000","last_peered":"2024-09-19T11:17:14.747697+0000","last_clean":"2024-09-19T11:17:14.747697+0000","last_became_active":"2024-09-19T11:13:33.350361+0000","last_became_peered":"2024-09-19T11:13:33.350361+0000","last_unstale":"2024-09-19T11:17:14.747697+0000","last_undegraded":"2024-09-19T11:17:14.747697+0000","last_fullsized":"2024-09-19T11:17:14.747697+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.747561+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.747561+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.747561+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:37:33.992563+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.24","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:16:59.719263+0000","last_change":"2024-09-19T11:16:59.719201+0000","last_active":"2024-09-19T11:16:59.719263+0000","last_peered":"2024-09-19T11:16:59.719263+0000","last_clean":"2024-09-19T11:16:59.719263+0000","last_became_active":"2024-09-19T11:13:31.363687+0000","last_became_peered":"2024-09-19T11:13:31.363687+0000","last_unstale":"2024-09-19T11:16:59.719263+0000","last_undegraded":"2024-09-19T11:16:59.719263+0000","last_fullsized":"2024-09-19T11:16:59.719263+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:16:59.719107+0000","last_clean_scrub_stamp":"2024-09-19T11:16:59.719107+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:00:52.014566+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.22","version":"37'6","reported_seq":58,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.509482+0000","last_change":"2024-09-19T11:17:14.509403+0000","last_active":"2024-09-19T11:17:14.509482+0000","last_peered":"2024-09-19T11:17:14.509482+0000","last_clean":"2024-09-19T11:17:14.509482+0000","last_became_active":"2024-09-19T11:13:33.355805+0000","last_became_peered":"2024-09-19T11:13:33.355805+0000","last_unstale":"2024-09-19T11:17:14.509482+0000","last_undegraded":"2024-09-19T11:17:14.509482+0000","last_fullsized":"2024-09-19T11:17:14.509482+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:14.509322+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:14.509322+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.509322+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:14:03.517999+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":15,"num_read_kb":15,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.25","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.712749+0000","last_change":"2024-09-19T11:17:04.712688+0000","last_active":"2024-09-19T11:17:04.712749+0000","last_peered":"2024-09-19T11:17:04.712749+0000","last_clean":"2024-09-19T11:17:04.712749+0000","last_became_active":"2024-09-19T11:13:31.365112+0000","last_became_peered":"2024-09-19T11:13:31.365112+0000","last_unstale":"2024-09-19T11:17:04.712749+0000","last_undegraded":"2024-09-19T11:17:04.712749+0000","last_fullsized":"2024-09-19T11:17:04.712749+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.712601+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.712601+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:30:18.151651+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.21","version":"37'8","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.722988+0000","last_change":"2024-09-19T11:17:20.722908+0000","last_active":"2024-09-19T11:17:20.722988+0000","last_peered":"2024-09-19T11:17:20.722988+0000","last_clean":"2024-09-19T11:17:20.722988+0000","last_became_active":"2024-09-19T11:13:33.342066+0000","last_became_peered":"2024-09-19T11:13:33.342066+0000","last_unstale":"2024-09-19T11:17:20.722988+0000","last_undegraded":"2024-09-19T11:17:20.722988+0000","last_fullsized":"2024-09-19T11:17:20.722988+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:20.722811+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:20.722811+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.722811+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:40:08.485371+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":30,"num_read_kb":26,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.26","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:03.127532+0000","last_change":"2024-09-19T11:17:03.127471+0000","last_active":"2024-09-19T11:17:03.127532+0000","last_peered":"2024-09-19T11:17:03.127532+0000","last_clean":"2024-09-19T11:17:03.127532+0000","last_became_active":"2024-09-19T11:13:31.356746+0000","last_became_peered":"2024-09-19T11:13:31.356746+0000","last_unstale":"2024-09-19T11:17:03.127532+0000","last_undegraded":"2024-09-19T11:17:03.127532+0000","last_fullsized":"2024-09-19T11:17:03.127532+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:03.127373+0000","last_clean_scrub_stamp":"2024-09-19T11:17:03.127373+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:53:45.319191+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,3,1,0],"acting":[2,3,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.20","version":"37'4","reported_seq":54,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.542704+0000","last_change":"2024-09-19T11:17:13.542620+0000","last_active":"2024-09-19T11:17:13.542704+0000","last_peered":"2024-09-19T11:17:13.542704+0000","last_clean":"2024-09-19T11:17:13.542704+0000","last_became_active":"2024-09-19T11:13:33.350095+0000","last_became_peered":"2024-09-19T11:13:33.350095+0000","last_unstale":"2024-09-19T11:17:13.542704+0000","last_undegraded":"2024-09-19T11:17:13.542704+0000","last_fullsized":"2024-09-19T11:17:13.542704+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:13.542491+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.542491+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:20:23.162891+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":11,"num_read_kb":11,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.27","version":"37'4","reported_seq":60,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.719936+0000","last_change":"2024-09-19T11:17:02.719810+0000","last_active":"2024-09-19T11:17:02.719936+0000","last_peered":"2024-09-19T11:17:02.719936+0000","last_clean":"2024-09-19T11:17:02.719936+0000","last_became_active":"2024-09-19T11:13:31.377460+0000","last_became_peered":"2024-09-19T11:13:31.377460+0000","last_unstale":"2024-09-19T11:17:02.719936+0000","last_undegraded":"2024-09-19T11:17:02.719936+0000","last_fullsized":"2024-09-19T11:17:02.719936+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:02.719684+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.719684+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:21:09.105342+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":24,"num_read_kb":10,"num_write":28,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1,2,3],"acting":[0,1,2,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2f","version":"37'6","reported_seq":68,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:20.571925+0000","last_change":"2024-09-19T11:17:20.571852+0000","last_active":"2024-09-19T11:17:20.571925+0000","last_peered":"2024-09-19T11:17:20.571925+0000","last_clean":"2024-09-19T11:17:20.571925+0000","last_became_active":"2024-09-19T11:13:33.357602+0000","last_became_peered":"2024-09-19T11:13:33.357602+0000","last_unstale":"2024-09-19T11:17:20.571925+0000","last_undegraded":"2024-09-19T11:17:20.571925+0000","last_fullsized":"2024-09-19T11:17:20.571925+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:20.571768+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:20.571768+0000","last_clean_scrub_stamp":"2024-09-19T11:17:20.571768+0000","objects_scrubbed":0,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:46:21.919126+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":28,"num_read_kb":28,"num_write":6,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.28","version":"35'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:13.324856+0000","last_change":"2024-09-19T11:17:13.324790+0000","last_active":"2024-09-19T11:17:13.324856+0000","last_peered":"2024-09-19T11:17:13.324856+0000","last_clean":"2024-09-19T11:17:13.324856+0000","last_became_active":"2024-09-19T11:13:31.374218+0000","last_became_peered":"2024-09-19T11:13:31.374218+0000","last_unstale":"2024-09-19T11:17:13.324856+0000","last_undegraded":"2024-09-19T11:17:13.324856+0000","last_fullsized":"2024-09-19T11:17:13.324856+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"35'2","last_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_deep_scrub":"35'2","last_deep_scrub_stamp":"2024-09-19T11:17:13.324688+0000","last_clean_scrub_stamp":"2024-09-19T11:17:13.324688+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:17:10.883666+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":5,"num_read_kb":3,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2e","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:35.141962+0000","last_change":"2024-09-19T11:17:35.141851+0000","last_active":"2024-09-19T11:17:35.141962+0000","last_peered":"2024-09-19T11:17:35.141962+0000","last_clean":"2024-09-19T11:17:35.141962+0000","last_became_active":"2024-09-19T11:13:33.353123+0000","last_became_peered":"2024-09-19T11:13:33.353123+0000","last_unstale":"2024-09-19T11:17:35.141962+0000","last_undegraded":"2024-09-19T11:17:35.141962+0000","last_fullsized":"2024-09-19T11:17:35.141962+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:35.141748+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:35.141748+0000","last_clean_scrub_stamp":"2024-09-19T11:17:35.141748+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:00:12.731724+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2],"acting":[3,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.29","version":"37'2","reported_seq":52,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.735272+0000","last_change":"2024-09-19T11:17:04.735210+0000","last_active":"2024-09-19T11:17:04.735272+0000","last_peered":"2024-09-19T11:17:04.735272+0000","last_clean":"2024-09-19T11:17:04.735272+0000","last_became_active":"2024-09-19T11:13:31.377450+0000","last_became_peered":"2024-09-19T11:13:31.377450+0000","last_unstale":"2024-09-19T11:17:04.735272+0000","last_undegraded":"2024-09-19T11:17:04.735272+0000","last_fullsized":"2024-09-19T11:17:04.735272+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:04.735127+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.735127+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:02:17.771568+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":4,"num_read_kb":2,"num_write":10,"num_write_kb":1,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,1,3],"acting":[0,2,1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.2d","version":"37'12","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.724462+0000","last_change":"2024-09-19T11:17:18.724380+0000","last_active":"2024-09-19T11:17:18.724462+0000","last_peered":"2024-09-19T11:17:18.724462+0000","last_clean":"2024-09-19T11:17:18.724462+0000","last_became_active":"2024-09-19T11:13:33.354774+0000","last_became_peered":"2024-09-19T11:13:33.354774+0000","last_unstale":"2024-09-19T11:17:18.724462+0000","last_undegraded":"2024-09-19T11:17:18.724462+0000","last_fullsized":"2024-09-19T11:17:18.724462+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:18.724292+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:18.724292+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.724292+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:58:51.156798+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":55,"num_read_kb":51,"num_write":13,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,3],"acting":[0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.2a","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:02.744135+0000","last_change":"2024-09-19T11:17:02.744045+0000","last_active":"2024-09-19T11:17:02.744135+0000","last_peered":"2024-09-19T11:17:02.744135+0000","last_clean":"2024-09-19T11:17:02.744135+0000","last_became_active":"2024-09-19T11:13:31.368606+0000","last_became_peered":"2024-09-19T11:13:31.368606+0000","last_unstale":"2024-09-19T11:17:02.744135+0000","last_undegraded":"2024-09-19T11:17:02.744135+0000","last_fullsized":"2024-09-19T11:17:02.744135+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:02.743932+0000","last_clean_scrub_stamp":"2024-09-19T11:17:02.743932+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T20:31:55.116235+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3,2,0],"acting":[1,3,2,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2c","version":"37'4","reported_seq":56,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:19.556469+0000","last_change":"2024-09-19T11:17:19.556409+0000","last_active":"2024-09-19T11:17:19.556469+0000","last_peered":"2024-09-19T11:17:19.556469+0000","last_clean":"2024-09-19T11:17:19.556469+0000","last_became_active":"2024-09-19T11:13:33.342897+0000","last_became_peered":"2024-09-19T11:13:33.342897+0000","last_unstale":"2024-09-19T11:17:19.556469+0000","last_undegraded":"2024-09-19T11:17:19.556469+0000","last_fullsized":"2024-09-19T11:17:19.556469+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:19.556323+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:19.556323+0000","last_clean_scrub_stamp":"2024-09-19T11:17:19.556323+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:46:45.864627+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":14,"num_read_kb":14,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2b","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:01.781142+0000","last_change":"2024-09-19T11:17:01.781064+0000","last_active":"2024-09-19T11:17:01.781142+0000","last_peered":"2024-09-19T11:17:01.781142+0000","last_clean":"2024-09-19T11:17:01.781142+0000","last_became_active":"2024-09-19T11:13:31.366582+0000","last_became_peered":"2024-09-19T11:13:31.366582+0000","last_unstale":"2024-09-19T11:17:01.781142+0000","last_undegraded":"2024-09-19T11:17:01.781142+0000","last_fullsized":"2024-09-19T11:17:01.781142+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:01.780976+0000","last_clean_scrub_stamp":"2024-09-19T11:17:01.780976+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:47:25.647175+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2,0,3],"acting":[1,2,0,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"4.2b","version":"37'14","reported_seq":81,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.510013+0000","last_change":"2024-09-19T11:17:17.509949+0000","last_active":"2024-09-19T11:17:17.510013+0000","last_peered":"2024-09-19T11:17:17.510013+0000","last_clean":"2024-09-19T11:17:17.510013+0000","last_became_active":"2024-09-19T11:14:07.596036+0000","last_became_peered":"2024-09-19T11:14:07.596036+0000","last_unstale":"2024-09-19T11:17:17.510013+0000","last_undegraded":"2024-09-19T11:17:17.510013+0000","last_fullsized":"2024-09-19T11:17:17.510013+0000","mapping_epoch":36,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":37,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'14","last_scrub_stamp":"2024-09-19T11:17:17.509860+0000","last_deep_scrub":"37'14","last_deep_scrub_stamp":"2024-09-19T11:17:17.509860+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.509860+0000","objects_scrubbed":0,"log_size":14,"log_dups_size":0,"ondisk_log_size":14,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T21:02:13.758418+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":20,"num_read_kb":20,"num_write":14,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":2,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2c","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:14.362733+0000","last_change":"2024-09-19T11:17:14.362674+0000","last_active":"2024-09-19T11:17:14.362733+0000","last_peered":"2024-09-19T11:17:14.362733+0000","last_clean":"2024-09-19T11:17:14.362733+0000","last_became_active":"2024-09-19T11:13:31.367944+0000","last_became_peered":"2024-09-19T11:13:31.367944+0000","last_unstale":"2024-09-19T11:17:14.362733+0000","last_undegraded":"2024-09-19T11:17:14.362733+0000","last_fullsized":"2024-09-19T11:17:14.362733+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:14.362585+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:14.362585+0000","last_clean_scrub_stamp":"2024-09-19T11:17:14.362585+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T15:32:42.088426+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1,0,2],"acting":[3,1,0,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.2a","version":"37'12","reported_seq":85,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.482164+0000","last_change":"2024-09-19T11:17:16.482087+0000","last_active":"2024-09-19T11:17:16.482164+0000","last_peered":"2024-09-19T11:17:16.482164+0000","last_clean":"2024-09-19T11:17:16.482164+0000","last_became_active":"2024-09-19T11:13:33.358131+0000","last_became_peered":"2024-09-19T11:13:33.358131+0000","last_unstale":"2024-09-19T11:17:16.482164+0000","last_undegraded":"2024-09-19T11:17:16.482164+0000","last_fullsized":"2024-09-19T11:17:16.482164+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'12","last_scrub_stamp":"2024-09-19T11:17:16.482004+0000","last_deep_scrub":"37'12","last_deep_scrub_stamp":"2024-09-19T11:17:16.482004+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.482004+0000","objects_scrubbed":1,"log_size":12,"log_dups_size":0,"ondisk_log_size":12,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T23:04:19.747512+0000","scrub_duration":2,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":46,"num_read_kb":46,"num_write":11,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,2],"acting":[1,2],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2d","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:15.374642+0000","last_change":"2024-09-19T11:17:15.374545+0000","last_active":"2024-09-19T11:17:15.374642+0000","last_peered":"2024-09-19T11:17:15.374642+0000","last_clean":"2024-09-19T11:17:15.374642+0000","last_became_active":"2024-09-19T11:13:31.367494+0000","last_became_peered":"2024-09-19T11:13:31.367494+0000","last_unstale":"2024-09-19T11:17:15.374642+0000","last_undegraded":"2024-09-19T11:17:15.374642+0000","last_fullsized":"2024-09-19T11:17:15.374642+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:15.374417+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:15.374417+0000","last_clean_scrub_stamp":"2024-09-19T11:17:15.374417+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T11:22:03.758631+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,0,2,1],"acting":[3,0,2,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.29","version":"37'6","reported_seq":55,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:34.151470+0000","last_change":"2024-09-19T11:17:34.151411+0000","last_active":"2024-09-19T11:17:34.151470+0000","last_peered":"2024-09-19T11:17:34.151470+0000","last_clean":"2024-09-19T11:17:34.151470+0000","last_became_active":"2024-09-19T11:13:33.348228+0000","last_became_peered":"2024-09-19T11:13:33.348228+0000","last_unstale":"2024-09-19T11:17:34.151470+0000","last_undegraded":"2024-09-19T11:17:34.151470+0000","last_fullsized":"2024-09-19T11:17:34.151470+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'6","last_scrub_stamp":"2024-09-19T11:17:34.151316+0000","last_deep_scrub":"37'6","last_deep_scrub_stamp":"2024-09-19T11:17:34.151316+0000","last_clean_scrub_stamp":"2024-09-19T11:17:34.151316+0000","objects_scrubbed":1,"log_size":6,"log_dups_size":0,"ondisk_log_size":6,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":1,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:12:29.956213+0000","scrub_duration":1,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":1,"num_object_clones":0,"num_object_copies":2,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":1,"num_whiteouts":0,"num_read":10,"num_read_kb":10,"num_write":5,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":1,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,1],"acting":[3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.2e","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:04.153299+0000","last_change":"2024-09-19T11:17:04.153242+0000","last_active":"2024-09-19T11:17:04.153299+0000","last_peered":"2024-09-19T11:17:04.153299+0000","last_clean":"2024-09-19T11:17:04.153299+0000","last_became_active":"2024-09-19T11:13:31.358259+0000","last_became_peered":"2024-09-19T11:13:31.358259+0000","last_unstale":"2024-09-19T11:17:04.153299+0000","last_undegraded":"2024-09-19T11:17:04.153299+0000","last_fullsized":"2024-09-19T11:17:04.153299+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:04.153146+0000","last_clean_scrub_stamp":"2024-09-19T11:17:04.153146+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T19:18:23.740652+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[2,0,3,1],"acting":[2,0,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":2,"acting_primary":2,"purged_snaps":[]},{"pgid":"4.28","version":"37'8","reported_seq":65,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:18.559592+0000","last_change":"2024-09-19T11:17:18.559499+0000","last_active":"2024-09-19T11:17:18.559592+0000","last_peered":"2024-09-19T11:17:18.559592+0000","last_clean":"2024-09-19T11:17:18.559592+0000","last_became_active":"2024-09-19T11:13:33.346418+0000","last_became_peered":"2024-09-19T11:13:33.346418+0000","last_unstale":"2024-09-19T11:17:18.559592+0000","last_undegraded":"2024-09-19T11:17:18.559592+0000","last_fullsized":"2024-09-19T11:17:18.559592+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'8","last_scrub_stamp":"2024-09-19T11:17:18.559406+0000","last_deep_scrub":"37'8","last_deep_scrub_stamp":"2024-09-19T11:17:18.559406+0000","last_clean_scrub_stamp":"2024-09-19T11:17:18.559406+0000","objects_scrubbed":0,"log_size":8,"log_dups_size":0,"ondisk_log_size":8,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T14:46:02.731291+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":36,"num_read_kb":32,"num_write":10,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,0],"acting":[1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]},{"pgid":"3.2f","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.333691+0000","last_change":"2024-09-19T11:17:17.333631+0000","last_active":"2024-09-19T11:17:17.333691+0000","last_peered":"2024-09-19T11:17:17.333691+0000","last_clean":"2024-09-19T11:17:17.333691+0000","last_became_active":"2024-09-19T11:13:31.366446+0000","last_became_peered":"2024-09-19T11:13:31.366446+0000","last_unstale":"2024-09-19T11:17:17.333691+0000","last_undegraded":"2024-09-19T11:17:17.333691+0000","last_fullsized":"2024-09-19T11:17:17.333691+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:17.333525+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:17.333525+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.333525+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T22:07:07.331615+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,1,0],"acting":[3,2,1,0],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"3.30","version":"0'0","reported_seq":49,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:16.360953+0000","last_change":"2024-09-19T11:17:16.360890+0000","last_active":"2024-09-19T11:17:16.360953+0000","last_peered":"2024-09-19T11:17:16.360953+0000","last_clean":"2024-09-19T11:17:16.360953+0000","last_became_active":"2024-09-19T11:13:31.374654+0000","last_became_peered":"2024-09-19T11:13:31.374654+0000","last_unstale":"2024-09-19T11:17:16.360953+0000","last_undegraded":"2024-09-19T11:17:16.360953+0000","last_fullsized":"2024-09-19T11:17:16.360953+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"0'0","last_scrub_stamp":"2024-09-19T11:17:16.360792+0000","last_deep_scrub":"0'0","last_deep_scrub_stamp":"2024-09-19T11:17:16.360792+0000","last_clean_scrub_stamp":"2024-09-19T11:17:16.360792+0000","objects_scrubbed":0,"log_size":0,"log_dups_size":0,"ondisk_log_size":0,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T16:49:58.587005+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[3,2,0,1],"acting":[3,2,0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":3,"acting_primary":3,"purged_snaps":[]},{"pgid":"4.37","version":"37'10","reported_seq":75,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:17.687011+0000","last_change":"2024-09-19T11:17:17.686885+0000","last_active":"2024-09-19T11:17:17.687011+0000","last_peered":"2024-09-19T11:17:17.687011+0000","last_clean":"2024-09-19T11:17:17.687011+0000","last_became_active":"2024-09-19T11:13:33.348399+0000","last_became_peered":"2024-09-19T11:13:33.348399+0000","last_unstale":"2024-09-19T11:17:17.687011+0000","last_undegraded":"2024-09-19T11:17:17.687011+0000","last_fullsized":"2024-09-19T11:17:17.687011+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'10","last_scrub_stamp":"2024-09-19T11:17:17.686787+0000","last_deep_scrub":"37'10","last_deep_scrub_stamp":"2024-09-19T11:17:17.686787+0000","last_clean_scrub_stamp":"2024-09-19T11:17:17.686787+0000","objects_scrubbed":0,"log_size":10,"log_dups_size":0,"ondisk_log_size":10,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T17:58:29.308455+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":49,"num_read_kb":45,"num_write":12,"num_write_kb":3,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,1],"acting":[0,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"3.31","version":"37'2","reported_seq":51,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:06.699867+0000","last_change":"2024-09-19T11:17:06.699792+0000","last_active":"2024-09-19T11:17:06.699867+0000","last_peered":"2024-09-19T11:17:06.699867+0000","last_clean":"2024-09-19T11:17:06.699867+0000","last_became_active":"2024-09-19T11:13:31.378046+0000","last_became_peered":"2024-09-19T11:13:31.378046+0000","last_unstale":"2024-09-19T11:17:06.699867+0000","last_undegraded":"2024-09-19T11:17:06.699867+0000","last_fullsized":"2024-09-19T11:17:06.699867+0000","mapping_epoch":23,"log_start":"0'0","ondisk_log_start":"0'0","created":23,"last_epoch_clean":24,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'2","last_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_deep_scrub":"37'2","last_deep_scrub_stamp":"2024-09-19T11:17:06.699710+0000","last_clean_scrub_stamp":"2024-09-19T11:17:06.699710+0000","objects_scrubbed":0,"log_size":2,"log_dups_size":0,"ondisk_log_size":2,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T12:54:06.685184+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":1,"num_read_kb":0,"num_write":2,"num_write_kb":4092,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[0,2,3,1],"acting":[0,2,3,1],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":0,"acting_primary":0,"purged_snaps":[]},{"pgid":"4.36","version":"37'4","reported_seq":53,"reported_epoch":37,"state":"active+clean","last_fresh":"2024-09-19T11:17:26.420216+0000","last_change":"2024-09-19T11:17:26.420123+0000","last_active":"2024-09-19T11:17:26.420216+0000","last_peered":"2024-09-19T11:17:26.420216+0000","last_clean":"2024-09-19T11:17:26.420216+0000","last_became_active":"2024-09-19T11:13:33.352966+0000","last_became_peered":"2024-09-19T11:13:33.352966+0000","last_unstale":"2024-09-19T11:17:26.420216+0000","last_undegraded":"2024-09-19T11:17:26.420216+0000","last_fullsized":"2024-09-19T11:17:26.420216+0000","mapping_epoch":25,"log_start":"0'0","ondisk_log_start":"0'0","created":25,"last_epoch_clean":26,"parent":"0.0","parent_split_bits":0,"last_scrub":"37'4","last_scrub_stamp":"2024-09-19T11:17:26.420010+0000","last_deep_scrub":"37'4","last_deep_scrub_stamp":"2024-09-19T11:17:26.420010+0000","last_clean_scrub_stamp":"2024-09-19T11:17:26.420010+0000","objects_scrubbed":0,"log_size":4,"log_dups_size":0,"ondisk_log_size":4,"stats_invalid":false,"dirty_stats_invalid":false,"omap_stats_invalid":false,"hitset_stats_invalid":false,"hitset_bytes_stats_invalid":false,"pin_stats_invalid":false,"manifest_stats_invalid":false,"snaptrimq_len":0,"last_scrub_duration":0,"scrub_schedule":"periodic scrub scheduled @ 2024-09-20T13:35:17.288611+0000","scrub_duration":0,"objects_trimmed":0,"snaptrim_duration":0,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":9,"num_read_kb":9,"num_write":4,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"up":[1,3],"acting":[1,3],"avail_no_missing":[],"object_location_counts":[],"blocked_by":[],"up_primary":1,"acting_primary":1,"purged_snaps":[]}],"pool_stats":[{"poolid":8,"num_pg":32,"stat_sum":{"num_bytes":1549,"num_objects":9,"num_object_clones":0,"num_object_copies":18,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":9,"num_whiteouts":0,"num_read":692,"num_read_kb":660,"num_write":560,"num_write_kb":172,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":2,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":349,"num_omap_keys":2,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3098,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":277,"ondisk_log_size":277,"up":64,"acting":64,"num_store_stats":4},{"poolid":7,"num_pg":32,"stat_sum":{"num_bytes":0,"num_objects":8,"num_object_clones":0,"num_object_copies":16,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":8,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":0,"num_write_kb":0,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":2288,"ondisk_log_size":2288,"up":64,"acting":64,"num_store_stats":4},{"poolid":6,"num_pg":32,"stat_sum":{"num_bytes":11674,"num_objects":183,"num_object_clones":0,"num_object_copies":366,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":183,"num_whiteouts":0,"num_read":1601,"num_read_kb":1398,"num_write":599,"num_write_kb":74,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":5,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":3000,"num_omap_keys":14,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":278528,"data_stored":7404,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":1558,"ondisk_log_size":1558,"up":64,"acting":64,"num_store_stats":4},{"poolid":5,"num_pg":32,"stat_sum":{"num_bytes":1800,"num_objects":7,"num_object_clones":0,"num_object_copies":14,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":7,"num_whiteouts":0,"num_read":972,"num_read_kb":972,"num_write":19,"num_write_kb":12,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":3600,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":19,"ondisk_log_size":19,"up":64,"acting":64,"num_store_stats":4},{"poolid":4,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":11,"num_object_clones":0,"num_object_copies":22,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":11,"num_whiteouts":0,"num_read":1663,"num_read_kb":1553,"num_write":528,"num_write_kb":85,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":7,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":11,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":483,"ondisk_log_size":483,"up":128,"acting":128,"num_store_stats":4},{"poolid":3,"num_pg":64,"stat_sum":{"num_bytes":0,"num_objects":0,"num_object_clones":0,"num_object_copies":0,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":0,"num_whiteouts":0,"num_read":189,"num_read_kb":87,"num_write":316,"num_write_kb":58617,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":83,"ondisk_log_size":83,"up":256,"acting":256,"num_store_stats":4},{"poolid":2,"num_pg":8,"stat_sum":{"num_bytes":19,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":0,"num_read_kb":0,"num_write":2,"num_write_kb":2,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":38,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":5,"ondisk_log_size":5,"up":16,"acting":16,"num_store_stats":4},{"poolid":1,"num_pg":1,"stat_sum":{"num_bytes":590368,"num_objects":2,"num_object_clones":0,"num_object_copies":4,"num_objects_missing_on_primary":0,"num_objects_missing":0,"num_objects_degraded":0,"num_objects_misplaced":0,"num_objects_unfound":0,"num_objects_dirty":2,"num_whiteouts":0,"num_read":66,"num_read_kb":55,"num_write":101,"num_write_kb":1628,"num_scrub_errors":0,"num_shallow_scrub_errors":0,"num_deep_scrub_errors":0,"num_objects_recovered":0,"num_bytes_recovered":0,"num_keys_recovered":0,"num_objects_omap":0,"num_objects_hit_set_archive":0,"num_bytes_hit_set_archive":0,"num_flush":0,"num_flush_kb":0,"num_evict":0,"num_evict_kb":0,"num_promote":0,"num_flush_mode_high":0,"num_flush_mode_low":0,"num_evict_mode_some":0,"num_evict_mode_full":0,"num_objects_pinned":0,"num_legacy_snapsets":0,"num_large_omap_objects":0,"num_objects_manifest":0,"num_omap_bytes":0,"num_omap_keys":0,"num_objects_repaired":0},"store_stats":{"total":0,"available":0,"internally_reserved":0,"allocated":1187840,"data_stored":1180736,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},"log_size":74,"ondisk_log_size":74,"up":2,"acting":2,"num_store_stats":2}],"osd_stats":[{"osd":3,"up_from":11,"seq":47244640324,"num_pgs":178,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40004,"kb_used_data":500,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331836,"statfs":{"total":96636764160,"available":96595800064,"internally_reserved":0,"allocated":512000,"data_stored":161981,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1593,"internal_metadata":40434119},"hb_peers":[0,1,2],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":2,"up_from":11,"seq":47244640325,"num_pgs":154,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40512,"kb_used_data":1008,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331328,"statfs":{"total":96636764160,"available":96595279872,"internally_reserved":0,"allocated":1032192,"data_stored":749066,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,1,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":1,"up_from":11,"seq":47244640325,"num_pgs":155,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":40536,"kb_used_data":1032,"kb_used_omap":1,"kb_used_meta":39486,"kb_avail":94331304,"statfs":{"total":96636764160,"available":96595255296,"internally_reserved":0,"allocated":1056768,"data_stored":749395,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":40434117},"hb_peers":[0,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]},{"osd":0,"up_from":9,"seq":38654705731,"num_pgs":171,"num_osds":1,"num_per_pool_osds":1,"num_per_pool_omap_osds":1,"kb":94371840,"kb_used":27492,"kb_used_data":468,"kb_used_omap":1,"kb_used_meta":27006,"kb_avail":94344348,"statfs":{"total":96636764160,"available":96608612352,"internally_reserved":0,"allocated":479232,"data_stored":160962,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":1595,"internal_metadata":27654597},"hb_peers":[1,2,3],"snap_trim_queue_len":0,"num_snap_trimming":0,"num_shards_repaired":0,"op_queue_age_hist":{"histogram":[],"upper_bound":1},"perf_stat":{"commit_latency_ms":0,"apply_latency_ms":0,"commit_latency_ns":0,"apply_latency_ns":0},"alerts":[]}],"pool_statfs":[{"poolid":1,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":1,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":593920,"data_stored":590368,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":2,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":4096,"data_stored":19,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":3,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":4,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1318,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":12288,"data_stored":138,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":8192,"data_stored":482,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":5,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":1662,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1650,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":61440,"data_stored":1612,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":57344,"data_stored":1584,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":6,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":98304,"data_stored":2558,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":7,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":0,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1343,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":1,"total":0,"available":0,"internally_reserved":0,"allocated":16384,"data_stored":645,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":2,"total":0,"available":0,"internally_reserved":0,"allocated":0,"data_stored":0,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0},{"poolid":8,"osd":3,"total":0,"available":0,"internally_reserved":0,"allocated":20480,"data_stored":1110,"data_compressed":0,"data_compressed_allocated":0,"data_compressed_original":0,"omap_allocated":0,"internal_metadata":0}]}} 2024-09-19T11:18:36.316 DEBUG:teuthology.orchestra.run.smithi037:> sudo ceph --cluster ceph config set global mon_health_to_clog false 2024-09-19T11:18:36.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.444+0000 7f84ba008640 1 Processor -- start 2024-09-19T11:18:36.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.444+0000 7f84ba008640 1 -- start start 2024-09-19T11:18:36.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.444+0000 7f84ba008640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84b4097470 0x7f84b4097850 unknown :-1 s=NONE pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:36.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.444+0000 7f84ba008640 1 -- --> v1:172.21.15.37:6789/0 -- auth(proto 0 30 bytes epoch 0) -- 0x7f84b409a2e0 con 0x7f84b4097d90 2024-09-19T11:18:36.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.444+0000 7f84ba008640 1 -- --> v2:172.21.15.37:3300/0 -- mon_getmap magic: 0 -- 0x7f84b4072510 con 0x7f84b4097470 2024-09-19T11:18:36.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.445+0000 7f84b37fe640 1 --2- >> v2:172.21.15.37:3300/0 conn(0x7f84b4097470 0x7f84b4097850 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=0 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:36.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.445+0000 7f84abfff640 1 --1- >> v1:172.21.15.37:6789/0 conn(0x7f84b4097d90 0x7f84b406dfb0 :-1 s=CONNECTING_WAIT_BANNER_AND_IDENTIFY pgs=0 cs=0 l=0).handle_server_banner_and_identify peer v1:172.21.15.37:6789/0 says I am v1:172.21.15.37:52392/0 (socket says 172.21.15.37:52392) 2024-09-19T11:18:36.446 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.445+0000 7f84abfff640 1 -- 172.21.15.37:0/604938004 learned_addr learned my addr 172.21.15.37:0/604938004 (peer_addr_for_me v1:172.21.15.37:0/0) 2024-09-19T11:18:36.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.445+0000 7f84b37fe640 1 -- 172.21.15.37:0/604938004 >> v1:172.21.15.37:6789/0 conn(0x7f84b4097d90 legacy=0x7f84b406dfb0 unknown :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:36.447 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.445+0000 7f84b37fe640 1 -- 172.21.15.37:0/604938004 --> v2:172.21.15.37:3300/0 -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b40712d0 con 0x7f84b4097470 2024-09-19T11:18:36.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84b37fe640 1 --2- 172.21.15.37:0/604938004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b4097850 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009720 tx=0x7f84a402a110 comp rx=0 tx=0).ready entity=mon.0 client_cookie=b3d58d08c2e92542 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:36.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84b2ffd640 1 -- 172.21.15.37:0/604938004 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a4037070 con 0x7f84b4097470 2024-09-19T11:18:36.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84b2ffd640 1 -- 172.21.15.37:0/604938004 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a402ad90 con 0x7f84b4097470 2024-09-19T11:18:36.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84b2ffd640 1 -- 172.21.15.37:0/604938004 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a4032590 con 0x7f84b4097470 2024-09-19T11:18:36.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84ba008640 1 -- 172.21.15.37:0/604938004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 msgr2=0x7f84b4097850 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:36.448 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84ba008640 1 --2- 172.21.15.37:0/604938004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b4097850 secure :-1 s=READY pgs=905 cs=0 l=1 rev1=1 crypto rx=0x7f84a4009720 tx=0x7f84a402a110 comp rx=0 tx=0).stop 2024-09-19T11:18:36.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84ba008640 1 -- 172.21.15.37:0/604938004 shutdown_connections 2024-09-19T11:18:36.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84ba008640 1 --2- 172.21.15.37:0/604938004 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b4097850 unknown :-1 s=CLOSED pgs=905 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84ba008640 1 -- 172.21.15.37:0/604938004 >> 172.21.15.37:0/604938004 conn(0x7f84b409abc0 msgr2=0x7f84b4098490 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:18:36.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84ba008640 1 -- 172.21.15.37:0/604938004 shutdown_connections 2024-09-19T11:18:36.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.446+0000 7f84ba008640 1 -- 172.21.15.37:0/604938004 wait complete. 2024-09-19T11:18:36.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.447+0000 7f84ba008640 1 Processor -- start 2024-09-19T11:18:36.449 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.447+0000 7f84ba008640 1 -- start start 2024-09-19T11:18:36.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84ba008640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b41c3fa0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:36.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84ba008640 1 -- --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_getmap magic: 0 -- 0x7f84b406e6c0 con 0x7f84b4097470 2024-09-19T11:18:36.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b41c3fa0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:36.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84b37fe640 1 --2- >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b41c3fa0 unknown :-1 s=HELLO_CONNECTING pgs=0 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).handle_hello peer v2:172.21.15.37:3300/0 says I am v2:172.21.15.37:41290/0 (socket says 172.21.15.37:41290) 2024-09-19T11:18:36.451 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84b37fe640 1 -- 172.21.15.37:0/4051890122 learned_addr learned my addr 172.21.15.37:0/4051890122 (peer_addr_for_me v2:172.21.15.37:0/0) 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84b37fe640 1 -- 172.21.15.37:0/4051890122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({config=0+,monmap=0+}) -- 0x7f84b4073ee0 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84b37fe640 1 --2- 172.21.15.37:0/4051890122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b41c3fa0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f84a402a150 tx=0x7f84a40046c0 comp rx=0 tx=0).ready entity=mon.0 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84b0ff9640 1 -- 172.21.15.37:0/4051890122 <== mon.0 v2:172.21.15.37:3300/0 1 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a4041070 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84b0ff9640 1 -- 172.21.15.37:0/4051890122 <== mon.0 v2:172.21.15.37:3300/0 2 ==== config(0 keys) ==== 4+0+0 (secure 0 0 0) 0x7f84a4032e30 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84b0ff9640 1 -- 172.21.15.37:0/4051890122 <== mon.0 v2:172.21.15.37:3300/0 3 ==== mon_map magic: 0 ==== 205+0+0 (secure 0 0 0) 0x7f84a4037040 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({mgrmap=0+}) -- 0x7f84b4129b40 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.448+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_subscribe({osdmap=0}) -- 0x7f84b4090490 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.449+0000 7f84b0ff9640 1 -- 172.21.15.37:0/4051890122 <== mon.0 v2:172.21.15.37:3300/0 4 ==== mgrmap(e 5) ==== 51031+0+0 (secure 0 0 0) 0x7f84a4044070 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.449+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command({"prefix": "get_command_descriptions"} v 0) -- 0x7f84b406ebc0 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.449+0000 7f84b0ff9640 1 --2- 172.21.15.37:0/4051890122 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f849403e710 0x7f8494040bd0 unknown :-1 s=NONE pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0).connect 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.450+0000 7f84b0ff9640 1 -- 172.21.15.37:0/4051890122 <== mon.0 v2:172.21.15.37:3300/0 5 ==== osd_map(37..37 src has 1..37) ==== 6336+0+0 (secure 0 0 0) 0x7f84a40740e0 con 0x7f84b4097470 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.450+0000 7f84abfff640 1 --2- 172.21.15.37:0/4051890122 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f849403e710 0x7f8494040bd0 unknown :-1 s=BANNER_CONNECTING pgs=0 cs=0 l=1 rev1=0 crypto rx=0 tx=0 comp rx=0 tx=0)._handle_peer_banner_payload supported=3 required=0 2024-09-19T11:18:36.452 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.450+0000 7f84abfff640 1 --2- 172.21.15.37:0/4051890122 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f849403e710 0x7f8494040bd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f849c007fd0 tx=0x7f849c007aa0 comp rx=0 tx=0).ready entity=mgr.4102 client_cookie=0 server_cookie=0 in_seq=0 out_seq=0 2024-09-19T11:18:36.455 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.454+0000 7f84b0ff9640 1 -- 172.21.15.37:0/4051890122 <== mon.0 v2:172.21.15.37:3300/0 6 ==== mon_command_ack([{"prefix": "get_command_descriptions"}]=0 v0) ==== 72+0+196984 (secure 0 0 0) 0x7f84b4073ee0 con 0x7f84b4097470 2024-09-19T11:18:36.640 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.639+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 --> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] -- mon_command([{prefix=config set, name=mon_health_to_clog}] v 0) -- 0x7f84b4075000 con 0x7f84b4097470 2024-09-19T11:18:36.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.641+0000 7f84b0ff9640 1 -- 172.21.15.37:0/4051890122 <== mon.0 v2:172.21.15.37:3300/0 7 ==== mon_command_ack([{prefix=config set, name=mon_health_to_clog}]=0 v6)=0 v6) ==== 123+0+0 (secure 0 0 0) 0x7f84a404ed60 con 0x7f84b4097470 2024-09-19T11:18:36.642 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.642+0000 7f84b0ff9640 1 -- 172.21.15.37:0/4051890122 <== mon.0 v2:172.21.15.37:3300/0 8 ==== config(1 keys) ==== 35+0+0 (secure 0 0 0) 0x7f84a404e8d0 con 0x7f84b4097470 2024-09-19T11:18:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f849403e710 msgr2=0x7f8494040bd0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 --2- 172.21.15.37:0/4051890122 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f849403e710 0x7f8494040bd0 secure :-1 s=READY pgs=374 cs=0 l=1 rev1=1 crypto rx=0x7f849c007fd0 tx=0x7f849c007aa0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 msgr2=0x7f84b41c3fa0 secure :-1 s=STATE_CONNECTION_ESTABLISHED l=1).mark_down 2024-09-19T11:18:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 --2- 172.21.15.37:0/4051890122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b41c3fa0 secure :-1 s=READY pgs=906 cs=0 l=1 rev1=1 crypto rx=0x7f84a402a150 tx=0x7f84a40046c0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.645 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 shutdown_connections 2024-09-19T11:18:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 --2- 172.21.15.37:0/4051890122 >> [v2:172.21.15.102:6824/3738146565,v1:172.21.15.102:6825/3738146565] conn(0x7f849403e710 0x7f8494040bd0 unknown :-1 s=CLOSED pgs=374 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 --2- 172.21.15.37:0/4051890122 >> [v2:172.21.15.37:3300/0,v1:172.21.15.37:6789/0] conn(0x7f84b4097470 0x7f84b41c3fa0 unknown :-1 s=CLOSED pgs=906 cs=0 l=1 rev1=1 crypto rx=0 tx=0 comp rx=0 tx=0).stop 2024-09-19T11:18:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 >> 172.21.15.37:0/4051890122 conn(0x7f84b409abc0 msgr2=0x7f84b4122b50 unknown :-1 s=STATE_NONE l=0).mark_down 2024-09-19T11:18:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 shutdown_connections 2024-09-19T11:18:36.646 INFO:teuthology.orchestra.run.smithi037.stderr:2024-09-19T11:18:36.644+0000 7f84ba008640 1 -- 172.21.15.37:0/4051890122 wait complete. 2024-09-19T11:18:36.655 INFO:teuthology.misc:Shutting down mds daemons... 2024-09-19T11:18:36.656 INFO:teuthology.misc:Shutting down osd daemons... 2024-09-19T11:18:36.656 DEBUG:tasks.ceph.osd.0:waiting for process to exit 2024-09-19T11:18:36.656 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T11:18:36.706 INFO:tasks.ceph.osd.0:Stopped 2024-09-19T11:18:36.706 DEBUG:tasks.ceph.osd.1:waiting for process to exit 2024-09-19T11:18:36.706 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T11:18:36.735 INFO:tasks.ceph.osd.1:Stopped 2024-09-19T11:18:36.735 DEBUG:tasks.ceph.osd.2:waiting for process to exit 2024-09-19T11:18:36.735 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T11:18:36.801 INFO:tasks.ceph.osd.2:Stopped 2024-09-19T11:18:36.802 DEBUG:tasks.ceph.osd.3:waiting for process to exit 2024-09-19T11:18:36.802 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T11:18:36.870 INFO:tasks.ceph.osd.3:Stopped 2024-09-19T11:18:36.870 INFO:teuthology.misc:Shutting down mgr daemons... 2024-09-19T11:18:36.871 DEBUG:tasks.ceph.mgr.x:waiting for process to exit 2024-09-19T11:18:36.871 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T11:18:36.940 INFO:tasks.ceph.mgr.x:Stopped 2024-09-19T11:18:36.941 INFO:teuthology.misc:Shutting down mon daemons... 2024-09-19T11:18:36.941 DEBUG:tasks.ceph.mon.a:waiting for process to exit 2024-09-19T11:18:36.941 INFO:teuthology.orchestra.run:waiting for 300 2024-09-19T11:18:36.953 INFO:tasks.ceph.mon.a:Stopped 2024-09-19T11:18:36.953 INFO:tasks.ceph:Checking cluster log for badness... 2024-09-19T11:18:36.953 DEBUG:teuthology.orchestra.run.smithi037:> sudo egrep '\[ERR\]|\[WRN\]|\[SEC\]' /var/log/ceph/ceph.log | egrep -v '\(MDS_ALL_DOWN\)' | egrep -v '\(MDS_UP_LESS_THAN_MAX\)' | egrep -v '\(PG_AVAILABILITY\)' | egrep -v '\(PG_DEGRADED\)' | egrep -v '\(POOL_APP_NOT_ENABLED\)' | egrep -v 'not have an application enabled' | head -n 1 2024-09-19T11:18:37.023 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-0 on ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T11:18:37.023 DEBUG:teuthology.orchestra.run.smithi037:> sync && sudo umount -f /var/lib/ceph/osd/ceph-0 2024-09-19T11:18:37.179 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-1 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:18:37.179 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-1 2024-09-19T11:18:37.422 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-2 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:18:37.422 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-2 2024-09-19T11:18:37.498 INFO:tasks.ceph:Unmounting /var/lib/ceph/osd/ceph-3 on ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:18:37.498 DEBUG:teuthology.orchestra.run.smithi102:> sync && sudo umount -f /var/lib/ceph/osd/ceph-3 2024-09-19T11:18:37.596 INFO:tasks.ceph:Archiving mon data... 2024-09-19T11:18:37.601 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/mon/ceph-a to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417/data/mon.a.tgz 2024-09-19T11:18:37.601 DEBUG:teuthology.orchestra.run.smithi037:> mktemp 2024-09-19T11:18:37.620 INFO:teuthology.orchestra.run.smithi037.stdout:/tmp/tmp.l7nM6ZGudK 2024-09-19T11:18:37.620 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar cz -f - -C /var/lib/ceph/mon/ceph-a -- . > /tmp/tmp.l7nM6ZGudK 2024-09-19T11:18:37.775 DEBUG:teuthology.orchestra.run.smithi037:> sudo chmod 0666 /tmp/tmp.l7nM6ZGudK 2024-09-19T11:18:37.863 DEBUG:teuthology.orchestra.remote:smithi037:/tmp/tmp.l7nM6ZGudK is 284KB 2024-09-19T11:18:37.958 DEBUG:teuthology.orchestra.run.smithi037:> rm -fr /tmp/tmp.l7nM6ZGudK 2024-09-19T11:18:37.974 INFO:tasks.ceph:Cleaning ceph cluster... 2024-09-19T11:18:37.974 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T11:18:38.016 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -rf -- /etc/ceph/ceph.conf /etc/ceph/ceph.keyring /home/ubuntu/cephtest/ceph.data /home/ubuntu/cephtest/ceph.monmap /home/ubuntu/cephtest/../*.pid 2024-09-19T11:18:38.097 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T11:18:38.116 INFO:teuthology.util.scanner:summary_data or yaml_file is empty! 2024-09-19T11:18:38.116 INFO:tasks.ceph:Archiving crash dumps... 2024-09-19T11:18:38.117 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/lib/ceph/crash to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417/remote/smithi037/crash 2024-09-19T11:18:38.118 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T11:18:38.164 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/lib/ceph/crash to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417/remote/smithi102/crash 2024-09-19T11:18:38.165 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/lib/ceph/crash -- . 2024-09-19T11:18:38.210 INFO:tasks.ceph:Compressing logs... 2024-09-19T11:18:38.210 DEBUG:teuthology.orchestra.run.smithi037:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T11:18:38.213 DEBUG:teuthology.orchestra.run.smithi102:> time sudo find /var/log/ceph -name '*.log' -print0 | sudo xargs --max-args=1 --max-procs=0 --verbose -0 --no-run-if-empty -- gzip -5 --verbose -- 2024-09-19T11:18:38.236 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-osd.0.log 2024-09-19T11:18:38.270 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31502.log 2024-09-19T11:18:38.270 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31334.log 2024-09-19T11:18:38.270 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-osd.0.log: /var/log/ceph/ceph-client.admin.31502.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32379.log 2024-09-19T11:18:38.270 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31502.log.gz 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31334.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31503.log 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31334.log.gz 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31863.log 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32379.log: /var/log/ceph/ceph-client.admin.31503.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32211.log 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr: 85.3% -- replaced with /var/log/ceph/ceph-client.admin.32379.log.gz 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31503.log.gz 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31650.log 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.31863.log.gz 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32211.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32337.log 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32211.log.gz 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31650.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31332.log 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31650.log.gz 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32337.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30888.log 2024-09-19T11:18:38.271 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31332.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32337.log.gz 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31166.log 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.31332.log.gz 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30888.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31501.log 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr: 86.6% -- replaced with /var/log/ceph/ceph-client.admin.30888.log.gz 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31166.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30750.log 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31166.log.gz 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31501.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32547.log 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.31501.log.gz 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30750.log: gzip -5 --verbose -- /var/log/ceph/ceph.audit.log 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30750.log.gz 2024-09-19T11:18:38.272 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32547.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31167.log 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.32547.log.gz/var/log/ceph/ceph.audit.log: 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31065.log 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31167.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31611.log 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr: 88.4% -- replaced with /var/log/ceph/ceph.audit.log.gz 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31167.log.gz 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31065.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31333.log 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.31065.log.gz 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31611.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32463.log 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31611.log.gz 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31333.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31164.log 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr: 86.7% -- replaced with /var/log/ceph/ceph-client.admin.31333.log.gz 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32463.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32421.log 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7%/var/log/ceph/ceph-client.admin.31164.log: -- replaced with /var/log/ceph/ceph-client.admin.32463.log.gz 2024-09-19T11:18:38.273 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31959.log 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr: 87.8% -- replaced with /var/log/ceph/ceph-client.admin.31164.log.gz 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32421.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32253.log 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32421.log.gz 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31959.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31023.log 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31959.log.gz/var/log/ceph/ceph-client.admin.32253.log: 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31443.log 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.32253.log.gz 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31023.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31673.log 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31023.log.gz 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31443.log: gzip -5 --verbose -- /var/log/ceph/ceph-mon.a.log 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31443.log.gz 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31673.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31917.log 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.31673.log.gz 2024-09-19T11:18:38.274 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-mon.a.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32633.log 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31917.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32085.log 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.31917.log.gz 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32633.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31651.log 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31335.log 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32633.log.gz 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32085.log: /var/log/ceph/ceph-client.admin.31651.log: 86.8% -- replaced with /var/log/ceph/ceph-client.admin.32085.log.gz 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32127.log 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr: 87.0% -- replaced with /var/log/ceph/ceph-client.admin.31651.log.gz 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30807.log 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31335.log: /var/log/ceph/ceph-client.admin.32127.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30863.log 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.31335.log.gz 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30807.log: 85.4% -- replaced with /var/log/ceph/ceph-client.admin.32127.log.gz 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.log 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr: 86.4% -- replaced with /var/log/ceph/ceph-client.admin.30807.log.gz 2024-09-19T11:18:38.275 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30863.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31165.log 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.30863.log.gz 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32043.log 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.log: /var/log/ceph/ceph-client.admin.31165.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29217.log 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.31165.log.gz 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32043.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31821.log 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31779.log 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.32043.log.gz 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29217.log: /var/log/ceph/ceph-client.admin.31821.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.29217.log.gz 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29176.log 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.31821.log.gz 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.31779.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32169.log 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr: 86.3% -- replaced with /var/log/ceph/ceph.log.gz 2024-09-19T11:18:38.276 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph.tmp-client.admin.27350.log 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.29176.log: 85.9% -- replaced with /var/log/ceph/ceph-client.admin.31779.log.gz 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32169.log: 84.9% -- replaced with /var/log/ceph/ceph-client.admin.29176.log.gz 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30981.log 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr: 86.9% -- replaced with /var/log/ceph/ceph-client.admin.32169.log.gz 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph.tmp-client.admin.27350.log: 0.0% -- replaced with /var/log/ceph/ceph.tmp-client.admin.27350.log.gz 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32505.log 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32001.log 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30981.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32589.log/var/log/ceph/ceph-client.admin.32505.log: 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr: 86.0% -- replaced with /var/log/ceph/ceph-client.admin.30981.log.gz 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32001.log: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32505.log.gz 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.32673.log 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr: 85.7% -- replaced with /var/log/ceph/ceph-client.admin.32001.log.gz 2024-09-19T11:18:38.277 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32589.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.29058.log 2024-09-19T11:18:38.278 INFO:teuthology.orchestra.run.smithi037.stderr:gzip 85.5% -5 -- replaced with /var/log/ceph/ceph-client.admin.32589.log.gz --verbose 2024-09-19T11:18:38.278 INFO:teuthology.orchestra.run.smithi037.stderr: -- /var/log/ceph/ceph-client.admin.32295.log 2024-09-19T11:18:38.278 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32673.log: /var/log/ceph/ceph-client.admin.29058.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.30939.log 2024-09-19T11:18:38.278 INFO:teuthology.orchestra.run.smithi037.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.32673.log.gz 2024-09-19T11:18:38.278 INFO:teuthology.orchestra.run.smithi037.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.29058.log.gz 2024-09-19T11:18:38.278 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.32295.log: 85.6% -- replaced with /var/log/ceph/ceph-client.admin.32295.log.gz 2024-09-19T11:18:38.278 INFO:teuthology.orchestra.run.smithi037.stderr:/var/log/ceph/ceph-client.admin.30939.log: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.30939.log.gz 2024-09-19T11:18:38.313 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92355.log 2024-09-19T11:18:38.313 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54270.log 2024-09-19T11:18:38.313 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.92355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.38546.log 2024-09-19T11:18:38.313 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.54270.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77865.log 2024-09-19T11:18:38.313 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.38546.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.36731.log 2024-09-19T11:18:38.313 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.92960.log/var/log/ceph/ceph-client.0.77865.log: 2024-09-19T11:18:38.313 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.54270.log.gz 2024-09-19T11:18:38.313 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92355.log.gz 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.36731.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51245.log 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.92960.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.77260.log 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.38546.log.gz 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77865.log.gz/var/log/ceph/ceph-client.0.51245.log: 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.81495.log 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.77260.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74840.log 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.92960.log.gz 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.81495.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.57295.log 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/ceph-client.0.36731.log.gz 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39756.log 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.74840.log: /var/log/ceph/ceph-client.0.57295.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.51245.log.gz 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91750.log 2024-09-19T11:18:38.314 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.77260.log.gz 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95985.log 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.39756.log: /var/log/ceph/ceph-client.0.91750.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.55480.log 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr: 90.4% -- replaced with /var/log/ceph/ceph-client.0.39756.log.gz 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.95985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.61530.log 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.74840.log.gz 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.55480.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.57295.log.gz 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.93565.log 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.81495.log.gz 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91750.log.gz 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.61530.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37941.log 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66370.log 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.93565.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.95985.log.gz 2024-09-19T11:18:38.315 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.37941.log: gzip -5 --verbose -- /var/log/ceph/ceph-osd.1.log 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.66370.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88725.log 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.55480.log.gz 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.61530.log.gz 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.1.log: gzip -5 --verbose -- /var/log/ceph/ops-log-ceph-client.0.log 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.93565.log.gz 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.88725.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47010.log 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.37941.log.gz 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ops-log-ceph-client.0.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.88120.log 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.66370.log.gz 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.47010.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62740.log 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ops-log-ceph-client.0.log.gz 2024-09-19T11:18:38.316 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.88120.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.64555.log 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.88725.log.gz 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.62740.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.62135.log 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.64555.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.41565.log 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.47010.log.gz 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.62135.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.91145.log 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.41565.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.62740.log.gz 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2%gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31134.log 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.88120.log.gz 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53665.log 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.91145.log: /var/log/ceph/ceph-client.admin.31134.log: gzip -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.0.64555.log.gz 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.0.84520.log 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr: 85.1% -- replaced with /var/log/ceph/ceph-client.admin.31134.log.gz 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.53665.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.73630.log 2024-09-19T11:18:38.317 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% 91.3% -- replaced with /var/log/ceph/ceph-client.0.41565.log.gz 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.62135.log.gz 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.84520.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80285.log 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40355.log/var/log/ceph/ceph-client.0.73630.log: 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.91145.log.gz 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.80285.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86922.log 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53665.log.gz 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.40355.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.86323.log 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.84520.log.gz 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.86922.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45195.log 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.73630.log.gz 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.86323.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63950.log 2024-09-19T11:18:38.318 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86922.log.gz 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.80285.log.gz 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.45195.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50035.log 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-client.0.40355.log.gz 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr: 90.5% -- replaced with /var/log/ceph/ceph-client.0.86323.log.gz 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.63950.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.67580.log 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.50035.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.60320.log 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.67580.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.50640.log 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.45195.log.gz 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.63950.log.gz 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.60320.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65765.log 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.51850.log 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.50640.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.50035.log.gz 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.65765.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.40960.log 2024-09-19T11:18:38.319 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.67580.log.gz 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.51850.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.71815.log 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.40960.log: gzip -5 --verbose 91.4% -- replaced with /var/log/ceph/ceph-client.0.50640.log.gz 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.60320.log.gz 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.0.89330.log 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.71815.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.65765.log.gz 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.47615.log 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.51850.log.gz 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68790.log 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.89330.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.40960.log.gz 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.47615.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94775.log 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71815.log.gz 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.68790.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.39151.log 2024-09-19T11:18:38.320 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.94775.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31094.log 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.89330.log.gz 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.39151.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.47615.log.gz 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42775.log 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48825.log 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31094.log: /var/log/ceph/ceph-client.0.42775.log: 84.8% -- replaced with /var/log/ceph/ceph-client.admin.31094.log.gz 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35857.log 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.94775.log.gz 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.48825.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59110.log 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35857.log: 86.5% -- replaced with /var/log/ceph/ceph-client.admin.35857.log.gz 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.68790.log.gz 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.72420.log 2024-09-19T11:18:38.321 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.39151.log.gz 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.42775.log.gz 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.53060.log 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.59110.log: /var/log/ceph/ceph-client.0.72420.log: gzip 91.3% -5 --verbose -- replaced with /var/log/ceph/ceph-client.0.48825.log.gz -- 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr: /var/log/ceph/ceph-client.admin.35937.log 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.53060.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82100.log 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35937.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.90540.log 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr: 85.8% -- replaced with /var/log/ceph/ceph-client.admin.35937.log.gz 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.59110.log.gz 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.82100.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.68185.log 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.90540.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.48220.log 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.53060.log.gz 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.68185.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.37336.log 2024-09-19T11:18:38.322 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.48220.log: gzip -5 --verbose 91.6% -- /var/log/ceph/ceph-client.0.56085.log 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.72420.log.gz 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.37336.log: 91.0% -- replaced with /var/log/ceph/ceph-client.0.90540.log.gz 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.59715.log 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.56085.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.89935.log 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.68185.log.gz 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr: 91.5% -- replaced with /var/log/ceph/ceph-client.0.82100.log.gz/var/log/ceph/ceph-client.0.59715.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.48220.log.gz 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.46405.log 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.78470.log 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.89935.log: 91.4% -- replaced with /var/log/ceph/ceph-client.0.37336.log.gz 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.46405.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31014.log 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.56085.log.gz 2024-09-19T11:18:38.323 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.78470.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76655.log 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31014.log: 91.0%gzip -5 --verbose -- /var/log/ceph/ceph-osd.2.log 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.59715.log.gz 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr: 85.5% -- replaced with /var/log/ceph/ceph-client.admin.31014.log.gz 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.76655.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.46405.log.gz 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.69395.log 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.89935.log.gz 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.94170.log 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.2.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.78470.log.gz 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.69395.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.42170.log 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.94170.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.76655.log.gz 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.96642.log 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.42170.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.75445.log 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.96642.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.95380.log 2024-09-19T11:18:38.324 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.75445.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.65160.log 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.94170.log.gz 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.95380.log: 91.1% -- replaced with /var/log/ceph/ceph-client.0.42170.log.gz 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.31054.log 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.65160.log: 93.3% -- replaced with /var/log/ceph/ceph-client.0.69395.log.gzgzip -5 --verbose -- /var/log/ceph/ceph-client.0.44590.log 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr: 91.7% -- replaced with /var/log/ceph/ceph-client.0.75445.log.gz 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.80890.log 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.95380.log.gz 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.31054.log: /var/log/ceph/ceph-client.0.44590.log: gzip -5 --verbose -- /var/log/ceph/ceph-mgr.x.log 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr: 84.6% -- replaced with /var/log/ceph/ceph-client.admin.31054.log.gz 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.80890.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.63345.log 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr: 93.2% -- replaced with /var/log/ceph/ceph-client.0.96642.log.gz 2024-09-19T11:18:38.325 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-mgr.x.log: gzip -5 --verbose 91.2% -- replaced with /var/log/ceph/ceph-client.0.65160.log.gz 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.0.71210.log 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.63345.log: gzip -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.0.44590.log.gz 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.0.58505.log 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.71210.log: 91.2% -- replaced with /var/log/ceph/ceph-client.0.80890.log.gz 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.52455.log 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.58505.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.70605.log 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.52455.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43380.log 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.63345.log.gz 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.71210.log.gz 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.70605.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.56690.log 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.58505.log.gz 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.43380.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.49430.log 2024-09-19T11:18:38.326 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.52455.log.gz 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.56690.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85724.log 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.49430.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.85125.log 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.43380.log.gz 91.3% -- replaced with /var/log/ceph/ceph-client.0.70605.log.gz 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.85724.log: gzip -5 --verbose 91.5% -- /var/log/ceph/ceph-client.0.57900.log 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr: -- replaced with /var/log/ceph/ceph-client.0.56690.log.gz 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.85125.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.49430.log.gz 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/rgw.ceph.client.0.log 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.85724.log.gz 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.45800.log 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.57900.log: 90.4% -- replaced with /var/log/ceph/ceph-client.0.85125.log.gz 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:gzip/var/log/ceph/rgw.ceph.client.0.log: -5 --verbose -- /var/log/ceph/ceph-client.0.70000.log 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.45800.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35777.log 2024-09-19T11:18:38.327 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.70000.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.79075.log 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.57900.log.gz/var/log/ceph/ceph-client.admin.35777.log: 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35777.log.gz 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr: 91.1% -- replaced with /var/log/ceph/ceph-client.0.45800.log.gz 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.43985.log 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.79075.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83915.log 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.43985.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35897.log 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr: 92.6% -- replaced with /var/log/ceph/ceph-client.0.70000.log.gz 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.83915.log: gzip -5 91.0% -- replaced with /var/log/ceph/ceph-client.0.79075.log.gz 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr: --verbose -- /var/log/ceph/ceph-client.0.79680.log 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35897.log: 91.3% -- replaced with /var/log/ceph/ceph-client.0.43985.log.gz 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose -- /var/log/ceph/ceph-client.0.82705.log 2024-09-19T11:18:38.328 INFO:teuthology.orchestra.run.smithi102.stderr: 86.2% -- replaced with /var/log/ceph/ceph-client.admin.35897.log.gz 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.79680.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.76050.log 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.82705.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.54875.log 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.76050.log: 91.6% -- replaced with /var/log/ceph/ceph-client.0.83915.log.gz 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose 91.0% -- replaced with /var/log/ceph/ceph-client.0.79680.log.gz 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.82705.log.gz 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.0.73025.log 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.54875.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.66975.log 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.73025.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.87521.log 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr: 91.2% -- replaced with /var/log/ceph/ceph-client.0.76050.log.gz 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.66975.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.74235.log 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.87521.log: 91.9% -- replaced with /var/log/ceph/ceph-client.0.54875.log.gz 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:gzip -5 --verbose 91.1% -- replaced with /var/log/ceph/ceph-client.0.73025.log.gz 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr: -- /var/log/ceph/ceph-client.0.60925.log 2024-09-19T11:18:38.329 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.74235.log: 90.5% -- replaced with /var/log/ceph/ceph-client.0.87521.log.gz 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr:gzip 91.8% -- replaced with /var/log/ceph/ceph-client.0.66975.log.gz 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr: -5 --verbose -- /var/log/ceph/ceph-osd.3.log 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.0.60925.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.0.83310.log 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-osd.3.log: gzip -5 --verbose -- /var/log/ceph/ceph-client.admin.35817.log 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr: 91.4% -- replaced with /var/log/ceph/ceph-client.0.74235.log.gz/var/log/ceph/ceph-client.0.83310.log: 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr: 91.0% -- replaced with /var/log/ceph/ceph-client.0.60925.log.gz 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr:/var/log/ceph/ceph-client.admin.35817.log: 86.1% -- replaced with /var/log/ceph/ceph-client.admin.35817.log.gz 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr: 91.3% -- replaced with /var/log/ceph/ceph-client.0.83310.log.gz 2024-09-19T11:18:38.330 INFO:teuthology.orchestra.run.smithi102.stderr: 91.8% -- replaced with /var/log/ceph/ceph-mgr.x.log.gz 2024-09-19T11:18:38.332 INFO:teuthology.orchestra.run.smithi102.stderr: 92.0% -- replaced with /var/log/ceph/rgw.ceph.client.0.log.gz 2024-09-19T11:18:38.429 INFO:teuthology.orchestra.run.smithi037.stderr: 91.5% -- replaced with /var/log/ceph/ceph-mon.a.log.gz 2024-09-19T11:18:39.160 INFO:teuthology.orchestra.run.smithi102.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.2.log.gz 2024-09-19T11:18:39.242 INFO:teuthology.orchestra.run.smithi102.stderr: 94.0% -- replaced with /var/log/ceph/ceph-osd.1.log.gz 2024-09-19T11:18:39.298 INFO:teuthology.orchestra.run.smithi102.stderr: 94.1% -- replaced with /var/log/ceph/ceph-osd.3.log.gz 2024-09-19T11:18:39.300 INFO:teuthology.orchestra.run.smithi102.stderr: 2024-09-19T11:18:39.300 INFO:teuthology.orchestra.run.smithi102.stderr:real 0m1.071s 2024-09-19T11:18:39.300 INFO:teuthology.orchestra.run.smithi102.stderr:user 0m3.036s 2024-09-19T11:18:39.300 INFO:teuthology.orchestra.run.smithi102.stderr:sys 0m0.216s 2024-09-19T11:18:39.304 INFO:teuthology.orchestra.run.smithi037.stderr: 93.9% -- replaced with /var/log/ceph/ceph-osd.0.log.gz 2024-09-19T11:18:39.306 INFO:teuthology.orchestra.run.smithi037.stderr: 2024-09-19T11:18:39.307 INFO:teuthology.orchestra.run.smithi037.stderr:real 0m1.081s 2024-09-19T11:18:39.307 INFO:teuthology.orchestra.run.smithi037.stderr:user 0m1.251s 2024-09-19T11:18:39.307 INFO:teuthology.orchestra.run.smithi037.stderr:sys 0m0.073s 2024-09-19T11:18:39.307 INFO:tasks.ceph:Archiving logs... 2024-09-19T11:18:39.307 DEBUG:teuthology.misc:Transferring archived files from smithi037:/var/log/ceph to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417/remote/smithi037/log 2024-09-19T11:18:39.308 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T11:18:39.598 DEBUG:teuthology.misc:Transferring archived files from smithi102:/var/log/ceph to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417/remote/smithi102/log 2024-09-19T11:18:39.599 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /var/log/ceph -- . 2024-09-19T11:18:40.139 DEBUG:teuthology.run_tasks:Unwinding manager install 2024-09-19T11:18:40.148 INFO:teuthology.task.install.util:Removing shipped files: /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer... 2024-09-19T11:18:40.149 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T11:18:40.151 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /home/ubuntu/cephtest/valgrind.supp /usr/bin/daemon-helper /usr/bin/adjust-ulimits /usr/bin/stdin-killer 2024-09-19T11:18:40.246 DEBUG:teuthology.run_tasks:Unwinding manager clock 2024-09-19T11:18:40.255 INFO:teuthology.task.clock:Checking final clock skew... 2024-09-19T11:18:40.255 DEBUG:teuthology.orchestra.run.smithi037:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T11:18:40.258 DEBUG:teuthology.orchestra.run.smithi102:> PATH=/usr/bin:/usr/sbin ntpq -p || PATH=/usr/bin:/usr/sbin chronyc sources || true 2024-09-19T11:18:40.272 INFO:teuthology.orchestra.run.smithi102.stderr:bash: line 1: ntpq: command not found 2024-09-19T11:18:40.272 INFO:teuthology.orchestra.run.smithi037.stderr:bash: line 1: ntpq: command not found 2024-09-19T11:18:40.276 INFO:teuthology.orchestra.run.smithi102.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T11:18:40.276 INFO:teuthology.orchestra.run.smithi102.stdout:=============================================================================== 2024-09-19T11:18:40.276 INFO:teuthology.orchestra.run.smithi102.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +251us[ +263us] +/- 55ms 2024-09-19T11:18:40.276 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 36 +250us[ +262us] +/- 70ms 2024-09-19T11:18:40.276 INFO:teuthology.orchestra.run.smithi102.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -580us[ -568us] +/- 78ms 2024-09-19T11:18:40.276 INFO:teuthology.orchestra.run.smithi102.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:18:40.277 INFO:teuthology.orchestra.run.smithi037.stdout:MS Name/IP address Stratum Poll Reach LastRx Last sample 2024-09-19T11:18:40.277 INFO:teuthology.orchestra.run.smithi037.stdout:=============================================================================== 2024-09-19T11:18:40.278 INFO:teuthology.orchestra.run.smithi037.stdout:^* hv01.front.sepia.ceph.com 3 6 377 36 +249us[ +284us] +/- 55ms 2024-09-19T11:18:40.278 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv02.front.sepia.ceph.com 3 6 377 37 +237us[ +271us] +/- 70ms 2024-09-19T11:18:40.278 INFO:teuthology.orchestra.run.smithi037.stdout:^+ hv03.front.sepia.ceph.com 3 6 377 36 -577us[ -542us] +/- 78ms 2024-09-19T11:18:40.278 INFO:teuthology.orchestra.run.smithi037.stdout:^? hv04.front.sepia.ceph.com 0 8 0 - +0ns[ +0ns] +/- 0ns 2024-09-19T11:18:40.279 DEBUG:teuthology.run_tasks:Unwinding manager ansible.cephlab 2024-09-19T11:18:40.287 INFO:teuthology.task.ansible:Skipping ansible cleanup... 2024-09-19T11:18:40.288 DEBUG:teuthology.run_tasks:Unwinding manager selinux 2024-09-19T11:18:40.296 DEBUG:teuthology.orchestra.run.smithi037:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T11:18:40.389 DEBUG:teuthology.orchestra.run.smithi102:> mkdir /home/ubuntu/cephtest/archive/audit && sudo cp /var/log/audit/audit.log /home/ubuntu/cephtest/archive/audit && sudo chown $USER /home/ubuntu/cephtest/archive/audit/audit.log && gzip /home/ubuntu/cephtest/archive/audit/audit.log 2024-09-19T11:18:40.449 DEBUG:teuthology.orchestra.run.smithi037:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-19T11:18:40.480 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:18:40.481 DEBUG:teuthology.orchestra.run.smithi102:> sudo grep -a 'avc: .*denied' /var/log/audit/audit.log | grep -av -e 'comm="dmidecode"' -e chronyd.service -e 'name="cephtest"' -e scontext=system_u:system_r:nrpe_t:s0 -e scontext=system_u:system_r:pcp_pmlogger_t -e scontext=system_u:system_r:pcp_pmcd_t:s0 -e 'comm="rhsmd"' -e scontext=system_u:system_r:syslogd_t:s0 -e tcontext=system_u:system_r:nrpe_t:s0 -e 'comm="updatedb"' -e 'comm="smartd"' -e 'comm="rhsmcertd-worke"' -e 'comm="setroubleshootd"' -e 'comm="rpm"' -e tcontext=system_u:object_r:container_runtime_exec_t:s0 -e 'comm="ksmtuned"' -e 'comm="sssd"' -e 'comm="sss_cache"' -e context=system_u:system_r:NetworkManager_dispatcher_t:s0 -e context=system_u:system_r:getty_t:s0 2024-09-19T11:18:40.508 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:18:40.509 DEBUG:teuthology.run_tasks:Unwinding manager pcp 2024-09-19T11:18:40.523 DEBUG:teuthology.run_tasks:Unwinding manager internal.timer 2024-09-19T11:18:40.531 INFO:teuthology.task.internal:Duration was 725.551120 seconds 2024-09-19T11:18:40.532 DEBUG:teuthology.run_tasks:Unwinding manager internal.syslog 2024-09-19T11:18:40.540 INFO:teuthology.task.internal.syslog:Shutting down syslog monitoring... 2024-09-19T11:18:40.540 DEBUG:teuthology.orchestra.run.smithi037:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T11:18:40.543 DEBUG:teuthology.orchestra.run.smithi102:> sudo rm -f -- /etc/rsyslog.d/80-cephtest.conf && sudo service rsyslog restart 2024-09-19T11:18:40.584 INFO:teuthology.orchestra.run.smithi037.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T11:18:40.587 INFO:teuthology.orchestra.run.smithi102.stderr:Redirecting to /bin/systemctl restart rsyslog.service 2024-09-19T11:18:40.866 INFO:teuthology.task.internal.syslog:Checking logs for errors... 2024-09-19T11:18:40.866 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi037.front.sepia.ceph.com 2024-09-19T11:18:40.866 DEBUG:teuthology.orchestra.run.smithi037:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T11:18:40.929 DEBUG:teuthology.task.internal.syslog:Checking ubuntu@smithi102.front.sepia.ceph.com 2024-09-19T11:18:40.929 DEBUG:teuthology.orchestra.run.smithi102:> egrep --binary-files=text '\bBUG\b|\bINFO\b|\bDEADLOCK\b' /home/ubuntu/cephtest/archive/syslog/kern.log | grep -v 'task .* blocked for more than .* seconds' | grep -v 'lockdep is turned off' | grep -v 'trying to register non-static key' | grep -v 'DEBUG: fsize' | grep -v CRON | grep -v 'BUG: bad unlock balance detected' | grep -v 'inconsistent lock state' | grep -v '*** DEADLOCK ***' | grep -v 'INFO: possible irq lock inversion dependency detected' | grep -v 'INFO: NMI handler (perf_event_nmi_handler) took too long to run' | grep -v 'INFO: recovery required on readonly' | grep -v 'ceph-create-keys: INFO' | grep -v INFO:ceph-create-keys | grep -v 'Loaded datasource DataSourceOpenStack' | grep -v 'container-storage-setup: INFO: Volume group backing root filesystem could not be determined' | egrep -v '\bsalt-master\b|\bsalt-minion\b|\bsalt-api\b' | grep -v ceph-crash | egrep -v '\btcmu-runner\b.*\bINFO\b' | head -n 1 2024-09-19T11:18:40.953 INFO:teuthology.task.internal.syslog:Compressing syslogs... 2024-09-19T11:18:40.954 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T11:18:40.971 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest/archive/syslog -name '*.log' -print0 | sudo xargs -0 --no-run-if-empty -- gzip -- 2024-09-19T11:18:41.020 INFO:teuthology.task.internal.syslog:Gathering journactl -b0... 2024-09-19T11:18:41.020 DEBUG:teuthology.orchestra.run.smithi037:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T11:18:41.041 DEBUG:teuthology.orchestra.run.smithi102:> sudo journalctl -b0 | gzip -9 > /home/ubuntu/cephtest/archive/syslog/journalctl-b0.gz 2024-09-19T11:18:41.157 DEBUG:teuthology.run_tasks:Unwinding manager internal.sudo 2024-09-19T11:18:41.168 INFO:teuthology.task.internal:Restoring /etc/sudoers... 2024-09-19T11:18:41.168 DEBUG:teuthology.orchestra.run.smithi037:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T11:18:41.194 DEBUG:teuthology.orchestra.run.smithi102:> sudo mv -f /etc/sudoers.orig.teuthology /etc/sudoers 2024-09-19T11:18:41.219 DEBUG:teuthology.run_tasks:Unwinding manager internal.coredump 2024-09-19T11:18:41.228 DEBUG:teuthology.orchestra.run.smithi037:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T11:18:41.236 DEBUG:teuthology.orchestra.run.smithi102:> sudo sysctl -w kernel.core_pattern=core && sudo bash -c 'for f in `find /home/ubuntu/cephtest/archive/coredump -type f`; do file $f | grep -q systemd-sysusers && rm $f || true ; done' && rmdir --ignore-fail-on-non-empty -- /home/ubuntu/cephtest/archive/coredump 2024-09-19T11:18:41.258 INFO:teuthology.orchestra.run.smithi037.stdout:kernel.core_pattern = core 2024-09-19T11:18:41.282 INFO:teuthology.orchestra.run.smithi102.stdout:kernel.core_pattern = core 2024-09-19T11:18:41.305 DEBUG:teuthology.orchestra.run.smithi037:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T11:18:41.336 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:18:41.337 DEBUG:teuthology.orchestra.run.smithi102:> test -e /home/ubuntu/cephtest/archive/coredump 2024-09-19T11:18:41.359 DEBUG:teuthology.orchestra.run:got remote process result: 1 2024-09-19T11:18:41.359 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive 2024-09-19T11:18:41.369 INFO:teuthology.task.internal:Transferring archived files... 2024-09-19T11:18:41.370 DEBUG:teuthology.misc:Transferring archived files from smithi037:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417/remote/smithi037 2024-09-19T11:18:41.370 DEBUG:teuthology.orchestra.run.smithi037:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T11:18:41.412 DEBUG:teuthology.misc:Transferring archived files from smithi102:/home/ubuntu/cephtest/archive to /home/teuthworker/archive/yuvalif-2024-09-19_08:49:34-rgw-wip-yuval-test-distro-default-smithi/7912417/remote/smithi102 2024-09-19T11:18:41.413 DEBUG:teuthology.orchestra.run.smithi102:> sudo tar c -f - -C /home/ubuntu/cephtest/archive -- . 2024-09-19T11:18:41.453 INFO:teuthology.task.internal:Removing archive directory... 2024-09-19T11:18:41.453 DEBUG:teuthology.orchestra.run.smithi037:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T11:18:41.456 DEBUG:teuthology.orchestra.run.smithi102:> rm -rf -- /home/ubuntu/cephtest/archive 2024-09-19T11:18:41.496 DEBUG:teuthology.run_tasks:Unwinding manager internal.archive_upload 2024-09-19T11:18:41.508 INFO:teuthology.task.internal:Not uploading archives. 2024-09-19T11:18:41.508 DEBUG:teuthology.run_tasks:Unwinding manager internal.base 2024-09-19T11:18:41.516 INFO:teuthology.task.internal:Tidying up after the test... 2024-09-19T11:18:41.517 DEBUG:teuthology.orchestra.run.smithi037:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T11:18:41.519 DEBUG:teuthology.orchestra.run.smithi102:> find /home/ubuntu/cephtest -ls ; rmdir -- /home/ubuntu/cephtest 2024-09-19T11:18:41.532 INFO:teuthology.orchestra.run.smithi037.stdout: 265324 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 11:18 /home/ubuntu/cephtest 2024-09-19T11:18:41.551 INFO:teuthology.orchestra.run.smithi102.stdout: 266063 4 drwxr-xr-x 2 ubuntu ubuntu 4096 Sep 19 11:18 /home/ubuntu/cephtest 2024-09-19T11:18:41.553 DEBUG:teuthology.run_tasks:Unwinding manager kernel 2024-09-19T11:18:41.564 DEBUG:teuthology.run_tasks:Unwinding manager console_log 2024-09-19T11:18:41.593 INFO:teuthology.run:Summary data: description: rgw/singleton/{all/radosgw-admin frontend/beast ignore-pg-availability objectstore/bluestore-bitmap overrides rgw_pool_type/ec-profile supported-random-distro$/{centos_latest}} duration: 725.5511200428009 flavor: default owner: scheduled_yuvalif@teuthology success: true 2024-09-19T11:18:41.593 DEBUG:teuthology.report:Pushing job info to https://paddles.front.sepia.ceph.com/ 2024-09-19T11:18:41.682 INFO:teuthology.run:pass